-- Logs begin at Tue 2022-09-13 19:05:47 UTC, end at Tue 2022-09-13 20:17:20 UTC. -- Sep 13 19:40:13.153610 dv-cinder-828806-6-smb systemd[1]: Starting Devstack devstack@keystone.service... Sep 13 19:40:13.161085 dv-cinder-828806-6-smb devstack@keystone.service[82016]: [uWSGI] getting INI configuration from /etc/keystone/keystone-uwsgi-public.ini Sep 13 19:40:13.163207 dv-cinder-828806-6-smb devstack@keystone.service[82016]: *** Starting uWSGI 2.0.18-debian (64bit) on [Tue Sep 13 19:40:13 2022] *** Sep 13 19:40:13.163207 dv-cinder-828806-6-smb devstack@keystone.service[82016]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Sep 13 19:40:13.163207 dv-cinder-828806-6-smb devstack@keystone.service[82016]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Sep 13 19:40:13.163207 dv-cinder-828806-6-smb devstack@keystone.service[82016]: nodename: dv-cinder-828806-6-smb Sep 13 19:40:13.163207 dv-cinder-828806-6-smb devstack@keystone.service[82016]: machine: x86_64 Sep 13 19:40:13.163207 dv-cinder-828806-6-smb devstack@keystone.service[82016]: clock source: unix Sep 13 19:40:13.163207 dv-cinder-828806-6-smb devstack@keystone.service[82016]: pcre jit disabled Sep 13 19:40:13.163207 dv-cinder-828806-6-smb devstack@keystone.service[82016]: detected number of CPU cores: 4 Sep 13 19:40:13.163207 dv-cinder-828806-6-smb devstack@keystone.service[82016]: current working directory: / Sep 13 19:40:13.163707 dv-cinder-828806-6-smb devstack@keystone.service[82016]: detected binary path: /usr/bin/uwsgi-core Sep 13 19:40:13.163707 dv-cinder-828806-6-smb devstack@keystone.service[82016]: your processes number limit is 47680 Sep 13 19:40:13.163707 dv-cinder-828806-6-smb devstack@keystone.service[82016]: your memory page size is 4096 bytes Sep 13 19:40:13.163707 dv-cinder-828806-6-smb devstack@keystone.service[82016]: detected max file descriptor number: 2048 Sep 13 19:40:13.163707 dv-cinder-828806-6-smb devstack@keystone.service[82016]: lock engine: pthread robust mutexes Sep 13 19:40:13.163707 dv-cinder-828806-6-smb devstack@keystone.service[82016]: thunder lock: enabled Sep 13 19:40:13.163707 dv-cinder-828806-6-smb devstack@keystone.service[82016]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/keystone-wsgi-public.socket fd 4 Sep 13 19:40:13.163707 dv-cinder-828806-6-smb devstack@keystone.service[82016]: Python version: 3.8.10 (default, Jun 22 2022, 20:18:18) [GCC 9.4.0] Sep 13 19:40:13.211064 dv-cinder-828806-6-smb devstack@keystone.service[82016]: Python main interpreter initialized at 0x564c962439c0 Sep 13 19:40:13.211064 dv-cinder-828806-6-smb devstack@keystone.service[82016]: python threads support enabled Sep 13 19:40:13.211064 dv-cinder-828806-6-smb devstack@keystone.service[82016]: your server socket listen backlog is limited to 100 connections Sep 13 19:40:13.211064 dv-cinder-828806-6-smb devstack@keystone.service[82016]: your mercy for graceful operations on workers is 90 seconds Sep 13 19:40:13.211460 dv-cinder-828806-6-smb devstack@keystone.service[82016]: mapped 403077 bytes (393 KB) for 2 cores Sep 13 19:40:13.211536 dv-cinder-828806-6-smb devstack@keystone.service[82016]: *** Operational MODE: preforking *** Sep 13 19:40:13.211816 dv-cinder-828806-6-smb devstack@keystone.service[82016]: *** uWSGI is running in multiple interpreter mode *** Sep 13 19:40:13.211816 dv-cinder-828806-6-smb devstack@keystone.service[82016]: spawned uWSGI master process (pid: 82016) Sep 13 19:40:13.212032 dv-cinder-828806-6-smb systemd[1]: Started Devstack devstack@keystone.service. Sep 13 19:40:13.213414 dv-cinder-828806-6-smb devstack@keystone.service[82016]: spawned uWSGI worker 1 (pid: 82025, cores: 1) Sep 13 19:40:13.213414 dv-cinder-828806-6-smb devstack@keystone.service[82016]: spawned uWSGI worker 2 (pid: 82026, cores: 1) Sep 13 19:40:13.213414 dv-cinder-828806-6-smb devstack@keystone.service[82016]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Sep 13 19:40:17.612308 dv-cinder-828806-6-smb devstack@keystone.service[82026]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Sep 13 19:40:17.612308 dv-cinder-828806-6-smb devstack@keystone.service[82026]: from cryptography.utils import int_from_bytes Sep 13 19:40:17.613074 dv-cinder-828806-6-smb devstack@keystone.service[82026]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Sep 13 19:40:17.613074 dv-cinder-828806-6-smb devstack@keystone.service[82026]: from cryptography.utils import int_from_bytes Sep 13 19:40:17.614270 dv-cinder-828806-6-smb devstack@keystone.service[82025]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Sep 13 19:40:17.614270 dv-cinder-828806-6-smb devstack@keystone.service[82025]: from cryptography.utils import int_from_bytes Sep 13 19:40:17.614716 dv-cinder-828806-6-smb devstack@keystone.service[82025]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Sep 13 19:40:17.614716 dv-cinder-828806-6-smb devstack@keystone.service[82025]: from cryptography.utils import int_from_bytes Sep 13 19:40:17.664966 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=82025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Sep 13 19:40:17.665162 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG uwsgi [-] Configuration options gathered from: {{(pid=82025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Sep 13 19:40:17.665357 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG uwsgi [-] command line args: [] {{(pid=82025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Sep 13 19:40:17.665455 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=82026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Sep 13 19:40:17.665573 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG uwsgi [-] Configuration options gathered from: {{(pid=82026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Sep 13 19:40:17.665655 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG uwsgi [-] config files: ['/etc/keystone/keystone.conf'] {{(pid=82025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Sep 13 19:40:17.665772 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG uwsgi [-] command line args: [] {{(pid=82026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Sep 13 19:40:17.665860 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG uwsgi [-] ================================================================================ {{(pid=82025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Sep 13 19:40:17.666033 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG uwsgi [-] admin_token = **** {{(pid=82025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 19:40:17.666121 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG uwsgi [-] config files: ['/etc/keystone/keystone.conf'] {{(pid=82026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Sep 13 19:40:17.666229 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG uwsgi [-] ================================================================================ {{(pid=82026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Sep 13 19:40:17.666316 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG uwsgi [-] config_dir = [] {{(pid=82025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 19:40:17.666456 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG uwsgi [-] config_file = ['/etc/keystone/keystone.conf'] {{(pid=82025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 19:40:17.666540 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG uwsgi [-] admin_token = **** {{(pid=82026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 19:40:17.666639 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG uwsgi [-] config_source = [] {{(pid=82025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 19:40:17.666728 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG uwsgi [-] config_dir = [] {{(pid=82026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 19:40:17.666802 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG uwsgi [-] debug = True {{(pid=82025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 19:40:17.666909 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG uwsgi [-] config_file = ['/etc/keystone/keystone.conf'] {{(pid=82026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 19:40:17.666989 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG uwsgi [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'dogpile=INFO', 'routes=INFO'] {{(pid=82025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 19:40:17.667290 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG uwsgi [-] config_source = [] {{(pid=82026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 19:40:17.667290 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG uwsgi [-] debug = True {{(pid=82026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 19:40:17.667409 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG uwsgi [-] default_publisher_id = None {{(pid=82025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 19:40:17.667545 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG uwsgi [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'dogpile=INFO', 'routes=INFO'] {{(pid=82026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 19:40:17.667674 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG uwsgi [-] insecure_debug = False {{(pid=82025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 19:40:17.667784 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG uwsgi [-] default_publisher_id = None {{(pid=82026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 19:40:17.667883 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG uwsgi [-] instance_format = [instance: %(uuid)s] {{(pid=82025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 19:40:17.667978 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG uwsgi [-] insecure_debug = False {{(pid=82026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 19:40:17.668078 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG uwsgi [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=82025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 19:40:17.668182 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG uwsgi [-] instance_format = [instance: %(uuid)s] {{(pid=82026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 19:40:17.668289 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG uwsgi [-] list_limit = None {{(pid=82025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 19:40:17.668396 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG uwsgi [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=82026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 19:40:17.668500 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG uwsgi [-] log_config_append = None {{(pid=82025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 19:40:17.669093 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG uwsgi [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=82025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 19:40:17.669277 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG uwsgi [-] log_dir = None {{(pid=82025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 19:40:17.669457 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG uwsgi [-] log_file = None {{(pid=82025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 19:40:17.669663 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG uwsgi [-] list_limit = None {{(pid=82026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 19:40:17.669820 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG uwsgi [-] log_rotate_interval = 1 {{(pid=82025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 19:40:17.669910 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG uwsgi [-] log_config_append = None {{(pid=82026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 19:40:17.669990 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG uwsgi [-] log_rotate_interval_type = days {{(pid=82025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 19:40:17.670108 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG uwsgi [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=82026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 19:40:17.670225 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG uwsgi [-] log_rotation_type = none {{(pid=82025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 19:40:17.670345 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG uwsgi [-] log_dir = None {{(pid=82026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 19:40:17.670466 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG uwsgi [-] log_file = None {{(pid=82026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 19:40:17.670591 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG uwsgi [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=82025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 19:40:17.670591 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG uwsgi [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=82025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 19:40:17.670820 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG uwsgi [-] log_rotate_interval = 1 {{(pid=82026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 19:40:17.670941 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG uwsgi [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=82025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 19:40:17.671094 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG uwsgi [-] log_rotate_interval_type = days {{(pid=82026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 19:40:17.671221 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG uwsgi [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=82025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 19:40:17.671339 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG uwsgi [-] log_rotation_type = none {{(pid=82026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 19:40:17.671452 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG uwsgi [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=82025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 19:40:17.671604 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG uwsgi [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=82026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 19:40:17.671724 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG uwsgi [-] max_logfile_count = 30 {{(pid=82025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 19:40:17.671844 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG uwsgi [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=82026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 19:40:17.671978 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG uwsgi [-] max_logfile_size_mb = 200 {{(pid=82025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 19:40:17.672100 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG uwsgi [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=82026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 19:40:17.672222 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG uwsgi [-] max_param_size = 64 {{(pid=82025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 19:40:17.672344 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG uwsgi [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=82026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 19:40:17.672459 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG uwsgi [-] max_project_tree_depth = 5 {{(pid=82025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 19:40:17.672580 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG uwsgi [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=82026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 19:40:17.672703 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG uwsgi [-] max_token_size = 16384 {{(pid=82025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 19:40:17.672825 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG uwsgi [-] max_logfile_count = 30 {{(pid=82026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 19:40:17.672936 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG uwsgi [-] notification_format = cadf {{(pid=82025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 19:40:17.673055 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG uwsgi [-] max_logfile_size_mb = 200 {{(pid=82026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 19:40:17.673176 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG uwsgi [-] notification_opt_out = ['identity.authenticate.success', 'identity.authenticate.pending', 'identity.authenticate.failed'] {{(pid=82025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 19:40:17.673300 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG uwsgi [-] max_param_size = 64 {{(pid=82026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 19:40:17.673300 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG uwsgi [-] max_project_tree_depth = 5 {{(pid=82026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 19:40:17.673529 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG uwsgi [-] public_endpoint = http://10.222.0.33/identity {{(pid=82025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 19:40:17.673645 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG uwsgi [-] max_token_size = 16384 {{(pid=82026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 19:40:17.673766 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG uwsgi [-] publish_errors = False {{(pid=82025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 19:40:17.673888 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG uwsgi [-] notification_format = cadf {{(pid=82026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 19:40:17.674002 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG uwsgi [-] pydev_debug_host = None {{(pid=82025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 19:40:17.674116 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG uwsgi [-] notification_opt_out = ['identity.authenticate.success', 'identity.authenticate.pending', 'identity.authenticate.failed'] {{(pid=82026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 19:40:17.674231 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG uwsgi [-] pydev_debug_port = None {{(pid=82025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 19:40:17.674231 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG uwsgi [-] rate_limit_burst = 0 {{(pid=82025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 19:40:17.674452 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG uwsgi [-] rate_limit_except_level = CRITICAL {{(pid=82025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 19:40:17.674572 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG uwsgi [-] public_endpoint = http://10.222.0.33/identity {{(pid=82026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 19:40:17.674572 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG uwsgi [-] publish_errors = False {{(pid=82026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 19:40:17.674792 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG uwsgi [-] rate_limit_interval = 0 {{(pid=82025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 19:40:17.674970 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG uwsgi [-] pydev_debug_host = None {{(pid=82026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 19:40:17.675116 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG uwsgi [-] standard_threads = False {{(pid=82025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 19:40:17.675342 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG uwsgi [-] pydev_debug_port = None {{(pid=82026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 19:40:17.675462 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG uwsgi [-] strict_password_check = False {{(pid=82025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 19:40:17.675588 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG uwsgi [-] rate_limit_burst = 0 {{(pid=82026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 19:40:17.675704 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG uwsgi [-] syslog_log_facility = LOG_USER {{(pid=82025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 19:40:17.675819 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG uwsgi [-] rate_limit_except_level = CRITICAL {{(pid=82026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 19:40:17.675933 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG uwsgi [-] use_eventlog = False {{(pid=82025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 19:40:17.675933 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG uwsgi [-] use_journal = False {{(pid=82025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 19:40:17.676152 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG uwsgi [-] rate_limit_interval = 0 {{(pid=82026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 19:40:17.676275 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG uwsgi [-] use_json = False {{(pid=82025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 19:40:17.676397 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG uwsgi [-] standard_threads = False {{(pid=82026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 19:40:17.676514 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG uwsgi [-] use_stderr = False {{(pid=82025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 19:40:17.676514 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG uwsgi [-] use_syslog = False {{(pid=82025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 19:40:17.676732 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG uwsgi [-] strict_password_check = False {{(pid=82026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 19:40:17.676848 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG uwsgi [-] watch_log_file = False {{(pid=82025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 19:40:17.676973 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG uwsgi [-] syslog_log_facility = LOG_USER {{(pid=82026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 19:40:17.676973 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG uwsgi [-] use_eventlog = False {{(pid=82026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 19:40:17.677208 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG uwsgi [-] oslo_concurrency.disable_process_locking = False {{(pid=82025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:40:17.677363 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG uwsgi [-] use_journal = False {{(pid=82026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 19:40:17.677480 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG uwsgi [-] oslo_concurrency.lock_path = None {{(pid=82025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:40:17.677596 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG uwsgi [-] use_json = False {{(pid=82026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 19:40:17.677596 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG uwsgi [-] use_stderr = False {{(pid=82026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 19:40:17.677827 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG uwsgi [-] profiler.connection_string = messaging:// {{(pid=82025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:40:17.677942 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG uwsgi [-] use_syslog = False {{(pid=82026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 19:40:17.678056 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG uwsgi [-] profiler.enabled = False {{(pid=82025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:40:17.678176 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG uwsgi [-] watch_log_file = False {{(pid=82026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 19:40:17.678291 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG uwsgi [-] profiler.es_doc_type = notification {{(pid=82025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:40:17.678482 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG uwsgi [-] oslo_concurrency.disable_process_locking = False {{(pid=82026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:40:17.678601 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG uwsgi [-] profiler.es_scroll_size = 10000 {{(pid=82025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:40:17.678722 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG uwsgi [-] oslo_concurrency.lock_path = None {{(pid=82026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:40:17.678842 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG uwsgi [-] profiler.es_scroll_time = 2m {{(pid=82025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:40:17.678958 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG uwsgi [-] profiler.connection_string = messaging:// {{(pid=82026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:40:17.679097 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG uwsgi [-] profiler.filter_error_trace = False {{(pid=82025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:40:17.679227 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG uwsgi [-] profiler.enabled = False {{(pid=82026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:40:17.679349 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG uwsgi [-] profiler.hmac_keys = SECRET_KEY {{(pid=82025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:40:17.679471 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG uwsgi [-] profiler.es_doc_type = notification {{(pid=82026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:40:17.679586 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG uwsgi [-] profiler.sentinel_service_name = mymaster {{(pid=82025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:40:17.679707 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG uwsgi [-] profiler.es_scroll_size = 10000 {{(pid=82026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:40:17.679822 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG uwsgi [-] profiler.socket_timeout = 0.1 {{(pid=82025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:40:17.679944 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG uwsgi [-] profiler.es_scroll_time = 2m {{(pid=82026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:40:17.680059 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG uwsgi [-] profiler.trace_sqlalchemy = False {{(pid=82025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:40:17.680173 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG uwsgi [-] profiler.filter_error_trace = False {{(pid=82026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:40:17.680287 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=82025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:40:17.680407 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG uwsgi [-] profiler.hmac_keys = SECRET_KEY {{(pid=82026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:40:17.680522 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=82025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:40:17.680647 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG uwsgi [-] profiler.sentinel_service_name = mymaster {{(pid=82026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:40:17.680764 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_process_name = {{(pid=82025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:40:17.680884 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG uwsgi [-] profiler.socket_timeout = 0.1 {{(pid=82026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:40:17.681004 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=82025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:40:17.681125 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG uwsgi [-] profiler.trace_sqlalchemy = False {{(pid=82026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:40:17.681239 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=82025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:40:17.681361 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=82026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:40:17.681483 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG uwsgi [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=82025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:40:17.681604 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=82026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:40:17.681724 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG uwsgi [-] audit.namespace = openstack {{(pid=82025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:40:17.681840 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_process_name = {{(pid=82026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:40:17.681954 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG uwsgi [-] oslo_policy.enforce_new_defaults = False {{(pid=82025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:40:17.682078 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=82026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:40:17.682200 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG uwsgi [-] oslo_policy.enforce_scope = False {{(pid=82025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:40:17.682316 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=82026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:40:17.682430 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG uwsgi [-] oslo_policy.policy_default_rule = default {{(pid=82025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:40:17.682543 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG uwsgi [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=82026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:40:17.682663 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG uwsgi [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=82025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:40:17.682795 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG uwsgi [-] audit.namespace = openstack {{(pid=82026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:40:17.682917 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG uwsgi [-] oslo_policy.policy_file = policy.yaml {{(pid=82025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:40:17.683048 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG uwsgi [-] oslo_policy.enforce_new_defaults = False {{(pid=82026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:40:17.683166 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG uwsgi [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=82025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:40:17.683280 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG uwsgi [-] oslo_policy.enforce_scope = False {{(pid=82026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:40:17.683394 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG uwsgi [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=82025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:40:17.683522 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG uwsgi [-] oslo_policy.policy_default_rule = default {{(pid=82026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:40:17.683646 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=82025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:40:17.683767 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG uwsgi [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=82026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:40:17.683884 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=82025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:40:17.683998 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG uwsgi [-] oslo_policy.policy_file = policy.yaml {{(pid=82026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:40:17.684113 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG uwsgi [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=82025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:40:17.684834 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG uwsgi [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=82026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:40:17.684989 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG uwsgi [-] keystone_authtoken.admin_password = **** {{(pid=82025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:40:17.685145 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG uwsgi [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=82026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:40:17.685263 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG uwsgi [-] keystone_authtoken.admin_tenant_name = admin {{(pid=82025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:40:17.685375 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=82026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:40:17.685498 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG uwsgi [-] keystone_authtoken.admin_token = **** {{(pid=82025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:40:17.685614 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=82026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:40:17.685734 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG uwsgi [-] keystone_authtoken.admin_user = None {{(pid=82025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:40:17.685734 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG uwsgi [-] keystone_authtoken.auth_admin_prefix = {{(pid=82025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:40:17.685957 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG uwsgi [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=82026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:40:17.686078 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG uwsgi [-] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=82025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:40:17.686078 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG uwsgi [-] keystone_authtoken.auth_port = 35357 {{(pid=82025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:40:17.686078 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG uwsgi [-] keystone_authtoken.auth_protocol = https {{(pid=82025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:40:17.686402 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG uwsgi [-] keystone_authtoken.admin_password = **** {{(pid=82026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:40:17.686517 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG uwsgi [-] keystone_authtoken.auth_section = None {{(pid=82025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:40:17.686631 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG uwsgi [-] keystone_authtoken.admin_tenant_name = admin {{(pid=82026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:40:17.686745 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG uwsgi [-] keystone_authtoken.auth_type = None {{(pid=82025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:40:17.686867 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG uwsgi [-] keystone_authtoken.admin_token = **** {{(pid=82026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:40:17.686984 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG uwsgi [-] keystone_authtoken.auth_uri = None {{(pid=82025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:40:17.687131 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG uwsgi [-] keystone_authtoken.admin_user = None {{(pid=82026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:40:17.687258 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG uwsgi [-] keystone_authtoken.auth_version = None {{(pid=82025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:40:17.687380 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG uwsgi [-] keystone_authtoken.auth_admin_prefix = {{(pid=82026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:40:17.687501 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG uwsgi [-] keystone_authtoken.cache = None {{(pid=82025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:40:17.687630 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG uwsgi [-] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=82026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:40:17.687748 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG uwsgi [-] keystone_authtoken.cafile = None {{(pid=82025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:40:17.687868 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG uwsgi [-] keystone_authtoken.auth_port = 35357 {{(pid=82026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:40:17.687974 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG uwsgi [-] keystone_authtoken.certfile = None {{(pid=82025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:40:17.688071 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG uwsgi [-] keystone_authtoken.auth_protocol = https {{(pid=82026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:40:17.688165 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG uwsgi [-] keystone_authtoken.delay_auth_decision = False {{(pid=82025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:40:17.688268 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG uwsgi [-] keystone_authtoken.auth_section = None {{(pid=82026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:40:17.688371 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG uwsgi [-] keystone_authtoken.enforce_token_bind = permissive {{(pid=82025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:40:17.688474 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG uwsgi [-] keystone_authtoken.auth_type = None {{(pid=82026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:40:17.688571 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG uwsgi [-] keystone_authtoken.http_connect_timeout = None {{(pid=82025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:40:17.688667 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG uwsgi [-] keystone_authtoken.auth_uri = None {{(pid=82026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:40:17.688793 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG uwsgi [-] keystone_authtoken.http_request_max_retries = 3 {{(pid=82025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:40:17.688916 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG uwsgi [-] keystone_authtoken.auth_version = None {{(pid=82026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:40:17.689016 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG uwsgi [-] keystone_authtoken.identity_uri = None {{(pid=82025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:40:17.689016 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG uwsgi [-] keystone_authtoken.include_service_catalog = True {{(pid=82025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:40:17.689201 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG uwsgi [-] keystone_authtoken.cache = None {{(pid=82026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:40:17.689305 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG uwsgi [-] keystone_authtoken.insecure = False {{(pid=82025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:40:17.689403 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG uwsgi [-] keystone_authtoken.cafile = None {{(pid=82026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:40:17.689510 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG uwsgi [-] keystone_authtoken.interface = internal {{(pid=82025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:40:17.689609 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG uwsgi [-] keystone_authtoken.certfile = None {{(pid=82026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:40:17.689706 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG uwsgi [-] keystone_authtoken.keyfile = None {{(pid=82025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:40:17.689801 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG uwsgi [-] keystone_authtoken.delay_auth_decision = False {{(pid=82026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:40:17.689904 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=82025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:40:17.690000 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG uwsgi [-] keystone_authtoken.enforce_token_bind = permissive {{(pid=82026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:40:17.690104 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=82025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:40:17.690214 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG uwsgi [-] keystone_authtoken.http_connect_timeout = None {{(pid=82026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:40:17.690324 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=82025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:40:17.690430 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG uwsgi [-] keystone_authtoken.http_request_max_retries = 3 {{(pid=82026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:40:17.690529 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=82025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:40:17.690625 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG uwsgi [-] keystone_authtoken.identity_uri = None {{(pid=82026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:40:17.690728 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=82025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:40:17.690833 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG uwsgi [-] keystone_authtoken.include_service_catalog = True {{(pid=82026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:40:17.690937 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG uwsgi [-] keystone_authtoken.memcache_secret_key = **** {{(pid=82025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:40:17.691063 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG uwsgi [-] keystone_authtoken.insecure = False {{(pid=82026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:40:17.691176 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG uwsgi [-] keystone_authtoken.memcache_security_strategy = None {{(pid=82025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:40:17.691274 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG uwsgi [-] keystone_authtoken.interface = internal {{(pid=82026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:40:17.691370 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG uwsgi [-] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=82025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:40:17.692100 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG uwsgi [-] keystone_authtoken.keyfile = None {{(pid=82026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:40:17.692209 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG uwsgi [-] keystone_authtoken.memcached_servers = None {{(pid=82025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:40:17.692307 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=82026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:40:17.692411 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG uwsgi [-] keystone_authtoken.region_name = None {{(pid=82025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:40:17.692517 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=82026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:40:17.692615 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles = ['service'] {{(pid=82025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:40:17.692720 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=82026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:40:17.692828 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles_required = False {{(pid=82025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:40:17.692925 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=82026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:40:17.693028 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG uwsgi [-] keystone_authtoken.service_type = None {{(pid=82025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:40:17.693131 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=82026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:40:17.693236 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG uwsgi [-] keystone_authtoken.token_cache_time = 300 {{(pid=82025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:40:17.693356 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG uwsgi [-] keystone_authtoken.memcache_secret_key = **** {{(pid=82026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:40:17.693440 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG uwsgi [-] keystone_authtoken.www_authenticate_uri = None {{(pid=82025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:40:17.693561 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG uwsgi [-] keystone_authtoken.memcache_security_strategy = None {{(pid=82026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:40:17.693638 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG uwsgi [-] cache.backend = dogpile.cache.memcached {{(pid=82025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:40:17.693756 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG uwsgi [-] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=82026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:40:17.693833 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG uwsgi [-] cache.backend_argument = **** {{(pid=82025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:40:17.693958 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG uwsgi [-] keystone_authtoken.memcached_servers = None {{(pid=82026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:40:17.694076 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG uwsgi [-] cache.config_prefix = cache.oslo {{(pid=82025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:40:17.694152 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG uwsgi [-] keystone_authtoken.region_name = None {{(pid=82026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:40:17.694277 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG uwsgi [-] cache.dead_timeout = 60.0 {{(pid=82025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:40:17.694361 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles = ['service'] {{(pid=82026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:40:17.694425 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG uwsgi [-] cache.debug_cache_backend = False {{(pid=82025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:40:17.694526 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles_required = False {{(pid=82026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:40:17.694618 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG uwsgi [-] cache.enable_retry_client = False {{(pid=82025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:40:17.694692 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG uwsgi [-] keystone_authtoken.service_type = None {{(pid=82026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:40:17.694804 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG uwsgi [-] cache.enable_socket_keepalive = False {{(pid=82025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:40:17.694920 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG uwsgi [-] keystone_authtoken.token_cache_time = 300 {{(pid=82026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:40:17.695002 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG uwsgi [-] cache.enabled = True {{(pid=82025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:40:17.695185 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG uwsgi [-] keystone_authtoken.www_authenticate_uri = None {{(pid=82026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:40:17.695265 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG uwsgi [-] cache.expiration_time = 600 {{(pid=82025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:40:17.695338 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG uwsgi [-] cache.backend = dogpile.cache.memcached {{(pid=82026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:40:17.695450 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG uwsgi [-] cache.hashclient_retry_attempts = 2 {{(pid=82025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:40:17.695529 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG uwsgi [-] cache.backend_argument = **** {{(pid=82026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:40:17.695602 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG uwsgi [-] cache.hashclient_retry_delay = 1.0 {{(pid=82025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:40:17.695793 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG uwsgi [-] cache.config_prefix = cache.oslo {{(pid=82026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:40:17.695879 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG uwsgi [-] cache.memcache_dead_retry = 300 {{(pid=82025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:40:17.695953 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG uwsgi [-] cache.dead_timeout = 60.0 {{(pid=82026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:40:17.696070 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG uwsgi [-] cache.memcache_password = {{(pid=82025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:40:17.696153 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG uwsgi [-] cache.debug_cache_backend = False {{(pid=82026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:40:17.696227 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG uwsgi [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=82025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:40:17.696352 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG uwsgi [-] cache.enable_retry_client = False {{(pid=82026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:40:17.696470 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG uwsgi [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=82025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:40:17.696546 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG uwsgi [-] cache.enable_socket_keepalive = False {{(pid=82026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:40:17.696663 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG uwsgi [-] cache.memcache_pool_maxsize = 10 {{(pid=82025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:40:17.696739 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG uwsgi [-] cache.enabled = True {{(pid=82026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:40:17.696856 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG uwsgi [-] cache.memcache_pool_unused_timeout = 60 {{(pid=82025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:40:17.696943 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG uwsgi [-] cache.expiration_time = 600 {{(pid=82026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:40:17.697026 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG uwsgi [-] cache.memcache_sasl_enabled = False {{(pid=82025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:40:17.697110 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG uwsgi [-] cache.hashclient_retry_attempts = 2 {{(pid=82026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:40:17.697184 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG uwsgi [-] cache.memcache_servers = ['localhost:11211'] {{(pid=82025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:40:17.697302 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG uwsgi [-] cache.hashclient_retry_delay = 1.0 {{(pid=82026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:40:17.697384 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG uwsgi [-] cache.memcache_socket_timeout = 1.0 {{(pid=82025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:40:17.697458 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG uwsgi [-] cache.memcache_dead_retry = 300 {{(pid=82026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:40:17.697624 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG uwsgi [-] cache.memcache_username = {{(pid=82025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:40:17.697715 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG uwsgi [-] cache.memcache_password = {{(pid=82026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:40:17.697868 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG uwsgi [-] cache.proxies = [] {{(pid=82025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:40:17.697948 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG uwsgi [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=82026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:40:17.698108 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG uwsgi [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=82026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:40:17.698187 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG uwsgi [-] cache.retry_attempts = 2 {{(pid=82025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:40:17.698349 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG uwsgi [-] cache.retry_delay = 0.0 {{(pid=82025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:40:17.698436 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG uwsgi [-] cache.memcache_pool_maxsize = 10 {{(pid=82026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:40:17.698589 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG uwsgi [-] cache.memcache_pool_unused_timeout = 60 {{(pid=82026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:40:17.698667 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG uwsgi [-] cache.socket_keepalive_count = 1 {{(pid=82025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:40:17.698824 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG uwsgi [-] cache.socket_keepalive_idle = 1 {{(pid=82025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:40:17.698904 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG uwsgi [-] cache.memcache_sasl_enabled = False {{(pid=82026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:40:17.699088 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG uwsgi [-] cache.socket_keepalive_interval = 1 {{(pid=82025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:40:17.699245 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG uwsgi [-] cache.memcache_servers = ['localhost:11211'] {{(pid=82026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:40:17.699329 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG uwsgi [-] cache.tls_allowed_ciphers = None {{(pid=82025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:40:17.699431 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG uwsgi [-] cache.memcache_socket_timeout = 1.0 {{(pid=82026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:40:17.699531 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG uwsgi [-] cache.tls_cafile = None {{(pid=82025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:40:17.699687 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG uwsgi [-] cache.memcache_username = {{(pid=82026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:40:17.699769 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG uwsgi [-] cache.tls_certfile = None {{(pid=82025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:40:17.700111 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG uwsgi [-] cache.tls_enabled = False {{(pid=82025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:40:17.700204 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG uwsgi [-] cache.proxies = [] {{(pid=82026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:40:17.700387 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG uwsgi [-] cache.tls_keyfile = None {{(pid=82025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:40:17.700632 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG uwsgi [-] application_credential.cache_time = None {{(pid=82025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:40:17.700722 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG uwsgi [-] cache.retry_attempts = 2 {{(pid=82026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:40:17.700872 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG uwsgi [-] application_credential.caching = True {{(pid=82025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:40:17.700963 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG uwsgi [-] cache.retry_delay = 0.0 {{(pid=82026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:40:17.701125 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG uwsgi [-] application_credential.driver = sql {{(pid=82025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:40:17.701207 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG uwsgi [-] cache.socket_keepalive_count = 1 {{(pid=82026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:40:17.701364 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG uwsgi [-] application_credential.user_limit = -1 {{(pid=82025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:40:17.701444 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG uwsgi [-] cache.socket_keepalive_idle = 1 {{(pid=82026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:40:17.701624 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG uwsgi [-] assignment.driver = sql {{(pid=82025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:40:17.701716 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG uwsgi [-] cache.socket_keepalive_interval = 1 {{(pid=82026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:40:17.701882 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG uwsgi [-] cache.tls_allowed_ciphers = None {{(pid=82026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:40:17.701961 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG uwsgi [-] assignment.prohibited_implied_role = ['admin'] {{(pid=82025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:40:17.702122 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG uwsgi [-] cache.tls_cafile = None {{(pid=82026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:40:17.702202 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG uwsgi [-] auth.application_credential = None {{(pid=82025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:40:17.702354 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG uwsgi [-] auth.external = None {{(pid=82025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:40:17.702441 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG uwsgi [-] cache.tls_certfile = None {{(pid=82026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:40:17.702587 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG uwsgi [-] auth.mapped = None {{(pid=82025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:40:17.702667 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG uwsgi [-] cache.tls_enabled = False {{(pid=82026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:40:17.702821 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG uwsgi [-] cache.tls_keyfile = None {{(pid=82026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:40:17.702899 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG uwsgi [-] auth.methods = ['external', 'password', 'token', 'oauth1', 'mapped', 'application_credential'] {{(pid=82025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:40:17.703092 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG uwsgi [-] application_credential.cache_time = None {{(pid=82026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:40:17.703217 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG uwsgi [-] auth.oauth1 = None {{(pid=82025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:40:17.703327 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG uwsgi [-] application_credential.caching = True {{(pid=82026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:40:17.703449 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG uwsgi [-] auth.password = None {{(pid=82025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:40:17.703581 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG uwsgi [-] application_credential.driver = sql {{(pid=82026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:40:17.703665 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG uwsgi [-] auth.token = None {{(pid=82025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:40:17.703822 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG uwsgi [-] catalog.cache_time = None {{(pid=82025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:40:17.703910 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG uwsgi [-] application_credential.user_limit = -1 {{(pid=82026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:40:17.704064 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG uwsgi [-] catalog.caching = True {{(pid=82025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:40:17.704155 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG uwsgi [-] assignment.driver = sql {{(pid=82026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:40:17.704314 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG uwsgi [-] catalog.driver = sql {{(pid=82025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:40:17.704397 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG uwsgi [-] assignment.prohibited_implied_role = ['admin'] {{(pid=82026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:40:17.704548 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG uwsgi [-] catalog.list_limit = None {{(pid=82025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:40:17.704675 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG uwsgi [-] auth.application_credential = None {{(pid=82026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:40:17.704802 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG uwsgi [-] auth.external = None {{(pid=82026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:40:17.704922 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG uwsgi [-] catalog.template_file = default_catalog.templates {{(pid=82025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:40:17.705039 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG uwsgi [-] auth.mapped = None {{(pid=82026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:40:17.705156 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG uwsgi [-] credential.auth_ttl = 15 {{(pid=82025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:40:17.705272 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG uwsgi [-] credential.cache_time = None {{(pid=82025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:40:17.705388 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG uwsgi [-] auth.methods = ['external', 'password', 'token', 'oauth1', 'mapped', 'application_credential'] {{(pid=82026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:40:17.705514 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG uwsgi [-] credential.caching = True {{(pid=82025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:40:17.705632 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG uwsgi [-] auth.oauth1 = None {{(pid=82026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:40:17.705749 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG uwsgi [-] credential.driver = sql {{(pid=82025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:40:17.705866 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG uwsgi [-] auth.password = None {{(pid=82026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:40:17.705987 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG uwsgi [-] credential.key_repository = /etc/keystone/credential-keys/ {{(pid=82025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:40:17.706110 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG uwsgi [-] auth.token = None {{(pid=82026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:40:17.706226 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG uwsgi [-] credential.provider = fernet {{(pid=82025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:40:17.706343 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG uwsgi [-] catalog.cache_time = None {{(pid=82026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:40:17.706459 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG uwsgi [-] credential.user_limit = -1 {{(pid=82025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:40:17.706574 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG uwsgi [-] catalog.caching = True {{(pid=82026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:40:17.706690 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG uwsgi [-] domain_config.cache_time = 300 {{(pid=82025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:40:17.706806 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG uwsgi [-] catalog.driver = sql {{(pid=82026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:40:17.706931 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG uwsgi [-] domain_config.caching = True {{(pid=82025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:40:17.707101 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG uwsgi [-] catalog.list_limit = None {{(pid=82026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:40:17.707232 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG uwsgi [-] domain_config.driver = sql {{(pid=82025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:40:17.707351 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG uwsgi [-] catalog.template_file = default_catalog.templates {{(pid=82026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:40:17.707468 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG uwsgi [-] endpoint_filter.driver = sql {{(pid=82025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:40:17.707585 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG uwsgi [-] credential.auth_ttl = 15 {{(pid=82026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:40:17.707709 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG uwsgi [-] endpoint_filter.return_all_endpoints_if_no_filter = True {{(pid=82025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:40:17.707828 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG uwsgi [-] credential.cache_time = None {{(pid=82026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:40:17.707950 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG uwsgi [-] endpoint_policy.driver = sql {{(pid=82025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:40:17.708069 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG uwsgi [-] credential.caching = True {{(pid=82026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:40:17.708185 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG uwsgi [-] eventlet_server.admin_bind_host = 0.0.0.0 {{(pid=82025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:40:17.708300 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG uwsgi [-] credential.driver = sql {{(pid=82026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:40:17.708424 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG uwsgi [-] eventlet_server.admin_port = 35357 {{(pid=82025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:40:17.708542 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG uwsgi [-] credential.key_repository = /etc/keystone/credential-keys/ {{(pid=82026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:40:17.708659 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG uwsgi [-] eventlet_server.public_bind_host = 0.0.0.0 {{(pid=82025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:40:17.708774 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG uwsgi [-] credential.provider = fernet {{(pid=82026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:40:17.708890 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG uwsgi [-] eventlet_server.public_port = 5000 {{(pid=82025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:40:17.709015 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG uwsgi [-] credential.user_limit = -1 {{(pid=82026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:40:17.709142 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG uwsgi [-] federation.assertion_prefix = {{(pid=82025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:40:17.709268 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG uwsgi [-] domain_config.cache_time = 300 {{(pid=82026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:40:17.709385 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG uwsgi [-] federation.caching = True {{(pid=82025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:40:17.709502 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG uwsgi [-] domain_config.caching = True {{(pid=82026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:40:17.709618 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG uwsgi [-] federation.default_authorization_ttl = 0 {{(pid=82025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:40:17.709734 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG uwsgi [-] domain_config.driver = sql {{(pid=82026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:40:17.709933 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG uwsgi [-] federation.driver = sql {{(pid=82025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:40:17.710054 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG uwsgi [-] endpoint_filter.driver = sql {{(pid=82026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:40:17.710171 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG uwsgi [-] federation.federated_domain_name = Federated {{(pid=82025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:40:17.710287 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG uwsgi [-] endpoint_filter.return_all_endpoints_if_no_filter = True {{(pid=82026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:40:17.710410 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG uwsgi [-] federation.remote_id_attribute = None {{(pid=82025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:40:17.710528 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG uwsgi [-] endpoint_policy.driver = sql {{(pid=82026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:40:17.710652 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG uwsgi [-] federation.sso_callback_template = /etc/keystone/sso_callback_template.html {{(pid=82025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:40:17.710771 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG uwsgi [-] eventlet_server.admin_bind_host = 0.0.0.0 {{(pid=82026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:40:17.710887 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG uwsgi [-] federation.trusted_dashboard = [] {{(pid=82025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:40:17.711003 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG uwsgi [-] eventlet_server.admin_port = 35357 {{(pid=82026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:40:17.711145 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG uwsgi [-] fernet_receipts.key_repository = /etc/keystone/fernet-keys/ {{(pid=82025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:40:17.711263 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG uwsgi [-] eventlet_server.public_bind_host = 0.0.0.0 {{(pid=82026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:40:17.711393 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG uwsgi [-] fernet_receipts.max_active_keys = 3 {{(pid=82025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:40:17.711511 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG uwsgi [-] eventlet_server.public_port = 5000 {{(pid=82026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:40:17.711628 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG uwsgi [-] fernet_tokens.key_repository = /etc/keystone/fernet-keys/ {{(pid=82025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:40:17.711744 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG uwsgi [-] federation.assertion_prefix = {{(pid=82026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:40:17.711860 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG uwsgi [-] fernet_tokens.max_active_keys = 3 {{(pid=82025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:40:17.711977 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG uwsgi [-] federation.caching = True {{(pid=82026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:40:17.712101 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG uwsgi [-] identity.cache_time = 600 {{(pid=82025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:40:17.712220 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG uwsgi [-] federation.default_authorization_ttl = 0 {{(pid=82026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:40:17.712336 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG uwsgi [-] identity.caching = True {{(pid=82025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:40:17.712336 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG uwsgi [-] identity.default_domain_id = default {{(pid=82025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:40:17.712525 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG uwsgi [-] federation.driver = sql {{(pid=82026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:40:17.712630 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG uwsgi [-] identity.domain_config_dir = /etc/keystone/domains {{(pid=82025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:40:17.712755 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG uwsgi [-] federation.federated_domain_name = Federated {{(pid=82026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:40:17.712858 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG uwsgi [-] identity.domain_configurations_from_database = False {{(pid=82025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:40:17.712974 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG uwsgi [-] federation.remote_id_attribute = None {{(pid=82026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:40:17.713089 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG uwsgi [-] identity.domain_specific_drivers_enabled = False {{(pid=82025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:40:17.713206 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG uwsgi [-] federation.sso_callback_template = /etc/keystone/sso_callback_template.html {{(pid=82026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:40:17.713332 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG uwsgi [-] identity.driver = sql {{(pid=82025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:40:17.713442 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG uwsgi [-] federation.trusted_dashboard = [] {{(pid=82026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:40:17.713556 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG uwsgi [-] identity.list_limit = None {{(pid=82025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:40:17.713678 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG uwsgi [-] fernet_receipts.key_repository = /etc/keystone/fernet-keys/ {{(pid=82026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:40:17.713795 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG uwsgi [-] identity.max_password_length = 4096 {{(pid=82025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:40:17.713910 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG uwsgi [-] fernet_receipts.max_active_keys = 3 {{(pid=82026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:40:17.714035 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG uwsgi [-] identity.password_hash_algorithm = bcrypt {{(pid=82025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:40:17.714159 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG uwsgi [-] fernet_tokens.key_repository = /etc/keystone/fernet-keys/ {{(pid=82026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:40:17.714277 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG uwsgi [-] identity.password_hash_rounds = 4 {{(pid=82025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:40:17.714393 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG uwsgi [-] fernet_tokens.max_active_keys = 3 {{(pid=82026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:40:17.714509 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG uwsgi [-] identity.salt_bytesize = None {{(pid=82025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:40:17.714624 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG uwsgi [-] identity.cache_time = 600 {{(pid=82026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:40:17.714747 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG uwsgi [-] identity.scrypt_block_size = None {{(pid=82025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:40:17.714870 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG uwsgi [-] identity.caching = True {{(pid=82026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:40:17.714988 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG uwsgi [-] identity.scrypt_parallelism = None {{(pid=82025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:40:17.715133 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG uwsgi [-] identity.default_domain_id = default {{(pid=82026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:40:17.715249 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG uwsgi [-] identity_mapping.backward_compatible_ids = True {{(pid=82025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:40:17.715366 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG uwsgi [-] identity.domain_config_dir = /etc/keystone/domains {{(pid=82026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:40:17.715509 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG uwsgi [-] identity_mapping.driver = sql {{(pid=82025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:40:17.715626 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG uwsgi [-] identity.domain_configurations_from_database = False {{(pid=82026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:40:17.715792 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG uwsgi [-] identity_mapping.generator = sha256 {{(pid=82025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:40:17.715792 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG uwsgi [-] jwt_tokens.jws_private_key_repository = /etc/keystone/jws-keys/private {{(pid=82025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:40:17.716062 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG uwsgi [-] jwt_tokens.jws_public_key_repository = /etc/keystone/jws-keys/public {{(pid=82025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:40:17.716192 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG uwsgi [-] identity.domain_specific_drivers_enabled = False {{(pid=82026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:40:17.716410 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG uwsgi [-] ldap.alias_dereferencing = default {{(pid=82025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:40:17.716533 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG uwsgi [-] identity.driver = sql {{(pid=82026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:40:17.716650 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG uwsgi [-] ldap.auth_pool_connection_lifetime = 60 {{(pid=82025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:40:17.716766 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG uwsgi [-] identity.list_limit = None {{(pid=82026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:40:17.716873 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG uwsgi [-] ldap.auth_pool_size = 100 {{(pid=82025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:40:17.716970 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG uwsgi [-] identity.max_password_length = 4096 {{(pid=82026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:40:17.717105 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG uwsgi [-] ldap.chase_referrals = None {{(pid=82025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:40:17.717221 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG uwsgi [-] identity.password_hash_algorithm = bcrypt {{(pid=82026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:40:17.717355 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG uwsgi [-] ldap.connection_timeout = -1 {{(pid=82025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:40:17.717463 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG uwsgi [-] identity.password_hash_rounds = 4 {{(pid=82026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:40:17.717590 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG uwsgi [-] ldap.debug_level = None {{(pid=82025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:40:17.717697 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG uwsgi [-] identity.salt_bytesize = None {{(pid=82026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:40:17.717827 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG uwsgi [-] identity.scrypt_block_size = None {{(pid=82026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:40:17.717936 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG uwsgi [-] ldap.group_ad_nesting = False {{(pid=82025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:40:17.718066 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG uwsgi [-] ldap.group_additional_attribute_mapping = [] {{(pid=82025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:40:17.718171 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG uwsgi [-] identity.scrypt_parallelism = None {{(pid=82026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:40:17.718308 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG uwsgi [-] ldap.group_attribute_ignore = [] {{(pid=82025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:40:17.718415 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG uwsgi [-] identity_mapping.backward_compatible_ids = True {{(pid=82026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:40:17.718560 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG uwsgi [-] identity_mapping.driver = sql {{(pid=82026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:40:17.718668 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG uwsgi [-] ldap.group_desc_attribute = description {{(pid=82025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:40:17.718791 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG uwsgi [-] ldap.group_filter = None {{(pid=82025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:40:17.718896 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG uwsgi [-] identity_mapping.generator = sha256 {{(pid=82026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:40:17.719057 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG uwsgi [-] ldap.group_id_attribute = cn {{(pid=82025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:40:17.719168 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG uwsgi [-] jwt_tokens.jws_private_key_repository = /etc/keystone/jws-keys/private {{(pid=82026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:40:17.720787 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG uwsgi [-] ldap.group_member_attribute = member {{(pid=82025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:40:17.720896 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG uwsgi [-] jwt_tokens.jws_public_key_repository = /etc/keystone/jws-keys/public {{(pid=82026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:40:17.721016 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG uwsgi [-] ldap.group_members_are_ids = False {{(pid=82025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:40:17.721132 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG uwsgi [-] ldap.alias_dereferencing = default {{(pid=82026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:40:17.721249 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG uwsgi [-] ldap.group_name_attribute = ou {{(pid=82025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:40:17.721364 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG uwsgi [-] ldap.auth_pool_connection_lifetime = 60 {{(pid=82026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:40:17.721492 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG uwsgi [-] ldap.group_objectclass = groupOfNames {{(pid=82025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:40:17.721613 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG uwsgi [-] ldap.auth_pool_size = 100 {{(pid=82026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:40:17.721730 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG uwsgi [-] ldap.group_tree_dn = None {{(pid=82025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:40:17.721852 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG uwsgi [-] ldap.chase_referrals = None {{(pid=82026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:40:17.721970 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG uwsgi [-] ldap.page_size = 0 {{(pid=82025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:40:17.722086 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG uwsgi [-] ldap.connection_timeout = -1 {{(pid=82026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:40:17.722209 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG uwsgi [-] ldap.password = **** {{(pid=82025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:40:17.722327 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG uwsgi [-] ldap.debug_level = None {{(pid=82026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:40:17.722450 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG uwsgi [-] ldap.pool_connection_lifetime = 600 {{(pid=82025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:40:17.722567 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG uwsgi [-] ldap.group_ad_nesting = False {{(pid=82026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:40:17.722567 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG uwsgi [-] ldap.group_additional_attribute_mapping = [] {{(pid=82026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:40:17.722786 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG uwsgi [-] ldap.pool_connection_timeout = -1 {{(pid=82025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:40:17.722910 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG uwsgi [-] ldap.group_attribute_ignore = [] {{(pid=82026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:40:17.723028 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG uwsgi [-] ldap.pool_retry_delay = 0.1 {{(pid=82025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:40:17.723171 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG uwsgi [-] ldap.group_desc_attribute = description {{(pid=82026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:40:17.723289 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG uwsgi [-] ldap.pool_retry_max = 3 {{(pid=82025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:40:17.723405 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG uwsgi [-] ldap.group_filter = None {{(pid=82026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:40:17.723521 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG uwsgi [-] ldap.pool_size = 10 {{(pid=82025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:40:17.723649 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG uwsgi [-] ldap.group_id_attribute = cn {{(pid=82026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:40:17.723770 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG uwsgi [-] ldap.query_scope = one {{(pid=82025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:40:17.723887 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG uwsgi [-] ldap.group_member_attribute = member {{(pid=82026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:40:17.724004 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG uwsgi [-] ldap.suffix = cn=example,cn=com {{(pid=82025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:40:17.724120 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG uwsgi [-] ldap.group_members_are_ids = False {{(pid=82026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:40:17.724236 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG uwsgi [-] ldap.tls_cacertdir = None {{(pid=82025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:40:17.724361 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG uwsgi [-] ldap.group_name_attribute = ou {{(pid=82026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:40:17.724479 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG uwsgi [-] ldap.tls_cacertfile = None {{(pid=82025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:40:17.724595 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG uwsgi [-] ldap.group_objectclass = groupOfNames {{(pid=82026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:40:17.724711 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG uwsgi [-] ldap.tls_req_cert = demand {{(pid=82025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:40:17.724828 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG uwsgi [-] ldap.group_tree_dn = None {{(pid=82026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:40:17.724949 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG uwsgi [-] ldap.url = ldap://localhost {{(pid=82025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:40:17.725075 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG uwsgi [-] ldap.page_size = 0 {{(pid=82026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:40:17.725193 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG uwsgi [-] ldap.use_auth_pool = True {{(pid=82025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:40:17.725309 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG uwsgi [-] ldap.password = **** {{(pid=82026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:40:17.725427 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG uwsgi [-] ldap.use_pool = True {{(pid=82025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:40:17.725550 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG uwsgi [-] ldap.pool_connection_lifetime = 600 {{(pid=82026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:40:17.725668 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG uwsgi [-] ldap.use_tls = False {{(pid=82025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:40:17.725805 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG uwsgi [-] ldap.pool_connection_timeout = -1 {{(pid=82026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:40:17.725924 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG uwsgi [-] ldap.user = None {{(pid=82025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:40:17.726040 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG uwsgi [-] ldap.pool_retry_delay = 0.1 {{(pid=82026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:40:17.726157 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG uwsgi [-] ldap.user_additional_attribute_mapping = [] {{(pid=82025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:40:17.726273 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG uwsgi [-] ldap.pool_retry_max = 3 {{(pid=82026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:40:17.726389 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG uwsgi [-] ldap.user_attribute_ignore = ['default_project_id'] {{(pid=82025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:40:17.726514 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG uwsgi [-] ldap.pool_size = 10 {{(pid=82026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:40:17.726632 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG uwsgi [-] ldap.user_default_project_id_attribute = None {{(pid=82025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:40:17.726748 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG uwsgi [-] ldap.query_scope = one {{(pid=82026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:40:17.726866 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG uwsgi [-] ldap.user_description_attribute = description {{(pid=82025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:40:17.726983 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG uwsgi [-] ldap.suffix = cn=example,cn=com {{(pid=82026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:40:17.727130 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG uwsgi [-] ldap.user_enabled_attribute = enabled {{(pid=82025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:40:17.727250 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG uwsgi [-] ldap.tls_cacertdir = None {{(pid=82026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:40:17.727367 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG uwsgi [-] ldap.user_enabled_default = True {{(pid=82025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:40:17.727483 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG uwsgi [-] ldap.tls_cacertfile = None {{(pid=82026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:40:17.727600 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG uwsgi [-] ldap.user_enabled_emulation = False {{(pid=82025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:40:17.727716 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG uwsgi [-] ldap.tls_req_cert = demand {{(pid=82026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:40:17.727845 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG uwsgi [-] ldap.user_enabled_emulation_dn = None {{(pid=82025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:40:17.727965 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG uwsgi [-] ldap.url = ldap://localhost {{(pid=82026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:40:17.728083 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG uwsgi [-] ldap.user_enabled_emulation_use_group_config = False {{(pid=82025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:40:17.728199 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG uwsgi [-] ldap.use_auth_pool = True {{(pid=82026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:40:17.728315 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG uwsgi [-] ldap.user_enabled_invert = False {{(pid=82025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:40:17.728430 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG uwsgi [-] ldap.use_pool = True {{(pid=82026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:40:17.728554 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG uwsgi [-] ldap.user_enabled_mask = 0 {{(pid=82025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:40:17.728554 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG uwsgi [-] ldap.user_filter = None {{(pid=82025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:40:17.728780 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG uwsgi [-] ldap.use_tls = False {{(pid=82026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:40:17.728780 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG uwsgi [-] ldap.user = None {{(pid=82026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:40:17.728998 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG uwsgi [-] ldap.user_id_attribute = cn {{(pid=82025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:40:17.729114 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG uwsgi [-] ldap.user_additional_attribute_mapping = [] {{(pid=82026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:40:17.729238 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG uwsgi [-] ldap.user_mail_attribute = mail {{(pid=82025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:40:17.729356 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG uwsgi [-] ldap.user_attribute_ignore = ['default_project_id'] {{(pid=82026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:40:17.729485 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG uwsgi [-] ldap.user_name_attribute = sn {{(pid=82025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:40:17.729604 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG uwsgi [-] ldap.user_default_project_id_attribute = None {{(pid=82026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:40:17.729720 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG uwsgi [-] ldap.user_objectclass = inetOrgPerson {{(pid=82025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:40:17.729836 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG uwsgi [-] ldap.user_description_attribute = description {{(pid=82026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:40:17.729960 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG uwsgi [-] ldap.user_pass_attribute = userPassword {{(pid=82025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:40:17.729960 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG uwsgi [-] ldap.user_tree_dn = None {{(pid=82025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:40:17.730179 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG uwsgi [-] ldap.user_enabled_attribute = enabled {{(pid=82026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:40:17.730302 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG uwsgi [-] memcache.dead_retry = 300 {{(pid=82025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:40:17.730419 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG uwsgi [-] ldap.user_enabled_default = True {{(pid=82026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:40:17.730535 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG uwsgi [-] memcache.pool_connection_get_timeout = 10 {{(pid=82025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:40:17.730659 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG uwsgi [-] ldap.user_enabled_emulation = False {{(pid=82026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:40:17.730784 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG uwsgi [-] memcache.pool_maxsize = 10 {{(pid=82025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:40:17.730901 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG uwsgi [-] ldap.user_enabled_emulation_dn = None {{(pid=82026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:40:17.731017 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG uwsgi [-] memcache.pool_unused_timeout = 60 {{(pid=82025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:40:17.731689 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG uwsgi [-] ldap.user_enabled_emulation_use_group_config = False {{(pid=82026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:40:17.731807 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG uwsgi [-] memcache.socket_timeout = 3 {{(pid=82025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:40:17.731936 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG uwsgi [-] ldap.user_enabled_invert = False {{(pid=82026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:40:17.732055 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG uwsgi [-] oauth1.access_token_duration = 86400 {{(pid=82025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:40:17.732173 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG uwsgi [-] ldap.user_enabled_mask = 0 {{(pid=82026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:40:17.732290 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG uwsgi [-] oauth1.driver = sql {{(pid=82025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:40:17.732406 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG uwsgi [-] ldap.user_filter = None {{(pid=82026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:40:17.732522 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG uwsgi [-] oauth1.request_token_duration = 28800 {{(pid=82025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:40:17.732647 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG uwsgi [-] ldap.user_id_attribute = cn {{(pid=82026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:40:17.732766 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG uwsgi [-] policy.driver = sql {{(pid=82025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:40:17.732882 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG uwsgi [-] ldap.user_mail_attribute = mail {{(pid=82026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:40:17.732999 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG uwsgi [-] policy.list_limit = None {{(pid=82025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:40:17.733116 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG uwsgi [-] ldap.user_name_attribute = sn {{(pid=82026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:40:17.733232 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG uwsgi [-] receipt.cache_on_issue = True {{(pid=82025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:40:17.733232 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG uwsgi [-] receipt.cache_time = 300 {{(pid=82025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:40:17.733232 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG uwsgi [-] receipt.caching = True {{(pid=82025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:40:17.733568 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG uwsgi [-] ldap.user_objectclass = inetOrgPerson {{(pid=82026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:40:17.733687 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG uwsgi [-] receipt.expiration = 300 {{(pid=82025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:40:17.733804 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG uwsgi [-] ldap.user_pass_attribute = userPassword {{(pid=82026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:40:17.733921 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG uwsgi [-] receipt.provider = fernet {{(pid=82025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:40:17.734045 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG uwsgi [-] ldap.user_tree_dn = None {{(pid=82026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:40:17.734164 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG uwsgi [-] resource.admin_project_domain_name = None {{(pid=82025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:40:17.734281 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG uwsgi [-] memcache.dead_retry = 300 {{(pid=82026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:40:17.734397 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG uwsgi [-] resource.admin_project_name = None {{(pid=82025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:40:17.734397 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG uwsgi [-] resource.cache_time = None {{(pid=82025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:40:17.734615 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG uwsgi [-] memcache.pool_connection_get_timeout = 10 {{(pid=82026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:40:17.734810 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG uwsgi [-] resource.caching = True {{(pid=82025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:40:17.734931 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG uwsgi [-] memcache.pool_maxsize = 10 {{(pid=82026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:40:17.735103 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG uwsgi [-] resource.domain_name_url_safe = off {{(pid=82025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:40:17.735224 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG uwsgi [-] memcache.pool_unused_timeout = 60 {{(pid=82026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:40:17.735382 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG uwsgi [-] resource.driver = sql {{(pid=82025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:40:17.735501 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG uwsgi [-] memcache.socket_timeout = 3 {{(pid=82026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:40:17.735629 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG uwsgi [-] resource.list_limit = None {{(pid=82025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:40:17.735747 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG uwsgi [-] oauth1.access_token_duration = 86400 {{(pid=82026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:40:17.735864 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG uwsgi [-] resource.project_name_url_safe = off {{(pid=82025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:40:17.735980 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG uwsgi [-] oauth1.driver = sql {{(pid=82026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:40:17.736097 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG uwsgi [-] revoke.cache_time = 3600 {{(pid=82025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:40:17.736213 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG uwsgi [-] oauth1.request_token_duration = 28800 {{(pid=82026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:40:17.736339 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG uwsgi [-] revoke.caching = True {{(pid=82025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:40:17.736457 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG uwsgi [-] policy.driver = sql {{(pid=82026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:40:17.736574 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG uwsgi [-] revoke.driver = sql {{(pid=82025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:40:17.736690 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG uwsgi [-] policy.list_limit = None {{(pid=82026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:40:17.736806 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG uwsgi [-] revoke.expiration_buffer = 1800 {{(pid=82025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:40:17.736922 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG uwsgi [-] receipt.cache_on_issue = True {{(pid=82026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:40:17.737047 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG uwsgi [-] role.cache_time = None {{(pid=82025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:40:17.737165 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG uwsgi [-] receipt.cache_time = 300 {{(pid=82026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:40:17.737281 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG uwsgi [-] role.caching = True {{(pid=82025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:40:17.737398 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG uwsgi [-] receipt.caching = True {{(pid=82026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:40:17.737514 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG uwsgi [-] role.driver = sql {{(pid=82025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:40:17.737630 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG uwsgi [-] receipt.expiration = 300 {{(pid=82026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:40:17.737754 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG uwsgi [-] role.list_limit = None {{(pid=82025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:40:17.737872 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG uwsgi [-] receipt.provider = fernet {{(pid=82026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:40:17.737988 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG uwsgi [-] saml.assertion_expiration_time = 3600 {{(pid=82025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:40:17.738103 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG uwsgi [-] resource.admin_project_domain_name = None {{(pid=82026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:40:17.738220 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG uwsgi [-] saml.certfile = /etc/keystone/ssl/certs/signing_cert.pem {{(pid=82025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:40:17.738336 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG uwsgi [-] resource.admin_project_name = None {{(pid=82026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:40:17.738461 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG uwsgi [-] saml.idp_contact_company = Example, Inc. {{(pid=82025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:40:17.738579 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG uwsgi [-] resource.cache_time = None {{(pid=82026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:40:17.738694 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG uwsgi [-] saml.idp_contact_email = support@example.com {{(pid=82025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:40:17.738810 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG uwsgi [-] resource.caching = True {{(pid=82026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:40:17.738926 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG uwsgi [-] saml.idp_contact_name = SAML Identity Provider Support {{(pid=82025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:40:17.739059 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG uwsgi [-] resource.domain_name_url_safe = off {{(pid=82026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:40:17.739191 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG uwsgi [-] saml.idp_contact_surname = Support {{(pid=82025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:40:17.739311 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG uwsgi [-] resource.driver = sql {{(pid=82026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:40:17.739427 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG uwsgi [-] saml.idp_contact_telephone = +1 800 555 0100 {{(pid=82025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:40:17.739550 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG uwsgi [-] resource.list_limit = None {{(pid=82026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:40:17.739667 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG uwsgi [-] saml.idp_contact_type = other {{(pid=82025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:40:17.739783 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG uwsgi [-] resource.project_name_url_safe = off {{(pid=82026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:40:17.739897 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG uwsgi [-] saml.idp_entity_id = None {{(pid=82025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:40:17.740004 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG uwsgi [-] revoke.cache_time = 3600 {{(pid=82026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:40:17.740119 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG uwsgi [-] saml.idp_lang = en {{(pid=82025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:40:17.740234 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG uwsgi [-] revoke.caching = True {{(pid=82026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:40:17.740349 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG uwsgi [-] saml.idp_metadata_path = /etc/keystone/saml2_idp_metadata.xml {{(pid=82025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:40:17.740474 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG uwsgi [-] revoke.driver = sql {{(pid=82026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:40:17.740592 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG uwsgi [-] saml.idp_organization_display_name = OpenStack SAML Identity Provider {{(pid=82025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:40:17.740707 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG uwsgi [-] revoke.expiration_buffer = 1800 {{(pid=82026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:40:17.740823 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG uwsgi [-] saml.idp_organization_name = SAML Identity Provider {{(pid=82025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:40:17.740939 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG uwsgi [-] role.cache_time = None {{(pid=82026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:40:17.740939 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG uwsgi [-] role.caching = True {{(pid=82026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:40:17.741164 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG uwsgi [-] saml.idp_organization_url = https://example.com/ {{(pid=82025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:40:17.741282 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG uwsgi [-] role.driver = sql {{(pid=82026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:40:17.741397 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG uwsgi [-] saml.idp_sso_endpoint = None {{(pid=82025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:40:17.741514 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG uwsgi [-] role.list_limit = None {{(pid=82026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:40:17.741630 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG uwsgi [-] saml.keyfile = /etc/keystone/ssl/private/signing_key.pem {{(pid=82025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:40:17.741747 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG uwsgi [-] saml.assertion_expiration_time = 3600 {{(pid=82026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:40:17.741870 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG uwsgi [-] saml.relay_state_prefix = ss:mem: {{(pid=82025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:40:17.741988 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG uwsgi [-] saml.certfile = /etc/keystone/ssl/certs/signing_cert.pem {{(pid=82026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:40:17.742105 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG uwsgi [-] saml.xmlsec1_binary = xmlsec1 {{(pid=82025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:40:17.742220 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG uwsgi [-] saml.idp_contact_company = Example, Inc. {{(pid=82026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:40:17.742336 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG uwsgi [-] security_compliance.change_password_upon_first_use = False {{(pid=82025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:40:17.742452 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG uwsgi [-] saml.idp_contact_email = support@example.com {{(pid=82026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:40:17.742577 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG uwsgi [-] security_compliance.disable_user_account_days_inactive = None {{(pid=82025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:40:17.742693 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG uwsgi [-] saml.idp_contact_name = SAML Identity Provider Support {{(pid=82026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:40:17.742810 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG uwsgi [-] security_compliance.lockout_duration = 10 {{(pid=82025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:40:17.742926 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG uwsgi [-] saml.idp_contact_surname = Support {{(pid=82026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:40:17.743124 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG uwsgi [-] security_compliance.lockout_failure_attempts = 2 {{(pid=82025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:40:17.743246 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG uwsgi [-] saml.idp_contact_telephone = +1 800 555 0100 {{(pid=82026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:40:17.743366 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG uwsgi [-] security_compliance.minimum_password_age = 0 {{(pid=82025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:40:17.743483 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG uwsgi [-] saml.idp_contact_type = other {{(pid=82026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:40:17.743601 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG uwsgi [-] security_compliance.password_expires_days = None {{(pid=82025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:40:17.743717 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG uwsgi [-] saml.idp_entity_id = None {{(pid=82026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:40:17.743832 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG uwsgi [-] security_compliance.password_regex = None {{(pid=82025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:40:17.743948 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG uwsgi [-] saml.idp_lang = en {{(pid=82026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:40:17.744071 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG uwsgi [-] security_compliance.password_regex_description = None {{(pid=82025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:40:17.744190 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG uwsgi [-] saml.idp_metadata_path = /etc/keystone/saml2_idp_metadata.xml {{(pid=82026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:40:17.744312 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG uwsgi [-] security_compliance.unique_last_password_count = 2 {{(pid=82025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:40:17.744429 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG uwsgi [-] saml.idp_organization_display_name = OpenStack SAML Identity Provider {{(pid=82026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:40:17.744546 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG uwsgi [-] shadow_users.driver = sql {{(pid=82025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:40:17.744668 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG uwsgi [-] saml.idp_organization_name = SAML Identity Provider {{(pid=82026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:40:17.744792 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG uwsgi [-] token.allow_expired_window = 172800 {{(pid=82025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:40:17.744792 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG uwsgi [-] token.allow_rescope_scoped_token = True {{(pid=82025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:40:17.744792 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG uwsgi [-] token.cache_on_issue = True {{(pid=82025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:40:17.745110 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG uwsgi [-] saml.idp_organization_url = https://example.com/ {{(pid=82026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:40:17.745233 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG uwsgi [-] token.cache_time = None {{(pid=82025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:40:17.745350 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG uwsgi [-] saml.idp_sso_endpoint = None {{(pid=82026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:40:17.745475 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG uwsgi [-] token.caching = True {{(pid=82025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:40:17.745593 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG uwsgi [-] saml.keyfile = /etc/keystone/ssl/private/signing_key.pem {{(pid=82026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:40:17.745711 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG uwsgi [-] token.expiration = 3600 {{(pid=82025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:40:17.745826 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG uwsgi [-] saml.relay_state_prefix = ss:mem: {{(pid=82026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:40:17.745943 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG uwsgi [-] token.provider = fernet {{(pid=82025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:40:17.746059 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG uwsgi [-] saml.xmlsec1_binary = xmlsec1 {{(pid=82026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:40:17.746184 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG uwsgi [-] token.revoke_by_id = True {{(pid=82025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:40:17.746302 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG uwsgi [-] security_compliance.change_password_upon_first_use = False {{(pid=82026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:40:17.746419 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG uwsgi [-] tokenless_auth.issuer_attribute = SSL_CLIENT_I_DN {{(pid=82025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:40:17.746535 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG uwsgi [-] security_compliance.disable_user_account_days_inactive = None {{(pid=82026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:40:17.746652 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG uwsgi [-] tokenless_auth.protocol = x509 {{(pid=82025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:40:17.747367 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG uwsgi [-] security_compliance.lockout_duration = 10 {{(pid=82026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:40:17.747494 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG uwsgi [-] tokenless_auth.trusted_issuer = [] {{(pid=82025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:40:17.747612 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG uwsgi [-] security_compliance.lockout_failure_attempts = 2 {{(pid=82026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:40:17.747729 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG uwsgi [-] totp.included_previous_windows = 1 {{(pid=82025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:40:17.747847 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG uwsgi [-] security_compliance.minimum_password_age = 0 {{(pid=82026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:40:17.747964 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG uwsgi [-] trust.allow_redelegation = False {{(pid=82025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:40:17.748093 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG uwsgi [-] security_compliance.password_expires_days = None {{(pid=82026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:40:17.748213 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG uwsgi [-] trust.driver = sql {{(pid=82025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:40:17.748336 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG uwsgi [-] security_compliance.password_regex = None {{(pid=82026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:40:17.748454 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG uwsgi [-] trust.max_redelegation_count = 3 {{(pid=82025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:40:17.748571 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG uwsgi [-] security_compliance.password_regex_description = None {{(pid=82026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:40:17.748688 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG uwsgi [-] unified_limit.cache_time = None {{(pid=82025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:40:17.748688 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG uwsgi [-] unified_limit.caching = True {{(pid=82025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:40:17.748688 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG uwsgi [-] unified_limit.driver = sql {{(pid=82025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:40:17.749019 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG uwsgi [-] security_compliance.unique_last_password_count = 2 {{(pid=82026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:40:17.749136 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG uwsgi [-] unified_limit.enforcement_model = flat {{(pid=82025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:40:17.749252 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG uwsgi [-] shadow_users.driver = sql {{(pid=82026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:40:17.749368 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG uwsgi [-] unified_limit.list_limit = None {{(pid=82025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:40:17.749497 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG uwsgi [-] token.allow_expired_window = 172800 {{(pid=82026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:40:17.749623 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG uwsgi [-] wsgi.debug_middleware = False {{(pid=82025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:40:17.749750 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG uwsgi [-] token.allow_rescope_scoped_token = True {{(pid=82026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:40:17.749868 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG uwsgi [-] database.backend = sqlalchemy {{(pid=82025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:40:17.749986 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG uwsgi [-] token.cache_on_issue = True {{(pid=82026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:40:17.750103 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG uwsgi [-] database.connection = **** {{(pid=82025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:40:17.750219 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG uwsgi [-] token.cache_time = None {{(pid=82026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:40:17.750336 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG uwsgi [-] database.connection_debug = 0 {{(pid=82025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:40:17.750460 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG uwsgi [-] token.caching = True {{(pid=82026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:40:17.750578 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG uwsgi [-] database.connection_parameters = {{(pid=82025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:40:17.750694 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG uwsgi [-] token.expiration = 3600 {{(pid=82026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:40:17.750810 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG uwsgi [-] database.connection_recycle_time = 3600 {{(pid=82025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:40:17.750926 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG uwsgi [-] token.provider = fernet {{(pid=82026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:40:17.751072 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG uwsgi [-] database.connection_trace = False {{(pid=82025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:40:17.751205 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG uwsgi [-] token.revoke_by_id = True {{(pid=82026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:40:17.751325 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG uwsgi [-] database.db_inc_retry_interval = True {{(pid=82025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:40:17.751441 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG uwsgi [-] tokenless_auth.issuer_attribute = SSL_CLIENT_I_DN {{(pid=82026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:40:17.751559 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG uwsgi [-] database.db_max_retries = 20 {{(pid=82025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:40:17.751675 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG uwsgi [-] tokenless_auth.protocol = x509 {{(pid=82026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:40:17.751791 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG uwsgi [-] database.db_max_retry_interval = 10 {{(pid=82025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:40:17.751911 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG uwsgi [-] tokenless_auth.trusted_issuer = [] {{(pid=82026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:40:17.752013 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG uwsgi [-] database.db_retry_interval = 1 {{(pid=82025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:40:17.752127 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG uwsgi [-] totp.included_previous_windows = 1 {{(pid=82026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:40:17.752244 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG uwsgi [-] database.max_overflow = 50 {{(pid=82025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:40:17.752360 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG uwsgi [-] trust.allow_redelegation = False {{(pid=82026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:40:17.752477 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG uwsgi [-] database.max_pool_size = 5 {{(pid=82025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:40:17.752601 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG uwsgi [-] trust.driver = sql {{(pid=82026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:40:17.752719 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG uwsgi [-] database.max_retries = 10 {{(pid=82025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:40:17.752836 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG uwsgi [-] trust.max_redelegation_count = 3 {{(pid=82026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:40:17.752952 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG uwsgi [-] database.mysql_enable_ndb = False {{(pid=82025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:40:17.753070 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG uwsgi [-] unified_limit.cache_time = None {{(pid=82026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:40:17.753186 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG uwsgi [-] database.mysql_sql_mode = TRADITIONAL {{(pid=82025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:40:17.753311 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG uwsgi [-] unified_limit.caching = True {{(pid=82026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:40:17.753429 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG uwsgi [-] database.pool_timeout = None {{(pid=82025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:40:17.753546 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG uwsgi [-] unified_limit.driver = sql {{(pid=82026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:40:17.753663 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG uwsgi [-] database.retry_interval = 10 {{(pid=82025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:40:17.753779 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG uwsgi [-] unified_limit.enforcement_model = flat {{(pid=82026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:40:17.754011 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG uwsgi [-] database.slave_connection = **** {{(pid=82025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:40:17.754139 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG uwsgi [-] unified_limit.list_limit = None {{(pid=82026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:40:17.754267 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG uwsgi [-] database.sqlite_synchronous = True {{(pid=82025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:40:17.754458 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG uwsgi [-] wsgi.debug_middleware = False {{(pid=82026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:40:17.754583 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG uwsgi [-] database.use_db_reconnect = False {{(pid=82025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:40:17.754583 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=82025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Sep 13 19:40:17.754804 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG uwsgi [-] database.backend = sqlalchemy {{(pid=82026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:40:17.754804 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG uwsgi [-] database.connection = **** {{(pid=82026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:40:17.754804 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG uwsgi [-] database.connection_debug = 0 {{(pid=82026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:40:17.754804 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG uwsgi [-] database.connection_parameters = {{(pid=82026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:40:17.754804 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG uwsgi [-] database.connection_recycle_time = 3600 {{(pid=82026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:40:17.754804 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG uwsgi [-] database.connection_trace = False {{(pid=82026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:40:17.755466 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG uwsgi [-] database.db_inc_retry_interval = True {{(pid=82026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:40:17.755466 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG uwsgi [-] database.db_max_retries = 20 {{(pid=82026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:40:17.755466 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG uwsgi [-] database.db_max_retry_interval = 10 {{(pid=82026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:40:17.755802 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG uwsgi [-] database.db_retry_interval = 1 {{(pid=82026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:40:17.755802 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG uwsgi [-] database.max_overflow = 50 {{(pid=82026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:40:17.756020 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG uwsgi [-] database.max_pool_size = 5 {{(pid=82026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:40:17.756249 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG uwsgi [-] database.max_retries = 10 {{(pid=82026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:40:17.756491 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG uwsgi [-] database.mysql_enable_ndb = False {{(pid=82026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:40:17.756747 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG uwsgi [-] database.mysql_sql_mode = TRADITIONAL {{(pid=82026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:40:17.756989 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG uwsgi [-] database.pool_timeout = None {{(pid=82026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:40:17.757240 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG uwsgi [-] database.retry_interval = 10 {{(pid=82026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:40:17.757478 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG uwsgi [-] database.slave_connection = **** {{(pid=82026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:40:17.757726 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG uwsgi [-] database.sqlite_synchronous = True {{(pid=82026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:40:17.757967 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG uwsgi [-] database.use_db_reconnect = False {{(pid=82026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:40:17.758142 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=82026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Sep 13 19:40:17.783430 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.deleted`. {{(pid=82025) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 13 19:40:17.783662 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.disabled`. {{(pid=82025) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 13 19:40:17.783893 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_assignment_removal` subscribed to event `identity.remove_application_credentials_for_user.internal`. {{(pid=82025) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 13 19:40:17.785203 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.deleted`. {{(pid=82026) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 13 19:40:17.785445 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.disabled`. {{(pid=82026) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 13 19:40:17.785680 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_assignment_removal` subscribed to event `identity.remove_application_credentials_for_user.internal`. {{(pid=82026) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 13 19:40:17.792224 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.notifications [-] Callback: `keystone.assignment.core.Manager._delete_domain_assignments` subscribed to event `identity.domain.deleted`. {{(pid=82025) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 13 19:40:17.795063 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.notifications [-] Callback: `keystone.assignment.core.Manager._delete_domain_assignments` subscribed to event `identity.domain.deleted`. {{(pid=82026) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 13 19:40:17.821165 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.project.deleted`. {{(pid=82025) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 13 19:40:17.821397 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.endpoint.deleted`. {{(pid=82025) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 13 19:40:17.822062 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.project.deleted`. {{(pid=82026) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 13 19:40:17.822304 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.endpoint.deleted`. {{(pid=82026) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 13 19:40:17.883999 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.notifications [-] Callback: `keystone.federation.core.Manager._cleanup_identity_provider` subscribed to event `identity.domain_deleted.internal`. {{(pid=82025) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 13 19:40:17.894251 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.notifications [-] Callback: `keystone.federation.core.Manager._cleanup_identity_provider` subscribed to event `identity.domain_deleted.internal`. {{(pid=82026) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 13 19:40:17.938902 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._domain_deleted` subscribed to event `identity.domain_deleted.internal`. {{(pid=82026) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 13 19:40:17.939155 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._unset_default_project` subscribed to event `identity.project.deleted`. {{(pid=82026) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 13 19:40:17.943655 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._domain_deleted` subscribed to event `identity.domain_deleted.internal`. {{(pid=82025) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 13 19:40:17.943894 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._unset_default_project` subscribed to event `identity.project.deleted`. {{(pid=82025) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 13 19:40:18.102834 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._trust_callback` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=82026) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 13 19:40:18.103092 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._consumer_callback` subscribed to event `identity.OS-OAUTH1:consumer.deleted`. {{(pid=82026) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 13 19:40:18.103315 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.deleted`. {{(pid=82026) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 13 19:40:18.103539 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._project_callback` subscribed to event `identity.project.deleted`. {{(pid=82026) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 13 19:40:18.103762 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.disabled`. {{(pid=82026) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 13 19:40:18.103982 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.persist_revocation_event_for_user.internal`. {{(pid=82026) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 13 19:40:18.104187 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._trust_callback` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=82025) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 13 19:40:18.104429 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._consumer_callback` subscribed to event `identity.OS-OAUTH1:consumer.deleted`. {{(pid=82025) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 13 19:40:18.104662 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.deleted`. {{(pid=82025) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 13 19:40:18.104887 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._project_callback` subscribed to event `identity.project.deleted`. {{(pid=82025) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 13 19:40:18.105110 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.disabled`. {{(pid=82025) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 13 19:40:18.105329 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.persist_revocation_event_for_user.internal`. {{(pid=82025) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 13 19:40:18.136812 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=82026) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 13 19:40:18.136991 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.deleted`. {{(pid=82026) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 13 19:40:18.137161 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=82025) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 13 19:40:18.137246 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.deleted`. {{(pid=82026) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 13 19:40:18.137990 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.disabled`. {{(pid=82026) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 13 19:40:18.138084 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.deleted`. {{(pid=82025) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 13 19:40:18.138230 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.disabled`. {{(pid=82026) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 13 19:40:18.138312 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.deleted`. {{(pid=82025) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 13 19:40:18.138436 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.project.disabled`. {{(pid=82026) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 13 19:40:18.138516 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.disabled`. {{(pid=82025) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 13 19:40:18.138626 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=82026) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 13 19:40:18.138722 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.disabled`. {{(pid=82025) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 13 19:40:18.138930 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.project.disabled`. {{(pid=82025) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 13 19:40:18.139181 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=82025) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 13 19:40:18.149751 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.notifications [-] Callback: `keystone.trust.core.Manager._on_user_delete` subscribed to event `identity.user.deleted`. {{(pid=82026) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 13 19:40:18.150169 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.notifications [-] Callback: `keystone.trust.core.Manager._on_user_delete` subscribed to event `identity.user.deleted`. {{(pid=82025) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 13 19:40:18.162705 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=82025) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 13 19:40:18.162951 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.deleted`. {{(pid=82025) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 13 19:40:18.163213 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.deleted`. {{(pid=82025) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 13 19:40:18.163444 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.disabled`. {{(pid=82025) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 13 19:40:18.163553 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=82026) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 13 19:40:18.163657 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.disabled`. {{(pid=82025) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 13 19:40:18.163792 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.deleted`. {{(pid=82026) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 13 19:40:18.163876 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.project.disabled`. {{(pid=82025) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 13 19:40:18.164025 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.deleted`. {{(pid=82026) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 13 19:40:18.164500 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=82025) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 13 19:40:18.164594 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.disabled`. {{(pid=82026) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 13 19:40:18.164683 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.disabled`. {{(pid=82026) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 13 19:40:18.164864 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.project.disabled`. {{(pid=82026) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 13 19:40:18.165086 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=82026) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 13 19:40:18.183483 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/projects' {}] {{(pid=82026) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 13 19:40:18.183687 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/projects' {}] {{(pid=82026) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Sep 13 19:40:18.184030 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/domains' {}] {{(pid=82026) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 13 19:40:18.184305 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/domains' {}] {{(pid=82026) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Sep 13 19:40:18.185128 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/system' {}] {{(pid=82026) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 13 19:40:18.185350 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/catalog' {}] {{(pid=82026) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 13 19:40:18.185615 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens/OS-PKI/revoked' {}] {{(pid=82026) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 13 19:40:18.185875 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens' {}] {{(pid=82026) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 13 19:40:18.187268 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/projects' {}] {{(pid=82025) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 13 19:40:18.187488 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/projects' {}] {{(pid=82025) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Sep 13 19:40:18.190297 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/domains' {}] {{(pid=82025) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 13 19:40:18.190513 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/domains' {}] {{(pid=82025) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Sep 13 19:40:18.190801 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/system' {}] {{(pid=82025) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 13 19:40:18.191094 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/catalog' {}] {{(pid=82025) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 13 19:40:18.191366 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens/OS-PKI/revoked' {}] {{(pid=82025) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 13 19:40:18.191632 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens' {}] {{(pid=82025) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 13 19:40:18.195487 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2' {}] {{(pid=82026) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 13 19:40:18.195771 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2/ecp' {}] {{(pid=82026) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 13 19:40:18.196045 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/websso/' {}] {{(pid=82026) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 13 19:40:18.196328 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/identity_providers//protocols//websso' {}] {{(pid=82026) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 13 19:40:18.201393 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2' {}] {{(pid=82025) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 13 19:40:18.201684 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2/ecp' {}] {{(pid=82025) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 13 19:40:18.201966 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/websso/' {}] {{(pid=82025) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 13 19:40:18.202259 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/identity_providers//protocols//websso' {}] {{(pid=82025) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 13 19:40:18.203649 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.common [-] Adding standard routes to API credentials for `type` (API Prefix: ) [/credentials, /credentials/] {{(pid=82026) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 13 19:40:18.206661 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.common [-] Adding standard routes to API domains for `type` (API Prefix: ) [/domains, /domains/] {{(pid=82026) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 13 19:40:18.206952 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config' {}] {{(pid=82026) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 13 19:40:18.207264 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config/' {}] {{(pid=82026) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 13 19:40:18.207554 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config//' {}] {{(pid=82026) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 13 19:40:18.207843 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config/default' {}] {{(pid=82026) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 13 19:40:18.208110 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config//default' {}] {{(pid=82026) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 13 19:40:18.208469 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config///default' {}] {{(pid=82026) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 13 19:40:18.208757 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles' {}] {{(pid=82026) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 13 19:40:18.209236 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.common [-] Adding standard routes to API credentials for `type` (API Prefix: ) [/credentials, /credentials/] {{(pid=82025) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 13 19:40:18.209952 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles/' {}] {{(pid=82026) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 13 19:40:18.210240 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles' {}] {{(pid=82026) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 13 19:40:18.210520 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles/' {}] {{(pid=82026) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 13 19:40:18.212147 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.common [-] Adding standard routes to API domains for `type` (API Prefix: ) [/domains, /domains/] {{(pid=82025) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 13 19:40:18.212444 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config' {}] {{(pid=82025) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 13 19:40:18.212733 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config/' {}] {{(pid=82025) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 13 19:40:18.213022 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config//' {}] {{(pid=82025) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 13 19:40:18.213314 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config/default' {}] {{(pid=82025) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 13 19:40:18.213582 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config//default' {}] {{(pid=82025) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 13 19:40:18.213857 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config///default' {}] {{(pid=82025) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 13 19:40:18.214136 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles' {}] {{(pid=82025) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 13 19:40:18.214413 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles/' {}] {{(pid=82025) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 13 19:40:18.214692 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles' {}] {{(pid=82025) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 13 19:40:18.214969 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles/' {}] {{(pid=82025) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 13 19:40:18.236677 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.common [-] Adding resource routes to API ec2tokens: ['/ec2tokens' {}] {{(pid=82026) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 13 19:40:18.238266 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.common [-] Adding standard routes to API endpoints for `type` (API Prefix: ) [/endpoints, /endpoints/] {{(pid=82026) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 13 19:40:18.238557 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.common [-] Adding resource routes to API endpoints: ['/endpoints//OS-ENDPOINT-POLICY/policy' {}] {{(pid=82026) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 13 19:40:18.239182 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.common [-] Adding resource routes to API ec2tokens: ['/ec2tokens' {}] {{(pid=82025) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 13 19:40:18.240660 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.common [-] Adding standard routes to API endpoints for `type` (API Prefix: ) [/endpoints, /endpoints/] {{(pid=82025) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 13 19:40:18.240955 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.common [-] Adding resource routes to API endpoints: ['/endpoints//OS-ENDPOINT-POLICY/policy' {}] {{(pid=82025) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 13 19:40:18.243350 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.common [-] Adding standard routes to API groups for `type` (API Prefix: ) [/groups, /groups/] {{(pid=82026) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 13 19:40:18.243637 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users' {}] {{(pid=82026) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 13 19:40:18.243925 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users/' {}] {{(pid=82026) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 13 19:40:18.245479 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.common [-] Adding standard routes to API groups for `type` (API Prefix: ) [/groups, /groups/] {{(pid=82025) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 13 19:40:18.245776 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users' {}] {{(pid=82025) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 13 19:40:18.246174 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users/' {}] {{(pid=82025) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 13 19:40:18.250961 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.common [-] Adding standard routes to API limits for `type` (API Prefix: ) [/limits, /limits/] {{(pid=82026) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 13 19:40:18.256213 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.common [-] Adding resource routes to API limits: ['/limits/model' {}] {{(pid=82026) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 13 19:40:18.256297 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.common [-] Adding standard routes to API limits for `type` (API Prefix: ) [/limits, /limits/] {{(pid=82025) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 13 19:40:18.256297 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.common [-] Adding resource routes to API limits: ['/limits/model' {}] {{(pid=82025) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 13 19:40:18.257058 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-EP-FILTER for `type` (API Prefix: /OS-EP-FILTER) [/endpoint_groups, /endpoint_groups/] {{(pid=82026) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 13 19:40:18.257363 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoints//projects' {}] {{(pid=82026) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 13 19:40:18.257444 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-EP-FILTER for `type` (API Prefix: /OS-EP-FILTER) [/endpoint_groups, /endpoint_groups/] {{(pid=82025) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 13 19:40:18.257662 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints/' {}] {{(pid=82026) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 13 19:40:18.257745 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoints//projects' {}] {{(pid=82025) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 13 19:40:18.257960 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints/' {}] {{(pid=82025) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 13 19:40:18.258040 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints' {}] {{(pid=82026) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 13 19:40:18.258242 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoint_groups' {}] {{(pid=82026) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 13 19:40:18.258530 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//endpoints' {}] {{(pid=82026) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 13 19:40:18.258812 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects' {}] {{(pid=82026) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 13 19:40:18.259121 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects/' {}] {{(pid=82026) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 13 19:40:18.260100 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints' {}] {{(pid=82025) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 13 19:40:18.260398 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoint_groups' {}] {{(pid=82025) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 13 19:40:18.260689 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//endpoints' {}] {{(pid=82025) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 13 19:40:18.260974 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects' {}] {{(pid=82025) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 13 19:40:18.261256 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects/' {}] {{(pid=82025) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 13 19:40:18.274795 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/saml2/metadata' {}] {{(pid=82026) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 13 19:40:18.275107 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/identity_providers//protocols//auth' {}] {{(pid=82026) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 13 19:40:18.276915 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/saml2/metadata' {}] {{(pid=82025) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 13 19:40:18.277202 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/identity_providers//protocols//auth' {}] {{(pid=82025) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 13 19:40:18.279331 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.common [-] Adding standard routes to API identity_providers for `type` (API Prefix: /OS-FEDERATION) [/identity_providers, /identity_providers/] {{(pid=82026) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 13 19:40:18.281121 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.common [-] Adding standard routes to API identity_providers for `type` (API Prefix: /OS-FEDERATION) [/identity_providers, /identity_providers/] {{(pid=82025) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 13 19:40:18.282546 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols/' {}] {{(pid=82026) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 13 19:40:18.282849 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols' {}] {{(pid=82026) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 13 19:40:18.284257 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols/' {}] {{(pid=82025) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 13 19:40:18.284678 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols' {}] {{(pid=82025) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 13 19:40:18.287190 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.common [-] Adding standard routes to API mappings for `type` (API Prefix: /OS-FEDERATION) [/mappings, /mappings/] {{(pid=82026) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 13 19:40:18.288894 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.common [-] Adding standard routes to API mappings for `type` (API Prefix: /OS-FEDERATION) [/mappings, /mappings/] {{(pid=82025) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 13 19:40:18.290326 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.common [-] Adding standard routes to API service_providers for `type` (API Prefix: /OS-FEDERATION) [/service_providers, /service_providers/] {{(pid=82026) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 13 19:40:18.292021 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.common [-] Adding standard routes to API service_providers for `type` (API Prefix: /OS-FEDERATION) [/service_providers, /service_providers/] {{(pid=82025) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 13 19:40:18.293531 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles//inherited_to_projects' {}] {{(pid=82026) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 13 19:40:18.294391 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles/inherited_to_projects' {}] {{(pid=82026) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 13 19:40:18.294653 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles//inherited_to_projects' {}] {{(pid=82026) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 13 19:40:18.298013 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles/inherited_to_projects' {}] {{(pid=82026) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 13 19:40:18.298013 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//users//roles//inherited_to_projects' {}] {{(pid=82026) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 13 19:40:18.298013 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//groups//roles//inherited_to_projects' {}] {{(pid=82026) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 13 19:40:18.298210 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles//inherited_to_projects' {}] {{(pid=82025) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 13 19:40:18.298210 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles/inherited_to_projects' {}] {{(pid=82025) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 13 19:40:18.298210 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles//inherited_to_projects' {}] {{(pid=82025) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 13 19:40:18.298210 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles/inherited_to_projects' {}] {{(pid=82025) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 13 19:40:18.298210 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//users//roles//inherited_to_projects' {}] {{(pid=82025) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 13 19:40:18.298210 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//groups//roles//inherited_to_projects' {}] {{(pid=82025) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 13 19:40:18.311931 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-OAUTH1 for `type` (API Prefix: /OS-OAUTH1) [/consumers, /consumers/] {{(pid=82026) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 13 19:40:18.312225 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/request_token' {}] {{(pid=82026) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 13 19:40:18.322236 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/access_token' {}] {{(pid=82026) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 13 19:40:18.322236 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/authorize/' {}] {{(pid=82026) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 13 19:40:18.322367 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-OAUTH1 for `type` (API Prefix: /OS-OAUTH1) [/consumers, /consumers/] {{(pid=82025) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 13 19:40:18.322367 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/request_token' {}] {{(pid=82025) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 13 19:40:18.322367 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/access_token' {}] {{(pid=82025) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 13 19:40:18.322367 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/authorize/' {}] {{(pid=82025) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 13 19:40:18.322592 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH2: ['/token' {}] {{(pid=82026) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 13 19:40:18.322655 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH2: ['/token' {}] {{(pid=82025) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 13 19:40:18.322715 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.common [-] Adding resource routes to API events: ['/events' {}] {{(pid=82026) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 13 19:40:18.322784 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.common [-] Adding resource routes to API events: ['/events' {}] {{(pid=82025) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 13 19:40:18.322848 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/ca' {}] {{(pid=82026) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 13 19:40:18.322848 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/certificates' {}] {{(pid=82026) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 13 19:40:18.323873 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/ca' {}] {{(pid=82025) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 13 19:40:18.324159 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/certificates' {}] {{(pid=82025) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 13 19:40:18.325437 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.common [-] Adding standard routes to API policy for `type` (API Prefix: ) [/policies, /policies/] {{(pid=82026) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 13 19:40:18.325725 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints' {}] {{(pid=82026) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 13 19:40:18.326011 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints/' {}] {{(pid=82026) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 13 19:40:18.326300 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services/' {}] {{(pid=82026) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 13 19:40:18.326689 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services//regions/' {}] {{(pid=82026) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 13 19:40:18.326855 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.common [-] Adding standard routes to API policy for `type` (API Prefix: ) [/policies, /policies/] {{(pid=82025) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 13 19:40:18.327173 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints' {}] {{(pid=82025) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 13 19:40:18.327463 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints/' {}] {{(pid=82025) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 13 19:40:18.327753 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services/' {}] {{(pid=82025) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 13 19:40:18.328050 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services//regions/' {}] {{(pid=82025) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 13 19:40:18.337786 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.common [-] Adding standard routes to API projects for `type` (API Prefix: ) [/projects, /projects/] {{(pid=82026) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 13 19:40:18.338074 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags' {}] {{(pid=82026) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 13 19:40:18.338360 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags/' {}] {{(pid=82026) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 13 19:40:18.338650 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles/' {}] {{(pid=82026) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 13 19:40:18.339057 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles' {}] {{(pid=82026) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 13 19:40:18.339248 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.common [-] Adding standard routes to API projects for `type` (API Prefix: ) [/projects, /projects/] {{(pid=82025) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 13 19:40:18.339333 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles/' {}] {{(pid=82026) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 13 19:40:18.339542 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags' {}] {{(pid=82025) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 13 19:40:18.339627 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles' {}] {{(pid=82026) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 13 19:40:18.339830 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags/' {}] {{(pid=82025) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 13 19:40:18.340119 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles/' {}] {{(pid=82025) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 13 19:40:18.340418 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles' {}] {{(pid=82025) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 13 19:40:18.340849 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles/' {}] {{(pid=82025) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 13 19:40:18.341090 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles' {}] {{(pid=82025) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 13 19:40:18.355282 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.common [-] Adding standard routes to API regions for `type` (API Prefix: ) [/regions, /regions/] {{(pid=82026) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 13 19:40:18.356904 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.common [-] Adding standard routes to API regions for `type` (API Prefix: ) [/regions, /regions/] {{(pid=82025) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 13 19:40:18.358801 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.common [-] Adding standard routes to API registered_limit for `type` (API Prefix: ) [/registered_limits, /registered_limits/] {{(pid=82026) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 13 19:40:18.359956 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.common [-] Adding standard routes to API registered_limit for `type` (API Prefix: ) [/registered_limits, /registered_limits/] {{(pid=82025) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 13 19:40:18.361703 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_assignments: ['/role_assignments' {}] {{(pid=82026) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 13 19:40:18.362843 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_assignments: ['/role_assignments' {}] {{(pid=82025) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 13 19:40:18.363159 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_inferences: ['/role_inferences' {}] {{(pid=82026) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 13 19:40:18.364336 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_inferences: ['/role_inferences' {}] {{(pid=82025) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 13 19:40:18.367717 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.common [-] Adding standard routes to API roles for `type` (API Prefix: ) [/roles, /roles/] {{(pid=82026) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 13 19:40:18.367717 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies' {}] {{(pid=82026) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 13 19:40:18.367717 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies/' {}] {{(pid=82026) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 13 19:40:18.367895 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.common [-] Adding standard routes to API roles for `type` (API Prefix: ) [/roles, /roles/] {{(pid=82025) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 13 19:40:18.367895 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies' {}] {{(pid=82025) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 13 19:40:18.367895 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies/' {}] {{(pid=82025) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 13 19:40:18.372375 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.common [-] Adding resource routes to API s3tokens: ['/s3tokens' {}] {{(pid=82026) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 13 19:40:18.373524 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.common [-] Adding resource routes to API s3tokens: ['/s3tokens' {}] {{(pid=82025) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 13 19:40:18.374080 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.common [-] Adding standard routes to API services for `type` (API Prefix: ) [/services, /services/] {{(pid=82026) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 13 19:40:18.374973 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.common [-] Adding standard routes to API services for `type` (API Prefix: ) [/services, /services/] {{(pid=82025) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 13 19:40:18.377016 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles' {}] {{(pid=82026) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 13 19:40:18.377415 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles/' {}] {{(pid=82026) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 13 19:40:18.377706 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles' {}] {{(pid=82026) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 13 19:40:18.377860 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles' {}] {{(pid=82025) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 13 19:40:18.378020 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles/' {}] {{(pid=82026) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 13 19:40:18.378159 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles/' {}] {{(pid=82025) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 13 19:40:18.378436 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles' {}] {{(pid=82025) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 13 19:40:18.378719 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles/' {}] {{(pid=82025) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 13 19:40:18.385771 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.common [-] Adding standard routes to API trusts for `type` (API Prefix: /OS-TRUST) [/trusts, /trusts/] {{(pid=82026) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 13 19:40:18.386061 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles' {}] {{(pid=82026) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 13 19:40:18.386346 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles/' {}] {{(pid=82026) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 13 19:40:18.390843 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.common [-] Adding standard routes to API trusts for `type` (API Prefix: /OS-TRUST) [/trusts, /trusts/] {{(pid=82025) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 13 19:40:18.390843 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles' {}] {{(pid=82025) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 13 19:40:18.390843 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles/' {}] {{(pid=82025) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 13 19:40:18.393388 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.common [-] Adding standard routes to API users for `type` (API Prefix: ) [/users, /users/] {{(pid=82026) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 13 19:40:18.393679 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//password' {}] {{(pid=82026) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 13 19:40:18.393963 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//groups' {}] {{(pid=82026) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 13 19:40:18.394048 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.common [-] Adding standard routes to API users for `type` (API Prefix: ) [/users, /users/] {{(pid=82025) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 13 19:40:18.394241 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//projects' {}] {{(pid=82026) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 13 19:40:18.394335 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//password' {}] {{(pid=82025) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 13 19:40:18.394518 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2' {}] {{(pid=82026) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 13 19:40:18.394603 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//groups' {}] {{(pid=82025) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 13 19:40:18.394802 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2/' {}] {{(pid=82026) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 13 19:40:18.394889 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//projects' {}] {{(pid=82025) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 13 19:40:18.395102 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens' {}] {{(pid=82026) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 13 19:40:18.395189 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2' {}] {{(pid=82025) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 13 19:40:18.395384 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens/' {}] {{(pid=82026) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 13 19:40:18.395487 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2/' {}] {{(pid=82025) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 13 19:40:18.395658 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles' {}] {{(pid=82026) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 13 19:40:18.395742 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens' {}] {{(pid=82025) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 13 19:40:18.395937 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles/' {}] {{(pid=82026) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 13 19:40:18.396020 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens/' {}] {{(pid=82025) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 13 19:40:18.396209 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles' {}] {{(pid=82025) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 13 19:40:18.396293 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials' {}] {{(pid=82026) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 13 19:40:18.396502 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles/' {}] {{(pid=82025) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 13 19:40:18.396584 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials/' {}] {{(pid=82026) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 13 19:40:18.396787 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials' {}] {{(pid=82025) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 13 19:40:18.396879 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules' {}] {{(pid=82026) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 13 19:40:18.397063 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials/' {}] {{(pid=82025) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 13 19:40:18.397146 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules/' {}] {{(pid=82026) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 13 19:40:18.397334 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules' {}] {{(pid=82025) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 13 19:40:18.397609 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules/' {}] {{(pid=82025) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 13 19:40:18.431995 dv-cinder-828806-6-smb devstack@keystone.service[82025]: WSGI app 0 (mountpoint='') ready in 5 seconds on interpreter 0x564c962439c0 pid: 82025 (default app) Sep 13 19:40:18.432202 dv-cinder-828806-6-smb devstack@keystone.service[82026]: WSGI app 0 (mountpoint='') ready in 5 seconds on interpreter 0x564c962439c0 pid: 82026 (default app) Sep 13 19:40:18.435533 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e482ce6a-3ce8-4bee-aa1d-df4f37318cef None None] REQUEST_METHOD: `GET` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:40:18.435823 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e482ce6a-3ce8-4bee-aa1d-df4f37318cef None None] SCRIPT_NAME: `/identity` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:40:18.436100 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e482ce6a-3ce8-4bee-aa1d-df4f37318cef None None] PATH_INFO: `/v3` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:40:18.440403 dv-cinder-828806-6-smb devstack@keystone.service[82026]: [pid: 82026|app: 0|req: 1/1] 10.222.0.33 () {50 vars in 791 bytes} [Tue Sep 13 19:40:18 2022] GET /identity/v3/ => generated 255 bytes in 8 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 19:40:26.254092 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2669eb1-c622-493a-b121-af76664b03fc None None] REQUEST_METHOD: `GET` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:40:26.254617 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2669eb1-c622-493a-b121-af76664b03fc None None] SCRIPT_NAME: `/identity` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:40:26.254698 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2669eb1-c622-493a-b121-af76664b03fc None None] PATH_INFO: `/` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:40:26.258953 dv-cinder-828806-6-smb devstack@keystone.service[82025]: [pid: 82025|app: 0|req: 1/2] 10.222.0.33 () {54 vars in 927 bytes} [Tue Sep 13 19:40:26 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 13 19:40:26.264718 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-695c0f67-2db5-4266-be78-1d419dc7787a None None] REQUEST_METHOD: `POST` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:40:26.265151 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-695c0f67-2db5-4266-be78-1d419dc7787a None None] SCRIPT_NAME: `/identity` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:40:26.265282 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-695c0f67-2db5-4266-be78-1d419dc7787a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:40:26.337329 dv-cinder-828806-6-smb devstack@keystone.service[82026]: INFO dbcounter [None req-695c0f67-2db5-4266-be78-1d419dc7787a None None] Registered counter for database keystone Sep 13 19:40:26.358072 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG oslo_db.sqlalchemy.engines [None req-695c0f67-2db5-4266-be78-1d419dc7787a None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=82026) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 13 19:40:26.364345 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG dbcounter [-] [82026] Writer thread running {{(pid=82026) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 13 19:40:26.546300 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG passlib.handlers.bcrypt [None req-695c0f67-2db5-4266-be78-1d419dc7787a None None] detected 'bcrypt' backend, version '4.0.0' {{(pid=82026) _load_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:625}} Sep 13 19:40:26.546688 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG passlib.handlers.bcrypt [None req-695c0f67-2db5-4266-be78-1d419dc7787a None None] 'bcrypt' backend lacks $2$ support, enabling workaround {{(pid=82026) _finalize_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:406}} Sep 13 19:40:26.608578 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.auth.core [None req-695c0f67-2db5-4266-be78-1d419dc7787a None None] MFA Rules not processed for user `57539b6a6f3b4d589f5f5e1d211cd6a0`. Rule list: `[]` (Enabled: `True`). {{(pid=82026) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 19:40:26.610198 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.common.fernet_utils [None req-695c0f67-2db5-4266-be78-1d419dc7787a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82026) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 19:40:26.737106 dv-cinder-828806-6-smb devstack@keystone.service[82026]: [pid: 82026|app: 0|req: 2/3] 10.222.0.33 () {58 vars in 1024 bytes} [Tue Sep 13 19:40:26 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 474 msecs (HTTP/1.1 201) 6 headers in 384 bytes (2 switches on core 0) Sep 13 19:40:27.172855 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2669eb1-c622-493a-b121-af76664b03fc None None] Authenticating user token {{(pid=82025) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:40:27.241889 dv-cinder-828806-6-smb devstack@keystone.service[82025]: INFO dbcounter [None req-c2669eb1-c622-493a-b121-af76664b03fc None None] Registered counter for database keystone Sep 13 19:40:27.263704 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG oslo_db.sqlalchemy.engines [None req-c2669eb1-c622-493a-b121-af76664b03fc None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=82025) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 13 19:40:27.270097 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG dbcounter [-] [82025] Writer thread running {{(pid=82025) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 13 19:40:27.389729 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2669eb1-c622-493a-b121-af76664b03fc None None] Validating token access rules against request {{(pid=82025) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:40:27.394013 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f75f522-9867-4d7d-b482-4085eb6f1ee5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57539b6a6f3b4d589f5f5e1d211cd6a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b454f707d20347ada3d82aa85495635e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82025) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:40:27.394650 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f75f522-9867-4d7d-b482-4085eb6f1ee5 admin admin] REQUEST_METHOD: `GET` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:40:27.394936 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f75f522-9867-4d7d-b482-4085eb6f1ee5 admin admin] SCRIPT_NAME: `/identity` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:40:27.395242 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f75f522-9867-4d7d-b482-4085eb6f1ee5 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:40:27.403810 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f75f522-9867-4d7d-b482-4085eb6f1ee5 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=82025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:40:27.455138 dv-cinder-828806-6-smb devstack@keystone.service[82025]: WARNING keystone.common.rbac_enforcer.enforcer [None req-2f75f522-9867-4d7d-b482-4085eb6f1ee5 admin admin] Deprecated policy rules found. Use oslopolicy-policy-generator and oslopolicy-policy-upgrade to detect and resolve deprecated policies in your configuration. Sep 13 19:40:27.455438 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f75f522-9867-4d7d-b482-4085eb6f1ee5 admin admin] RBAC: Authorization granted {{(pid=82025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:40:27.464842 dv-cinder-828806-6-smb devstack@keystone.service[82025]: [pid: 82025|app: 0|req: 2/4] 10.222.0.33 () {58 vars in 1324 bytes} [Tue Sep 13 19:40:27 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 293 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Sep 13 19:40:27.470835 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-695c0f67-2db5-4266-be78-1d419dc7787a None None] Authenticating user token {{(pid=82026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:40:27.488324 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-695c0f67-2db5-4266-be78-1d419dc7787a None None] Validating token access rules against request {{(pid=82026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:40:27.492704 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04f27d51-b8e2-4d43-bbfe-09418477cf27 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57539b6a6f3b4d589f5f5e1d211cd6a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b454f707d20347ada3d82aa85495635e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:40:27.493806 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04f27d51-b8e2-4d43-bbfe-09418477cf27 admin admin] REQUEST_METHOD: `GET` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:40:27.494091 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04f27d51-b8e2-4d43-bbfe-09418477cf27 admin admin] SCRIPT_NAME: `/identity` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:40:27.494375 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04f27d51-b8e2-4d43-bbfe-09418477cf27 admin admin] PATH_INFO: `/v3/projects/b454f707d20347ada3d82aa85495635e` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:40:27.495984 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04f27d51-b8e2-4d43-bbfe-09418477cf27 admin admin] RBAC: Authorizing `identity:get_project(project_id=b454f707d20347ada3d82aa85495635e)` {{(pid=82026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:40:27.549923 dv-cinder-828806-6-smb devstack@keystone.service[82026]: WARNING keystone.common.rbac_enforcer.enforcer [None req-04f27d51-b8e2-4d43-bbfe-09418477cf27 admin admin] Deprecated policy rules found. Use oslopolicy-policy-generator and oslopolicy-policy-upgrade to detect and resolve deprecated policies in your configuration. Sep 13 19:40:27.550273 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04f27d51-b8e2-4d43-bbfe-09418477cf27 admin admin] RBAC: Authorization granted {{(pid=82026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:40:27.554831 dv-cinder-828806-6-smb devstack@keystone.service[82026]: [pid: 82026|app: 0|req: 3/5] 10.222.0.33 () {56 vars in 1207 bytes} [Tue Sep 13 19:40:27 2022] GET /identity/v3/projects/b454f707d20347ada3d82aa85495635e => generated 344 bytes in 85 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 13 19:40:29.748280 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a85d9703-273d-4d4f-bc0d-a4fd0fa9c4dd None None] REQUEST_METHOD: `GET` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:40:29.748792 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a85d9703-273d-4d4f-bc0d-a4fd0fa9c4dd None None] SCRIPT_NAME: `/identity` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:40:29.748878 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a85d9703-273d-4d4f-bc0d-a4fd0fa9c4dd None None] PATH_INFO: `/` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:40:29.752954 dv-cinder-828806-6-smb devstack@keystone.service[82025]: [pid: 82025|app: 0|req: 3/6] 10.222.0.33 () {54 vars in 927 bytes} [Tue Sep 13 19:40:29 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 19:40:29.758611 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e2a0f8f-a897-4ae6-81fd-45344d3dbd75 None None] REQUEST_METHOD: `POST` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:40:29.758985 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e2a0f8f-a897-4ae6-81fd-45344d3dbd75 None None] SCRIPT_NAME: `/identity` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:40:29.759223 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e2a0f8f-a897-4ae6-81fd-45344d3dbd75 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:40:29.779864 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.auth.core [None req-9e2a0f8f-a897-4ae6-81fd-45344d3dbd75 None None] MFA Rules not processed for user `57539b6a6f3b4d589f5f5e1d211cd6a0`. Rule list: `[]` (Enabled: `True`). {{(pid=82026) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 19:40:29.781405 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.common.fernet_utils [None req-9e2a0f8f-a897-4ae6-81fd-45344d3dbd75 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82026) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 19:40:29.789212 dv-cinder-828806-6-smb devstack@keystone.service[82026]: [pid: 82026|app: 0|req: 4/7] 10.222.0.33 () {58 vars in 1024 bytes} [Tue Sep 13 19:40:29 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Sep 13 19:40:30.069096 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a85d9703-273d-4d4f-bc0d-a4fd0fa9c4dd None None] Authenticating user token {{(pid=82025) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:40:30.083362 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a85d9703-273d-4d4f-bc0d-a4fd0fa9c4dd None None] Validating token access rules against request {{(pid=82025) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:40:30.087539 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee0bbacb-b355-48a8-b34e-ebda4d077adf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57539b6a6f3b4d589f5f5e1d211cd6a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b454f707d20347ada3d82aa85495635e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82025) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:40:30.088167 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee0bbacb-b355-48a8-b34e-ebda4d077adf admin admin] REQUEST_METHOD: `GET` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:40:30.088448 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee0bbacb-b355-48a8-b34e-ebda4d077adf admin admin] SCRIPT_NAME: `/identity` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:40:30.088725 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee0bbacb-b355-48a8-b34e-ebda4d077adf admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:40:30.096641 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee0bbacb-b355-48a8-b34e-ebda4d077adf admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=82025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:40:30.098683 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee0bbacb-b355-48a8-b34e-ebda4d077adf admin admin] RBAC: Authorization granted {{(pid=82025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:40:30.107923 dv-cinder-828806-6-smb devstack@keystone.service[82025]: [pid: 82025|app: 0|req: 4/8] 10.222.0.33 () {58 vars in 1324 bytes} [Tue Sep 13 19:40:30 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Sep 13 19:40:30.113495 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e2a0f8f-a897-4ae6-81fd-45344d3dbd75 None None] Authenticating user token {{(pid=82026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:40:30.123295 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e2a0f8f-a897-4ae6-81fd-45344d3dbd75 None None] Validating token access rules against request {{(pid=82026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:40:30.127650 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66d1e1ae-5363-4bbc-9b4c-06046e0b815a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57539b6a6f3b4d589f5f5e1d211cd6a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b454f707d20347ada3d82aa85495635e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:40:30.128271 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66d1e1ae-5363-4bbc-9b4c-06046e0b815a admin admin] REQUEST_METHOD: `GET` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:40:30.128554 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66d1e1ae-5363-4bbc-9b4c-06046e0b815a admin admin] SCRIPT_NAME: `/identity` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:40:30.128828 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66d1e1ae-5363-4bbc-9b4c-06046e0b815a admin admin] PATH_INFO: `/v3/users/57539b6a6f3b4d589f5f5e1d211cd6a0` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:40:30.130123 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66d1e1ae-5363-4bbc-9b4c-06046e0b815a admin admin] RBAC: Authorizing `identity:get_user(user_id=57539b6a6f3b4d589f5f5e1d211cd6a0)` {{(pid=82026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:40:30.131983 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66d1e1ae-5363-4bbc-9b4c-06046e0b815a admin admin] RBAC: Authorization granted {{(pid=82026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:40:30.133485 dv-cinder-828806-6-smb devstack@keystone.service[82026]: [pid: 82026|app: 0|req: 5/9] 10.222.0.33 () {56 vars in 1198 bytes} [Tue Sep 13 19:40:30 2022] GET /identity/v3/users/57539b6a6f3b4d589f5f5e1d211cd6a0 => generated 247 bytes in 20 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 19:40:32.338259 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5c4d32e-aae3-4a49-80d0-52abadaec41d None None] REQUEST_METHOD: `GET` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:40:32.338744 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5c4d32e-aae3-4a49-80d0-52abadaec41d None None] SCRIPT_NAME: `/identity` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:40:32.338828 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5c4d32e-aae3-4a49-80d0-52abadaec41d None None] PATH_INFO: `/` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:40:32.340192 dv-cinder-828806-6-smb devstack@keystone.service[82025]: [pid: 82025|app: 0|req: 5/10] 10.222.0.33 () {54 vars in 927 bytes} [Tue Sep 13 19:40:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 13 19:40:32.345979 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-298ab50a-2f46-4cbb-b2b9-4908a96f7565 None None] REQUEST_METHOD: `POST` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:40:32.346424 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-298ab50a-2f46-4cbb-b2b9-4908a96f7565 None None] SCRIPT_NAME: `/identity` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:40:32.346640 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-298ab50a-2f46-4cbb-b2b9-4908a96f7565 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:40:32.365234 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.auth.core [None req-298ab50a-2f46-4cbb-b2b9-4908a96f7565 None None] MFA Rules not processed for user `57539b6a6f3b4d589f5f5e1d211cd6a0`. Rule list: `[]` (Enabled: `True`). {{(pid=82026) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 19:40:32.366414 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.common.fernet_utils [None req-298ab50a-2f46-4cbb-b2b9-4908a96f7565 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82026) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 19:40:32.369988 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93ebe34c-0908-4221-b08e-5cd3999f0889 None None] REQUEST_METHOD: `GET` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:40:32.370281 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93ebe34c-0908-4221-b08e-5cd3999f0889 None None] SCRIPT_NAME: `/identity` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:40:32.370569 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93ebe34c-0908-4221-b08e-5cd3999f0889 None None] PATH_INFO: `/` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:40:32.371898 dv-cinder-828806-6-smb devstack@keystone.service[82025]: [pid: 82025|app: 0|req: 6/11] 10.222.0.33 () {54 vars in 927 bytes} [Tue Sep 13 19:40:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 13 19:40:32.377301 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20d2b3f6-7c3d-4844-9468-95f0c139d2f6 None None] REQUEST_METHOD: `POST` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:40:32.377591 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20d2b3f6-7c3d-4844-9468-95f0c139d2f6 None None] SCRIPT_NAME: `/identity` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:40:32.377874 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20d2b3f6-7c3d-4844-9468-95f0c139d2f6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:40:32.420580 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG passlib.handlers.bcrypt [None req-20d2b3f6-7c3d-4844-9468-95f0c139d2f6 None None] detected 'bcrypt' backend, version '4.0.0' {{(pid=82025) _load_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:625}} Sep 13 19:40:32.420986 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG passlib.handlers.bcrypt [None req-20d2b3f6-7c3d-4844-9468-95f0c139d2f6 None None] 'bcrypt' backend lacks $2$ support, enabling workaround {{(pid=82025) _finalize_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:406}} Sep 13 19:40:32.447906 dv-cinder-828806-6-smb devstack@keystone.service[82026]: [pid: 82026|app: 0|req: 6/12] 10.222.0.33 () {58 vars in 1024 bytes} [Tue Sep 13 19:40:32 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 13 19:40:32.471090 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.auth.core [None req-20d2b3f6-7c3d-4844-9468-95f0c139d2f6 None None] MFA Rules not processed for user `57539b6a6f3b4d589f5f5e1d211cd6a0`. Rule list: `[]` (Enabled: `True`). {{(pid=82025) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 19:40:32.472716 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.fernet_utils [None req-20d2b3f6-7c3d-4844-9468-95f0c139d2f6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82025) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 19:40:32.571413 dv-cinder-828806-6-smb devstack@keystone.service[82025]: [pid: 82025|app: 0|req: 7/13] 10.222.0.33 () {58 vars in 1024 bytes} [Tue Sep 13 19:40:32 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 195 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 13 19:40:32.715842 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-298ab50a-2f46-4cbb-b2b9-4908a96f7565 None None] Authenticating user token {{(pid=82026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:40:32.741294 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG dbcounter [-] [82026] Writing DB stats keystone:SELECT=100 {{(pid=82026) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:40:32.819898 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-298ab50a-2f46-4cbb-b2b9-4908a96f7565 None None] Validating token access rules against request {{(pid=82026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:40:32.853170 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98f9e4d9-67d7-4e7d-a97c-32a71a5cf564 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57539b6a6f3b4d589f5f5e1d211cd6a0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:40:32.853739 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98f9e4d9-67d7-4e7d-a97c-32a71a5cf564 None admin] REQUEST_METHOD: `GET` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:40:32.854026 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98f9e4d9-67d7-4e7d-a97c-32a71a5cf564 None admin] SCRIPT_NAME: `/identity` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:40:32.854308 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98f9e4d9-67d7-4e7d-a97c-32a71a5cf564 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:40:32.860747 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20d2b3f6-7c3d-4844-9468-95f0c139d2f6 None None] Authenticating user token {{(pid=82025) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:40:32.866035 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98f9e4d9-67d7-4e7d-a97c-32a71a5cf564 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=82026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 13 19:40:32.875288 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application [None req-98f9e4d9-67d7-4e7d-a97c-32a71a5cf564 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 13 19:40:32.875288 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 19:40:32.875288 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 19:40:32.875288 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 19:40:32.875288 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 19:40:32.875288 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 19:40:32.875288 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 19:40:32.875288 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 19:40:32.875288 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 19:40:32.875288 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 19:40:32.875288 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 19:40:32.875288 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 19:40:32.875288 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 13 19:40:32.875288 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 13 19:40:32.875288 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 13 19:40:32.875288 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 13 19:40:32.876245 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 13 19:40:32.876245 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 13 19:40:32.876245 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 13 19:40:32.876245 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 13 19:40:32.876245 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 19:40:32.876245 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 19:40:32.876245 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 19:40:32.876245 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 19:40:32.876245 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 19:40:32.876245 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 19:40:32.876245 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 19:40:32.876245 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application with Lock( Sep 13 19:40:32.876245 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 19:40:32.876245 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application return self._enter() Sep 13 19:40:32.876245 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 19:40:32.876245 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 19:40:32.877043 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 19:40:32.877043 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application return self.creator() Sep 13 19:40:32.877043 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 19:40:32.877043 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application created_value = creator( Sep 13 19:40:32.877043 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 13 19:40:32.877043 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 13 19:40:32.877043 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 13 19:40:32.877043 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 13 19:40:32.877043 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 13 19:40:32.877043 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 13 19:40:32.877043 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 13 19:40:32.877043 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application Sep 13 19:40:32.877043 dv-cinder-828806-6-smb devstack@keystone.service[82026]: [pid: 82026|app: 0|req: 7/14] 10.222.0.33 () {56 vars in 1096 bytes} [Tue Sep 13 19:40:32 2022] GET /identity/v3/roles/admin => generated 83 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 19:40:32.882073 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98f9e4d9-67d7-4e7d-a97c-32a71a5cf564 None admin] Authenticating user token {{(pid=82026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:40:32.973030 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG dbcounter [-] [82026] Writing DB stats keystone:SELECT=100 {{(pid=82026) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:40:32.978046 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20d2b3f6-7c3d-4844-9468-95f0c139d2f6 None None] Validating token access rules against request {{(pid=82025) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:40:32.980430 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG dbcounter [-] [82025] Writing DB stats keystone:SELECT=100 {{(pid=82025) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:40:32.990855 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98f9e4d9-67d7-4e7d-a97c-32a71a5cf564 None admin] Validating token access rules against request {{(pid=82026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:40:33.015956 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42f43d01-20eb-4d00-a531-b79a9f2e3ba0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57539b6a6f3b4d589f5f5e1d211cd6a0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82025) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:40:33.016820 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42f43d01-20eb-4d00-a531-b79a9f2e3ba0 None admin] REQUEST_METHOD: `GET` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:40:33.017109 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42f43d01-20eb-4d00-a531-b79a9f2e3ba0 None admin] SCRIPT_NAME: `/identity` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:40:33.017389 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42f43d01-20eb-4d00-a531-b79a9f2e3ba0 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:40:33.027728 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb4ca4e3-9680-486d-b64e-0477d4d122ba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57539b6a6f3b4d589f5f5e1d211cd6a0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:40:33.028346 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb4ca4e3-9680-486d-b64e-0477d4d122ba None admin] REQUEST_METHOD: `GET` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:40:33.028692 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb4ca4e3-9680-486d-b64e-0477d4d122ba None admin] SCRIPT_NAME: `/identity` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:40:33.028982 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb4ca4e3-9680-486d-b64e-0477d4d122ba None admin] PATH_INFO: `/v3/roles` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:40:33.029667 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb4ca4e3-9680-486d-b64e-0477d4d122ba None admin] RBAC: Adding query filter params (name=admin) {{(pid=82026) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 19:40:33.029981 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb4ca4e3-9680-486d-b64e-0477d4d122ba None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:40:33.031418 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb4ca4e3-9680-486d-b64e-0477d4d122ba None admin] RBAC: Authorization granted {{(pid=82026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:40:33.043002 dv-cinder-828806-6-smb devstack@keystone.service[82026]: [pid: 82026|app: 0|req: 8/15] 10.222.0.33 () {56 vars in 1099 bytes} [Tue Sep 13 19:40:32 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 13 19:40:33.048743 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb4ca4e3-9680-486d-b64e-0477d4d122ba None admin] Authenticating user token {{(pid=82026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:40:33.086126 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42f43d01-20eb-4d00-a531-b79a9f2e3ba0 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=82025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:40:33.087699 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42f43d01-20eb-4d00-a531-b79a9f2e3ba0 None admin] RBAC: Authorization granted {{(pid=82025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:40:33.148293 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb4ca4e3-9680-486d-b64e-0477d4d122ba None admin] Validating token access rules against request {{(pid=82026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:40:33.182578 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e00cc54-f437-4335-9037-0b603ad9876a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57539b6a6f3b4d589f5f5e1d211cd6a0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:40:33.183250 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e00cc54-f437-4335-9037-0b603ad9876a None admin] REQUEST_METHOD: `GET` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:40:33.183538 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e00cc54-f437-4335-9037-0b603ad9876a None admin] SCRIPT_NAME: `/identity` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:40:33.183821 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e00cc54-f437-4335-9037-0b603ad9876a None admin] PATH_INFO: `/v3/users/57539b6a6f3b4d589f5f5e1d211cd6a0` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:40:33.184982 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e00cc54-f437-4335-9037-0b603ad9876a None admin] RBAC: Authorizing `identity:get_user(user_id=57539b6a6f3b4d589f5f5e1d211cd6a0)` {{(pid=82026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:40:33.185966 dv-cinder-828806-6-smb devstack@keystone.service[82025]: [pid: 82025|app: 0|req: 8/16] 10.222.0.33 () {58 vars in 1282 bytes} [Tue Sep 13 19:40:32 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 326 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Sep 13 19:40:33.186539 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e00cc54-f437-4335-9037-0b603ad9876a None admin] RBAC: Authorization granted {{(pid=82026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:40:33.188345 dv-cinder-828806-6-smb devstack@keystone.service[82026]: [pid: 82026|app: 0|req: 9/17] 10.222.0.33 () {56 vars in 1177 bytes} [Tue Sep 13 19:40:33 2022] GET /identity/v3/users/57539b6a6f3b4d589f5f5e1d211cd6a0 => generated 247 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 13 19:40:33.191615 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42f43d01-20eb-4d00-a531-b79a9f2e3ba0 None admin] Authenticating user token {{(pid=82025) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:40:33.193321 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e00cc54-f437-4335-9037-0b603ad9876a None admin] Authenticating user token {{(pid=82026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:40:33.194450 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG dbcounter [-] [82025] Writing DB stats keystone:SELECT=100 {{(pid=82025) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:40:33.209295 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG dbcounter [-] [82026] Writing DB stats keystone:SELECT=100 {{(pid=82026) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:40:33.303688 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42f43d01-20eb-4d00-a531-b79a9f2e3ba0 None admin] Validating token access rules against request {{(pid=82025) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:40:33.305764 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e00cc54-f437-4335-9037-0b603ad9876a None admin] Validating token access rules against request {{(pid=82026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:40:33.338118 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c12bece-eac3-4d76-ba42-924e25478741 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57539b6a6f3b4d589f5f5e1d211cd6a0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82025) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:40:33.338962 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c12bece-eac3-4d76-ba42-924e25478741 None admin] REQUEST_METHOD: `GET` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:40:33.339537 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c12bece-eac3-4d76-ba42-924e25478741 None admin] SCRIPT_NAME: `/identity` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:40:33.339537 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c12bece-eac3-4d76-ba42-924e25478741 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:40:33.340311 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c0fea4e-4222-4cdb-abff-c06d8e297a97 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57539b6a6f3b4d589f5f5e1d211cd6a0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:40:33.341515 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c0fea4e-4222-4cdb-abff-c06d8e297a97 None admin] REQUEST_METHOD: `GET` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:40:33.342302 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c0fea4e-4222-4cdb-abff-c06d8e297a97 None admin] SCRIPT_NAME: `/identity` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:40:33.342588 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c0fea4e-4222-4cdb-abff-c06d8e297a97 None admin] PATH_INFO: `/v3/domains/default` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:40:33.343750 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c0fea4e-4222-4cdb-abff-c06d8e297a97 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=82026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:40:33.345230 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c0fea4e-4222-4cdb-abff-c06d8e297a97 None admin] RBAC: Authorization granted {{(pid=82026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:40:33.346778 dv-cinder-828806-6-smb devstack@keystone.service[82026]: [pid: 82026|app: 0|req: 10/18] 10.222.0.33 () {56 vars in 1108 bytes} [Tue Sep 13 19:40:33 2022] GET /identity/v3/domains/default => generated 199 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 13 19:40:33.352697 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c0fea4e-4222-4cdb-abff-c06d8e297a97 None admin] Authenticating user token {{(pid=82026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:40:33.358967 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c12bece-eac3-4d76-ba42-924e25478741 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=82025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:40:33.360458 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c12bece-eac3-4d76-ba42-924e25478741 None admin] RBAC: Authorization granted {{(pid=82025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:40:33.378758 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application [None req-3c12bece-eac3-4d76-ba42-924e25478741 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 13 19:40:33.378758 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 19:40:33.378758 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 19:40:33.378758 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 19:40:33.378758 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 19:40:33.378758 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 19:40:33.378758 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 19:40:33.378758 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 19:40:33.378758 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 19:40:33.378758 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 19:40:33.378758 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 19:40:33.378758 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 19:40:33.378758 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 13 19:40:33.378758 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 13 19:40:33.378758 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 13 19:40:33.378758 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 13 19:40:33.379840 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 19:40:33.379840 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 19:40:33.379840 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 19:40:33.379840 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 19:40:33.379840 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 19:40:33.379840 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 19:40:33.379840 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 19:40:33.379840 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application with Lock( Sep 13 19:40:33.379840 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 19:40:33.379840 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application return self._enter() Sep 13 19:40:33.379840 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 19:40:33.379840 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 19:40:33.379840 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 19:40:33.379840 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application return self.creator() Sep 13 19:40:33.379840 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 19:40:33.379840 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application created_value = creator( Sep 13 19:40:33.379840 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 13 19:40:33.380852 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 13 19:40:33.380852 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 13 19:40:33.380852 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application Sep 13 19:40:33.380852 dv-cinder-828806-6-smb devstack@keystone.service[82025]: [pid: 82025|app: 0|req: 9/19] 10.222.0.33 () {56 vars in 1108 bytes} [Tue Sep 13 19:40:33 2022] GET /identity/v3/domains/Default => generated 87 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 19:40:33.385803 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c12bece-eac3-4d76-ba42-924e25478741 None admin] Authenticating user token {{(pid=82025) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:40:33.438887 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG dbcounter [-] [82026] Writing DB stats keystone:SELECT=100 {{(pid=82026) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:40:33.442961 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG dbcounter [-] [82025] Writing DB stats keystone:SELECT=100 {{(pid=82025) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:40:33.458667 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c0fea4e-4222-4cdb-abff-c06d8e297a97 None admin] Validating token access rules against request {{(pid=82026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:40:33.491844 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c12bece-eac3-4d76-ba42-924e25478741 None admin] Validating token access rules against request {{(pid=82025) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:40:33.497280 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b365af05-7b37-4478-bd1e-15611b9e0674 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57539b6a6f3b4d589f5f5e1d211cd6a0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:40:33.497946 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b365af05-7b37-4478-bd1e-15611b9e0674 None admin] REQUEST_METHOD: `GET` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:40:33.498227 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b365af05-7b37-4478-bd1e-15611b9e0674 None admin] SCRIPT_NAME: `/identity` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:40:33.498503 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b365af05-7b37-4478-bd1e-15611b9e0674 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:40:33.499272 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b365af05-7b37-4478-bd1e-15611b9e0674 None admin] RBAC: Adding query filter params (role.id=e5af7d5baa93469e9e486ef21c85474e, scope.domain.id=default, user.id=57539b6a6f3b4d589f5f5e1d211cd6a0) {{(pid=82026) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 19:40:33.499635 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b365af05-7b37-4478-bd1e-15611b9e0674 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=82026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:40:33.501078 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b365af05-7b37-4478-bd1e-15611b9e0674 None admin] RBAC: Authorization granted {{(pid=82026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:40:33.507729 dv-cinder-828806-6-smb devstack@keystone.service[82026]: [pid: 82026|app: 0|req: 11/20] 10.222.0.33 () {56 vars in 1322 bytes} [Tue Sep 13 19:40:33 2022] GET /identity/v3/role_assignments?user.id=57539b6a6f3b4d589f5f5e1d211cd6a0&scope.domain.id=default&role.id=e5af7d5baa93469e9e486ef21c85474e => generated 233 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 13 19:40:33.528062 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42a5f5a4-04ff-4ec7-8651-1aa91f69783a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57539b6a6f3b4d589f5f5e1d211cd6a0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82025) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:40:33.529297 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42a5f5a4-04ff-4ec7-8651-1aa91f69783a None admin] REQUEST_METHOD: `GET` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:40:33.529579 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42a5f5a4-04ff-4ec7-8651-1aa91f69783a None admin] SCRIPT_NAME: `/identity` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:40:33.529853 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42a5f5a4-04ff-4ec7-8651-1aa91f69783a None admin] PATH_INFO: `/v3/domains` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:40:33.530522 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42a5f5a4-04ff-4ec7-8651-1aa91f69783a None admin] RBAC: Adding query filter params (name=Default) {{(pid=82025) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 19:40:33.530831 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42a5f5a4-04ff-4ec7-8651-1aa91f69783a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:40:33.532340 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42a5f5a4-04ff-4ec7-8651-1aa91f69783a None admin] RBAC: Authorization granted {{(pid=82025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:40:33.553303 dv-cinder-828806-6-smb devstack@keystone.service[82025]: [pid: 82025|app: 0|req: 10/21] 10.222.0.33 () {56 vars in 1109 bytes} [Tue Sep 13 19:40:33 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 13 19:40:35.899292 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0923bca-0880-4d94-a632-1dee49375fb3 None None] REQUEST_METHOD: `GET` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:40:35.899852 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0923bca-0880-4d94-a632-1dee49375fb3 None None] SCRIPT_NAME: `/identity` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:40:35.899852 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0923bca-0880-4d94-a632-1dee49375fb3 None None] PATH_INFO: `/` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:40:35.901503 dv-cinder-828806-6-smb devstack@keystone.service[82026]: [pid: 82026|app: 0|req: 12/22] 10.222.0.33 () {54 vars in 927 bytes} [Tue Sep 13 19:40:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 19:40:35.907363 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d2fb4e0-9958-4349-95c2-ce3186beb5e9 None None] REQUEST_METHOD: `POST` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:40:35.911223 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d2fb4e0-9958-4349-95c2-ce3186beb5e9 None None] SCRIPT_NAME: `/identity` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:40:35.911223 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d2fb4e0-9958-4349-95c2-ce3186beb5e9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:40:35.936248 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.auth.core [None req-7d2fb4e0-9958-4349-95c2-ce3186beb5e9 None None] MFA Rules not processed for user `57539b6a6f3b4d589f5f5e1d211cd6a0`. Rule list: `[]` (Enabled: `True`). {{(pid=82025) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 19:40:35.937487 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.fernet_utils [None req-7d2fb4e0-9958-4349-95c2-ce3186beb5e9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82025) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 19:40:35.998624 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ce0f258-9668-40d6-af9d-1d0c9679cc3d None None] REQUEST_METHOD: `GET` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:40:35.998955 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ce0f258-9668-40d6-af9d-1d0c9679cc3d None None] SCRIPT_NAME: `/identity` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:40:35.999217 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ce0f258-9668-40d6-af9d-1d0c9679cc3d None None] PATH_INFO: `/` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:40:36.000939 dv-cinder-828806-6-smb devstack@keystone.service[82026]: [pid: 82026|app: 0|req: 13/23] 10.222.0.33 () {54 vars in 927 bytes} [Tue Sep 13 19:40:35 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 19:40:36.006168 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d297111-0f9e-44e5-9c92-7cc2892f6963 None None] REQUEST_METHOD: `POST` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:40:36.006468 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d297111-0f9e-44e5-9c92-7cc2892f6963 None None] SCRIPT_NAME: `/identity` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:40:36.006755 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d297111-0f9e-44e5-9c92-7cc2892f6963 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:40:36.040559 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.auth.core [None req-7d297111-0f9e-44e5-9c92-7cc2892f6963 None None] MFA Rules not processed for user `57539b6a6f3b4d589f5f5e1d211cd6a0`. Rule list: `[]` (Enabled: `True`). {{(pid=82026) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 19:40:36.042089 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.common.fernet_utils [None req-7d297111-0f9e-44e5-9c92-7cc2892f6963 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82026) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 19:40:36.046361 dv-cinder-828806-6-smb devstack@keystone.service[82025]: [pid: 82025|app: 0|req: 11/24] 10.222.0.33 () {58 vars in 1024 bytes} [Tue Sep 13 19:40:35 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 140 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 13 19:40:36.153537 dv-cinder-828806-6-smb devstack@keystone.service[82026]: [pid: 82026|app: 0|req: 14/25] 10.222.0.33 () {58 vars in 1024 bytes} [Tue Sep 13 19:40:36 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 148 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 13 19:40:36.513221 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d2fb4e0-9958-4349-95c2-ce3186beb5e9 None None] Authenticating user token {{(pid=82025) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:40:36.524022 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86a578aa-27f3-44ae-97d1-62fda5f95d15 None None] REQUEST_METHOD: `GET` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:40:36.524310 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86a578aa-27f3-44ae-97d1-62fda5f95d15 None None] SCRIPT_NAME: `/identity` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:40:36.524590 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86a578aa-27f3-44ae-97d1-62fda5f95d15 None None] PATH_INFO: `/` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:40:36.525953 dv-cinder-828806-6-smb devstack@keystone.service[82026]: [pid: 82026|app: 0|req: 15/26] 10.222.0.33 () {54 vars in 927 bytes} [Tue Sep 13 19:40:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 13 19:40:36.531704 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95b3fe7a-ec16-40ed-8d42-790fc73b262c None None] REQUEST_METHOD: `POST` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:40:36.531995 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95b3fe7a-ec16-40ed-8d42-790fc73b262c None None] SCRIPT_NAME: `/identity` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:40:36.532277 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95b3fe7a-ec16-40ed-8d42-790fc73b262c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:40:36.560259 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.auth.core [None req-95b3fe7a-ec16-40ed-8d42-790fc73b262c None None] MFA Rules not processed for user `57539b6a6f3b4d589f5f5e1d211cd6a0`. Rule list: `[]` (Enabled: `True`). {{(pid=82026) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 19:40:36.561806 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.common.fernet_utils [None req-95b3fe7a-ec16-40ed-8d42-790fc73b262c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82026) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 19:40:36.616955 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG dbcounter [-] [82025] Writing DB stats keystone:SELECT=100 {{(pid=82025) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:40:36.676384 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d2fb4e0-9958-4349-95c2-ce3186beb5e9 None None] Validating token access rules against request {{(pid=82025) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:40:36.709321 dv-cinder-828806-6-smb devstack@keystone.service[82026]: [pid: 82026|app: 0|req: 16/27] 10.222.0.33 () {58 vars in 1024 bytes} [Tue Sep 13 19:40:36 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 178 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 13 19:40:36.710368 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95b3fe7a-ec16-40ed-8d42-790fc73b262c None None] Authenticating user token {{(pid=82026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:40:36.715352 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG dbcounter [-] [82026] Writing DB stats keystone:SELECT=100 {{(pid=82026) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:40:36.722920 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e61c9fd-9ee4-41c9-8b79-1cb8d2bc4529 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57539b6a6f3b4d589f5f5e1d211cd6a0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82025) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:40:36.728837 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e61c9fd-9ee4-41c9-8b79-1cb8d2bc4529 None admin] REQUEST_METHOD: `GET` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:40:36.728837 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e61c9fd-9ee4-41c9-8b79-1cb8d2bc4529 None admin] SCRIPT_NAME: `/identity` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:40:36.728837 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e61c9fd-9ee4-41c9-8b79-1cb8d2bc4529 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:40:36.749584 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e61c9fd-9ee4-41c9-8b79-1cb8d2bc4529 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=82025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 13 19:40:36.755878 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application [None req-6e61c9fd-9ee4-41c9-8b79-1cb8d2bc4529 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 13 19:40:36.755878 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 19:40:36.755878 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 19:40:36.755878 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 19:40:36.755878 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 19:40:36.755878 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 19:40:36.755878 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 19:40:36.755878 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 19:40:36.755878 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 19:40:36.755878 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 19:40:36.755878 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 19:40:36.755878 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 19:40:36.755878 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 13 19:40:36.755878 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 13 19:40:36.755878 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 13 19:40:36.755878 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 13 19:40:36.756745 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 13 19:40:36.756745 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 13 19:40:36.756745 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 13 19:40:36.756745 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 13 19:40:36.756745 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 19:40:36.756745 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 19:40:36.756745 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 19:40:36.756745 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 19:40:36.756745 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 19:40:36.756745 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 19:40:36.756745 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 19:40:36.756745 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application with Lock( Sep 13 19:40:36.756745 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 19:40:36.756745 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application return self._enter() Sep 13 19:40:36.756745 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 19:40:36.756745 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 19:40:36.757507 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 19:40:36.757507 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application return self.creator() Sep 13 19:40:36.757507 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 19:40:36.757507 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application created_value = creator( Sep 13 19:40:36.757507 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 13 19:40:36.757507 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 13 19:40:36.757507 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 13 19:40:36.757507 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 13 19:40:36.757507 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 13 19:40:36.757507 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 13 19:40:36.757507 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 13 19:40:36.757507 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application Sep 13 19:40:36.757507 dv-cinder-828806-6-smb devstack@keystone.service[82025]: [pid: 82025|app: 0|req: 12/28] 10.222.0.33 () {56 vars in 1096 bytes} [Tue Sep 13 19:40:36 2022] GET /identity/v3/roles/admin => generated 83 bytes in 245 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 19:40:36.764822 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e61c9fd-9ee4-41c9-8b79-1cb8d2bc4529 None admin] Authenticating user token {{(pid=82025) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:40:36.908420 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95b3fe7a-ec16-40ed-8d42-790fc73b262c None None] Validating token access rules against request {{(pid=82026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:40:36.921249 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e61c9fd-9ee4-41c9-8b79-1cb8d2bc4529 None admin] Validating token access rules against request {{(pid=82025) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:40:36.937142 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG dbcounter [-] [82025] Writing DB stats keystone:SELECT=100 {{(pid=82025) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:40:36.969722 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61ace1b5-4110-486a-bfb6-d2a9911e8c78 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57539b6a6f3b4d589f5f5e1d211cd6a0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82025) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:40:36.970353 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61ace1b5-4110-486a-bfb6-d2a9911e8c78 None admin] REQUEST_METHOD: `GET` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:40:36.970641 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61ace1b5-4110-486a-bfb6-d2a9911e8c78 None admin] SCRIPT_NAME: `/identity` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:40:36.970924 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61ace1b5-4110-486a-bfb6-d2a9911e8c78 None admin] PATH_INFO: `/v3/roles` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:40:36.972217 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61ace1b5-4110-486a-bfb6-d2a9911e8c78 None admin] RBAC: Adding query filter params (name=admin) {{(pid=82025) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 19:40:36.972540 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61ace1b5-4110-486a-bfb6-d2a9911e8c78 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:40:36.973930 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61ace1b5-4110-486a-bfb6-d2a9911e8c78 None admin] RBAC: Authorization granted {{(pid=82025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:40:36.982787 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dfe65f9-ad55-4a1f-aa38-61555edb99c4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57539b6a6f3b4d589f5f5e1d211cd6a0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:40:36.983459 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dfe65f9-ad55-4a1f-aa38-61555edb99c4 None admin] REQUEST_METHOD: `GET` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:40:36.983749 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dfe65f9-ad55-4a1f-aa38-61555edb99c4 None admin] SCRIPT_NAME: `/identity` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:40:36.984032 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dfe65f9-ad55-4a1f-aa38-61555edb99c4 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:40:37.000316 dv-cinder-828806-6-smb devstack@keystone.service[82025]: [pid: 82025|app: 0|req: 13/29] 10.222.0.33 () {56 vars in 1099 bytes} [Tue Sep 13 19:40:36 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 236 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 19:40:37.001246 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dfe65f9-ad55-4a1f-aa38-61555edb99c4 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=82026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:40:37.002872 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dfe65f9-ad55-4a1f-aa38-61555edb99c4 None admin] RBAC: Authorization granted {{(pid=82026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:40:37.004524 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d83c2975-9efa-4bf0-82b1-20df82f68612 None None] REQUEST_METHOD: `GET` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:40:37.004817 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d83c2975-9efa-4bf0-82b1-20df82f68612 None None] SCRIPT_NAME: `/identity` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:40:37.005095 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d83c2975-9efa-4bf0-82b1-20df82f68612 None None] PATH_INFO: `/` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:40:37.006574 dv-cinder-828806-6-smb devstack@keystone.service[82025]: [pid: 82025|app: 0|req: 14/30] 10.222.0.33 () {54 vars in 927 bytes} [Tue Sep 13 19:40:37 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 19:40:37.008575 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d83c2975-9efa-4bf0-82b1-20df82f68612 None None] Authenticating user token {{(pid=82025) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:40:37.038865 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application [None req-3dfe65f9-ad55-4a1f-aa38-61555edb99c4 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 13 19:40:37.038865 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 19:40:37.038865 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 19:40:37.038865 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 19:40:37.038865 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 19:40:37.038865 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 19:40:37.038865 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 19:40:37.038865 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 19:40:37.038865 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 19:40:37.038865 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 19:40:37.038865 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 19:40:37.038865 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 19:40:37.038865 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 13 19:40:37.038865 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 13 19:40:37.038865 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 13 19:40:37.038865 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 13 19:40:37.046462 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 19:40:37.046462 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 19:40:37.046462 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 19:40:37.046462 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 19:40:37.046462 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 19:40:37.046462 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 19:40:37.046462 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 19:40:37.046462 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application with Lock( Sep 13 19:40:37.046462 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 19:40:37.046462 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application return self._enter() Sep 13 19:40:37.046462 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 19:40:37.046462 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 19:40:37.046462 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 19:40:37.046462 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application return self.creator() Sep 13 19:40:37.046462 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 19:40:37.046462 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application created_value = creator( Sep 13 19:40:37.046462 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 13 19:40:37.047302 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 13 19:40:37.047302 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 13 19:40:37.047302 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application Sep 13 19:40:37.047302 dv-cinder-828806-6-smb devstack@keystone.service[82026]: [pid: 82026|app: 0|req: 17/31] 10.222.0.33 () {56 vars in 1108 bytes} [Tue Sep 13 19:40:36 2022] GET /identity/v3/domains/Default => generated 87 bytes in 332 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 19:40:37.047302 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be1410ea-aa4a-4951-8d78-d3619520fbab None None] REQUEST_METHOD: `POST` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:40:37.047302 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be1410ea-aa4a-4951-8d78-d3619520fbab None None] SCRIPT_NAME: `/identity` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:40:37.047302 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be1410ea-aa4a-4951-8d78-d3619520fbab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:40:37.068761 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.auth.core [None req-be1410ea-aa4a-4951-8d78-d3619520fbab None None] MFA Rules not processed for user `57539b6a6f3b4d589f5f5e1d211cd6a0`. Rule list: `[]` (Enabled: `True`). {{(pid=82026) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 19:40:37.070397 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.common.fernet_utils [None req-be1410ea-aa4a-4951-8d78-d3619520fbab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82026) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 19:40:37.132021 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG dbcounter [-] [82026] Writing DB stats keystone:SELECT=100 {{(pid=82026) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:40:37.141174 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d83c2975-9efa-4bf0-82b1-20df82f68612 None None] Validating token access rules against request {{(pid=82025) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:40:37.154728 dv-cinder-828806-6-smb devstack@keystone.service[82026]: [pid: 82026|app: 0|req: 18/32] 10.222.0.33 () {58 vars in 1024 bytes} [Tue Sep 13 19:40:37 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 13 19:40:37.156019 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be1410ea-aa4a-4951-8d78-d3619520fbab None None] Authenticating user token {{(pid=82026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:40:37.182596 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd294075-89ea-466a-a412-042cd739f422 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57539b6a6f3b4d589f5f5e1d211cd6a0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82025) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:40:37.183682 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd294075-89ea-466a-a412-042cd739f422 None admin] REQUEST_METHOD: `GET` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:40:37.184185 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd294075-89ea-466a-a412-042cd739f422 None admin] SCRIPT_NAME: `/identity` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:40:37.184682 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd294075-89ea-466a-a412-042cd739f422 None admin] PATH_INFO: `/v3/users/57539b6a6f3b4d589f5f5e1d211cd6a0` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:40:37.186565 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd294075-89ea-466a-a412-042cd739f422 None admin] RBAC: Authorizing `identity:get_user(user_id=57539b6a6f3b4d589f5f5e1d211cd6a0)` {{(pid=82025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:40:37.188382 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd294075-89ea-466a-a412-042cd739f422 None admin] RBAC: Authorization granted {{(pid=82025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:40:37.190565 dv-cinder-828806-6-smb devstack@keystone.service[82025]: [pid: 82025|app: 0|req: 15/33] 10.222.0.33 () {56 vars in 1177 bytes} [Tue Sep 13 19:40:37 2022] GET /identity/v3/users/57539b6a6f3b4d589f5f5e1d211cd6a0 => generated 247 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 19:40:37.191600 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd294075-89ea-466a-a412-042cd739f422 None admin] Authenticating user token {{(pid=82025) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:40:37.243054 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG dbcounter [-] [82025] Writing DB stats keystone:SELECT=100 {{(pid=82025) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:40:37.329466 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be1410ea-aa4a-4951-8d78-d3619520fbab None None] Validating token access rules against request {{(pid=82026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:40:37.377307 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd294075-89ea-466a-a412-042cd739f422 None admin] Validating token access rules against request {{(pid=82025) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:40:37.395103 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9811c7d-3ad4-4514-90e5-4c5d7bd3b18e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57539b6a6f3b4d589f5f5e1d211cd6a0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:40:37.395735 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9811c7d-3ad4-4514-90e5-4c5d7bd3b18e None admin] REQUEST_METHOD: `GET` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:40:37.396021 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9811c7d-3ad4-4514-90e5-4c5d7bd3b18e None admin] SCRIPT_NAME: `/identity` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:40:37.396297 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9811c7d-3ad4-4514-90e5-4c5d7bd3b18e None admin] PATH_INFO: `/v3/domains` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:40:37.396954 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9811c7d-3ad4-4514-90e5-4c5d7bd3b18e None admin] RBAC: Adding query filter params (name=Default) {{(pid=82026) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 19:40:37.397260 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9811c7d-3ad4-4514-90e5-4c5d7bd3b18e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:40:37.398666 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9811c7d-3ad4-4514-90e5-4c5d7bd3b18e None admin] RBAC: Authorization granted {{(pid=82026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:40:37.439656 dv-cinder-828806-6-smb devstack@keystone.service[82026]: [pid: 82026|app: 0|req: 19/34] 10.222.0.33 () {56 vars in 1109 bytes} [Tue Sep 13 19:40:37 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 284 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 19:40:37.440313 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9811c7d-3ad4-4514-90e5-4c5d7bd3b18e None admin] Authenticating user token {{(pid=82026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:40:37.448733 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac9f1e5c-4d26-4337-a661-f3bfec205810 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57539b6a6f3b4d589f5f5e1d211cd6a0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82025) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:40:37.449365 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac9f1e5c-4d26-4337-a661-f3bfec205810 None admin] REQUEST_METHOD: `POST` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:40:37.449652 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac9f1e5c-4d26-4337-a661-f3bfec205810 None admin] SCRIPT_NAME: `/identity` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:40:37.449931 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac9f1e5c-4d26-4337-a661-f3bfec205810 None admin] PATH_INFO: `/v3/roles` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:40:37.450664 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac9f1e5c-4d26-4337-a661-f3bfec205810 None admin] RBAC: Authorizing `identity:create_role()` {{(pid=82025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:40:37.452191 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac9f1e5c-4d26-4337-a661-f3bfec205810 None admin] RBAC: Authorization granted {{(pid=82025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:40:37.492811 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG dbcounter [-] [82026] Writing DB stats keystone:SELECT=100 {{(pid=82026) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:40:37.548264 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9811c7d-3ad4-4514-90e5-4c5d7bd3b18e None admin] Validating token access rules against request {{(pid=82026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:40:37.582300 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebc156de-f6a3-442e-9ef5-3544571d28a7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57539b6a6f3b4d589f5f5e1d211cd6a0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:40:37.582921 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebc156de-f6a3-442e-9ef5-3544571d28a7 None admin] REQUEST_METHOD: `GET` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:40:37.583461 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebc156de-f6a3-442e-9ef5-3544571d28a7 None admin] SCRIPT_NAME: `/identity` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:40:37.583678 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebc156de-f6a3-442e-9ef5-3544571d28a7 None admin] PATH_INFO: `/v3/domains/default` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:40:37.584779 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebc156de-f6a3-442e-9ef5-3544571d28a7 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=82026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:40:37.586402 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebc156de-f6a3-442e-9ef5-3544571d28a7 None admin] RBAC: Authorization granted {{(pid=82026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:40:37.588202 dv-cinder-828806-6-smb devstack@keystone.service[82026]: [pid: 82026|app: 0|req: 20/35] 10.222.0.33 () {56 vars in 1108 bytes} [Tue Sep 13 19:40:37 2022] GET /identity/v3/domains/default => generated 199 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 19:40:37.591737 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebc156de-f6a3-442e-9ef5-3544571d28a7 None admin] Authenticating user token {{(pid=82026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:40:37.709546 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebc156de-f6a3-442e-9ef5-3544571d28a7 None admin] Validating token access rules against request {{(pid=82026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:40:37.725134 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG dbcounter [-] [82026] Writing DB stats keystone:SELECT=100 {{(pid=82026) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:40:37.743445 dv-cinder-828806-6-smb devstack@keystone.service[82025]: [pid: 82025|app: 0|req: 16/36] 10.222.0.33 () {60 vars in 1131 bytes} [Tue Sep 13 19:40:37 2022] POST /identity/v3/roles => generated 219 bytes in 552 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 13 19:40:37.745048 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac9f1e5c-4d26-4337-a661-f3bfec205810 None admin] Authenticating user token {{(pid=82025) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:40:37.746994 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ffcf930-1c5b-4454-a921-5c410505f826 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57539b6a6f3b4d589f5f5e1d211cd6a0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:40:37.748369 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ffcf930-1c5b-4454-a921-5c410505f826 None admin] REQUEST_METHOD: `POST` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:40:37.748752 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ffcf930-1c5b-4454-a921-5c410505f826 None admin] SCRIPT_NAME: `/identity` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:40:37.749133 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ffcf930-1c5b-4454-a921-5c410505f826 None admin] PATH_INFO: `/v3/projects` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:40:37.750014 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ffcf930-1c5b-4454-a921-5c410505f826 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=82026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:40:37.751978 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ffcf930-1c5b-4454-a921-5c410505f826 None admin] RBAC: Authorization granted {{(pid=82026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:40:37.863887 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG dbcounter [-] [82025] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82025) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:40:37.870662 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac9f1e5c-4d26-4337-a661-f3bfec205810 None admin] Validating token access rules against request {{(pid=82025) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:40:37.928623 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d28d774-dd30-4403-a67c-229100f36e77 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57539b6a6f3b4d589f5f5e1d211cd6a0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82025) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:40:37.929415 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d28d774-dd30-4403-a67c-229100f36e77 None admin] REQUEST_METHOD: `POST` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:40:37.929634 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d28d774-dd30-4403-a67c-229100f36e77 None admin] SCRIPT_NAME: `/identity` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:40:37.929920 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d28d774-dd30-4403-a67c-229100f36e77 None admin] PATH_INFO: `/v3/roles` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:40:37.930678 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d28d774-dd30-4403-a67c-229100f36e77 None admin] RBAC: Authorizing `identity:create_role()` {{(pid=82025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:40:37.932889 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d28d774-dd30-4403-a67c-229100f36e77 None admin] RBAC: Authorization granted {{(pid=82025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:40:38.020404 dv-cinder-828806-6-smb devstack@keystone.service[82025]: [pid: 82025|app: 0|req: 17/37] 10.222.0.33 () {60 vars in 1131 bytes} [Tue Sep 13 19:40:37 2022] POST /identity/v3/roles => generated 225 bytes in 276 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 13 19:40:38.021094 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d28d774-dd30-4403-a67c-229100f36e77 None admin] Authenticating user token {{(pid=82025) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:40:38.111196 dv-cinder-828806-6-smb devstack@keystone.service[82026]: [pid: 82026|app: 0|req: 21/38] 10.222.0.33 () {60 vars in 1141 bytes} [Tue Sep 13 19:40:37 2022] POST /identity/v3/projects => generated 301 bytes in 523 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 13 19:40:38.112833 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-583ca2ca-37aa-4648-a810-060976b255e6 None None] REQUEST_METHOD: `GET` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:40:38.113140 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-583ca2ca-37aa-4648-a810-060976b255e6 None None] SCRIPT_NAME: `/identity` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:40:38.113431 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-583ca2ca-37aa-4648-a810-060976b255e6 None None] PATH_INFO: `/` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:40:38.115108 dv-cinder-828806-6-smb devstack@keystone.service[82026]: [pid: 82026|app: 0|req: 22/39] 10.222.0.33 () {54 vars in 927 bytes} [Tue Sep 13 19:40:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 19:40:38.120725 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2027191b-9ac9-4172-8c67-a1ed8dec2255 None None] REQUEST_METHOD: `GET` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:40:38.121055 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2027191b-9ac9-4172-8c67-a1ed8dec2255 None None] SCRIPT_NAME: `/identity` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:40:38.121547 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2027191b-9ac9-4172-8c67-a1ed8dec2255 None None] PATH_INFO: `/` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:40:38.123786 dv-cinder-828806-6-smb devstack@keystone.service[82026]: [pid: 82026|app: 0|req: 23/40] 10.222.0.33 () {54 vars in 927 bytes} [Tue Sep 13 19:40:38 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 19:40:38.131222 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57ecdfb7-cfaf-4f8c-a44a-1e4445e7cfd5 None None] REQUEST_METHOD: `POST` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:40:38.131222 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57ecdfb7-cfaf-4f8c-a44a-1e4445e7cfd5 None None] SCRIPT_NAME: `/identity` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:40:38.131222 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57ecdfb7-cfaf-4f8c-a44a-1e4445e7cfd5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:40:38.152240 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.auth.core [None req-57ecdfb7-cfaf-4f8c-a44a-1e4445e7cfd5 None None] MFA Rules not processed for user `57539b6a6f3b4d589f5f5e1d211cd6a0`. Rule list: `[]` (Enabled: `True`). {{(pid=82026) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 19:40:38.154524 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.common.fernet_utils [None req-57ecdfb7-cfaf-4f8c-a44a-1e4445e7cfd5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82026) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 19:40:38.168166 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d28d774-dd30-4403-a67c-229100f36e77 None admin] Validating token access rules against request {{(pid=82025) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:40:38.210268 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd9f22d2-b84c-4982-a96a-48c80f47c057 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57539b6a6f3b4d589f5f5e1d211cd6a0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82025) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:40:38.210972 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd9f22d2-b84c-4982-a96a-48c80f47c057 None admin] REQUEST_METHOD: `PUT` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:40:38.211293 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd9f22d2-b84c-4982-a96a-48c80f47c057 None admin] SCRIPT_NAME: `/identity` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:40:38.211656 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd9f22d2-b84c-4982-a96a-48c80f47c057 None admin] PATH_INFO: `/v3/domains/default/users/57539b6a6f3b4d589f5f5e1d211cd6a0/roles/e5af7d5baa93469e9e486ef21c85474e` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:40:38.214648 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd9f22d2-b84c-4982-a96a-48c80f47c057 None admin] RBAC: Authorizing `identity:create_grant(domain_id=default, user_id=57539b6a6f3b4d589f5f5e1d211cd6a0, role_id=e5af7d5baa93469e9e486ef21c85474e)` {{(pid=82025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:40:38.216732 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd9f22d2-b84c-4982-a96a-48c80f47c057 None admin] RBAC: Authorization granted {{(pid=82025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:40:38.237913 dv-cinder-828806-6-smb devstack@keystone.service[82026]: [pid: 82026|app: 0|req: 24/41] 10.222.0.33 () {58 vars in 1024 bytes} [Tue Sep 13 19:40:38 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 13 19:40:38.239398 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f44e4fc-0550-4f4d-8bd3-c247a4a5c7ed None None] REQUEST_METHOD: `POST` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:40:38.239701 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f44e4fc-0550-4f4d-8bd3-c247a4a5c7ed None None] SCRIPT_NAME: `/identity` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:40:38.239987 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f44e4fc-0550-4f4d-8bd3-c247a4a5c7ed None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:40:38.260021 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.auth.core [None req-0f44e4fc-0550-4f4d-8bd3-c247a4a5c7ed None None] MFA Rules not processed for user `57539b6a6f3b4d589f5f5e1d211cd6a0`. Rule list: `[]` (Enabled: `True`). {{(pid=82026) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 19:40:38.261280 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.common.fernet_utils [None req-0f44e4fc-0550-4f4d-8bd3-c247a4a5c7ed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82026) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 19:40:38.298439 dv-cinder-828806-6-smb devstack@keystone.service[82025]: [pid: 82025|app: 0|req: 18/42] 10.222.0.33 () {58 vars in 1361 bytes} [Tue Sep 13 19:40:38 2022] PUT /identity/v3/domains/default/users/57539b6a6f3b4d589f5f5e1d211cd6a0/roles/e5af7d5baa93469e9e486ef21c85474e => generated 0 bytes in 277 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 19:40:38.354240 dv-cinder-828806-6-smb devstack@keystone.service[82026]: [pid: 82026|app: 0|req: 25/43] 10.222.0.33 () {58 vars in 1024 bytes} [Tue Sep 13 19:40:38 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 13 19:40:38.541128 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd9f22d2-b84c-4982-a96a-48c80f47c057 None admin] Authenticating user token {{(pid=82025) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:40:38.560966 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG dbcounter [-] [82025] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=82025) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:40:38.637314 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f44e4fc-0550-4f4d-8bd3-c247a4a5c7ed None None] Authenticating user token {{(pid=82026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:40:38.644714 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd9f22d2-b84c-4982-a96a-48c80f47c057 None admin] Validating token access rules against request {{(pid=82025) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:40:38.666602 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG dbcounter [-] [82026] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82026) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:40:38.682795 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-630df53b-ce29-4256-83c7-dcacec31435a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57539b6a6f3b4d589f5f5e1d211cd6a0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82025) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:40:38.683449 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-630df53b-ce29-4256-83c7-dcacec31435a None admin] REQUEST_METHOD: `POST` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:40:38.683737 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-630df53b-ce29-4256-83c7-dcacec31435a None admin] SCRIPT_NAME: `/identity` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:40:38.684018 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-630df53b-ce29-4256-83c7-dcacec31435a None admin] PATH_INFO: `/v3/roles` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:40:38.685404 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-630df53b-ce29-4256-83c7-dcacec31435a None admin] RBAC: Authorizing `identity:create_role()` {{(pid=82025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:40:38.687060 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-630df53b-ce29-4256-83c7-dcacec31435a None admin] RBAC: Authorization granted {{(pid=82025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:40:38.745379 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f44e4fc-0550-4f4d-8bd3-c247a4a5c7ed None None] Validating token access rules against request {{(pid=82026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:40:38.755532 dv-cinder-828806-6-smb devstack@keystone.service[82025]: [pid: 82025|app: 0|req: 19/44] 10.222.0.33 () {60 vars in 1131 bytes} [Tue Sep 13 19:40:38 2022] POST /identity/v3/roles => generated 223 bytes in 215 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 13 19:40:38.794224 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac398e33-91ff-470e-9976-b97ceec5c0d9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57539b6a6f3b4d589f5f5e1d211cd6a0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:40:38.795583 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac398e33-91ff-470e-9976-b97ceec5c0d9 None admin] REQUEST_METHOD: `GET` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:40:38.795877 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac398e33-91ff-470e-9976-b97ceec5c0d9 None admin] SCRIPT_NAME: `/identity` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:40:38.796157 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac398e33-91ff-470e-9976-b97ceec5c0d9 None admin] PATH_INFO: `/v3/domains/default` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:40:38.797414 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac398e33-91ff-470e-9976-b97ceec5c0d9 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=82026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:40:38.799080 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac398e33-91ff-470e-9976-b97ceec5c0d9 None admin] RBAC: Authorization granted {{(pid=82026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:40:38.803080 dv-cinder-828806-6-smb devstack@keystone.service[82026]: [pid: 82026|app: 0|req: 26/45] 10.222.0.33 () {56 vars in 1108 bytes} [Tue Sep 13 19:40:38 2022] GET /identity/v3/domains/default => generated 199 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 13 19:40:38.806691 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-630df53b-ce29-4256-83c7-dcacec31435a None admin] Authenticating user token {{(pid=82025) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:40:38.895632 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG dbcounter [-] [82025] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82025) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:40:38.922041 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-630df53b-ce29-4256-83c7-dcacec31435a None admin] Validating token access rules against request {{(pid=82025) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:40:38.957921 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa71d60d-c6f4-4df2-8124-a67523d9e178 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57539b6a6f3b4d589f5f5e1d211cd6a0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82025) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:40:38.958591 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa71d60d-c6f4-4df2-8124-a67523d9e178 None admin] REQUEST_METHOD: `POST` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:40:38.958863 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa71d60d-c6f4-4df2-8124-a67523d9e178 None admin] SCRIPT_NAME: `/identity` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:40:38.959268 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa71d60d-c6f4-4df2-8124-a67523d9e178 None admin] PATH_INFO: `/v3/projects` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:40:38.959958 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa71d60d-c6f4-4df2-8124-a67523d9e178 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=82025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:40:38.967021 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa71d60d-c6f4-4df2-8124-a67523d9e178 None admin] RBAC: Authorization granted {{(pid=82025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:40:39.024571 dv-cinder-828806-6-smb devstack@keystone.service[82025]: [pid: 82025|app: 0|req: 20/46] 10.222.0.33 () {60 vars in 1141 bytes} [Tue Sep 13 19:40:38 2022] POST /identity/v3/projects => generated 312 bytes in 218 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 13 19:40:40.499479 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc4aef7e-938a-4f03-8db2-3243a1f4113a None None] REQUEST_METHOD: `GET` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:40:40.500010 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc4aef7e-938a-4f03-8db2-3243a1f4113a None None] SCRIPT_NAME: `/identity` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:40:40.500100 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc4aef7e-938a-4f03-8db2-3243a1f4113a None None] PATH_INFO: `/` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:40:40.501578 dv-cinder-828806-6-smb devstack@keystone.service[82026]: [pid: 82026|app: 0|req: 27/47] 10.222.0.33 () {54 vars in 927 bytes} [Tue Sep 13 19:40:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 19:40:40.506653 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b55f9b50-7e20-4c63-bb17-775ea75d0f5f None None] REQUEST_METHOD: `POST` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:40:40.507072 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b55f9b50-7e20-4c63-bb17-775ea75d0f5f None None] SCRIPT_NAME: `/identity` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:40:40.507361 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b55f9b50-7e20-4c63-bb17-775ea75d0f5f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:40:40.525432 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.auth.core [None req-b55f9b50-7e20-4c63-bb17-775ea75d0f5f None None] MFA Rules not processed for user `57539b6a6f3b4d589f5f5e1d211cd6a0`. Rule list: `[]` (Enabled: `True`). {{(pid=82025) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 19:40:40.527224 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.fernet_utils [None req-b55f9b50-7e20-4c63-bb17-775ea75d0f5f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82025) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 19:40:40.592773 dv-cinder-828806-6-smb devstack@keystone.service[82025]: [pid: 82025|app: 0|req: 21/48] 10.222.0.33 () {58 vars in 1024 bytes} [Tue Sep 13 19:40:40 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 13 19:40:40.861146 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc4aef7e-938a-4f03-8db2-3243a1f4113a None None] Authenticating user token {{(pid=82026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:40:40.956397 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG dbcounter [-] [82026] Writing DB stats keystone:SELECT=100 {{(pid=82026) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:40:40.964055 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc4aef7e-938a-4f03-8db2-3243a1f4113a None None] Validating token access rules against request {{(pid=82026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:40:40.999851 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d37b3f6-de4e-4742-b262-5443196d8f0c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57539b6a6f3b4d589f5f5e1d211cd6a0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:40:41.000480 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d37b3f6-de4e-4742-b262-5443196d8f0c None admin] REQUEST_METHOD: `GET` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:40:41.000770 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d37b3f6-de4e-4742-b262-5443196d8f0c None admin] SCRIPT_NAME: `/identity` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:40:41.001050 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d37b3f6-de4e-4742-b262-5443196d8f0c None admin] PATH_INFO: `/v3/roles/admin` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:40:41.011088 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d37b3f6-de4e-4742-b262-5443196d8f0c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=82026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 13 19:40:41.016813 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application [None req-0d37b3f6-de4e-4742-b262-5443196d8f0c None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 13 19:40:41.016813 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 19:40:41.016813 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 19:40:41.016813 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 19:40:41.016813 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 19:40:41.016813 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 19:40:41.016813 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 19:40:41.016813 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 19:40:41.016813 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 19:40:41.016813 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 19:40:41.016813 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 19:40:41.016813 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 19:40:41.016813 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 13 19:40:41.016813 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 13 19:40:41.016813 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 13 19:40:41.016813 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 13 19:40:41.017634 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 13 19:40:41.017634 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 13 19:40:41.017634 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 13 19:40:41.017634 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 13 19:40:41.017634 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 19:40:41.017634 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 19:40:41.017634 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 19:40:41.017634 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 19:40:41.017634 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 19:40:41.017634 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 19:40:41.017634 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 19:40:41.017634 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application with Lock( Sep 13 19:40:41.017634 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 19:40:41.017634 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application return self._enter() Sep 13 19:40:41.017634 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 19:40:41.017634 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 19:40:41.018377 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 19:40:41.018377 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application return self.creator() Sep 13 19:40:41.018377 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 19:40:41.018377 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application created_value = creator( Sep 13 19:40:41.018377 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 13 19:40:41.018377 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 13 19:40:41.018377 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 13 19:40:41.018377 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 13 19:40:41.018377 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 13 19:40:41.018377 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 13 19:40:41.018377 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 13 19:40:41.018377 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application Sep 13 19:40:41.018377 dv-cinder-828806-6-smb devstack@keystone.service[82026]: [pid: 82026|app: 0|req: 28/49] 10.222.0.33 () {56 vars in 1096 bytes} [Tue Sep 13 19:40:40 2022] GET /identity/v3/roles/admin => generated 83 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 19:40:41.023891 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b55f9b50-7e20-4c63-bb17-775ea75d0f5f None None] Authenticating user token {{(pid=82025) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:40:41.085486 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG dbcounter [-] [82025] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82025) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:40:41.130964 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b55f9b50-7e20-4c63-bb17-775ea75d0f5f None None] Validating token access rules against request {{(pid=82025) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:40:41.165380 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb879e07-0158-45e7-9ea1-8d07ca3d27ca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57539b6a6f3b4d589f5f5e1d211cd6a0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82025) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:40:41.165996 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb879e07-0158-45e7-9ea1-8d07ca3d27ca None admin] REQUEST_METHOD: `GET` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:40:41.166288 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb879e07-0158-45e7-9ea1-8d07ca3d27ca None admin] SCRIPT_NAME: `/identity` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:40:41.166569 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb879e07-0158-45e7-9ea1-8d07ca3d27ca None admin] PATH_INFO: `/v3/roles` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:40:41.167273 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb879e07-0158-45e7-9ea1-8d07ca3d27ca None admin] RBAC: Adding query filter params (name=admin) {{(pid=82025) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 19:40:41.167584 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb879e07-0158-45e7-9ea1-8d07ca3d27ca None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:40:41.168974 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb879e07-0158-45e7-9ea1-8d07ca3d27ca None admin] RBAC: Authorization granted {{(pid=82025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:40:41.177153 dv-cinder-828806-6-smb devstack@keystone.service[82025]: [pid: 82025|app: 0|req: 22/50] 10.222.0.33 () {56 vars in 1099 bytes} [Tue Sep 13 19:40:41 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 19:40:41.182752 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d37b3f6-de4e-4742-b262-5443196d8f0c None admin] Authenticating user token {{(pid=82026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:40:41.210441 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-282ad333-8b34-4d28-9c12-6d2ba80e7842 None None] REQUEST_METHOD: `GET` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:40:41.210735 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-282ad333-8b34-4d28-9c12-6d2ba80e7842 None None] SCRIPT_NAME: `/identity` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:40:41.211019 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-282ad333-8b34-4d28-9c12-6d2ba80e7842 None None] PATH_INFO: `/` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:40:41.212531 dv-cinder-828806-6-smb devstack@keystone.service[82025]: [pid: 82025|app: 0|req: 23/51] 10.222.0.33 () {54 vars in 927 bytes} [Tue Sep 13 19:40:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 13 19:40:41.217294 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3d2ef93-8f26-4fda-be34-cfa74ff5798f None None] REQUEST_METHOD: `POST` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:40:41.217583 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3d2ef93-8f26-4fda-be34-cfa74ff5798f None None] SCRIPT_NAME: `/identity` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:40:41.217863 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3d2ef93-8f26-4fda-be34-cfa74ff5798f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:40:41.236340 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.auth.core [None req-d3d2ef93-8f26-4fda-be34-cfa74ff5798f None None] MFA Rules not processed for user `57539b6a6f3b4d589f5f5e1d211cd6a0`. Rule list: `[]` (Enabled: `True`). {{(pid=82025) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 19:40:41.237538 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.fernet_utils [None req-d3d2ef93-8f26-4fda-be34-cfa74ff5798f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82025) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 19:40:41.286848 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d37b3f6-de4e-4742-b262-5443196d8f0c None admin] Validating token access rules against request {{(pid=82026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:40:41.324516 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95f62a86-e435-4be7-a9ea-04c4b2fe06e0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57539b6a6f3b4d589f5f5e1d211cd6a0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:40:41.325177 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95f62a86-e435-4be7-a9ea-04c4b2fe06e0 None admin] REQUEST_METHOD: `GET` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:40:41.326195 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95f62a86-e435-4be7-a9ea-04c4b2fe06e0 None admin] SCRIPT_NAME: `/identity` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:40:41.326541 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95f62a86-e435-4be7-a9ea-04c4b2fe06e0 None admin] PATH_INFO: `/v3/users/57539b6a6f3b4d589f5f5e1d211cd6a0` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:40:41.327821 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95f62a86-e435-4be7-a9ea-04c4b2fe06e0 None admin] RBAC: Authorizing `identity:get_user(user_id=57539b6a6f3b4d589f5f5e1d211cd6a0)` {{(pid=82026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:40:41.329376 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95f62a86-e435-4be7-a9ea-04c4b2fe06e0 None admin] RBAC: Authorization granted {{(pid=82026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:40:41.331110 dv-cinder-828806-6-smb devstack@keystone.service[82026]: [pid: 82026|app: 0|req: 29/52] 10.222.0.33 () {56 vars in 1177 bytes} [Tue Sep 13 19:40:41 2022] GET /identity/v3/users/57539b6a6f3b4d589f5f5e1d211cd6a0 => generated 247 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 19:40:41.336726 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95f62a86-e435-4be7-a9ea-04c4b2fe06e0 None admin] Authenticating user token {{(pid=82026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:40:41.363101 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG dbcounter [-] [82026] Writing DB stats keystone:SELECT=100 {{(pid=82026) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:40:41.409321 dv-cinder-828806-6-smb devstack@keystone.service[82025]: [pid: 82025|app: 0|req: 24/53] 10.222.0.33 () {58 vars in 1024 bytes} [Tue Sep 13 19:40:41 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 192 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 13 19:40:41.445115 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95f62a86-e435-4be7-a9ea-04c4b2fe06e0 None admin] Validating token access rules against request {{(pid=82026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:40:41.477774 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6a2c0d9-b901-4396-bfc0-670982547517 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57539b6a6f3b4d589f5f5e1d211cd6a0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:40:41.478406 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6a2c0d9-b901-4396-bfc0-670982547517 None admin] REQUEST_METHOD: `GET` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:40:41.478699 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6a2c0d9-b901-4396-bfc0-670982547517 None admin] SCRIPT_NAME: `/identity` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:40:41.478985 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6a2c0d9-b901-4396-bfc0-670982547517 None admin] PATH_INFO: `/v3/domains/default` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:40:41.480155 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6a2c0d9-b901-4396-bfc0-670982547517 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=82026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:40:41.482167 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6a2c0d9-b901-4396-bfc0-670982547517 None admin] RBAC: Authorization granted {{(pid=82026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:40:41.483841 dv-cinder-828806-6-smb devstack@keystone.service[82026]: [pid: 82026|app: 0|req: 30/54] 10.222.0.33 () {56 vars in 1108 bytes} [Tue Sep 13 19:40:41 2022] GET /identity/v3/domains/default => generated 199 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 13 19:40:41.489597 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3d2ef93-8f26-4fda-be34-cfa74ff5798f None None] Authenticating user token {{(pid=82025) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:40:41.538622 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG dbcounter [-] [82025] Writing DB stats keystone:SELECT=100 {{(pid=82025) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:40:41.589360 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3d2ef93-8f26-4fda-be34-cfa74ff5798f None None] Validating token access rules against request {{(pid=82025) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:40:41.623172 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7568dee0-b19b-4fa4-8f56-6fb15742ca43 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57539b6a6f3b4d589f5f5e1d211cd6a0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82025) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:40:41.623783 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7568dee0-b19b-4fa4-8f56-6fb15742ca43 None admin] REQUEST_METHOD: `GET` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:40:41.624073 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7568dee0-b19b-4fa4-8f56-6fb15742ca43 None admin] SCRIPT_NAME: `/identity` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:40:41.624359 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7568dee0-b19b-4fa4-8f56-6fb15742ca43 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:40:41.625086 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7568dee0-b19b-4fa4-8f56-6fb15742ca43 None admin] RBAC: Adding query filter params (role.id=e5af7d5baa93469e9e486ef21c85474e, scope.domain.id=default, user.id=57539b6a6f3b4d589f5f5e1d211cd6a0) {{(pid=82025) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 19:40:41.625401 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7568dee0-b19b-4fa4-8f56-6fb15742ca43 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=82025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:40:41.626836 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7568dee0-b19b-4fa4-8f56-6fb15742ca43 None admin] RBAC: Authorization granted {{(pid=82025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:40:41.634984 dv-cinder-828806-6-smb devstack@keystone.service[82025]: [pid: 82025|app: 0|req: 25/55] 10.222.0.33 () {56 vars in 1322 bytes} [Tue Sep 13 19:40:41 2022] GET /identity/v3/role_assignments?user.id=57539b6a6f3b4d589f5f5e1d211cd6a0&scope.domain.id=default&role.id=e5af7d5baa93469e9e486ef21c85474e => generated 530 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 19:40:41.686946 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6a2c0d9-b901-4396-bfc0-670982547517 None admin] Authenticating user token {{(pid=82026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:40:41.784406 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG dbcounter [-] [82026] Writing DB stats keystone:SELECT=100 {{(pid=82026) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:40:41.795877 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6a2c0d9-b901-4396-bfc0-670982547517 None admin] Validating token access rules against request {{(pid=82026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:40:41.832440 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e157550a-dced-4ce8-9f8b-3e32dcb71871 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57539b6a6f3b4d589f5f5e1d211cd6a0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:40:41.833116 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e157550a-dced-4ce8-9f8b-3e32dcb71871 None admin] REQUEST_METHOD: `GET` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:40:41.833411 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e157550a-dced-4ce8-9f8b-3e32dcb71871 None admin] SCRIPT_NAME: `/identity` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:40:41.833699 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e157550a-dced-4ce8-9f8b-3e32dcb71871 None admin] PATH_INFO: `/v3/domains/default` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:40:41.834840 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e157550a-dced-4ce8-9f8b-3e32dcb71871 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=82026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:40:41.836345 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e157550a-dced-4ce8-9f8b-3e32dcb71871 None admin] RBAC: Authorization granted {{(pid=82026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:40:41.837950 dv-cinder-828806-6-smb devstack@keystone.service[82026]: [pid: 82026|app: 0|req: 31/56] 10.222.0.33 () {56 vars in 1108 bytes} [Tue Sep 13 19:40:41 2022] GET /identity/v3/domains/default => generated 199 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 13 19:40:41.844256 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7568dee0-b19b-4fa4-8f56-6fb15742ca43 None admin] Authenticating user token {{(pid=82025) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:40:41.944067 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7568dee0-b19b-4fa4-8f56-6fb15742ca43 None admin] Validating token access rules against request {{(pid=82025) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:40:41.957510 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG dbcounter [-] [82025] Writing DB stats keystone:SELECT=100 {{(pid=82025) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:40:41.977470 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2262275-8a55-4e9e-945b-6ea06378dc9f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57539b6a6f3b4d589f5f5e1d211cd6a0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82025) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:40:41.978084 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2262275-8a55-4e9e-945b-6ea06378dc9f None admin] REQUEST_METHOD: `POST` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:40:41.978376 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2262275-8a55-4e9e-945b-6ea06378dc9f None admin] SCRIPT_NAME: `/identity` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:40:41.978661 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2262275-8a55-4e9e-945b-6ea06378dc9f None admin] PATH_INFO: `/v3/projects` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:40:41.979364 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2262275-8a55-4e9e-945b-6ea06378dc9f None admin] RBAC: Authorizing `identity:create_project()` {{(pid=82025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:40:41.980813 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2262275-8a55-4e9e-945b-6ea06378dc9f None admin] RBAC: Authorization granted {{(pid=82025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:40:42.047053 dv-cinder-828806-6-smb devstack@keystone.service[82025]: [pid: 82025|app: 0|req: 26/57] 10.222.0.33 () {60 vars in 1140 bytes} [Tue Sep 13 19:40:41 2022] POST /identity/v3/projects => generated 298 bytes in 203 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 13 19:40:44.205849 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ac469db-f349-42ad-95a0-0fa17b7b2fa7 None None] REQUEST_METHOD: `GET` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:40:44.206366 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ac469db-f349-42ad-95a0-0fa17b7b2fa7 None None] SCRIPT_NAME: `/identity` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:40:44.206480 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ac469db-f349-42ad-95a0-0fa17b7b2fa7 None None] PATH_INFO: `/` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:40:44.207794 dv-cinder-828806-6-smb devstack@keystone.service[82026]: [pid: 82026|app: 0|req: 32/58] 10.222.0.33 () {54 vars in 927 bytes} [Tue Sep 13 19:40:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 19:40:44.212894 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a80fe37d-6f3f-47b6-b4ba-6ecfc6f602c0 None None] REQUEST_METHOD: `POST` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:40:44.213326 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a80fe37d-6f3f-47b6-b4ba-6ecfc6f602c0 None None] SCRIPT_NAME: `/identity` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:40:44.213452 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a80fe37d-6f3f-47b6-b4ba-6ecfc6f602c0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:40:44.232663 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.auth.core [None req-a80fe37d-6f3f-47b6-b4ba-6ecfc6f602c0 None None] MFA Rules not processed for user `57539b6a6f3b4d589f5f5e1d211cd6a0`. Rule list: `[]` (Enabled: `True`). {{(pid=82025) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 19:40:44.233864 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.fernet_utils [None req-a80fe37d-6f3f-47b6-b4ba-6ecfc6f602c0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82025) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 19:40:44.300363 dv-cinder-828806-6-smb devstack@keystone.service[82025]: [pid: 82025|app: 0|req: 27/59] 10.222.0.33 () {58 vars in 1024 bytes} [Tue Sep 13 19:40:44 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 13 19:40:44.564978 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ac469db-f349-42ad-95a0-0fa17b7b2fa7 None None] Authenticating user token {{(pid=82026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:40:44.664684 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ac469db-f349-42ad-95a0-0fa17b7b2fa7 None None] Validating token access rules against request {{(pid=82026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:40:44.696834 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-860fdf5c-7fb9-4838-8bf7-47edc610b206 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57539b6a6f3b4d589f5f5e1d211cd6a0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:40:44.697459 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-860fdf5c-7fb9-4838-8bf7-47edc610b206 None admin] REQUEST_METHOD: `GET` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:40:44.697746 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-860fdf5c-7fb9-4838-8bf7-47edc610b206 None admin] SCRIPT_NAME: `/identity` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:40:44.698027 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-860fdf5c-7fb9-4838-8bf7-47edc610b206 None admin] PATH_INFO: `/v3/domains/default` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:40:44.699167 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-860fdf5c-7fb9-4838-8bf7-47edc610b206 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=82026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:40:44.701253 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-860fdf5c-7fb9-4838-8bf7-47edc610b206 None admin] RBAC: Authorization granted {{(pid=82026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:40:44.702830 dv-cinder-828806-6-smb devstack@keystone.service[82026]: [pid: 82026|app: 0|req: 33/60] 10.222.0.33 () {56 vars in 1108 bytes} [Tue Sep 13 19:40:44 2022] GET /identity/v3/domains/default => generated 199 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 19:40:44.708376 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a80fe37d-6f3f-47b6-b4ba-6ecfc6f602c0 None None] Authenticating user token {{(pid=82025) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:40:44.799990 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG dbcounter [-] [82025] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82025) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:40:44.805593 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a80fe37d-6f3f-47b6-b4ba-6ecfc6f602c0 None None] Validating token access rules against request {{(pid=82025) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:40:44.838408 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-923f886b-d861-435c-84e4-554972dcad57 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57539b6a6f3b4d589f5f5e1d211cd6a0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82025) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:40:44.838958 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-923f886b-d861-435c-84e4-554972dcad57 None admin] REQUEST_METHOD: `POST` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:40:44.839281 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-923f886b-d861-435c-84e4-554972dcad57 None admin] SCRIPT_NAME: `/identity` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:40:44.839570 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-923f886b-d861-435c-84e4-554972dcad57 None admin] PATH_INFO: `/v3/users` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:40:44.840225 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-923f886b-d861-435c-84e4-554972dcad57 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=82025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:40:44.842536 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-923f886b-d861-435c-84e4-554972dcad57 None admin] RBAC: Authorization granted {{(pid=82025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:40:44.948397 dv-cinder-828806-6-smb devstack@keystone.service[82025]: [pid: 82025|app: 0|req: 28/61] 10.222.0.33 () {60 vars in 1132 bytes} [Tue Sep 13 19:40:44 2022] POST /identity/v3/users => generated 275 bytes in 240 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 13 19:40:48.299192 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1817e9e-5eae-4a84-9a4d-0fed28f2ad4b None None] REQUEST_METHOD: `GET` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:40:48.300008 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1817e9e-5eae-4a84-9a4d-0fed28f2ad4b None None] SCRIPT_NAME: `/identity` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:40:48.300429 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1817e9e-5eae-4a84-9a4d-0fed28f2ad4b None None] PATH_INFO: `/` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:40:48.301918 dv-cinder-828806-6-smb devstack@keystone.service[82026]: [pid: 82026|app: 0|req: 34/62] 10.222.0.33 () {54 vars in 927 bytes} [Tue Sep 13 19:40:48 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 19:40:48.307397 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4fc61f1-b36d-4795-a032-057e6e238e17 None None] REQUEST_METHOD: `POST` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:40:48.308258 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4fc61f1-b36d-4795-a032-057e6e238e17 None None] SCRIPT_NAME: `/identity` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:40:48.308693 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4fc61f1-b36d-4795-a032-057e6e238e17 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:40:48.339474 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.auth.core [None req-f4fc61f1-b36d-4795-a032-057e6e238e17 None None] MFA Rules not processed for user `57539b6a6f3b4d589f5f5e1d211cd6a0`. Rule list: `[]` (Enabled: `True`). {{(pid=82025) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 19:40:48.340923 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.fernet_utils [None req-f4fc61f1-b36d-4795-a032-057e6e238e17 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82025) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 19:40:48.437582 dv-cinder-828806-6-smb devstack@keystone.service[82025]: [pid: 82025|app: 0|req: 29/63] 10.222.0.33 () {58 vars in 1024 bytes} [Tue Sep 13 19:40:48 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 13 19:40:48.513154 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce88126b-598e-41b7-9797-1dea2d9c9a5d None None] REQUEST_METHOD: `GET` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:40:48.513688 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce88126b-598e-41b7-9797-1dea2d9c9a5d None None] SCRIPT_NAME: `/identity` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:40:48.514109 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce88126b-598e-41b7-9797-1dea2d9c9a5d None None] PATH_INFO: `/` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:40:48.515914 dv-cinder-828806-6-smb devstack@keystone.service[82026]: [pid: 82026|app: 0|req: 35/64] 10.222.0.33 () {54 vars in 927 bytes} [Tue Sep 13 19:40:48 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 19:40:48.521269 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b01d430e-585c-4d55-9ae8-9c9bfebaa4cb None None] REQUEST_METHOD: `POST` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:40:48.521739 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b01d430e-585c-4d55-9ae8-9c9bfebaa4cb None None] SCRIPT_NAME: `/identity` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:40:48.522180 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b01d430e-585c-4d55-9ae8-9c9bfebaa4cb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:40:48.548034 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.auth.core [None req-b01d430e-585c-4d55-9ae8-9c9bfebaa4cb None None] MFA Rules not processed for user `57539b6a6f3b4d589f5f5e1d211cd6a0`. Rule list: `[]` (Enabled: `True`). {{(pid=82025) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 19:40:48.549233 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.fernet_utils [None req-b01d430e-585c-4d55-9ae8-9c9bfebaa4cb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82025) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 19:40:48.624532 dv-cinder-828806-6-smb devstack@keystone.service[82025]: [pid: 82025|app: 0|req: 30/65] 10.222.0.33 () {58 vars in 1024 bytes} [Tue Sep 13 19:40:48 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 13 19:40:48.646602 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27786b1a-f506-48a0-b6dc-4d80306a3d8c None None] REQUEST_METHOD: `GET` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:40:48.646918 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27786b1a-f506-48a0-b6dc-4d80306a3d8c None None] SCRIPT_NAME: `/identity` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:40:48.647203 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27786b1a-f506-48a0-b6dc-4d80306a3d8c None None] PATH_INFO: `/` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:40:48.648829 dv-cinder-828806-6-smb devstack@keystone.service[82026]: [pid: 82026|app: 0|req: 36/66] 10.222.0.33 () {54 vars in 927 bytes} [Tue Sep 13 19:40:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 19:40:48.657142 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b641abcd-7c33-438a-abe3-c66f3d17d164 None None] REQUEST_METHOD: `POST` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:40:48.657665 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b641abcd-7c33-438a-abe3-c66f3d17d164 None None] SCRIPT_NAME: `/identity` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:40:48.658160 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b641abcd-7c33-438a-abe3-c66f3d17d164 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:40:48.676621 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.auth.core [None req-b641abcd-7c33-438a-abe3-c66f3d17d164 None None] MFA Rules not processed for user `57539b6a6f3b4d589f5f5e1d211cd6a0`. Rule list: `[]` (Enabled: `True`). {{(pid=82025) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 19:40:48.678087 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.fernet_utils [None req-b641abcd-7c33-438a-abe3-c66f3d17d164 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82025) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 19:40:48.686736 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG dbcounter [-] [82025] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=82025) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:40:48.753971 dv-cinder-828806-6-smb devstack@keystone.service[82025]: [pid: 82025|app: 0|req: 31/67] 10.222.0.33 () {58 vars in 1024 bytes} [Tue Sep 13 19:40:48 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 13 19:40:48.866045 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27786b1a-f506-48a0-b6dc-4d80306a3d8c None None] Authenticating user token {{(pid=82026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:40:48.902171 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG dbcounter [-] [82026] Writing DB stats keystone:SELECT=100 {{(pid=82026) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:40:48.980358 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27786b1a-f506-48a0-b6dc-4d80306a3d8c None None] Validating token access rules against request {{(pid=82026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:40:48.989911 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23375d50-e6b4-4479-9f8f-333300440247 None None] REQUEST_METHOD: `GET` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:40:48.990987 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23375d50-e6b4-4479-9f8f-333300440247 None None] SCRIPT_NAME: `/identity` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:40:48.991512 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23375d50-e6b4-4479-9f8f-333300440247 None None] PATH_INFO: `/` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:40:48.993319 dv-cinder-828806-6-smb devstack@keystone.service[82025]: [pid: 82025|app: 0|req: 32/68] 10.222.0.33 () {54 vars in 927 bytes} [Tue Sep 13 19:40:48 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 19:40:49.001052 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efebc5b8-5c50-4c4c-baf2-c4f6bd1ab594 None None] REQUEST_METHOD: `GET` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:40:49.001725 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efebc5b8-5c50-4c4c-baf2-c4f6bd1ab594 None None] SCRIPT_NAME: `/identity` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:40:49.002472 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efebc5b8-5c50-4c4c-baf2-c4f6bd1ab594 None None] PATH_INFO: `/` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:40:49.004232 dv-cinder-828806-6-smb devstack@keystone.service[82025]: [pid: 82025|app: 0|req: 33/69] 10.222.0.33 () {54 vars in 927 bytes} [Tue Sep 13 19:40:48 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 13 19:40:49.005426 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efebc5b8-5c50-4c4c-baf2-c4f6bd1ab594 None None] Authenticating user token {{(pid=82025) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:40:49.025812 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29ef8dad-91b2-4c95-8628-c053bf78773c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57539b6a6f3b4d589f5f5e1d211cd6a0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:40:49.026455 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29ef8dad-91b2-4c95-8628-c053bf78773c None admin] REQUEST_METHOD: `GET` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:40:49.026742 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29ef8dad-91b2-4c95-8628-c053bf78773c None admin] SCRIPT_NAME: `/identity` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:40:49.027318 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29ef8dad-91b2-4c95-8628-c053bf78773c None admin] PATH_INFO: `/v3/roles/admin` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:40:49.038080 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29ef8dad-91b2-4c95-8628-c053bf78773c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=82026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 13 19:40:49.042904 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application [None req-29ef8dad-91b2-4c95-8628-c053bf78773c None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 13 19:40:49.042904 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 19:40:49.042904 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 19:40:49.042904 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 19:40:49.042904 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 19:40:49.042904 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 19:40:49.042904 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 19:40:49.042904 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 19:40:49.042904 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 19:40:49.042904 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 19:40:49.042904 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 19:40:49.042904 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 19:40:49.042904 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 13 19:40:49.042904 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 13 19:40:49.042904 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 13 19:40:49.042904 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 13 19:40:49.043933 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 13 19:40:49.043933 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 13 19:40:49.043933 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 13 19:40:49.043933 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 13 19:40:49.043933 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 19:40:49.043933 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 19:40:49.043933 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 19:40:49.043933 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 19:40:49.043933 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 19:40:49.043933 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 19:40:49.043933 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 19:40:49.043933 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application with Lock( Sep 13 19:40:49.043933 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 19:40:49.043933 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application return self._enter() Sep 13 19:40:49.043933 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 19:40:49.043933 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 19:40:49.045500 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 19:40:49.045500 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application return self.creator() Sep 13 19:40:49.045500 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 19:40:49.045500 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application created_value = creator( Sep 13 19:40:49.045500 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 13 19:40:49.045500 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 13 19:40:49.045500 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 13 19:40:49.045500 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 13 19:40:49.045500 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 13 19:40:49.045500 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 13 19:40:49.045500 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 13 19:40:49.045500 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application Sep 13 19:40:49.045500 dv-cinder-828806-6-smb devstack@keystone.service[82026]: [pid: 82026|app: 0|req: 37/70] 10.222.0.33 () {56 vars in 1096 bytes} [Tue Sep 13 19:40:48 2022] GET /identity/v3/roles/admin => generated 83 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 19:40:49.045500 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc915992-c901-41fa-a4f6-30513990dc3b None None] REQUEST_METHOD: `POST` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:40:49.046363 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc915992-c901-41fa-a4f6-30513990dc3b None None] SCRIPT_NAME: `/identity` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:40:49.046363 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc915992-c901-41fa-a4f6-30513990dc3b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:40:49.063344 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.auth.core [None req-fc915992-c901-41fa-a4f6-30513990dc3b None None] MFA Rules not processed for user `57539b6a6f3b4d589f5f5e1d211cd6a0`. Rule list: `[]` (Enabled: `True`). {{(pid=82026) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 19:40:49.064544 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.common.fernet_utils [None req-fc915992-c901-41fa-a4f6-30513990dc3b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82026) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 19:40:49.123911 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efebc5b8-5c50-4c4c-baf2-c4f6bd1ab594 None None] Validating token access rules against request {{(pid=82025) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:40:49.134513 dv-cinder-828806-6-smb devstack@keystone.service[82026]: [pid: 82026|app: 0|req: 38/71] 10.222.0.33 () {58 vars in 1024 bytes} [Tue Sep 13 19:40:49 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 13 19:40:49.136411 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-103b90b7-b2b1-40f0-876a-5540e813ae5a None None] REQUEST_METHOD: `POST` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:40:49.137073 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-103b90b7-b2b1-40f0-876a-5540e813ae5a None None] SCRIPT_NAME: `/identity` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:40:49.137362 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-103b90b7-b2b1-40f0-876a-5540e813ae5a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:40:49.161333 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.auth.core [None req-103b90b7-b2b1-40f0-876a-5540e813ae5a None None] MFA Rules not processed for user `57539b6a6f3b4d589f5f5e1d211cd6a0`. Rule list: `[]` (Enabled: `True`). {{(pid=82026) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 19:40:49.161333 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.common.fernet_utils [None req-103b90b7-b2b1-40f0-876a-5540e813ae5a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82026) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 19:40:49.165776 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-335b85dc-b077-4388-b467-80cea28bff38 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57539b6a6f3b4d589f5f5e1d211cd6a0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82025) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:40:49.166420 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-335b85dc-b077-4388-b467-80cea28bff38 None admin] REQUEST_METHOD: `GET` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:40:49.166710 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-335b85dc-b077-4388-b467-80cea28bff38 None admin] SCRIPT_NAME: `/identity` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:40:49.166991 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-335b85dc-b077-4388-b467-80cea28bff38 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:40:49.172449 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG dbcounter [-] [82026] Writing DB stats keystone:SELECT=100 {{(pid=82026) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:40:49.177620 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-335b85dc-b077-4388-b467-80cea28bff38 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=82025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 13 19:40:49.182512 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application [None req-335b85dc-b077-4388-b467-80cea28bff38 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 13 19:40:49.182512 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 19:40:49.182512 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 19:40:49.182512 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 19:40:49.182512 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 19:40:49.182512 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 19:40:49.182512 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 19:40:49.182512 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 19:40:49.182512 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 19:40:49.182512 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 19:40:49.182512 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 19:40:49.182512 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 19:40:49.182512 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 13 19:40:49.182512 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 13 19:40:49.182512 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 13 19:40:49.182512 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 13 19:40:49.187337 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 13 19:40:49.187337 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 13 19:40:49.187337 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 13 19:40:49.187337 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 13 19:40:49.187337 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 19:40:49.187337 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 19:40:49.187337 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 19:40:49.187337 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 19:40:49.187337 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 19:40:49.187337 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 19:40:49.187337 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 19:40:49.187337 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application with Lock( Sep 13 19:40:49.187337 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 19:40:49.187337 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application return self._enter() Sep 13 19:40:49.187337 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 19:40:49.187337 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 19:40:49.188110 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 19:40:49.188110 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application return self.creator() Sep 13 19:40:49.188110 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 19:40:49.188110 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application created_value = creator( Sep 13 19:40:49.188110 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 13 19:40:49.188110 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 13 19:40:49.188110 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 13 19:40:49.188110 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 13 19:40:49.188110 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 13 19:40:49.188110 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 13 19:40:49.188110 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 13 19:40:49.188110 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application Sep 13 19:40:49.188110 dv-cinder-828806-6-smb devstack@keystone.service[82025]: [pid: 82025|app: 0|req: 34/72] 10.222.0.33 () {56 vars in 1114 bytes} [Tue Sep 13 19:40:49 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 19:40:49.188110 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-335b85dc-b077-4388-b467-80cea28bff38 None admin] Authenticating user token {{(pid=82025) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:40:49.189580 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG dbcounter [-] [82025] Writing DB stats keystone:SELECT=100 {{(pid=82025) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:40:49.238967 dv-cinder-828806-6-smb devstack@keystone.service[82026]: [pid: 82026|app: 0|req: 39/73] 10.222.0.33 () {58 vars in 1024 bytes} [Tue Sep 13 19:40:49 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 13 19:40:49.239880 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-103b90b7-b2b1-40f0-876a-5540e813ae5a None None] Authenticating user token {{(pid=82026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:40:49.302798 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-335b85dc-b077-4388-b467-80cea28bff38 None admin] Validating token access rules against request {{(pid=82025) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:40:49.340380 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e983697a-b9b6-407f-b328-92ef4f50e8a4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57539b6a6f3b4d589f5f5e1d211cd6a0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82025) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:40:49.342398 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e983697a-b9b6-407f-b328-92ef4f50e8a4 None admin] REQUEST_METHOD: `GET` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:40:49.342780 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e983697a-b9b6-407f-b328-92ef4f50e8a4 None admin] SCRIPT_NAME: `/identity` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:40:49.343299 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e983697a-b9b6-407f-b328-92ef4f50e8a4 None admin] PATH_INFO: `/v3/roles` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:40:49.344123 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e983697a-b9b6-407f-b328-92ef4f50e8a4 None admin] RBAC: Adding query filter params (name=admin) {{(pid=82025) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 19:40:49.344688 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e983697a-b9b6-407f-b328-92ef4f50e8a4 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:40:49.346449 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e983697a-b9b6-407f-b328-92ef4f50e8a4 None admin] RBAC: Authorization granted {{(pid=82025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:40:49.355611 dv-cinder-828806-6-smb devstack@keystone.service[82025]: [pid: 82025|app: 0|req: 35/74] 10.222.0.33 () {56 vars in 1099 bytes} [Tue Sep 13 19:40:49 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 19:40:49.362187 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e983697a-b9b6-407f-b328-92ef4f50e8a4 None admin] Authenticating user token {{(pid=82025) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:40:49.373797 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-103b90b7-b2b1-40f0-876a-5540e813ae5a None None] Validating token access rules against request {{(pid=82026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:40:49.413365 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2913059c-4b2d-4952-b396-88cbb68759da None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57539b6a6f3b4d589f5f5e1d211cd6a0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:40:49.414431 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2913059c-4b2d-4952-b396-88cbb68759da None admin] REQUEST_METHOD: `GET` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:40:49.414921 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2913059c-4b2d-4952-b396-88cbb68759da None admin] SCRIPT_NAME: `/identity` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:40:49.415421 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2913059c-4b2d-4952-b396-88cbb68759da None admin] PATH_INFO: `/v3/roles/member` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:40:49.434055 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG dbcounter [-] [82025] Writing DB stats keystone:SELECT=100 {{(pid=82025) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:40:49.439074 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2913059c-4b2d-4952-b396-88cbb68759da None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=82026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 13 19:40:49.444351 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application [None req-2913059c-4b2d-4952-b396-88cbb68759da None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 13 19:40:49.444351 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 19:40:49.444351 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 19:40:49.444351 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 19:40:49.444351 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 19:40:49.444351 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 19:40:49.444351 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 19:40:49.444351 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 19:40:49.444351 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 19:40:49.444351 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 19:40:49.444351 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 19:40:49.444351 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 19:40:49.444351 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 13 19:40:49.444351 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 13 19:40:49.444351 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 13 19:40:49.444351 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 13 19:40:49.453306 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 13 19:40:49.453306 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 13 19:40:49.453306 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 13 19:40:49.453306 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 13 19:40:49.453306 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 19:40:49.453306 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 19:40:49.453306 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 19:40:49.453306 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 19:40:49.453306 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 19:40:49.453306 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 19:40:49.453306 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 19:40:49.453306 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application with Lock( Sep 13 19:40:49.453306 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 19:40:49.453306 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application return self._enter() Sep 13 19:40:49.453306 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 19:40:49.453306 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 19:40:49.454279 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 19:40:49.454279 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application return self.creator() Sep 13 19:40:49.454279 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 19:40:49.454279 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application created_value = creator( Sep 13 19:40:49.454279 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 13 19:40:49.454279 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 13 19:40:49.454279 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 13 19:40:49.454279 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 13 19:40:49.454279 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 13 19:40:49.454279 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 13 19:40:49.454279 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 13 19:40:49.454279 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application Sep 13 19:40:49.454279 dv-cinder-828806-6-smb devstack@keystone.service[82026]: [pid: 82026|app: 0|req: 40/75] 10.222.0.33 () {56 vars in 1099 bytes} [Tue Sep 13 19:40:49 2022] GET /identity/v3/roles/member => generated 84 bytes in 206 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 19:40:49.454279 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2913059c-4b2d-4952-b396-88cbb68759da None admin] Authenticating user token {{(pid=82026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:40:49.461202 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG dbcounter [-] [82026] Writing DB stats keystone:SELECT=100 {{(pid=82026) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:40:49.481844 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e983697a-b9b6-407f-b328-92ef4f50e8a4 None admin] Validating token access rules against request {{(pid=82025) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:40:49.518676 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-581855f3-8d14-4f98-a4c5-e26224dfe3cf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57539b6a6f3b4d589f5f5e1d211cd6a0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82025) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:40:49.519552 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-581855f3-8d14-4f98-a4c5-e26224dfe3cf None admin] REQUEST_METHOD: `GET` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:40:49.519992 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-581855f3-8d14-4f98-a4c5-e26224dfe3cf None admin] SCRIPT_NAME: `/identity` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:40:49.520349 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-581855f3-8d14-4f98-a4c5-e26224dfe3cf None admin] PATH_INFO: `/v3/roles` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:40:49.520944 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-581855f3-8d14-4f98-a4c5-e26224dfe3cf None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=82025) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 19:40:49.521260 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-581855f3-8d14-4f98-a4c5-e26224dfe3cf None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:40:49.522799 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-581855f3-8d14-4f98-a4c5-e26224dfe3cf None admin] RBAC: Authorization granted {{(pid=82025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:40:49.531747 dv-cinder-828806-6-smb devstack@keystone.service[82025]: [pid: 82025|app: 0|req: 36/76] 10.222.0.33 () {56 vars in 1111 bytes} [Tue Sep 13 19:40:49 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 19:40:49.532625 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-581855f3-8d14-4f98-a4c5-e26224dfe3cf None admin] Authenticating user token {{(pid=82025) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:40:49.559251 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2913059c-4b2d-4952-b396-88cbb68759da None admin] Validating token access rules against request {{(pid=82026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:40:49.592864 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62af2533-14fa-4e1d-a082-b315b10e4001 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57539b6a6f3b4d589f5f5e1d211cd6a0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:40:49.593492 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62af2533-14fa-4e1d-a082-b315b10e4001 None admin] REQUEST_METHOD: `GET` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:40:49.593780 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62af2533-14fa-4e1d-a082-b315b10e4001 None admin] SCRIPT_NAME: `/identity` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:40:49.594058 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62af2533-14fa-4e1d-a082-b315b10e4001 None admin] PATH_INFO: `/v3/users/57539b6a6f3b4d589f5f5e1d211cd6a0` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:40:49.595231 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62af2533-14fa-4e1d-a082-b315b10e4001 None admin] RBAC: Authorizing `identity:get_user(user_id=57539b6a6f3b4d589f5f5e1d211cd6a0)` {{(pid=82026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:40:49.596685 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62af2533-14fa-4e1d-a082-b315b10e4001 None admin] RBAC: Authorization granted {{(pid=82026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:40:49.598425 dv-cinder-828806-6-smb devstack@keystone.service[82026]: [pid: 82026|app: 0|req: 41/77] 10.222.0.33 () {56 vars in 1177 bytes} [Tue Sep 13 19:40:49 2022] GET /identity/v3/users/57539b6a6f3b4d589f5f5e1d211cd6a0 => generated 247 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 19:40:49.599122 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62af2533-14fa-4e1d-a082-b315b10e4001 None admin] Authenticating user token {{(pid=82026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:40:49.637611 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-581855f3-8d14-4f98-a4c5-e26224dfe3cf None admin] Validating token access rules against request {{(pid=82025) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:40:49.662700 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG dbcounter [-] [82025] Writing DB stats keystone:SELECT=100 {{(pid=82025) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:40:49.671795 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de640fe5-b3bd-4a2a-a7db-b6e292c3fcce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57539b6a6f3b4d589f5f5e1d211cd6a0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82025) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:40:49.672411 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de640fe5-b3bd-4a2a-a7db-b6e292c3fcce None admin] REQUEST_METHOD: `GET` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:40:49.672717 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de640fe5-b3bd-4a2a-a7db-b6e292c3fcce None admin] SCRIPT_NAME: `/identity` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:40:49.672979 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de640fe5-b3bd-4a2a-a7db-b6e292c3fcce None admin] PATH_INFO: `/v3/roles/member` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:40:49.676106 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG dbcounter [-] [82026] Writing DB stats keystone:SELECT=100 {{(pid=82026) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:40:49.683313 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de640fe5-b3bd-4a2a-a7db-b6e292c3fcce None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=82025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 13 19:40:49.688852 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application [None req-de640fe5-b3bd-4a2a-a7db-b6e292c3fcce None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 13 19:40:49.688852 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 19:40:49.688852 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 19:40:49.688852 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 19:40:49.688852 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 19:40:49.688852 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 19:40:49.688852 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 19:40:49.688852 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 19:40:49.688852 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 19:40:49.688852 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 19:40:49.688852 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 19:40:49.688852 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 19:40:49.688852 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 13 19:40:49.688852 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 13 19:40:49.688852 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 13 19:40:49.688852 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 13 19:40:49.689696 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 13 19:40:49.689696 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 13 19:40:49.689696 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 13 19:40:49.689696 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 13 19:40:49.689696 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 19:40:49.689696 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 19:40:49.689696 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 19:40:49.689696 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 19:40:49.689696 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 19:40:49.689696 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 19:40:49.689696 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 19:40:49.689696 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application with Lock( Sep 13 19:40:49.689696 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 19:40:49.689696 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application return self._enter() Sep 13 19:40:49.689696 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 19:40:49.689696 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 19:40:49.690463 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 19:40:49.690463 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application return self.creator() Sep 13 19:40:49.690463 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 19:40:49.690463 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application created_value = creator( Sep 13 19:40:49.690463 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 13 19:40:49.690463 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 13 19:40:49.690463 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 13 19:40:49.690463 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 13 19:40:49.690463 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 13 19:40:49.690463 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 13 19:40:49.690463 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 13 19:40:49.690463 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application Sep 13 19:40:49.690463 dv-cinder-828806-6-smb devstack@keystone.service[82025]: [pid: 82025|app: 0|req: 37/78] 10.222.0.33 () {56 vars in 1099 bytes} [Tue Sep 13 19:40:49 2022] GET /identity/v3/roles/member => generated 84 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 19:40:49.691110 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de640fe5-b3bd-4a2a-a7db-b6e292c3fcce None admin] Authenticating user token {{(pid=82025) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:40:49.703652 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62af2533-14fa-4e1d-a082-b315b10e4001 None admin] Validating token access rules against request {{(pid=82026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:40:49.738032 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e019b78c-e2da-47ea-b728-62c7c111813c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57539b6a6f3b4d589f5f5e1d211cd6a0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:40:49.738641 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e019b78c-e2da-47ea-b728-62c7c111813c None admin] REQUEST_METHOD: `GET` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:40:49.738926 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e019b78c-e2da-47ea-b728-62c7c111813c None admin] SCRIPT_NAME: `/identity` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:40:49.739235 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e019b78c-e2da-47ea-b728-62c7c111813c None admin] PATH_INFO: `/v3/roles` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:40:49.739907 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e019b78c-e2da-47ea-b728-62c7c111813c None admin] RBAC: Adding query filter params (name=member) {{(pid=82026) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 19:40:49.740213 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e019b78c-e2da-47ea-b728-62c7c111813c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:40:49.741591 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e019b78c-e2da-47ea-b728-62c7c111813c None admin] RBAC: Authorization granted {{(pid=82026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:40:49.750255 dv-cinder-828806-6-smb devstack@keystone.service[82026]: [pid: 82026|app: 0|req: 42/79] 10.222.0.33 () {56 vars in 1101 bytes} [Tue Sep 13 19:40:49 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 19:40:49.751053 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e019b78c-e2da-47ea-b728-62c7c111813c None admin] Authenticating user token {{(pid=82026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:40:49.790941 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de640fe5-b3bd-4a2a-a7db-b6e292c3fcce None admin] Validating token access rules against request {{(pid=82025) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:40:49.828973 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaa43e47-fa3e-4c0a-ad78-2e1e7320578b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57539b6a6f3b4d589f5f5e1d211cd6a0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82025) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:40:49.829601 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaa43e47-fa3e-4c0a-ad78-2e1e7320578b None admin] REQUEST_METHOD: `GET` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:40:49.829889 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaa43e47-fa3e-4c0a-ad78-2e1e7320578b None admin] SCRIPT_NAME: `/identity` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:40:49.830171 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaa43e47-fa3e-4c0a-ad78-2e1e7320578b None admin] PATH_INFO: `/v3/domains/default` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:40:49.831337 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaa43e47-fa3e-4c0a-ad78-2e1e7320578b None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=82025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:40:49.832775 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaa43e47-fa3e-4c0a-ad78-2e1e7320578b None admin] RBAC: Authorization granted {{(pid=82025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:40:49.834325 dv-cinder-828806-6-smb devstack@keystone.service[82025]: [pid: 82025|app: 0|req: 38/80] 10.222.0.33 () {56 vars in 1108 bytes} [Tue Sep 13 19:40:49 2022] GET /identity/v3/domains/default => generated 199 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 19:40:49.839155 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaa43e47-fa3e-4c0a-ad78-2e1e7320578b None admin] Authenticating user token {{(pid=82025) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:40:49.852318 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e019b78c-e2da-47ea-b728-62c7c111813c None admin] Validating token access rules against request {{(pid=82026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:40:49.885274 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-385d73d6-a473-4780-bfe1-d4a095c2142a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57539b6a6f3b4d589f5f5e1d211cd6a0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:40:49.885899 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-385d73d6-a473-4780-bfe1-d4a095c2142a None admin] REQUEST_METHOD: `GET` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:40:49.886186 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-385d73d6-a473-4780-bfe1-d4a095c2142a None admin] SCRIPT_NAME: `/identity` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:40:49.886464 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-385d73d6-a473-4780-bfe1-d4a095c2142a None admin] PATH_INFO: `/v3/users/6485aa9aa85e4a2aa1b120072f8422e4` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:40:49.889655 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG dbcounter [-] [82026] Writing DB stats keystone:SELECT=100 {{(pid=82026) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:40:49.893012 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG dbcounter [-] [82025] Writing DB stats keystone:SELECT=100 {{(pid=82025) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:40:49.900959 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-385d73d6-a473-4780-bfe1-d4a095c2142a None admin] RBAC: Authorizing `identity:get_user(user_id=6485aa9aa85e4a2aa1b120072f8422e4)` {{(pid=82026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:40:49.902792 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-385d73d6-a473-4780-bfe1-d4a095c2142a None admin] RBAC: Authorization granted {{(pid=82026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:40:49.905312 dv-cinder-828806-6-smb devstack@keystone.service[82026]: [pid: 82026|app: 0|req: 43/81] 10.222.0.33 () {56 vars in 1177 bytes} [Tue Sep 13 19:40:49 2022] GET /identity/v3/users/6485aa9aa85e4a2aa1b120072f8422e4 => generated 275 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 19:40:49.906091 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-385d73d6-a473-4780-bfe1-d4a095c2142a None admin] Authenticating user token {{(pid=82026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:40:49.938608 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaa43e47-fa3e-4c0a-ad78-2e1e7320578b None admin] Validating token access rules against request {{(pid=82025) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:40:49.972724 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bda046d0-5290-4625-ba78-d16b3a4aaefd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57539b6a6f3b4d589f5f5e1d211cd6a0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82025) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:40:49.973343 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bda046d0-5290-4625-ba78-d16b3a4aaefd None admin] REQUEST_METHOD: `GET` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:40:49.973631 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bda046d0-5290-4625-ba78-d16b3a4aaefd None admin] SCRIPT_NAME: `/identity` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:40:49.973919 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bda046d0-5290-4625-ba78-d16b3a4aaefd None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:40:50.006758 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-385d73d6-a473-4780-bfe1-d4a095c2142a None admin] Validating token access rules against request {{(pid=82026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:40:50.040459 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1c56ac3-2412-42b6-b43f-f6edf4a6df1f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57539b6a6f3b4d589f5f5e1d211cd6a0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:40:50.040621 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bda046d0-5290-4625-ba78-d16b3a4aaefd None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=82025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:40:50.041077 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1c56ac3-2412-42b6-b43f-f6edf4a6df1f None admin] REQUEST_METHOD: `GET` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:40:50.041370 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1c56ac3-2412-42b6-b43f-f6edf4a6df1f None admin] SCRIPT_NAME: `/identity` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:40:50.041656 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1c56ac3-2412-42b6-b43f-f6edf4a6df1f None admin] PATH_INFO: `/v3/roles` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:40:50.042114 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bda046d0-5290-4625-ba78-d16b3a4aaefd None admin] RBAC: Authorization granted {{(pid=82025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:40:50.042381 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1c56ac3-2412-42b6-b43f-f6edf4a6df1f None admin] RBAC: Adding query filter params (name=member) {{(pid=82026) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 19:40:50.042698 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1c56ac3-2412-42b6-b43f-f6edf4a6df1f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:40:50.044186 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1c56ac3-2412-42b6-b43f-f6edf4a6df1f None admin] RBAC: Authorization granted {{(pid=82026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:40:50.052767 dv-cinder-828806-6-smb devstack@keystone.service[82026]: [pid: 82026|app: 0|req: 44/82] 10.222.0.33 () {56 vars in 1101 bytes} [Tue Sep 13 19:40:49 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 19:40:50.057534 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1c56ac3-2412-42b6-b43f-f6edf4a6df1f None admin] Authenticating user token {{(pid=82026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:40:50.097405 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG dbcounter [-] [82025] Writing DB stats keystone:SELECT=100 {{(pid=82025) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:40:50.113008 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG dbcounter [-] [82026] Writing DB stats keystone:SELECT=100 {{(pid=82026) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:40:50.142264 dv-cinder-828806-6-smb devstack@keystone.service[82025]: [pid: 82025|app: 0|req: 39/83] 10.222.0.33 () {58 vars in 1282 bytes} [Tue Sep 13 19:40:49 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 307 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 13 19:40:50.143203 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bda046d0-5290-4625-ba78-d16b3a4aaefd None admin] Authenticating user token {{(pid=82025) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:40:50.159733 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1c56ac3-2412-42b6-b43f-f6edf4a6df1f None admin] Validating token access rules against request {{(pid=82026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:40:50.192771 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2815673d-052e-41c8-9b66-6f78b524178a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57539b6a6f3b4d589f5f5e1d211cd6a0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:40:50.193333 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2815673d-052e-41c8-9b66-6f78b524178a None admin] REQUEST_METHOD: `GET` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:40:50.193621 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2815673d-052e-41c8-9b66-6f78b524178a None admin] SCRIPT_NAME: `/identity` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:40:50.193901 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2815673d-052e-41c8-9b66-6f78b524178a None admin] PATH_INFO: `/v3/users/6485aa9aa85e4a2aa1b120072f8422e4` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:40:50.195048 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2815673d-052e-41c8-9b66-6f78b524178a None admin] RBAC: Authorizing `identity:get_user(user_id=6485aa9aa85e4a2aa1b120072f8422e4)` {{(pid=82026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:40:50.196501 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2815673d-052e-41c8-9b66-6f78b524178a None admin] RBAC: Authorization granted {{(pid=82026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:40:50.198067 dv-cinder-828806-6-smb devstack@keystone.service[82026]: [pid: 82026|app: 0|req: 45/84] 10.222.0.33 () {56 vars in 1177 bytes} [Tue Sep 13 19:40:50 2022] GET /identity/v3/users/6485aa9aa85e4a2aa1b120072f8422e4 => generated 275 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 19:40:50.198908 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2815673d-052e-41c8-9b66-6f78b524178a None admin] Authenticating user token {{(pid=82026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:40:50.252411 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bda046d0-5290-4625-ba78-d16b3a4aaefd None admin] Validating token access rules against request {{(pid=82025) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:40:50.289489 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81f5fc48-b823-4ee1-8a6d-98036967bcee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57539b6a6f3b4d589f5f5e1d211cd6a0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82025) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:40:50.290102 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81f5fc48-b823-4ee1-8a6d-98036967bcee None admin] REQUEST_METHOD: `POST` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:40:50.290411 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81f5fc48-b823-4ee1-8a6d-98036967bcee None admin] SCRIPT_NAME: `/identity` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:40:50.290686 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81f5fc48-b823-4ee1-8a6d-98036967bcee None admin] PATH_INFO: `/v3/users` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:40:50.291387 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81f5fc48-b823-4ee1-8a6d-98036967bcee None admin] RBAC: Authorizing `identity:create_user()` {{(pid=82025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:40:50.292836 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81f5fc48-b823-4ee1-8a6d-98036967bcee None admin] RBAC: Authorization granted {{(pid=82025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:40:50.300737 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2815673d-052e-41c8-9b66-6f78b524178a None admin] Validating token access rules against request {{(pid=82026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:40:50.324850 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG dbcounter [-] [82026] Writing DB stats keystone:SELECT=100 {{(pid=82026) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:40:50.335392 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52237ea1-e30e-4875-b98d-016dc7503c37 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57539b6a6f3b4d589f5f5e1d211cd6a0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:40:50.336009 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52237ea1-e30e-4875-b98d-016dc7503c37 None admin] REQUEST_METHOD: `GET` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:40:50.336301 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52237ea1-e30e-4875-b98d-016dc7503c37 None admin] SCRIPT_NAME: `/identity` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:40:50.336588 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52237ea1-e30e-4875-b98d-016dc7503c37 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:40:50.376161 dv-cinder-828806-6-smb devstack@keystone.service[82025]: [pid: 82025|app: 0|req: 40/85] 10.222.0.33 () {60 vars in 1132 bytes} [Tue Sep 13 19:40:50 2022] POST /identity/v3/users => generated 289 bytes in 233 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 13 19:40:50.377940 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81f5fc48-b823-4ee1-8a6d-98036967bcee None admin] Authenticating user token {{(pid=82025) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:40:50.392989 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG dbcounter [-] [82025] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=82025) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:40:50.417717 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52237ea1-e30e-4875-b98d-016dc7503c37 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=82026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:40:50.421358 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52237ea1-e30e-4875-b98d-016dc7503c37 None admin] RBAC: Authorization granted {{(pid=82026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:40:50.496640 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81f5fc48-b823-4ee1-8a6d-98036967bcee None admin] Validating token access rules against request {{(pid=82025) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:40:50.536038 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-592206fe-06a2-459c-b411-44fcdd8a30d8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57539b6a6f3b4d589f5f5e1d211cd6a0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82025) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:40:50.536757 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-592206fe-06a2-459c-b411-44fcdd8a30d8 None admin] REQUEST_METHOD: `GET` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:40:50.537044 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-592206fe-06a2-459c-b411-44fcdd8a30d8 None admin] SCRIPT_NAME: `/identity` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:40:50.537250 dv-cinder-828806-6-smb devstack@keystone.service[82026]: [pid: 82026|app: 0|req: 46/86] 10.222.0.33 () {58 vars in 1282 bytes} [Tue Sep 13 19:40:50 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 339 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 13 19:40:50.538094 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52237ea1-e30e-4875-b98d-016dc7503c37 None admin] Authenticating user token {{(pid=82026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:40:50.542220 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-592206fe-06a2-459c-b411-44fcdd8a30d8 None admin] PATH_INFO: `/v3/users/6485aa9aa85e4a2aa1b120072f8422e4` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:40:50.543596 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-592206fe-06a2-459c-b411-44fcdd8a30d8 None admin] RBAC: Authorizing `identity:get_user(user_id=6485aa9aa85e4a2aa1b120072f8422e4)` {{(pid=82025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:40:50.545896 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-592206fe-06a2-459c-b411-44fcdd8a30d8 None admin] RBAC: Authorization granted {{(pid=82025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:40:50.547544 dv-cinder-828806-6-smb devstack@keystone.service[82025]: [pid: 82025|app: 0|req: 41/87] 10.222.0.33 () {56 vars in 1177 bytes} [Tue Sep 13 19:40:50 2022] GET /identity/v3/users/6485aa9aa85e4a2aa1b120072f8422e4 => generated 275 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 19:40:50.548325 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-592206fe-06a2-459c-b411-44fcdd8a30d8 None admin] Authenticating user token {{(pid=82025) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:40:50.571966 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG dbcounter [-] [82026] Writing DB stats keystone:SELECT=100 {{(pid=82026) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:40:50.641628 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG dbcounter [-] [82025] Writing DB stats keystone:SELECT=100 {{(pid=82025) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:40:50.667519 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-592206fe-06a2-459c-b411-44fcdd8a30d8 None admin] Validating token access rules against request {{(pid=82025) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:40:50.667772 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52237ea1-e30e-4875-b98d-016dc7503c37 None admin] Validating token access rules against request {{(pid=82026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:40:50.711232 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f4c6380-4341-4c7e-ad20-e163cdca00e5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57539b6a6f3b4d589f5f5e1d211cd6a0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:40:50.711881 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f4c6380-4341-4c7e-ad20-e163cdca00e5 None admin] REQUEST_METHOD: `GET` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:40:50.712167 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f4c6380-4341-4c7e-ad20-e163cdca00e5 None admin] SCRIPT_NAME: `/identity` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:40:50.712447 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f4c6380-4341-4c7e-ad20-e163cdca00e5 None admin] PATH_INFO: `/v3/projects/7e18b3e4745c4afeaafeb826dc0445e0` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:40:50.713577 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f4c6380-4341-4c7e-ad20-e163cdca00e5 None admin] RBAC: Authorizing `identity:get_project(project_id=7e18b3e4745c4afeaafeb826dc0445e0)` {{(pid=82026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:40:50.714139 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96c5210f-065c-4330-9648-82c297d90345 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57539b6a6f3b4d589f5f5e1d211cd6a0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82025) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:40:50.714763 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96c5210f-065c-4330-9648-82c297d90345 None admin] REQUEST_METHOD: `GET` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:40:50.715058 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f4c6380-4341-4c7e-ad20-e163cdca00e5 None admin] RBAC: Authorization granted {{(pid=82026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:40:50.715157 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96c5210f-065c-4330-9648-82c297d90345 None admin] SCRIPT_NAME: `/identity` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:40:50.715429 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96c5210f-065c-4330-9648-82c297d90345 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:40:50.717910 dv-cinder-828806-6-smb devstack@keystone.service[82026]: [pid: 82026|app: 0|req: 47/88] 10.222.0.33 () {56 vars in 1186 bytes} [Tue Sep 13 19:40:50 2022] GET /identity/v3/projects/7e18b3e4745c4afeaafeb826dc0445e0 => generated 298 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 19:40:50.718721 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f4c6380-4341-4c7e-ad20-e163cdca00e5 None admin] Authenticating user token {{(pid=82026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:40:50.801164 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96c5210f-065c-4330-9648-82c297d90345 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=82025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:40:50.803456 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96c5210f-065c-4330-9648-82c297d90345 None admin] RBAC: Authorization granted {{(pid=82025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:40:50.845469 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG dbcounter [-] [82026] Writing DB stats keystone:SELECT=100 {{(pid=82026) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:40:50.854442 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f4c6380-4341-4c7e-ad20-e163cdca00e5 None admin] Validating token access rules against request {{(pid=82026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:40:50.896546 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0732e252-446f-4f21-b229-9aff1a7f0d4f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57539b6a6f3b4d589f5f5e1d211cd6a0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:40:50.897742 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0732e252-446f-4f21-b229-9aff1a7f0d4f None admin] REQUEST_METHOD: `GET` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:40:50.898114 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0732e252-446f-4f21-b229-9aff1a7f0d4f None admin] SCRIPT_NAME: `/identity` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:40:50.898497 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0732e252-446f-4f21-b229-9aff1a7f0d4f None admin] PATH_INFO: `/v3/projects/7e18b3e4745c4afeaafeb826dc0445e0` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:40:50.899975 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0732e252-446f-4f21-b229-9aff1a7f0d4f None admin] RBAC: Authorizing `identity:get_project(project_id=7e18b3e4745c4afeaafeb826dc0445e0)` {{(pid=82026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:40:50.902718 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0732e252-446f-4f21-b229-9aff1a7f0d4f None admin] RBAC: Authorization granted {{(pid=82026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:40:50.905230 dv-cinder-828806-6-smb devstack@keystone.service[82026]: [pid: 82026|app: 0|req: 48/89] 10.222.0.33 () {56 vars in 1186 bytes} [Tue Sep 13 19:40:50 2022] GET /identity/v3/projects/7e18b3e4745c4afeaafeb826dc0445e0 => generated 298 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 19:40:50.907104 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0732e252-446f-4f21-b229-9aff1a7f0d4f None admin] Authenticating user token {{(pid=82026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:40:50.932909 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG dbcounter [-] [82025] Writing DB stats keystone:SELECT=100 {{(pid=82025) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:40:50.963523 dv-cinder-828806-6-smb devstack@keystone.service[82025]: [pid: 82025|app: 0|req: 42/90] 10.222.0.33 () {58 vars in 1282 bytes} [Tue Sep 13 19:40:50 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 415 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 13 19:40:50.969650 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96c5210f-065c-4330-9648-82c297d90345 None admin] Authenticating user token {{(pid=82025) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:40:51.031416 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0732e252-446f-4f21-b229-9aff1a7f0d4f None admin] Validating token access rules against request {{(pid=82026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:40:51.067795 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01070b89-5c49-4d4b-84c8-856b61a25e0d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57539b6a6f3b4d589f5f5e1d211cd6a0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:40:51.068336 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01070b89-5c49-4d4b-84c8-856b61a25e0d None admin] REQUEST_METHOD: `GET` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:40:51.068628 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01070b89-5c49-4d4b-84c8-856b61a25e0d None admin] SCRIPT_NAME: `/identity` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:40:51.068914 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01070b89-5c49-4d4b-84c8-856b61a25e0d None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:40:51.082603 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96c5210f-065c-4330-9648-82c297d90345 None admin] Validating token access rules against request {{(pid=82025) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:40:51.107590 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG dbcounter [-] [82026] Writing DB stats keystone:SELECT=100 {{(pid=82026) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:40:51.121382 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bf76b41-b857-4437-808f-0327059f4cbf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57539b6a6f3b4d589f5f5e1d211cd6a0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82025) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:40:51.122302 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bf76b41-b857-4437-808f-0327059f4cbf None admin] REQUEST_METHOD: `GET` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:40:51.122862 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bf76b41-b857-4437-808f-0327059f4cbf None admin] SCRIPT_NAME: `/identity` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:40:51.123341 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bf76b41-b857-4437-808f-0327059f4cbf None admin] PATH_INFO: `/v3/role_assignments` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:40:51.124265 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bf76b41-b857-4437-808f-0327059f4cbf None admin] RBAC: Adding query filter params (role.id=e5af7d5baa93469e9e486ef21c85474e, scope.project.id=7e18b3e4745c4afeaafeb826dc0445e0, user.id=57539b6a6f3b4d589f5f5e1d211cd6a0) {{(pid=82025) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 19:40:51.124756 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bf76b41-b857-4437-808f-0327059f4cbf None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=82025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:40:51.126434 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bf76b41-b857-4437-808f-0327059f4cbf None admin] RBAC: Authorization granted {{(pid=82025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:40:51.132154 dv-cinder-828806-6-smb devstack@keystone.service[82025]: [pid: 82025|app: 0|req: 43/91] 10.222.0.33 () {56 vars in 1374 bytes} [Tue Sep 13 19:40:50 2022] GET /identity/v3/role_assignments?user.id=57539b6a6f3b4d589f5f5e1d211cd6a0&scope.project.id=7e18b3e4745c4afeaafeb826dc0445e0&role.id=e5af7d5baa93469e9e486ef21c85474e => generated 259 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 19:40:51.133191 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bf76b41-b857-4437-808f-0327059f4cbf None admin] Authenticating user token {{(pid=82025) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:40:51.146615 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01070b89-5c49-4d4b-84c8-856b61a25e0d None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=82026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:40:51.148443 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01070b89-5c49-4d4b-84c8-856b61a25e0d None admin] RBAC: Authorization granted {{(pid=82026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:40:51.186172 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG dbcounter [-] [82025] Writing DB stats keystone:SELECT=100 {{(pid=82025) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:40:51.254487 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bf76b41-b857-4437-808f-0327059f4cbf None admin] Validating token access rules against request {{(pid=82025) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:40:51.314714 dv-cinder-828806-6-smb devstack@keystone.service[82026]: [pid: 82026|app: 0|req: 49/92] 10.222.0.33 () {58 vars in 1282 bytes} [Tue Sep 13 19:40:50 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 409 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 13 19:40:51.315540 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01070b89-5c49-4d4b-84c8-856b61a25e0d None admin] Authenticating user token {{(pid=82026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:40:51.333724 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-117e333b-986c-4518-ac8e-e1f72396b7b4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57539b6a6f3b4d589f5f5e1d211cd6a0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82025) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:40:51.334280 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-117e333b-986c-4518-ac8e-e1f72396b7b4 None admin] REQUEST_METHOD: `GET` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:40:51.334571 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-117e333b-986c-4518-ac8e-e1f72396b7b4 None admin] SCRIPT_NAME: `/identity` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:40:51.334855 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-117e333b-986c-4518-ac8e-e1f72396b7b4 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:40:51.335789 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-117e333b-986c-4518-ac8e-e1f72396b7b4 None admin] RBAC: Adding query filter params (role.id=6bcd095c76b341e186ea8caa11f5fa31, scope.project.id=7e18b3e4745c4afeaafeb826dc0445e0, user.id=6485aa9aa85e4a2aa1b120072f8422e4) {{(pid=82025) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 19:40:51.336109 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-117e333b-986c-4518-ac8e-e1f72396b7b4 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=82025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:40:51.337592 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-117e333b-986c-4518-ac8e-e1f72396b7b4 None admin] RBAC: Authorization granted {{(pid=82025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:40:51.349342 dv-cinder-828806-6-smb devstack@keystone.service[82025]: [pid: 82025|app: 0|req: 44/93] 10.222.0.33 () {56 vars in 1374 bytes} [Tue Sep 13 19:40:51 2022] GET /identity/v3/role_assignments?user.id=6485aa9aa85e4a2aa1b120072f8422e4&scope.project.id=7e18b3e4745c4afeaafeb826dc0445e0&role.id=6bcd095c76b341e186ea8caa11f5fa31 => generated 259 bytes in 216 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 19:40:51.352278 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-117e333b-986c-4518-ac8e-e1f72396b7b4 None admin] Authenticating user token {{(pid=82025) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:40:51.460276 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG dbcounter [-] [82026] Writing DB stats keystone:SELECT=100 {{(pid=82026) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:40:51.483862 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-117e333b-986c-4518-ac8e-e1f72396b7b4 None admin] Validating token access rules against request {{(pid=82025) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:40:51.502052 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG dbcounter [-] [82025] Writing DB stats keystone:SELECT=100 {{(pid=82025) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:40:51.549676 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9777a3b3-ff60-469e-ab59-dc60b8b99ac9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57539b6a6f3b4d589f5f5e1d211cd6a0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82025) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:40:51.550670 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9777a3b3-ff60-469e-ab59-dc60b8b99ac9 None admin] REQUEST_METHOD: `GET` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:40:51.554244 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01070b89-5c49-4d4b-84c8-856b61a25e0d None admin] Validating token access rules against request {{(pid=82026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:40:51.554494 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9777a3b3-ff60-469e-ab59-dc60b8b99ac9 None admin] SCRIPT_NAME: `/identity` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:40:51.554984 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9777a3b3-ff60-469e-ab59-dc60b8b99ac9 None admin] PATH_INFO: `/v3/projects/4e1069c665d147a9b09c598d9a1ac8e4` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:40:51.556464 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9777a3b3-ff60-469e-ab59-dc60b8b99ac9 None admin] RBAC: Authorizing `identity:get_project(project_id=4e1069c665d147a9b09c598d9a1ac8e4)` {{(pid=82025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:40:51.559315 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9777a3b3-ff60-469e-ab59-dc60b8b99ac9 None admin] RBAC: Authorization granted {{(pid=82025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:40:51.566000 dv-cinder-828806-6-smb devstack@keystone.service[82025]: [pid: 82025|app: 0|req: 45/94] 10.222.0.33 () {56 vars in 1186 bytes} [Tue Sep 13 19:40:51 2022] GET /identity/v3/projects/4e1069c665d147a9b09c598d9a1ac8e4 => generated 312 bytes in 213 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 19:40:51.578087 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9777a3b3-ff60-469e-ab59-dc60b8b99ac9 None admin] Authenticating user token {{(pid=82025) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:40:51.634557 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b72987a-2096-4370-b7fa-382d9ef6494f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57539b6a6f3b4d589f5f5e1d211cd6a0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:40:51.635152 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b72987a-2096-4370-b7fa-382d9ef6494f None admin] REQUEST_METHOD: `GET` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:40:51.635659 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b72987a-2096-4370-b7fa-382d9ef6494f None admin] SCRIPT_NAME: `/identity` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:40:51.635955 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b72987a-2096-4370-b7fa-382d9ef6494f None admin] PATH_INFO: `/v3/projects/7e18b3e4745c4afeaafeb826dc0445e0` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:40:51.639528 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b72987a-2096-4370-b7fa-382d9ef6494f None admin] RBAC: Authorizing `identity:get_project(project_id=7e18b3e4745c4afeaafeb826dc0445e0)` {{(pid=82026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:40:51.641935 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b72987a-2096-4370-b7fa-382d9ef6494f None admin] RBAC: Authorization granted {{(pid=82026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:40:51.644674 dv-cinder-828806-6-smb devstack@keystone.service[82026]: [pid: 82026|app: 0|req: 50/95] 10.222.0.33 () {56 vars in 1186 bytes} [Tue Sep 13 19:40:51 2022] GET /identity/v3/projects/7e18b3e4745c4afeaafeb826dc0445e0 => generated 298 bytes in 330 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 19:40:51.656553 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b72987a-2096-4370-b7fa-382d9ef6494f None admin] Authenticating user token {{(pid=82026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:40:51.771077 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9777a3b3-ff60-469e-ab59-dc60b8b99ac9 None admin] Validating token access rules against request {{(pid=82025) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:40:51.817823 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b72987a-2096-4370-b7fa-382d9ef6494f None admin] Validating token access rules against request {{(pid=82026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:40:51.847772 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f16681b5-33c3-4f18-9a26-827a88cb48c7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57539b6a6f3b4d589f5f5e1d211cd6a0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82025) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:40:51.848726 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f16681b5-33c3-4f18-9a26-827a88cb48c7 None admin] REQUEST_METHOD: `GET` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:40:51.849386 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f16681b5-33c3-4f18-9a26-827a88cb48c7 None admin] SCRIPT_NAME: `/identity` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:40:51.849852 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f16681b5-33c3-4f18-9a26-827a88cb48c7 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:40:51.850604 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f16681b5-33c3-4f18-9a26-827a88cb48c7 None admin] RBAC: Adding query filter params (role.id=3618ab638a65401f82333da7596d1daf, scope.project.id=4e1069c665d147a9b09c598d9a1ac8e4, user.id=6485aa9aa85e4a2aa1b120072f8422e4) {{(pid=82025) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 19:40:51.850918 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f16681b5-33c3-4f18-9a26-827a88cb48c7 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=82025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:40:51.852406 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f16681b5-33c3-4f18-9a26-827a88cb48c7 None admin] RBAC: Authorization granted {{(pid=82025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:40:51.854769 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG dbcounter [-] [82026] Writing DB stats keystone:SELECT=100 {{(pid=82026) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:40:51.863698 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ba58ddc-b275-4a73-a447-489830688dc1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57539b6a6f3b4d589f5f5e1d211cd6a0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:40:51.864568 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ba58ddc-b275-4a73-a447-489830688dc1 None admin] REQUEST_METHOD: `GET` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:40:51.865033 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ba58ddc-b275-4a73-a447-489830688dc1 None admin] SCRIPT_NAME: `/identity` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:40:51.865490 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ba58ddc-b275-4a73-a447-489830688dc1 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:40:51.866463 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ba58ddc-b275-4a73-a447-489830688dc1 None admin] RBAC: Adding query filter params (role.id=3618ab638a65401f82333da7596d1daf, scope.project.id=7e18b3e4745c4afeaafeb826dc0445e0, user.id=6485aa9aa85e4a2aa1b120072f8422e4) {{(pid=82026) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 19:40:51.866960 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ba58ddc-b275-4a73-a447-489830688dc1 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=82026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:40:51.868944 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ba58ddc-b275-4a73-a447-489830688dc1 None admin] RBAC: Authorization granted {{(pid=82026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:40:51.870169 dv-cinder-828806-6-smb devstack@keystone.service[82025]: [pid: 82025|app: 0|req: 46/96] 10.222.0.33 () {56 vars in 1374 bytes} [Tue Sep 13 19:40:51 2022] GET /identity/v3/role_assignments?user.id=6485aa9aa85e4a2aa1b120072f8422e4&scope.project.id=4e1069c665d147a9b09c598d9a1ac8e4&role.id=3618ab638a65401f82333da7596d1daf => generated 259 bytes in 293 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 13 19:40:51.882344 dv-cinder-828806-6-smb devstack@keystone.service[82026]: [pid: 82026|app: 0|req: 51/97] 10.222.0.33 () {56 vars in 1374 bytes} [Tue Sep 13 19:40:51 2022] GET /identity/v3/role_assignments?user.id=6485aa9aa85e4a2aa1b120072f8422e4&scope.project.id=7e18b3e4745c4afeaafeb826dc0445e0&role.id=3618ab638a65401f82333da7596d1daf => generated 259 bytes in 227 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 13 19:40:53.215520 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a423789f-4dec-438a-ae36-2733e4996c0e None None] REQUEST_METHOD: `GET` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:40:53.217103 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a423789f-4dec-438a-ae36-2733e4996c0e None None] SCRIPT_NAME: `/identity` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:40:53.217631 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a423789f-4dec-438a-ae36-2733e4996c0e None None] PATH_INFO: `/` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:40:53.219276 dv-cinder-828806-6-smb devstack@keystone.service[82025]: [pid: 82025|app: 0|req: 47/98] 10.222.0.33 () {54 vars in 927 bytes} [Tue Sep 13 19:40:53 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 19:40:53.225148 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7bc24a3-fb94-4175-b220-845bc277af38 None None] REQUEST_METHOD: `POST` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:40:53.226014 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7bc24a3-fb94-4175-b220-845bc277af38 None None] SCRIPT_NAME: `/identity` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:40:53.226501 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7bc24a3-fb94-4175-b220-845bc277af38 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:40:53.251558 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.auth.core [None req-a7bc24a3-fb94-4175-b220-845bc277af38 None None] MFA Rules not processed for user `57539b6a6f3b4d589f5f5e1d211cd6a0`. Rule list: `[]` (Enabled: `True`). {{(pid=82026) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 19:40:53.253118 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.common.fernet_utils [None req-a7bc24a3-fb94-4175-b220-845bc277af38 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82026) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 19:40:53.356265 dv-cinder-828806-6-smb devstack@keystone.service[82026]: [pid: 82026|app: 0|req: 52/99] 10.222.0.33 () {58 vars in 1024 bytes} [Tue Sep 13 19:40:53 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 132 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 13 19:40:53.894415 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a423789f-4dec-438a-ae36-2733e4996c0e None None] Authenticating user token {{(pid=82025) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:40:53.942254 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG dbcounter [-] [82025] Writing DB stats keystone:SELECT=100 {{(pid=82025) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:40:53.969058 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a77fc08-6cc6-4c48-93bb-1f9191533c6c None None] REQUEST_METHOD: `GET` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:40:53.969365 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a77fc08-6cc6-4c48-93bb-1f9191533c6c None None] SCRIPT_NAME: `/identity` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:40:53.969636 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a77fc08-6cc6-4c48-93bb-1f9191533c6c None None] PATH_INFO: `/` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:40:53.971195 dv-cinder-828806-6-smb devstack@keystone.service[82026]: [pid: 82026|app: 0|req: 53/100] 10.222.0.33 () {54 vars in 927 bytes} [Tue Sep 13 19:40:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 19:40:53.975786 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa3fa53a-bc22-44dc-ad45-129dc5b2c784 None None] REQUEST_METHOD: `GET` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:40:53.976099 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa3fa53a-bc22-44dc-ad45-129dc5b2c784 None None] SCRIPT_NAME: `/identity` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:40:53.976397 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa3fa53a-bc22-44dc-ad45-129dc5b2c784 None None] PATH_INFO: `/` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:40:53.977739 dv-cinder-828806-6-smb devstack@keystone.service[82026]: [pid: 82026|app: 0|req: 54/101] 10.222.0.33 () {54 vars in 927 bytes} [Tue Sep 13 19:40:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 13 19:40:53.978782 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03d4e090-829f-45d7-b9af-1b728926376e None None] REQUEST_METHOD: `POST` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:40:53.979092 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03d4e090-829f-45d7-b9af-1b728926376e None None] SCRIPT_NAME: `/identity` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:40:53.979380 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03d4e090-829f-45d7-b9af-1b728926376e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:40:54.015096 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a423789f-4dec-438a-ae36-2733e4996c0e None None] Validating token access rules against request {{(pid=82025) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:40:54.020127 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.auth.core [None req-03d4e090-829f-45d7-b9af-1b728926376e None None] MFA Rules not processed for user `57539b6a6f3b4d589f5f5e1d211cd6a0`. Rule list: `[]` (Enabled: `True`). {{(pid=82026) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 19:40:54.021356 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.common.fernet_utils [None req-03d4e090-829f-45d7-b9af-1b728926376e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82026) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 19:40:54.051105 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74dea0b0-86ef-438b-aabf-9dff8fdb8776 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57539b6a6f3b4d589f5f5e1d211cd6a0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82025) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:40:54.051756 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74dea0b0-86ef-438b-aabf-9dff8fdb8776 None admin] REQUEST_METHOD: `GET` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:40:54.052050 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74dea0b0-86ef-438b-aabf-9dff8fdb8776 None admin] SCRIPT_NAME: `/identity` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:40:54.052344 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74dea0b0-86ef-438b-aabf-9dff8fdb8776 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:40:54.064548 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74dea0b0-86ef-438b-aabf-9dff8fdb8776 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=82025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 13 19:40:54.070150 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application [None req-74dea0b0-86ef-438b-aabf-9dff8fdb8776 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Sep 13 19:40:54.070150 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 19:40:54.070150 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 19:40:54.070150 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 19:40:54.070150 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 19:40:54.070150 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 19:40:54.070150 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 19:40:54.070150 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 19:40:54.070150 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 19:40:54.070150 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 19:40:54.070150 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 19:40:54.070150 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 19:40:54.070150 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 13 19:40:54.070150 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 13 19:40:54.070150 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 13 19:40:54.070150 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 13 19:40:54.071017 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 13 19:40:54.071017 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 13 19:40:54.071017 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 13 19:40:54.071017 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 13 19:40:54.071017 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 19:40:54.071017 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 19:40:54.071017 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 19:40:54.071017 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 19:40:54.071017 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 19:40:54.071017 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 19:40:54.071017 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 19:40:54.071017 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application with Lock( Sep 13 19:40:54.071017 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 19:40:54.071017 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application return self._enter() Sep 13 19:40:54.071017 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 19:40:54.071017 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 19:40:54.072445 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 19:40:54.072445 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application return self.creator() Sep 13 19:40:54.072445 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 19:40:54.072445 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application created_value = creator( Sep 13 19:40:54.072445 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 13 19:40:54.072445 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 13 19:40:54.072445 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 13 19:40:54.072445 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 13 19:40:54.072445 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 13 19:40:54.072445 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 13 19:40:54.072445 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Sep 13 19:40:54.072445 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application Sep 13 19:40:54.072445 dv-cinder-828806-6-smb devstack@keystone.service[82025]: [pid: 82025|app: 0|req: 48/102] 10.222.0.33 () {56 vars in 1099 bytes} [Tue Sep 13 19:40:53 2022] GET /identity/v3/roles/reader => generated 84 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 19:40:54.073104 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fedce618-ac0c-4ffd-8c2c-2ad3c3d11d6c None None] REQUEST_METHOD: `POST` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:40:54.073104 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fedce618-ac0c-4ffd-8c2c-2ad3c3d11d6c None None] SCRIPT_NAME: `/identity` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:40:54.073104 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fedce618-ac0c-4ffd-8c2c-2ad3c3d11d6c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:40:54.092913 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.auth.core [None req-fedce618-ac0c-4ffd-8c2c-2ad3c3d11d6c None None] MFA Rules not processed for user `57539b6a6f3b4d589f5f5e1d211cd6a0`. Rule list: `[]` (Enabled: `True`). {{(pid=82025) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 19:40:54.094137 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.fernet_utils [None req-fedce618-ac0c-4ffd-8c2c-2ad3c3d11d6c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82025) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 19:40:54.172576 dv-cinder-828806-6-smb devstack@keystone.service[82025]: [pid: 82025|app: 0|req: 49/103] 10.222.0.33 () {58 vars in 1024 bytes} [Tue Sep 13 19:40:54 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 13 19:40:54.173367 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fedce618-ac0c-4ffd-8c2c-2ad3c3d11d6c None None] Authenticating user token {{(pid=82025) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:40:54.203464 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG dbcounter [-] [82025] Writing DB stats keystone:SELECT=100 {{(pid=82025) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:40:54.247180 dv-cinder-828806-6-smb devstack@keystone.service[82026]: [pid: 82026|app: 0|req: 55/104] 10.222.0.33 () {58 vars in 1024 bytes} [Tue Sep 13 19:40:53 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 269 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 13 19:40:54.303430 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fedce618-ac0c-4ffd-8c2c-2ad3c3d11d6c None None] Validating token access rules against request {{(pid=82025) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:40:54.338670 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b2ef559-2c4c-413e-af55-28095312b061 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57539b6a6f3b4d589f5f5e1d211cd6a0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82025) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:40:54.340320 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b2ef559-2c4c-413e-af55-28095312b061 None admin] REQUEST_METHOD: `GET` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:40:54.340320 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b2ef559-2c4c-413e-af55-28095312b061 None admin] SCRIPT_NAME: `/identity` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:40:54.340320 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b2ef559-2c4c-413e-af55-28095312b061 None admin] PATH_INFO: `/v3/roles` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:40:54.342089 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b2ef559-2c4c-413e-af55-28095312b061 None admin] RBAC: Adding query filter params (name=reader) {{(pid=82025) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 19:40:54.342406 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b2ef559-2c4c-413e-af55-28095312b061 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:40:54.343930 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b2ef559-2c4c-413e-af55-28095312b061 None admin] RBAC: Authorization granted {{(pid=82025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:40:54.352759 dv-cinder-828806-6-smb devstack@keystone.service[82025]: [pid: 82025|app: 0|req: 50/105] 10.222.0.33 () {56 vars in 1101 bytes} [Tue Sep 13 19:40:54 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 19:40:54.364136 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03d4e090-829f-45d7-b9af-1b728926376e None None] Authenticating user token {{(pid=82026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:40:54.425461 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1523418c-5d0b-4a4b-b50d-807664f99c50 None None] REQUEST_METHOD: `GET` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:40:54.425757 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1523418c-5d0b-4a4b-b50d-807664f99c50 None None] SCRIPT_NAME: `/identity` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:40:54.425966 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1523418c-5d0b-4a4b-b50d-807664f99c50 None None] PATH_INFO: `/` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:40:54.427640 dv-cinder-828806-6-smb devstack@keystone.service[82025]: [pid: 82025|app: 0|req: 51/106] 10.222.0.33 () {54 vars in 927 bytes} [Tue Sep 13 19:40:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 19:40:54.436164 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d78eb68-8593-48c9-b37c-754dbd585ae4 None None] REQUEST_METHOD: `POST` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:40:54.436455 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d78eb68-8593-48c9-b37c-754dbd585ae4 None None] SCRIPT_NAME: `/identity` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:40:54.436768 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d78eb68-8593-48c9-b37c-754dbd585ae4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:40:54.450387 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG dbcounter [-] [82026] Writing DB stats keystone:SELECT=100 {{(pid=82026) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:40:54.462808 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.auth.core [None req-9d78eb68-8593-48c9-b37c-754dbd585ae4 None None] MFA Rules not processed for user `57539b6a6f3b4d589f5f5e1d211cd6a0`. Rule list: `[]` (Enabled: `True`). {{(pid=82025) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 19:40:54.464052 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.fernet_utils [None req-9d78eb68-8593-48c9-b37c-754dbd585ae4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82025) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 19:40:54.567565 dv-cinder-828806-6-smb devstack@keystone.service[82025]: [pid: 82025|app: 0|req: 52/107] 10.222.0.33 () {58 vars in 1024 bytes} [Tue Sep 13 19:40:54 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 132 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 13 19:40:54.585007 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03d4e090-829f-45d7-b9af-1b728926376e None None] Validating token access rules against request {{(pid=82026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:40:54.628177 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d78eb68-8593-48c9-b37c-754dbd585ae4 None None] Authenticating user token {{(pid=82025) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:40:54.643742 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1909edce-d9c0-4134-bb76-a4d660be121e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57539b6a6f3b4d589f5f5e1d211cd6a0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:40:54.644628 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1909edce-d9c0-4134-bb76-a4d660be121e None admin] REQUEST_METHOD: `GET` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:40:54.645061 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1909edce-d9c0-4134-bb76-a4d660be121e None admin] SCRIPT_NAME: `/identity` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:40:54.645481 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1909edce-d9c0-4134-bb76-a4d660be121e None admin] PATH_INFO: `/v3/users/91e2f1223d1143e7a8988b14dd8d3b1e` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:40:54.659057 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG dbcounter [-] [82025] Writing DB stats keystone:SELECT=100 {{(pid=82025) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:40:54.667598 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1909edce-d9c0-4134-bb76-a4d660be121e None admin] RBAC: Authorizing `identity:get_user(user_id=91e2f1223d1143e7a8988b14dd8d3b1e)` {{(pid=82026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:40:54.669115 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1909edce-d9c0-4134-bb76-a4d660be121e None admin] RBAC: Authorization granted {{(pid=82026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:40:54.682645 dv-cinder-828806-6-smb devstack@keystone.service[82026]: [pid: 82026|app: 0|req: 56/108] 10.222.0.33 () {56 vars in 1177 bytes} [Tue Sep 13 19:40:54 2022] GET /identity/v3/users/91e2f1223d1143e7a8988b14dd8d3b1e => generated 289 bytes in 319 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 19:40:54.683531 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1909edce-d9c0-4134-bb76-a4d660be121e None admin] Authenticating user token {{(pid=82026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:40:54.770254 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d78eb68-8593-48c9-b37c-754dbd585ae4 None None] Validating token access rules against request {{(pid=82025) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:40:54.809279 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ccca830-9c34-4b7f-b56e-24575aec16a3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57539b6a6f3b4d589f5f5e1d211cd6a0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82025) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:40:54.810501 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ccca830-9c34-4b7f-b56e-24575aec16a3 None admin] REQUEST_METHOD: `GET` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:40:54.810806 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ccca830-9c34-4b7f-b56e-24575aec16a3 None admin] SCRIPT_NAME: `/identity` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:40:54.811129 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ccca830-9c34-4b7f-b56e-24575aec16a3 None admin] PATH_INFO: `/v3/domains/default` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:40:54.812273 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ccca830-9c34-4b7f-b56e-24575aec16a3 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=82025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:40:54.813756 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ccca830-9c34-4b7f-b56e-24575aec16a3 None admin] RBAC: Authorization granted {{(pid=82025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:40:54.815806 dv-cinder-828806-6-smb devstack@keystone.service[82025]: [pid: 82025|app: 0|req: 53/109] 10.222.0.33 () {56 vars in 1108 bytes} [Tue Sep 13 19:40:54 2022] GET /identity/v3/domains/default => generated 199 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 19:40:54.816595 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ccca830-9c34-4b7f-b56e-24575aec16a3 None admin] Authenticating user token {{(pid=82025) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:40:54.915449 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG dbcounter [-] [82025] Writing DB stats keystone:SELECT=100 {{(pid=82025) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:40:54.922114 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1909edce-d9c0-4134-bb76-a4d660be121e None admin] Validating token access rules against request {{(pid=82026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:40:54.930746 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ccca830-9c34-4b7f-b56e-24575aec16a3 None admin] Validating token access rules against request {{(pid=82025) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:40:54.934906 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG dbcounter [-] [82026] Writing DB stats keystone:SELECT=100 {{(pid=82026) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:40:54.963711 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea0f0a5b-ef2c-436b-83ec-180b755997b3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57539b6a6f3b4d589f5f5e1d211cd6a0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:40:54.964623 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea0f0a5b-ef2c-436b-83ec-180b755997b3 None admin] REQUEST_METHOD: `GET` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:40:54.964921 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea0f0a5b-ef2c-436b-83ec-180b755997b3 None admin] SCRIPT_NAME: `/identity` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:40:54.965312 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea0f0a5b-ef2c-436b-83ec-180b755997b3 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:40:54.968599 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-decba944-31d7-42b4-885d-6867147ff5e2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57539b6a6f3b4d589f5f5e1d211cd6a0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82025) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:40:54.969342 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-decba944-31d7-42b4-885d-6867147ff5e2 None admin] REQUEST_METHOD: `GET` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:40:54.969697 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-decba944-31d7-42b4-885d-6867147ff5e2 None admin] SCRIPT_NAME: `/identity` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:40:54.970046 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-decba944-31d7-42b4-885d-6867147ff5e2 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:40:54.982481 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-decba944-31d7-42b4-885d-6867147ff5e2 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=82025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 13 19:40:54.987749 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application [None req-decba944-31d7-42b4-885d-6867147ff5e2 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 13 19:40:54.987749 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 19:40:54.987749 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 19:40:54.987749 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 19:40:54.987749 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 19:40:54.987749 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 19:40:54.987749 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 19:40:54.987749 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 19:40:54.987749 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 19:40:54.987749 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 19:40:54.987749 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 19:40:54.987749 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 19:40:54.987749 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 13 19:40:54.987749 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 13 19:40:54.987749 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 13 19:40:54.987749 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 13 19:40:54.988580 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 13 19:40:54.988580 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 13 19:40:54.988580 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 13 19:40:54.988580 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 13 19:40:54.988580 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 19:40:54.988580 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 19:40:54.988580 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 19:40:54.988580 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 19:40:54.988580 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 19:40:54.988580 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 19:40:54.988580 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 19:40:54.988580 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application with Lock( Sep 13 19:40:54.988580 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 19:40:54.988580 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application return self._enter() Sep 13 19:40:54.988580 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 19:40:54.988580 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 19:40:54.989579 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 19:40:54.989579 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application return self.creator() Sep 13 19:40:54.989579 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 19:40:54.989579 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application created_value = creator( Sep 13 19:40:54.989579 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 13 19:40:54.989579 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 13 19:40:54.989579 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 13 19:40:54.989579 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 13 19:40:54.989579 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 13 19:40:54.989579 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 13 19:40:54.989579 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 13 19:40:54.989579 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application Sep 13 19:40:54.989579 dv-cinder-828806-6-smb devstack@keystone.service[82025]: [pid: 82025|app: 0|req: 54/110] 10.222.0.33 () {56 vars in 1096 bytes} [Tue Sep 13 19:40:54 2022] GET /identity/v3/roles/admin => generated 83 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 19:40:54.990202 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-decba944-31d7-42b4-885d-6867147ff5e2 None admin] Authenticating user token {{(pid=82025) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:40:55.055028 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea0f0a5b-ef2c-436b-83ec-180b755997b3 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=82026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:40:55.057024 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea0f0a5b-ef2c-436b-83ec-180b755997b3 None admin] RBAC: Authorization granted {{(pid=82026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:40:55.134162 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-decba944-31d7-42b4-885d-6867147ff5e2 None admin] Validating token access rules against request {{(pid=82025) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:40:55.170791 dv-cinder-828806-6-smb devstack@keystone.service[82026]: [pid: 82026|app: 0|req: 57/111] 10.222.0.33 () {58 vars in 1282 bytes} [Tue Sep 13 19:40:54 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 487 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 13 19:40:55.171764 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea0f0a5b-ef2c-436b-83ec-180b755997b3 None admin] Authenticating user token {{(pid=82026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:40:55.186688 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG dbcounter [-] [82026] Writing DB stats keystone:SELECT=100 {{(pid=82026) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:40:55.189600 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5be141f-2c49-4647-a5ee-8c6c71268fd2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57539b6a6f3b4d589f5f5e1d211cd6a0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82025) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:40:55.190686 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5be141f-2c49-4647-a5ee-8c6c71268fd2 None admin] REQUEST_METHOD: `POST` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:40:55.190985 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5be141f-2c49-4647-a5ee-8c6c71268fd2 None admin] SCRIPT_NAME: `/identity` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:40:55.191362 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5be141f-2c49-4647-a5ee-8c6c71268fd2 None admin] PATH_INFO: `/v3/projects` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:40:55.192368 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5be141f-2c49-4647-a5ee-8c6c71268fd2 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=82025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:40:55.194438 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5be141f-2c49-4647-a5ee-8c6c71268fd2 None admin] RBAC: Authorization granted {{(pid=82025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:40:55.283891 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG dbcounter [-] [82025] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82025) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:40:55.289378 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea0f0a5b-ef2c-436b-83ec-180b755997b3 None admin] Validating token access rules against request {{(pid=82026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:40:55.289938 dv-cinder-828806-6-smb devstack@keystone.service[82025]: [pid: 82025|app: 0|req: 55/112] 10.222.0.33 () {60 vars in 1141 bytes} [Tue Sep 13 19:40:54 2022] POST /identity/v3/projects => generated 302 bytes in 300 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 13 19:40:55.290763 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5be141f-2c49-4647-a5ee-8c6c71268fd2 None admin] Authenticating user token {{(pid=82025) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:40:55.342776 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-976a2239-8183-459f-a33b-3141c8101f56 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57539b6a6f3b4d589f5f5e1d211cd6a0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:40:55.343457 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-976a2239-8183-459f-a33b-3141c8101f56 None admin] REQUEST_METHOD: `GET` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:40:55.343739 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-976a2239-8183-459f-a33b-3141c8101f56 None admin] SCRIPT_NAME: `/identity` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:40:55.344020 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-976a2239-8183-459f-a33b-3141c8101f56 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:40:55.359018 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-976a2239-8183-459f-a33b-3141c8101f56 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=82026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 13 19:40:55.364189 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application [None req-976a2239-8183-459f-a33b-3141c8101f56 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 13 19:40:55.364189 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 19:40:55.364189 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 19:40:55.364189 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 19:40:55.364189 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 19:40:55.364189 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 19:40:55.364189 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 19:40:55.364189 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 19:40:55.364189 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 19:40:55.364189 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 19:40:55.364189 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 19:40:55.364189 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 19:40:55.364189 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 13 19:40:55.364189 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 13 19:40:55.364189 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 13 19:40:55.364189 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 13 19:40:55.365274 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 13 19:40:55.365274 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 13 19:40:55.365274 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 13 19:40:55.365274 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 13 19:40:55.365274 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 19:40:55.365274 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 19:40:55.365274 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 19:40:55.365274 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 19:40:55.365274 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 19:40:55.365274 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 19:40:55.365274 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 19:40:55.365274 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application with Lock( Sep 13 19:40:55.365274 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 19:40:55.365274 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application return self._enter() Sep 13 19:40:55.365274 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 19:40:55.365274 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 19:40:55.366084 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 19:40:55.366084 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application return self.creator() Sep 13 19:40:55.366084 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 19:40:55.366084 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application created_value = creator( Sep 13 19:40:55.366084 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 13 19:40:55.366084 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 13 19:40:55.366084 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 13 19:40:55.366084 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 13 19:40:55.366084 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 13 19:40:55.366084 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 13 19:40:55.366084 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 13 19:40:55.366084 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application Sep 13 19:40:55.366084 dv-cinder-828806-6-smb devstack@keystone.service[82026]: [pid: 82026|app: 0|req: 58/113] 10.222.0.33 () {56 vars in 1114 bytes} [Tue Sep 13 19:40:55 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 19:40:55.367446 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-976a2239-8183-459f-a33b-3141c8101f56 None admin] Authenticating user token {{(pid=82026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:40:55.418154 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5be141f-2c49-4647-a5ee-8c6c71268fd2 None admin] Validating token access rules against request {{(pid=82025) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:40:55.444604 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG dbcounter [-] [82026] Writing DB stats keystone:SELECT=100 {{(pid=82026) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:40:55.458587 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72f76e93-50d9-4231-ad26-05e6804bcde2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57539b6a6f3b4d589f5f5e1d211cd6a0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82025) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:40:55.459265 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72f76e93-50d9-4231-ad26-05e6804bcde2 None admin] REQUEST_METHOD: `GET` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:40:55.459560 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72f76e93-50d9-4231-ad26-05e6804bcde2 None admin] SCRIPT_NAME: `/identity` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:40:55.459847 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72f76e93-50d9-4231-ad26-05e6804bcde2 None admin] PATH_INFO: `/v3/roles` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:40:55.460547 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72f76e93-50d9-4231-ad26-05e6804bcde2 None admin] RBAC: Adding query filter params (name=admin) {{(pid=82025) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 19:40:55.460860 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72f76e93-50d9-4231-ad26-05e6804bcde2 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:40:55.462607 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72f76e93-50d9-4231-ad26-05e6804bcde2 None admin] RBAC: Authorization granted {{(pid=82025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:40:55.472348 dv-cinder-828806-6-smb devstack@keystone.service[82025]: [pid: 82025|app: 0|req: 56/114] 10.222.0.33 () {56 vars in 1099 bytes} [Tue Sep 13 19:40:55 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 19:40:55.473602 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-690cddfb-5d23-4760-aab3-e26f4909b436 None None] REQUEST_METHOD: `GET` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:40:55.473900 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-690cddfb-5d23-4760-aab3-e26f4909b436 None None] SCRIPT_NAME: `/identity` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:40:55.474382 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-690cddfb-5d23-4760-aab3-e26f4909b436 None None] PATH_INFO: `/` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:40:55.475786 dv-cinder-828806-6-smb devstack@keystone.service[82025]: [pid: 82025|app: 0|req: 57/115] 10.222.0.33 () {54 vars in 927 bytes} [Tue Sep 13 19:40:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 19:40:55.478816 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1336eb41-9992-43c0-aadf-3e4677a6db0c None None] REQUEST_METHOD: `GET` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:40:55.480037 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1336eb41-9992-43c0-aadf-3e4677a6db0c None None] SCRIPT_NAME: `/identity` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:40:55.480037 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1336eb41-9992-43c0-aadf-3e4677a6db0c None None] PATH_INFO: `/` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:40:55.480774 dv-cinder-828806-6-smb devstack@keystone.service[82025]: [pid: 82025|app: 0|req: 58/116] 10.222.0.33 () {54 vars in 927 bytes} [Tue Sep 13 19:40:55 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 19:40:55.481719 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1336eb41-9992-43c0-aadf-3e4677a6db0c None None] Authenticating user token {{(pid=82025) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:40:55.483022 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-976a2239-8183-459f-a33b-3141c8101f56 None admin] Validating token access rules against request {{(pid=82026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:40:55.521500 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e99e168-c9d2-4dff-bbdb-446d96c4d0e0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57539b6a6f3b4d589f5f5e1d211cd6a0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:40:55.522145 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e99e168-c9d2-4dff-bbdb-446d96c4d0e0 None admin] REQUEST_METHOD: `GET` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:40:55.522436 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e99e168-c9d2-4dff-bbdb-446d96c4d0e0 None admin] SCRIPT_NAME: `/identity` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:40:55.522723 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e99e168-c9d2-4dff-bbdb-446d96c4d0e0 None admin] PATH_INFO: `/v3/projects/7e18b3e4745c4afeaafeb826dc0445e0` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:40:55.523913 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e99e168-c9d2-4dff-bbdb-446d96c4d0e0 None admin] RBAC: Authorizing `identity:get_project(project_id=7e18b3e4745c4afeaafeb826dc0445e0)` {{(pid=82026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:40:55.525815 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e99e168-c9d2-4dff-bbdb-446d96c4d0e0 None admin] RBAC: Authorization granted {{(pid=82026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:40:55.528827 dv-cinder-828806-6-smb devstack@keystone.service[82026]: [pid: 82026|app: 0|req: 59/117] 10.222.0.33 () {56 vars in 1186 bytes} [Tue Sep 13 19:40:55 2022] GET /identity/v3/projects/7e18b3e4745c4afeaafeb826dc0445e0 => generated 298 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 19:40:55.528827 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e99e168-c9d2-4dff-bbdb-446d96c4d0e0 None admin] Authenticating user token {{(pid=82026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:40:55.557055 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG dbcounter [-] [82025] Writing DB stats keystone:SELECT=100 {{(pid=82025) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:40:55.607835 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1336eb41-9992-43c0-aadf-3e4677a6db0c None None] Validating token access rules against request {{(pid=82025) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:40:55.636759 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e99e168-c9d2-4dff-bbdb-446d96c4d0e0 None admin] Validating token access rules against request {{(pid=82026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:40:55.644974 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-298e6aee-71fe-402d-839d-921fff5ea7af None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57539b6a6f3b4d589f5f5e1d211cd6a0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82025) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:40:55.645598 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-298e6aee-71fe-402d-839d-921fff5ea7af None admin] REQUEST_METHOD: `GET` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:40:55.645888 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-298e6aee-71fe-402d-839d-921fff5ea7af None admin] SCRIPT_NAME: `/identity` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:40:55.646174 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-298e6aee-71fe-402d-839d-921fff5ea7af None admin] PATH_INFO: `/v3/roles` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:40:55.646853 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-298e6aee-71fe-402d-839d-921fff5ea7af None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=82025) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 19:40:55.647204 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-298e6aee-71fe-402d-839d-921fff5ea7af None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:40:55.648595 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-298e6aee-71fe-402d-839d-921fff5ea7af None admin] RBAC: Authorization granted {{(pid=82025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:40:55.657938 dv-cinder-828806-6-smb devstack@keystone.service[82025]: [pid: 82025|app: 0|req: 59/118] 10.222.0.33 () {56 vars in 1111 bytes} [Tue Sep 13 19:40:55 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 19:40:55.659183 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c8be08a-f26a-4dcb-b45b-5085586722ad None None] REQUEST_METHOD: `POST` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:40:55.659485 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c8be08a-f26a-4dcb-b45b-5085586722ad None None] SCRIPT_NAME: `/identity` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:40:55.659771 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c8be08a-f26a-4dcb-b45b-5085586722ad None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:40:55.679238 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.auth.core [None req-5c8be08a-f26a-4dcb-b45b-5085586722ad None None] MFA Rules not processed for user `57539b6a6f3b4d589f5f5e1d211cd6a0`. Rule list: `[]` (Enabled: `True`). {{(pid=82025) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 19:40:55.680535 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.fernet_utils [None req-5c8be08a-f26a-4dcb-b45b-5085586722ad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82025) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 19:40:55.681599 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41ff9110-7d75-4b34-9e24-e9700bfaca08 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57539b6a6f3b4d589f5f5e1d211cd6a0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:40:55.682305 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41ff9110-7d75-4b34-9e24-e9700bfaca08 None admin] REQUEST_METHOD: `GET` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:40:55.682605 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41ff9110-7d75-4b34-9e24-e9700bfaca08 None admin] SCRIPT_NAME: `/identity` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:40:55.682884 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41ff9110-7d75-4b34-9e24-e9700bfaca08 None admin] PATH_INFO: `/v3/users/57539b6a6f3b4d589f5f5e1d211cd6a0` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:40:55.684850 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41ff9110-7d75-4b34-9e24-e9700bfaca08 None admin] RBAC: Authorizing `identity:get_user(user_id=57539b6a6f3b4d589f5f5e1d211cd6a0)` {{(pid=82026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:40:55.687001 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41ff9110-7d75-4b34-9e24-e9700bfaca08 None admin] RBAC: Authorization granted {{(pid=82026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:40:55.693163 dv-cinder-828806-6-smb devstack@keystone.service[82026]: [pid: 82026|app: 0|req: 60/119] 10.222.0.33 () {56 vars in 1177 bytes} [Tue Sep 13 19:40:55 2022] GET /identity/v3/users/57539b6a6f3b4d589f5f5e1d211cd6a0 => generated 247 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 19:40:55.693163 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fab03776-0ef5-411a-b266-194a03efb2f6 None None] REQUEST_METHOD: `POST` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:40:55.693163 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fab03776-0ef5-411a-b266-194a03efb2f6 None None] SCRIPT_NAME: `/identity` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:40:55.693163 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fab03776-0ef5-411a-b266-194a03efb2f6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:40:55.704239 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG dbcounter [-] [82026] Writing DB stats keystone:SELECT=100 {{(pid=82026) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:40:55.710108 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.auth.core [None req-fab03776-0ef5-411a-b266-194a03efb2f6 None None] MFA Rules not processed for user `57539b6a6f3b4d589f5f5e1d211cd6a0`. Rule list: `[]` (Enabled: `True`). {{(pid=82026) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 19:40:55.711358 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.common.fernet_utils [None req-fab03776-0ef5-411a-b266-194a03efb2f6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82026) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 19:40:55.761282 dv-cinder-828806-6-smb devstack@keystone.service[82025]: [pid: 82025|app: 0|req: 60/120] 10.222.0.33 () {58 vars in 1024 bytes} [Tue Sep 13 19:40:55 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 13 19:40:55.772238 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c8be08a-f26a-4dcb-b45b-5085586722ad None None] Authenticating user token {{(pid=82025) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:40:55.791603 dv-cinder-828806-6-smb devstack@keystone.service[82026]: [pid: 82026|app: 0|req: 61/121] 10.222.0.33 () {58 vars in 1024 bytes} [Tue Sep 13 19:40:55 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 13 19:40:55.792579 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fab03776-0ef5-411a-b266-194a03efb2f6 None None] Authenticating user token {{(pid=82026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:40:55.842394 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG dbcounter [-] [82025] Writing DB stats keystone:SELECT=100 {{(pid=82025) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:40:55.939990 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c8be08a-f26a-4dcb-b45b-5085586722ad None None] Validating token access rules against request {{(pid=82025) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:40:56.006057 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fab03776-0ef5-411a-b266-194a03efb2f6 None None] Validating token access rules against request {{(pid=82026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:40:56.009336 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b9fe728-9068-483f-a6af-866eb87eb1ab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57539b6a6f3b4d589f5f5e1d211cd6a0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82025) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:40:56.009961 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b9fe728-9068-483f-a6af-866eb87eb1ab None admin] REQUEST_METHOD: `GET` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:40:56.010249 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b9fe728-9068-483f-a6af-866eb87eb1ab None admin] SCRIPT_NAME: `/identity` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:40:56.010533 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b9fe728-9068-483f-a6af-866eb87eb1ab None admin] PATH_INFO: `/v3/role_assignments` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:40:56.011297 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b9fe728-9068-483f-a6af-866eb87eb1ab None admin] RBAC: Adding query filter params (role.id=81338d9374bb480785c7d7aa54829af8, scope.project.id=7e18b3e4745c4afeaafeb826dc0445e0, user.id=91e2f1223d1143e7a8988b14dd8d3b1e) {{(pid=82025) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 19:40:56.011618 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b9fe728-9068-483f-a6af-866eb87eb1ab None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=82025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:40:56.013070 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b9fe728-9068-483f-a6af-866eb87eb1ab None admin] RBAC: Authorization granted {{(pid=82025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:40:56.028420 dv-cinder-828806-6-smb devstack@keystone.service[82025]: [pid: 82025|app: 0|req: 61/122] 10.222.0.33 () {56 vars in 1374 bytes} [Tue Sep 13 19:40:55 2022] GET /identity/v3/role_assignments?user.id=91e2f1223d1143e7a8988b14dd8d3b1e&scope.project.id=7e18b3e4745c4afeaafeb826dc0445e0&role.id=81338d9374bb480785c7d7aa54829af8 => generated 259 bytes in 267 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 19:40:56.030055 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b9fe728-9068-483f-a6af-866eb87eb1ab None admin] Authenticating user token {{(pid=82025) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:40:56.084198 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fb263a7-5f75-4455-808c-d7c807680245 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57539b6a6f3b4d589f5f5e1d211cd6a0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:40:56.084860 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fb263a7-5f75-4455-808c-d7c807680245 None admin] REQUEST_METHOD: `GET` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:40:56.085949 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fb263a7-5f75-4455-808c-d7c807680245 None admin] SCRIPT_NAME: `/identity` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:40:56.086464 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fb263a7-5f75-4455-808c-d7c807680245 None admin] PATH_INFO: `/v3/users/6485aa9aa85e4a2aa1b120072f8422e4` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:40:56.090026 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fb263a7-5f75-4455-808c-d7c807680245 None admin] RBAC: Authorizing `identity:get_user(user_id=6485aa9aa85e4a2aa1b120072f8422e4)` {{(pid=82026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:40:56.092300 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fb263a7-5f75-4455-808c-d7c807680245 None admin] RBAC: Authorization granted {{(pid=82026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:40:56.097847 dv-cinder-828806-6-smb devstack@keystone.service[82026]: [pid: 82026|app: 0|req: 62/123] 10.222.0.33 () {56 vars in 1177 bytes} [Tue Sep 13 19:40:55 2022] GET /identity/v3/users/6485aa9aa85e4a2aa1b120072f8422e4 => generated 275 bytes in 306 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 19:40:56.098564 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fb263a7-5f75-4455-808c-d7c807680245 None admin] Authenticating user token {{(pid=82026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:40:56.108557 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG dbcounter [-] [82026] Writing DB stats keystone:SELECT=100 {{(pid=82026) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:40:56.207750 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b9fe728-9068-483f-a6af-866eb87eb1ab None admin] Validating token access rules against request {{(pid=82025) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:40:56.228375 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG dbcounter [-] [82025] Writing DB stats keystone:SELECT=100 {{(pid=82025) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:40:56.250374 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4be3ff11-6396-4101-a7ae-8c0d119fbcf4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57539b6a6f3b4d589f5f5e1d211cd6a0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82025) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:40:56.251069 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4be3ff11-6396-4101-a7ae-8c0d119fbcf4 None admin] REQUEST_METHOD: `GET` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:40:56.251332 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4be3ff11-6396-4101-a7ae-8c0d119fbcf4 None admin] SCRIPT_NAME: `/identity` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:40:56.251615 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4be3ff11-6396-4101-a7ae-8c0d119fbcf4 None admin] PATH_INFO: `/v3/projects/7e18b3e4745c4afeaafeb826dc0445e0` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:40:56.260020 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4be3ff11-6396-4101-a7ae-8c0d119fbcf4 None admin] RBAC: Authorizing `identity:get_project(project_id=7e18b3e4745c4afeaafeb826dc0445e0)` {{(pid=82025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:40:56.261640 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4be3ff11-6396-4101-a7ae-8c0d119fbcf4 None admin] RBAC: Authorization granted {{(pid=82025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:40:56.264458 dv-cinder-828806-6-smb devstack@keystone.service[82025]: [pid: 82025|app: 0|req: 62/124] 10.222.0.33 () {56 vars in 1186 bytes} [Tue Sep 13 19:40:56 2022] GET /identity/v3/projects/7e18b3e4745c4afeaafeb826dc0445e0 => generated 298 bytes in 235 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 19:40:56.265339 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4be3ff11-6396-4101-a7ae-8c0d119fbcf4 None admin] Authenticating user token {{(pid=82025) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:40:56.265692 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fb263a7-5f75-4455-808c-d7c807680245 None admin] Validating token access rules against request {{(pid=82026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:40:56.317950 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e932c216-82ae-46b3-b0a0-5a22ef886128 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57539b6a6f3b4d589f5f5e1d211cd6a0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:40:56.319302 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e932c216-82ae-46b3-b0a0-5a22ef886128 None admin] REQUEST_METHOD: `GET` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:40:56.319741 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e932c216-82ae-46b3-b0a0-5a22ef886128 None admin] SCRIPT_NAME: `/identity` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:40:56.320196 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e932c216-82ae-46b3-b0a0-5a22ef886128 None admin] PATH_INFO: `/v3/roles/member` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:40:56.334601 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e932c216-82ae-46b3-b0a0-5a22ef886128 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=82026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 13 19:40:56.343546 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application [None req-e932c216-82ae-46b3-b0a0-5a22ef886128 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 13 19:40:56.343546 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 19:40:56.343546 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 19:40:56.343546 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 19:40:56.343546 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 19:40:56.343546 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 19:40:56.343546 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 19:40:56.343546 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 19:40:56.343546 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 19:40:56.343546 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 19:40:56.343546 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 19:40:56.343546 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 19:40:56.343546 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 13 19:40:56.343546 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 13 19:40:56.343546 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 13 19:40:56.343546 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 13 19:40:56.344604 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 13 19:40:56.344604 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 13 19:40:56.344604 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 13 19:40:56.344604 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 13 19:40:56.344604 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 19:40:56.344604 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 19:40:56.344604 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 19:40:56.344604 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 19:40:56.344604 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 19:40:56.344604 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 19:40:56.344604 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 19:40:56.344604 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application with Lock( Sep 13 19:40:56.344604 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 19:40:56.344604 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application return self._enter() Sep 13 19:40:56.344604 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 19:40:56.344604 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 19:40:56.345555 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 19:40:56.345555 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application return self.creator() Sep 13 19:40:56.345555 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 19:40:56.345555 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application created_value = creator( Sep 13 19:40:56.345555 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 13 19:40:56.345555 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 13 19:40:56.345555 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 13 19:40:56.345555 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 13 19:40:56.345555 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 13 19:40:56.345555 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 13 19:40:56.345555 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 13 19:40:56.345555 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application Sep 13 19:40:56.352762 dv-cinder-828806-6-smb devstack@keystone.service[82026]: [pid: 82026|app: 0|req: 63/125] 10.222.0.33 () {56 vars in 1099 bytes} [Tue Sep 13 19:40:56 2022] GET /identity/v3/roles/member => generated 84 bytes in 253 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 19:40:56.352762 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e932c216-82ae-46b3-b0a0-5a22ef886128 None admin] Authenticating user token {{(pid=82026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:40:56.412223 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4be3ff11-6396-4101-a7ae-8c0d119fbcf4 None admin] Validating token access rules against request {{(pid=82025) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:40:56.434956 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG dbcounter [-] [82026] Writing DB stats keystone:SELECT=100 {{(pid=82026) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:40:56.453896 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25c8ed81-2d69-4b38-ba1c-850211bb1aa4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57539b6a6f3b4d589f5f5e1d211cd6a0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82025) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:40:56.454402 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25c8ed81-2d69-4b38-ba1c-850211bb1aa4 None admin] REQUEST_METHOD: `GET` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:40:56.454611 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25c8ed81-2d69-4b38-ba1c-850211bb1aa4 None admin] SCRIPT_NAME: `/identity` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:40:56.458196 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25c8ed81-2d69-4b38-ba1c-850211bb1aa4 None admin] PATH_INFO: `/v3/projects/7e18b3e4745c4afeaafeb826dc0445e0` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:40:56.458196 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25c8ed81-2d69-4b38-ba1c-850211bb1aa4 None admin] RBAC: Authorizing `identity:get_project(project_id=7e18b3e4745c4afeaafeb826dc0445e0)` {{(pid=82025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:40:56.458196 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25c8ed81-2d69-4b38-ba1c-850211bb1aa4 None admin] RBAC: Authorization granted {{(pid=82025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:40:56.464171 dv-cinder-828806-6-smb devstack@keystone.service[82025]: [pid: 82025|app: 0|req: 63/126] 10.222.0.33 () {56 vars in 1186 bytes} [Tue Sep 13 19:40:56 2022] GET /identity/v3/projects/7e18b3e4745c4afeaafeb826dc0445e0 => generated 298 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 19:40:56.464171 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25c8ed81-2d69-4b38-ba1c-850211bb1aa4 None admin] Authenticating user token {{(pid=82025) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:40:56.489051 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e932c216-82ae-46b3-b0a0-5a22ef886128 None admin] Validating token access rules against request {{(pid=82026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:40:56.530297 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f18ae08-7749-4d2b-9c9b-947b771e2157 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57539b6a6f3b4d589f5f5e1d211cd6a0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:40:56.531139 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f18ae08-7749-4d2b-9c9b-947b771e2157 None admin] REQUEST_METHOD: `GET` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:40:56.531435 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f18ae08-7749-4d2b-9c9b-947b771e2157 None admin] SCRIPT_NAME: `/identity` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:40:56.531717 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f18ae08-7749-4d2b-9c9b-947b771e2157 None admin] PATH_INFO: `/v3/roles/member` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:40:56.545078 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG dbcounter [-] [82025] Writing DB stats keystone:SELECT=100 {{(pid=82025) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:40:56.549988 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f18ae08-7749-4d2b-9c9b-947b771e2157 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=82026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 13 19:40:56.557078 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application [None req-7f18ae08-7749-4d2b-9c9b-947b771e2157 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 13 19:40:56.557078 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 19:40:56.557078 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 19:40:56.557078 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 19:40:56.557078 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 19:40:56.557078 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 19:40:56.557078 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 19:40:56.557078 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 19:40:56.557078 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 19:40:56.557078 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 19:40:56.557078 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 19:40:56.557078 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 19:40:56.557078 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 13 19:40:56.557078 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 13 19:40:56.557078 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 13 19:40:56.557078 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 13 19:40:56.564820 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 13 19:40:56.564820 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 13 19:40:56.564820 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 13 19:40:56.564820 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 13 19:40:56.564820 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 19:40:56.564820 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 19:40:56.564820 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 19:40:56.564820 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 19:40:56.564820 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 19:40:56.564820 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 19:40:56.564820 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 19:40:56.564820 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application with Lock( Sep 13 19:40:56.564820 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 19:40:56.564820 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application return self._enter() Sep 13 19:40:56.564820 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 19:40:56.564820 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 19:40:56.565725 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 19:40:56.565725 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application return self.creator() Sep 13 19:40:56.565725 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 19:40:56.565725 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application created_value = creator( Sep 13 19:40:56.565725 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 13 19:40:56.565725 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 13 19:40:56.565725 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 13 19:40:56.565725 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 13 19:40:56.565725 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 13 19:40:56.565725 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 13 19:40:56.565725 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 13 19:40:56.565725 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application Sep 13 19:40:56.565725 dv-cinder-828806-6-smb devstack@keystone.service[82026]: [pid: 82026|app: 0|req: 64/127] 10.222.0.33 () {56 vars in 1099 bytes} [Tue Sep 13 19:40:56 2022] GET /identity/v3/roles/member => generated 84 bytes in 207 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 19:40:56.565725 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f18ae08-7749-4d2b-9c9b-947b771e2157 None admin] Authenticating user token {{(pid=82026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:40:56.614957 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25c8ed81-2d69-4b38-ba1c-850211bb1aa4 None admin] Validating token access rules against request {{(pid=82025) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:40:56.666591 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf7f1988-c4d7-4faa-81a3-13113581a1e5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57539b6a6f3b4d589f5f5e1d211cd6a0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82025) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:40:56.667665 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf7f1988-c4d7-4faa-81a3-13113581a1e5 None admin] REQUEST_METHOD: `PUT` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:40:56.668520 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf7f1988-c4d7-4faa-81a3-13113581a1e5 None admin] SCRIPT_NAME: `/identity` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:40:56.668957 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf7f1988-c4d7-4faa-81a3-13113581a1e5 None admin] PATH_INFO: `/v3/projects/7e18b3e4745c4afeaafeb826dc0445e0/users/57539b6a6f3b4d589f5f5e1d211cd6a0/roles/e5af7d5baa93469e9e486ef21c85474e` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:40:56.672759 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf7f1988-c4d7-4faa-81a3-13113581a1e5 None admin] RBAC: Authorizing `identity:create_grant(project_id=7e18b3e4745c4afeaafeb826dc0445e0, user_id=57539b6a6f3b4d589f5f5e1d211cd6a0, role_id=e5af7d5baa93469e9e486ef21c85474e)` {{(pid=82025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:40:56.674988 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf7f1988-c4d7-4faa-81a3-13113581a1e5 None admin] RBAC: Authorization granted {{(pid=82025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:40:56.692138 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f18ae08-7749-4d2b-9c9b-947b771e2157 None admin] Validating token access rules against request {{(pid=82026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:40:56.716533 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG dbcounter [-] [82026] Writing DB stats keystone:SELECT=100 {{(pid=82026) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:40:56.727305 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-052de840-78b0-43f8-aca2-c0f6b0982117 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57539b6a6f3b4d589f5f5e1d211cd6a0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:40:56.727922 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-052de840-78b0-43f8-aca2-c0f6b0982117 None admin] REQUEST_METHOD: `GET` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:40:56.728213 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-052de840-78b0-43f8-aca2-c0f6b0982117 None admin] SCRIPT_NAME: `/identity` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:40:56.728492 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-052de840-78b0-43f8-aca2-c0f6b0982117 None admin] PATH_INFO: `/v3/roles` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:40:56.729168 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-052de840-78b0-43f8-aca2-c0f6b0982117 None admin] RBAC: Adding query filter params (name=member) {{(pid=82026) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 19:40:56.729537 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-052de840-78b0-43f8-aca2-c0f6b0982117 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:40:56.730943 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-052de840-78b0-43f8-aca2-c0f6b0982117 None admin] RBAC: Authorization granted {{(pid=82026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:40:56.740357 dv-cinder-828806-6-smb devstack@keystone.service[82026]: [pid: 82026|app: 0|req: 65/128] 10.222.0.33 () {56 vars in 1101 bytes} [Tue Sep 13 19:40:56 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 19:40:56.741072 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-052de840-78b0-43f8-aca2-c0f6b0982117 None admin] Authenticating user token {{(pid=82026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:40:56.744115 dv-cinder-828806-6-smb devstack@keystone.service[82025]: [pid: 82025|app: 0|req: 64/129] 10.222.0.33 () {58 vars in 1439 bytes} [Tue Sep 13 19:40:56 2022] PUT /identity/v3/projects/7e18b3e4745c4afeaafeb826dc0445e0/users/57539b6a6f3b4d589f5f5e1d211cd6a0/roles/e5af7d5baa93469e9e486ef21c85474e => generated 0 bytes in 284 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 19:40:56.746108 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf7f1988-c4d7-4faa-81a3-13113581a1e5 None admin] Authenticating user token {{(pid=82025) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:40:56.876538 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-052de840-78b0-43f8-aca2-c0f6b0982117 None admin] Validating token access rules against request {{(pid=82026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:40:56.909076 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf7f1988-c4d7-4faa-81a3-13113581a1e5 None admin] Validating token access rules against request {{(pid=82025) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:40:56.921161 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00ac760f-1383-4228-a262-3849f181d19c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57539b6a6f3b4d589f5f5e1d211cd6a0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:40:56.922674 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00ac760f-1383-4228-a262-3849f181d19c None admin] REQUEST_METHOD: `PUT` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:40:56.923215 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00ac760f-1383-4228-a262-3849f181d19c None admin] SCRIPT_NAME: `/identity` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:40:56.923703 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00ac760f-1383-4228-a262-3849f181d19c None admin] PATH_INFO: `/v3/projects/7e18b3e4745c4afeaafeb826dc0445e0/users/6485aa9aa85e4a2aa1b120072f8422e4/roles/6bcd095c76b341e186ea8caa11f5fa31` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:40:56.926274 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00ac760f-1383-4228-a262-3849f181d19c None admin] RBAC: Authorizing `identity:create_grant(project_id=7e18b3e4745c4afeaafeb826dc0445e0, user_id=6485aa9aa85e4a2aa1b120072f8422e4, role_id=6bcd095c76b341e186ea8caa11f5fa31)` {{(pid=82026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:40:56.928115 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00ac760f-1383-4228-a262-3849f181d19c None admin] RBAC: Authorization granted {{(pid=82026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:40:56.940597 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG dbcounter [-] [82025] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82025) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:40:56.975318 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56d381c4-b9a1-4244-baa1-bbe5dc55aa4b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57539b6a6f3b4d589f5f5e1d211cd6a0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82025) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:40:56.975956 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56d381c4-b9a1-4244-baa1-bbe5dc55aa4b None admin] REQUEST_METHOD: `GET` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:40:56.976249 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56d381c4-b9a1-4244-baa1-bbe5dc55aa4b None admin] SCRIPT_NAME: `/identity` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:40:56.977621 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56d381c4-b9a1-4244-baa1-bbe5dc55aa4b None admin] PATH_INFO: `/v3/roles` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:40:56.977621 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56d381c4-b9a1-4244-baa1-bbe5dc55aa4b None admin] RBAC: Adding query filter params (name=member) {{(pid=82025) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 19:40:56.977621 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56d381c4-b9a1-4244-baa1-bbe5dc55aa4b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:40:56.979159 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56d381c4-b9a1-4244-baa1-bbe5dc55aa4b None admin] RBAC: Authorization granted {{(pid=82025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:40:56.990361 dv-cinder-828806-6-smb devstack@keystone.service[82025]: [pid: 82025|app: 0|req: 65/130] 10.222.0.33 () {56 vars in 1101 bytes} [Tue Sep 13 19:40:56 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 244 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 19:40:56.991514 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56d381c4-b9a1-4244-baa1-bbe5dc55aa4b None admin] Authenticating user token {{(pid=82025) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:40:57.051354 dv-cinder-828806-6-smb devstack@keystone.service[82026]: [pid: 82026|app: 0|req: 66/131] 10.222.0.33 () {58 vars in 1439 bytes} [Tue Sep 13 19:40:56 2022] PUT /identity/v3/projects/7e18b3e4745c4afeaafeb826dc0445e0/users/6485aa9aa85e4a2aa1b120072f8422e4/roles/6bcd095c76b341e186ea8caa11f5fa31 => generated 0 bytes in 303 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 19:40:57.054618 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00ac760f-1383-4228-a262-3849f181d19c None admin] Authenticating user token {{(pid=82026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:40:57.163024 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG dbcounter [-] [82026] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82026) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:40:57.172893 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56d381c4-b9a1-4244-baa1-bbe5dc55aa4b None admin] Validating token access rules against request {{(pid=82025) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:40:57.232967 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22af4fc1-61ca-4b5e-899f-118494333f76 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57539b6a6f3b4d589f5f5e1d211cd6a0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82025) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:40:57.233829 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22af4fc1-61ca-4b5e-899f-118494333f76 None admin] REQUEST_METHOD: `GET` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:40:57.234124 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22af4fc1-61ca-4b5e-899f-118494333f76 None admin] SCRIPT_NAME: `/identity` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:40:57.234409 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22af4fc1-61ca-4b5e-899f-118494333f76 None admin] PATH_INFO: `/v3/users/6485aa9aa85e4a2aa1b120072f8422e4` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:40:57.237444 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22af4fc1-61ca-4b5e-899f-118494333f76 None admin] RBAC: Authorizing `identity:get_user(user_id=6485aa9aa85e4a2aa1b120072f8422e4)` {{(pid=82025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:40:57.239065 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22af4fc1-61ca-4b5e-899f-118494333f76 None admin] RBAC: Authorization granted {{(pid=82025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:40:57.240707 dv-cinder-828806-6-smb devstack@keystone.service[82025]: [pid: 82025|app: 0|req: 66/132] 10.222.0.33 () {56 vars in 1177 bytes} [Tue Sep 13 19:40:56 2022] GET /identity/v3/users/6485aa9aa85e4a2aa1b120072f8422e4 => generated 275 bytes in 250 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 19:40:57.248744 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22af4fc1-61ca-4b5e-899f-118494333f76 None admin] Authenticating user token {{(pid=82025) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:40:57.282415 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00ac760f-1383-4228-a262-3849f181d19c None admin] Validating token access rules against request {{(pid=82026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:40:57.330759 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG dbcounter [-] [82025] Writing DB stats keystone:SELECT=100 {{(pid=82025) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:40:57.361665 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3177cfd7-03da-4343-85e5-8fea34fdda7d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57539b6a6f3b4d589f5f5e1d211cd6a0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:40:57.362356 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3177cfd7-03da-4343-85e5-8fea34fdda7d None admin] REQUEST_METHOD: `GET` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:40:57.362661 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3177cfd7-03da-4343-85e5-8fea34fdda7d None admin] SCRIPT_NAME: `/identity` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:40:57.362950 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3177cfd7-03da-4343-85e5-8fea34fdda7d None admin] PATH_INFO: `/v3/users/6485aa9aa85e4a2aa1b120072f8422e4` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:40:57.364211 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3177cfd7-03da-4343-85e5-8fea34fdda7d None admin] RBAC: Authorizing `identity:get_user(user_id=6485aa9aa85e4a2aa1b120072f8422e4)` {{(pid=82026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:40:57.365704 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3177cfd7-03da-4343-85e5-8fea34fdda7d None admin] RBAC: Authorization granted {{(pid=82026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:40:57.367560 dv-cinder-828806-6-smb devstack@keystone.service[82026]: [pid: 82026|app: 0|req: 67/133] 10.222.0.33 () {56 vars in 1177 bytes} [Tue Sep 13 19:40:57 2022] GET /identity/v3/users/6485aa9aa85e4a2aa1b120072f8422e4 => generated 275 bytes in 315 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 19:40:57.374867 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3177cfd7-03da-4343-85e5-8fea34fdda7d None admin] Authenticating user token {{(pid=82026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:40:57.402125 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22af4fc1-61ca-4b5e-899f-118494333f76 None admin] Validating token access rules against request {{(pid=82025) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:40:57.444546 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cafbcd56-3814-4616-9874-3bcf6124b6c7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57539b6a6f3b4d589f5f5e1d211cd6a0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82025) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:40:57.445214 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cafbcd56-3814-4616-9874-3bcf6124b6c7 None admin] REQUEST_METHOD: `GET` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:40:57.445507 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cafbcd56-3814-4616-9874-3bcf6124b6c7 None admin] SCRIPT_NAME: `/identity` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:40:57.445796 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cafbcd56-3814-4616-9874-3bcf6124b6c7 None admin] PATH_INFO: `/v3/projects/4e1069c665d147a9b09c598d9a1ac8e4` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:40:57.447003 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cafbcd56-3814-4616-9874-3bcf6124b6c7 None admin] RBAC: Authorizing `identity:get_project(project_id=4e1069c665d147a9b09c598d9a1ac8e4)` {{(pid=82025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:40:57.449168 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cafbcd56-3814-4616-9874-3bcf6124b6c7 None admin] RBAC: Authorization granted {{(pid=82025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:40:57.451563 dv-cinder-828806-6-smb devstack@keystone.service[82025]: [pid: 82025|app: 0|req: 67/134] 10.222.0.33 () {56 vars in 1186 bytes} [Tue Sep 13 19:40:57 2022] GET /identity/v3/projects/4e1069c665d147a9b09c598d9a1ac8e4 => generated 312 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 13 19:40:57.457224 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cafbcd56-3814-4616-9874-3bcf6124b6c7 None admin] Authenticating user token {{(pid=82025) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:40:57.517281 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3177cfd7-03da-4343-85e5-8fea34fdda7d None admin] Validating token access rules against request {{(pid=82026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:40:57.537576 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG dbcounter [-] [82026] Writing DB stats keystone:SELECT=100 {{(pid=82026) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:40:57.582267 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cafbcd56-3814-4616-9874-3bcf6124b6c7 None admin] Validating token access rules against request {{(pid=82025) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:40:57.607784 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1af6e242-0927-42ae-8150-9521838752e6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57539b6a6f3b4d589f5f5e1d211cd6a0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:40:57.608830 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1af6e242-0927-42ae-8150-9521838752e6 None admin] REQUEST_METHOD: `GET` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:40:57.609314 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1af6e242-0927-42ae-8150-9521838752e6 None admin] SCRIPT_NAME: `/identity` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:40:57.609789 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1af6e242-0927-42ae-8150-9521838752e6 None admin] PATH_INFO: `/v3/projects/7e18b3e4745c4afeaafeb826dc0445e0` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:40:57.611234 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1af6e242-0927-42ae-8150-9521838752e6 None admin] RBAC: Authorizing `identity:get_project(project_id=7e18b3e4745c4afeaafeb826dc0445e0)` {{(pid=82026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:40:57.612894 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1af6e242-0927-42ae-8150-9521838752e6 None admin] RBAC: Authorization granted {{(pid=82026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:40:57.619132 dv-cinder-828806-6-smb devstack@keystone.service[82026]: [pid: 82026|app: 0|req: 68/135] 10.222.0.33 () {56 vars in 1186 bytes} [Tue Sep 13 19:40:57 2022] GET /identity/v3/projects/7e18b3e4745c4afeaafeb826dc0445e0 => generated 298 bytes in 242 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 19:40:57.620863 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1af6e242-0927-42ae-8150-9521838752e6 None admin] Authenticating user token {{(pid=82026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:40:57.627433 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG dbcounter [-] [82025] Writing DB stats keystone:SELECT=100 {{(pid=82025) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:40:57.651101 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c826ce5b-64fb-4b6f-85ab-875b955beef3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57539b6a6f3b4d589f5f5e1d211cd6a0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82025) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:40:57.651842 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c826ce5b-64fb-4b6f-85ab-875b955beef3 None admin] REQUEST_METHOD: `PUT` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:40:57.652134 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c826ce5b-64fb-4b6f-85ab-875b955beef3 None admin] SCRIPT_NAME: `/identity` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:40:57.652681 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c826ce5b-64fb-4b6f-85ab-875b955beef3 None admin] PATH_INFO: `/v3/projects/4e1069c665d147a9b09c598d9a1ac8e4/users/6485aa9aa85e4a2aa1b120072f8422e4/roles/3618ab638a65401f82333da7596d1daf` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:40:57.656468 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c826ce5b-64fb-4b6f-85ab-875b955beef3 None admin] RBAC: Authorizing `identity:create_grant(project_id=4e1069c665d147a9b09c598d9a1ac8e4, user_id=6485aa9aa85e4a2aa1b120072f8422e4, role_id=3618ab638a65401f82333da7596d1daf)` {{(pid=82025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:40:57.658134 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c826ce5b-64fb-4b6f-85ab-875b955beef3 None admin] RBAC: Authorization granted {{(pid=82025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:40:57.738218 dv-cinder-828806-6-smb devstack@keystone.service[82025]: [pid: 82025|app: 0|req: 68/136] 10.222.0.33 () {58 vars in 1439 bytes} [Tue Sep 13 19:40:57 2022] PUT /identity/v3/projects/4e1069c665d147a9b09c598d9a1ac8e4/users/6485aa9aa85e4a2aa1b120072f8422e4/roles/3618ab638a65401f82333da7596d1daf => generated 0 bytes in 281 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 19:40:57.739449 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00835a5f-dcbb-4426-b8f8-b3a45559bb7a None None] REQUEST_METHOD: `GET` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:40:57.739742 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00835a5f-dcbb-4426-b8f8-b3a45559bb7a None None] SCRIPT_NAME: `/identity` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:40:57.740028 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00835a5f-dcbb-4426-b8f8-b3a45559bb7a None None] PATH_INFO: `/` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:40:57.741278 dv-cinder-828806-6-smb devstack@keystone.service[82025]: [pid: 82025|app: 0|req: 69/137] 10.222.0.33 () {54 vars in 927 bytes} [Tue Sep 13 19:40:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 19:40:57.748230 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc0d6e43-acc9-443f-9c3b-309f19462776 None None] REQUEST_METHOD: `POST` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:40:57.748456 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc0d6e43-acc9-443f-9c3b-309f19462776 None None] SCRIPT_NAME: `/identity` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:40:57.748798 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc0d6e43-acc9-443f-9c3b-309f19462776 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:40:57.790160 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1af6e242-0927-42ae-8150-9521838752e6 None admin] Validating token access rules against request {{(pid=82026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:40:57.804189 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.auth.core [None req-cc0d6e43-acc9-443f-9c3b-309f19462776 None None] MFA Rules not processed for user `57539b6a6f3b4d589f5f5e1d211cd6a0`. Rule list: `[]` (Enabled: `True`). {{(pid=82025) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 19:40:57.810757 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.fernet_utils [None req-cc0d6e43-acc9-443f-9c3b-309f19462776 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82025) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 19:40:57.861215 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d1aa8ee-2efd-487c-863e-8d4dc617670f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57539b6a6f3b4d589f5f5e1d211cd6a0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:40:57.862292 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d1aa8ee-2efd-487c-863e-8d4dc617670f None admin] REQUEST_METHOD: `PUT` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:40:57.862828 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d1aa8ee-2efd-487c-863e-8d4dc617670f None admin] SCRIPT_NAME: `/identity` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:40:57.863521 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d1aa8ee-2efd-487c-863e-8d4dc617670f None admin] PATH_INFO: `/v3/projects/7e18b3e4745c4afeaafeb826dc0445e0/users/6485aa9aa85e4a2aa1b120072f8422e4/roles/3618ab638a65401f82333da7596d1daf` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:40:57.865870 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d1aa8ee-2efd-487c-863e-8d4dc617670f None admin] RBAC: Authorizing `identity:create_grant(project_id=7e18b3e4745c4afeaafeb826dc0445e0, user_id=6485aa9aa85e4a2aa1b120072f8422e4, role_id=3618ab638a65401f82333da7596d1daf)` {{(pid=82026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:40:57.875064 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d1aa8ee-2efd-487c-863e-8d4dc617670f None admin] RBAC: Authorization granted {{(pid=82026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:40:57.955303 dv-cinder-828806-6-smb devstack@keystone.service[82026]: [pid: 82026|app: 0|req: 69/138] 10.222.0.33 () {58 vars in 1439 bytes} [Tue Sep 13 19:40:57 2022] PUT /identity/v3/projects/7e18b3e4745c4afeaafeb826dc0445e0/users/6485aa9aa85e4a2aa1b120072f8422e4/roles/3618ab638a65401f82333da7596d1daf => generated 0 bytes in 335 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 13 19:40:57.976397 dv-cinder-828806-6-smb devstack@keystone.service[82025]: [pid: 82025|app: 0|req: 70/139] 10.222.0.33 () {58 vars in 1024 bytes} [Tue Sep 13 19:40:57 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 230 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 13 19:40:58.343399 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d1aa8ee-2efd-487c-863e-8d4dc617670f None admin] Authenticating user token {{(pid=82026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:40:58.406943 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG dbcounter [-] [82026] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82026) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:40:58.486939 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d1aa8ee-2efd-487c-863e-8d4dc617670f None admin] Validating token access rules against request {{(pid=82026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:40:58.536316 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10fc7dc2-aff5-477b-9219-9fc7ce6bb349 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57539b6a6f3b4d589f5f5e1d211cd6a0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:40:58.536970 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10fc7dc2-aff5-477b-9219-9fc7ce6bb349 None admin] REQUEST_METHOD: `GET` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:40:58.537262 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10fc7dc2-aff5-477b-9219-9fc7ce6bb349 None admin] SCRIPT_NAME: `/identity` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:40:58.537546 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10fc7dc2-aff5-477b-9219-9fc7ce6bb349 None admin] PATH_INFO: `/v3/domains/default` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:40:58.538759 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10fc7dc2-aff5-477b-9219-9fc7ce6bb349 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=82026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:40:58.540203 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10fc7dc2-aff5-477b-9219-9fc7ce6bb349 None admin] RBAC: Authorization granted {{(pid=82026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:40:58.542083 dv-cinder-828806-6-smb devstack@keystone.service[82026]: [pid: 82026|app: 0|req: 70/140] 10.222.0.33 () {56 vars in 1108 bytes} [Tue Sep 13 19:40:58 2022] GET /identity/v3/domains/default => generated 199 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 19:40:58.547674 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc0d6e43-acc9-443f-9c3b-309f19462776 None None] Authenticating user token {{(pid=82025) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:40:58.671566 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc0d6e43-acc9-443f-9c3b-309f19462776 None None] Validating token access rules against request {{(pid=82025) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:40:58.673133 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG dbcounter [-] [82025] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82025) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:40:58.720168 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49305440-51fc-4b1a-95fd-24a761d8ef7f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57539b6a6f3b4d589f5f5e1d211cd6a0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82025) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:40:58.720810 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49305440-51fc-4b1a-95fd-24a761d8ef7f None admin] REQUEST_METHOD: `POST` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:40:58.721098 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49305440-51fc-4b1a-95fd-24a761d8ef7f None admin] SCRIPT_NAME: `/identity` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:40:58.721371 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49305440-51fc-4b1a-95fd-24a761d8ef7f None admin] PATH_INFO: `/v3/users` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:40:58.722053 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49305440-51fc-4b1a-95fd-24a761d8ef7f None admin] RBAC: Authorizing `identity:create_user()` {{(pid=82025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:40:58.723532 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49305440-51fc-4b1a-95fd-24a761d8ef7f None admin] RBAC: Authorization granted {{(pid=82025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:40:58.840620 dv-cinder-828806-6-smb devstack@keystone.service[82025]: [pid: 82025|app: 0|req: 71/141] 10.222.0.33 () {60 vars in 1132 bytes} [Tue Sep 13 19:40:58 2022] POST /identity/v3/users => generated 283 bytes in 293 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 13 19:40:59.006808 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13932283-ae1b-4ed2-b587-4c5f39bad169 None None] REQUEST_METHOD: `GET` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:40:59.007188 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13932283-ae1b-4ed2-b587-4c5f39bad169 None None] SCRIPT_NAME: `/identity` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:40:59.007410 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13932283-ae1b-4ed2-b587-4c5f39bad169 None None] PATH_INFO: `/` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:40:59.008986 dv-cinder-828806-6-smb devstack@keystone.service[82026]: [pid: 82026|app: 0|req: 71/142] 10.222.0.33 () {54 vars in 927 bytes} [Tue Sep 13 19:40:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 19:40:59.014479 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dc7067d-8c07-49fe-9c55-6d63f4263a92 None None] REQUEST_METHOD: `POST` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:40:59.014765 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dc7067d-8c07-49fe-9c55-6d63f4263a92 None None] SCRIPT_NAME: `/identity` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:40:59.015064 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dc7067d-8c07-49fe-9c55-6d63f4263a92 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:40:59.055369 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.auth.core [None req-3dc7067d-8c07-49fe-9c55-6d63f4263a92 None None] MFA Rules not processed for user `57539b6a6f3b4d589f5f5e1d211cd6a0`. Rule list: `[]` (Enabled: `True`). {{(pid=82025) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 19:40:59.056571 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.fernet_utils [None req-3dc7067d-8c07-49fe-9c55-6d63f4263a92 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82025) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 19:40:59.148445 dv-cinder-828806-6-smb devstack@keystone.service[82025]: [pid: 82025|app: 0|req: 72/143] 10.222.0.33 () {58 vars in 1024 bytes} [Tue Sep 13 19:40:59 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 135 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 13 19:40:59.639422 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13932283-ae1b-4ed2-b587-4c5f39bad169 None None] Authenticating user token {{(pid=82026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:40:59.763987 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13932283-ae1b-4ed2-b587-4c5f39bad169 None None] Validating token access rules against request {{(pid=82026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:40:59.776783 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG dbcounter [-] [82026] Writing DB stats keystone:SELECT=100 {{(pid=82026) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:40:59.818174 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbd1b934-6621-45b7-9d47-c203553abba9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57539b6a6f3b4d589f5f5e1d211cd6a0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:40:59.818902 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbd1b934-6621-45b7-9d47-c203553abba9 None admin] REQUEST_METHOD: `GET` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:40:59.819225 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbd1b934-6621-45b7-9d47-c203553abba9 None admin] SCRIPT_NAME: `/identity` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:40:59.819512 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbd1b934-6621-45b7-9d47-c203553abba9 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:40:59.833379 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbd1b934-6621-45b7-9d47-c203553abba9 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=82026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 13 19:40:59.838364 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application [None req-fbd1b934-6621-45b7-9d47-c203553abba9 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Sep 13 19:40:59.838364 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 19:40:59.838364 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 19:40:59.838364 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 19:40:59.838364 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 19:40:59.838364 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 19:40:59.838364 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 19:40:59.838364 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 19:40:59.838364 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 19:40:59.838364 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 19:40:59.838364 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 19:40:59.838364 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 19:40:59.838364 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 13 19:40:59.838364 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 13 19:40:59.838364 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 13 19:40:59.838364 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 13 19:40:59.839293 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 13 19:40:59.839293 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 13 19:40:59.839293 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 13 19:40:59.839293 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 13 19:40:59.839293 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 19:40:59.839293 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 19:40:59.839293 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 19:40:59.839293 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 19:40:59.839293 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 19:40:59.839293 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 19:40:59.839293 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 19:40:59.839293 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application with Lock( Sep 13 19:40:59.839293 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 19:40:59.839293 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application return self._enter() Sep 13 19:40:59.839293 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 19:40:59.839293 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 19:40:59.840118 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 19:40:59.840118 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application return self.creator() Sep 13 19:40:59.840118 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 19:40:59.840118 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application created_value = creator( Sep 13 19:40:59.840118 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 13 19:40:59.840118 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 13 19:40:59.840118 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 13 19:40:59.840118 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 13 19:40:59.840118 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 13 19:40:59.840118 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 13 19:40:59.840118 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Sep 13 19:40:59.840118 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application Sep 13 19:40:59.843976 dv-cinder-828806-6-smb devstack@keystone.service[82026]: [pid: 82026|app: 0|req: 72/144] 10.222.0.33 () {56 vars in 1099 bytes} [Tue Sep 13 19:40:59 2022] GET /identity/v3/roles/reader => generated 84 bytes in 205 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 19:40:59.849509 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dc7067d-8c07-49fe-9c55-6d63f4263a92 None None] Authenticating user token {{(pid=82025) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:40:59.938569 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a39aabc1-3c11-42ff-9dad-2552cf7c591c None None] REQUEST_METHOD: `GET` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:40:59.938859 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a39aabc1-3c11-42ff-9dad-2552cf7c591c None None] SCRIPT_NAME: `/identity` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:40:59.939069 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a39aabc1-3c11-42ff-9dad-2552cf7c591c None None] PATH_INFO: `/` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:40:59.940595 dv-cinder-828806-6-smb devstack@keystone.service[82026]: [pid: 82026|app: 0|req: 73/145] 10.222.0.33 () {54 vars in 927 bytes} [Tue Sep 13 19:40:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 13 19:40:59.964691 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG dbcounter [-] [82025] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=82025) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:40:59.969316 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fafabfe5-ea58-411b-a972-bf4f513cf0d8 None None] REQUEST_METHOD: `POST` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:40:59.969603 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fafabfe5-ea58-411b-a972-bf4f513cf0d8 None None] SCRIPT_NAME: `/identity` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:40:59.969879 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fafabfe5-ea58-411b-a972-bf4f513cf0d8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:40:59.995357 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.auth.core [None req-fafabfe5-ea58-411b-a972-bf4f513cf0d8 None None] MFA Rules not processed for user `57539b6a6f3b4d589f5f5e1d211cd6a0`. Rule list: `[]` (Enabled: `True`). {{(pid=82026) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 19:40:59.996685 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.common.fernet_utils [None req-fafabfe5-ea58-411b-a972-bf4f513cf0d8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82026) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 19:40:59.999515 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dc7067d-8c07-49fe-9c55-6d63f4263a92 None None] Validating token access rules against request {{(pid=82025) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:41:00.072392 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4ce8ab6-088d-4496-8019-a1d3878dbbfe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57539b6a6f3b4d589f5f5e1d211cd6a0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82025) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:41:00.073019 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4ce8ab6-088d-4496-8019-a1d3878dbbfe None admin] REQUEST_METHOD: `GET` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:41:00.073299 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4ce8ab6-088d-4496-8019-a1d3878dbbfe None admin] SCRIPT_NAME: `/identity` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:41:00.073571 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4ce8ab6-088d-4496-8019-a1d3878dbbfe None admin] PATH_INFO: `/v3/roles` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:41:00.074250 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4ce8ab6-088d-4496-8019-a1d3878dbbfe None admin] RBAC: Adding query filter params (name=reader) {{(pid=82025) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 19:41:00.074553 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4ce8ab6-088d-4496-8019-a1d3878dbbfe None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:41:00.076003 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4ce8ab6-088d-4496-8019-a1d3878dbbfe None admin] RBAC: Authorization granted {{(pid=82025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:41:00.086537 dv-cinder-828806-6-smb devstack@keystone.service[82025]: [pid: 82025|app: 0|req: 73/146] 10.222.0.33 () {56 vars in 1101 bytes} [Tue Sep 13 19:40:59 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 238 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 19:41:00.092999 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4ce8ab6-088d-4496-8019-a1d3878dbbfe None admin] Authenticating user token {{(pid=82025) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:41:00.117864 dv-cinder-828806-6-smb devstack@keystone.service[82026]: [pid: 82026|app: 0|req: 74/147] 10.222.0.33 () {58 vars in 1024 bytes} [Tue Sep 13 19:40:59 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 149 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 13 19:41:00.191435 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f0bb1be-8f85-4039-9658-e34301ff4ef7 None None] REQUEST_METHOD: `GET` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:41:00.192306 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f0bb1be-8f85-4039-9658-e34301ff4ef7 None None] SCRIPT_NAME: `/identity` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:41:00.192799 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f0bb1be-8f85-4039-9658-e34301ff4ef7 None None] PATH_INFO: `/` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:41:00.194537 dv-cinder-828806-6-smb devstack@keystone.service[82026]: [pid: 82026|app: 0|req: 75/148] 10.222.0.33 () {54 vars in 927 bytes} [Tue Sep 13 19:41:00 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 13 19:41:00.206491 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4ce8ab6-088d-4496-8019-a1d3878dbbfe None admin] Validating token access rules against request {{(pid=82025) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:41:00.208240 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88cd1ba4-60a7-4da7-aed1-d2100e9b1fb2 None None] REQUEST_METHOD: `POST` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:41:00.208811 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88cd1ba4-60a7-4da7-aed1-d2100e9b1fb2 None None] SCRIPT_NAME: `/identity` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:41:00.209285 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88cd1ba4-60a7-4da7-aed1-d2100e9b1fb2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:41:00.232901 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.auth.core [None req-88cd1ba4-60a7-4da7-aed1-d2100e9b1fb2 None None] MFA Rules not processed for user `57539b6a6f3b4d589f5f5e1d211cd6a0`. Rule list: `[]` (Enabled: `True`). {{(pid=82026) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 19:41:00.234463 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.common.fernet_utils [None req-88cd1ba4-60a7-4da7-aed1-d2100e9b1fb2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82026) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 19:41:00.255755 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9600aae9-6ebd-4ded-a944-9a56b3d8fe19 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57539b6a6f3b4d589f5f5e1d211cd6a0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82025) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:41:00.256404 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9600aae9-6ebd-4ded-a944-9a56b3d8fe19 None admin] REQUEST_METHOD: `GET` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:41:00.256690 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9600aae9-6ebd-4ded-a944-9a56b3d8fe19 None admin] SCRIPT_NAME: `/identity` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:41:00.256971 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9600aae9-6ebd-4ded-a944-9a56b3d8fe19 None admin] PATH_INFO: `/v3/users/91e2f1223d1143e7a8988b14dd8d3b1e` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:41:00.258134 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9600aae9-6ebd-4ded-a944-9a56b3d8fe19 None admin] RBAC: Authorizing `identity:get_user(user_id=91e2f1223d1143e7a8988b14dd8d3b1e)` {{(pid=82025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:41:00.259633 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9600aae9-6ebd-4ded-a944-9a56b3d8fe19 None admin] RBAC: Authorization granted {{(pid=82025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:41:00.261211 dv-cinder-828806-6-smb devstack@keystone.service[82025]: [pid: 82025|app: 0|req: 74/149] 10.222.0.33 () {56 vars in 1177 bytes} [Tue Sep 13 19:41:00 2022] GET /identity/v3/users/91e2f1223d1143e7a8988b14dd8d3b1e => generated 289 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 13 19:41:00.267552 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9600aae9-6ebd-4ded-a944-9a56b3d8fe19 None admin] Authenticating user token {{(pid=82025) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:41:00.316168 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG dbcounter [-] [82025] Writing DB stats keystone:SELECT=100 {{(pid=82025) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:41:00.320519 dv-cinder-828806-6-smb devstack@keystone.service[82026]: [pid: 82026|app: 0|req: 76/150] 10.222.0.33 () {58 vars in 1024 bytes} [Tue Sep 13 19:41:00 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 13 19:41:00.448030 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9600aae9-6ebd-4ded-a944-9a56b3d8fe19 None admin] Validating token access rules against request {{(pid=82025) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:41:00.492479 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0043a8c-f75c-4f99-b211-0a3cba4b468b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57539b6a6f3b4d589f5f5e1d211cd6a0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82025) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:41:00.493124 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0043a8c-f75c-4f99-b211-0a3cba4b468b None admin] REQUEST_METHOD: `GET` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:41:00.493415 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0043a8c-f75c-4f99-b211-0a3cba4b468b None admin] SCRIPT_NAME: `/identity` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:41:00.493698 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0043a8c-f75c-4f99-b211-0a3cba4b468b None admin] PATH_INFO: `/v3/projects/7e18b3e4745c4afeaafeb826dc0445e0` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:41:00.499771 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0043a8c-f75c-4f99-b211-0a3cba4b468b None admin] RBAC: Authorizing `identity:get_project(project_id=7e18b3e4745c4afeaafeb826dc0445e0)` {{(pid=82025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:41:00.501247 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0043a8c-f75c-4f99-b211-0a3cba4b468b None admin] RBAC: Authorization granted {{(pid=82025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:41:00.502936 dv-cinder-828806-6-smb devstack@keystone.service[82025]: [pid: 82025|app: 0|req: 75/151] 10.222.0.33 () {56 vars in 1186 bytes} [Tue Sep 13 19:41:00 2022] GET /identity/v3/projects/7e18b3e4745c4afeaafeb826dc0445e0 => generated 298 bytes in 236 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 13 19:41:00.508971 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88cd1ba4-60a7-4da7-aed1-d2100e9b1fb2 None None] Authenticating user token {{(pid=82026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:41:00.517522 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0043a8c-f75c-4f99-b211-0a3cba4b468b None admin] Authenticating user token {{(pid=82025) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:41:00.555071 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG dbcounter [-] [82026] Writing DB stats keystone:SELECT=100 {{(pid=82026) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:41:00.648150 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG dbcounter [-] [82025] Writing DB stats keystone:SELECT=100 {{(pid=82025) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:41:00.674830 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0043a8c-f75c-4f99-b211-0a3cba4b468b None admin] Validating token access rules against request {{(pid=82025) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:41:00.698988 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88cd1ba4-60a7-4da7-aed1-d2100e9b1fb2 None None] Validating token access rules against request {{(pid=82026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:41:00.755129 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e69bcb06-d2e0-43bb-8dc8-8d6391cbc059 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57539b6a6f3b4d589f5f5e1d211cd6a0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82025) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:41:00.756018 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e69bcb06-d2e0-43bb-8dc8-8d6391cbc059 None admin] REQUEST_METHOD: `GET` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:41:00.756455 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e69bcb06-d2e0-43bb-8dc8-8d6391cbc059 None admin] SCRIPT_NAME: `/identity` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:41:00.756879 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e69bcb06-d2e0-43bb-8dc8-8d6391cbc059 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:41:00.759748 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39cb9736-02df-4bbb-bc83-c9a86136b24c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57539b6a6f3b4d589f5f5e1d211cd6a0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:41:00.761297 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39cb9736-02df-4bbb-bc83-c9a86136b24c None admin] REQUEST_METHOD: `PUT` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:41:00.761865 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39cb9736-02df-4bbb-bc83-c9a86136b24c None admin] SCRIPT_NAME: `/identity` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:41:00.763355 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39cb9736-02df-4bbb-bc83-c9a86136b24c None admin] PATH_INFO: `/v3/projects/7e18b3e4745c4afeaafeb826dc0445e0/users/91e2f1223d1143e7a8988b14dd8d3b1e/roles/81338d9374bb480785c7d7aa54829af8` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:41:00.767618 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39cb9736-02df-4bbb-bc83-c9a86136b24c None admin] RBAC: Authorizing `identity:create_grant(project_id=7e18b3e4745c4afeaafeb826dc0445e0, user_id=91e2f1223d1143e7a8988b14dd8d3b1e, role_id=81338d9374bb480785c7d7aa54829af8)` {{(pid=82026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:41:00.769462 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39cb9736-02df-4bbb-bc83-c9a86136b24c None admin] RBAC: Authorization granted {{(pid=82026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:41:00.778449 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e69bcb06-d2e0-43bb-8dc8-8d6391cbc059 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=82025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 13 19:41:00.784876 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application [None req-e69bcb06-d2e0-43bb-8dc8-8d6391cbc059 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 13 19:41:00.784876 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 19:41:00.784876 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 19:41:00.784876 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 19:41:00.784876 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 19:41:00.784876 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 19:41:00.784876 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 19:41:00.784876 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 19:41:00.784876 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 19:41:00.784876 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 19:41:00.784876 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 19:41:00.784876 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 19:41:00.784876 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 13 19:41:00.784876 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 13 19:41:00.784876 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 13 19:41:00.784876 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 13 19:41:00.795250 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 13 19:41:00.795250 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 13 19:41:00.795250 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 13 19:41:00.795250 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 13 19:41:00.795250 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 19:41:00.795250 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 19:41:00.795250 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 19:41:00.795250 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 19:41:00.795250 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 19:41:00.795250 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 19:41:00.795250 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 19:41:00.795250 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application with Lock( Sep 13 19:41:00.795250 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 19:41:00.795250 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application return self._enter() Sep 13 19:41:00.795250 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 19:41:00.795250 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 19:41:00.796298 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 19:41:00.796298 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application return self.creator() Sep 13 19:41:00.796298 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 19:41:00.796298 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application created_value = creator( Sep 13 19:41:00.796298 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 13 19:41:00.796298 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 13 19:41:00.796298 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 13 19:41:00.796298 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 13 19:41:00.796298 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 13 19:41:00.796298 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 13 19:41:00.796298 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 13 19:41:00.796298 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application Sep 13 19:41:00.796298 dv-cinder-828806-6-smb devstack@keystone.service[82025]: [pid: 82025|app: 0|req: 76/152] 10.222.0.33 () {56 vars in 1114 bytes} [Tue Sep 13 19:41:00 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 270 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 13 19:41:00.796298 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e69bcb06-d2e0-43bb-8dc8-8d6391cbc059 None admin] Authenticating user token {{(pid=82025) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:41:00.858656 dv-cinder-828806-6-smb devstack@keystone.service[82026]: [pid: 82026|app: 0|req: 77/153] 10.222.0.33 () {58 vars in 1439 bytes} [Tue Sep 13 19:41:00 2022] PUT /identity/v3/projects/7e18b3e4745c4afeaafeb826dc0445e0/users/91e2f1223d1143e7a8988b14dd8d3b1e/roles/81338d9374bb480785c7d7aa54829af8 => generated 0 bytes in 350 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 19:41:00.859542 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39cb9736-02df-4bbb-bc83-c9a86136b24c None admin] Authenticating user token {{(pid=82026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:41:00.939625 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e69bcb06-d2e0-43bb-8dc8-8d6391cbc059 None admin] Validating token access rules against request {{(pid=82025) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:41:00.978801 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d28e1eea-2554-4e26-8785-9cfcbf2b46e5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57539b6a6f3b4d589f5f5e1d211cd6a0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82025) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:41:00.979400 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d28e1eea-2554-4e26-8785-9cfcbf2b46e5 None admin] REQUEST_METHOD: `GET` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:41:00.979688 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d28e1eea-2554-4e26-8785-9cfcbf2b46e5 None admin] SCRIPT_NAME: `/identity` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:41:00.979968 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d28e1eea-2554-4e26-8785-9cfcbf2b46e5 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:41:00.992112 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d28e1eea-2554-4e26-8785-9cfcbf2b46e5 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=82025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 13 19:41:00.998323 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application [None req-d28e1eea-2554-4e26-8785-9cfcbf2b46e5 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 13 19:41:00.998323 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 19:41:00.998323 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 19:41:00.998323 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 19:41:00.998323 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 19:41:00.998323 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 19:41:00.998323 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 19:41:00.998323 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 19:41:00.998323 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 19:41:00.998323 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 19:41:00.998323 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 19:41:00.998323 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 19:41:00.998323 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 13 19:41:00.998323 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 13 19:41:00.998323 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 13 19:41:00.998323 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 13 19:41:01.000780 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 13 19:41:01.000780 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 13 19:41:01.000780 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 13 19:41:01.000780 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 13 19:41:01.000780 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 19:41:01.000780 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 19:41:01.000780 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 19:41:01.000780 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 19:41:01.000780 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 19:41:01.000780 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 19:41:01.000780 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 19:41:01.000780 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application with Lock( Sep 13 19:41:01.000780 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 19:41:01.000780 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application return self._enter() Sep 13 19:41:01.000780 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 19:41:01.000780 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 19:41:01.003171 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 19:41:01.003171 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application return self.creator() Sep 13 19:41:01.003171 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 19:41:01.003171 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application created_value = creator( Sep 13 19:41:01.003171 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 13 19:41:01.003171 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 13 19:41:01.003171 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 13 19:41:01.003171 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 13 19:41:01.003171 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 13 19:41:01.003171 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 13 19:41:01.003171 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 13 19:41:01.003171 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application Sep 13 19:41:01.003171 dv-cinder-828806-6-smb devstack@keystone.service[82025]: [pid: 82025|app: 0|req: 77/154] 10.222.0.33 () {56 vars in 1096 bytes} [Tue Sep 13 19:41:00 2022] GET /identity/v3/roles/admin => generated 83 bytes in 212 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 19:41:01.009481 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d28e1eea-2554-4e26-8785-9cfcbf2b46e5 None admin] Authenticating user token {{(pid=82025) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:41:01.022373 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG dbcounter [-] [82025] Writing DB stats keystone:SELECT=100 {{(pid=82025) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:41:01.109302 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG dbcounter [-] [82026] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82026) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:41:01.129540 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d28e1eea-2554-4e26-8785-9cfcbf2b46e5 None admin] Validating token access rules against request {{(pid=82025) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:41:01.141279 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39cb9736-02df-4bbb-bc83-c9a86136b24c None admin] Validating token access rules against request {{(pid=82026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:41:01.169659 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c84bae50-ce54-4602-859a-cc4ede4c99b6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57539b6a6f3b4d589f5f5e1d211cd6a0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82025) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:41:01.170275 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c84bae50-ce54-4602-859a-cc4ede4c99b6 None admin] REQUEST_METHOD: `GET` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:41:01.170562 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c84bae50-ce54-4602-859a-cc4ede4c99b6 None admin] SCRIPT_NAME: `/identity` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:41:01.170917 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c84bae50-ce54-4602-859a-cc4ede4c99b6 None admin] PATH_INFO: `/v3/roles` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:41:01.171648 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c84bae50-ce54-4602-859a-cc4ede4c99b6 None admin] RBAC: Adding query filter params (name=admin) {{(pid=82025) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 19:41:01.175513 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c84bae50-ce54-4602-859a-cc4ede4c99b6 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:41:01.177957 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c84bae50-ce54-4602-859a-cc4ede4c99b6 None admin] RBAC: Authorization granted {{(pid=82025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:41:01.192621 dv-cinder-828806-6-smb devstack@keystone.service[82025]: [pid: 82025|app: 0|req: 78/155] 10.222.0.33 () {56 vars in 1099 bytes} [Tue Sep 13 19:41:01 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 13 19:41:01.205787 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c84bae50-ce54-4602-859a-cc4ede4c99b6 None admin] Authenticating user token {{(pid=82025) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:41:01.231970 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bffcd566-b5da-43d7-b1ba-e5d824787daa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57539b6a6f3b4d589f5f5e1d211cd6a0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:41:01.233061 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bffcd566-b5da-43d7-b1ba-e5d824787daa None admin] REQUEST_METHOD: `GET` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:41:01.233341 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bffcd566-b5da-43d7-b1ba-e5d824787daa None admin] SCRIPT_NAME: `/identity` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:41:01.233617 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bffcd566-b5da-43d7-b1ba-e5d824787daa None admin] PATH_INFO: `/v3/roles` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:41:01.234311 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bffcd566-b5da-43d7-b1ba-e5d824787daa None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=82026) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 19:41:01.234621 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bffcd566-b5da-43d7-b1ba-e5d824787daa None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:41:01.236046 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bffcd566-b5da-43d7-b1ba-e5d824787daa None admin] RBAC: Authorization granted {{(pid=82026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:41:01.261088 dv-cinder-828806-6-smb devstack@keystone.service[82026]: [pid: 82026|app: 0|req: 78/156] 10.222.0.33 () {56 vars in 1111 bytes} [Tue Sep 13 19:41:00 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 402 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 19:41:01.268132 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bffcd566-b5da-43d7-b1ba-e5d824787daa None admin] Authenticating user token {{(pid=82026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:41:01.318427 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG dbcounter [-] [82025] Writing DB stats keystone:SELECT=100 {{(pid=82025) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:41:01.353074 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c84bae50-ce54-4602-859a-cc4ede4c99b6 None admin] Validating token access rules against request {{(pid=82025) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:41:01.401774 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45d83b5b-a95a-446e-b53c-43a7b46a10d3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57539b6a6f3b4d589f5f5e1d211cd6a0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82025) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:41:01.402419 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45d83b5b-a95a-446e-b53c-43a7b46a10d3 None admin] REQUEST_METHOD: `GET` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:41:01.402975 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45d83b5b-a95a-446e-b53c-43a7b46a10d3 None admin] SCRIPT_NAME: `/identity` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:41:01.403396 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45d83b5b-a95a-446e-b53c-43a7b46a10d3 None admin] PATH_INFO: `/v3/users/57539b6a6f3b4d589f5f5e1d211cd6a0` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:41:01.406935 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45d83b5b-a95a-446e-b53c-43a7b46a10d3 None admin] RBAC: Authorizing `identity:get_user(user_id=57539b6a6f3b4d589f5f5e1d211cd6a0)` {{(pid=82025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:41:01.408699 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45d83b5b-a95a-446e-b53c-43a7b46a10d3 None admin] RBAC: Authorization granted {{(pid=82025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:41:01.410861 dv-cinder-828806-6-smb devstack@keystone.service[82025]: [pid: 82025|app: 0|req: 79/157] 10.222.0.33 () {56 vars in 1177 bytes} [Tue Sep 13 19:41:01 2022] GET /identity/v3/users/57539b6a6f3b4d589f5f5e1d211cd6a0 => generated 247 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 19:41:01.425950 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45d83b5b-a95a-446e-b53c-43a7b46a10d3 None admin] Authenticating user token {{(pid=82025) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:41:01.477746 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bffcd566-b5da-43d7-b1ba-e5d824787daa None admin] Validating token access rules against request {{(pid=82026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:41:01.528773 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb964d3f-7519-449a-b21d-12033ef827c2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57539b6a6f3b4d589f5f5e1d211cd6a0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:41:01.529380 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb964d3f-7519-449a-b21d-12033ef827c2 None admin] REQUEST_METHOD: `GET` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:41:01.529658 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb964d3f-7519-449a-b21d-12033ef827c2 None admin] SCRIPT_NAME: `/identity` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:41:01.529928 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb964d3f-7519-449a-b21d-12033ef827c2 None admin] PATH_INFO: `/v3/users/6485aa9aa85e4a2aa1b120072f8422e4` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:41:01.531146 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb964d3f-7519-449a-b21d-12033ef827c2 None admin] RBAC: Authorizing `identity:get_user(user_id=6485aa9aa85e4a2aa1b120072f8422e4)` {{(pid=82026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:41:01.533610 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb964d3f-7519-449a-b21d-12033ef827c2 None admin] RBAC: Authorization granted {{(pid=82026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:41:01.539146 dv-cinder-828806-6-smb devstack@keystone.service[82026]: [pid: 82026|app: 0|req: 79/158] 10.222.0.33 () {56 vars in 1177 bytes} [Tue Sep 13 19:41:01 2022] GET /identity/v3/users/6485aa9aa85e4a2aa1b120072f8422e4 => generated 275 bytes in 268 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 19:41:01.542191 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb964d3f-7519-449a-b21d-12033ef827c2 None admin] Authenticating user token {{(pid=82026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:41:01.577548 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG dbcounter [-] [82026] Writing DB stats keystone:SELECT=100 {{(pid=82026) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:41:01.674546 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb964d3f-7519-449a-b21d-12033ef827c2 None admin] Validating token access rules against request {{(pid=82026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:41:01.730341 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6de906a4-2acf-4977-aa01-634f3aedaae5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57539b6a6f3b4d589f5f5e1d211cd6a0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:41:01.730960 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6de906a4-2acf-4977-aa01-634f3aedaae5 None admin] REQUEST_METHOD: `GET` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:41:01.731262 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6de906a4-2acf-4977-aa01-634f3aedaae5 None admin] SCRIPT_NAME: `/identity` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:41:01.731539 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6de906a4-2acf-4977-aa01-634f3aedaae5 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:41:01.772667 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45d83b5b-a95a-446e-b53c-43a7b46a10d3 None admin] Validating token access rules against request {{(pid=82025) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:41:01.850602 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6de906a4-2acf-4977-aa01-634f3aedaae5 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=82026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:41:01.852406 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6de906a4-2acf-4977-aa01-634f3aedaae5 None admin] RBAC: Authorization granted {{(pid=82026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:41:01.861273 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ac6595b-196f-4d77-9555-abe725fc21c4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57539b6a6f3b4d589f5f5e1d211cd6a0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82025) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:41:01.861905 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ac6595b-196f-4d77-9555-abe725fc21c4 None admin] REQUEST_METHOD: `GET` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:41:01.862189 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ac6595b-196f-4d77-9555-abe725fc21c4 None admin] SCRIPT_NAME: `/identity` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:41:01.862473 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ac6595b-196f-4d77-9555-abe725fc21c4 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:41:01.870128 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG dbcounter [-] [82025] Writing DB stats keystone:SELECT=100 {{(pid=82025) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:41:01.890370 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG dbcounter [-] [82026] Writing DB stats keystone:SELECT=100 {{(pid=82026) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:41:01.968452 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ac6595b-196f-4d77-9555-abe725fc21c4 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=82025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:41:01.969955 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ac6595b-196f-4d77-9555-abe725fc21c4 None admin] RBAC: Authorization granted {{(pid=82025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:41:02.040041 dv-cinder-828806-6-smb devstack@keystone.service[82026]: [pid: 82026|app: 0|req: 80/159] 10.222.0.33 () {58 vars in 1282 bytes} [Tue Sep 13 19:41:01 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 499 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Sep 13 19:41:02.044162 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bfcf609-202c-42f3-90a7-e6bebb8f491e None None] REQUEST_METHOD: `GET` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:41:02.044461 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bfcf609-202c-42f3-90a7-e6bebb8f491e None None] SCRIPT_NAME: `/identity` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:41:02.046013 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bfcf609-202c-42f3-90a7-e6bebb8f491e None None] PATH_INFO: `/` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:41:02.047499 dv-cinder-828806-6-smb devstack@keystone.service[82026]: [pid: 82026|app: 0|req: 81/160] 10.222.0.33 () {54 vars in 927 bytes} [Tue Sep 13 19:41:02 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 19:41:02.050551 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c052db3d-f309-4b26-ba34-ca30171f4770 None None] REQUEST_METHOD: `GET` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:41:02.050841 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c052db3d-f309-4b26-ba34-ca30171f4770 None None] SCRIPT_NAME: `/identity` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:41:02.051149 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c052db3d-f309-4b26-ba34-ca30171f4770 None None] PATH_INFO: `/` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:41:02.056591 dv-cinder-828806-6-smb devstack@keystone.service[82026]: [pid: 82026|app: 0|req: 82/161] 10.222.0.33 () {54 vars in 927 bytes} [Tue Sep 13 19:41:02 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 19:41:02.058287 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95102974-8436-400a-87f7-02c85660773c None None] REQUEST_METHOD: `POST` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:41:02.058582 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95102974-8436-400a-87f7-02c85660773c None None] SCRIPT_NAME: `/identity` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:41:02.058861 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95102974-8436-400a-87f7-02c85660773c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:41:02.082275 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.auth.core [None req-95102974-8436-400a-87f7-02c85660773c None None] MFA Rules not processed for user `57539b6a6f3b4d589f5f5e1d211cd6a0`. Rule list: `[]` (Enabled: `True`). {{(pid=82026) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 19:41:02.083521 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.common.fernet_utils [None req-95102974-8436-400a-87f7-02c85660773c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82026) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 19:41:02.131989 dv-cinder-828806-6-smb devstack@keystone.service[82025]: [pid: 82025|app: 0|req: 80/162] 10.222.0.33 () {58 vars in 1282 bytes} [Tue Sep 13 19:41:01 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 706 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Sep 13 19:41:02.132589 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ac6595b-196f-4d77-9555-abe725fc21c4 None admin] Authenticating user token {{(pid=82025) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:41:02.207487 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG dbcounter [-] [82025] Writing DB stats keystone:SELECT=100 {{(pid=82025) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:41:02.285383 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ac6595b-196f-4d77-9555-abe725fc21c4 None admin] Validating token access rules against request {{(pid=82025) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:41:02.300690 dv-cinder-828806-6-smb devstack@keystone.service[82026]: [pid: 82026|app: 0|req: 83/163] 10.222.0.33 () {58 vars in 1024 bytes} [Tue Sep 13 19:41:02 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 243 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 13 19:41:02.301971 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bdcbf30-688c-4ac2-b0ba-7b6a8a5b7c21 None None] REQUEST_METHOD: `POST` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:41:02.302259 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bdcbf30-688c-4ac2-b0ba-7b6a8a5b7c21 None None] SCRIPT_NAME: `/identity` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:41:02.302533 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bdcbf30-688c-4ac2-b0ba-7b6a8a5b7c21 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:41:02.345690 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.auth.core [None req-0bdcbf30-688c-4ac2-b0ba-7b6a8a5b7c21 None None] MFA Rules not processed for user `57539b6a6f3b4d589f5f5e1d211cd6a0`. Rule list: `[]` (Enabled: `True`). {{(pid=82026) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 19:41:02.346894 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.common.fernet_utils [None req-0bdcbf30-688c-4ac2-b0ba-7b6a8a5b7c21 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82026) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 19:41:02.352685 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29564aeb-193e-4a39-bd3e-4d06301159b8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57539b6a6f3b4d589f5f5e1d211cd6a0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82025) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:41:02.353338 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29564aeb-193e-4a39-bd3e-4d06301159b8 None admin] REQUEST_METHOD: `GET` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:41:02.353621 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29564aeb-193e-4a39-bd3e-4d06301159b8 None admin] SCRIPT_NAME: `/identity` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:41:02.353898 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29564aeb-193e-4a39-bd3e-4d06301159b8 None admin] PATH_INFO: `/v3/projects/7e18b3e4745c4afeaafeb826dc0445e0` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:41:02.355065 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29564aeb-193e-4a39-bd3e-4d06301159b8 None admin] RBAC: Authorizing `identity:get_project(project_id=7e18b3e4745c4afeaafeb826dc0445e0)` {{(pid=82025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:41:02.356776 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29564aeb-193e-4a39-bd3e-4d06301159b8 None admin] RBAC: Authorization granted {{(pid=82025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:41:02.358721 dv-cinder-828806-6-smb devstack@keystone.service[82025]: [pid: 82025|app: 0|req: 81/164] 10.222.0.33 () {56 vars in 1186 bytes} [Tue Sep 13 19:41:02 2022] GET /identity/v3/projects/7e18b3e4745c4afeaafeb826dc0445e0 => generated 298 bytes in 226 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 19:41:02.363670 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29564aeb-193e-4a39-bd3e-4d06301159b8 None admin] Authenticating user token {{(pid=82025) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:41:02.462031 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG dbcounter [-] [82026] Writing DB stats keystone:SELECT=100 {{(pid=82026) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:41:02.505546 dv-cinder-828806-6-smb devstack@keystone.service[82026]: [pid: 82026|app: 0|req: 84/165] 10.222.0.33 () {58 vars in 1024 bytes} [Tue Sep 13 19:41:02 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 204 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 13 19:41:02.506224 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bdcbf30-688c-4ac2-b0ba-7b6a8a5b7c21 None None] Authenticating user token {{(pid=82026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:41:02.550633 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29564aeb-193e-4a39-bd3e-4d06301159b8 None admin] Validating token access rules against request {{(pid=82025) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:41:02.557659 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG dbcounter [-] [82025] Writing DB stats keystone:SELECT=100 {{(pid=82025) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:41:02.636784 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-839a3fcf-0a7a-43ab-94e0-cf7289f0def5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57539b6a6f3b4d589f5f5e1d211cd6a0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82025) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:41:02.637799 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-839a3fcf-0a7a-43ab-94e0-cf7289f0def5 None admin] REQUEST_METHOD: `GET` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:41:02.638851 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-839a3fcf-0a7a-43ab-94e0-cf7289f0def5 None admin] SCRIPT_NAME: `/identity` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:41:02.639460 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-839a3fcf-0a7a-43ab-94e0-cf7289f0def5 None admin] PATH_INFO: `/v3/projects/7e18b3e4745c4afeaafeb826dc0445e0` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:41:02.643816 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-839a3fcf-0a7a-43ab-94e0-cf7289f0def5 None admin] RBAC: Authorizing `identity:get_project(project_id=7e18b3e4745c4afeaafeb826dc0445e0)` {{(pid=82025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:41:02.645558 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-839a3fcf-0a7a-43ab-94e0-cf7289f0def5 None admin] RBAC: Authorization granted {{(pid=82025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:41:02.647561 dv-cinder-828806-6-smb devstack@keystone.service[82025]: [pid: 82025|app: 0|req: 82/166] 10.222.0.33 () {56 vars in 1186 bytes} [Tue Sep 13 19:41:02 2022] GET /identity/v3/projects/7e18b3e4745c4afeaafeb826dc0445e0 => generated 298 bytes in 288 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 19:41:02.653794 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-839a3fcf-0a7a-43ab-94e0-cf7289f0def5 None admin] Authenticating user token {{(pid=82025) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:41:02.718355 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bdcbf30-688c-4ac2-b0ba-7b6a8a5b7c21 None None] Validating token access rules against request {{(pid=82026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:41:02.790569 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ae4dc69-48b9-40fe-affb-31528b788e6c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57539b6a6f3b4d589f5f5e1d211cd6a0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:41:02.791239 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ae4dc69-48b9-40fe-affb-31528b788e6c None admin] REQUEST_METHOD: `GET` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:41:02.791488 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ae4dc69-48b9-40fe-affb-31528b788e6c None admin] SCRIPT_NAME: `/identity` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:41:02.791791 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ae4dc69-48b9-40fe-affb-31528b788e6c None admin] PATH_INFO: `/v3/role_assignments` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:41:02.792501 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ae4dc69-48b9-40fe-affb-31528b788e6c None admin] RBAC: Adding query filter params (role.id=6bcd095c76b341e186ea8caa11f5fa31, scope.project.id=7e18b3e4745c4afeaafeb826dc0445e0, user.id=6485aa9aa85e4a2aa1b120072f8422e4) {{(pid=82026) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 19:41:02.792811 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ae4dc69-48b9-40fe-affb-31528b788e6c None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=82026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:41:02.794332 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ae4dc69-48b9-40fe-affb-31528b788e6c None admin] RBAC: Authorization granted {{(pid=82026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:41:02.809618 dv-cinder-828806-6-smb devstack@keystone.service[82026]: [pid: 82026|app: 0|req: 85/167] 10.222.0.33 () {56 vars in 1374 bytes} [Tue Sep 13 19:41:02 2022] GET /identity/v3/role_assignments?user.id=6485aa9aa85e4a2aa1b120072f8422e4&scope.project.id=7e18b3e4745c4afeaafeb826dc0445e0&role.id=6bcd095c76b341e186ea8caa11f5fa31 => generated 608 bytes in 303 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 19:41:02.811002 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ae4dc69-48b9-40fe-affb-31528b788e6c None admin] Authenticating user token {{(pid=82026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:41:02.853714 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-839a3fcf-0a7a-43ab-94e0-cf7289f0def5 None admin] Validating token access rules against request {{(pid=82025) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:41:02.917093 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1f4d7a8-80cc-4fbd-a62e-f89eb7bce3c8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57539b6a6f3b4d589f5f5e1d211cd6a0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82025) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:41:02.917722 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1f4d7a8-80cc-4fbd-a62e-f89eb7bce3c8 None admin] REQUEST_METHOD: `GET` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:41:02.918007 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1f4d7a8-80cc-4fbd-a62e-f89eb7bce3c8 None admin] SCRIPT_NAME: `/identity` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:41:02.918282 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1f4d7a8-80cc-4fbd-a62e-f89eb7bce3c8 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:41:02.919025 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1f4d7a8-80cc-4fbd-a62e-f89eb7bce3c8 None admin] RBAC: Adding query filter params (role.id=e5af7d5baa93469e9e486ef21c85474e, scope.project.id=7e18b3e4745c4afeaafeb826dc0445e0, user.id=57539b6a6f3b4d589f5f5e1d211cd6a0) {{(pid=82025) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 19:41:02.919509 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1f4d7a8-80cc-4fbd-a62e-f89eb7bce3c8 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=82025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:41:02.921128 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1f4d7a8-80cc-4fbd-a62e-f89eb7bce3c8 None admin] RBAC: Authorization granted {{(pid=82025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:41:02.927517 dv-cinder-828806-6-smb devstack@keystone.service[82025]: [pid: 82025|app: 0|req: 83/168] 10.222.0.33 () {56 vars in 1374 bytes} [Tue Sep 13 19:41:02 2022] GET /identity/v3/role_assignments?user.id=57539b6a6f3b4d589f5f5e1d211cd6a0&scope.project.id=7e18b3e4745c4afeaafeb826dc0445e0&role.id=e5af7d5baa93469e9e486ef21c85474e => generated 608 bytes in 274 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 13 19:41:02.951900 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG dbcounter [-] [82026] Writing DB stats keystone:SELECT=100 {{(pid=82026) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:41:03.042961 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ae4dc69-48b9-40fe-affb-31528b788e6c None admin] Validating token access rules against request {{(pid=82026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:41:03.084907 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df211b6c-8cc7-420a-a254-d4cd7360b696 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57539b6a6f3b4d589f5f5e1d211cd6a0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:41:03.085554 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df211b6c-8cc7-420a-a254-d4cd7360b696 None admin] REQUEST_METHOD: `GET` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:41:03.085835 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df211b6c-8cc7-420a-a254-d4cd7360b696 None admin] SCRIPT_NAME: `/identity` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:41:03.086108 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df211b6c-8cc7-420a-a254-d4cd7360b696 None admin] PATH_INFO: `/v3/roles/member` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:41:03.108585 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df211b6c-8cc7-420a-a254-d4cd7360b696 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=82026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 13 19:41:03.114189 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application [None req-df211b6c-8cc7-420a-a254-d4cd7360b696 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 13 19:41:03.114189 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 19:41:03.114189 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 19:41:03.114189 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 19:41:03.114189 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 19:41:03.114189 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 19:41:03.114189 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 19:41:03.114189 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 19:41:03.114189 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 19:41:03.114189 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 19:41:03.114189 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 19:41:03.114189 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 19:41:03.114189 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 13 19:41:03.114189 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 13 19:41:03.114189 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 13 19:41:03.114189 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 13 19:41:03.115161 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 13 19:41:03.115161 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 13 19:41:03.115161 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 13 19:41:03.115161 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 13 19:41:03.115161 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 19:41:03.115161 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 19:41:03.115161 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 19:41:03.115161 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 19:41:03.115161 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 19:41:03.115161 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 19:41:03.115161 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 19:41:03.115161 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application with Lock( Sep 13 19:41:03.115161 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 19:41:03.115161 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application return self._enter() Sep 13 19:41:03.115161 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 19:41:03.115161 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 19:41:03.115950 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 19:41:03.115950 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application return self.creator() Sep 13 19:41:03.115950 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 19:41:03.115950 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application created_value = creator( Sep 13 19:41:03.115950 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 13 19:41:03.115950 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 13 19:41:03.115950 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 13 19:41:03.115950 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 13 19:41:03.115950 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 13 19:41:03.115950 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 13 19:41:03.115950 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 13 19:41:03.115950 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application Sep 13 19:41:03.115950 dv-cinder-828806-6-smb devstack@keystone.service[82026]: [pid: 82026|app: 0|req: 86/169] 10.222.0.33 () {56 vars in 1099 bytes} [Tue Sep 13 19:41:02 2022] GET /identity/v3/roles/member => generated 84 bytes in 305 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 19:41:03.122953 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1f4d7a8-80cc-4fbd-a62e-f89eb7bce3c8 None admin] Authenticating user token {{(pid=82025) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:41:03.177767 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG dbcounter [-] [82025] Writing DB stats keystone:SELECT=100 {{(pid=82025) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:41:03.254168 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1f4d7a8-80cc-4fbd-a62e-f89eb7bce3c8 None admin] Validating token access rules against request {{(pid=82025) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:41:03.291279 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b51820cc-8d2d-46b7-a6e7-6f2d1f2c37e6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57539b6a6f3b4d589f5f5e1d211cd6a0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82025) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:41:03.291909 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b51820cc-8d2d-46b7-a6e7-6f2d1f2c37e6 None admin] REQUEST_METHOD: `GET` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:41:03.292204 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b51820cc-8d2d-46b7-a6e7-6f2d1f2c37e6 None admin] SCRIPT_NAME: `/identity` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:41:03.292487 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b51820cc-8d2d-46b7-a6e7-6f2d1f2c37e6 None admin] PATH_INFO: `/v3/roles` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:41:03.293234 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b51820cc-8d2d-46b7-a6e7-6f2d1f2c37e6 None admin] RBAC: Adding query filter params (name=member) {{(pid=82025) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 19:41:03.293494 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b51820cc-8d2d-46b7-a6e7-6f2d1f2c37e6 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:41:03.295454 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b51820cc-8d2d-46b7-a6e7-6f2d1f2c37e6 None admin] RBAC: Authorization granted {{(pid=82025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:41:03.304724 dv-cinder-828806-6-smb devstack@keystone.service[82025]: [pid: 82025|app: 0|req: 84/170] 10.222.0.33 () {56 vars in 1101 bytes} [Tue Sep 13 19:41:03 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 19:41:03.310590 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df211b6c-8cc7-420a-a254-d4cd7360b696 None admin] Authenticating user token {{(pid=82026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:41:03.330539 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b51820cc-8d2d-46b7-a6e7-6f2d1f2c37e6 None admin] Authenticating user token {{(pid=82025) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:41:03.444905 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG dbcounter [-] [82025] Writing DB stats keystone:SELECT=100 {{(pid=82025) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:41:03.447394 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b51820cc-8d2d-46b7-a6e7-6f2d1f2c37e6 None admin] Validating token access rules against request {{(pid=82025) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:41:03.510019 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df211b6c-8cc7-420a-a254-d4cd7360b696 None admin] Validating token access rules against request {{(pid=82026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:41:03.515371 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG dbcounter [-] [82026] Writing DB stats keystone:SELECT=100 {{(pid=82026) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:41:03.524123 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c2dee9a-0dfd-440a-8ab6-72d768092f41 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57539b6a6f3b4d589f5f5e1d211cd6a0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82025) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:41:03.524778 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c2dee9a-0dfd-440a-8ab6-72d768092f41 None admin] REQUEST_METHOD: `GET` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:41:03.525061 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c2dee9a-0dfd-440a-8ab6-72d768092f41 None admin] SCRIPT_NAME: `/identity` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:41:03.525339 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c2dee9a-0dfd-440a-8ab6-72d768092f41 None admin] PATH_INFO: `/v3/roles/member` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:41:03.549168 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c2dee9a-0dfd-440a-8ab6-72d768092f41 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=82025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 13 19:41:03.554546 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application [None req-9c2dee9a-0dfd-440a-8ab6-72d768092f41 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 13 19:41:03.554546 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 19:41:03.554546 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 19:41:03.554546 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 19:41:03.554546 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 19:41:03.554546 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 19:41:03.554546 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 19:41:03.554546 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 19:41:03.554546 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 19:41:03.554546 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 19:41:03.554546 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 19:41:03.554546 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 19:41:03.554546 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 13 19:41:03.554546 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 13 19:41:03.554546 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 13 19:41:03.554546 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 13 19:41:03.555479 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 13 19:41:03.555479 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 13 19:41:03.555479 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 13 19:41:03.555479 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 13 19:41:03.555479 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 19:41:03.555479 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 19:41:03.555479 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 19:41:03.555479 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 19:41:03.555479 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 19:41:03.555479 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 19:41:03.555479 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 19:41:03.555479 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application with Lock( Sep 13 19:41:03.555479 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 19:41:03.555479 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application return self._enter() Sep 13 19:41:03.555479 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 19:41:03.555479 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 19:41:03.556281 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 19:41:03.556281 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application return self.creator() Sep 13 19:41:03.556281 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 19:41:03.556281 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application created_value = creator( Sep 13 19:41:03.556281 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 13 19:41:03.556281 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 13 19:41:03.556281 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 13 19:41:03.556281 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 13 19:41:03.556281 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 13 19:41:03.556281 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 13 19:41:03.556281 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 13 19:41:03.556281 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application Sep 13 19:41:03.556879 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12338a37-01d6-45ac-b0bf-ad9a77305137 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57539b6a6f3b4d589f5f5e1d211cd6a0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:41:03.556879 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12338a37-01d6-45ac-b0bf-ad9a77305137 None admin] REQUEST_METHOD: `GET` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:41:03.556879 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12338a37-01d6-45ac-b0bf-ad9a77305137 None admin] SCRIPT_NAME: `/identity` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:41:03.557079 dv-cinder-828806-6-smb devstack@keystone.service[82025]: [pid: 82025|app: 0|req: 85/171] 10.222.0.33 () {56 vars in 1099 bytes} [Tue Sep 13 19:41:03 2022] GET /identity/v3/roles/member => generated 84 bytes in 226 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 19:41:03.557144 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12338a37-01d6-45ac-b0bf-ad9a77305137 None admin] PATH_INFO: `/v3/users/6485aa9aa85e4a2aa1b120072f8422e4` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:41:03.562313 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12338a37-01d6-45ac-b0bf-ad9a77305137 None admin] RBAC: Authorizing `identity:get_user(user_id=6485aa9aa85e4a2aa1b120072f8422e4)` {{(pid=82026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:41:03.562718 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c2dee9a-0dfd-440a-8ab6-72d768092f41 None admin] Authenticating user token {{(pid=82025) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:41:03.563894 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12338a37-01d6-45ac-b0bf-ad9a77305137 None admin] RBAC: Authorization granted {{(pid=82026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:41:03.565565 dv-cinder-828806-6-smb devstack@keystone.service[82026]: [pid: 82026|app: 0|req: 87/172] 10.222.0.33 () {56 vars in 1177 bytes} [Tue Sep 13 19:41:03 2022] GET /identity/v3/users/6485aa9aa85e4a2aa1b120072f8422e4 => generated 275 bytes in 256 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 19:41:03.571091 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12338a37-01d6-45ac-b0bf-ad9a77305137 None admin] Authenticating user token {{(pid=82026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:41:03.723970 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12338a37-01d6-45ac-b0bf-ad9a77305137 None admin] Validating token access rules against request {{(pid=82026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:41:03.786642 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89d933da-c3c6-4510-ab55-8cfd61ee52a8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57539b6a6f3b4d589f5f5e1d211cd6a0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:41:03.787364 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89d933da-c3c6-4510-ab55-8cfd61ee52a8 None admin] REQUEST_METHOD: `GET` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:41:03.787654 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89d933da-c3c6-4510-ab55-8cfd61ee52a8 None admin] SCRIPT_NAME: `/identity` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:41:03.787934 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89d933da-c3c6-4510-ab55-8cfd61ee52a8 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:41:03.830112 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c2dee9a-0dfd-440a-8ab6-72d768092f41 None admin] Validating token access rules against request {{(pid=82025) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:41:03.868687 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cfbbb86-fb2d-41b6-8575-fe289199d6b4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57539b6a6f3b4d589f5f5e1d211cd6a0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82025) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:41:03.869355 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cfbbb86-fb2d-41b6-8575-fe289199d6b4 None admin] REQUEST_METHOD: `GET` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:41:03.869726 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cfbbb86-fb2d-41b6-8575-fe289199d6b4 None admin] SCRIPT_NAME: `/identity` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:41:03.870002 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cfbbb86-fb2d-41b6-8575-fe289199d6b4 None admin] PATH_INFO: `/v3/roles` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:41:03.870723 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cfbbb86-fb2d-41b6-8575-fe289199d6b4 None admin] RBAC: Adding query filter params (name=member) {{(pid=82025) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 19:41:03.870999 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cfbbb86-fb2d-41b6-8575-fe289199d6b4 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:41:03.872484 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cfbbb86-fb2d-41b6-8575-fe289199d6b4 None admin] RBAC: Authorization granted {{(pid=82025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:41:03.877540 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG dbcounter [-] [82026] Writing DB stats keystone:SELECT=100 {{(pid=82026) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:41:03.886006 dv-cinder-828806-6-smb devstack@keystone.service[82025]: [pid: 82025|app: 0|req: 86/173] 10.222.0.33 () {56 vars in 1101 bytes} [Tue Sep 13 19:41:03 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 324 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 13 19:41:03.892542 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cfbbb86-fb2d-41b6-8575-fe289199d6b4 None admin] Authenticating user token {{(pid=82025) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:41:03.930583 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG dbcounter [-] [82025] Writing DB stats keystone:SELECT=100 {{(pid=82025) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:41:03.959127 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89d933da-c3c6-4510-ab55-8cfd61ee52a8 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=82026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:41:03.961632 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89d933da-c3c6-4510-ab55-8cfd61ee52a8 None admin] RBAC: Authorization granted {{(pid=82026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:41:04.038656 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cfbbb86-fb2d-41b6-8575-fe289199d6b4 None admin] Validating token access rules against request {{(pid=82025) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:41:04.097681 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d956546-1df7-4cde-97a8-c5579d028ac1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57539b6a6f3b4d589f5f5e1d211cd6a0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82025) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:41:04.098254 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d956546-1df7-4cde-97a8-c5579d028ac1 None admin] REQUEST_METHOD: `GET` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:41:04.098543 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d956546-1df7-4cde-97a8-c5579d028ac1 None admin] SCRIPT_NAME: `/identity` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:41:04.098826 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d956546-1df7-4cde-97a8-c5579d028ac1 None admin] PATH_INFO: `/v3/users/6485aa9aa85e4a2aa1b120072f8422e4` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:41:04.103790 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d956546-1df7-4cde-97a8-c5579d028ac1 None admin] RBAC: Authorizing `identity:get_user(user_id=6485aa9aa85e4a2aa1b120072f8422e4)` {{(pid=82025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:41:04.105262 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d956546-1df7-4cde-97a8-c5579d028ac1 None admin] RBAC: Authorization granted {{(pid=82025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:41:04.106870 dv-cinder-828806-6-smb devstack@keystone.service[82025]: [pid: 82025|app: 0|req: 87/174] 10.222.0.33 () {56 vars in 1177 bytes} [Tue Sep 13 19:41:03 2022] GET /identity/v3/users/6485aa9aa85e4a2aa1b120072f8422e4 => generated 275 bytes in 215 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 13 19:41:04.109385 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b62cad1-c21b-4774-b390-b830f45395f5 None None] REQUEST_METHOD: `GET` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:41:04.109686 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b62cad1-c21b-4774-b390-b830f45395f5 None None] SCRIPT_NAME: `/identity` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:41:04.109972 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b62cad1-c21b-4774-b390-b830f45395f5 None None] PATH_INFO: `/` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:41:04.111247 dv-cinder-828806-6-smb devstack@keystone.service[82025]: [pid: 82025|app: 0|req: 88/175] 10.222.0.33 () {54 vars in 927 bytes} [Tue Sep 13 19:41:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 13 19:41:04.115698 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b62cad1-c21b-4774-b390-b830f45395f5 None None] Authenticating user token {{(pid=82025) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:41:04.150918 dv-cinder-828806-6-smb devstack@keystone.service[82026]: [pid: 82026|app: 0|req: 88/176] 10.222.0.33 () {58 vars in 1282 bytes} [Tue Sep 13 19:41:03 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 580 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Sep 13 19:41:04.152327 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a03679a-f48f-4858-a819-a8cffadcb50c None None] REQUEST_METHOD: `POST` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:41:04.152615 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a03679a-f48f-4858-a819-a8cffadcb50c None None] SCRIPT_NAME: `/identity` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:41:04.153155 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a03679a-f48f-4858-a819-a8cffadcb50c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:41:04.191008 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.auth.core [None req-6a03679a-f48f-4858-a819-a8cffadcb50c None None] MFA Rules not processed for user `57539b6a6f3b4d589f5f5e1d211cd6a0`. Rule list: `[]` (Enabled: `True`). {{(pid=82026) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 19:41:04.192252 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.common.fernet_utils [None req-6a03679a-f48f-4858-a819-a8cffadcb50c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82026) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 19:41:04.260366 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG dbcounter [-] [82025] Writing DB stats keystone:SELECT=100 {{(pid=82025) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:41:04.275164 dv-cinder-828806-6-smb devstack@keystone.service[82026]: [pid: 82026|app: 0|req: 89/177] 10.222.0.33 () {58 vars in 1024 bytes} [Tue Sep 13 19:41:04 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 13 19:41:04.275793 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b62cad1-c21b-4774-b390-b830f45395f5 None None] Validating token access rules against request {{(pid=82025) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:41:04.276871 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a03679a-f48f-4858-a819-a8cffadcb50c None None] Authenticating user token {{(pid=82026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:41:04.280550 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG dbcounter [-] [82026] Writing DB stats keystone:SELECT=100 {{(pid=82026) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:41:04.321772 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-899066d7-6c61-4730-8f2d-6237346fc634 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57539b6a6f3b4d589f5f5e1d211cd6a0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82025) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:41:04.322635 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-899066d7-6c61-4730-8f2d-6237346fc634 None admin] REQUEST_METHOD: `GET` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:41:04.323091 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-899066d7-6c61-4730-8f2d-6237346fc634 None admin] SCRIPT_NAME: `/identity` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:41:04.323510 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-899066d7-6c61-4730-8f2d-6237346fc634 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:41:04.413587 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-899066d7-6c61-4730-8f2d-6237346fc634 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=82025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:41:04.415319 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-899066d7-6c61-4730-8f2d-6237346fc634 None admin] RBAC: Authorization granted {{(pid=82025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:41:04.515442 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG dbcounter [-] [82025] Writing DB stats keystone:SELECT=100 {{(pid=82025) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:41:04.524176 dv-cinder-828806-6-smb devstack@keystone.service[82025]: [pid: 82025|app: 0|req: 89/178] 10.222.0.33 () {58 vars in 1282 bytes} [Tue Sep 13 19:41:04 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 409 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 13 19:41:04.527231 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a03679a-f48f-4858-a819-a8cffadcb50c None None] Validating token access rules against request {{(pid=82026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:41:04.531162 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdeb5bb7-5f72-459c-b311-a6aa333a6499 None None] REQUEST_METHOD: `GET` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:41:04.531639 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdeb5bb7-5f72-459c-b311-a6aa333a6499 None None] SCRIPT_NAME: `/identity` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:41:04.532066 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdeb5bb7-5f72-459c-b311-a6aa333a6499 None None] PATH_INFO: `/` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:41:04.533600 dv-cinder-828806-6-smb devstack@keystone.service[82025]: [pid: 82025|app: 0|req: 90/179] 10.222.0.33 () {54 vars in 927 bytes} [Tue Sep 13 19:41:04 2022] GET /identity => generated 270 bytes in 9 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 19:41:04.534634 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdeb5bb7-5f72-459c-b311-a6aa333a6499 None None] Authenticating user token {{(pid=82025) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:41:04.644329 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b3254c0-6664-4ac3-a3a4-31e50bc47a39 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57539b6a6f3b4d589f5f5e1d211cd6a0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:41:04.645017 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b3254c0-6664-4ac3-a3a4-31e50bc47a39 None admin] REQUEST_METHOD: `GET` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:41:04.645300 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b3254c0-6664-4ac3-a3a4-31e50bc47a39 None admin] SCRIPT_NAME: `/identity` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:41:04.645572 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b3254c0-6664-4ac3-a3a4-31e50bc47a39 None admin] PATH_INFO: `/v3/projects/4e1069c665d147a9b09c598d9a1ac8e4` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:41:04.647536 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b3254c0-6664-4ac3-a3a4-31e50bc47a39 None admin] RBAC: Authorizing `identity:get_project(project_id=4e1069c665d147a9b09c598d9a1ac8e4)` {{(pid=82026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:41:04.648514 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b3254c0-6664-4ac3-a3a4-31e50bc47a39 None admin] RBAC: Authorization granted {{(pid=82026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:41:04.650340 dv-cinder-828806-6-smb devstack@keystone.service[82026]: [pid: 82026|app: 0|req: 90/180] 10.222.0.33 () {56 vars in 1186 bytes} [Tue Sep 13 19:41:04 2022] GET /identity/v3/projects/4e1069c665d147a9b09c598d9a1ac8e4 => generated 312 bytes in 374 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 19:41:04.657878 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3516a9c0-c297-4dca-b782-0a666123dc0f None None] REQUEST_METHOD: `POST` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:41:04.657878 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3516a9c0-c297-4dca-b782-0a666123dc0f None None] SCRIPT_NAME: `/identity` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:41:04.657878 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3516a9c0-c297-4dca-b782-0a666123dc0f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:41:04.709663 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdeb5bb7-5f72-459c-b311-a6aa333a6499 None None] Validating token access rules against request {{(pid=82025) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:41:04.709876 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.auth.core [None req-3516a9c0-c297-4dca-b782-0a666123dc0f None None] MFA Rules not processed for user `57539b6a6f3b4d589f5f5e1d211cd6a0`. Rule list: `[]` (Enabled: `True`). {{(pid=82026) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 19:41:04.709876 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.common.fernet_utils [None req-3516a9c0-c297-4dca-b782-0a666123dc0f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82026) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 19:41:04.723048 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14e602ee-e4ee-404f-a79c-37259cf1d22a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57539b6a6f3b4d589f5f5e1d211cd6a0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82025) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:41:04.723710 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14e602ee-e4ee-404f-a79c-37259cf1d22a None admin] REQUEST_METHOD: `GET` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:41:04.723995 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14e602ee-e4ee-404f-a79c-37259cf1d22a None admin] SCRIPT_NAME: `/identity` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:41:04.724271 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14e602ee-e4ee-404f-a79c-37259cf1d22a None admin] PATH_INFO: `/v3/projects/7e18b3e4745c4afeaafeb826dc0445e0` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:41:04.725431 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14e602ee-e4ee-404f-a79c-37259cf1d22a None admin] RBAC: Authorizing `identity:get_project(project_id=7e18b3e4745c4afeaafeb826dc0445e0)` {{(pid=82025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:41:04.726920 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14e602ee-e4ee-404f-a79c-37259cf1d22a None admin] RBAC: Authorization granted {{(pid=82025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:41:04.729642 dv-cinder-828806-6-smb devstack@keystone.service[82025]: [pid: 82025|app: 0|req: 91/181] 10.222.0.33 () {56 vars in 1186 bytes} [Tue Sep 13 19:41:04 2022] GET /identity/v3/projects/7e18b3e4745c4afeaafeb826dc0445e0 => generated 298 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 19:41:04.730491 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14e602ee-e4ee-404f-a79c-37259cf1d22a None admin] Authenticating user token {{(pid=82025) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:41:04.797937 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG dbcounter [-] [82026] Writing DB stats keystone:SELECT=100 {{(pid=82026) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:41:04.803420 dv-cinder-828806-6-smb devstack@keystone.service[82026]: [pid: 82026|app: 0|req: 91/182] 10.222.0.33 () {58 vars in 1024 bytes} [Tue Sep 13 19:41:04 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 153 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 13 19:41:04.806489 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3516a9c0-c297-4dca-b782-0a666123dc0f None None] Authenticating user token {{(pid=82026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:41:04.807595 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG dbcounter [-] [82025] Writing DB stats keystone:SELECT=100 {{(pid=82025) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:41:04.864855 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14e602ee-e4ee-404f-a79c-37259cf1d22a None admin] Validating token access rules against request {{(pid=82025) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:41:04.903132 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ded755c2-26ea-42da-b4eb-5184550ffda6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57539b6a6f3b4d589f5f5e1d211cd6a0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82025) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:41:04.903753 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ded755c2-26ea-42da-b4eb-5184550ffda6 None admin] REQUEST_METHOD: `GET` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:41:04.904633 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ded755c2-26ea-42da-b4eb-5184550ffda6 None admin] SCRIPT_NAME: `/identity` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:41:04.904916 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ded755c2-26ea-42da-b4eb-5184550ffda6 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:41:04.905668 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ded755c2-26ea-42da-b4eb-5184550ffda6 None admin] RBAC: Adding query filter params (role.id=3618ab638a65401f82333da7596d1daf, scope.project.id=4e1069c665d147a9b09c598d9a1ac8e4, user.id=6485aa9aa85e4a2aa1b120072f8422e4) {{(pid=82025) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 19:41:04.905976 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ded755c2-26ea-42da-b4eb-5184550ffda6 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=82025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:41:04.907486 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ded755c2-26ea-42da-b4eb-5184550ffda6 None admin] RBAC: Authorization granted {{(pid=82025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:41:04.923077 dv-cinder-828806-6-smb devstack@keystone.service[82025]: [pid: 82025|app: 0|req: 92/183] 10.222.0.33 () {56 vars in 1374 bytes} [Tue Sep 13 19:41:04 2022] GET /identity/v3/role_assignments?user.id=6485aa9aa85e4a2aa1b120072f8422e4&scope.project.id=4e1069c665d147a9b09c598d9a1ac8e4&role.id=3618ab638a65401f82333da7596d1daf => generated 608 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 19:41:04.923077 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ded755c2-26ea-42da-b4eb-5184550ffda6 None admin] Authenticating user token {{(pid=82025) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:41:04.929407 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3516a9c0-c297-4dca-b782-0a666123dc0f None None] Validating token access rules against request {{(pid=82026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:41:04.975734 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-570c72c6-ec85-41cc-90b8-6ae6809684aa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57539b6a6f3b4d589f5f5e1d211cd6a0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:41:04.976368 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-570c72c6-ec85-41cc-90b8-6ae6809684aa None admin] REQUEST_METHOD: `GET` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:41:04.976661 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-570c72c6-ec85-41cc-90b8-6ae6809684aa None admin] SCRIPT_NAME: `/identity` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:41:04.976939 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-570c72c6-ec85-41cc-90b8-6ae6809684aa None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:41:04.992152 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-570c72c6-ec85-41cc-90b8-6ae6809684aa None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=82026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 13 19:41:04.997747 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application [None req-570c72c6-ec85-41cc-90b8-6ae6809684aa None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 13 19:41:04.997747 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 19:41:04.997747 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 19:41:04.997747 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 19:41:04.997747 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 19:41:04.997747 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 19:41:04.997747 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 19:41:04.997747 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 19:41:04.997747 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 19:41:04.997747 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 19:41:04.997747 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 19:41:04.997747 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 19:41:04.997747 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 13 19:41:04.997747 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 13 19:41:04.997747 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 13 19:41:04.997747 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 13 19:41:04.999609 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 13 19:41:04.999609 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 13 19:41:04.999609 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 13 19:41:04.999609 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 13 19:41:04.999609 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 19:41:04.999609 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 19:41:04.999609 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 19:41:04.999609 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 19:41:04.999609 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 19:41:04.999609 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 19:41:04.999609 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 19:41:04.999609 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application with Lock( Sep 13 19:41:04.999609 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 19:41:04.999609 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application return self._enter() Sep 13 19:41:04.999609 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 19:41:04.999609 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 19:41:05.000429 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 19:41:05.000429 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application return self.creator() Sep 13 19:41:05.000429 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 19:41:05.000429 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application created_value = creator( Sep 13 19:41:05.000429 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 13 19:41:05.000429 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 13 19:41:05.000429 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 13 19:41:05.000429 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 13 19:41:05.000429 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 13 19:41:05.000429 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 13 19:41:05.000429 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 13 19:41:05.000429 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application Sep 13 19:41:05.002887 dv-cinder-828806-6-smb devstack@keystone.service[82026]: [pid: 82026|app: 0|req: 92/184] 10.222.0.33 () {56 vars in 1114 bytes} [Tue Sep 13 19:41:04 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 199 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 19:41:05.004513 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f532254-6338-4da4-88fd-af008e0a5428 None None] REQUEST_METHOD: `GET` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:41:05.005028 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f532254-6338-4da4-88fd-af008e0a5428 None None] SCRIPT_NAME: `/identity` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:41:05.005514 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f532254-6338-4da4-88fd-af008e0a5428 None None] PATH_INFO: `/` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:41:05.011959 dv-cinder-828806-6-smb devstack@keystone.service[82026]: [pid: 82026|app: 0|req: 93/185] 10.222.0.33 () {54 vars in 927 bytes} [Tue Sep 13 19:41:05 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 19:41:05.013873 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b68e44d-1e6e-4584-a571-471d5c3bebad None None] REQUEST_METHOD: `GET` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:41:05.014455 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b68e44d-1e6e-4584-a571-471d5c3bebad None None] SCRIPT_NAME: `/identity` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:41:05.014954 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b68e44d-1e6e-4584-a571-471d5c3bebad None None] PATH_INFO: `/` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:41:05.016616 dv-cinder-828806-6-smb devstack@keystone.service[82026]: [pid: 82026|app: 0|req: 94/186] 10.222.0.33 () {54 vars in 927 bytes} [Tue Sep 13 19:41:05 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 19:41:05.017686 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b68e44d-1e6e-4584-a571-471d5c3bebad None None] Authenticating user token {{(pid=82026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:41:05.066921 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ded755c2-26ea-42da-b4eb-5184550ffda6 None admin] Validating token access rules against request {{(pid=82025) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:41:05.097732 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG dbcounter [-] [82026] Writing DB stats keystone:SELECT=100 {{(pid=82026) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:41:05.097942 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG dbcounter [-] [82025] Writing DB stats keystone:SELECT=100 {{(pid=82025) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:41:05.115664 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78b9594f-40be-40aa-be6f-fa7228159cdf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57539b6a6f3b4d589f5f5e1d211cd6a0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82025) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:41:05.116559 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78b9594f-40be-40aa-be6f-fa7228159cdf None admin] REQUEST_METHOD: `GET` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:41:05.116842 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78b9594f-40be-40aa-be6f-fa7228159cdf None admin] SCRIPT_NAME: `/identity` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:41:05.117278 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78b9594f-40be-40aa-be6f-fa7228159cdf None admin] PATH_INFO: `/v3/role_assignments` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:41:05.118205 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78b9594f-40be-40aa-be6f-fa7228159cdf None admin] RBAC: Adding query filter params (role.id=3618ab638a65401f82333da7596d1daf, scope.project.id=7e18b3e4745c4afeaafeb826dc0445e0, user.id=6485aa9aa85e4a2aa1b120072f8422e4) {{(pid=82025) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 19:41:05.118528 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78b9594f-40be-40aa-be6f-fa7228159cdf None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=82025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:41:05.120132 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78b9594f-40be-40aa-be6f-fa7228159cdf None admin] RBAC: Authorization granted {{(pid=82025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:41:05.127573 dv-cinder-828806-6-smb devstack@keystone.service[82025]: [pid: 82025|app: 0|req: 93/187] 10.222.0.33 () {56 vars in 1374 bytes} [Tue Sep 13 19:41:04 2022] GET /identity/v3/role_assignments?user.id=6485aa9aa85e4a2aa1b120072f8422e4&scope.project.id=7e18b3e4745c4afeaafeb826dc0445e0&role.id=3618ab638a65401f82333da7596d1daf => generated 608 bytes in 213 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 19:41:05.128884 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57a6a947-0322-49e9-9cb0-37847d8264ca None None] REQUEST_METHOD: `POST` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:41:05.129178 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57a6a947-0322-49e9-9cb0-37847d8264ca None None] SCRIPT_NAME: `/identity` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:41:05.129464 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57a6a947-0322-49e9-9cb0-37847d8264ca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:41:05.148101 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b68e44d-1e6e-4584-a571-471d5c3bebad None None] Validating token access rules against request {{(pid=82026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:41:05.150525 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.auth.core [None req-57a6a947-0322-49e9-9cb0-37847d8264ca None None] MFA Rules not processed for user `57539b6a6f3b4d589f5f5e1d211cd6a0`. Rule list: `[]` (Enabled: `True`). {{(pid=82025) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 19:41:05.151741 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.fernet_utils [None req-57a6a947-0322-49e9-9cb0-37847d8264ca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82025) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 19:41:05.194311 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f10d7534-a181-4c9c-9baa-c05fa21a1dd2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57539b6a6f3b4d589f5f5e1d211cd6a0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:41:05.195307 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f10d7534-a181-4c9c-9baa-c05fa21a1dd2 None admin] REQUEST_METHOD: `GET` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:41:05.195829 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f10d7534-a181-4c9c-9baa-c05fa21a1dd2 None admin] SCRIPT_NAME: `/identity` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:41:05.196327 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f10d7534-a181-4c9c-9baa-c05fa21a1dd2 None admin] PATH_INFO: `/v3/roles` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:41:05.197259 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f10d7534-a181-4c9c-9baa-c05fa21a1dd2 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=82026) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 19:41:05.197790 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f10d7534-a181-4c9c-9baa-c05fa21a1dd2 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:41:05.199427 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f10d7534-a181-4c9c-9baa-c05fa21a1dd2 None admin] RBAC: Authorization granted {{(pid=82026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:41:05.210945 dv-cinder-828806-6-smb devstack@keystone.service[82026]: [pid: 82026|app: 0|req: 95/188] 10.222.0.33 () {56 vars in 1111 bytes} [Tue Sep 13 19:41:05 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 19:41:05.212289 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fbeec61-636e-4b18-b43c-66d40c71f9b6 None None] REQUEST_METHOD: `POST` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:41:05.212563 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fbeec61-636e-4b18-b43c-66d40c71f9b6 None None] SCRIPT_NAME: `/identity` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:41:05.212846 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fbeec61-636e-4b18-b43c-66d40c71f9b6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:41:05.237379 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.auth.core [None req-7fbeec61-636e-4b18-b43c-66d40c71f9b6 None None] MFA Rules not processed for user `57539b6a6f3b4d589f5f5e1d211cd6a0`. Rule list: `[]` (Enabled: `True`). {{(pid=82026) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 19:41:05.238532 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.common.fernet_utils [None req-7fbeec61-636e-4b18-b43c-66d40c71f9b6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82026) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 19:41:05.267855 dv-cinder-828806-6-smb devstack@keystone.service[82025]: [pid: 82025|app: 0|req: 94/189] 10.222.0.33 () {58 vars in 1024 bytes} [Tue Sep 13 19:41:05 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 140 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 13 19:41:05.268830 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57a6a947-0322-49e9-9cb0-37847d8264ca None None] Authenticating user token {{(pid=82025) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:41:05.341275 dv-cinder-828806-6-smb devstack@keystone.service[82026]: [pid: 82026|app: 0|req: 96/190] 10.222.0.33 () {58 vars in 1024 bytes} [Tue Sep 13 19:41:05 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 13 19:41:05.342173 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fbeec61-636e-4b18-b43c-66d40c71f9b6 None None] Authenticating user token {{(pid=82026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:41:05.395968 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57a6a947-0322-49e9-9cb0-37847d8264ca None None] Validating token access rules against request {{(pid=82025) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:41:05.412486 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG dbcounter [-] [82025] Writing DB stats keystone:SELECT=100 {{(pid=82025) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:41:05.434316 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG dbcounter [-] [82026] Writing DB stats keystone:SELECT=100 {{(pid=82026) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:41:05.436389 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e677e045-0120-4f6d-b918-612f40f7454a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57539b6a6f3b4d589f5f5e1d211cd6a0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82025) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:41:05.437202 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e677e045-0120-4f6d-b918-612f40f7454a None admin] REQUEST_METHOD: `GET` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:41:05.437580 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e677e045-0120-4f6d-b918-612f40f7454a None admin] SCRIPT_NAME: `/identity` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:41:05.437893 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e677e045-0120-4f6d-b918-612f40f7454a None admin] PATH_INFO: `/v3/roles/admin` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:41:05.449610 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e677e045-0120-4f6d-b918-612f40f7454a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=82025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 13 19:41:05.455155 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application [None req-e677e045-0120-4f6d-b918-612f40f7454a None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 13 19:41:05.455155 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 19:41:05.455155 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 19:41:05.455155 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 19:41:05.455155 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 19:41:05.455155 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 19:41:05.455155 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 19:41:05.455155 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 19:41:05.455155 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 19:41:05.455155 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 19:41:05.455155 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 19:41:05.455155 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 19:41:05.455155 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 13 19:41:05.455155 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 13 19:41:05.455155 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 13 19:41:05.455155 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 13 19:41:05.456188 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 13 19:41:05.456188 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 13 19:41:05.456188 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 13 19:41:05.456188 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 13 19:41:05.456188 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 19:41:05.456188 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 19:41:05.456188 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 19:41:05.456188 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 19:41:05.456188 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 19:41:05.456188 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 19:41:05.456188 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 19:41:05.456188 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application with Lock( Sep 13 19:41:05.456188 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 19:41:05.456188 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application return self._enter() Sep 13 19:41:05.456188 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 19:41:05.456188 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 19:41:05.457213 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 19:41:05.457213 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application return self.creator() Sep 13 19:41:05.457213 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 19:41:05.457213 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application created_value = creator( Sep 13 19:41:05.457213 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 13 19:41:05.457213 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 13 19:41:05.457213 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 13 19:41:05.457213 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 13 19:41:05.457213 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 13 19:41:05.457213 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 13 19:41:05.457213 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 13 19:41:05.457213 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application Sep 13 19:41:05.457213 dv-cinder-828806-6-smb devstack@keystone.service[82025]: [pid: 82025|app: 0|req: 95/191] 10.222.0.33 () {56 vars in 1096 bytes} [Tue Sep 13 19:41:05 2022] GET /identity/v3/roles/admin => generated 83 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 19:41:05.464968 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e677e045-0120-4f6d-b918-612f40f7454a None admin] Authenticating user token {{(pid=82025) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:41:05.496876 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fbeec61-636e-4b18-b43c-66d40c71f9b6 None None] Validating token access rules against request {{(pid=82026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:41:05.536888 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2395154f-2f9c-49eb-8fe2-b41306867df8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57539b6a6f3b4d589f5f5e1d211cd6a0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:41:05.537847 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2395154f-2f9c-49eb-8fe2-b41306867df8 None admin] REQUEST_METHOD: `GET` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:41:05.538321 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2395154f-2f9c-49eb-8fe2-b41306867df8 None admin] SCRIPT_NAME: `/identity` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:41:05.538785 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2395154f-2f9c-49eb-8fe2-b41306867df8 None admin] PATH_INFO: `/v3/users/66dd5274b2434c7b86e70e4c95589707` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:41:05.554144 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2395154f-2f9c-49eb-8fe2-b41306867df8 None admin] RBAC: Authorizing `identity:get_user(user_id=66dd5274b2434c7b86e70e4c95589707)` {{(pid=82026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:41:05.555923 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2395154f-2f9c-49eb-8fe2-b41306867df8 None admin] RBAC: Authorization granted {{(pid=82026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:41:05.558079 dv-cinder-828806-6-smb devstack@keystone.service[82026]: [pid: 82026|app: 0|req: 97/192] 10.222.0.33 () {56 vars in 1177 bytes} [Tue Sep 13 19:41:05 2022] GET /identity/v3/users/66dd5274b2434c7b86e70e4c95589707 => generated 283 bytes in 216 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 19:41:05.565460 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2395154f-2f9c-49eb-8fe2-b41306867df8 None admin] Authenticating user token {{(pid=82026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:41:05.589088 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e677e045-0120-4f6d-b918-612f40f7454a None admin] Validating token access rules against request {{(pid=82025) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:41:05.630989 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-809c929c-58aa-49f5-ba50-8381ff409b00 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57539b6a6f3b4d589f5f5e1d211cd6a0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82025) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:41:05.631881 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-809c929c-58aa-49f5-ba50-8381ff409b00 None admin] REQUEST_METHOD: `GET` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:41:05.632160 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-809c929c-58aa-49f5-ba50-8381ff409b00 None admin] SCRIPT_NAME: `/identity` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:41:05.632438 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-809c929c-58aa-49f5-ba50-8381ff409b00 None admin] PATH_INFO: `/v3/roles` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:41:05.634393 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-809c929c-58aa-49f5-ba50-8381ff409b00 None admin] RBAC: Adding query filter params (name=admin) {{(pid=82025) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 19:41:05.634980 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-809c929c-58aa-49f5-ba50-8381ff409b00 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:41:05.637482 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-809c929c-58aa-49f5-ba50-8381ff409b00 None admin] RBAC: Authorization granted {{(pid=82025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:41:05.657887 dv-cinder-828806-6-smb devstack@keystone.service[82025]: [pid: 82025|app: 0|req: 96/193] 10.222.0.33 () {56 vars in 1099 bytes} [Tue Sep 13 19:41:05 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 19:41:05.658853 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-809c929c-58aa-49f5-ba50-8381ff409b00 None admin] Authenticating user token {{(pid=82025) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:41:05.698811 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2395154f-2f9c-49eb-8fe2-b41306867df8 None admin] Validating token access rules against request {{(pid=82026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:41:05.707491 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG dbcounter [-] [82025] Writing DB stats keystone:SELECT=100 {{(pid=82025) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:41:05.711003 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG dbcounter [-] [82026] Writing DB stats keystone:SELECT=100 {{(pid=82026) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:41:05.736412 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60ef3cd6-d010-4030-a56f-38cb549e565b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57539b6a6f3b4d589f5f5e1d211cd6a0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:41:05.737384 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60ef3cd6-d010-4030-a56f-38cb549e565b None admin] REQUEST_METHOD: `GET` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:41:05.737663 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60ef3cd6-d010-4030-a56f-38cb549e565b None admin] SCRIPT_NAME: `/identity` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:41:05.737943 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60ef3cd6-d010-4030-a56f-38cb549e565b None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:41:05.780504 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-809c929c-58aa-49f5-ba50-8381ff409b00 None admin] Validating token access rules against request {{(pid=82025) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:41:05.820286 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dae8e90-4db1-4939-b98f-a3650e7f813c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57539b6a6f3b4d589f5f5e1d211cd6a0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82025) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:41:05.820926 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dae8e90-4db1-4939-b98f-a3650e7f813c None admin] REQUEST_METHOD: `GET` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:41:05.821212 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dae8e90-4db1-4939-b98f-a3650e7f813c None admin] SCRIPT_NAME: `/identity` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:41:05.821657 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dae8e90-4db1-4939-b98f-a3650e7f813c None admin] PATH_INFO: `/v3/domains/default` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:41:05.823889 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dae8e90-4db1-4939-b98f-a3650e7f813c None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=82025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:41:05.825535 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60ef3cd6-d010-4030-a56f-38cb549e565b None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=82026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:41:05.826319 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dae8e90-4db1-4939-b98f-a3650e7f813c None admin] RBAC: Authorization granted {{(pid=82025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:41:05.827553 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60ef3cd6-d010-4030-a56f-38cb549e565b None admin] RBAC: Authorization granted {{(pid=82026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:41:05.828340 dv-cinder-828806-6-smb devstack@keystone.service[82025]: [pid: 82025|app: 0|req: 97/194] 10.222.0.33 () {56 vars in 1108 bytes} [Tue Sep 13 19:41:05 2022] GET /identity/v3/domains/default => generated 199 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 19:41:05.828879 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dae8e90-4db1-4939-b98f-a3650e7f813c None admin] Authenticating user token {{(pid=82025) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:41:05.945767 dv-cinder-828806-6-smb devstack@keystone.service[82026]: [pid: 82026|app: 0|req: 98/195] 10.222.0.33 () {58 vars in 1282 bytes} [Tue Sep 13 19:41:05 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 381 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 13 19:41:05.947618 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60ef3cd6-d010-4030-a56f-38cb549e565b None admin] Authenticating user token {{(pid=82026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:41:05.958600 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dae8e90-4db1-4939-b98f-a3650e7f813c None admin] Validating token access rules against request {{(pid=82025) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:41:05.960738 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG dbcounter [-] [82026] Writing DB stats keystone:SELECT=100 {{(pid=82026) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:41:05.962201 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG dbcounter [-] [82025] Writing DB stats keystone:SELECT=100 {{(pid=82025) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:41:06.000183 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f25bb406-872f-4961-9004-eb3fddb16c97 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57539b6a6f3b4d589f5f5e1d211cd6a0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82025) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:41:06.000830 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f25bb406-872f-4961-9004-eb3fddb16c97 None admin] REQUEST_METHOD: `GET` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:41:06.001275 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f25bb406-872f-4961-9004-eb3fddb16c97 None admin] SCRIPT_NAME: `/identity` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:41:06.001564 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f25bb406-872f-4961-9004-eb3fddb16c97 None admin] PATH_INFO: `/v3/users/66dd5274b2434c7b86e70e4c95589707` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:41:06.002724 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f25bb406-872f-4961-9004-eb3fddb16c97 None admin] RBAC: Authorizing `identity:get_user(user_id=66dd5274b2434c7b86e70e4c95589707)` {{(pid=82025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:41:06.004236 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f25bb406-872f-4961-9004-eb3fddb16c97 None admin] RBAC: Authorization granted {{(pid=82025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:41:06.006181 dv-cinder-828806-6-smb devstack@keystone.service[82025]: [pid: 82025|app: 0|req: 98/196] 10.222.0.33 () {56 vars in 1177 bytes} [Tue Sep 13 19:41:05 2022] GET /identity/v3/users/66dd5274b2434c7b86e70e4c95589707 => generated 283 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 19:41:06.006861 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f25bb406-872f-4961-9004-eb3fddb16c97 None admin] Authenticating user token {{(pid=82025) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:41:06.069163 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60ef3cd6-d010-4030-a56f-38cb549e565b None admin] Validating token access rules against request {{(pid=82026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:41:06.112966 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7345f8b2-2261-4bd6-ada5-7da76495f9b7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57539b6a6f3b4d589f5f5e1d211cd6a0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:41:06.113659 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7345f8b2-2261-4bd6-ada5-7da76495f9b7 None admin] REQUEST_METHOD: `GET` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:41:06.113943 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7345f8b2-2261-4bd6-ada5-7da76495f9b7 None admin] SCRIPT_NAME: `/identity` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:41:06.114215 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7345f8b2-2261-4bd6-ada5-7da76495f9b7 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:41:06.119062 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f25bb406-872f-4961-9004-eb3fddb16c97 None admin] Validating token access rules against request {{(pid=82025) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:41:06.129797 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7345f8b2-2261-4bd6-ada5-7da76495f9b7 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=82026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 13 19:41:06.134889 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application [None req-7345f8b2-2261-4bd6-ada5-7da76495f9b7 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Sep 13 19:41:06.134889 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 19:41:06.134889 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 19:41:06.134889 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 19:41:06.134889 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 19:41:06.134889 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 19:41:06.134889 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 19:41:06.134889 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 19:41:06.134889 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 19:41:06.134889 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 19:41:06.134889 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 19:41:06.134889 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 19:41:06.134889 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 13 19:41:06.134889 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 13 19:41:06.134889 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 13 19:41:06.134889 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 13 19:41:06.135897 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 13 19:41:06.135897 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 13 19:41:06.135897 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 13 19:41:06.135897 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 13 19:41:06.135897 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 19:41:06.135897 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 19:41:06.135897 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 19:41:06.135897 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 19:41:06.135897 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 19:41:06.135897 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 19:41:06.135897 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 19:41:06.135897 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application with Lock( Sep 13 19:41:06.135897 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 19:41:06.135897 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application return self._enter() Sep 13 19:41:06.135897 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 19:41:06.135897 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 19:41:06.136902 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 19:41:06.136902 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application return self.creator() Sep 13 19:41:06.136902 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 19:41:06.136902 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application created_value = creator( Sep 13 19:41:06.136902 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 13 19:41:06.136902 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 13 19:41:06.136902 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 13 19:41:06.136902 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 13 19:41:06.136902 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 13 19:41:06.136902 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 13 19:41:06.136902 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Sep 13 19:41:06.136902 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application Sep 13 19:41:06.136902 dv-cinder-828806-6-smb devstack@keystone.service[82026]: [pid: 82026|app: 0|req: 99/197] 10.222.0.33 () {56 vars in 1099 bytes} [Tue Sep 13 19:41:05 2022] GET /identity/v3/roles/reader => generated 84 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 19:41:06.136902 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7345f8b2-2261-4bd6-ada5-7da76495f9b7 None admin] Authenticating user token {{(pid=82026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:41:06.160502 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af05fc93-5a6c-457b-98d0-fc05b937d439 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57539b6a6f3b4d589f5f5e1d211cd6a0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82025) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:41:06.161151 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af05fc93-5a6c-457b-98d0-fc05b937d439 None admin] REQUEST_METHOD: `POST` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:41:06.161437 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af05fc93-5a6c-457b-98d0-fc05b937d439 None admin] SCRIPT_NAME: `/identity` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:41:06.161712 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af05fc93-5a6c-457b-98d0-fc05b937d439 None admin] PATH_INFO: `/v3/users` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:41:06.162369 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af05fc93-5a6c-457b-98d0-fc05b937d439 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=82025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:41:06.164130 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af05fc93-5a6c-457b-98d0-fc05b937d439 None admin] RBAC: Authorization granted {{(pid=82025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:41:06.222724 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG dbcounter [-] [82026] Writing DB stats keystone:SELECT=100 {{(pid=82026) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:41:06.254318 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7345f8b2-2261-4bd6-ada5-7da76495f9b7 None admin] Validating token access rules against request {{(pid=82026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:41:06.258124 dv-cinder-828806-6-smb devstack@keystone.service[82025]: [pid: 82025|app: 0|req: 99/198] 10.222.0.33 () {60 vars in 1132 bytes} [Tue Sep 13 19:41:06 2022] POST /identity/v3/users => generated 297 bytes in 252 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 13 19:41:06.258969 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af05fc93-5a6c-457b-98d0-fc05b937d439 None admin] Authenticating user token {{(pid=82025) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:41:06.307365 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f141ba96-25f5-4cd7-8141-af9a2a693513 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57539b6a6f3b4d589f5f5e1d211cd6a0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:41:06.308452 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f141ba96-25f5-4cd7-8141-af9a2a693513 None admin] REQUEST_METHOD: `GET` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:41:06.308773 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f141ba96-25f5-4cd7-8141-af9a2a693513 None admin] SCRIPT_NAME: `/identity` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:41:06.309019 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f141ba96-25f5-4cd7-8141-af9a2a693513 None admin] PATH_INFO: `/v3/projects/bee3101ec8f84efa9f84a402c3c3cbbe` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:41:06.310234 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f141ba96-25f5-4cd7-8141-af9a2a693513 None admin] RBAC: Authorizing `identity:get_project(project_id=bee3101ec8f84efa9f84a402c3c3cbbe)` {{(pid=82026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:41:06.311841 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f141ba96-25f5-4cd7-8141-af9a2a693513 None admin] RBAC: Authorization granted {{(pid=82026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:41:06.313351 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG dbcounter [-] [82025] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=82025) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:41:06.313842 dv-cinder-828806-6-smb devstack@keystone.service[82026]: [pid: 82026|app: 0|req: 100/199] 10.222.0.33 () {56 vars in 1186 bytes} [Tue Sep 13 19:41:06 2022] GET /identity/v3/projects/bee3101ec8f84efa9f84a402c3c3cbbe => generated 302 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 19:41:06.314405 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f141ba96-25f5-4cd7-8141-af9a2a693513 None admin] Authenticating user token {{(pid=82026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:41:06.418315 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af05fc93-5a6c-457b-98d0-fc05b937d439 None admin] Validating token access rules against request {{(pid=82025) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:41:06.460771 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f141ba96-25f5-4cd7-8141-af9a2a693513 None admin] Validating token access rules against request {{(pid=82026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:41:06.466534 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73a62f66-b386-4f5e-8eb7-887e4720bb08 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57539b6a6f3b4d589f5f5e1d211cd6a0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82025) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:41:06.466534 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73a62f66-b386-4f5e-8eb7-887e4720bb08 None admin] REQUEST_METHOD: `GET` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:41:06.466937 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73a62f66-b386-4f5e-8eb7-887e4720bb08 None admin] SCRIPT_NAME: `/identity` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:41:06.467310 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73a62f66-b386-4f5e-8eb7-887e4720bb08 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:41:06.524996 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-427c780c-e868-441d-8c30-5eeeba1b1698 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57539b6a6f3b4d589f5f5e1d211cd6a0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:41:06.524996 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-427c780c-e868-441d-8c30-5eeeba1b1698 None admin] REQUEST_METHOD: `GET` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:41:06.524996 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-427c780c-e868-441d-8c30-5eeeba1b1698 None admin] SCRIPT_NAME: `/identity` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:41:06.524996 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-427c780c-e868-441d-8c30-5eeeba1b1698 None admin] PATH_INFO: `/v3/roles` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:41:06.525467 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-427c780c-e868-441d-8c30-5eeeba1b1698 None admin] RBAC: Adding query filter params (name=reader) {{(pid=82026) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 19:41:06.525467 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-427c780c-e868-441d-8c30-5eeeba1b1698 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:41:06.526712 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-427c780c-e868-441d-8c30-5eeeba1b1698 None admin] RBAC: Authorization granted {{(pid=82026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:41:06.533244 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG dbcounter [-] [82026] Writing DB stats keystone:SELECT=100 {{(pid=82026) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:41:06.536965 dv-cinder-828806-6-smb devstack@keystone.service[82026]: [pid: 82026|app: 0|req: 101/200] 10.222.0.33 () {56 vars in 1101 bytes} [Tue Sep 13 19:41:06 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 223 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 19:41:06.537983 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-427c780c-e868-441d-8c30-5eeeba1b1698 None admin] Authenticating user token {{(pid=82026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:41:06.566867 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73a62f66-b386-4f5e-8eb7-887e4720bb08 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=82025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:41:06.568365 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73a62f66-b386-4f5e-8eb7-887e4720bb08 None admin] RBAC: Authorization granted {{(pid=82025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:41:06.606398 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG dbcounter [-] [82025] Writing DB stats keystone:SELECT=100 {{(pid=82025) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:41:06.666235 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-427c780c-e868-441d-8c30-5eeeba1b1698 None admin] Validating token access rules against request {{(pid=82026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:41:06.704209 dv-cinder-828806-6-smb devstack@keystone.service[82025]: [pid: 82025|app: 0|req: 100/201] 10.222.0.33 () {58 vars in 1282 bytes} [Tue Sep 13 19:41:06 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 445 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 13 19:41:06.704558 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73a62f66-b386-4f5e-8eb7-887e4720bb08 None admin] Authenticating user token {{(pid=82025) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:41:06.714313 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-495625c8-14de-4feb-8eef-221651a7245a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57539b6a6f3b4d589f5f5e1d211cd6a0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:41:06.715312 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-495625c8-14de-4feb-8eef-221651a7245a None admin] REQUEST_METHOD: `GET` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:41:06.715795 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-495625c8-14de-4feb-8eef-221651a7245a None admin] SCRIPT_NAME: `/identity` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:41:06.716285 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-495625c8-14de-4feb-8eef-221651a7245a None admin] PATH_INFO: `/v3/role_assignments` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:41:06.717778 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-495625c8-14de-4feb-8eef-221651a7245a None admin] RBAC: Adding query filter params (role.id=6bcd095c76b341e186ea8caa11f5fa31, scope.project.id=bee3101ec8f84efa9f84a402c3c3cbbe, user.id=66dd5274b2434c7b86e70e4c95589707) {{(pid=82026) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 19:41:06.718436 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-495625c8-14de-4feb-8eef-221651a7245a None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=82026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:41:06.720070 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-495625c8-14de-4feb-8eef-221651a7245a None admin] RBAC: Authorization granted {{(pid=82026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:41:06.727670 dv-cinder-828806-6-smb devstack@keystone.service[82026]: [pid: 82026|app: 0|req: 102/202] 10.222.0.33 () {56 vars in 1374 bytes} [Tue Sep 13 19:41:06 2022] GET /identity/v3/role_assignments?user.id=66dd5274b2434c7b86e70e4c95589707&scope.project.id=bee3101ec8f84efa9f84a402c3c3cbbe&role.id=6bcd095c76b341e186ea8caa11f5fa31 => generated 259 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 19:41:06.727928 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-495625c8-14de-4feb-8eef-221651a7245a None admin] Authenticating user token {{(pid=82026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:41:06.844661 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG dbcounter [-] [82026] Writing DB stats keystone:SELECT=100 {{(pid=82026) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:41:06.867235 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73a62f66-b386-4f5e-8eb7-887e4720bb08 None admin] Validating token access rules against request {{(pid=82025) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:41:06.917927 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-495625c8-14de-4feb-8eef-221651a7245a None admin] Validating token access rules against request {{(pid=82026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:41:06.919481 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG dbcounter [-] [82025] Writing DB stats keystone:SELECT=100 {{(pid=82025) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:41:06.936678 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f64353f7-d7e6-46ff-9799-fcecf98926d6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57539b6a6f3b4d589f5f5e1d211cd6a0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82025) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:41:06.937329 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f64353f7-d7e6-46ff-9799-fcecf98926d6 None admin] REQUEST_METHOD: `GET` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:41:06.937613 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f64353f7-d7e6-46ff-9799-fcecf98926d6 None admin] SCRIPT_NAME: `/identity` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:41:06.937888 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f64353f7-d7e6-46ff-9799-fcecf98926d6 None admin] PATH_INFO: `/v3/users/91e2f1223d1143e7a8988b14dd8d3b1e` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:41:06.940694 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f64353f7-d7e6-46ff-9799-fcecf98926d6 None admin] RBAC: Authorizing `identity:get_user(user_id=91e2f1223d1143e7a8988b14dd8d3b1e)` {{(pid=82025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:41:06.945544 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f64353f7-d7e6-46ff-9799-fcecf98926d6 None admin] RBAC: Authorization granted {{(pid=82025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:41:06.946395 dv-cinder-828806-6-smb devstack@keystone.service[82025]: [pid: 82025|app: 0|req: 101/203] 10.222.0.33 () {56 vars in 1177 bytes} [Tue Sep 13 19:41:06 2022] GET /identity/v3/users/91e2f1223d1143e7a8988b14dd8d3b1e => generated 289 bytes in 242 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 19:41:06.958875 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f64353f7-d7e6-46ff-9799-fcecf98926d6 None admin] Authenticating user token {{(pid=82025) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:41:06.999463 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aae6a4fb-85b0-46d3-b874-dd91c6625892 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57539b6a6f3b4d589f5f5e1d211cd6a0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:41:07.000735 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aae6a4fb-85b0-46d3-b874-dd91c6625892 None admin] REQUEST_METHOD: `GET` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:41:07.001228 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aae6a4fb-85b0-46d3-b874-dd91c6625892 None admin] SCRIPT_NAME: `/identity` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:41:07.001695 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aae6a4fb-85b0-46d3-b874-dd91c6625892 None admin] PATH_INFO: `/v3/projects/bee3101ec8f84efa9f84a402c3c3cbbe` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:41:07.005235 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aae6a4fb-85b0-46d3-b874-dd91c6625892 None admin] RBAC: Authorizing `identity:get_project(project_id=bee3101ec8f84efa9f84a402c3c3cbbe)` {{(pid=82026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:41:07.007003 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aae6a4fb-85b0-46d3-b874-dd91c6625892 None admin] RBAC: Authorization granted {{(pid=82026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:41:07.009034 dv-cinder-828806-6-smb devstack@keystone.service[82026]: [pid: 82026|app: 0|req: 103/204] 10.222.0.33 () {56 vars in 1186 bytes} [Tue Sep 13 19:41:06 2022] GET /identity/v3/projects/bee3101ec8f84efa9f84a402c3c3cbbe => generated 302 bytes in 282 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 19:41:07.015309 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aae6a4fb-85b0-46d3-b874-dd91c6625892 None admin] Authenticating user token {{(pid=82026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:41:07.081545 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f64353f7-d7e6-46ff-9799-fcecf98926d6 None admin] Validating token access rules against request {{(pid=82025) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:41:07.141642 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a14e029-fa4a-4aca-b4f6-547998d23d95 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57539b6a6f3b4d589f5f5e1d211cd6a0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82025) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:41:07.143502 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a14e029-fa4a-4aca-b4f6-547998d23d95 None admin] REQUEST_METHOD: `GET` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:41:07.143789 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a14e029-fa4a-4aca-b4f6-547998d23d95 None admin] SCRIPT_NAME: `/identity` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:41:07.144066 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a14e029-fa4a-4aca-b4f6-547998d23d95 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:41:07.166627 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aae6a4fb-85b0-46d3-b874-dd91c6625892 None admin] Validating token access rules against request {{(pid=82026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:41:07.225592 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a63cfcc8-79ba-4daf-bdec-d3594499e5f0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57539b6a6f3b4d589f5f5e1d211cd6a0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:41:07.225592 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a63cfcc8-79ba-4daf-bdec-d3594499e5f0 None admin] REQUEST_METHOD: `GET` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:41:07.225850 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a63cfcc8-79ba-4daf-bdec-d3594499e5f0 None admin] SCRIPT_NAME: `/identity` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:41:07.225935 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a63cfcc8-79ba-4daf-bdec-d3594499e5f0 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:41:07.226629 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a63cfcc8-79ba-4daf-bdec-d3594499e5f0 None admin] RBAC: Adding query filter params (role.id=e5af7d5baa93469e9e486ef21c85474e, scope.project.id=bee3101ec8f84efa9f84a402c3c3cbbe, user.id=66dd5274b2434c7b86e70e4c95589707) {{(pid=82026) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 19:41:07.226949 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a63cfcc8-79ba-4daf-bdec-d3594499e5f0 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=82026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:41:07.231721 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a63cfcc8-79ba-4daf-bdec-d3594499e5f0 None admin] RBAC: Authorization granted {{(pid=82026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:41:07.247512 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG dbcounter [-] [82026] Writing DB stats keystone:SELECT=100 {{(pid=82026) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:41:07.254337 dv-cinder-828806-6-smb devstack@keystone.service[82026]: [pid: 82026|app: 0|req: 104/205] 10.222.0.33 () {56 vars in 1374 bytes} [Tue Sep 13 19:41:07 2022] GET /identity/v3/role_assignments?user.id=66dd5274b2434c7b86e70e4c95589707&scope.project.id=bee3101ec8f84efa9f84a402c3c3cbbe&role.id=e5af7d5baa93469e9e486ef21c85474e => generated 259 bytes in 239 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 19:41:07.267430 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG dbcounter [-] [82025] Writing DB stats keystone:SELECT=100 {{(pid=82025) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:41:07.272250 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a14e029-fa4a-4aca-b4f6-547998d23d95 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=82025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:41:07.273841 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a14e029-fa4a-4aca-b4f6-547998d23d95 None admin] RBAC: Authorization granted {{(pid=82025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:41:07.386320 dv-cinder-828806-6-smb devstack@keystone.service[82025]: [pid: 82025|app: 0|req: 102/206] 10.222.0.33 () {58 vars in 1282 bytes} [Tue Sep 13 19:41:06 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 428 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Sep 13 19:41:07.392076 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a63cfcc8-79ba-4daf-bdec-d3594499e5f0 None admin] Authenticating user token {{(pid=82026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:41:07.552433 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a63cfcc8-79ba-4daf-bdec-d3594499e5f0 None admin] Validating token access rules against request {{(pid=82026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:41:07.596350 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4885434-ed60-4083-b58e-57372385fcb3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57539b6a6f3b4d589f5f5e1d211cd6a0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:41:07.596995 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4885434-ed60-4083-b58e-57372385fcb3 None admin] REQUEST_METHOD: `GET` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:41:07.597277 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4885434-ed60-4083-b58e-57372385fcb3 None admin] SCRIPT_NAME: `/identity` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:41:07.597557 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4885434-ed60-4083-b58e-57372385fcb3 None admin] PATH_INFO: `/v3/projects/7e18b3e4745c4afeaafeb826dc0445e0` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:41:07.598702 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4885434-ed60-4083-b58e-57372385fcb3 None admin] RBAC: Authorizing `identity:get_project(project_id=7e18b3e4745c4afeaafeb826dc0445e0)` {{(pid=82026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:41:07.600187 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4885434-ed60-4083-b58e-57372385fcb3 None admin] RBAC: Authorization granted {{(pid=82026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:41:07.602120 dv-cinder-828806-6-smb devstack@keystone.service[82026]: [pid: 82026|app: 0|req: 105/207] 10.222.0.33 () {56 vars in 1186 bytes} [Tue Sep 13 19:41:07 2022] GET /identity/v3/projects/7e18b3e4745c4afeaafeb826dc0445e0 => generated 298 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 19:41:07.608820 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a14e029-fa4a-4aca-b4f6-547998d23d95 None admin] Authenticating user token {{(pid=82025) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:41:07.737123 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG dbcounter [-] [82025] Writing DB stats keystone:SELECT=100 {{(pid=82025) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:41:07.743453 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a14e029-fa4a-4aca-b4f6-547998d23d95 None admin] Validating token access rules against request {{(pid=82025) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:41:07.778421 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf28e2c5-04f2-42eb-b9ad-b3afecf73a05 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57539b6a6f3b4d589f5f5e1d211cd6a0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82025) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:41:07.783835 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf28e2c5-04f2-42eb-b9ad-b3afecf73a05 None admin] REQUEST_METHOD: `GET` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:41:07.784129 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf28e2c5-04f2-42eb-b9ad-b3afecf73a05 None admin] SCRIPT_NAME: `/identity` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:41:07.784407 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf28e2c5-04f2-42eb-b9ad-b3afecf73a05 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:41:07.785193 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf28e2c5-04f2-42eb-b9ad-b3afecf73a05 None admin] RBAC: Adding query filter params (role.id=81338d9374bb480785c7d7aa54829af8, scope.project.id=7e18b3e4745c4afeaafeb826dc0445e0, user.id=91e2f1223d1143e7a8988b14dd8d3b1e) {{(pid=82025) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 19:41:07.785559 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf28e2c5-04f2-42eb-b9ad-b3afecf73a05 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=82025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:41:07.787018 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf28e2c5-04f2-42eb-b9ad-b3afecf73a05 None admin] RBAC: Authorization granted {{(pid=82025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:41:07.796411 dv-cinder-828806-6-smb devstack@keystone.service[82025]: [pid: 82025|app: 0|req: 103/208] 10.222.0.33 () {56 vars in 1374 bytes} [Tue Sep 13 19:41:07 2022] GET /identity/v3/role_assignments?user.id=91e2f1223d1143e7a8988b14dd8d3b1e&scope.project.id=7e18b3e4745c4afeaafeb826dc0445e0&role.id=81338d9374bb480785c7d7aa54829af8 => generated 608 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 19:41:08.926048 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9a964aa-ca35-4236-aba6-1853e2e2a487 None None] REQUEST_METHOD: `GET` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:41:08.926569 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9a964aa-ca35-4236-aba6-1853e2e2a487 None None] SCRIPT_NAME: `/identity` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:41:08.926569 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9a964aa-ca35-4236-aba6-1853e2e2a487 None None] PATH_INFO: `/` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:41:08.927968 dv-cinder-828806-6-smb devstack@keystone.service[82026]: [pid: 82026|app: 0|req: 106/209] 10.222.0.33 () {54 vars in 927 bytes} [Tue Sep 13 19:41:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 19:41:08.933294 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ac856e0-583f-4c71-adde-8686ec7f515c None None] REQUEST_METHOD: `POST` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:41:08.933705 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ac856e0-583f-4c71-adde-8686ec7f515c None None] SCRIPT_NAME: `/identity` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:41:08.933877 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ac856e0-583f-4c71-adde-8686ec7f515c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:41:08.952778 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.auth.core [None req-1ac856e0-583f-4c71-adde-8686ec7f515c None None] MFA Rules not processed for user `57539b6a6f3b4d589f5f5e1d211cd6a0`. Rule list: `[]` (Enabled: `True`). {{(pid=82025) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 19:41:08.953962 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.fernet_utils [None req-1ac856e0-583f-4c71-adde-8686ec7f515c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82025) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 19:41:08.965978 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2588bdbb-cdd3-4061-b9b5-9b8295a4e53e None None] REQUEST_METHOD: `GET` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:41:08.966266 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2588bdbb-cdd3-4061-b9b5-9b8295a4e53e None None] SCRIPT_NAME: `/identity` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:41:08.967121 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2588bdbb-cdd3-4061-b9b5-9b8295a4e53e None None] PATH_INFO: `/` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:41:08.968704 dv-cinder-828806-6-smb devstack@keystone.service[82026]: [pid: 82026|app: 0|req: 107/210] 10.222.0.33 () {54 vars in 927 bytes} [Tue Sep 13 19:41:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 19:41:08.974840 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bb8398f-b1ea-4b1e-baba-38334bc03e8a None None] REQUEST_METHOD: `POST` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:41:08.975167 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bb8398f-b1ea-4b1e-baba-38334bc03e8a None None] SCRIPT_NAME: `/identity` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:41:08.975443 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bb8398f-b1ea-4b1e-baba-38334bc03e8a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:41:08.995081 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.auth.core [None req-5bb8398f-b1ea-4b1e-baba-38334bc03e8a None None] MFA Rules not processed for user `57539b6a6f3b4d589f5f5e1d211cd6a0`. Rule list: `[]` (Enabled: `True`). {{(pid=82026) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 19:41:08.996276 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.common.fernet_utils [None req-5bb8398f-b1ea-4b1e-baba-38334bc03e8a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82026) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 19:41:09.036832 dv-cinder-828806-6-smb devstack@keystone.service[82025]: [pid: 82025|app: 0|req: 104/211] 10.222.0.33 () {58 vars in 1024 bytes} [Tue Sep 13 19:41:08 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 13 19:41:09.064885 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG dbcounter [-] [82026] Writing DB stats keystone:SELECT=100 {{(pid=82026) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:41:09.074352 dv-cinder-828806-6-smb devstack@keystone.service[82026]: [pid: 82026|app: 0|req: 108/212] 10.222.0.33 () {58 vars in 1024 bytes} [Tue Sep 13 19:41:08 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 13 19:41:09.304843 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69281762-4352-42c0-811f-d220ff53f349 None None] REQUEST_METHOD: `GET` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:41:09.305435 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69281762-4352-42c0-811f-d220ff53f349 None None] SCRIPT_NAME: `/identity` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:41:09.305934 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69281762-4352-42c0-811f-d220ff53f349 None None] PATH_INFO: `/` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:41:09.307522 dv-cinder-828806-6-smb devstack@keystone.service[82025]: [pid: 82025|app: 0|req: 105/213] 10.222.0.33 () {54 vars in 927 bytes} [Tue Sep 13 19:41:09 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 19:41:09.312820 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdfd5c0c-b8ca-4153-9f0d-b6af8c7e0f79 None None] REQUEST_METHOD: `POST` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:41:09.313110 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdfd5c0c-b8ca-4153-9f0d-b6af8c7e0f79 None None] SCRIPT_NAME: `/identity` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:41:09.313636 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdfd5c0c-b8ca-4153-9f0d-b6af8c7e0f79 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:41:09.317999 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69281762-4352-42c0-811f-d220ff53f349 None None] Authenticating user token {{(pid=82025) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:41:09.333514 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.auth.core [None req-cdfd5c0c-b8ca-4153-9f0d-b6af8c7e0f79 None None] MFA Rules not processed for user `57539b6a6f3b4d589f5f5e1d211cd6a0`. Rule list: `[]` (Enabled: `True`). {{(pid=82026) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 19:41:09.335122 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.common.fernet_utils [None req-cdfd5c0c-b8ca-4153-9f0d-b6af8c7e0f79 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82026) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 19:41:09.409342 dv-cinder-828806-6-smb devstack@keystone.service[82026]: [pid: 82026|app: 0|req: 109/214] 10.222.0.33 () {58 vars in 1024 bytes} [Tue Sep 13 19:41:09 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 13 19:41:09.410556 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdfd5c0c-b8ca-4153-9f0d-b6af8c7e0f79 None None] Authenticating user token {{(pid=82026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:41:09.430099 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG dbcounter [-] [82025] Writing DB stats keystone:SELECT=100 {{(pid=82025) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:41:09.441174 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69281762-4352-42c0-811f-d220ff53f349 None None] Validating token access rules against request {{(pid=82025) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:41:09.479649 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0335f4b-426e-4c5d-b796-8801f74af63a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57539b6a6f3b4d589f5f5e1d211cd6a0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82025) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:41:09.480511 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0335f4b-426e-4c5d-b796-8801f74af63a None admin] REQUEST_METHOD: `GET` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:41:09.480943 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0335f4b-426e-4c5d-b796-8801f74af63a None admin] SCRIPT_NAME: `/identity` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:41:09.481361 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0335f4b-426e-4c5d-b796-8801f74af63a None admin] PATH_INFO: `/v3/roles/member` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:41:09.493273 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0335f4b-426e-4c5d-b796-8801f74af63a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=82025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 13 19:41:09.499539 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application [None req-f0335f4b-426e-4c5d-b796-8801f74af63a None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 13 19:41:09.499539 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 19:41:09.499539 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 19:41:09.499539 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 19:41:09.499539 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 19:41:09.499539 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 19:41:09.499539 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 19:41:09.499539 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 19:41:09.499539 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 19:41:09.499539 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 19:41:09.499539 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 19:41:09.499539 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 19:41:09.499539 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 13 19:41:09.499539 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 13 19:41:09.499539 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 13 19:41:09.499539 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 13 19:41:09.500599 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 13 19:41:09.500599 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 13 19:41:09.500599 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 13 19:41:09.500599 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 13 19:41:09.500599 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 19:41:09.500599 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 19:41:09.500599 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 19:41:09.500599 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 19:41:09.500599 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 19:41:09.500599 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 19:41:09.500599 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 19:41:09.500599 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application with Lock( Sep 13 19:41:09.500599 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 19:41:09.500599 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application return self._enter() Sep 13 19:41:09.500599 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 19:41:09.500599 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 19:41:09.501555 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 19:41:09.501555 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application return self.creator() Sep 13 19:41:09.501555 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 19:41:09.501555 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application created_value = creator( Sep 13 19:41:09.501555 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 13 19:41:09.501555 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 13 19:41:09.501555 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 13 19:41:09.501555 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 13 19:41:09.501555 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 13 19:41:09.501555 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 13 19:41:09.501555 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 13 19:41:09.501555 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application Sep 13 19:41:09.503620 dv-cinder-828806-6-smb devstack@keystone.service[82025]: [pid: 82025|app: 0|req: 106/215] 10.222.0.33 () {56 vars in 1099 bytes} [Tue Sep 13 19:41:09 2022] GET /identity/v3/roles/member => generated 84 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 13 19:41:09.513059 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0335f4b-426e-4c5d-b796-8801f74af63a None admin] Authenticating user token {{(pid=82025) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:41:09.519382 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdfd5c0c-b8ca-4153-9f0d-b6af8c7e0f79 None None] Validating token access rules against request {{(pid=82026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:41:09.545682 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG dbcounter [-] [82026] Writing DB stats keystone:SELECT=100 {{(pid=82026) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:41:09.556776 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99968657-6c74-4e3a-81f2-4dc38c8638ee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57539b6a6f3b4d589f5f5e1d211cd6a0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:41:09.557431 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99968657-6c74-4e3a-81f2-4dc38c8638ee None admin] REQUEST_METHOD: `GET` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:41:09.562048 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99968657-6c74-4e3a-81f2-4dc38c8638ee None admin] SCRIPT_NAME: `/identity` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:41:09.562048 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99968657-6c74-4e3a-81f2-4dc38c8638ee None admin] PATH_INFO: `/v3/domains/default` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:41:09.562048 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99968657-6c74-4e3a-81f2-4dc38c8638ee None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=82026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:41:09.562048 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99968657-6c74-4e3a-81f2-4dc38c8638ee None admin] RBAC: Authorization granted {{(pid=82026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:41:09.563026 dv-cinder-828806-6-smb devstack@keystone.service[82026]: [pid: 82026|app: 0|req: 110/216] 10.222.0.33 () {56 vars in 1108 bytes} [Tue Sep 13 19:41:09 2022] GET /identity/v3/domains/default => generated 199 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 19:41:09.569102 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99968657-6c74-4e3a-81f2-4dc38c8638ee None admin] Authenticating user token {{(pid=82026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:41:09.627286 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0335f4b-426e-4c5d-b796-8801f74af63a None admin] Validating token access rules against request {{(pid=82025) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:41:09.664827 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-237206b9-6f93-415b-91b1-0320ade7f04a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57539b6a6f3b4d589f5f5e1d211cd6a0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82025) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:41:09.665919 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-237206b9-6f93-415b-91b1-0320ade7f04a None admin] REQUEST_METHOD: `GET` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:41:09.666376 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-237206b9-6f93-415b-91b1-0320ade7f04a None admin] SCRIPT_NAME: `/identity` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:41:09.666822 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-237206b9-6f93-415b-91b1-0320ade7f04a None admin] PATH_INFO: `/v3/roles` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:41:09.667696 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-237206b9-6f93-415b-91b1-0320ade7f04a None admin] RBAC: Adding query filter params (name=member) {{(pid=82025) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 19:41:09.668191 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-237206b9-6f93-415b-91b1-0320ade7f04a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:41:09.669966 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-237206b9-6f93-415b-91b1-0320ade7f04a None admin] RBAC: Authorization granted {{(pid=82025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:41:09.685257 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99968657-6c74-4e3a-81f2-4dc38c8638ee None admin] Validating token access rules against request {{(pid=82026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:41:09.686557 dv-cinder-828806-6-smb devstack@keystone.service[82025]: [pid: 82025|app: 0|req: 107/217] 10.222.0.33 () {56 vars in 1101 bytes} [Tue Sep 13 19:41:09 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 19:41:09.687654 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-237206b9-6f93-415b-91b1-0320ade7f04a None admin] Authenticating user token {{(pid=82025) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:41:09.703527 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG dbcounter [-] [82025] Writing DB stats keystone:SELECT=100 {{(pid=82025) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:41:09.720093 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31925ec7-3147-451c-bc3c-8e019a921c9b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57539b6a6f3b4d589f5f5e1d211cd6a0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:41:09.720725 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31925ec7-3147-451c-bc3c-8e019a921c9b None admin] REQUEST_METHOD: `POST` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:41:09.721010 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31925ec7-3147-451c-bc3c-8e019a921c9b None admin] SCRIPT_NAME: `/identity` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:41:09.721283 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31925ec7-3147-451c-bc3c-8e019a921c9b None admin] PATH_INFO: `/v3/users` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:41:09.721941 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31925ec7-3147-451c-bc3c-8e019a921c9b None admin] RBAC: Authorizing `identity:create_user()` {{(pid=82026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:41:09.723411 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31925ec7-3147-451c-bc3c-8e019a921c9b None admin] RBAC: Authorization granted {{(pid=82026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:41:09.787354 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-237206b9-6f93-415b-91b1-0320ade7f04a None admin] Validating token access rules against request {{(pid=82025) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:41:09.820682 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30821f92-030d-4f11-b5bd-b65fec99aa4d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57539b6a6f3b4d589f5f5e1d211cd6a0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82025) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:41:09.821274 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30821f92-030d-4f11-b5bd-b65fec99aa4d None admin] REQUEST_METHOD: `GET` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:41:09.821603 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30821f92-030d-4f11-b5bd-b65fec99aa4d None admin] SCRIPT_NAME: `/identity` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:41:09.821861 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30821f92-030d-4f11-b5bd-b65fec99aa4d None admin] PATH_INFO: `/v3/users/b6daa41d0b264085be0c1f37ff2d29e0` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:41:09.823659 dv-cinder-828806-6-smb devstack@keystone.service[82026]: [pid: 82026|app: 0|req: 111/218] 10.222.0.33 () {60 vars in 1132 bytes} [Tue Sep 13 19:41:09 2022] POST /identity/v3/users => generated 297 bytes in 255 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 13 19:41:09.824337 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31925ec7-3147-451c-bc3c-8e019a921c9b None admin] Authenticating user token {{(pid=82026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:41:09.851141 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30821f92-030d-4f11-b5bd-b65fec99aa4d None admin] RBAC: Authorizing `identity:get_user(user_id=b6daa41d0b264085be0c1f37ff2d29e0)` {{(pid=82025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:41:09.852805 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30821f92-030d-4f11-b5bd-b65fec99aa4d None admin] RBAC: Authorization granted {{(pid=82025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:41:09.854661 dv-cinder-828806-6-smb devstack@keystone.service[82025]: [pid: 82025|app: 0|req: 108/219] 10.222.0.33 () {56 vars in 1177 bytes} [Tue Sep 13 19:41:09 2022] GET /identity/v3/users/b6daa41d0b264085be0c1f37ff2d29e0 => generated 297 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 19:41:09.855904 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6007c38d-1613-49e8-968b-749927fe9087 None None] REQUEST_METHOD: `GET` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:41:09.856189 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6007c38d-1613-49e8-968b-749927fe9087 None None] SCRIPT_NAME: `/identity` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:41:09.856461 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6007c38d-1613-49e8-968b-749927fe9087 None None] PATH_INFO: `/` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:41:09.858335 dv-cinder-828806-6-smb devstack@keystone.service[82025]: [pid: 82025|app: 0|req: 109/220] 10.222.0.33 () {54 vars in 927 bytes} [Tue Sep 13 19:41:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 19:41:09.862614 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6007c38d-1613-49e8-968b-749927fe9087 None None] Authenticating user token {{(pid=82025) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:41:09.890201 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG dbcounter [-] [82026] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=82026) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:41:09.943800 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG dbcounter [-] [82025] Writing DB stats keystone:SELECT=100 {{(pid=82025) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:41:09.950182 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31925ec7-3147-451c-bc3c-8e019a921c9b None admin] Validating token access rules against request {{(pid=82026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:41:09.980359 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6007c38d-1613-49e8-968b-749927fe9087 None None] Validating token access rules against request {{(pid=82025) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:41:09.989385 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce327e95-ab68-4da1-88a6-d32468840127 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57539b6a6f3b4d589f5f5e1d211cd6a0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:41:09.990047 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce327e95-ab68-4da1-88a6-d32468840127 None admin] REQUEST_METHOD: `GET` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:41:09.990333 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce327e95-ab68-4da1-88a6-d32468840127 None admin] SCRIPT_NAME: `/identity` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:41:09.990622 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce327e95-ab68-4da1-88a6-d32468840127 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:41:10.002198 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce327e95-ab68-4da1-88a6-d32468840127 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=82026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 13 19:41:10.007918 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application [None req-ce327e95-ab68-4da1-88a6-d32468840127 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 13 19:41:10.007918 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 19:41:10.007918 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 19:41:10.007918 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 19:41:10.007918 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 19:41:10.007918 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 19:41:10.007918 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 19:41:10.007918 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 19:41:10.007918 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 19:41:10.007918 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 19:41:10.007918 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 19:41:10.007918 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 19:41:10.007918 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 13 19:41:10.007918 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 13 19:41:10.007918 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 13 19:41:10.007918 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 13 19:41:10.008860 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 13 19:41:10.008860 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 13 19:41:10.008860 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 13 19:41:10.008860 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 13 19:41:10.008860 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 19:41:10.008860 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 19:41:10.008860 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 19:41:10.008860 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 19:41:10.008860 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 19:41:10.008860 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 19:41:10.008860 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 19:41:10.008860 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application with Lock( Sep 13 19:41:10.008860 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 19:41:10.008860 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application return self._enter() Sep 13 19:41:10.008860 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 19:41:10.008860 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 19:41:10.009702 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 19:41:10.009702 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application return self.creator() Sep 13 19:41:10.009702 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 19:41:10.009702 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application created_value = creator( Sep 13 19:41:10.009702 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 13 19:41:10.009702 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 13 19:41:10.009702 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 13 19:41:10.009702 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 13 19:41:10.009702 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 13 19:41:10.009702 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 13 19:41:10.009702 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 13 19:41:10.009702 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application Sep 13 19:41:10.009702 dv-cinder-828806-6-smb devstack@keystone.service[82026]: [pid: 82026|app: 0|req: 112/221] 10.222.0.33 () {56 vars in 1114 bytes} [Tue Sep 13 19:41:09 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 19:41:10.010363 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-927a46ac-ad12-4a42-a597-3af4334bc984 None None] REQUEST_METHOD: `POST` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:41:10.010363 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-927a46ac-ad12-4a42-a597-3af4334bc984 None None] SCRIPT_NAME: `/identity` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:41:10.010487 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-927a46ac-ad12-4a42-a597-3af4334bc984 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:41:10.022534 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a255a06f-c4fa-47b9-a643-b454c6827b2c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57539b6a6f3b4d589f5f5e1d211cd6a0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82025) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:41:10.023711 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a255a06f-c4fa-47b9-a643-b454c6827b2c None admin] REQUEST_METHOD: `GET` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:41:10.023711 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a255a06f-c4fa-47b9-a643-b454c6827b2c None admin] SCRIPT_NAME: `/identity` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:41:10.023874 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a255a06f-c4fa-47b9-a643-b454c6827b2c None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:41:10.034373 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.auth.core [None req-927a46ac-ad12-4a42-a597-3af4334bc984 None None] MFA Rules not processed for user `57539b6a6f3b4d589f5f5e1d211cd6a0`. Rule list: `[]` (Enabled: `True`). {{(pid=82026) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 19:41:10.036002 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.common.fernet_utils [None req-927a46ac-ad12-4a42-a597-3af4334bc984 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82026) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 19:41:10.116280 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a255a06f-c4fa-47b9-a643-b454c6827b2c None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=82025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:41:10.117685 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a255a06f-c4fa-47b9-a643-b454c6827b2c None admin] RBAC: Authorization granted {{(pid=82025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:41:10.120424 dv-cinder-828806-6-smb devstack@keystone.service[82026]: [pid: 82026|app: 0|req: 113/222] 10.222.0.33 () {58 vars in 1024 bytes} [Tue Sep 13 19:41:10 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 13 19:41:10.121292 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-927a46ac-ad12-4a42-a597-3af4334bc984 None None] Authenticating user token {{(pid=82026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:41:10.170964 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG dbcounter [-] [82026] Writing DB stats keystone:SELECT=100 {{(pid=82026) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:41:10.217855 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG dbcounter [-] [82025] Writing DB stats keystone:SELECT=100 {{(pid=82025) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:41:10.246084 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-927a46ac-ad12-4a42-a597-3af4334bc984 None None] Validating token access rules against request {{(pid=82026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:41:10.257419 dv-cinder-828806-6-smb devstack@keystone.service[82025]: [pid: 82025|app: 0|req: 110/223] 10.222.0.33 () {58 vars in 1282 bytes} [Tue Sep 13 19:41:09 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 397 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Sep 13 19:41:10.263101 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a255a06f-c4fa-47b9-a643-b454c6827b2c None admin] Authenticating user token {{(pid=82025) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:41:10.288499 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-237f6c06-91e9-470a-b40e-79661ca7ccc7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57539b6a6f3b4d589f5f5e1d211cd6a0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:41:10.289392 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-237f6c06-91e9-470a-b40e-79661ca7ccc7 None admin] REQUEST_METHOD: `GET` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:41:10.289816 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-237f6c06-91e9-470a-b40e-79661ca7ccc7 None admin] SCRIPT_NAME: `/identity` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:41:10.290243 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-237f6c06-91e9-470a-b40e-79661ca7ccc7 None admin] PATH_INFO: `/v3/roles` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:41:10.291079 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-237f6c06-91e9-470a-b40e-79661ca7ccc7 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=82026) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 19:41:10.291619 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-237f6c06-91e9-470a-b40e-79661ca7ccc7 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:41:10.295308 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-237f6c06-91e9-470a-b40e-79661ca7ccc7 None admin] RBAC: Authorization granted {{(pid=82026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:41:10.303051 dv-cinder-828806-6-smb devstack@keystone.service[82026]: [pid: 82026|app: 0|req: 114/224] 10.222.0.33 () {56 vars in 1111 bytes} [Tue Sep 13 19:41:10 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 19:41:10.312000 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-237f6c06-91e9-470a-b40e-79661ca7ccc7 None admin] Authenticating user token {{(pid=82026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:41:10.454345 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a255a06f-c4fa-47b9-a643-b454c6827b2c None admin] Validating token access rules against request {{(pid=82025) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:41:10.494577 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG dbcounter [-] [82026] Writing DB stats keystone:SELECT=100 {{(pid=82026) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:41:10.497711 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-237f6c06-91e9-470a-b40e-79661ca7ccc7 None admin] Validating token access rules against request {{(pid=82026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:41:10.500564 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be140813-bc27-4946-b4c5-c008168a9da9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57539b6a6f3b4d589f5f5e1d211cd6a0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82025) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:41:10.501261 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be140813-bc27-4946-b4c5-c008168a9da9 None admin] REQUEST_METHOD: `GET` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:41:10.501552 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be140813-bc27-4946-b4c5-c008168a9da9 None admin] SCRIPT_NAME: `/identity` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:41:10.501832 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be140813-bc27-4946-b4c5-c008168a9da9 None admin] PATH_INFO: `/v3/projects/bee3101ec8f84efa9f84a402c3c3cbbe` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:41:10.505600 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be140813-bc27-4946-b4c5-c008168a9da9 None admin] RBAC: Authorizing `identity:get_project(project_id=bee3101ec8f84efa9f84a402c3c3cbbe)` {{(pid=82025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:41:10.507159 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be140813-bc27-4946-b4c5-c008168a9da9 None admin] RBAC: Authorization granted {{(pid=82025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:41:10.511102 dv-cinder-828806-6-smb devstack@keystone.service[82025]: [pid: 82025|app: 0|req: 111/225] 10.222.0.33 () {56 vars in 1186 bytes} [Tue Sep 13 19:41:10 2022] GET /identity/v3/projects/bee3101ec8f84efa9f84a402c3c3cbbe => generated 302 bytes in 246 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 19:41:10.515109 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be140813-bc27-4946-b4c5-c008168a9da9 None admin] Authenticating user token {{(pid=82025) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:41:10.539021 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-883995c2-557d-4491-b091-85cd9aae9756 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57539b6a6f3b4d589f5f5e1d211cd6a0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:41:10.539680 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-883995c2-557d-4491-b091-85cd9aae9756 None admin] REQUEST_METHOD: `GET` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:41:10.539962 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-883995c2-557d-4491-b091-85cd9aae9756 None admin] SCRIPT_NAME: `/identity` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:41:10.540235 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-883995c2-557d-4491-b091-85cd9aae9756 None admin] PATH_INFO: `/v3/users/66dd5274b2434c7b86e70e4c95589707` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:41:10.541532 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-883995c2-557d-4491-b091-85cd9aae9756 None admin] RBAC: Authorizing `identity:get_user(user_id=66dd5274b2434c7b86e70e4c95589707)` {{(pid=82026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:41:10.542983 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-883995c2-557d-4491-b091-85cd9aae9756 None admin] RBAC: Authorization granted {{(pid=82026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:41:10.546601 dv-cinder-828806-6-smb devstack@keystone.service[82026]: [pid: 82026|app: 0|req: 115/226] 10.222.0.33 () {56 vars in 1177 bytes} [Tue Sep 13 19:41:10 2022] GET /identity/v3/users/66dd5274b2434c7b86e70e4c95589707 => generated 283 bytes in 235 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 19:41:10.548272 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-883995c2-557d-4491-b091-85cd9aae9756 None admin] Authenticating user token {{(pid=82026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:41:10.570451 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG dbcounter [-] [82025] Writing DB stats keystone:SELECT=100 {{(pid=82025) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:41:10.640455 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be140813-bc27-4946-b4c5-c008168a9da9 None admin] Validating token access rules against request {{(pid=82025) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:41:10.679737 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75bc7ead-44a7-4757-9532-af7c8412e543 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57539b6a6f3b4d589f5f5e1d211cd6a0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82025) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:41:10.680663 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75bc7ead-44a7-4757-9532-af7c8412e543 None admin] REQUEST_METHOD: `GET` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:41:10.680820 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-883995c2-557d-4491-b091-85cd9aae9756 None admin] Validating token access rules against request {{(pid=82026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:41:10.681266 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75bc7ead-44a7-4757-9532-af7c8412e543 None admin] SCRIPT_NAME: `/identity` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:41:10.681721 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75bc7ead-44a7-4757-9532-af7c8412e543 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:41:10.682725 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75bc7ead-44a7-4757-9532-af7c8412e543 None admin] RBAC: Adding query filter params (role.id=3618ab638a65401f82333da7596d1daf, scope.project.id=bee3101ec8f84efa9f84a402c3c3cbbe, user.id=b6daa41d0b264085be0c1f37ff2d29e0) {{(pid=82025) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 19:41:10.683329 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75bc7ead-44a7-4757-9532-af7c8412e543 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=82025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:41:10.685032 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75bc7ead-44a7-4757-9532-af7c8412e543 None admin] RBAC: Authorization granted {{(pid=82025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:41:10.691016 dv-cinder-828806-6-smb devstack@keystone.service[82025]: [pid: 82025|app: 0|req: 112/227] 10.222.0.33 () {56 vars in 1374 bytes} [Tue Sep 13 19:41:10 2022] GET /identity/v3/role_assignments?user.id=b6daa41d0b264085be0c1f37ff2d29e0&scope.project.id=bee3101ec8f84efa9f84a402c3c3cbbe&role.id=3618ab638a65401f82333da7596d1daf => generated 259 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 13 19:41:10.692170 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75bc7ead-44a7-4757-9532-af7c8412e543 None admin] Authenticating user token {{(pid=82025) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:41:10.755391 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5c0b1dd-9bd2-4c56-a84d-86d97c356e25 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57539b6a6f3b4d589f5f5e1d211cd6a0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:41:10.756420 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5c0b1dd-9bd2-4c56-a84d-86d97c356e25 None admin] REQUEST_METHOD: `GET` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:41:10.756901 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5c0b1dd-9bd2-4c56-a84d-86d97c356e25 None admin] SCRIPT_NAME: `/identity` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:41:10.757372 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5c0b1dd-9bd2-4c56-a84d-86d97c356e25 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:41:10.783001 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5c0b1dd-9bd2-4c56-a84d-86d97c356e25 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=82026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 13 19:41:10.789555 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application [None req-c5c0b1dd-9bd2-4c56-a84d-86d97c356e25 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 13 19:41:10.789555 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 19:41:10.789555 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 19:41:10.789555 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 19:41:10.789555 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 19:41:10.789555 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 19:41:10.789555 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 19:41:10.789555 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 19:41:10.789555 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 19:41:10.789555 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 19:41:10.789555 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 19:41:10.789555 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 19:41:10.789555 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 13 19:41:10.789555 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 13 19:41:10.789555 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 13 19:41:10.789555 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 13 19:41:10.790445 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 13 19:41:10.790445 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 13 19:41:10.790445 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 13 19:41:10.790445 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 13 19:41:10.790445 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 19:41:10.790445 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 19:41:10.790445 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 19:41:10.790445 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 19:41:10.790445 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 19:41:10.790445 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 19:41:10.790445 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 19:41:10.790445 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application with Lock( Sep 13 19:41:10.790445 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 19:41:10.790445 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application return self._enter() Sep 13 19:41:10.790445 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 19:41:10.790445 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 19:41:10.791728 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 19:41:10.791728 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application return self.creator() Sep 13 19:41:10.791728 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 19:41:10.791728 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application created_value = creator( Sep 13 19:41:10.791728 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 13 19:41:10.791728 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 13 19:41:10.791728 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 13 19:41:10.791728 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 13 19:41:10.791728 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 13 19:41:10.791728 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 13 19:41:10.791728 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 13 19:41:10.791728 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application Sep 13 19:41:10.791728 dv-cinder-828806-6-smb devstack@keystone.service[82026]: [pid: 82026|app: 0|req: 116/228] 10.222.0.33 () {56 vars in 1096 bytes} [Tue Sep 13 19:41:10 2022] GET /identity/v3/roles/admin => generated 83 bytes in 243 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 19:41:10.800283 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5c0b1dd-9bd2-4c56-a84d-86d97c356e25 None admin] Authenticating user token {{(pid=82026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:41:10.835214 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG dbcounter [-] [82026] Writing DB stats keystone:SELECT=100 {{(pid=82026) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:41:10.917570 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75bc7ead-44a7-4757-9532-af7c8412e543 None admin] Validating token access rules against request {{(pid=82025) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:41:10.924498 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG dbcounter [-] [82025] Writing DB stats keystone:SELECT=100 {{(pid=82025) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:41:10.976874 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8124b9cf-e9c7-4c05-b0c6-7a5e3f2cb5ea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57539b6a6f3b4d589f5f5e1d211cd6a0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82025) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:41:10.977516 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8124b9cf-e9c7-4c05-b0c6-7a5e3f2cb5ea None admin] REQUEST_METHOD: `GET` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:41:10.977790 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8124b9cf-e9c7-4c05-b0c6-7a5e3f2cb5ea None admin] SCRIPT_NAME: `/identity` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:41:10.978070 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8124b9cf-e9c7-4c05-b0c6-7a5e3f2cb5ea None admin] PATH_INFO: `/v3/projects/bee3101ec8f84efa9f84a402c3c3cbbe` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:41:10.979261 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8124b9cf-e9c7-4c05-b0c6-7a5e3f2cb5ea None admin] RBAC: Authorizing `identity:get_project(project_id=bee3101ec8f84efa9f84a402c3c3cbbe)` {{(pid=82025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:41:10.980218 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5c0b1dd-9bd2-4c56-a84d-86d97c356e25 None admin] Validating token access rules against request {{(pid=82026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:41:10.980734 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8124b9cf-e9c7-4c05-b0c6-7a5e3f2cb5ea None admin] RBAC: Authorization granted {{(pid=82025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:41:10.983058 dv-cinder-828806-6-smb devstack@keystone.service[82025]: [pid: 82025|app: 0|req: 113/229] 10.222.0.33 () {56 vars in 1186 bytes} [Tue Sep 13 19:41:10 2022] GET /identity/v3/projects/bee3101ec8f84efa9f84a402c3c3cbbe => generated 302 bytes in 291 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 19:41:10.989093 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8124b9cf-e9c7-4c05-b0c6-7a5e3f2cb5ea None admin] Authenticating user token {{(pid=82025) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:41:11.046542 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad729990-4820-4c8c-aff5-7c721efb8bab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57539b6a6f3b4d589f5f5e1d211cd6a0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:41:11.047585 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad729990-4820-4c8c-aff5-7c721efb8bab None admin] REQUEST_METHOD: `GET` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:41:11.048077 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad729990-4820-4c8c-aff5-7c721efb8bab None admin] SCRIPT_NAME: `/identity` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:41:11.049116 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad729990-4820-4c8c-aff5-7c721efb8bab None admin] PATH_INFO: `/v3/roles` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:41:11.049983 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad729990-4820-4c8c-aff5-7c721efb8bab None admin] RBAC: Adding query filter params (name=admin) {{(pid=82026) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 19:41:11.050652 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad729990-4820-4c8c-aff5-7c721efb8bab None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:41:11.053645 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad729990-4820-4c8c-aff5-7c721efb8bab None admin] RBAC: Authorization granted {{(pid=82026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:41:11.071326 dv-cinder-828806-6-smb devstack@keystone.service[82026]: [pid: 82026|app: 0|req: 117/230] 10.222.0.33 () {56 vars in 1099 bytes} [Tue Sep 13 19:41:10 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 275 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 13 19:41:11.077879 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad729990-4820-4c8c-aff5-7c721efb8bab None admin] Authenticating user token {{(pid=82026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:41:11.177641 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8124b9cf-e9c7-4c05-b0c6-7a5e3f2cb5ea None admin] Validating token access rules against request {{(pid=82025) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:41:11.242739 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG dbcounter [-] [82026] Writing DB stats keystone:SELECT=100 {{(pid=82026) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:41:11.247437 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2311ace2-ee79-4949-9416-2834b611c73e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57539b6a6f3b4d589f5f5e1d211cd6a0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82025) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:41:11.248371 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2311ace2-ee79-4949-9416-2834b611c73e None admin] REQUEST_METHOD: `PUT` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:41:11.249025 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2311ace2-ee79-4949-9416-2834b611c73e None admin] SCRIPT_NAME: `/identity` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:41:11.249685 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2311ace2-ee79-4949-9416-2834b611c73e None admin] PATH_INFO: `/v3/projects/bee3101ec8f84efa9f84a402c3c3cbbe/users/66dd5274b2434c7b86e70e4c95589707/roles/6bcd095c76b341e186ea8caa11f5fa31` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:41:11.255066 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2311ace2-ee79-4949-9416-2834b611c73e None admin] RBAC: Authorizing `identity:create_grant(project_id=bee3101ec8f84efa9f84a402c3c3cbbe, user_id=66dd5274b2434c7b86e70e4c95589707, role_id=6bcd095c76b341e186ea8caa11f5fa31)` {{(pid=82025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:41:11.257744 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2311ace2-ee79-4949-9416-2834b611c73e None admin] RBAC: Authorization granted {{(pid=82025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:41:11.266998 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad729990-4820-4c8c-aff5-7c721efb8bab None admin] Validating token access rules against request {{(pid=82026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:41:11.306506 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcf0b249-b917-46d8-8b4a-c2e657d4cea0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57539b6a6f3b4d589f5f5e1d211cd6a0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:41:11.307735 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcf0b249-b917-46d8-8b4a-c2e657d4cea0 None admin] REQUEST_METHOD: `GET` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:41:11.308299 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcf0b249-b917-46d8-8b4a-c2e657d4cea0 None admin] SCRIPT_NAME: `/identity` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:41:11.308779 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcf0b249-b917-46d8-8b4a-c2e657d4cea0 None admin] PATH_INFO: `/v3/users/66dd5274b2434c7b86e70e4c95589707` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:41:11.310138 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcf0b249-b917-46d8-8b4a-c2e657d4cea0 None admin] RBAC: Authorizing `identity:get_user(user_id=66dd5274b2434c7b86e70e4c95589707)` {{(pid=82026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:41:11.311852 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcf0b249-b917-46d8-8b4a-c2e657d4cea0 None admin] RBAC: Authorization granted {{(pid=82026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:41:11.314308 dv-cinder-828806-6-smb devstack@keystone.service[82026]: [pid: 82026|app: 0|req: 118/231] 10.222.0.33 () {56 vars in 1177 bytes} [Tue Sep 13 19:41:11 2022] GET /identity/v3/users/66dd5274b2434c7b86e70e4c95589707 => generated 283 bytes in 237 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 13 19:41:11.319949 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcf0b249-b917-46d8-8b4a-c2e657d4cea0 None admin] Authenticating user token {{(pid=82026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:41:11.346132 dv-cinder-828806-6-smb devstack@keystone.service[82025]: [pid: 82025|app: 0|req: 114/232] 10.222.0.33 () {58 vars in 1439 bytes} [Tue Sep 13 19:41:10 2022] PUT /identity/v3/projects/bee3101ec8f84efa9f84a402c3c3cbbe/users/66dd5274b2434c7b86e70e4c95589707/roles/6bcd095c76b341e186ea8caa11f5fa31 => generated 0 bytes in 358 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 19:41:11.466109 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcf0b249-b917-46d8-8b4a-c2e657d4cea0 None admin] Validating token access rules against request {{(pid=82026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:41:11.510854 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4f0dba9-9f7d-4e0d-b404-b0958b21d2d9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57539b6a6f3b4d589f5f5e1d211cd6a0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:41:11.511594 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4f0dba9-9f7d-4e0d-b404-b0958b21d2d9 None admin] REQUEST_METHOD: `GET` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:41:11.511878 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4f0dba9-9f7d-4e0d-b404-b0958b21d2d9 None admin] SCRIPT_NAME: `/identity` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:41:11.512212 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4f0dba9-9f7d-4e0d-b404-b0958b21d2d9 None admin] PATH_INFO: `/v3/projects/bee3101ec8f84efa9f84a402c3c3cbbe` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:41:11.514256 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4f0dba9-9f7d-4e0d-b404-b0958b21d2d9 None admin] RBAC: Authorizing `identity:get_project(project_id=bee3101ec8f84efa9f84a402c3c3cbbe)` {{(pid=82026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:41:11.515949 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4f0dba9-9f7d-4e0d-b404-b0958b21d2d9 None admin] RBAC: Authorization granted {{(pid=82026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:41:11.518036 dv-cinder-828806-6-smb devstack@keystone.service[82026]: [pid: 82026|app: 0|req: 119/233] 10.222.0.33 () {56 vars in 1186 bytes} [Tue Sep 13 19:41:11 2022] GET /identity/v3/projects/bee3101ec8f84efa9f84a402c3c3cbbe => generated 302 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 19:41:11.528469 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2311ace2-ee79-4949-9416-2834b611c73e None admin] Authenticating user token {{(pid=82025) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:41:11.570729 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG dbcounter [-] [82025] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82025) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:41:11.673725 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2311ace2-ee79-4949-9416-2834b611c73e None admin] Validating token access rules against request {{(pid=82025) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:41:11.711391 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19ff72ae-9ec3-487d-9361-cb2e09c342d4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57539b6a6f3b4d589f5f5e1d211cd6a0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82025) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:41:11.712419 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19ff72ae-9ec3-487d-9361-cb2e09c342d4 None admin] REQUEST_METHOD: `PUT` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:41:11.712911 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19ff72ae-9ec3-487d-9361-cb2e09c342d4 None admin] SCRIPT_NAME: `/identity` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:41:11.713398 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19ff72ae-9ec3-487d-9361-cb2e09c342d4 None admin] PATH_INFO: `/v3/projects/bee3101ec8f84efa9f84a402c3c3cbbe/users/66dd5274b2434c7b86e70e4c95589707/roles/e5af7d5baa93469e9e486ef21c85474e` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:41:11.715592 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19ff72ae-9ec3-487d-9361-cb2e09c342d4 None admin] RBAC: Authorizing `identity:create_grant(project_id=bee3101ec8f84efa9f84a402c3c3cbbe, user_id=66dd5274b2434c7b86e70e4c95589707, role_id=e5af7d5baa93469e9e486ef21c85474e)` {{(pid=82025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:41:11.718561 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19ff72ae-9ec3-487d-9361-cb2e09c342d4 None admin] RBAC: Authorization granted {{(pid=82025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:41:11.833200 dv-cinder-828806-6-smb devstack@keystone.service[82025]: [pid: 82025|app: 0|req: 115/234] 10.222.0.33 () {58 vars in 1439 bytes} [Tue Sep 13 19:41:11 2022] PUT /identity/v3/projects/bee3101ec8f84efa9f84a402c3c3cbbe/users/66dd5274b2434c7b86e70e4c95589707/roles/e5af7d5baa93469e9e486ef21c85474e => generated 0 bytes in 305 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 19:41:12.475077 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc2bb4ee-75c1-4291-a215-97d9253572ef None None] REQUEST_METHOD: `GET` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:41:12.475603 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc2bb4ee-75c1-4291-a215-97d9253572ef None None] SCRIPT_NAME: `/identity` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:41:12.475684 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc2bb4ee-75c1-4291-a215-97d9253572ef None None] PATH_INFO: `/` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:41:12.477010 dv-cinder-828806-6-smb devstack@keystone.service[82026]: [pid: 82026|app: 0|req: 120/235] 10.222.0.33 () {54 vars in 927 bytes} [Tue Sep 13 19:41:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 19:41:12.492284 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3207eaf3-9031-4ac2-b90b-8da2b12520b3 None None] REQUEST_METHOD: `POST` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:41:12.493165 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3207eaf3-9031-4ac2-b90b-8da2b12520b3 None None] SCRIPT_NAME: `/identity` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:41:12.493673 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3207eaf3-9031-4ac2-b90b-8da2b12520b3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:41:12.520384 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.auth.core [None req-3207eaf3-9031-4ac2-b90b-8da2b12520b3 None None] MFA Rules not processed for user `57539b6a6f3b4d589f5f5e1d211cd6a0`. Rule list: `[]` (Enabled: `True`). {{(pid=82025) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 19:41:12.521993 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.fernet_utils [None req-3207eaf3-9031-4ac2-b90b-8da2b12520b3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82025) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 19:41:12.617452 dv-cinder-828806-6-smb devstack@keystone.service[82025]: [pid: 82025|app: 0|req: 116/236] 10.222.0.33 () {58 vars in 1024 bytes} [Tue Sep 13 19:41:12 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 13 19:41:12.663546 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ea0216d-3ebd-40a4-b1ce-2c7bbc15c130 None None] REQUEST_METHOD: `GET` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:41:12.663846 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ea0216d-3ebd-40a4-b1ce-2c7bbc15c130 None None] SCRIPT_NAME: `/identity` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:41:12.664122 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ea0216d-3ebd-40a4-b1ce-2c7bbc15c130 None None] PATH_INFO: `/` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:41:12.665730 dv-cinder-828806-6-smb devstack@keystone.service[82026]: [pid: 82026|app: 0|req: 121/237] 10.222.0.33 () {54 vars in 927 bytes} [Tue Sep 13 19:41:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 19:41:12.672701 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f33913a6-a4a8-4b7e-b70e-d8ca2fb9e170 None None] REQUEST_METHOD: `POST` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:41:12.673247 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f33913a6-a4a8-4b7e-b70e-d8ca2fb9e170 None None] SCRIPT_NAME: `/identity` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:41:12.673726 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f33913a6-a4a8-4b7e-b70e-d8ca2fb9e170 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:41:12.700942 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.auth.core [None req-f33913a6-a4a8-4b7e-b70e-d8ca2fb9e170 None None] MFA Rules not processed for user `57539b6a6f3b4d589f5f5e1d211cd6a0`. Rule list: `[]` (Enabled: `True`). {{(pid=82025) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 19:41:12.703765 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.fernet_utils [None req-f33913a6-a4a8-4b7e-b70e-d8ca2fb9e170 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82025) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 19:41:12.720321 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG dbcounter [-] [82025] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82025) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:41:12.787860 dv-cinder-828806-6-smb devstack@keystone.service[82025]: [pid: 82025|app: 0|req: 117/238] 10.222.0.33 () {58 vars in 1024 bytes} [Tue Sep 13 19:41:12 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 13 19:41:13.021627 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ea0216d-3ebd-40a4-b1ce-2c7bbc15c130 None None] Authenticating user token {{(pid=82026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:41:13.051175 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG dbcounter [-] [82026] Writing DB stats keystone:SELECT=100 {{(pid=82026) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:41:13.156706 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ea0216d-3ebd-40a4-b1ce-2c7bbc15c130 None None] Validating token access rules against request {{(pid=82026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:41:13.204923 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-672fa230-6fe0-460f-b305-b7152b6a71ac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57539b6a6f3b4d589f5f5e1d211cd6a0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:41:13.205596 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-672fa230-6fe0-460f-b305-b7152b6a71ac None admin] REQUEST_METHOD: `GET` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:41:13.205884 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-672fa230-6fe0-460f-b305-b7152b6a71ac None admin] SCRIPT_NAME: `/identity` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:41:13.206165 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-672fa230-6fe0-460f-b305-b7152b6a71ac None admin] PATH_INFO: `/v3/domains/default` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:41:13.207418 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-672fa230-6fe0-460f-b305-b7152b6a71ac None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=82026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:41:13.208945 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-672fa230-6fe0-460f-b305-b7152b6a71ac None admin] RBAC: Authorization granted {{(pid=82026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:41:13.210969 dv-cinder-828806-6-smb devstack@keystone.service[82026]: [pid: 82026|app: 0|req: 122/239] 10.222.0.33 () {56 vars in 1108 bytes} [Tue Sep 13 19:41:13 2022] GET /identity/v3/domains/default => generated 199 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 19:41:13.216815 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f33913a6-a4a8-4b7e-b70e-d8ca2fb9e170 None None] Authenticating user token {{(pid=82025) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:41:13.269852 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-672fa230-6fe0-460f-b305-b7152b6a71ac None admin] Authenticating user token {{(pid=82026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:41:13.389347 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f33913a6-a4a8-4b7e-b70e-d8ca2fb9e170 None None] Validating token access rules against request {{(pid=82025) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:41:13.418584 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG dbcounter [-] [82026] Writing DB stats keystone:SELECT=100 {{(pid=82026) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:41:13.427707 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-672fa230-6fe0-460f-b305-b7152b6a71ac None admin] Validating token access rules against request {{(pid=82026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:41:13.436653 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7154b45e-f04e-4dfb-b189-ec0f8aa98f8c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57539b6a6f3b4d589f5f5e1d211cd6a0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82025) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:41:13.437559 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7154b45e-f04e-4dfb-b189-ec0f8aa98f8c None admin] REQUEST_METHOD: `POST` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:41:13.438039 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7154b45e-f04e-4dfb-b189-ec0f8aa98f8c None admin] SCRIPT_NAME: `/identity` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:41:13.438535 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7154b45e-f04e-4dfb-b189-ec0f8aa98f8c None admin] PATH_INFO: `/v3/users` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:41:13.439493 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7154b45e-f04e-4dfb-b189-ec0f8aa98f8c None admin] RBAC: Authorizing `identity:create_user()` {{(pid=82025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:41:13.441130 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7154b45e-f04e-4dfb-b189-ec0f8aa98f8c None admin] RBAC: Authorization granted {{(pid=82025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:41:13.467312 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f211088-1a56-4fda-8087-1b61497acf89 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57539b6a6f3b4d589f5f5e1d211cd6a0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:41:13.467942 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f211088-1a56-4fda-8087-1b61497acf89 None admin] REQUEST_METHOD: `GET` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:41:13.468219 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f211088-1a56-4fda-8087-1b61497acf89 None admin] SCRIPT_NAME: `/identity` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:41:13.468644 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f211088-1a56-4fda-8087-1b61497acf89 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:41:13.479944 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f211088-1a56-4fda-8087-1b61497acf89 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=82026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 13 19:41:13.484967 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application [None req-5f211088-1a56-4fda-8087-1b61497acf89 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Sep 13 19:41:13.484967 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 19:41:13.484967 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 19:41:13.484967 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 19:41:13.484967 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 19:41:13.484967 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 19:41:13.484967 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 19:41:13.484967 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 19:41:13.484967 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 19:41:13.484967 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 19:41:13.484967 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 19:41:13.484967 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 19:41:13.484967 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 13 19:41:13.484967 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 13 19:41:13.484967 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 13 19:41:13.484967 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 13 19:41:13.485854 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 13 19:41:13.485854 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 13 19:41:13.485854 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 13 19:41:13.485854 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 13 19:41:13.485854 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 19:41:13.485854 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 19:41:13.485854 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 19:41:13.485854 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 19:41:13.485854 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 19:41:13.485854 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 19:41:13.485854 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 19:41:13.485854 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application with Lock( Sep 13 19:41:13.485854 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 19:41:13.485854 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application return self._enter() Sep 13 19:41:13.485854 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 19:41:13.485854 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 19:41:13.487277 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 19:41:13.487277 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application return self.creator() Sep 13 19:41:13.487277 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 19:41:13.487277 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application created_value = creator( Sep 13 19:41:13.487277 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 13 19:41:13.487277 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 13 19:41:13.487277 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 13 19:41:13.487277 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 13 19:41:13.487277 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 13 19:41:13.487277 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 13 19:41:13.487277 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Sep 13 19:41:13.487277 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application Sep 13 19:41:13.487277 dv-cinder-828806-6-smb devstack@keystone.service[82026]: [pid: 82026|app: 0|req: 123/240] 10.222.0.33 () {56 vars in 1099 bytes} [Tue Sep 13 19:41:13 2022] GET /identity/v3/roles/reader => generated 84 bytes in 217 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 13 19:41:13.487277 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21d61ae5-24c1-4d5c-af69-7ea813637755 None None] REQUEST_METHOD: `GET` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:41:13.488022 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21d61ae5-24c1-4d5c-af69-7ea813637755 None None] SCRIPT_NAME: `/identity` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:41:13.488022 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21d61ae5-24c1-4d5c-af69-7ea813637755 None None] PATH_INFO: `/` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:41:13.493239 dv-cinder-828806-6-smb devstack@keystone.service[82026]: [pid: 82026|app: 0|req: 124/241] 10.222.0.33 () {54 vars in 927 bytes} [Tue Sep 13 19:41:13 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 19:41:13.493239 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21d61ae5-24c1-4d5c-af69-7ea813637755 None None] Authenticating user token {{(pid=82026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:41:13.523259 dv-cinder-828806-6-smb devstack@keystone.service[82025]: [pid: 82025|app: 0|req: 118/242] 10.222.0.33 () {60 vars in 1132 bytes} [Tue Sep 13 19:41:13 2022] POST /identity/v3/users => generated 293 bytes in 307 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 13 19:41:13.526577 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45ce0b6c-d56f-4db3-92af-33a75766ede8 None None] REQUEST_METHOD: `POST` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:41:13.527121 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45ce0b6c-d56f-4db3-92af-33a75766ede8 None None] SCRIPT_NAME: `/identity` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:41:13.527864 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45ce0b6c-d56f-4db3-92af-33a75766ede8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:41:13.547689 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG dbcounter [-] [82025] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=82025) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:41:13.564641 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.auth.core [None req-45ce0b6c-d56f-4db3-92af-33a75766ede8 None None] MFA Rules not processed for user `57539b6a6f3b4d589f5f5e1d211cd6a0`. Rule list: `[]` (Enabled: `True`). {{(pid=82025) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 19:41:13.567343 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.fernet_utils [None req-45ce0b6c-d56f-4db3-92af-33a75766ede8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82025) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 19:41:13.689679 dv-cinder-828806-6-smb devstack@keystone.service[82025]: [pid: 82025|app: 0|req: 119/243] 10.222.0.33 () {58 vars in 1024 bytes} [Tue Sep 13 19:41:13 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 13 19:41:13.704711 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21d61ae5-24c1-4d5c-af69-7ea813637755 None None] Validating token access rules against request {{(pid=82026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:41:13.747137 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84e259b4-f371-499e-9cba-06a6e7c751ab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57539b6a6f3b4d589f5f5e1d211cd6a0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:41:13.747751 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84e259b4-f371-499e-9cba-06a6e7c751ab None admin] REQUEST_METHOD: `GET` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:41:13.748096 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84e259b4-f371-499e-9cba-06a6e7c751ab None admin] SCRIPT_NAME: `/identity` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:41:13.748369 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84e259b4-f371-499e-9cba-06a6e7c751ab None admin] PATH_INFO: `/v3/roles` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:41:13.749232 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84e259b4-f371-499e-9cba-06a6e7c751ab None admin] RBAC: Adding query filter params (name=reader) {{(pid=82026) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 19:41:13.749536 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84e259b4-f371-499e-9cba-06a6e7c751ab None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:41:13.750940 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84e259b4-f371-499e-9cba-06a6e7c751ab None admin] RBAC: Authorization granted {{(pid=82026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:41:13.760142 dv-cinder-828806-6-smb devstack@keystone.service[82026]: [pid: 82026|app: 0|req: 125/244] 10.222.0.33 () {56 vars in 1101 bytes} [Tue Sep 13 19:41:13 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 269 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 19:41:13.769410 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45ce0b6c-d56f-4db3-92af-33a75766ede8 None None] Authenticating user token {{(pid=82025) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:41:13.887918 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45ce0b6c-d56f-4db3-92af-33a75766ede8 None None] Validating token access rules against request {{(pid=82025) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:41:13.928090 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75978369-266d-441b-9dd5-dd8690c142c3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57539b6a6f3b4d589f5f5e1d211cd6a0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82025) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:41:13.928734 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75978369-266d-441b-9dd5-dd8690c142c3 None admin] REQUEST_METHOD: `GET` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:41:13.929013 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75978369-266d-441b-9dd5-dd8690c142c3 None admin] SCRIPT_NAME: `/identity` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:41:13.929289 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75978369-266d-441b-9dd5-dd8690c142c3 None admin] PATH_INFO: `/v3/users/2d7fb95fe9ca4fa4a5f9938eab41a591` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:41:13.932850 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG dbcounter [-] [82025] Writing DB stats keystone:SELECT=100 {{(pid=82025) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:41:13.952377 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75978369-266d-441b-9dd5-dd8690c142c3 None admin] RBAC: Authorizing `identity:get_user(user_id=2d7fb95fe9ca4fa4a5f9938eab41a591)` {{(pid=82025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:41:13.953779 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75978369-266d-441b-9dd5-dd8690c142c3 None admin] RBAC: Authorization granted {{(pid=82025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:41:13.955890 dv-cinder-828806-6-smb devstack@keystone.service[82025]: [pid: 82025|app: 0|req: 120/245] 10.222.0.33 () {56 vars in 1177 bytes} [Tue Sep 13 19:41:13 2022] GET /identity/v3/users/2d7fb95fe9ca4fa4a5f9938eab41a591 => generated 297 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 19:41:13.961015 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84e259b4-f371-499e-9cba-06a6e7c751ab None admin] Authenticating user token {{(pid=82026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:41:13.987004 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG dbcounter [-] [82026] Writing DB stats keystone:SELECT=100 {{(pid=82026) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:41:14.007143 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75978369-266d-441b-9dd5-dd8690c142c3 None admin] Authenticating user token {{(pid=82025) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:41:14.090668 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84e259b4-f371-499e-9cba-06a6e7c751ab None admin] Validating token access rules against request {{(pid=82026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:41:14.121800 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75978369-266d-441b-9dd5-dd8690c142c3 None admin] Validating token access rules against request {{(pid=82025) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:41:14.129699 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b77a6330-e42a-4aa6-886a-8fd65a579c08 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57539b6a6f3b4d589f5f5e1d211cd6a0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:41:14.130320 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b77a6330-e42a-4aa6-886a-8fd65a579c08 None admin] REQUEST_METHOD: `GET` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:41:14.130651 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b77a6330-e42a-4aa6-886a-8fd65a579c08 None admin] SCRIPT_NAME: `/identity` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:41:14.130935 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b77a6330-e42a-4aa6-886a-8fd65a579c08 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:41:14.159273 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6123a9f-0734-4722-9296-1dd8fa4c08fa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57539b6a6f3b4d589f5f5e1d211cd6a0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82025) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:41:14.159883 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6123a9f-0734-4722-9296-1dd8fa4c08fa None admin] REQUEST_METHOD: `GET` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:41:14.160168 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6123a9f-0734-4722-9296-1dd8fa4c08fa None admin] SCRIPT_NAME: `/identity` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:41:14.160444 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6123a9f-0734-4722-9296-1dd8fa4c08fa None admin] PATH_INFO: `/v3/roles/member` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:41:14.171310 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6123a9f-0734-4722-9296-1dd8fa4c08fa None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=82025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 13 19:41:14.176302 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application [None req-e6123a9f-0734-4722-9296-1dd8fa4c08fa None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 13 19:41:14.176302 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 19:41:14.176302 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 19:41:14.176302 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 19:41:14.176302 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 19:41:14.176302 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 19:41:14.176302 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 19:41:14.176302 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 19:41:14.176302 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 19:41:14.176302 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 19:41:14.176302 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 19:41:14.176302 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 19:41:14.176302 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 13 19:41:14.176302 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 13 19:41:14.176302 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 13 19:41:14.176302 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 13 19:41:14.178692 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 13 19:41:14.178692 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 13 19:41:14.178692 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 13 19:41:14.178692 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 13 19:41:14.178692 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 19:41:14.178692 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 19:41:14.178692 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 19:41:14.178692 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 19:41:14.178692 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 19:41:14.178692 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 19:41:14.178692 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 19:41:14.178692 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application with Lock( Sep 13 19:41:14.178692 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 19:41:14.178692 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application return self._enter() Sep 13 19:41:14.178692 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 19:41:14.178692 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 19:41:14.180741 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 19:41:14.180741 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application return self.creator() Sep 13 19:41:14.180741 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 19:41:14.180741 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application created_value = creator( Sep 13 19:41:14.180741 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 13 19:41:14.180741 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 13 19:41:14.180741 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 13 19:41:14.180741 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 13 19:41:14.180741 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 13 19:41:14.180741 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 13 19:41:14.180741 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 13 19:41:14.180741 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application Sep 13 19:41:14.180741 dv-cinder-828806-6-smb devstack@keystone.service[82025]: [pid: 82025|app: 0|req: 121/246] 10.222.0.33 () {56 vars in 1099 bytes} [Tue Sep 13 19:41:14 2022] GET /identity/v3/roles/member => generated 84 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 13 19:41:14.187277 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-746de1da-6dd4-40b1-a131-d76dac57793e None None] REQUEST_METHOD: `GET` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:41:14.187277 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-746de1da-6dd4-40b1-a131-d76dac57793e None None] SCRIPT_NAME: `/identity` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:41:14.187277 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-746de1da-6dd4-40b1-a131-d76dac57793e None None] PATH_INFO: `/` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:41:14.187277 dv-cinder-828806-6-smb devstack@keystone.service[82025]: [pid: 82025|app: 0|req: 122/247] 10.222.0.33 () {54 vars in 927 bytes} [Tue Sep 13 19:41:14 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 19:41:14.187277 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-746de1da-6dd4-40b1-a131-d76dac57793e None None] Authenticating user token {{(pid=82025) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:41:14.207978 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b77a6330-e42a-4aa6-886a-8fd65a579c08 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=82026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:41:14.209465 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b77a6330-e42a-4aa6-886a-8fd65a579c08 None admin] RBAC: Authorization granted {{(pid=82026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:41:14.229058 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG dbcounter [-] [82026] Writing DB stats keystone:SELECT=100 {{(pid=82026) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:41:14.259389 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG dbcounter [-] [82025] Writing DB stats keystone:SELECT=100 {{(pid=82025) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:41:14.317712 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-746de1da-6dd4-40b1-a131-d76dac57793e None None] Validating token access rules against request {{(pid=82025) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:41:14.342617 dv-cinder-828806-6-smb devstack@keystone.service[82026]: [pid: 82026|app: 0|req: 126/248] 10.222.0.33 () {58 vars in 1282 bytes} [Tue Sep 13 19:41:13 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 382 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 13 19:41:14.347066 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f6ee10f-1dc8-4d43-8002-933311e1b625 None None] REQUEST_METHOD: `POST` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:41:14.347066 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f6ee10f-1dc8-4d43-8002-933311e1b625 None None] SCRIPT_NAME: `/identity` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:41:14.347066 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f6ee10f-1dc8-4d43-8002-933311e1b625 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:41:14.362784 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaac5c0d-a015-420f-ab2e-0222ca4f82d1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57539b6a6f3b4d589f5f5e1d211cd6a0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82025) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:41:14.363775 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaac5c0d-a015-420f-ab2e-0222ca4f82d1 None admin] REQUEST_METHOD: `GET` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:41:14.364252 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaac5c0d-a015-420f-ab2e-0222ca4f82d1 None admin] SCRIPT_NAME: `/identity` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:41:14.364757 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaac5c0d-a015-420f-ab2e-0222ca4f82d1 None admin] PATH_INFO: `/v3/roles` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:41:14.365684 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaac5c0d-a015-420f-ab2e-0222ca4f82d1 None admin] RBAC: Adding query filter params (name=member) {{(pid=82025) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 19:41:14.365859 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.auth.core [None req-9f6ee10f-1dc8-4d43-8002-933311e1b625 None None] MFA Rules not processed for user `57539b6a6f3b4d589f5f5e1d211cd6a0`. Rule list: `[]` (Enabled: `True`). {{(pid=82026) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 19:41:14.366389 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaac5c0d-a015-420f-ab2e-0222ca4f82d1 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:41:14.367123 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.common.fernet_utils [None req-9f6ee10f-1dc8-4d43-8002-933311e1b625 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82026) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 19:41:14.368281 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaac5c0d-a015-420f-ab2e-0222ca4f82d1 None admin] RBAC: Authorization granted {{(pid=82025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:41:14.381281 dv-cinder-828806-6-smb devstack@keystone.service[82025]: [pid: 82025|app: 0|req: 123/249] 10.222.0.33 () {56 vars in 1101 bytes} [Tue Sep 13 19:41:14 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 19:41:14.382476 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaac5c0d-a015-420f-ab2e-0222ca4f82d1 None admin] Authenticating user token {{(pid=82025) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:41:14.459917 dv-cinder-828806-6-smb devstack@keystone.service[82026]: [pid: 82026|app: 0|req: 127/250] 10.222.0.33 () {58 vars in 1024 bytes} [Tue Sep 13 19:41:14 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 13 19:41:14.461034 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f6ee10f-1dc8-4d43-8002-933311e1b625 None None] Authenticating user token {{(pid=82026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:41:14.510673 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaac5c0d-a015-420f-ab2e-0222ca4f82d1 None admin] Validating token access rules against request {{(pid=82025) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:41:14.523573 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG dbcounter [-] [82026] Writing DB stats keystone:SELECT=100 {{(pid=82026) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:41:14.530539 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG dbcounter [-] [82025] Writing DB stats keystone:SELECT=100 {{(pid=82025) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:41:14.563426 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76bced7a-fb82-42c3-87b8-192f4df7f0af None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57539b6a6f3b4d589f5f5e1d211cd6a0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82025) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:41:14.564130 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76bced7a-fb82-42c3-87b8-192f4df7f0af None admin] REQUEST_METHOD: `GET` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:41:14.564420 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76bced7a-fb82-42c3-87b8-192f4df7f0af None admin] SCRIPT_NAME: `/identity` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:41:14.564699 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76bced7a-fb82-42c3-87b8-192f4df7f0af None admin] PATH_INFO: `/v3/projects/bee3101ec8f84efa9f84a402c3c3cbbe` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:41:14.566059 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76bced7a-fb82-42c3-87b8-192f4df7f0af None admin] RBAC: Authorizing `identity:get_project(project_id=bee3101ec8f84efa9f84a402c3c3cbbe)` {{(pid=82025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:41:14.567854 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76bced7a-fb82-42c3-87b8-192f4df7f0af None admin] RBAC: Authorization granted {{(pid=82025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:41:14.569517 dv-cinder-828806-6-smb devstack@keystone.service[82025]: [pid: 82025|app: 0|req: 124/251] 10.222.0.33 () {56 vars in 1186 bytes} [Tue Sep 13 19:41:14 2022] GET /identity/v3/projects/bee3101ec8f84efa9f84a402c3c3cbbe => generated 302 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 19:41:14.570644 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d57ee23-300a-4b80-9b2a-1af40317d48d None None] REQUEST_METHOD: `GET` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:41:14.570931 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d57ee23-300a-4b80-9b2a-1af40317d48d None None] SCRIPT_NAME: `/identity` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:41:14.571243 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d57ee23-300a-4b80-9b2a-1af40317d48d None None] PATH_INFO: `/` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:41:14.572439 dv-cinder-828806-6-smb devstack@keystone.service[82025]: [pid: 82025|app: 0|req: 125/252] 10.222.0.33 () {54 vars in 927 bytes} [Tue Sep 13 19:41:14 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 19:41:14.583810 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42ff7efe-fcc8-4ca8-9fbf-959658e2cfbd None None] REQUEST_METHOD: `POST` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:41:14.584090 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42ff7efe-fcc8-4ca8-9fbf-959658e2cfbd None None] SCRIPT_NAME: `/identity` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:41:14.584370 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42ff7efe-fcc8-4ca8-9fbf-959658e2cfbd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:41:14.621511 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.auth.core [None req-42ff7efe-fcc8-4ca8-9fbf-959658e2cfbd None None] MFA Rules not processed for user `57539b6a6f3b4d589f5f5e1d211cd6a0`. Rule list: `[]` (Enabled: `True`). {{(pid=82025) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 19:41:14.623615 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.fernet_utils [None req-42ff7efe-fcc8-4ca8-9fbf-959658e2cfbd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82025) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 19:41:14.655578 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f6ee10f-1dc8-4d43-8002-933311e1b625 None None] Validating token access rules against request {{(pid=82026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:41:14.730730 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fa1ba10-8d1a-4d58-84b1-61dcff854c60 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57539b6a6f3b4d589f5f5e1d211cd6a0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:41:14.731309 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fa1ba10-8d1a-4d58-84b1-61dcff854c60 None admin] REQUEST_METHOD: `GET` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:41:14.731591 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fa1ba10-8d1a-4d58-84b1-61dcff854c60 None admin] SCRIPT_NAME: `/identity` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:41:14.731861 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fa1ba10-8d1a-4d58-84b1-61dcff854c60 None admin] PATH_INFO: `/v3/users/b6daa41d0b264085be0c1f37ff2d29e0` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:41:14.734853 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fa1ba10-8d1a-4d58-84b1-61dcff854c60 None admin] RBAC: Authorizing `identity:get_user(user_id=b6daa41d0b264085be0c1f37ff2d29e0)` {{(pid=82026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:41:14.736376 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fa1ba10-8d1a-4d58-84b1-61dcff854c60 None admin] RBAC: Authorization granted {{(pid=82026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:41:14.738185 dv-cinder-828806-6-smb devstack@keystone.service[82026]: [pid: 82026|app: 0|req: 128/253] 10.222.0.33 () {56 vars in 1177 bytes} [Tue Sep 13 19:41:14 2022] GET /identity/v3/users/b6daa41d0b264085be0c1f37ff2d29e0 => generated 297 bytes in 278 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 19:41:14.738764 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fa1ba10-8d1a-4d58-84b1-61dcff854c60 None admin] Authenticating user token {{(pid=82026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:41:14.762992 dv-cinder-828806-6-smb devstack@keystone.service[82025]: [pid: 82025|app: 0|req: 126/254] 10.222.0.33 () {58 vars in 1024 bytes} [Tue Sep 13 19:41:14 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 184 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 13 19:41:14.764507 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42ff7efe-fcc8-4ca8-9fbf-959658e2cfbd None None] Authenticating user token {{(pid=82025) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:41:14.866148 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fa1ba10-8d1a-4d58-84b1-61dcff854c60 None admin] Validating token access rules against request {{(pid=82026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:41:14.891320 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG dbcounter [-] [82026] Writing DB stats keystone:SELECT=100 {{(pid=82026) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:41:14.914118 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6814044b-8c04-4e91-a356-fa74c7463c4c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57539b6a6f3b4d589f5f5e1d211cd6a0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:41:14.915228 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6814044b-8c04-4e91-a356-fa74c7463c4c None admin] REQUEST_METHOD: `GET` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:41:14.915518 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6814044b-8c04-4e91-a356-fa74c7463c4c None admin] SCRIPT_NAME: `/identity` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:41:14.915907 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6814044b-8c04-4e91-a356-fa74c7463c4c None admin] PATH_INFO: `/v3/role_assignments` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:41:14.916654 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6814044b-8c04-4e91-a356-fa74c7463c4c None admin] RBAC: Adding query filter params (role.id=81338d9374bb480785c7d7aa54829af8, scope.project.id=bee3101ec8f84efa9f84a402c3c3cbbe, user.id=2d7fb95fe9ca4fa4a5f9938eab41a591) {{(pid=82026) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 19:41:14.917021 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6814044b-8c04-4e91-a356-fa74c7463c4c None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=82026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:41:14.918473 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6814044b-8c04-4e91-a356-fa74c7463c4c None admin] RBAC: Authorization granted {{(pid=82026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:41:14.925145 dv-cinder-828806-6-smb devstack@keystone.service[82026]: [pid: 82026|app: 0|req: 129/255] 10.222.0.33 () {56 vars in 1374 bytes} [Tue Sep 13 19:41:14 2022] GET /identity/v3/role_assignments?user.id=2d7fb95fe9ca4fa4a5f9938eab41a591&scope.project.id=bee3101ec8f84efa9f84a402c3c3cbbe&role.id=81338d9374bb480785c7d7aa54829af8 => generated 259 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 19:41:14.926163 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6814044b-8c04-4e91-a356-fa74c7463c4c None admin] Authenticating user token {{(pid=82026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:41:14.990958 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42ff7efe-fcc8-4ca8-9fbf-959658e2cfbd None None] Validating token access rules against request {{(pid=82025) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:41:15.019447 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG dbcounter [-] [82025] Writing DB stats keystone:SELECT=100 {{(pid=82025) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:41:15.051484 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a166fda5-ea66-4c7d-88e6-0c8e9af130b9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57539b6a6f3b4d589f5f5e1d211cd6a0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82025) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:41:15.052280 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a166fda5-ea66-4c7d-88e6-0c8e9af130b9 None admin] REQUEST_METHOD: `GET` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:41:15.052574 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a166fda5-ea66-4c7d-88e6-0c8e9af130b9 None admin] SCRIPT_NAME: `/identity` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:41:15.052859 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a166fda5-ea66-4c7d-88e6-0c8e9af130b9 None admin] PATH_INFO: `/v3/projects/bee3101ec8f84efa9f84a402c3c3cbbe` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:41:15.054088 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a166fda5-ea66-4c7d-88e6-0c8e9af130b9 None admin] RBAC: Authorizing `identity:get_project(project_id=bee3101ec8f84efa9f84a402c3c3cbbe)` {{(pid=82025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:41:15.061823 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a166fda5-ea66-4c7d-88e6-0c8e9af130b9 None admin] RBAC: Authorization granted {{(pid=82025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:41:15.064009 dv-cinder-828806-6-smb devstack@keystone.service[82025]: [pid: 82025|app: 0|req: 127/256] 10.222.0.33 () {56 vars in 1186 bytes} [Tue Sep 13 19:41:14 2022] GET /identity/v3/projects/bee3101ec8f84efa9f84a402c3c3cbbe => generated 302 bytes in 300 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 19:41:15.073964 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a166fda5-ea66-4c7d-88e6-0c8e9af130b9 None admin] Authenticating user token {{(pid=82025) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:41:15.121258 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6814044b-8c04-4e91-a356-fa74c7463c4c None admin] Validating token access rules against request {{(pid=82026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:41:15.184741 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-385a0858-838e-41da-a4ad-9d04682d2ca1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57539b6a6f3b4d589f5f5e1d211cd6a0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:41:15.185452 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-385a0858-838e-41da-a4ad-9d04682d2ca1 None admin] REQUEST_METHOD: `GET` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:41:15.186260 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-385a0858-838e-41da-a4ad-9d04682d2ca1 None admin] SCRIPT_NAME: `/identity` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:41:15.187200 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-385a0858-838e-41da-a4ad-9d04682d2ca1 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:41:15.210031 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-385a0858-838e-41da-a4ad-9d04682d2ca1 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=82026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 13 19:41:15.220988 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application [None req-385a0858-838e-41da-a4ad-9d04682d2ca1 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 13 19:41:15.220988 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 19:41:15.220988 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 19:41:15.220988 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 19:41:15.220988 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 19:41:15.220988 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 19:41:15.220988 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 19:41:15.220988 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 19:41:15.220988 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 19:41:15.220988 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 19:41:15.220988 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 19:41:15.220988 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 19:41:15.220988 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 13 19:41:15.220988 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 13 19:41:15.220988 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 13 19:41:15.220988 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 13 19:41:15.221902 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 13 19:41:15.221902 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 13 19:41:15.221902 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 13 19:41:15.221902 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 13 19:41:15.221902 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 19:41:15.221902 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 19:41:15.221902 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 19:41:15.221902 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 19:41:15.221902 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 19:41:15.221902 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 19:41:15.221902 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 19:41:15.221902 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application with Lock( Sep 13 19:41:15.221902 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 19:41:15.221902 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application return self._enter() Sep 13 19:41:15.221902 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 19:41:15.221902 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 19:41:15.222698 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 19:41:15.222698 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application return self.creator() Sep 13 19:41:15.222698 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 19:41:15.222698 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application created_value = creator( Sep 13 19:41:15.222698 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 13 19:41:15.222698 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 13 19:41:15.222698 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 13 19:41:15.222698 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 13 19:41:15.222698 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 13 19:41:15.222698 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 13 19:41:15.222698 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 13 19:41:15.222698 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application Sep 13 19:41:15.224035 dv-cinder-828806-6-smb devstack@keystone.service[82026]: [pid: 82026|app: 0|req: 130/257] 10.222.0.33 () {56 vars in 1114 bytes} [Tue Sep 13 19:41:14 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 297 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 19:41:15.224110 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-385a0858-838e-41da-a4ad-9d04682d2ca1 None admin] Authenticating user token {{(pid=82026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:41:15.233701 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a166fda5-ea66-4c7d-88e6-0c8e9af130b9 None admin] Validating token access rules against request {{(pid=82025) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:41:15.300258 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79a24352-a4a2-464e-a6f5-0e15afafd8db None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57539b6a6f3b4d589f5f5e1d211cd6a0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82025) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:41:15.300923 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79a24352-a4a2-464e-a6f5-0e15afafd8db None admin] REQUEST_METHOD: `PUT` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:41:15.301204 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79a24352-a4a2-464e-a6f5-0e15afafd8db None admin] SCRIPT_NAME: `/identity` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:41:15.301474 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79a24352-a4a2-464e-a6f5-0e15afafd8db None admin] PATH_INFO: `/v3/projects/bee3101ec8f84efa9f84a402c3c3cbbe/users/b6daa41d0b264085be0c1f37ff2d29e0/roles/3618ab638a65401f82333da7596d1daf` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:41:15.308450 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79a24352-a4a2-464e-a6f5-0e15afafd8db None admin] RBAC: Authorizing `identity:create_grant(project_id=bee3101ec8f84efa9f84a402c3c3cbbe, user_id=b6daa41d0b264085be0c1f37ff2d29e0, role_id=3618ab638a65401f82333da7596d1daf)` {{(pid=82025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:41:15.310205 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG dbcounter [-] [82026] Writing DB stats keystone:SELECT=100 {{(pid=82026) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:41:15.313733 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79a24352-a4a2-464e-a6f5-0e15afafd8db None admin] RBAC: Authorization granted {{(pid=82025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:41:15.380779 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-385a0858-838e-41da-a4ad-9d04682d2ca1 None admin] Validating token access rules against request {{(pid=82026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:41:15.420646 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e5d7fda-8782-44e8-8ded-356841f62811 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57539b6a6f3b4d589f5f5e1d211cd6a0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:41:15.421264 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e5d7fda-8782-44e8-8ded-356841f62811 None admin] REQUEST_METHOD: `GET` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:41:15.421546 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e5d7fda-8782-44e8-8ded-356841f62811 None admin] SCRIPT_NAME: `/identity` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:41:15.421824 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e5d7fda-8782-44e8-8ded-356841f62811 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:41:15.436355 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e5d7fda-8782-44e8-8ded-356841f62811 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=82026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 13 19:41:15.439008 dv-cinder-828806-6-smb devstack@keystone.service[82025]: [pid: 82025|app: 0|req: 128/258] 10.222.0.33 () {58 vars in 1439 bytes} [Tue Sep 13 19:41:15 2022] PUT /identity/v3/projects/bee3101ec8f84efa9f84a402c3c3cbbe/users/b6daa41d0b264085be0c1f37ff2d29e0/roles/3618ab638a65401f82333da7596d1daf => generated 0 bytes in 366 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 19:41:15.439852 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79a24352-a4a2-464e-a6f5-0e15afafd8db None admin] Authenticating user token {{(pid=82025) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:41:15.454191 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application [None req-8e5d7fda-8782-44e8-8ded-356841f62811 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 13 19:41:15.454191 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 19:41:15.454191 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 19:41:15.454191 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 19:41:15.454191 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 19:41:15.454191 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 19:41:15.454191 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 19:41:15.454191 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 19:41:15.454191 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 19:41:15.454191 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 19:41:15.454191 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 19:41:15.454191 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 19:41:15.454191 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 13 19:41:15.454191 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 13 19:41:15.454191 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 13 19:41:15.454191 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 13 19:41:15.455204 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 13 19:41:15.455204 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 13 19:41:15.455204 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 13 19:41:15.455204 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 13 19:41:15.455204 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 19:41:15.455204 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 19:41:15.455204 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 19:41:15.455204 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 19:41:15.455204 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 19:41:15.455204 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 19:41:15.455204 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 19:41:15.455204 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application with Lock( Sep 13 19:41:15.455204 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 19:41:15.455204 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application return self._enter() Sep 13 19:41:15.455204 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 19:41:15.455204 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 19:41:15.455998 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 19:41:15.455998 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application return self.creator() Sep 13 19:41:15.455998 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 19:41:15.455998 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application created_value = creator( Sep 13 19:41:15.455998 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 13 19:41:15.455998 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 13 19:41:15.455998 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 13 19:41:15.455998 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 13 19:41:15.455998 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 13 19:41:15.455998 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 13 19:41:15.455998 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 13 19:41:15.455998 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application Sep 13 19:41:15.457593 dv-cinder-828806-6-smb devstack@keystone.service[82026]: [pid: 82026|app: 0|req: 131/259] 10.222.0.33 () {56 vars in 1096 bytes} [Tue Sep 13 19:41:15 2022] GET /identity/v3/roles/admin => generated 83 bytes in 233 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 19:41:15.461784 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e5d7fda-8782-44e8-8ded-356841f62811 None admin] Authenticating user token {{(pid=82026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:41:15.511151 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG dbcounter [-] [82025] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82025) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:41:15.626604 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79a24352-a4a2-464e-a6f5-0e15afafd8db None admin] Validating token access rules against request {{(pid=82025) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:41:15.644180 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG dbcounter [-] [82026] Writing DB stats keystone:SELECT=100 {{(pid=82026) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:41:15.650845 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e5d7fda-8782-44e8-8ded-356841f62811 None admin] Validating token access rules against request {{(pid=82026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:41:15.703832 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c32cfcc-fd91-461e-9927-52f6f66484a4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57539b6a6f3b4d589f5f5e1d211cd6a0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82025) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:41:15.704474 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c32cfcc-fd91-461e-9927-52f6f66484a4 None admin] REQUEST_METHOD: `GET` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:41:15.704755 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c32cfcc-fd91-461e-9927-52f6f66484a4 None admin] SCRIPT_NAME: `/identity` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:41:15.705027 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c32cfcc-fd91-461e-9927-52f6f66484a4 None admin] PATH_INFO: `/v3/roles` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:41:15.705720 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c32cfcc-fd91-461e-9927-52f6f66484a4 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=82025) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 19:41:15.706024 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c32cfcc-fd91-461e-9927-52f6f66484a4 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:41:15.707469 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c32cfcc-fd91-461e-9927-52f6f66484a4 None admin] RBAC: Authorization granted {{(pid=82025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:41:15.722046 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20c98875-09bc-455a-a73a-3be8e0b09b4c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57539b6a6f3b4d589f5f5e1d211cd6a0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:41:15.722665 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20c98875-09bc-455a-a73a-3be8e0b09b4c None admin] REQUEST_METHOD: `GET` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:41:15.722944 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20c98875-09bc-455a-a73a-3be8e0b09b4c None admin] SCRIPT_NAME: `/identity` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:41:15.723242 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20c98875-09bc-455a-a73a-3be8e0b09b4c None admin] PATH_INFO: `/v3/roles` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:41:15.723914 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20c98875-09bc-455a-a73a-3be8e0b09b4c None admin] RBAC: Adding query filter params (name=admin) {{(pid=82026) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 19:41:15.725154 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20c98875-09bc-455a-a73a-3be8e0b09b4c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:41:15.726780 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20c98875-09bc-455a-a73a-3be8e0b09b4c None admin] RBAC: Authorization granted {{(pid=82026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:41:15.729905 dv-cinder-828806-6-smb devstack@keystone.service[82025]: [pid: 82025|app: 0|req: 129/260] 10.222.0.33 () {56 vars in 1111 bytes} [Tue Sep 13 19:41:15 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 290 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 19:41:15.737021 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c32cfcc-fd91-461e-9927-52f6f66484a4 None admin] Authenticating user token {{(pid=82025) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:41:15.749337 dv-cinder-828806-6-smb devstack@keystone.service[82026]: [pid: 82026|app: 0|req: 132/261] 10.222.0.33 () {56 vars in 1099 bytes} [Tue Sep 13 19:41:15 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 288 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 19:41:15.756982 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20c98875-09bc-455a-a73a-3be8e0b09b4c None admin] Authenticating user token {{(pid=82026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:41:15.885565 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c32cfcc-fd91-461e-9927-52f6f66484a4 None admin] Validating token access rules against request {{(pid=82025) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:41:15.889373 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG dbcounter [-] [82025] Writing DB stats keystone:SELECT=100 {{(pid=82025) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:41:15.924377 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39fc9b49-73c9-424a-abc5-5b28f98e1232 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57539b6a6f3b4d589f5f5e1d211cd6a0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82025) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:41:15.925363 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39fc9b49-73c9-424a-abc5-5b28f98e1232 None admin] REQUEST_METHOD: `GET` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:41:15.926083 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39fc9b49-73c9-424a-abc5-5b28f98e1232 None admin] SCRIPT_NAME: `/identity` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:41:15.926555 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39fc9b49-73c9-424a-abc5-5b28f98e1232 None admin] PATH_INFO: `/v3/users/66dd5274b2434c7b86e70e4c95589707` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:41:15.928397 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39fc9b49-73c9-424a-abc5-5b28f98e1232 None admin] RBAC: Authorizing `identity:get_user(user_id=66dd5274b2434c7b86e70e4c95589707)` {{(pid=82025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:41:15.930246 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39fc9b49-73c9-424a-abc5-5b28f98e1232 None admin] RBAC: Authorization granted {{(pid=82025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:41:15.932058 dv-cinder-828806-6-smb devstack@keystone.service[82025]: [pid: 82025|app: 0|req: 130/262] 10.222.0.33 () {56 vars in 1177 bytes} [Tue Sep 13 19:41:15 2022] GET /identity/v3/users/66dd5274b2434c7b86e70e4c95589707 => generated 283 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 19:41:15.937399 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20c98875-09bc-455a-a73a-3be8e0b09b4c None admin] Validating token access rules against request {{(pid=82026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:41:15.938091 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39fc9b49-73c9-424a-abc5-5b28f98e1232 None admin] Authenticating user token {{(pid=82025) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:41:16.059165 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07c1691c-6eb3-4580-8d03-c7707b8699e3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57539b6a6f3b4d589f5f5e1d211cd6a0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:41:16.059165 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07c1691c-6eb3-4580-8d03-c7707b8699e3 None admin] REQUEST_METHOD: `GET` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:41:16.059165 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07c1691c-6eb3-4580-8d03-c7707b8699e3 None admin] SCRIPT_NAME: `/identity` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:41:16.059165 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07c1691c-6eb3-4580-8d03-c7707b8699e3 None admin] PATH_INFO: `/v3/users/66dd5274b2434c7b86e70e4c95589707` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:41:16.059570 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07c1691c-6eb3-4580-8d03-c7707b8699e3 None admin] RBAC: Authorizing `identity:get_user(user_id=66dd5274b2434c7b86e70e4c95589707)` {{(pid=82026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:41:16.067544 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07c1691c-6eb3-4580-8d03-c7707b8699e3 None admin] RBAC: Authorization granted {{(pid=82026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:41:16.073808 dv-cinder-828806-6-smb devstack@keystone.service[82026]: [pid: 82026|app: 0|req: 133/263] 10.222.0.33 () {56 vars in 1177 bytes} [Tue Sep 13 19:41:15 2022] GET /identity/v3/users/66dd5274b2434c7b86e70e4c95589707 => generated 283 bytes in 313 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 19:41:16.080004 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07c1691c-6eb3-4580-8d03-c7707b8699e3 None admin] Authenticating user token {{(pid=82026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:41:16.080523 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39fc9b49-73c9-424a-abc5-5b28f98e1232 None admin] Validating token access rules against request {{(pid=82025) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:41:16.138528 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e59af96-645b-4820-b784-49ce8e2a5928 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57539b6a6f3b4d589f5f5e1d211cd6a0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82025) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:41:16.140104 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e59af96-645b-4820-b784-49ce8e2a5928 None admin] REQUEST_METHOD: `GET` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:41:16.140583 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e59af96-645b-4820-b784-49ce8e2a5928 None admin] SCRIPT_NAME: `/identity` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:41:16.141054 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e59af96-645b-4820-b784-49ce8e2a5928 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:41:16.172109 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG dbcounter [-] [82026] Writing DB stats keystone:SELECT=100 {{(pid=82026) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:41:16.211406 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG dbcounter [-] [82025] Writing DB stats keystone:SELECT=100 {{(pid=82025) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:41:16.255395 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e59af96-645b-4820-b784-49ce8e2a5928 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=82025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:41:16.256914 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e59af96-645b-4820-b784-49ce8e2a5928 None admin] RBAC: Authorization granted {{(pid=82025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:41:16.366151 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07c1691c-6eb3-4580-8d03-c7707b8699e3 None admin] Validating token access rules against request {{(pid=82026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:41:16.445362 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c495853f-06c9-47f3-ad86-3651d21ee495 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57539b6a6f3b4d589f5f5e1d211cd6a0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:41:16.446329 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c495853f-06c9-47f3-ad86-3651d21ee495 None admin] REQUEST_METHOD: `GET` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:41:16.446817 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c495853f-06c9-47f3-ad86-3651d21ee495 None admin] SCRIPT_NAME: `/identity` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:41:16.447326 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c495853f-06c9-47f3-ad86-3651d21ee495 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:41:16.521267 dv-cinder-828806-6-smb devstack@keystone.service[82025]: [pid: 82025|app: 0|req: 131/264] 10.222.0.33 () {58 vars in 1282 bytes} [Tue Sep 13 19:41:15 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 584 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Sep 13 19:41:16.527325 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e59af96-645b-4820-b784-49ce8e2a5928 None admin] Authenticating user token {{(pid=82025) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:41:16.590662 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c495853f-06c9-47f3-ad86-3651d21ee495 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=82026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:41:16.594069 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c495853f-06c9-47f3-ad86-3651d21ee495 None admin] RBAC: Authorization granted {{(pid=82026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:41:16.671425 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG dbcounter [-] [82026] Writing DB stats keystone:SELECT=100 {{(pid=82026) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:41:16.698391 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG dbcounter [-] [82025] Writing DB stats keystone:SELECT=100 {{(pid=82025) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:41:16.744087 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e59af96-645b-4820-b784-49ce8e2a5928 None admin] Validating token access rules against request {{(pid=82025) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:41:16.803383 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c8d56bd-1883-470c-97e4-a302f74a0666 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57539b6a6f3b4d589f5f5e1d211cd6a0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82025) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:41:16.804035 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c8d56bd-1883-470c-97e4-a302f74a0666 None admin] REQUEST_METHOD: `GET` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:41:16.804304 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c8d56bd-1883-470c-97e4-a302f74a0666 None admin] SCRIPT_NAME: `/identity` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:41:16.809591 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c8d56bd-1883-470c-97e4-a302f74a0666 None admin] PATH_INFO: `/v3/projects/bee3101ec8f84efa9f84a402c3c3cbbe` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:41:16.809591 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c8d56bd-1883-470c-97e4-a302f74a0666 None admin] RBAC: Authorizing `identity:get_project(project_id=bee3101ec8f84efa9f84a402c3c3cbbe)` {{(pid=82025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:41:16.809591 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c8d56bd-1883-470c-97e4-a302f74a0666 None admin] RBAC: Authorization granted {{(pid=82025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:41:16.809591 dv-cinder-828806-6-smb devstack@keystone.service[82025]: [pid: 82025|app: 0|req: 132/265] 10.222.0.33 () {56 vars in 1186 bytes} [Tue Sep 13 19:41:16 2022] GET /identity/v3/projects/bee3101ec8f84efa9f84a402c3c3cbbe => generated 302 bytes in 282 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 13 19:41:16.810206 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f3fced9-b735-4863-8ff1-51342d7c1824 None None] REQUEST_METHOD: `GET` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:41:16.810521 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f3fced9-b735-4863-8ff1-51342d7c1824 None None] SCRIPT_NAME: `/identity` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:41:16.811409 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f3fced9-b735-4863-8ff1-51342d7c1824 None None] PATH_INFO: `/` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:41:16.814203 dv-cinder-828806-6-smb devstack@keystone.service[82025]: [pid: 82025|app: 0|req: 133/266] 10.222.0.33 () {54 vars in 927 bytes} [Tue Sep 13 19:41:16 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 19:41:16.823722 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f3fced9-b735-4863-8ff1-51342d7c1824 None None] Authenticating user token {{(pid=82025) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:41:16.836477 dv-cinder-828806-6-smb devstack@keystone.service[82026]: [pid: 82026|app: 0|req: 134/267] 10.222.0.33 () {58 vars in 1282 bytes} [Tue Sep 13 19:41:16 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 757 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 13 19:41:16.837789 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c6caaee-ec22-429c-9571-a394a5660279 None None] REQUEST_METHOD: `POST` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:41:16.838086 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c6caaee-ec22-429c-9571-a394a5660279 None None] SCRIPT_NAME: `/identity` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:41:16.838363 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c6caaee-ec22-429c-9571-a394a5660279 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:41:16.880254 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.auth.core [None req-3c6caaee-ec22-429c-9571-a394a5660279 None None] MFA Rules not processed for user `57539b6a6f3b4d589f5f5e1d211cd6a0`. Rule list: `[]` (Enabled: `True`). {{(pid=82026) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 19:41:16.880593 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.common.fernet_utils [None req-3c6caaee-ec22-429c-9571-a394a5660279 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82026) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 19:41:17.012483 dv-cinder-828806-6-smb devstack@keystone.service[82026]: [pid: 82026|app: 0|req: 135/268] 10.222.0.33 () {58 vars in 1024 bytes} [Tue Sep 13 19:41:16 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 175 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 13 19:41:17.014520 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c6caaee-ec22-429c-9571-a394a5660279 None None] Authenticating user token {{(pid=82026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:41:17.068391 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f3fced9-b735-4863-8ff1-51342d7c1824 None None] Validating token access rules against request {{(pid=82025) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:41:17.119839 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG dbcounter [-] [82026] Writing DB stats keystone:SELECT=100 {{(pid=82026) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:41:17.156473 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49387c5f-8acc-4580-b209-f627e3bed5b8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57539b6a6f3b4d589f5f5e1d211cd6a0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82025) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:41:17.157481 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49387c5f-8acc-4580-b209-f627e3bed5b8 None admin] REQUEST_METHOD: `GET` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:41:17.157997 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49387c5f-8acc-4580-b209-f627e3bed5b8 None admin] SCRIPT_NAME: `/identity` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:41:17.158517 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49387c5f-8acc-4580-b209-f627e3bed5b8 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:41:17.159468 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49387c5f-8acc-4580-b209-f627e3bed5b8 None admin] RBAC: Adding query filter params (role.id=6bcd095c76b341e186ea8caa11f5fa31, scope.project.id=bee3101ec8f84efa9f84a402c3c3cbbe, user.id=66dd5274b2434c7b86e70e4c95589707) {{(pid=82025) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 19:41:17.159975 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49387c5f-8acc-4580-b209-f627e3bed5b8 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=82025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:41:17.161612 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49387c5f-8acc-4580-b209-f627e3bed5b8 None admin] RBAC: Authorization granted {{(pid=82025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:41:17.171478 dv-cinder-828806-6-smb devstack@keystone.service[82025]: [pid: 82025|app: 0|req: 134/269] 10.222.0.33 () {56 vars in 1374 bytes} [Tue Sep 13 19:41:16 2022] GET /identity/v3/role_assignments?user.id=66dd5274b2434c7b86e70e4c95589707&scope.project.id=bee3101ec8f84efa9f84a402c3c3cbbe&role.id=6bcd095c76b341e186ea8caa11f5fa31 => generated 608 bytes in 352 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 19:41:17.208203 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c6caaee-ec22-429c-9571-a394a5660279 None None] Validating token access rules against request {{(pid=82026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:41:17.266465 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebf287dd-7bb4-4125-8a3d-a6a41063aeba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57539b6a6f3b4d589f5f5e1d211cd6a0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:41:17.267579 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebf287dd-7bb4-4125-8a3d-a6a41063aeba None admin] REQUEST_METHOD: `GET` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:41:17.268060 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebf287dd-7bb4-4125-8a3d-a6a41063aeba None admin] SCRIPT_NAME: `/identity` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:41:17.268531 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebf287dd-7bb4-4125-8a3d-a6a41063aeba None admin] PATH_INFO: `/v3/projects/bee3101ec8f84efa9f84a402c3c3cbbe` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:41:17.272513 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebf287dd-7bb4-4125-8a3d-a6a41063aeba None admin] RBAC: Authorizing `identity:get_project(project_id=bee3101ec8f84efa9f84a402c3c3cbbe)` {{(pid=82026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:41:17.274351 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebf287dd-7bb4-4125-8a3d-a6a41063aeba None admin] RBAC: Authorization granted {{(pid=82026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:41:17.276394 dv-cinder-828806-6-smb devstack@keystone.service[82026]: [pid: 82026|app: 0|req: 136/270] 10.222.0.33 () {56 vars in 1186 bytes} [Tue Sep 13 19:41:17 2022] GET /identity/v3/projects/bee3101ec8f84efa9f84a402c3c3cbbe => generated 302 bytes in 263 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 19:41:17.283106 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49387c5f-8acc-4580-b209-f627e3bed5b8 None admin] Authenticating user token {{(pid=82025) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:41:17.293339 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG dbcounter [-] [82025] Writing DB stats keystone:SELECT=100 {{(pid=82025) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:41:17.346174 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebf287dd-7bb4-4125-8a3d-a6a41063aeba None admin] Authenticating user token {{(pid=82026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:41:17.518928 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49387c5f-8acc-4580-b209-f627e3bed5b8 None admin] Validating token access rules against request {{(pid=82025) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:41:17.610373 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebf287dd-7bb4-4125-8a3d-a6a41063aeba None admin] Validating token access rules against request {{(pid=82026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:41:17.628821 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a188c3f-0436-4203-b29d-0f9d301222c8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57539b6a6f3b4d589f5f5e1d211cd6a0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82025) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:41:17.629446 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a188c3f-0436-4203-b29d-0f9d301222c8 None admin] REQUEST_METHOD: `GET` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:41:17.629727 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a188c3f-0436-4203-b29d-0f9d301222c8 None admin] SCRIPT_NAME: `/identity` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:41:17.629998 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a188c3f-0436-4203-b29d-0f9d301222c8 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:41:17.630729 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a188c3f-0436-4203-b29d-0f9d301222c8 None admin] RBAC: Adding query filter params (role.id=e5af7d5baa93469e9e486ef21c85474e, scope.project.id=bee3101ec8f84efa9f84a402c3c3cbbe, user.id=66dd5274b2434c7b86e70e4c95589707) {{(pid=82025) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 19:41:17.631059 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a188c3f-0436-4203-b29d-0f9d301222c8 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=82025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:41:17.635025 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a188c3f-0436-4203-b29d-0f9d301222c8 None admin] RBAC: Authorization granted {{(pid=82025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:41:17.647284 dv-cinder-828806-6-smb devstack@keystone.service[82025]: [pid: 82025|app: 0|req: 135/271] 10.222.0.33 () {56 vars in 1374 bytes} [Tue Sep 13 19:41:17 2022] GET /identity/v3/role_assignments?user.id=66dd5274b2434c7b86e70e4c95589707&scope.project.id=bee3101ec8f84efa9f84a402c3c3cbbe&role.id=e5af7d5baa93469e9e486ef21c85474e => generated 608 bytes in 364 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 19:41:17.650856 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ee315a4-cac7-4729-aa26-1331e9bfcbc7 None None] REQUEST_METHOD: `GET` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:41:17.650856 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ee315a4-cac7-4729-aa26-1331e9bfcbc7 None None] SCRIPT_NAME: `/identity` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:41:17.650856 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ee315a4-cac7-4729-aa26-1331e9bfcbc7 None None] PATH_INFO: `/` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:41:17.651140 dv-cinder-828806-6-smb devstack@keystone.service[82025]: [pid: 82025|app: 0|req: 136/272] 10.222.0.33 () {54 vars in 927 bytes} [Tue Sep 13 19:41:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 19:41:17.661604 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97b0896d-d791-411a-b347-8c5510a5daa7 None None] REQUEST_METHOD: `POST` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:41:17.661909 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97b0896d-d791-411a-b347-8c5510a5daa7 None None] SCRIPT_NAME: `/identity` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:41:17.662160 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97b0896d-d791-411a-b347-8c5510a5daa7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:41:17.676191 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG dbcounter [-] [82026] Writing DB stats keystone:SELECT=100 {{(pid=82026) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:41:17.696945 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f37ce41-06e5-4da9-bd6f-2e056ffccffb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57539b6a6f3b4d589f5f5e1d211cd6a0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:41:17.697595 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f37ce41-06e5-4da9-bd6f-2e056ffccffb None admin] REQUEST_METHOD: `GET` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:41:17.697874 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f37ce41-06e5-4da9-bd6f-2e056ffccffb None admin] SCRIPT_NAME: `/identity` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:41:17.698146 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f37ce41-06e5-4da9-bd6f-2e056ffccffb None admin] PATH_INFO: `/v3/roles/member` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:41:17.699578 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.auth.core [None req-97b0896d-d791-411a-b347-8c5510a5daa7 None None] MFA Rules not processed for user `57539b6a6f3b4d589f5f5e1d211cd6a0`. Rule list: `[]` (Enabled: `True`). {{(pid=82025) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 19:41:17.704578 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.fernet_utils [None req-97b0896d-d791-411a-b347-8c5510a5daa7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82025) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 19:41:17.727088 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f37ce41-06e5-4da9-bd6f-2e056ffccffb None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=82026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 13 19:41:17.735283 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application [None req-5f37ce41-06e5-4da9-bd6f-2e056ffccffb None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 13 19:41:17.735283 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 19:41:17.735283 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 19:41:17.735283 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 19:41:17.735283 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 19:41:17.735283 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 19:41:17.735283 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 19:41:17.735283 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 19:41:17.735283 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 19:41:17.735283 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 19:41:17.735283 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 19:41:17.735283 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 19:41:17.735283 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 13 19:41:17.735283 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 13 19:41:17.735283 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 13 19:41:17.735283 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 13 19:41:17.736522 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 13 19:41:17.736522 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 13 19:41:17.736522 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 13 19:41:17.736522 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 13 19:41:17.736522 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 19:41:17.736522 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 19:41:17.736522 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 19:41:17.736522 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 19:41:17.736522 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 19:41:17.736522 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 19:41:17.736522 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 19:41:17.736522 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application with Lock( Sep 13 19:41:17.736522 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 19:41:17.736522 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application return self._enter() Sep 13 19:41:17.736522 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 19:41:17.736522 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 19:41:17.737340 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 19:41:17.737340 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application return self.creator() Sep 13 19:41:17.737340 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 19:41:17.737340 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application created_value = creator( Sep 13 19:41:17.737340 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 13 19:41:17.737340 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 13 19:41:17.737340 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 13 19:41:17.737340 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 13 19:41:17.737340 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 13 19:41:17.737340 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 13 19:41:17.737340 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 13 19:41:17.737340 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application Sep 13 19:41:17.737340 dv-cinder-828806-6-smb devstack@keystone.service[82026]: [pid: 82026|app: 0|req: 137/273] 10.222.0.33 () {56 vars in 1099 bytes} [Tue Sep 13 19:41:17 2022] GET /identity/v3/roles/member => generated 84 bytes in 391 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 19:41:17.744214 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f37ce41-06e5-4da9-bd6f-2e056ffccffb None admin] Authenticating user token {{(pid=82026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:41:17.851144 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG dbcounter [-] [82025] Writing DB stats keystone:SELECT=100 {{(pid=82025) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:41:17.866814 dv-cinder-828806-6-smb devstack@keystone.service[82025]: [pid: 82025|app: 0|req: 137/274] 10.222.0.33 () {58 vars in 1024 bytes} [Tue Sep 13 19:41:17 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 206 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 13 19:41:17.930472 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f37ce41-06e5-4da9-bd6f-2e056ffccffb None admin] Validating token access rules against request {{(pid=82026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:41:17.975589 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1969d1c8-60a6-4630-803c-4601e0c39001 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57539b6a6f3b4d589f5f5e1d211cd6a0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:41:17.976204 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1969d1c8-60a6-4630-803c-4601e0c39001 None admin] REQUEST_METHOD: `GET` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:41:17.976487 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1969d1c8-60a6-4630-803c-4601e0c39001 None admin] SCRIPT_NAME: `/identity` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:41:17.976765 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1969d1c8-60a6-4630-803c-4601e0c39001 None admin] PATH_INFO: `/v3/roles` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:41:17.977442 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1969d1c8-60a6-4630-803c-4601e0c39001 None admin] RBAC: Adding query filter params (name=member) {{(pid=82026) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 19:41:17.977750 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1969d1c8-60a6-4630-803c-4601e0c39001 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:41:17.979162 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1969d1c8-60a6-4630-803c-4601e0c39001 None admin] RBAC: Authorization granted {{(pid=82026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:41:17.988501 dv-cinder-828806-6-smb devstack@keystone.service[82026]: [pid: 82026|app: 0|req: 138/275] 10.222.0.33 () {56 vars in 1101 bytes} [Tue Sep 13 19:41:17 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 244 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 13 19:41:17.994255 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1969d1c8-60a6-4630-803c-4601e0c39001 None admin] Authenticating user token {{(pid=82026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:41:17.994708 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b06ee98d-fbb0-4681-b66f-9fac8b85e562 None None] REQUEST_METHOD: `GET` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:41:17.995241 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b06ee98d-fbb0-4681-b66f-9fac8b85e562 None None] SCRIPT_NAME: `/identity` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:41:17.995538 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b06ee98d-fbb0-4681-b66f-9fac8b85e562 None None] PATH_INFO: `/` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:41:17.997318 dv-cinder-828806-6-smb devstack@keystone.service[82025]: [pid: 82025|app: 0|req: 138/276] 10.222.0.33 () {54 vars in 927 bytes} [Tue Sep 13 19:41:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 19:41:18.003055 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f99140b7-07e4-4bc4-a459-98e8cec35cdb None None] REQUEST_METHOD: `POST` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:41:18.003055 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f99140b7-07e4-4bc4-a459-98e8cec35cdb None None] SCRIPT_NAME: `/identity` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:41:18.003469 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f99140b7-07e4-4bc4-a459-98e8cec35cdb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:41:18.025548 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.auth.core [None req-f99140b7-07e4-4bc4-a459-98e8cec35cdb None None] MFA Rules not processed for user `57539b6a6f3b4d589f5f5e1d211cd6a0`. Rule list: `[]` (Enabled: `True`). {{(pid=82025) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 19:41:18.026760 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.fernet_utils [None req-f99140b7-07e4-4bc4-a459-98e8cec35cdb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82025) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 19:41:18.073763 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG dbcounter [-] [82026] Writing DB stats keystone:SELECT=100 {{(pid=82026) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:41:18.122321 dv-cinder-828806-6-smb devstack@keystone.service[82025]: [pid: 82025|app: 0|req: 139/277] 10.222.0.33 () {58 vars in 1024 bytes} [Tue Sep 13 19:41:18 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 13 19:41:18.141137 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1969d1c8-60a6-4630-803c-4601e0c39001 None admin] Validating token access rules against request {{(pid=82026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:41:18.179715 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f99140b7-07e4-4bc4-a459-98e8cec35cdb None None] Authenticating user token {{(pid=82025) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:41:18.184436 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b82cfd47-08a1-4a90-810e-c3f571965597 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57539b6a6f3b4d589f5f5e1d211cd6a0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:41:18.185078 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b82cfd47-08a1-4a90-810e-c3f571965597 None admin] REQUEST_METHOD: `GET` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:41:18.185368 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b82cfd47-08a1-4a90-810e-c3f571965597 None admin] SCRIPT_NAME: `/identity` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:41:18.185709 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b82cfd47-08a1-4a90-810e-c3f571965597 None admin] PATH_INFO: `/v3/users/b271a8d9f1484f09a9b5b75d3d1a7687` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:41:18.205121 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b82cfd47-08a1-4a90-810e-c3f571965597 None admin] RBAC: Authorizing `identity:get_user(user_id=b271a8d9f1484f09a9b5b75d3d1a7687)` {{(pid=82026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:41:18.206621 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b82cfd47-08a1-4a90-810e-c3f571965597 None admin] RBAC: Authorization granted {{(pid=82026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:41:18.208633 dv-cinder-828806-6-smb devstack@keystone.service[82026]: [pid: 82026|app: 0|req: 139/278] 10.222.0.33 () {56 vars in 1177 bytes} [Tue Sep 13 19:41:17 2022] GET /identity/v3/users/b271a8d9f1484f09a9b5b75d3d1a7687 => generated 293 bytes in 215 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 19:41:18.214520 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b82cfd47-08a1-4a90-810e-c3f571965597 None admin] Authenticating user token {{(pid=82026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:41:18.315702 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f99140b7-07e4-4bc4-a459-98e8cec35cdb None None] Validating token access rules against request {{(pid=82025) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:41:18.349908 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b82cfd47-08a1-4a90-810e-c3f571965597 None admin] Validating token access rules against request {{(pid=82026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:41:18.351582 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG dbcounter [-] [82025] Writing DB stats keystone:SELECT=100 {{(pid=82025) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:41:18.359947 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG dbcounter [-] [82026] Writing DB stats keystone:SELECT=100 {{(pid=82026) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:41:18.363156 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4d25a78-8444-49ff-ad85-435853f038fd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57539b6a6f3b4d589f5f5e1d211cd6a0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82025) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:41:18.364026 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4d25a78-8444-49ff-ad85-435853f038fd None admin] REQUEST_METHOD: `GET` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:41:18.364457 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4d25a78-8444-49ff-ad85-435853f038fd None admin] SCRIPT_NAME: `/identity` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:41:18.364879 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4d25a78-8444-49ff-ad85-435853f038fd None admin] PATH_INFO: `/v3/domains/default` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:41:18.366223 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4d25a78-8444-49ff-ad85-435853f038fd None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=82025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:41:18.367860 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4d25a78-8444-49ff-ad85-435853f038fd None admin] RBAC: Authorization granted {{(pid=82025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:41:18.369886 dv-cinder-828806-6-smb devstack@keystone.service[82025]: [pid: 82025|app: 0|req: 140/279] 10.222.0.33 () {56 vars in 1108 bytes} [Tue Sep 13 19:41:18 2022] GET /identity/v3/domains/default => generated 199 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 19:41:18.376325 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4d25a78-8444-49ff-ad85-435853f038fd None admin] Authenticating user token {{(pid=82025) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:41:18.390963 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36f0e1f8-90cf-4c85-a284-78e0aedfe372 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57539b6a6f3b4d589f5f5e1d211cd6a0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:41:18.391751 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36f0e1f8-90cf-4c85-a284-78e0aedfe372 None admin] REQUEST_METHOD: `GET` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:41:18.392111 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36f0e1f8-90cf-4c85-a284-78e0aedfe372 None admin] SCRIPT_NAME: `/identity` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:41:18.392462 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36f0e1f8-90cf-4c85-a284-78e0aedfe372 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:41:18.393266 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36f0e1f8-90cf-4c85-a284-78e0aedfe372 None admin] RBAC: Adding query filter params (role.id=3618ab638a65401f82333da7596d1daf, user.id=b271a8d9f1484f09a9b5b75d3d1a7687, scope.system=all) {{(pid=82026) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 19:41:18.393652 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36f0e1f8-90cf-4c85-a284-78e0aedfe372 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=82026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:41:18.395263 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36f0e1f8-90cf-4c85-a284-78e0aedfe372 None admin] RBAC: Authorization granted {{(pid=82026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:41:18.406300 dv-cinder-828806-6-smb devstack@keystone.service[82026]: [pid: 82026|app: 0|req: 140/280] 10.222.0.33 () {56 vars in 1308 bytes} [Tue Sep 13 19:41:18 2022] GET /identity/v3/role_assignments?user.id=b271a8d9f1484f09a9b5b75d3d1a7687&scope.system=all&role.id=3618ab638a65401f82333da7596d1daf => generated 226 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 13 19:41:18.431841 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36f0e1f8-90cf-4c85-a284-78e0aedfe372 None admin] Authenticating user token {{(pid=82026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:41:18.511338 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4d25a78-8444-49ff-ad85-435853f038fd None admin] Validating token access rules against request {{(pid=82025) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:41:18.558238 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36f0e1f8-90cf-4c85-a284-78e0aedfe372 None admin] Validating token access rules against request {{(pid=82026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:41:18.559579 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52a1e270-4929-4e32-a5ac-0a9418773eff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57539b6a6f3b4d589f5f5e1d211cd6a0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82025) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:41:18.561196 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52a1e270-4929-4e32-a5ac-0a9418773eff None admin] REQUEST_METHOD: `POST` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:41:18.561702 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52a1e270-4929-4e32-a5ac-0a9418773eff None admin] SCRIPT_NAME: `/identity` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:41:18.563222 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52a1e270-4929-4e32-a5ac-0a9418773eff None admin] PATH_INFO: `/v3/users` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:41:18.563885 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52a1e270-4929-4e32-a5ac-0a9418773eff None admin] RBAC: Authorizing `identity:create_user()` {{(pid=82025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:41:18.565354 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52a1e270-4929-4e32-a5ac-0a9418773eff None admin] RBAC: Authorization granted {{(pid=82025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:41:18.604752 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca587231-a946-430b-8083-fc5fa778a4b9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57539b6a6f3b4d589f5f5e1d211cd6a0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:41:18.605424 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca587231-a946-430b-8083-fc5fa778a4b9 None admin] REQUEST_METHOD: `GET` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:41:18.605711 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca587231-a946-430b-8083-fc5fa778a4b9 None admin] SCRIPT_NAME: `/identity` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:41:18.605988 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca587231-a946-430b-8083-fc5fa778a4b9 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:41:18.617026 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca587231-a946-430b-8083-fc5fa778a4b9 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=82026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 13 19:41:18.621974 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application [None req-ca587231-a946-430b-8083-fc5fa778a4b9 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Sep 13 19:41:18.621974 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 19:41:18.621974 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 19:41:18.621974 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 19:41:18.621974 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 19:41:18.621974 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 19:41:18.621974 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 19:41:18.621974 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 19:41:18.621974 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 19:41:18.621974 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 19:41:18.621974 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 19:41:18.621974 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 19:41:18.621974 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 13 19:41:18.621974 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 13 19:41:18.621974 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 13 19:41:18.621974 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 13 19:41:18.628660 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 13 19:41:18.628660 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 13 19:41:18.628660 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 13 19:41:18.628660 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 13 19:41:18.628660 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 19:41:18.628660 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 19:41:18.628660 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 19:41:18.628660 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 19:41:18.628660 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 19:41:18.628660 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 19:41:18.628660 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 19:41:18.628660 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application with Lock( Sep 13 19:41:18.628660 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 19:41:18.628660 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application return self._enter() Sep 13 19:41:18.628660 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 19:41:18.628660 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 19:41:18.629493 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 19:41:18.629493 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application return self.creator() Sep 13 19:41:18.629493 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 19:41:18.629493 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application created_value = creator( Sep 13 19:41:18.629493 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 13 19:41:18.629493 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 13 19:41:18.629493 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 13 19:41:18.629493 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 13 19:41:18.629493 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 13 19:41:18.629493 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 13 19:41:18.629493 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Sep 13 19:41:18.629493 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application Sep 13 19:41:18.629493 dv-cinder-828806-6-smb devstack@keystone.service[82026]: [pid: 82026|app: 0|req: 141/281] 10.222.0.33 () {56 vars in 1099 bytes} [Tue Sep 13 19:41:18 2022] GET /identity/v3/roles/reader => generated 84 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 13 19:41:18.629493 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-556c92a3-6374-4e5b-86a3-1c21f2ea7ca9 None None] REQUEST_METHOD: `GET` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:41:18.630252 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-556c92a3-6374-4e5b-86a3-1c21f2ea7ca9 None None] SCRIPT_NAME: `/identity` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:41:18.630252 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-556c92a3-6374-4e5b-86a3-1c21f2ea7ca9 None None] PATH_INFO: `/` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:41:18.630252 dv-cinder-828806-6-smb devstack@keystone.service[82026]: [pid: 82026|app: 0|req: 142/282] 10.222.0.33 () {54 vars in 927 bytes} [Tue Sep 13 19:41:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 19:41:18.631889 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-556c92a3-6374-4e5b-86a3-1c21f2ea7ca9 None None] Authenticating user token {{(pid=82026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:41:18.663898 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG dbcounter [-] [82026] Writing DB stats keystone:SELECT=100 {{(pid=82026) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:41:18.691257 dv-cinder-828806-6-smb devstack@keystone.service[82025]: [pid: 82025|app: 0|req: 141/283] 10.222.0.33 () {60 vars in 1132 bytes} [Tue Sep 13 19:41:18 2022] POST /identity/v3/users => generated 293 bytes in 315 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 13 19:41:18.692821 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-947178d8-e38a-436a-9ca5-0621438f9d6d None None] REQUEST_METHOD: `POST` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:41:18.693111 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-947178d8-e38a-436a-9ca5-0621438f9d6d None None] SCRIPT_NAME: `/identity` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:41:18.693382 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-947178d8-e38a-436a-9ca5-0621438f9d6d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:41:18.733181 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.auth.core [None req-947178d8-e38a-436a-9ca5-0621438f9d6d None None] MFA Rules not processed for user `57539b6a6f3b4d589f5f5e1d211cd6a0`. Rule list: `[]` (Enabled: `True`). {{(pid=82025) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 19:41:18.734533 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.fernet_utils [None req-947178d8-e38a-436a-9ca5-0621438f9d6d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82025) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 19:41:18.756956 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-556c92a3-6374-4e5b-86a3-1c21f2ea7ca9 None None] Validating token access rules against request {{(pid=82026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:41:18.797199 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG dbcounter [-] [82025] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=82025) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:41:18.804407 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25d4b503-d486-4aa0-b803-3845112d60f5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57539b6a6f3b4d589f5f5e1d211cd6a0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:41:18.805162 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25d4b503-d486-4aa0-b803-3845112d60f5 None admin] REQUEST_METHOD: `GET` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:41:18.805508 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25d4b503-d486-4aa0-b803-3845112d60f5 None admin] SCRIPT_NAME: `/identity` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:41:18.807216 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25d4b503-d486-4aa0-b803-3845112d60f5 None admin] PATH_INFO: `/v3/roles` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:41:18.807216 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25d4b503-d486-4aa0-b803-3845112d60f5 None admin] RBAC: Adding query filter params (name=reader) {{(pid=82026) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 19:41:18.807216 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25d4b503-d486-4aa0-b803-3845112d60f5 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:41:18.808689 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25d4b503-d486-4aa0-b803-3845112d60f5 None admin] RBAC: Authorization granted {{(pid=82026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:41:18.822928 dv-cinder-828806-6-smb devstack@keystone.service[82026]: [pid: 82026|app: 0|req: 143/284] 10.222.0.33 () {56 vars in 1101 bytes} [Tue Sep 13 19:41:18 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 19:41:18.826616 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25d4b503-d486-4aa0-b803-3845112d60f5 None admin] Authenticating user token {{(pid=82026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:41:18.832862 dv-cinder-828806-6-smb devstack@keystone.service[82025]: [pid: 82025|app: 0|req: 142/285] 10.222.0.33 () {58 vars in 1024 bytes} [Tue Sep 13 19:41:18 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 141 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 13 19:41:18.934032 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG dbcounter [-] [82026] Writing DB stats keystone:SELECT=100 {{(pid=82026) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:41:18.943394 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25d4b503-d486-4aa0-b803-3845112d60f5 None admin] Validating token access rules against request {{(pid=82026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:41:18.981067 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3620418-161e-45d1-9033-1dc90b0fcedc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57539b6a6f3b4d589f5f5e1d211cd6a0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:41:18.981708 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3620418-161e-45d1-9033-1dc90b0fcedc None admin] REQUEST_METHOD: `GET` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:41:18.981996 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3620418-161e-45d1-9033-1dc90b0fcedc None admin] SCRIPT_NAME: `/identity` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:41:18.982276 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3620418-161e-45d1-9033-1dc90b0fcedc None admin] PATH_INFO: `/v3/users/2d7fb95fe9ca4fa4a5f9938eab41a591` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:41:18.983844 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3620418-161e-45d1-9033-1dc90b0fcedc None admin] RBAC: Authorizing `identity:get_user(user_id=2d7fb95fe9ca4fa4a5f9938eab41a591)` {{(pid=82026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:41:18.985371 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3620418-161e-45d1-9033-1dc90b0fcedc None admin] RBAC: Authorization granted {{(pid=82026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:41:18.991210 dv-cinder-828806-6-smb devstack@keystone.service[82026]: [pid: 82026|app: 0|req: 144/286] 10.222.0.33 () {56 vars in 1177 bytes} [Tue Sep 13 19:41:18 2022] GET /identity/v3/users/2d7fb95fe9ca4fa4a5f9938eab41a591 => generated 297 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 13 19:41:18.993067 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-947178d8-e38a-436a-9ca5-0621438f9d6d None None] Authenticating user token {{(pid=82025) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:41:19.114604 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3620418-161e-45d1-9033-1dc90b0fcedc None admin] Authenticating user token {{(pid=82026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:41:19.125022 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-947178d8-e38a-436a-9ca5-0621438f9d6d None None] Validating token access rules against request {{(pid=82025) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:41:19.172414 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b48ca57-66e8-448f-974f-e5faaf8d0a60 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57539b6a6f3b4d589f5f5e1d211cd6a0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82025) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:41:19.173053 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b48ca57-66e8-448f-974f-e5faaf8d0a60 None admin] REQUEST_METHOD: `GET` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:41:19.173338 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b48ca57-66e8-448f-974f-e5faaf8d0a60 None admin] SCRIPT_NAME: `/identity` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:41:19.173607 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b48ca57-66e8-448f-974f-e5faaf8d0a60 None admin] PATH_INFO: `/v3/projects/bee3101ec8f84efa9f84a402c3c3cbbe` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:41:19.174738 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b48ca57-66e8-448f-974f-e5faaf8d0a60 None admin] RBAC: Authorizing `identity:get_project(project_id=bee3101ec8f84efa9f84a402c3c3cbbe)` {{(pid=82025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:41:19.176218 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b48ca57-66e8-448f-974f-e5faaf8d0a60 None admin] RBAC: Authorization granted {{(pid=82025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:41:19.178232 dv-cinder-828806-6-smb devstack@keystone.service[82025]: [pid: 82025|app: 0|req: 143/287] 10.222.0.33 () {56 vars in 1186 bytes} [Tue Sep 13 19:41:18 2022] GET /identity/v3/projects/bee3101ec8f84efa9f84a402c3c3cbbe => generated 302 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 19:41:19.189113 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b48ca57-66e8-448f-974f-e5faaf8d0a60 None admin] Authenticating user token {{(pid=82025) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:41:19.255352 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3620418-161e-45d1-9033-1dc90b0fcedc None admin] Validating token access rules against request {{(pid=82026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:41:19.265905 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG dbcounter [-] [82025] Writing DB stats keystone:SELECT=100 {{(pid=82025) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:41:19.327201 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b48ca57-66e8-448f-974f-e5faaf8d0a60 None admin] Validating token access rules against request {{(pid=82025) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:41:19.356310 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24f88129-096f-4704-84d6-f2dbceb81777 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57539b6a6f3b4d589f5f5e1d211cd6a0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:41:19.357320 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24f88129-096f-4704-84d6-f2dbceb81777 None admin] REQUEST_METHOD: `GET` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:41:19.357916 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24f88129-096f-4704-84d6-f2dbceb81777 None admin] SCRIPT_NAME: `/identity` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:41:19.358389 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24f88129-096f-4704-84d6-f2dbceb81777 None admin] PATH_INFO: `/v3/roles/member` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:41:19.376786 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4b049bc-be55-4427-9dd7-45bdd949573e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57539b6a6f3b4d589f5f5e1d211cd6a0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82025) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:41:19.377470 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4b049bc-be55-4427-9dd7-45bdd949573e None admin] REQUEST_METHOD: `PUT` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:41:19.377757 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4b049bc-be55-4427-9dd7-45bdd949573e None admin] SCRIPT_NAME: `/identity` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:41:19.378037 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4b049bc-be55-4427-9dd7-45bdd949573e None admin] PATH_INFO: `/v3/projects/bee3101ec8f84efa9f84a402c3c3cbbe/users/2d7fb95fe9ca4fa4a5f9938eab41a591/roles/81338d9374bb480785c7d7aa54829af8` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:41:19.389315 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4b049bc-be55-4427-9dd7-45bdd949573e None admin] RBAC: Authorizing `identity:create_grant(project_id=bee3101ec8f84efa9f84a402c3c3cbbe, user_id=2d7fb95fe9ca4fa4a5f9938eab41a591, role_id=81338d9374bb480785c7d7aa54829af8)` {{(pid=82025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:41:19.390849 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4b049bc-be55-4427-9dd7-45bdd949573e None admin] RBAC: Authorization granted {{(pid=82025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:41:19.397022 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24f88129-096f-4704-84d6-f2dbceb81777 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=82026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 13 19:41:19.402568 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application [None req-24f88129-096f-4704-84d6-f2dbceb81777 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 13 19:41:19.402568 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 19:41:19.402568 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 19:41:19.402568 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 19:41:19.402568 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 19:41:19.402568 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 19:41:19.402568 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 19:41:19.402568 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 19:41:19.402568 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 19:41:19.402568 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 19:41:19.402568 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 19:41:19.402568 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 19:41:19.402568 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 13 19:41:19.402568 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 13 19:41:19.402568 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 13 19:41:19.402568 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 13 19:41:19.422892 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 13 19:41:19.422892 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 13 19:41:19.422892 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 13 19:41:19.422892 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 13 19:41:19.422892 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 19:41:19.422892 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 19:41:19.422892 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 19:41:19.422892 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 19:41:19.422892 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 19:41:19.422892 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 19:41:19.422892 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 19:41:19.422892 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application with Lock( Sep 13 19:41:19.422892 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 19:41:19.422892 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application return self._enter() Sep 13 19:41:19.422892 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 19:41:19.422892 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 19:41:19.423893 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 19:41:19.423893 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application return self.creator() Sep 13 19:41:19.423893 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 19:41:19.423893 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application created_value = creator( Sep 13 19:41:19.423893 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 13 19:41:19.423893 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 13 19:41:19.423893 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 13 19:41:19.423893 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 13 19:41:19.423893 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 13 19:41:19.423893 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 13 19:41:19.423893 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 13 19:41:19.423893 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application Sep 13 19:41:19.423893 dv-cinder-828806-6-smb devstack@keystone.service[82026]: [pid: 82026|app: 0|req: 145/288] 10.222.0.33 () {56 vars in 1099 bytes} [Tue Sep 13 19:41:19 2022] GET /identity/v3/roles/member => generated 84 bytes in 290 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 19:41:19.423893 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24f88129-096f-4704-84d6-f2dbceb81777 None admin] Authenticating user token {{(pid=82026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:41:19.442658 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG dbcounter [-] [82026] Writing DB stats keystone:SELECT=100 {{(pid=82026) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:41:19.491877 dv-cinder-828806-6-smb devstack@keystone.service[82025]: [pid: 82025|app: 0|req: 144/289] 10.222.0.33 () {58 vars in 1439 bytes} [Tue Sep 13 19:41:19 2022] PUT /identity/v3/projects/bee3101ec8f84efa9f84a402c3c3cbbe/users/2d7fb95fe9ca4fa4a5f9938eab41a591/roles/81338d9374bb480785c7d7aa54829af8 => generated 0 bytes in 303 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 19:41:19.545199 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24f88129-096f-4704-84d6-f2dbceb81777 None admin] Validating token access rules against request {{(pid=82026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:41:19.591473 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80dcad7e-6b65-42fd-b981-44a96628b8d6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57539b6a6f3b4d589f5f5e1d211cd6a0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:41:19.592888 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80dcad7e-6b65-42fd-b981-44a96628b8d6 None admin] REQUEST_METHOD: `GET` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:41:19.593407 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80dcad7e-6b65-42fd-b981-44a96628b8d6 None admin] SCRIPT_NAME: `/identity` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:41:19.593822 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80dcad7e-6b65-42fd-b981-44a96628b8d6 None admin] PATH_INFO: `/v3/roles` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:41:19.594666 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80dcad7e-6b65-42fd-b981-44a96628b8d6 None admin] RBAC: Adding query filter params (name=member) {{(pid=82026) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 19:41:19.595207 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80dcad7e-6b65-42fd-b981-44a96628b8d6 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:41:19.598480 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80dcad7e-6b65-42fd-b981-44a96628b8d6 None admin] RBAC: Authorization granted {{(pid=82026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:41:19.608196 dv-cinder-828806-6-smb devstack@keystone.service[82026]: [pid: 82026|app: 0|req: 146/290] 10.222.0.33 () {56 vars in 1101 bytes} [Tue Sep 13 19:41:19 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 19:41:19.614417 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4b049bc-be55-4427-9dd7-45bdd949573e None admin] Authenticating user token {{(pid=82025) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:41:19.757022 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4b049bc-be55-4427-9dd7-45bdd949573e None admin] Validating token access rules against request {{(pid=82025) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:41:19.775347 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG dbcounter [-] [82025] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82025) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:41:19.808605 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8ad12b1-3ac5-4e68-a6f8-500edbdcc34a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57539b6a6f3b4d589f5f5e1d211cd6a0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82025) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:41:19.809525 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8ad12b1-3ac5-4e68-a6f8-500edbdcc34a None admin] REQUEST_METHOD: `GET` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:41:19.809957 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8ad12b1-3ac5-4e68-a6f8-500edbdcc34a None admin] SCRIPT_NAME: `/identity` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:41:19.810405 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8ad12b1-3ac5-4e68-a6f8-500edbdcc34a None admin] PATH_INFO: `/v3/users/b6daa41d0b264085be0c1f37ff2d29e0` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:41:19.812025 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8ad12b1-3ac5-4e68-a6f8-500edbdcc34a None admin] RBAC: Authorizing `identity:get_user(user_id=b6daa41d0b264085be0c1f37ff2d29e0)` {{(pid=82025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:41:19.813759 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8ad12b1-3ac5-4e68-a6f8-500edbdcc34a None admin] RBAC: Authorization granted {{(pid=82025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:41:19.815591 dv-cinder-828806-6-smb devstack@keystone.service[82025]: [pid: 82025|app: 0|req: 145/291] 10.222.0.33 () {56 vars in 1177 bytes} [Tue Sep 13 19:41:19 2022] GET /identity/v3/users/b6daa41d0b264085be0c1f37ff2d29e0 => generated 297 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 19:41:19.821421 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80dcad7e-6b65-42fd-b981-44a96628b8d6 None admin] Authenticating user token {{(pid=82026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:41:19.921082 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG dbcounter [-] [82026] Writing DB stats keystone:SELECT=100 {{(pid=82026) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:41:19.943506 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80dcad7e-6b65-42fd-b981-44a96628b8d6 None admin] Validating token access rules against request {{(pid=82026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:41:19.981444 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd4d44a7-3081-4ff3-8e06-0cf250f4747a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57539b6a6f3b4d589f5f5e1d211cd6a0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:41:19.982385 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd4d44a7-3081-4ff3-8e06-0cf250f4747a None admin] REQUEST_METHOD: `GET` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:41:19.983460 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd4d44a7-3081-4ff3-8e06-0cf250f4747a None admin] SCRIPT_NAME: `/identity` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:41:19.983955 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd4d44a7-3081-4ff3-8e06-0cf250f4747a None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:41:20.057730 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd4d44a7-3081-4ff3-8e06-0cf250f4747a None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=82026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:41:20.059635 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd4d44a7-3081-4ff3-8e06-0cf250f4747a None admin] RBAC: Authorization granted {{(pid=82026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:41:20.174168 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG dbcounter [-] [82026] Writing DB stats keystone:SELECT=100 {{(pid=82026) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:41:20.202242 dv-cinder-828806-6-smb devstack@keystone.service[82026]: [pid: 82026|app: 0|req: 147/292] 10.222.0.33 () {58 vars in 1282 bytes} [Tue Sep 13 19:41:19 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 381 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 13 19:41:20.207933 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8ad12b1-3ac5-4e68-a6f8-500edbdcc34a None admin] Authenticating user token {{(pid=82025) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:41:20.381987 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8ad12b1-3ac5-4e68-a6f8-500edbdcc34a None admin] Validating token access rules against request {{(pid=82025) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:41:20.431897 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a84d6ea-fff0-4531-bf3e-41e130b489cb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57539b6a6f3b4d589f5f5e1d211cd6a0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82025) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:41:20.432540 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a84d6ea-fff0-4531-bf3e-41e130b489cb None admin] REQUEST_METHOD: `GET` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:41:20.432827 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a84d6ea-fff0-4531-bf3e-41e130b489cb None admin] SCRIPT_NAME: `/identity` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:41:20.433102 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a84d6ea-fff0-4531-bf3e-41e130b489cb None admin] PATH_INFO: `/v3/projects/bee3101ec8f84efa9f84a402c3c3cbbe` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:41:20.435892 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a84d6ea-fff0-4531-bf3e-41e130b489cb None admin] RBAC: Authorizing `identity:get_project(project_id=bee3101ec8f84efa9f84a402c3c3cbbe)` {{(pid=82025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:41:20.437684 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a84d6ea-fff0-4531-bf3e-41e130b489cb None admin] RBAC: Authorization granted {{(pid=82025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:41:20.439881 dv-cinder-828806-6-smb devstack@keystone.service[82025]: [pid: 82025|app: 0|req: 146/293] 10.222.0.33 () {56 vars in 1186 bytes} [Tue Sep 13 19:41:20 2022] GET /identity/v3/projects/bee3101ec8f84efa9f84a402c3c3cbbe => generated 302 bytes in 232 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 19:41:20.445995 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd4d44a7-3081-4ff3-8e06-0cf250f4747a None admin] Authenticating user token {{(pid=82026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:41:20.584987 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd4d44a7-3081-4ff3-8e06-0cf250f4747a None admin] Validating token access rules against request {{(pid=82026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:41:20.628475 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be67677a-973c-446d-9d2a-74a535efcb86 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57539b6a6f3b4d589f5f5e1d211cd6a0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:41:20.629471 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be67677a-973c-446d-9d2a-74a535efcb86 None admin] REQUEST_METHOD: `GET` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:41:20.630008 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be67677a-973c-446d-9d2a-74a535efcb86 None admin] SCRIPT_NAME: `/identity` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:41:20.630481 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be67677a-973c-446d-9d2a-74a535efcb86 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:41:20.631426 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be67677a-973c-446d-9d2a-74a535efcb86 None admin] RBAC: Adding query filter params (role.id=3618ab638a65401f82333da7596d1daf, scope.project.id=bee3101ec8f84efa9f84a402c3c3cbbe, user.id=b6daa41d0b264085be0c1f37ff2d29e0) {{(pid=82026) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 19:41:20.631932 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be67677a-973c-446d-9d2a-74a535efcb86 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=82026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:41:20.633626 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be67677a-973c-446d-9d2a-74a535efcb86 None admin] RBAC: Authorization granted {{(pid=82026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:41:20.641286 dv-cinder-828806-6-smb devstack@keystone.service[82026]: [pid: 82026|app: 0|req: 148/294] 10.222.0.33 () {56 vars in 1374 bytes} [Tue Sep 13 19:41:20 2022] GET /identity/v3/role_assignments?user.id=b6daa41d0b264085be0c1f37ff2d29e0&scope.project.id=bee3101ec8f84efa9f84a402c3c3cbbe&role.id=3618ab638a65401f82333da7596d1daf => generated 608 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 19:41:20.854413 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42510e23-2937-4892-8a3c-fd571e338673 None None] REQUEST_METHOD: `GET` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:41:20.855363 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42510e23-2937-4892-8a3c-fd571e338673 None None] SCRIPT_NAME: `/identity` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:41:20.855849 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42510e23-2937-4892-8a3c-fd571e338673 None None] PATH_INFO: `/` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:41:20.857781 dv-cinder-828806-6-smb devstack@keystone.service[82025]: [pid: 82025|app: 0|req: 147/295] 10.222.0.33 () {54 vars in 927 bytes} [Tue Sep 13 19:41:20 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 19:41:20.863171 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b2e1d4e-9258-4035-98da-acd470326274 None None] REQUEST_METHOD: `POST` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:41:20.863583 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b2e1d4e-9258-4035-98da-acd470326274 None None] SCRIPT_NAME: `/identity` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:41:20.863740 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b2e1d4e-9258-4035-98da-acd470326274 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:41:20.886716 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.auth.core [None req-7b2e1d4e-9258-4035-98da-acd470326274 None None] MFA Rules not processed for user `57539b6a6f3b4d589f5f5e1d211cd6a0`. Rule list: `[]` (Enabled: `True`). {{(pid=82026) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 19:41:20.887896 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.common.fernet_utils [None req-7b2e1d4e-9258-4035-98da-acd470326274 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82026) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 19:41:20.946250 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG dbcounter [-] [82026] Writing DB stats keystone:SELECT=100 {{(pid=82026) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:41:20.978628 dv-cinder-828806-6-smb devstack@keystone.service[82026]: [pid: 82026|app: 0|req: 149/296] 10.222.0.33 () {58 vars in 1024 bytes} [Tue Sep 13 19:41:20 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 13 19:41:21.276946 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42510e23-2937-4892-8a3c-fd571e338673 None None] Authenticating user token {{(pid=82025) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:41:21.331402 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG dbcounter [-] [82025] Writing DB stats keystone:SELECT=100 {{(pid=82025) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:41:21.386070 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42510e23-2937-4892-8a3c-fd571e338673 None None] Validating token access rules against request {{(pid=82025) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:41:21.426070 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d3fc8e3-2e83-4ee0-98f5-d185f63c641b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57539b6a6f3b4d589f5f5e1d211cd6a0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82025) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:41:21.426714 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d3fc8e3-2e83-4ee0-98f5-d185f63c641b None admin] REQUEST_METHOD: `GET` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:41:21.427129 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d3fc8e3-2e83-4ee0-98f5-d185f63c641b None admin] SCRIPT_NAME: `/identity` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:41:21.427399 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d3fc8e3-2e83-4ee0-98f5-d185f63c641b None admin] PATH_INFO: `/v3/roles/member` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:41:21.439620 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d3fc8e3-2e83-4ee0-98f5-d185f63c641b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=82025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 13 19:41:21.444472 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application [None req-0d3fc8e3-2e83-4ee0-98f5-d185f63c641b None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 13 19:41:21.444472 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 19:41:21.444472 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 19:41:21.444472 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 19:41:21.444472 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 19:41:21.444472 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 19:41:21.444472 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 19:41:21.444472 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 19:41:21.444472 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 19:41:21.444472 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 19:41:21.444472 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 19:41:21.444472 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 19:41:21.444472 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 13 19:41:21.444472 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 13 19:41:21.444472 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 13 19:41:21.444472 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 13 19:41:21.445330 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 13 19:41:21.445330 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 13 19:41:21.445330 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 13 19:41:21.445330 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 13 19:41:21.445330 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 19:41:21.445330 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 19:41:21.445330 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 19:41:21.445330 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 19:41:21.445330 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 19:41:21.445330 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 19:41:21.445330 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 19:41:21.445330 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application with Lock( Sep 13 19:41:21.445330 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 19:41:21.445330 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application return self._enter() Sep 13 19:41:21.445330 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 19:41:21.445330 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 19:41:21.446113 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 19:41:21.446113 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application return self.creator() Sep 13 19:41:21.446113 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 19:41:21.446113 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application created_value = creator( Sep 13 19:41:21.446113 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 13 19:41:21.446113 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 13 19:41:21.446113 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 13 19:41:21.446113 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 13 19:41:21.446113 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 13 19:41:21.446113 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 13 19:41:21.446113 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 13 19:41:21.446113 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application Sep 13 19:41:21.446113 dv-cinder-828806-6-smb devstack@keystone.service[82025]: [pid: 82025|app: 0|req: 148/297] 10.222.0.33 () {56 vars in 1099 bytes} [Tue Sep 13 19:41:21 2022] GET /identity/v3/roles/member => generated 84 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 19:41:21.451493 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b2e1d4e-9258-4035-98da-acd470326274 None None] Authenticating user token {{(pid=82026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:41:21.547438 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-952516ae-a479-4388-b5ff-c99ff6bf9c4e None None] REQUEST_METHOD: `GET` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:41:21.548177 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-952516ae-a479-4388-b5ff-c99ff6bf9c4e None None] SCRIPT_NAME: `/identity` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:41:21.549034 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-952516ae-a479-4388-b5ff-c99ff6bf9c4e None None] PATH_INFO: `/` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:41:21.551203 dv-cinder-828806-6-smb devstack@keystone.service[82025]: [pid: 82025|app: 0|req: 149/298] 10.222.0.33 () {54 vars in 927 bytes} [Tue Sep 13 19:41:21 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 19:41:21.556400 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15d9f2ca-4b98-4487-b824-696a26681a41 None None] REQUEST_METHOD: `POST` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:41:21.556689 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15d9f2ca-4b98-4487-b824-696a26681a41 None None] SCRIPT_NAME: `/identity` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:41:21.556965 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15d9f2ca-4b98-4487-b824-696a26681a41 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:41:21.559099 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b2e1d4e-9258-4035-98da-acd470326274 None None] Validating token access rules against request {{(pid=82026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:41:21.579295 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.auth.core [None req-15d9f2ca-4b98-4487-b824-696a26681a41 None None] MFA Rules not processed for user `57539b6a6f3b4d589f5f5e1d211cd6a0`. Rule list: `[]` (Enabled: `True`). {{(pid=82025) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 19:41:21.580496 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.fernet_utils [None req-15d9f2ca-4b98-4487-b824-696a26681a41 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82025) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 19:41:21.602607 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-958c2388-5a6f-44cf-b051-92c510efb040 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57539b6a6f3b4d589f5f5e1d211cd6a0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:41:21.603273 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-958c2388-5a6f-44cf-b051-92c510efb040 None admin] REQUEST_METHOD: `GET` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:41:21.603563 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-958c2388-5a6f-44cf-b051-92c510efb040 None admin] SCRIPT_NAME: `/identity` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:41:21.603845 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-958c2388-5a6f-44cf-b051-92c510efb040 None admin] PATH_INFO: `/v3/roles` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:41:21.604544 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-958c2388-5a6f-44cf-b051-92c510efb040 None admin] RBAC: Adding query filter params (name=member) {{(pid=82026) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 19:41:21.605522 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-958c2388-5a6f-44cf-b051-92c510efb040 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:41:21.607338 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-958c2388-5a6f-44cf-b051-92c510efb040 None admin] RBAC: Authorization granted {{(pid=82026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:41:21.621107 dv-cinder-828806-6-smb devstack@keystone.service[82026]: [pid: 82026|app: 0|req: 150/299] 10.222.0.33 () {56 vars in 1101 bytes} [Tue Sep 13 19:41:21 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 19:41:21.628065 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-958c2388-5a6f-44cf-b051-92c510efb040 None admin] Authenticating user token {{(pid=82026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:41:21.672054 dv-cinder-828806-6-smb devstack@keystone.service[82025]: [pid: 82025|app: 0|req: 150/300] 10.222.0.33 () {58 vars in 1024 bytes} [Tue Sep 13 19:41:21 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 13 19:41:21.679388 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG dbcounter [-] [82026] Writing DB stats keystone:SELECT=100 {{(pid=82026) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:41:21.734566 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-958c2388-5a6f-44cf-b051-92c510efb040 None admin] Validating token access rules against request {{(pid=82026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:41:21.735088 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb35e3cc-b73a-419d-990c-63abf9b543d7 None None] REQUEST_METHOD: `GET` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:41:21.735600 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb35e3cc-b73a-419d-990c-63abf9b543d7 None None] SCRIPT_NAME: `/identity` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:41:21.736082 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb35e3cc-b73a-419d-990c-63abf9b543d7 None None] PATH_INFO: `/` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:41:21.737977 dv-cinder-828806-6-smb devstack@keystone.service[82025]: [pid: 82025|app: 0|req: 151/301] 10.222.0.33 () {54 vars in 927 bytes} [Tue Sep 13 19:41:21 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 19:41:21.743692 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77ddfc4d-34f1-4499-8975-830d45f031d1 None None] REQUEST_METHOD: `POST` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:41:21.744280 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77ddfc4d-34f1-4499-8975-830d45f031d1 None None] SCRIPT_NAME: `/identity` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:41:21.744763 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77ddfc4d-34f1-4499-8975-830d45f031d1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:41:21.766814 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.auth.core [None req-77ddfc4d-34f1-4499-8975-830d45f031d1 None None] MFA Rules not processed for user `57539b6a6f3b4d589f5f5e1d211cd6a0`. Rule list: `[]` (Enabled: `True`). {{(pid=82025) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 19:41:21.768661 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.fernet_utils [None req-77ddfc4d-34f1-4499-8975-830d45f031d1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82025) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 19:41:21.770182 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39a831c0-092b-4ba1-b362-a347cf140e74 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57539b6a6f3b4d589f5f5e1d211cd6a0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:41:21.770822 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39a831c0-092b-4ba1-b362-a347cf140e74 None admin] REQUEST_METHOD: `GET` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:41:21.771143 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39a831c0-092b-4ba1-b362-a347cf140e74 None admin] SCRIPT_NAME: `/identity` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:41:21.771426 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39a831c0-092b-4ba1-b362-a347cf140e74 None admin] PATH_INFO: `/v3/users/b271a8d9f1484f09a9b5b75d3d1a7687` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:41:21.772912 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39a831c0-092b-4ba1-b362-a347cf140e74 None admin] RBAC: Authorizing `identity:get_user(user_id=b271a8d9f1484f09a9b5b75d3d1a7687)` {{(pid=82026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:41:21.774445 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39a831c0-092b-4ba1-b362-a347cf140e74 None admin] RBAC: Authorization granted {{(pid=82026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:41:21.776409 dv-cinder-828806-6-smb devstack@keystone.service[82026]: [pid: 82026|app: 0|req: 151/302] 10.222.0.33 () {56 vars in 1177 bytes} [Tue Sep 13 19:41:21 2022] GET /identity/v3/users/b271a8d9f1484f09a9b5b75d3d1a7687 => generated 293 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 19:41:21.783523 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39a831c0-092b-4ba1-b362-a347cf140e74 None admin] Authenticating user token {{(pid=82026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:41:21.803555 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG dbcounter [-] [82025] Writing DB stats keystone:SELECT=100 {{(pid=82025) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:41:21.851071 dv-cinder-828806-6-smb devstack@keystone.service[82025]: [pid: 82025|app: 0|req: 152/303] 10.222.0.33 () {58 vars in 1024 bytes} [Tue Sep 13 19:41:21 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 13 19:41:21.914196 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39a831c0-092b-4ba1-b362-a347cf140e74 None admin] Validating token access rules against request {{(pid=82026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:41:21.921487 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG dbcounter [-] [82026] Writing DB stats keystone:SELECT=100 {{(pid=82026) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:41:21.949263 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e74604e-f65f-443e-8f3e-a81231d243f4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57539b6a6f3b4d589f5f5e1d211cd6a0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:41:21.949927 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e74604e-f65f-443e-8f3e-a81231d243f4 None admin] REQUEST_METHOD: `PUT` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:41:21.950229 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e74604e-f65f-443e-8f3e-a81231d243f4 None admin] SCRIPT_NAME: `/identity` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:41:21.950505 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e74604e-f65f-443e-8f3e-a81231d243f4 None admin] PATH_INFO: `/v3/system/users/b271a8d9f1484f09a9b5b75d3d1a7687/roles/3618ab638a65401f82333da7596d1daf` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:41:21.952517 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e74604e-f65f-443e-8f3e-a81231d243f4 None admin] RBAC: Authorizing `identity:create_system_grant_for_user(user_id=b271a8d9f1484f09a9b5b75d3d1a7687, role_id=3618ab638a65401f82333da7596d1daf)` {{(pid=82026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:41:21.953963 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e74604e-f65f-443e-8f3e-a81231d243f4 None admin] RBAC: Authorization granted {{(pid=82026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:41:21.972962 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77ddfc4d-34f1-4499-8975-830d45f031d1 None None] Authenticating user token {{(pid=82025) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:41:22.031058 dv-cinder-828806-6-smb devstack@keystone.service[82026]: [pid: 82026|app: 0|req: 152/304] 10.222.0.33 () {58 vars in 1334 bytes} [Tue Sep 13 19:41:21 2022] PUT /identity/v3/system/users/b271a8d9f1484f09a9b5b75d3d1a7687/roles/3618ab638a65401f82333da7596d1daf => generated 0 bytes in 242 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 13 19:41:22.094248 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77ddfc4d-34f1-4499-8975-830d45f031d1 None None] Validating token access rules against request {{(pid=82025) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:41:22.130514 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e74604e-f65f-443e-8f3e-a81231d243f4 None admin] Authenticating user token {{(pid=82026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:41:22.147755 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57d4463e-0d9b-4eed-9547-b71e17110d1c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57539b6a6f3b4d589f5f5e1d211cd6a0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82025) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:41:22.148413 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57d4463e-0d9b-4eed-9547-b71e17110d1c None admin] REQUEST_METHOD: `GET` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:41:22.148701 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57d4463e-0d9b-4eed-9547-b71e17110d1c None admin] SCRIPT_NAME: `/identity` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:41:22.148980 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57d4463e-0d9b-4eed-9547-b71e17110d1c None admin] PATH_INFO: `/v3/roles/reader` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:41:22.173044 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57d4463e-0d9b-4eed-9547-b71e17110d1c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=82025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 13 19:41:22.178687 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application [None req-57d4463e-0d9b-4eed-9547-b71e17110d1c None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Sep 13 19:41:22.178687 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 19:41:22.178687 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 19:41:22.178687 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 19:41:22.178687 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 19:41:22.178687 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 19:41:22.178687 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 19:41:22.178687 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 19:41:22.178687 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 19:41:22.178687 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 19:41:22.178687 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 19:41:22.178687 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 19:41:22.178687 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 13 19:41:22.178687 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 13 19:41:22.178687 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 13 19:41:22.178687 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 13 19:41:22.179651 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 13 19:41:22.179651 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 13 19:41:22.179651 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 13 19:41:22.179651 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 13 19:41:22.179651 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 19:41:22.179651 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 19:41:22.179651 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 19:41:22.179651 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 19:41:22.179651 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 19:41:22.179651 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 19:41:22.179651 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 19:41:22.179651 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application with Lock( Sep 13 19:41:22.179651 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 19:41:22.179651 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application return self._enter() Sep 13 19:41:22.179651 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 19:41:22.179651 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 19:41:22.180445 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 19:41:22.180445 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application return self.creator() Sep 13 19:41:22.180445 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 19:41:22.180445 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application created_value = creator( Sep 13 19:41:22.180445 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 13 19:41:22.180445 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 13 19:41:22.180445 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 13 19:41:22.180445 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 13 19:41:22.180445 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 13 19:41:22.180445 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 13 19:41:22.180445 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Sep 13 19:41:22.180445 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application Sep 13 19:41:22.188391 dv-cinder-828806-6-smb devstack@keystone.service[82025]: [pid: 82025|app: 0|req: 153/305] 10.222.0.33 () {56 vars in 1099 bytes} [Tue Sep 13 19:41:21 2022] GET /identity/v3/roles/reader => generated 84 bytes in 215 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 13 19:41:22.189568 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57d4463e-0d9b-4eed-9547-b71e17110d1c None admin] Authenticating user token {{(pid=82025) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:41:22.224672 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG dbcounter [-] [82025] Writing DB stats keystone:SELECT=100 {{(pid=82025) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:41:22.255691 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e74604e-f65f-443e-8f3e-a81231d243f4 None admin] Validating token access rules against request {{(pid=82026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:41:22.302009 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d467482d-f7f3-44ca-9f4f-56a0907524dd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57539b6a6f3b4d589f5f5e1d211cd6a0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:41:22.302767 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d467482d-f7f3-44ca-9f4f-56a0907524dd None admin] REQUEST_METHOD: `GET` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:41:22.303073 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d467482d-f7f3-44ca-9f4f-56a0907524dd None admin] SCRIPT_NAME: `/identity` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:41:22.303369 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d467482d-f7f3-44ca-9f4f-56a0907524dd None admin] PATH_INFO: `/v3/domains/default` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:41:22.304460 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d467482d-f7f3-44ca-9f4f-56a0907524dd None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=82026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:41:22.305383 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57d4463e-0d9b-4eed-9547-b71e17110d1c None admin] Validating token access rules against request {{(pid=82025) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:41:22.305913 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d467482d-f7f3-44ca-9f4f-56a0907524dd None admin] RBAC: Authorization granted {{(pid=82026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:41:22.308104 dv-cinder-828806-6-smb devstack@keystone.service[82026]: [pid: 82026|app: 0|req: 153/306] 10.222.0.33 () {56 vars in 1108 bytes} [Tue Sep 13 19:41:22 2022] GET /identity/v3/domains/default => generated 199 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 19:41:22.309122 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fae79653-1542-42c8-bbb5-cde3b88765e8 None None] REQUEST_METHOD: `GET` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:41:22.309416 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fae79653-1542-42c8-bbb5-cde3b88765e8 None None] SCRIPT_NAME: `/identity` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:41:22.309695 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fae79653-1542-42c8-bbb5-cde3b88765e8 None None] PATH_INFO: `/` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:41:22.313059 dv-cinder-828806-6-smb devstack@keystone.service[82026]: [pid: 82026|app: 0|req: 154/307] 10.222.0.33 () {54 vars in 927 bytes} [Tue Sep 13 19:41:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 19:41:22.313666 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fae79653-1542-42c8-bbb5-cde3b88765e8 None None] Authenticating user token {{(pid=82026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:41:22.348364 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58eeacb3-fe53-46f0-8a0e-37af57c7025f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57539b6a6f3b4d589f5f5e1d211cd6a0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82025) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:41:22.348714 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58eeacb3-fe53-46f0-8a0e-37af57c7025f None admin] REQUEST_METHOD: `GET` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:41:22.348965 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58eeacb3-fe53-46f0-8a0e-37af57c7025f None admin] SCRIPT_NAME: `/identity` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:41:22.349238 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58eeacb3-fe53-46f0-8a0e-37af57c7025f None admin] PATH_INFO: `/v3/roles` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:41:22.349902 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58eeacb3-fe53-46f0-8a0e-37af57c7025f None admin] RBAC: Adding query filter params (name=reader) {{(pid=82025) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 19:41:22.350219 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58eeacb3-fe53-46f0-8a0e-37af57c7025f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:41:22.351602 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58eeacb3-fe53-46f0-8a0e-37af57c7025f None admin] RBAC: Authorization granted {{(pid=82025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:41:22.360430 dv-cinder-828806-6-smb devstack@keystone.service[82025]: [pid: 82025|app: 0|req: 154/308] 10.222.0.33 () {56 vars in 1101 bytes} [Tue Sep 13 19:41:22 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 19:41:22.361484 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed69edda-9320-4b78-8c41-ef974ffb4b60 None None] REQUEST_METHOD: `POST` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:41:22.361774 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed69edda-9320-4b78-8c41-ef974ffb4b60 None None] SCRIPT_NAME: `/identity` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:41:22.362051 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed69edda-9320-4b78-8c41-ef974ffb4b60 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:41:22.365465 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG dbcounter [-] [82026] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82026) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:41:22.380610 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.auth.core [None req-ed69edda-9320-4b78-8c41-ef974ffb4b60 None None] MFA Rules not processed for user `57539b6a6f3b4d589f5f5e1d211cd6a0`. Rule list: `[]` (Enabled: `True`). {{(pid=82025) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 19:41:22.381818 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.fernet_utils [None req-ed69edda-9320-4b78-8c41-ef974ffb4b60 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82025) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 19:41:22.436205 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fae79653-1542-42c8-bbb5-cde3b88765e8 None None] Validating token access rules against request {{(pid=82026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:41:22.457468 dv-cinder-828806-6-smb devstack@keystone.service[82025]: [pid: 82025|app: 0|req: 155/309] 10.222.0.33 () {58 vars in 1024 bytes} [Tue Sep 13 19:41:22 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 13 19:41:22.458148 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed69edda-9320-4b78-8c41-ef974ffb4b60 None None] Authenticating user token {{(pid=82025) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:41:22.477320 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG dbcounter [-] [82025] Writing DB stats keystone:SELECT=100 {{(pid=82025) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:41:22.482809 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24cccb6e-4ee9-4b24-95a9-58833b5978d2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57539b6a6f3b4d589f5f5e1d211cd6a0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:41:22.484346 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24cccb6e-4ee9-4b24-95a9-58833b5978d2 None admin] REQUEST_METHOD: `POST` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:41:22.484979 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24cccb6e-4ee9-4b24-95a9-58833b5978d2 None admin] SCRIPT_NAME: `/identity` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:41:22.485542 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24cccb6e-4ee9-4b24-95a9-58833b5978d2 None admin] PATH_INFO: `/v3/groups` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:41:22.486502 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24cccb6e-4ee9-4b24-95a9-58833b5978d2 None admin] RBAC: Authorizing `identity:create_group()` {{(pid=82026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:41:22.488815 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24cccb6e-4ee9-4b24-95a9-58833b5978d2 None admin] RBAC: Authorization granted {{(pid=82026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:41:22.568393 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed69edda-9320-4b78-8c41-ef974ffb4b60 None None] Validating token access rules against request {{(pid=82025) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:41:22.586333 dv-cinder-828806-6-smb devstack@keystone.service[82026]: [pid: 82026|app: 0|req: 155/310] 10.222.0.33 () {60 vars in 1134 bytes} [Tue Sep 13 19:41:22 2022] POST /identity/v3/groups => generated 229 bytes in 273 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 13 19:41:22.614371 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a479039-94f1-4deb-ab65-ae75affb9e58 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57539b6a6f3b4d589f5f5e1d211cd6a0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82025) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:41:22.615465 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a479039-94f1-4deb-ab65-ae75affb9e58 None admin] REQUEST_METHOD: `GET` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:41:22.615963 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a479039-94f1-4deb-ab65-ae75affb9e58 None admin] SCRIPT_NAME: `/identity` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:41:22.616474 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a479039-94f1-4deb-ab65-ae75affb9e58 None admin] PATH_INFO: `/v3/users/e513e033d2a14a2db9fa6800d80abfef` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:41:22.633918 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a479039-94f1-4deb-ab65-ae75affb9e58 None admin] RBAC: Authorizing `identity:get_user(user_id=e513e033d2a14a2db9fa6800d80abfef)` {{(pid=82025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:41:22.635838 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a479039-94f1-4deb-ab65-ae75affb9e58 None admin] RBAC: Authorization granted {{(pid=82025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:41:22.637948 dv-cinder-828806-6-smb devstack@keystone.service[82025]: [pid: 82025|app: 0|req: 156/311] 10.222.0.33 () {56 vars in 1177 bytes} [Tue Sep 13 19:41:22 2022] GET /identity/v3/users/e513e033d2a14a2db9fa6800d80abfef => generated 293 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 19:41:22.644348 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24cccb6e-4ee9-4b24-95a9-58833b5978d2 None admin] Authenticating user token {{(pid=82026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:41:22.760880 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a479039-94f1-4deb-ab65-ae75affb9e58 None admin] Authenticating user token {{(pid=82025) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:41:22.761833 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG dbcounter [-] [82026] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82026) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:41:22.765486 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24cccb6e-4ee9-4b24-95a9-58833b5978d2 None admin] Validating token access rules against request {{(pid=82026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:41:22.811209 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-429aaba1-65ce-403a-adc6-943ff676abb3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57539b6a6f3b4d589f5f5e1d211cd6a0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:41:22.812087 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-429aaba1-65ce-403a-adc6-943ff676abb3 None admin] REQUEST_METHOD: `GET` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:41:22.812376 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-429aaba1-65ce-403a-adc6-943ff676abb3 None admin] SCRIPT_NAME: `/identity` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:41:22.812659 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-429aaba1-65ce-403a-adc6-943ff676abb3 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:41:22.813409 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-429aaba1-65ce-403a-adc6-943ff676abb3 None admin] RBAC: Adding query filter params (role.id=81338d9374bb480785c7d7aa54829af8, user.id=e513e033d2a14a2db9fa6800d80abfef, scope.system=all) {{(pid=82026) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 19:41:22.813728 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-429aaba1-65ce-403a-adc6-943ff676abb3 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=82026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:41:22.815210 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-429aaba1-65ce-403a-adc6-943ff676abb3 None admin] RBAC: Authorization granted {{(pid=82026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:41:22.821774 dv-cinder-828806-6-smb devstack@keystone.service[82026]: [pid: 82026|app: 0|req: 156/312] 10.222.0.33 () {56 vars in 1308 bytes} [Tue Sep 13 19:41:22 2022] GET /identity/v3/role_assignments?user.id=e513e033d2a14a2db9fa6800d80abfef&scope.system=all&role.id=81338d9374bb480785c7d7aa54829af8 => generated 226 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 19:41:22.869547 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG dbcounter [-] [82025] Writing DB stats keystone:SELECT=100 {{(pid=82025) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:41:22.895336 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a479039-94f1-4deb-ab65-ae75affb9e58 None admin] Validating token access rules against request {{(pid=82025) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:41:22.938181 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8f305f3-923d-4c91-9a80-ac69750d55ae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57539b6a6f3b4d589f5f5e1d211cd6a0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82025) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:41:22.939121 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8f305f3-923d-4c91-9a80-ac69750d55ae None admin] REQUEST_METHOD: `GET` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:41:22.939541 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8f305f3-923d-4c91-9a80-ac69750d55ae None admin] SCRIPT_NAME: `/identity` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:41:22.939971 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8f305f3-923d-4c91-9a80-ac69750d55ae None admin] PATH_INFO: `/v3/roles/reader` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:41:22.952354 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8f305f3-923d-4c91-9a80-ac69750d55ae None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=82025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 13 19:41:22.957825 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application [None req-c8f305f3-923d-4c91-9a80-ac69750d55ae None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Sep 13 19:41:22.957825 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 19:41:22.957825 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 19:41:22.957825 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 19:41:22.957825 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 19:41:22.957825 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 19:41:22.957825 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 19:41:22.957825 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 19:41:22.957825 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 19:41:22.957825 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 19:41:22.957825 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 19:41:22.957825 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 19:41:22.957825 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 13 19:41:22.957825 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 13 19:41:22.957825 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 13 19:41:22.957825 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 13 19:41:22.961538 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 13 19:41:22.961538 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 13 19:41:22.961538 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 13 19:41:22.961538 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 13 19:41:22.961538 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 19:41:22.961538 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 19:41:22.961538 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 19:41:22.961538 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 19:41:22.961538 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 19:41:22.961538 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 19:41:22.961538 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 19:41:22.961538 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application with Lock( Sep 13 19:41:22.961538 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 19:41:22.961538 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application return self._enter() Sep 13 19:41:22.961538 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 19:41:22.961538 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 19:41:22.962333 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 19:41:22.962333 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application return self.creator() Sep 13 19:41:22.962333 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 19:41:22.962333 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application created_value = creator( Sep 13 19:41:22.962333 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 13 19:41:22.962333 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 13 19:41:22.962333 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 13 19:41:22.962333 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 13 19:41:22.962333 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 13 19:41:22.962333 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 13 19:41:22.962333 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Sep 13 19:41:22.962333 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application Sep 13 19:41:22.962333 dv-cinder-828806-6-smb devstack@keystone.service[82025]: [pid: 82025|app: 0|req: 157/313] 10.222.0.33 () {56 vars in 1099 bytes} [Tue Sep 13 19:41:22 2022] GET /identity/v3/roles/reader => generated 84 bytes in 199 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 19:41:22.965872 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-429aaba1-65ce-403a-adc6-943ff676abb3 None admin] Authenticating user token {{(pid=82026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:41:23.101489 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-429aaba1-65ce-403a-adc6-943ff676abb3 None admin] Validating token access rules against request {{(pid=82026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:41:23.137304 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5948f9bf-db73-4541-99f2-fd27c71e53a5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57539b6a6f3b4d589f5f5e1d211cd6a0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:41:23.138227 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5948f9bf-db73-4541-99f2-fd27c71e53a5 None admin] REQUEST_METHOD: `GET` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:41:23.138681 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5948f9bf-db73-4541-99f2-fd27c71e53a5 None admin] SCRIPT_NAME: `/identity` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:41:23.139448 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5948f9bf-db73-4541-99f2-fd27c71e53a5 None admin] PATH_INFO: `/v3/roles` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:41:23.140316 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5948f9bf-db73-4541-99f2-fd27c71e53a5 None admin] RBAC: Adding query filter params (name=reader) {{(pid=82026) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 19:41:23.140857 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5948f9bf-db73-4541-99f2-fd27c71e53a5 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:41:23.142401 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5948f9bf-db73-4541-99f2-fd27c71e53a5 None admin] RBAC: Authorization granted {{(pid=82026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:41:23.151180 dv-cinder-828806-6-smb devstack@keystone.service[82026]: [pid: 82026|app: 0|req: 157/314] 10.222.0.33 () {56 vars in 1101 bytes} [Tue Sep 13 19:41:22 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 13 19:41:23.157666 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8f305f3-923d-4c91-9a80-ac69750d55ae None admin] Authenticating user token {{(pid=82025) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:41:23.267324 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8f305f3-923d-4c91-9a80-ac69750d55ae None admin] Validating token access rules against request {{(pid=82025) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:41:23.304712 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff285e81-6b43-45b1-9788-941a56b4c693 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57539b6a6f3b4d589f5f5e1d211cd6a0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82025) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:41:23.305399 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff285e81-6b43-45b1-9788-941a56b4c693 None admin] REQUEST_METHOD: `GET` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:41:23.305681 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff285e81-6b43-45b1-9788-941a56b4c693 None admin] SCRIPT_NAME: `/identity` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:41:23.305959 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff285e81-6b43-45b1-9788-941a56b4c693 None admin] PATH_INFO: `/v3/users/2d7fb95fe9ca4fa4a5f9938eab41a591` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:41:23.307176 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff285e81-6b43-45b1-9788-941a56b4c693 None admin] RBAC: Authorizing `identity:get_user(user_id=2d7fb95fe9ca4fa4a5f9938eab41a591)` {{(pid=82025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:41:23.308623 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff285e81-6b43-45b1-9788-941a56b4c693 None admin] RBAC: Authorization granted {{(pid=82025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:41:23.310259 dv-cinder-828806-6-smb devstack@keystone.service[82025]: [pid: 82025|app: 0|req: 158/315] 10.222.0.33 () {56 vars in 1177 bytes} [Tue Sep 13 19:41:23 2022] GET /identity/v3/users/2d7fb95fe9ca4fa4a5f9938eab41a591 => generated 297 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 13 19:41:23.316237 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5948f9bf-db73-4541-99f2-fd27c71e53a5 None admin] Authenticating user token {{(pid=82026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:41:23.345534 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG dbcounter [-] [82026] Writing DB stats keystone:SELECT=100 {{(pid=82026) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:41:23.426073 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5948f9bf-db73-4541-99f2-fd27c71e53a5 None admin] Validating token access rules against request {{(pid=82026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:41:23.461264 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a26e80e-c836-4d48-bd5b-050710cf78b6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57539b6a6f3b4d589f5f5e1d211cd6a0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:41:23.461917 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a26e80e-c836-4d48-bd5b-050710cf78b6 None admin] REQUEST_METHOD: `GET` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:41:23.462203 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a26e80e-c836-4d48-bd5b-050710cf78b6 None admin] SCRIPT_NAME: `/identity` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:41:23.462477 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a26e80e-c836-4d48-bd5b-050710cf78b6 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:41:23.532826 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a26e80e-c836-4d48-bd5b-050710cf78b6 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=82026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:41:23.534414 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a26e80e-c836-4d48-bd5b-050710cf78b6 None admin] RBAC: Authorization granted {{(pid=82026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:41:23.559567 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG dbcounter [-] [82026] Writing DB stats keystone:SELECT=100 {{(pid=82026) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:41:23.643402 dv-cinder-828806-6-smb devstack@keystone.service[82026]: [pid: 82026|app: 0|req: 158/316] 10.222.0.33 () {58 vars in 1282 bytes} [Tue Sep 13 19:41:23 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 327 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 13 19:41:23.648107 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff285e81-6b43-45b1-9788-941a56b4c693 None admin] Authenticating user token {{(pid=82025) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:41:23.655526 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG dbcounter [-] [82025] Writing DB stats keystone:SELECT=100 {{(pid=82025) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:41:23.756307 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff285e81-6b43-45b1-9788-941a56b4c693 None admin] Validating token access rules against request {{(pid=82025) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:41:23.796232 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f61bca1d-b110-4509-bd7d-ebf5545aec52 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57539b6a6f3b4d589f5f5e1d211cd6a0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82025) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:41:23.796865 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f61bca1d-b110-4509-bd7d-ebf5545aec52 None admin] REQUEST_METHOD: `GET` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:41:23.797145 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f61bca1d-b110-4509-bd7d-ebf5545aec52 None admin] SCRIPT_NAME: `/identity` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:41:23.797418 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f61bca1d-b110-4509-bd7d-ebf5545aec52 None admin] PATH_INFO: `/v3/projects/bee3101ec8f84efa9f84a402c3c3cbbe` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:41:23.798547 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f61bca1d-b110-4509-bd7d-ebf5545aec52 None admin] RBAC: Authorizing `identity:get_project(project_id=bee3101ec8f84efa9f84a402c3c3cbbe)` {{(pid=82025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:41:23.800023 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f61bca1d-b110-4509-bd7d-ebf5545aec52 None admin] RBAC: Authorization granted {{(pid=82025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:41:23.801966 dv-cinder-828806-6-smb devstack@keystone.service[82025]: [pid: 82025|app: 0|req: 159/317] 10.222.0.33 () {56 vars in 1186 bytes} [Tue Sep 13 19:41:23 2022] GET /identity/v3/projects/bee3101ec8f84efa9f84a402c3c3cbbe => generated 302 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 19:41:23.807829 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a26e80e-c836-4d48-bd5b-050710cf78b6 None admin] Authenticating user token {{(pid=82026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:41:23.912240 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a26e80e-c836-4d48-bd5b-050710cf78b6 None admin] Validating token access rules against request {{(pid=82026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:41:23.939802 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG dbcounter [-] [82026] Writing DB stats keystone:SELECT=100 {{(pid=82026) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:41:23.947484 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc47b771-05c3-4441-ac78-b402e137c18b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57539b6a6f3b4d589f5f5e1d211cd6a0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:41:23.948480 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc47b771-05c3-4441-ac78-b402e137c18b None admin] REQUEST_METHOD: `GET` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:41:23.948770 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc47b771-05c3-4441-ac78-b402e137c18b None admin] SCRIPT_NAME: `/identity` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:41:23.949053 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc47b771-05c3-4441-ac78-b402e137c18b None admin] PATH_INFO: `/v3/role_assignments` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:41:23.949789 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc47b771-05c3-4441-ac78-b402e137c18b None admin] RBAC: Adding query filter params (role.id=81338d9374bb480785c7d7aa54829af8, scope.project.id=bee3101ec8f84efa9f84a402c3c3cbbe, user.id=2d7fb95fe9ca4fa4a5f9938eab41a591) {{(pid=82026) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 19:41:23.950146 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc47b771-05c3-4441-ac78-b402e137c18b None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=82026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:41:23.952540 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc47b771-05c3-4441-ac78-b402e137c18b None admin] RBAC: Authorization granted {{(pid=82026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:41:23.959197 dv-cinder-828806-6-smb devstack@keystone.service[82026]: [pid: 82026|app: 0|req: 159/318] 10.222.0.33 () {56 vars in 1374 bytes} [Tue Sep 13 19:41:23 2022] GET /identity/v3/role_assignments?user.id=2d7fb95fe9ca4fa4a5f9938eab41a591&scope.project.id=bee3101ec8f84efa9f84a402c3c3cbbe&role.id=81338d9374bb480785c7d7aa54829af8 => generated 608 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 19:41:24.317865 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04fc21cc-f497-45ad-83c2-8a32516a2bc1 None None] REQUEST_METHOD: `GET` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:41:24.318439 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04fc21cc-f497-45ad-83c2-8a32516a2bc1 None None] SCRIPT_NAME: `/identity` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:41:24.318439 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04fc21cc-f497-45ad-83c2-8a32516a2bc1 None None] PATH_INFO: `/` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:41:24.319945 dv-cinder-828806-6-smb devstack@keystone.service[82025]: [pid: 82025|app: 0|req: 160/319] 10.222.0.33 () {54 vars in 927 bytes} [Tue Sep 13 19:41:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 19:41:24.324908 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c95e4664-9d82-4fc5-8b73-06503a498188 None None] REQUEST_METHOD: `POST` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:41:24.325292 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c95e4664-9d82-4fc5-8b73-06503a498188 None None] SCRIPT_NAME: `/identity` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:41:24.325475 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c95e4664-9d82-4fc5-8b73-06503a498188 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:41:24.344814 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.auth.core [None req-c95e4664-9d82-4fc5-8b73-06503a498188 None None] MFA Rules not processed for user `57539b6a6f3b4d589f5f5e1d211cd6a0`. Rule list: `[]` (Enabled: `True`). {{(pid=82026) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 19:41:24.346006 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.common.fernet_utils [None req-c95e4664-9d82-4fc5-8b73-06503a498188 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82026) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 19:41:24.412445 dv-cinder-828806-6-smb devstack@keystone.service[82026]: [pid: 82026|app: 0|req: 160/320] 10.222.0.33 () {58 vars in 1024 bytes} [Tue Sep 13 19:41:24 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 13 19:41:24.691748 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04fc21cc-f497-45ad-83c2-8a32516a2bc1 None None] Authenticating user token {{(pid=82025) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:41:24.768136 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG dbcounter [-] [82025] Writing DB stats keystone:SELECT=100 {{(pid=82025) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:41:24.802565 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04fc21cc-f497-45ad-83c2-8a32516a2bc1 None None] Validating token access rules against request {{(pid=82025) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:41:24.837697 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b793ff7-894b-49a8-b7d4-958c49b3b0e8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57539b6a6f3b4d589f5f5e1d211cd6a0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82025) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:41:24.838327 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b793ff7-894b-49a8-b7d4-958c49b3b0e8 None admin] REQUEST_METHOD: `GET` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:41:24.838610 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b793ff7-894b-49a8-b7d4-958c49b3b0e8 None admin] SCRIPT_NAME: `/identity` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:41:24.838888 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b793ff7-894b-49a8-b7d4-958c49b3b0e8 None admin] PATH_INFO: `/v3/roles/member` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:41:24.850131 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b793ff7-894b-49a8-b7d4-958c49b3b0e8 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=82025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 13 19:41:24.855464 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application [None req-4b793ff7-894b-49a8-b7d4-958c49b3b0e8 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 13 19:41:24.855464 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 19:41:24.855464 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 19:41:24.855464 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 19:41:24.855464 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 19:41:24.855464 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 19:41:24.855464 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 19:41:24.855464 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 19:41:24.855464 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 19:41:24.855464 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 19:41:24.855464 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 19:41:24.855464 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 19:41:24.855464 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 13 19:41:24.855464 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 13 19:41:24.855464 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 13 19:41:24.855464 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 13 19:41:24.856355 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 13 19:41:24.856355 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 13 19:41:24.856355 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 13 19:41:24.856355 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 13 19:41:24.856355 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 19:41:24.856355 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 19:41:24.856355 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 19:41:24.856355 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 19:41:24.856355 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 19:41:24.856355 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 19:41:24.856355 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 19:41:24.856355 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application with Lock( Sep 13 19:41:24.856355 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 19:41:24.856355 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application return self._enter() Sep 13 19:41:24.856355 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 19:41:24.856355 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 19:41:24.857184 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 19:41:24.857184 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application return self.creator() Sep 13 19:41:24.857184 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 19:41:24.857184 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application created_value = creator( Sep 13 19:41:24.857184 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 13 19:41:24.857184 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 13 19:41:24.857184 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 13 19:41:24.857184 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 13 19:41:24.857184 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 13 19:41:24.857184 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 13 19:41:24.857184 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 13 19:41:24.857184 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application Sep 13 19:41:24.857184 dv-cinder-828806-6-smb devstack@keystone.service[82025]: [pid: 82025|app: 0|req: 161/321] 10.222.0.33 () {56 vars in 1099 bytes} [Tue Sep 13 19:41:24 2022] GET /identity/v3/roles/member => generated 84 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 13 19:41:24.864650 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c95e4664-9d82-4fc5-8b73-06503a498188 None None] Authenticating user token {{(pid=82026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:41:24.881737 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57a4eaa9-eb91-43d0-bddc-d7083503fe76 None None] REQUEST_METHOD: `GET` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:41:24.882028 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57a4eaa9-eb91-43d0-bddc-d7083503fe76 None None] SCRIPT_NAME: `/identity` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:41:24.882343 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57a4eaa9-eb91-43d0-bddc-d7083503fe76 None None] PATH_INFO: `/` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:41:24.883853 dv-cinder-828806-6-smb devstack@keystone.service[82025]: [pid: 82025|app: 0|req: 162/322] 10.222.0.33 () {54 vars in 927 bytes} [Tue Sep 13 19:41:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 19:41:24.888649 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79548646-7b33-4e84-9724-a380204ff616 None None] REQUEST_METHOD: `POST` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:41:24.889582 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79548646-7b33-4e84-9724-a380204ff616 None None] SCRIPT_NAME: `/identity` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:41:24.890062 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79548646-7b33-4e84-9724-a380204ff616 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:41:24.909299 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.auth.core [None req-79548646-7b33-4e84-9724-a380204ff616 None None] MFA Rules not processed for user `57539b6a6f3b4d589f5f5e1d211cd6a0`. Rule list: `[]` (Enabled: `True`). {{(pid=82025) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 19:41:24.910502 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.fernet_utils [None req-79548646-7b33-4e84-9724-a380204ff616 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82025) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 19:41:24.976271 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c95e4664-9d82-4fc5-8b73-06503a498188 None None] Validating token access rules against request {{(pid=82026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:41:24.989805 dv-cinder-828806-6-smb devstack@keystone.service[82025]: [pid: 82025|app: 0|req: 163/323] 10.222.0.33 () {58 vars in 1024 bytes} [Tue Sep 13 19:41:24 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 13 19:41:25.001514 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG dbcounter [-] [82026] Writing DB stats keystone:SELECT=100 {{(pid=82026) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:41:25.021622 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfd3f534-2acc-49fe-83df-d71a66083c8c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57539b6a6f3b4d589f5f5e1d211cd6a0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:41:25.022250 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfd3f534-2acc-49fe-83df-d71a66083c8c None admin] REQUEST_METHOD: `GET` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:41:25.022535 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfd3f534-2acc-49fe-83df-d71a66083c8c None admin] SCRIPT_NAME: `/identity` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:41:25.022813 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfd3f534-2acc-49fe-83df-d71a66083c8c None admin] PATH_INFO: `/v3/roles` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:41:25.023530 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfd3f534-2acc-49fe-83df-d71a66083c8c None admin] RBAC: Adding query filter params (name=member) {{(pid=82026) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 19:41:25.023846 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfd3f534-2acc-49fe-83df-d71a66083c8c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:41:25.025240 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfd3f534-2acc-49fe-83df-d71a66083c8c None admin] RBAC: Authorization granted {{(pid=82026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:41:25.038938 dv-cinder-828806-6-smb devstack@keystone.service[82026]: [pid: 82026|app: 0|req: 161/324] 10.222.0.33 () {56 vars in 1101 bytes} [Tue Sep 13 19:41:24 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 19:41:25.040171 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79548646-7b33-4e84-9724-a380204ff616 None None] Authenticating user token {{(pid=82025) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:41:25.094868 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0917f12b-d356-4954-86a5-fee78fc3ac25 None None] REQUEST_METHOD: `GET` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:41:25.095188 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0917f12b-d356-4954-86a5-fee78fc3ac25 None None] SCRIPT_NAME: `/identity` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:41:25.095469 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0917f12b-d356-4954-86a5-fee78fc3ac25 None None] PATH_INFO: `/` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:41:25.096955 dv-cinder-828806-6-smb devstack@keystone.service[82026]: [pid: 82026|app: 0|req: 162/325] 10.222.0.33 () {54 vars in 927 bytes} [Tue Sep 13 19:41:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 13 19:41:25.101734 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04b6490f-52dd-4b47-a6b4-23e598e5312a None None] REQUEST_METHOD: `POST` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:41:25.102022 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04b6490f-52dd-4b47-a6b4-23e598e5312a None None] SCRIPT_NAME: `/identity` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:41:25.102298 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04b6490f-52dd-4b47-a6b4-23e598e5312a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:41:25.106057 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG dbcounter [-] [82025] Writing DB stats keystone:SELECT=100 {{(pid=82025) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:41:25.121165 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.auth.core [None req-04b6490f-52dd-4b47-a6b4-23e598e5312a None None] MFA Rules not processed for user `57539b6a6f3b4d589f5f5e1d211cd6a0`. Rule list: `[]` (Enabled: `True`). {{(pid=82026) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 19:41:25.122358 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.common.fernet_utils [None req-04b6490f-52dd-4b47-a6b4-23e598e5312a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82026) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 19:41:25.146553 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79548646-7b33-4e84-9724-a380204ff616 None None] Validating token access rules against request {{(pid=82025) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:41:25.184614 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ceb9f2c1-4c5a-4b36-a692-2d36f720ec29 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57539b6a6f3b4d589f5f5e1d211cd6a0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82025) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:41:25.185249 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceb9f2c1-4c5a-4b36-a692-2d36f720ec29 None admin] REQUEST_METHOD: `GET` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:41:25.185535 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceb9f2c1-4c5a-4b36-a692-2d36f720ec29 None admin] SCRIPT_NAME: `/identity` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:41:25.185904 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceb9f2c1-4c5a-4b36-a692-2d36f720ec29 None admin] PATH_INFO: `/v3/users/b271a8d9f1484f09a9b5b75d3d1a7687` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:41:25.187101 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ceb9f2c1-4c5a-4b36-a692-2d36f720ec29 None admin] RBAC: Authorizing `identity:get_user(user_id=b271a8d9f1484f09a9b5b75d3d1a7687)` {{(pid=82025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:41:25.188538 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ceb9f2c1-4c5a-4b36-a692-2d36f720ec29 None admin] RBAC: Authorization granted {{(pid=82025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:41:25.190101 dv-cinder-828806-6-smb devstack@keystone.service[82025]: [pid: 82025|app: 0|req: 164/326] 10.222.0.33 () {56 vars in 1177 bytes} [Tue Sep 13 19:41:25 2022] GET /identity/v3/users/b271a8d9f1484f09a9b5b75d3d1a7687 => generated 293 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 19:41:25.195292 dv-cinder-828806-6-smb devstack@keystone.service[82026]: [pid: 82026|app: 0|req: 163/327] 10.222.0.33 () {58 vars in 1024 bytes} [Tue Sep 13 19:41:25 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 13 19:41:25.196806 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ceb9f2c1-4c5a-4b36-a692-2d36f720ec29 None admin] Authenticating user token {{(pid=82025) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:41:25.262483 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04b6490f-52dd-4b47-a6b4-23e598e5312a None None] Authenticating user token {{(pid=82026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:41:25.305042 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ceb9f2c1-4c5a-4b36-a692-2d36f720ec29 None admin] Validating token access rules against request {{(pid=82025) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:41:25.333952 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG dbcounter [-] [82025] Writing DB stats keystone:SELECT=100 {{(pid=82025) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:41:25.339758 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acb0043f-7955-40a9-8406-1aa6bd4be3c0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57539b6a6f3b4d589f5f5e1d211cd6a0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82025) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:41:25.340676 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acb0043f-7955-40a9-8406-1aa6bd4be3c0 None admin] REQUEST_METHOD: `GET` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:41:25.340961 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acb0043f-7955-40a9-8406-1aa6bd4be3c0 None admin] SCRIPT_NAME: `/identity` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:41:25.341241 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acb0043f-7955-40a9-8406-1aa6bd4be3c0 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:41:25.342464 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acb0043f-7955-40a9-8406-1aa6bd4be3c0 None admin] RBAC: Adding query filter params (role.id=3618ab638a65401f82333da7596d1daf, user.id=b271a8d9f1484f09a9b5b75d3d1a7687, scope.system=all) {{(pid=82025) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 19:41:25.344673 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acb0043f-7955-40a9-8406-1aa6bd4be3c0 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=82025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:41:25.344673 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acb0043f-7955-40a9-8406-1aa6bd4be3c0 None admin] RBAC: Authorization granted {{(pid=82025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:41:25.356364 dv-cinder-828806-6-smb devstack@keystone.service[82025]: [pid: 82025|app: 0|req: 165/328] 10.222.0.33 () {56 vars in 1308 bytes} [Tue Sep 13 19:41:25 2022] GET /identity/v3/role_assignments?user.id=b271a8d9f1484f09a9b5b75d3d1a7687&scope.system=all&role.id=3618ab638a65401f82333da7596d1daf => generated 510 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 13 19:41:25.383682 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04b6490f-52dd-4b47-a6b4-23e598e5312a None None] Validating token access rules against request {{(pid=82026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:41:25.397830 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG dbcounter [-] [82026] Writing DB stats keystone:SELECT=100 {{(pid=82026) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:41:25.423639 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1829408c-40b1-4c76-b541-799c8d059a96 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57539b6a6f3b4d589f5f5e1d211cd6a0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:41:25.424864 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1829408c-40b1-4c76-b541-799c8d059a96 None admin] REQUEST_METHOD: `GET` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:41:25.425515 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1829408c-40b1-4c76-b541-799c8d059a96 None admin] SCRIPT_NAME: `/identity` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:41:25.426609 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1829408c-40b1-4c76-b541-799c8d059a96 None admin] PATH_INFO: `/v3/domains/default` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:41:25.427932 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1829408c-40b1-4c76-b541-799c8d059a96 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=82026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:41:25.429552 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1829408c-40b1-4c76-b541-799c8d059a96 None admin] RBAC: Authorization granted {{(pid=82026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:41:25.435087 dv-cinder-828806-6-smb devstack@keystone.service[82026]: [pid: 82026|app: 0|req: 164/329] 10.222.0.33 () {56 vars in 1108 bytes} [Tue Sep 13 19:41:25 2022] GET /identity/v3/domains/default => generated 199 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 13 19:41:25.437505 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acb0043f-7955-40a9-8406-1aa6bd4be3c0 None admin] Authenticating user token {{(pid=82025) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:41:25.471442 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1829408c-40b1-4c76-b541-799c8d059a96 None admin] Authenticating user token {{(pid=82026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:41:25.562554 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acb0043f-7955-40a9-8406-1aa6bd4be3c0 None admin] Validating token access rules against request {{(pid=82025) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:41:25.583328 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1829408c-40b1-4c76-b541-799c8d059a96 None admin] Validating token access rules against request {{(pid=82026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:41:25.600901 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3fe8d06-c241-4b8c-8704-34a9ed08a7f2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57539b6a6f3b4d589f5f5e1d211cd6a0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82025) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:41:25.601515 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3fe8d06-c241-4b8c-8704-34a9ed08a7f2 None admin] REQUEST_METHOD: `POST` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:41:25.601796 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3fe8d06-c241-4b8c-8704-34a9ed08a7f2 None admin] SCRIPT_NAME: `/identity` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:41:25.602073 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3fe8d06-c241-4b8c-8704-34a9ed08a7f2 None admin] PATH_INFO: `/v3/groups` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:41:25.602716 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3fe8d06-c241-4b8c-8704-34a9ed08a7f2 None admin] RBAC: Authorizing `identity:create_group()` {{(pid=82025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:41:25.604181 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3fe8d06-c241-4b8c-8704-34a9ed08a7f2 None admin] RBAC: Authorization granted {{(pid=82025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:41:25.619232 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b67fd26-dbd1-48ec-ab59-35fff1af1ce4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57539b6a6f3b4d589f5f5e1d211cd6a0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:41:25.619854 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b67fd26-dbd1-48ec-ab59-35fff1af1ce4 None admin] REQUEST_METHOD: `GET` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:41:25.620134 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b67fd26-dbd1-48ec-ab59-35fff1af1ce4 None admin] SCRIPT_NAME: `/identity` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:41:25.620571 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b67fd26-dbd1-48ec-ab59-35fff1af1ce4 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:41:25.630912 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b67fd26-dbd1-48ec-ab59-35fff1af1ce4 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=82026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 13 19:41:25.635733 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application [None req-0b67fd26-dbd1-48ec-ab59-35fff1af1ce4 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Sep 13 19:41:25.635733 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 19:41:25.635733 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 19:41:25.635733 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 19:41:25.635733 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 19:41:25.635733 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 19:41:25.635733 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 19:41:25.635733 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 19:41:25.635733 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 19:41:25.635733 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 19:41:25.635733 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 19:41:25.635733 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 19:41:25.635733 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 13 19:41:25.635733 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 13 19:41:25.635733 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 13 19:41:25.635733 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 13 19:41:25.636735 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 13 19:41:25.636735 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 13 19:41:25.636735 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 13 19:41:25.636735 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 13 19:41:25.636735 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 19:41:25.636735 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 19:41:25.636735 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 19:41:25.636735 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 19:41:25.636735 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 19:41:25.636735 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 19:41:25.636735 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 19:41:25.636735 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application with Lock( Sep 13 19:41:25.636735 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 19:41:25.636735 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application return self._enter() Sep 13 19:41:25.636735 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 19:41:25.636735 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 19:41:25.637770 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 19:41:25.637770 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application return self.creator() Sep 13 19:41:25.637770 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 19:41:25.637770 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application created_value = creator( Sep 13 19:41:25.637770 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 13 19:41:25.637770 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 13 19:41:25.637770 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 13 19:41:25.637770 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 13 19:41:25.637770 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 13 19:41:25.637770 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 13 19:41:25.637770 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Sep 13 19:41:25.637770 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application Sep 13 19:41:25.637770 dv-cinder-828806-6-smb devstack@keystone.service[82026]: [pid: 82026|app: 0|req: 165/330] 10.222.0.33 () {56 vars in 1099 bytes} [Tue Sep 13 19:41:25 2022] GET /identity/v3/roles/reader => generated 84 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 13 19:41:25.642899 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b67fd26-dbd1-48ec-ab59-35fff1af1ce4 None admin] Authenticating user token {{(pid=82026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:41:25.681318 dv-cinder-828806-6-smb devstack@keystone.service[82025]: [pid: 82025|app: 0|req: 166/331] 10.222.0.33 () {60 vars in 1134 bytes} [Tue Sep 13 19:41:25 2022] POST /identity/v3/groups => generated 226 bytes in 244 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 13 19:41:25.685056 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG dbcounter [-] [82026] Writing DB stats keystone:SELECT=100 {{(pid=82026) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:41:25.750626 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b67fd26-dbd1-48ec-ab59-35fff1af1ce4 None admin] Validating token access rules against request {{(pid=82026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:41:25.785933 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2524c2b5-9e5c-4c89-9bef-b67f1691eaad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57539b6a6f3b4d589f5f5e1d211cd6a0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:41:25.786552 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2524c2b5-9e5c-4c89-9bef-b67f1691eaad None admin] REQUEST_METHOD: `GET` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:41:25.786832 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2524c2b5-9e5c-4c89-9bef-b67f1691eaad None admin] SCRIPT_NAME: `/identity` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:41:25.787140 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2524c2b5-9e5c-4c89-9bef-b67f1691eaad None admin] PATH_INFO: `/v3/roles` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:41:25.787817 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2524c2b5-9e5c-4c89-9bef-b67f1691eaad None admin] RBAC: Adding query filter params (name=reader) {{(pid=82026) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 19:41:25.788124 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2524c2b5-9e5c-4c89-9bef-b67f1691eaad None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:41:25.789518 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2524c2b5-9e5c-4c89-9bef-b67f1691eaad None admin] RBAC: Authorization granted {{(pid=82026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:41:25.799055 dv-cinder-828806-6-smb devstack@keystone.service[82026]: [pid: 82026|app: 0|req: 166/332] 10.222.0.33 () {56 vars in 1101 bytes} [Tue Sep 13 19:41:25 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 13 19:41:25.804840 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3fe8d06-c241-4b8c-8704-34a9ed08a7f2 None admin] Authenticating user token {{(pid=82025) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:41:25.858471 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG dbcounter [-] [82025] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82025) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:41:25.912748 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3fe8d06-c241-4b8c-8704-34a9ed08a7f2 None admin] Validating token access rules against request {{(pid=82025) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:41:25.948176 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cbf9cb0-e640-4869-a157-3ff80b3d78a3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57539b6a6f3b4d589f5f5e1d211cd6a0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82025) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:41:25.948820 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cbf9cb0-e640-4869-a157-3ff80b3d78a3 None admin] REQUEST_METHOD: `GET` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:41:25.949106 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cbf9cb0-e640-4869-a157-3ff80b3d78a3 None admin] SCRIPT_NAME: `/identity` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:41:25.949384 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cbf9cb0-e640-4869-a157-3ff80b3d78a3 None admin] PATH_INFO: `/v3/users/e513e033d2a14a2db9fa6800d80abfef` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:41:25.950530 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cbf9cb0-e640-4869-a157-3ff80b3d78a3 None admin] RBAC: Authorizing `identity:get_user(user_id=e513e033d2a14a2db9fa6800d80abfef)` {{(pid=82025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:41:25.952643 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cbf9cb0-e640-4869-a157-3ff80b3d78a3 None admin] RBAC: Authorization granted {{(pid=82025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:41:25.954396 dv-cinder-828806-6-smb devstack@keystone.service[82025]: [pid: 82025|app: 0|req: 167/333] 10.222.0.33 () {56 vars in 1177 bytes} [Tue Sep 13 19:41:25 2022] GET /identity/v3/users/e513e033d2a14a2db9fa6800d80abfef => generated 293 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 19:41:25.960109 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2524c2b5-9e5c-4c89-9bef-b67f1691eaad None admin] Authenticating user token {{(pid=82026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:41:26.074918 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG dbcounter [-] [82026] Writing DB stats keystone:SELECT=100 {{(pid=82026) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:41:26.078348 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2524c2b5-9e5c-4c89-9bef-b67f1691eaad None admin] Validating token access rules against request {{(pid=82026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:41:26.118325 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0932528-6cae-47e9-932d-853dd8a8c9d2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57539b6a6f3b4d589f5f5e1d211cd6a0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:41:26.118910 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0932528-6cae-47e9-932d-853dd8a8c9d2 None admin] REQUEST_METHOD: `PUT` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:41:26.119310 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0932528-6cae-47e9-932d-853dd8a8c9d2 None admin] SCRIPT_NAME: `/identity` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:41:26.119593 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0932528-6cae-47e9-932d-853dd8a8c9d2 None admin] PATH_INFO: `/v3/system/users/e513e033d2a14a2db9fa6800d80abfef/roles/81338d9374bb480785c7d7aa54829af8` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:41:26.121054 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0932528-6cae-47e9-932d-853dd8a8c9d2 None admin] RBAC: Authorizing `identity:create_system_grant_for_user(user_id=e513e033d2a14a2db9fa6800d80abfef, role_id=81338d9374bb480785c7d7aa54829af8)` {{(pid=82026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:41:26.122447 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0932528-6cae-47e9-932d-853dd8a8c9d2 None admin] RBAC: Authorization granted {{(pid=82026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:41:26.191595 dv-cinder-828806-6-smb devstack@keystone.service[82026]: [pid: 82026|app: 0|req: 167/334] 10.222.0.33 () {58 vars in 1334 bytes} [Tue Sep 13 19:41:25 2022] PUT /identity/v3/system/users/e513e033d2a14a2db9fa6800d80abfef/roles/81338d9374bb480785c7d7aa54829af8 => generated 0 bytes in 232 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 19:41:28.239936 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d3a98ac-fa7c-4f57-8b71-e79b63c13a11 None None] REQUEST_METHOD: `GET` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:41:28.240942 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d3a98ac-fa7c-4f57-8b71-e79b63c13a11 None None] SCRIPT_NAME: `/identity` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:41:28.241426 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d3a98ac-fa7c-4f57-8b71-e79b63c13a11 None None] PATH_INFO: `/` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:41:28.243311 dv-cinder-828806-6-smb devstack@keystone.service[82025]: [pid: 82025|app: 0|req: 168/335] 10.222.0.33 () {54 vars in 927 bytes} [Tue Sep 13 19:41:28 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 19:41:28.248507 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3799659f-ba93-459e-b6dd-ce7d59a1fbd8 None None] REQUEST_METHOD: `POST` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:41:28.249434 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3799659f-ba93-459e-b6dd-ce7d59a1fbd8 None None] SCRIPT_NAME: `/identity` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:41:28.249910 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3799659f-ba93-459e-b6dd-ce7d59a1fbd8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:41:28.272877 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.auth.core [None req-3799659f-ba93-459e-b6dd-ce7d59a1fbd8 None None] MFA Rules not processed for user `57539b6a6f3b4d589f5f5e1d211cd6a0`. Rule list: `[]` (Enabled: `True`). {{(pid=82026) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 19:41:28.274417 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.common.fernet_utils [None req-3799659f-ba93-459e-b6dd-ce7d59a1fbd8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82026) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 19:41:28.365318 dv-cinder-828806-6-smb devstack@keystone.service[82026]: [pid: 82026|app: 0|req: 168/336] 10.222.0.33 () {58 vars in 1024 bytes} [Tue Sep 13 19:41:28 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 13 19:41:28.817924 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daed4f72-5321-4349-9ccc-c9a9a088b6b9 None None] REQUEST_METHOD: `GET` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:41:28.821644 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daed4f72-5321-4349-9ccc-c9a9a088b6b9 None None] SCRIPT_NAME: `/identity` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:41:28.821644 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daed4f72-5321-4349-9ccc-c9a9a088b6b9 None None] PATH_INFO: `/` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:41:28.821644 dv-cinder-828806-6-smb devstack@keystone.service[82025]: [pid: 82025|app: 0|req: 169/337] 10.222.0.33 () {54 vars in 927 bytes} [Tue Sep 13 19:41:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 19:41:28.825776 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75cbe19f-aeb7-4ff8-bb80-69273e1b9ba1 None None] REQUEST_METHOD: `POST` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:41:28.826344 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75cbe19f-aeb7-4ff8-bb80-69273e1b9ba1 None None] SCRIPT_NAME: `/identity` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:41:28.827361 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75cbe19f-aeb7-4ff8-bb80-69273e1b9ba1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:41:28.850674 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.auth.core [None req-75cbe19f-aeb7-4ff8-bb80-69273e1b9ba1 None None] MFA Rules not processed for user `57539b6a6f3b4d589f5f5e1d211cd6a0`. Rule list: `[]` (Enabled: `True`). {{(pid=82026) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 19:41:28.852231 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.common.fernet_utils [None req-75cbe19f-aeb7-4ff8-bb80-69273e1b9ba1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82026) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 19:41:28.911883 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daed4f72-5321-4349-9ccc-c9a9a088b6b9 None None] Authenticating user token {{(pid=82025) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:41:28.942919 dv-cinder-828806-6-smb devstack@keystone.service[82026]: [pid: 82026|app: 0|req: 169/338] 10.222.0.33 () {58 vars in 1024 bytes} [Tue Sep 13 19:41:28 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 13 19:41:28.951206 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0d640c2-32a2-4630-9a95-50dac9cec1e3 None None] REQUEST_METHOD: `GET` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:41:28.951820 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0d640c2-32a2-4630-9a95-50dac9cec1e3 None None] SCRIPT_NAME: `/identity` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:41:28.952374 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0d640c2-32a2-4630-9a95-50dac9cec1e3 None None] PATH_INFO: `/` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:41:28.954240 dv-cinder-828806-6-smb devstack@keystone.service[82026]: [pid: 82026|app: 0|req: 170/339] 10.222.0.33 () {54 vars in 927 bytes} [Tue Sep 13 19:41:28 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 19:41:28.959779 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58ade705-6abd-42e4-a1d8-23500608d7dd None None] REQUEST_METHOD: `POST` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:41:28.960302 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58ade705-6abd-42e4-a1d8-23500608d7dd None None] SCRIPT_NAME: `/identity` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:41:28.960772 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58ade705-6abd-42e4-a1d8-23500608d7dd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:41:28.984722 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.auth.core [None req-58ade705-6abd-42e4-a1d8-23500608d7dd None None] MFA Rules not processed for user `57539b6a6f3b4d589f5f5e1d211cd6a0`. Rule list: `[]` (Enabled: `True`). {{(pid=82026) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 19:41:28.986271 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.common.fernet_utils [None req-58ade705-6abd-42e4-a1d8-23500608d7dd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82026) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 19:41:29.011605 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG dbcounter [-] [82026] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82026) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:41:29.080448 dv-cinder-828806-6-smb devstack@keystone.service[82026]: [pid: 82026|app: 0|req: 171/340] 10.222.0.33 () {58 vars in 1024 bytes} [Tue Sep 13 19:41:28 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 13 19:41:29.114003 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e959117d-5f7a-4cfc-b6a9-df657b7aec3e None None] REQUEST_METHOD: `GET` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:41:29.114360 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e959117d-5f7a-4cfc-b6a9-df657b7aec3e None None] SCRIPT_NAME: `/identity` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:41:29.115007 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e959117d-5f7a-4cfc-b6a9-df657b7aec3e None None] PATH_INFO: `/` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:41:29.116291 dv-cinder-828806-6-smb devstack@keystone.service[82026]: [pid: 82026|app: 0|req: 172/341] 10.222.0.33 () {54 vars in 927 bytes} [Tue Sep 13 19:41:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 19:41:29.118824 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daed4f72-5321-4349-9ccc-c9a9a088b6b9 None None] Validating token access rules against request {{(pid=82025) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:41:29.124723 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4412559b-74c9-4857-bddc-bcca4f9d7993 None None] REQUEST_METHOD: `POST` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:41:29.124723 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4412559b-74c9-4857-bddc-bcca4f9d7993 None None] SCRIPT_NAME: `/identity` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:41:29.124956 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4412559b-74c9-4857-bddc-bcca4f9d7993 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:41:29.146250 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG dbcounter [-] [82025] Writing DB stats keystone:SELECT=100 {{(pid=82025) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:41:29.162056 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.auth.core [None req-4412559b-74c9-4857-bddc-bcca4f9d7993 None None] MFA Rules not processed for user `57539b6a6f3b4d589f5f5e1d211cd6a0`. Rule list: `[]` (Enabled: `True`). {{(pid=82026) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 19:41:29.163454 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.common.fernet_utils [None req-4412559b-74c9-4857-bddc-bcca4f9d7993 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82026) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 19:41:29.174714 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f02c0b43-8d26-47d1-927b-1b770de67722 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57539b6a6f3b4d589f5f5e1d211cd6a0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82025) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:41:29.175441 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f02c0b43-8d26-47d1-927b-1b770de67722 None admin] REQUEST_METHOD: `GET` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:41:29.175727 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f02c0b43-8d26-47d1-927b-1b770de67722 None admin] SCRIPT_NAME: `/identity` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:41:29.176052 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f02c0b43-8d26-47d1-927b-1b770de67722 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:41:29.195995 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f02c0b43-8d26-47d1-927b-1b770de67722 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=82025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 13 19:41:29.200991 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application [None req-f02c0b43-8d26-47d1-927b-1b770de67722 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 13 19:41:29.200991 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 19:41:29.200991 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 19:41:29.200991 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 19:41:29.200991 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 19:41:29.200991 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 19:41:29.200991 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 19:41:29.200991 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 19:41:29.200991 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 19:41:29.200991 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 19:41:29.200991 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 19:41:29.200991 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 19:41:29.200991 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 13 19:41:29.200991 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 13 19:41:29.200991 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 13 19:41:29.200991 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 13 19:41:29.202058 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 13 19:41:29.202058 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 13 19:41:29.202058 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 13 19:41:29.202058 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 13 19:41:29.202058 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 19:41:29.202058 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 19:41:29.202058 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 19:41:29.202058 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 19:41:29.202058 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 19:41:29.202058 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 19:41:29.202058 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 19:41:29.202058 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application with Lock( Sep 13 19:41:29.202058 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 19:41:29.202058 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application return self._enter() Sep 13 19:41:29.202058 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 19:41:29.202058 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 19:41:29.202859 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 19:41:29.202859 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application return self.creator() Sep 13 19:41:29.202859 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 19:41:29.202859 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application created_value = creator( Sep 13 19:41:29.202859 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 13 19:41:29.202859 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 13 19:41:29.202859 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 13 19:41:29.202859 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 13 19:41:29.202859 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 13 19:41:29.202859 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 13 19:41:29.202859 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 13 19:41:29.202859 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application Sep 13 19:41:29.202859 dv-cinder-828806-6-smb devstack@keystone.service[82025]: [pid: 82025|app: 0|req: 170/342] 10.222.0.33 () {56 vars in 1114 bytes} [Tue Sep 13 19:41:28 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 293 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 19:41:29.211282 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f02c0b43-8d26-47d1-927b-1b770de67722 None admin] Authenticating user token {{(pid=82025) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:41:29.338442 dv-cinder-828806-6-smb devstack@keystone.service[82026]: [pid: 82026|app: 0|req: 173/343] 10.222.0.33 () {58 vars in 1024 bytes} [Tue Sep 13 19:41:29 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 215 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 13 19:41:29.403219 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f02c0b43-8d26-47d1-927b-1b770de67722 None admin] Validating token access rules against request {{(pid=82025) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:41:29.447281 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26af1359-8ed5-4483-a653-c5ac9b3a03c3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57539b6a6f3b4d589f5f5e1d211cd6a0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82025) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:41:29.447909 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26af1359-8ed5-4483-a653-c5ac9b3a03c3 None admin] REQUEST_METHOD: `GET` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:41:29.448190 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26af1359-8ed5-4483-a653-c5ac9b3a03c3 None admin] SCRIPT_NAME: `/identity` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:41:29.448507 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26af1359-8ed5-4483-a653-c5ac9b3a03c3 None admin] PATH_INFO: `/v3/roles` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:41:29.449194 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26af1359-8ed5-4483-a653-c5ac9b3a03c3 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=82025) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 19:41:29.449502 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26af1359-8ed5-4483-a653-c5ac9b3a03c3 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:41:29.450913 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26af1359-8ed5-4483-a653-c5ac9b3a03c3 None admin] RBAC: Authorization granted {{(pid=82025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:41:29.464088 dv-cinder-828806-6-smb devstack@keystone.service[82025]: [pid: 82025|app: 0|req: 171/344] 10.222.0.33 () {56 vars in 1111 bytes} [Tue Sep 13 19:41:29 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 253 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 13 19:41:29.470359 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4412559b-74c9-4857-bddc-bcca4f9d7993 None None] Authenticating user token {{(pid=82026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:41:29.482494 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26af1359-8ed5-4483-a653-c5ac9b3a03c3 None admin] Authenticating user token {{(pid=82025) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:41:29.543381 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG dbcounter [-] [82025] Writing DB stats keystone:SELECT=100 {{(pid=82025) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:41:29.625658 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26af1359-8ed5-4483-a653-c5ac9b3a03c3 None admin] Validating token access rules against request {{(pid=82025) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:41:29.638490 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG dbcounter [-] [82026] Writing DB stats keystone:SELECT=100 {{(pid=82026) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:41:29.658569 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4412559b-74c9-4857-bddc-bcca4f9d7993 None None] Validating token access rules against request {{(pid=82026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:41:29.682857 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38470157-b616-4f79-90bd-c0e14598c8dc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57539b6a6f3b4d589f5f5e1d211cd6a0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82025) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:41:29.684712 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38470157-b616-4f79-90bd-c0e14598c8dc None admin] REQUEST_METHOD: `GET` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:41:29.685172 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38470157-b616-4f79-90bd-c0e14598c8dc None admin] SCRIPT_NAME: `/identity` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:41:29.687652 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38470157-b616-4f79-90bd-c0e14598c8dc None admin] PATH_INFO: `/v3/roles/reader` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:41:29.709372 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38470157-b616-4f79-90bd-c0e14598c8dc None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=82025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 13 19:41:29.715483 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application [None req-38470157-b616-4f79-90bd-c0e14598c8dc None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Sep 13 19:41:29.715483 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 19:41:29.715483 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 19:41:29.715483 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 19:41:29.715483 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 19:41:29.715483 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 19:41:29.715483 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 19:41:29.715483 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 19:41:29.715483 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 19:41:29.715483 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 19:41:29.715483 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 19:41:29.715483 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 19:41:29.715483 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 13 19:41:29.715483 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 13 19:41:29.715483 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 13 19:41:29.715483 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 13 19:41:29.716346 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 13 19:41:29.716346 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 13 19:41:29.716346 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 13 19:41:29.716346 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 13 19:41:29.716346 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 19:41:29.716346 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 19:41:29.716346 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 19:41:29.716346 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 19:41:29.716346 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 19:41:29.716346 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 19:41:29.716346 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 19:41:29.716346 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application with Lock( Sep 13 19:41:29.716346 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 19:41:29.716346 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application return self._enter() Sep 13 19:41:29.716346 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 19:41:29.716346 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 19:41:29.717931 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 19:41:29.717931 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application return self.creator() Sep 13 19:41:29.717931 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 19:41:29.717931 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application created_value = creator( Sep 13 19:41:29.717931 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 13 19:41:29.717931 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 13 19:41:29.717931 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 13 19:41:29.717931 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 13 19:41:29.717931 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 13 19:41:29.717931 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 13 19:41:29.717931 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Sep 13 19:41:29.717931 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application Sep 13 19:41:29.720764 dv-cinder-828806-6-smb devstack@keystone.service[82025]: [pid: 82025|app: 0|req: 172/345] 10.222.0.33 () {56 vars in 1099 bytes} [Tue Sep 13 19:41:29 2022] GET /identity/v3/roles/reader => generated 84 bytes in 239 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 13 19:41:29.721869 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38470157-b616-4f79-90bd-c0e14598c8dc None admin] Authenticating user token {{(pid=82025) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:41:29.740086 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e73ce24-20da-4aad-89cd-98456e76a9dc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57539b6a6f3b4d589f5f5e1d211cd6a0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:41:29.741010 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e73ce24-20da-4aad-89cd-98456e76a9dc None admin] REQUEST_METHOD: `GET` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:41:29.741523 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e73ce24-20da-4aad-89cd-98456e76a9dc None admin] SCRIPT_NAME: `/identity` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:41:29.741953 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e73ce24-20da-4aad-89cd-98456e76a9dc None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:41:29.844049 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e73ce24-20da-4aad-89cd-98456e76a9dc None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=82026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:41:29.845797 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e73ce24-20da-4aad-89cd-98456e76a9dc None admin] RBAC: Authorization granted {{(pid=82026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:41:29.874322 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG dbcounter [-] [82025] Writing DB stats keystone:SELECT=100 {{(pid=82025) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:41:29.878926 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38470157-b616-4f79-90bd-c0e14598c8dc None admin] Validating token access rules against request {{(pid=82025) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:41:29.917098 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54ba2d96-a432-48a5-8021-549299d19170 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57539b6a6f3b4d589f5f5e1d211cd6a0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82025) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:41:29.917328 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54ba2d96-a432-48a5-8021-549299d19170 None admin] REQUEST_METHOD: `GET` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:41:29.917662 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54ba2d96-a432-48a5-8021-549299d19170 None admin] SCRIPT_NAME: `/identity` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:41:29.918008 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54ba2d96-a432-48a5-8021-549299d19170 None admin] PATH_INFO: `/v3/roles/member` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:41:29.930294 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54ba2d96-a432-48a5-8021-549299d19170 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=82025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 13 19:41:29.938216 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application [None req-54ba2d96-a432-48a5-8021-549299d19170 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 13 19:41:29.938216 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 19:41:29.938216 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 19:41:29.938216 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 19:41:29.938216 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 19:41:29.938216 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 19:41:29.938216 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 19:41:29.938216 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 19:41:29.938216 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 19:41:29.938216 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 19:41:29.938216 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 19:41:29.938216 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 19:41:29.938216 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 13 19:41:29.938216 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 13 19:41:29.938216 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 13 19:41:29.938216 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 13 19:41:29.939162 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 13 19:41:29.939162 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 13 19:41:29.939162 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 13 19:41:29.939162 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 13 19:41:29.939162 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 19:41:29.939162 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 19:41:29.939162 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 19:41:29.939162 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 19:41:29.939162 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 19:41:29.939162 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 19:41:29.939162 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 19:41:29.939162 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application with Lock( Sep 13 19:41:29.939162 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 19:41:29.939162 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application return self._enter() Sep 13 19:41:29.939162 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 19:41:29.939162 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 19:41:29.940042 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 19:41:29.940042 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application return self.creator() Sep 13 19:41:29.940042 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 19:41:29.940042 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application created_value = creator( Sep 13 19:41:29.940042 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 13 19:41:29.940042 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 13 19:41:29.940042 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 13 19:41:29.940042 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 13 19:41:29.940042 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 13 19:41:29.940042 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 13 19:41:29.940042 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 13 19:41:29.940042 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application Sep 13 19:41:29.940042 dv-cinder-828806-6-smb devstack@keystone.service[82025]: [pid: 82025|app: 0|req: 173/346] 10.222.0.33 () {56 vars in 1099 bytes} [Tue Sep 13 19:41:29 2022] GET /identity/v3/roles/member => generated 84 bytes in 218 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 19:41:29.940704 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54ba2d96-a432-48a5-8021-549299d19170 None admin] Authenticating user token {{(pid=82025) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:41:29.941650 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG dbcounter [-] [82026] Writing DB stats keystone:SELECT=100 {{(pid=82026) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:41:29.965407 dv-cinder-828806-6-smb devstack@keystone.service[82026]: [pid: 82026|app: 0|req: 174/347] 10.222.0.33 () {58 vars in 1282 bytes} [Tue Sep 13 19:41:29 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 495 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 13 19:41:29.966592 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e73ce24-20da-4aad-89cd-98456e76a9dc None admin] Authenticating user token {{(pid=82026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:41:30.053820 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54ba2d96-a432-48a5-8021-549299d19170 None admin] Validating token access rules against request {{(pid=82025) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:41:30.080693 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e73ce24-20da-4aad-89cd-98456e76a9dc None admin] Validating token access rules against request {{(pid=82026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:41:30.099232 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-268c8c97-88e9-48fc-bf79-dfa3c0114688 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57539b6a6f3b4d589f5f5e1d211cd6a0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82025) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:41:30.100251 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-268c8c97-88e9-48fc-bf79-dfa3c0114688 None admin] REQUEST_METHOD: `GET` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:41:30.100251 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-268c8c97-88e9-48fc-bf79-dfa3c0114688 None admin] SCRIPT_NAME: `/identity` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:41:30.100540 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-268c8c97-88e9-48fc-bf79-dfa3c0114688 None admin] PATH_INFO: `/v3/roles` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:41:30.101225 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-268c8c97-88e9-48fc-bf79-dfa3c0114688 None admin] RBAC: Adding query filter params (name=reader) {{(pid=82025) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 19:41:30.101532 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-268c8c97-88e9-48fc-bf79-dfa3c0114688 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:41:30.102973 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-268c8c97-88e9-48fc-bf79-dfa3c0114688 None admin] RBAC: Authorization granted {{(pid=82025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:41:30.116505 dv-cinder-828806-6-smb devstack@keystone.service[82025]: [pid: 82025|app: 0|req: 174/348] 10.222.0.33 () {56 vars in 1101 bytes} [Tue Sep 13 19:41:29 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 19:41:30.122080 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-268c8c97-88e9-48fc-bf79-dfa3c0114688 None admin] Authenticating user token {{(pid=82025) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:41:30.129235 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cda6601-6138-4e36-bbd8-f101200cabb2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57539b6a6f3b4d589f5f5e1d211cd6a0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:41:30.130181 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cda6601-6138-4e36-bbd8-f101200cabb2 None admin] REQUEST_METHOD: `GET` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:41:30.130675 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cda6601-6138-4e36-bbd8-f101200cabb2 None admin] SCRIPT_NAME: `/identity` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:41:30.131171 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cda6601-6138-4e36-bbd8-f101200cabb2 None admin] PATH_INFO: `/v3/roles/member` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:41:30.143253 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cda6601-6138-4e36-bbd8-f101200cabb2 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=82026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 13 19:41:30.147932 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG dbcounter [-] [82025] Writing DB stats keystone:SELECT=100 {{(pid=82025) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:41:30.149032 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application [None req-7cda6601-6138-4e36-bbd8-f101200cabb2 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 13 19:41:30.149032 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 19:41:30.149032 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 19:41:30.149032 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 19:41:30.149032 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 19:41:30.149032 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 19:41:30.149032 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 19:41:30.149032 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 19:41:30.149032 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 19:41:30.149032 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 19:41:30.149032 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 19:41:30.149032 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 19:41:30.149032 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 13 19:41:30.149032 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 13 19:41:30.149032 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 13 19:41:30.149032 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 13 19:41:30.149890 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 13 19:41:30.149890 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 13 19:41:30.149890 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 13 19:41:30.149890 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 13 19:41:30.149890 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 19:41:30.149890 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 19:41:30.149890 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 19:41:30.149890 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 19:41:30.149890 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 19:41:30.149890 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 19:41:30.149890 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 19:41:30.149890 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application with Lock( Sep 13 19:41:30.149890 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 19:41:30.149890 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application return self._enter() Sep 13 19:41:30.149890 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 19:41:30.149890 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 19:41:30.150672 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 19:41:30.150672 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application return self.creator() Sep 13 19:41:30.150672 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 19:41:30.150672 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application created_value = creator( Sep 13 19:41:30.150672 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 13 19:41:30.150672 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 13 19:41:30.150672 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 13 19:41:30.150672 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 13 19:41:30.150672 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 13 19:41:30.150672 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 13 19:41:30.150672 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 13 19:41:30.150672 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application Sep 13 19:41:30.153033 dv-cinder-828806-6-smb devstack@keystone.service[82026]: [pid: 82026|app: 0|req: 175/349] 10.222.0.33 () {56 vars in 1099 bytes} [Tue Sep 13 19:41:29 2022] GET /identity/v3/roles/member => generated 84 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 19:41:30.154024 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cda6601-6138-4e36-bbd8-f101200cabb2 None admin] Authenticating user token {{(pid=82026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:41:30.205262 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG dbcounter [-] [82026] Writing DB stats keystone:SELECT=100 {{(pid=82026) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:41:30.235455 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-268c8c97-88e9-48fc-bf79-dfa3c0114688 None admin] Validating token access rules against request {{(pid=82025) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:41:30.262851 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cda6601-6138-4e36-bbd8-f101200cabb2 None admin] Validating token access rules against request {{(pid=82026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:41:30.277785 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73685ef9-76e3-4892-a274-ff3b253ee77c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57539b6a6f3b4d589f5f5e1d211cd6a0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82025) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:41:30.277785 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73685ef9-76e3-4892-a274-ff3b253ee77c None admin] REQUEST_METHOD: `GET` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:41:30.277785 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73685ef9-76e3-4892-a274-ff3b253ee77c None admin] SCRIPT_NAME: `/identity` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:41:30.278126 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73685ef9-76e3-4892-a274-ff3b253ee77c None admin] PATH_INFO: `/v3/roles` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:41:30.278737 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73685ef9-76e3-4892-a274-ff3b253ee77c None admin] RBAC: Adding query filter params (name=member) {{(pid=82025) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 19:41:30.279063 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73685ef9-76e3-4892-a274-ff3b253ee77c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:41:30.283803 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73685ef9-76e3-4892-a274-ff3b253ee77c None admin] RBAC: Authorization granted {{(pid=82025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:41:30.296026 dv-cinder-828806-6-smb devstack@keystone.service[82025]: [pid: 82025|app: 0|req: 175/350] 10.222.0.33 () {56 vars in 1101 bytes} [Tue Sep 13 19:41:30 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 19:41:30.297137 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73685ef9-76e3-4892-a274-ff3b253ee77c None admin] Authenticating user token {{(pid=82025) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:41:30.317251 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14deef83-f2f9-4ebd-9e21-aa247d47b5f7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57539b6a6f3b4d589f5f5e1d211cd6a0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:41:30.317930 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14deef83-f2f9-4ebd-9e21-aa247d47b5f7 None admin] REQUEST_METHOD: `GET` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:41:30.318194 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14deef83-f2f9-4ebd-9e21-aa247d47b5f7 None admin] SCRIPT_NAME: `/identity` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:41:30.318474 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14deef83-f2f9-4ebd-9e21-aa247d47b5f7 None admin] PATH_INFO: `/v3/projects/7e18b3e4745c4afeaafeb826dc0445e0` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:41:30.319662 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14deef83-f2f9-4ebd-9e21-aa247d47b5f7 None admin] RBAC: Authorizing `identity:get_project(project_id=7e18b3e4745c4afeaafeb826dc0445e0)` {{(pid=82026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:41:30.322635 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14deef83-f2f9-4ebd-9e21-aa247d47b5f7 None admin] RBAC: Authorization granted {{(pid=82026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:41:30.323285 dv-cinder-828806-6-smb devstack@keystone.service[82026]: [pid: 82026|app: 0|req: 176/351] 10.222.0.33 () {56 vars in 1186 bytes} [Tue Sep 13 19:41:30 2022] GET /identity/v3/projects/7e18b3e4745c4afeaafeb826dc0445e0 => generated 298 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 19:41:30.324006 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14deef83-f2f9-4ebd-9e21-aa247d47b5f7 None admin] Authenticating user token {{(pid=82026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:41:30.414735 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG dbcounter [-] [82025] Writing DB stats keystone:SELECT=100 {{(pid=82025) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:41:30.452952 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73685ef9-76e3-4892-a274-ff3b253ee77c None admin] Validating token access rules against request {{(pid=82025) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:41:30.490609 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14deef83-f2f9-4ebd-9e21-aa247d47b5f7 None admin] Validating token access rules against request {{(pid=82026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:41:30.503368 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d526532b-3dbb-4ee3-9e78-54c5136202f1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57539b6a6f3b4d589f5f5e1d211cd6a0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82025) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:41:30.504013 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d526532b-3dbb-4ee3-9e78-54c5136202f1 None admin] REQUEST_METHOD: `GET` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:41:30.504163 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG dbcounter [-] [82026] Writing DB stats keystone:SELECT=100 {{(pid=82026) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:41:30.504296 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d526532b-3dbb-4ee3-9e78-54c5136202f1 None admin] SCRIPT_NAME: `/identity` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:41:30.504733 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d526532b-3dbb-4ee3-9e78-54c5136202f1 None admin] PATH_INFO: `/v3/users/e513e033d2a14a2db9fa6800d80abfef` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:41:30.506158 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d526532b-3dbb-4ee3-9e78-54c5136202f1 None admin] RBAC: Authorizing `identity:get_user(user_id=e513e033d2a14a2db9fa6800d80abfef)` {{(pid=82025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:41:30.507393 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d526532b-3dbb-4ee3-9e78-54c5136202f1 None admin] RBAC: Authorization granted {{(pid=82025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:41:30.508966 dv-cinder-828806-6-smb devstack@keystone.service[82025]: [pid: 82025|app: 0|req: 176/352] 10.222.0.33 () {56 vars in 1177 bytes} [Tue Sep 13 19:41:30 2022] GET /identity/v3/users/e513e033d2a14a2db9fa6800d80abfef => generated 293 bytes in 212 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 19:41:30.510362 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dd94f27-4ff3-4aeb-96b9-6249f96cd9a7 None None] REQUEST_METHOD: `GET` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:41:30.510654 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dd94f27-4ff3-4aeb-96b9-6249f96cd9a7 None None] SCRIPT_NAME: `/identity` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:41:30.510934 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dd94f27-4ff3-4aeb-96b9-6249f96cd9a7 None None] PATH_INFO: `/` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:41:30.512199 dv-cinder-828806-6-smb devstack@keystone.service[82025]: [pid: 82025|app: 0|req: 177/353] 10.222.0.33 () {54 vars in 927 bytes} [Tue Sep 13 19:41:30 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 19:41:30.516742 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dd94f27-4ff3-4aeb-96b9-6249f96cd9a7 None None] Authenticating user token {{(pid=82025) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:41:30.538912 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61de3db1-8db4-4552-9a4a-8b0870e21687 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57539b6a6f3b4d589f5f5e1d211cd6a0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:41:30.539596 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61de3db1-8db4-4552-9a4a-8b0870e21687 None admin] REQUEST_METHOD: `GET` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:41:30.539887 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61de3db1-8db4-4552-9a4a-8b0870e21687 None admin] SCRIPT_NAME: `/identity` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:41:30.540167 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61de3db1-8db4-4552-9a4a-8b0870e21687 None admin] PATH_INFO: `/v3/roles` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:41:30.540848 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61de3db1-8db4-4552-9a4a-8b0870e21687 None admin] RBAC: Adding query filter params (name=member) {{(pid=82026) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 19:41:30.541158 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61de3db1-8db4-4552-9a4a-8b0870e21687 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:41:30.542540 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61de3db1-8db4-4552-9a4a-8b0870e21687 None admin] RBAC: Authorization granted {{(pid=82026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:41:30.554948 dv-cinder-828806-6-smb devstack@keystone.service[82026]: [pid: 82026|app: 0|req: 177/354] 10.222.0.33 () {56 vars in 1101 bytes} [Tue Sep 13 19:41:30 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 231 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 19:41:30.555990 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61de3db1-8db4-4552-9a4a-8b0870e21687 None admin] Authenticating user token {{(pid=82026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:41:30.638287 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dd94f27-4ff3-4aeb-96b9-6249f96cd9a7 None None] Validating token access rules against request {{(pid=82025) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:41:30.675324 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61de3db1-8db4-4552-9a4a-8b0870e21687 None admin] Validating token access rules against request {{(pid=82026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:41:30.682023 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-316e020e-1cd9-4048-ac2c-478c06110040 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57539b6a6f3b4d589f5f5e1d211cd6a0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82025) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:41:30.682638 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-316e020e-1cd9-4048-ac2c-478c06110040 None admin] REQUEST_METHOD: `GET` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:41:30.682935 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-316e020e-1cd9-4048-ac2c-478c06110040 None admin] SCRIPT_NAME: `/identity` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:41:30.683217 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-316e020e-1cd9-4048-ac2c-478c06110040 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:41:30.703790 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG dbcounter [-] [82025] Writing DB stats keystone:SELECT=100 {{(pid=82025) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:41:30.714219 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-668e32f5-6d1d-42ad-95f3-1e30a2011f79 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57539b6a6f3b4d589f5f5e1d211cd6a0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:41:30.716097 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-668e32f5-6d1d-42ad-95f3-1e30a2011f79 None admin] REQUEST_METHOD: `GET` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:41:30.716097 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-668e32f5-6d1d-42ad-95f3-1e30a2011f79 None admin] SCRIPT_NAME: `/identity` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:41:30.716097 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-668e32f5-6d1d-42ad-95f3-1e30a2011f79 None admin] PATH_INFO: `/v3/groups/df4ab391f1e040fd93d08113e416b125` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:41:30.722931 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-668e32f5-6d1d-42ad-95f3-1e30a2011f79 None admin] RBAC: Authorizing `identity:get_group(group_id=df4ab391f1e040fd93d08113e416b125)` {{(pid=82026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:41:30.724625 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-668e32f5-6d1d-42ad-95f3-1e30a2011f79 None admin] RBAC: Authorization granted {{(pid=82026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:41:30.726321 dv-cinder-828806-6-smb devstack@keystone.service[82026]: [pid: 82026|app: 0|req: 178/355] 10.222.0.33 () {56 vars in 1180 bytes} [Tue Sep 13 19:41:30 2022] GET /identity/v3/groups/df4ab391f1e040fd93d08113e416b125 => generated 226 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 19:41:30.728335 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b76c3fd7-c07a-4ab7-a951-d5c1a08a5cc1 None None] REQUEST_METHOD: `GET` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:41:30.728335 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b76c3fd7-c07a-4ab7-a951-d5c1a08a5cc1 None None] SCRIPT_NAME: `/identity` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:41:30.728335 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b76c3fd7-c07a-4ab7-a951-d5c1a08a5cc1 None None] PATH_INFO: `/` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:41:30.729439 dv-cinder-828806-6-smb devstack@keystone.service[82026]: [pid: 82026|app: 0|req: 179/356] 10.222.0.33 () {54 vars in 927 bytes} [Tue Sep 13 19:41:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 19:41:30.731857 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b76c3fd7-c07a-4ab7-a951-d5c1a08a5cc1 None None] Authenticating user token {{(pid=82026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:41:30.765806 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-316e020e-1cd9-4048-ac2c-478c06110040 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=82025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:41:30.767323 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-316e020e-1cd9-4048-ac2c-478c06110040 None admin] RBAC: Authorization granted {{(pid=82025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:41:30.785344 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG dbcounter [-] [82026] Writing DB stats keystone:SELECT=100 {{(pid=82026) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:41:30.861442 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b76c3fd7-c07a-4ab7-a951-d5c1a08a5cc1 None None] Validating token access rules against request {{(pid=82026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:41:30.887526 dv-cinder-828806-6-smb devstack@keystone.service[82025]: [pid: 82025|app: 0|req: 178/357] 10.222.0.33 () {58 vars in 1282 bytes} [Tue Sep 13 19:41:30 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 375 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 13 19:41:30.890190 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d7f4f54-732b-4214-aab4-32672f35898f None None] REQUEST_METHOD: `POST` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:41:30.890656 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d7f4f54-732b-4214-aab4-32672f35898f None None] SCRIPT_NAME: `/identity` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:41:30.891175 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d7f4f54-732b-4214-aab4-32672f35898f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:41:30.898982 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42569676-7d3f-4efa-95ed-68a60fa61570 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57539b6a6f3b4d589f5f5e1d211cd6a0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:41:30.899550 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42569676-7d3f-4efa-95ed-68a60fa61570 None admin] REQUEST_METHOD: `GET` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:41:30.899832 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42569676-7d3f-4efa-95ed-68a60fa61570 None admin] SCRIPT_NAME: `/identity` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:41:30.900108 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42569676-7d3f-4efa-95ed-68a60fa61570 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:41:30.900843 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42569676-7d3f-4efa-95ed-68a60fa61570 None admin] RBAC: Adding query filter params (role.id=81338d9374bb480785c7d7aa54829af8, user.id=e513e033d2a14a2db9fa6800d80abfef, scope.system=all) {{(pid=82026) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 19:41:30.901155 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42569676-7d3f-4efa-95ed-68a60fa61570 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=82026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:41:30.902587 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42569676-7d3f-4efa-95ed-68a60fa61570 None admin] RBAC: Authorization granted {{(pid=82026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:41:30.912954 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.auth.core [None req-3d7f4f54-732b-4214-aab4-32672f35898f None None] MFA Rules not processed for user `57539b6a6f3b4d589f5f5e1d211cd6a0`. Rule list: `[]` (Enabled: `True`). {{(pid=82025) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 19:41:30.914174 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.fernet_utils [None req-3d7f4f54-732b-4214-aab4-32672f35898f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82025) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 19:41:30.921459 dv-cinder-828806-6-smb devstack@keystone.service[82026]: [pid: 82026|app: 0|req: 180/358] 10.222.0.33 () {56 vars in 1308 bytes} [Tue Sep 13 19:41:30 2022] GET /identity/v3/role_assignments?user.id=e513e033d2a14a2db9fa6800d80abfef&scope.system=all&role.id=81338d9374bb480785c7d7aa54829af8 => generated 510 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 19:41:30.922827 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42569676-7d3f-4efa-95ed-68a60fa61570 None admin] Authenticating user token {{(pid=82026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:41:30.970648 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG dbcounter [-] [82025] Writing DB stats keystone:SELECT=100 {{(pid=82025) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:41:31.004327 dv-cinder-828806-6-smb devstack@keystone.service[82025]: [pid: 82025|app: 0|req: 179/359] 10.222.0.33 () {58 vars in 1024 bytes} [Tue Sep 13 19:41:30 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 13 19:41:31.006513 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b1dbe7b-85d4-4001-9b97-6a4d70e16f8b None None] REQUEST_METHOD: `POST` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:41:31.006803 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b1dbe7b-85d4-4001-9b97-6a4d70e16f8b None None] SCRIPT_NAME: `/identity` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:41:31.007188 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b1dbe7b-85d4-4001-9b97-6a4d70e16f8b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:41:31.029049 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.auth.core [None req-1b1dbe7b-85d4-4001-9b97-6a4d70e16f8b None None] MFA Rules not processed for user `57539b6a6f3b4d589f5f5e1d211cd6a0`. Rule list: `[]` (Enabled: `True`). {{(pid=82025) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 19:41:31.030674 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.fernet_utils [None req-1b1dbe7b-85d4-4001-9b97-6a4d70e16f8b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82025) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 19:41:31.054993 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG dbcounter [-] [82026] Writing DB stats keystone:SELECT=100 {{(pid=82026) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:41:31.062728 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42569676-7d3f-4efa-95ed-68a60fa61570 None admin] Validating token access rules against request {{(pid=82026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:41:31.104167 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb7c5cab-19b4-4d00-9c29-c301542de909 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57539b6a6f3b4d589f5f5e1d211cd6a0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:41:31.104786 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb7c5cab-19b4-4d00-9c29-c301542de909 None admin] REQUEST_METHOD: `GET` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:41:31.105066 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb7c5cab-19b4-4d00-9c29-c301542de909 None admin] SCRIPT_NAME: `/identity` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:41:31.105423 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb7c5cab-19b4-4d00-9c29-c301542de909 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:41:31.116360 dv-cinder-828806-6-smb devstack@keystone.service[82025]: [pid: 82025|app: 0|req: 180/360] 10.222.0.33 () {58 vars in 1024 bytes} [Tue Sep 13 19:41:31 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 13 19:41:31.117596 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b1dbe7b-85d4-4001-9b97-6a4d70e16f8b None None] Authenticating user token {{(pid=82025) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:41:31.180122 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb7c5cab-19b4-4d00-9c29-c301542de909 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=82026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:41:31.181507 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb7c5cab-19b4-4d00-9c29-c301542de909 None admin] RBAC: Authorization granted {{(pid=82026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:41:31.227160 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b1dbe7b-85d4-4001-9b97-6a4d70e16f8b None None] Validating token access rules against request {{(pid=82025) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:41:31.238929 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG dbcounter [-] [82025] Writing DB stats keystone:SELECT=100 {{(pid=82025) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:41:31.263736 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4ac82a9-6fb4-4728-8719-ccac05070e04 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57539b6a6f3b4d589f5f5e1d211cd6a0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82025) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:41:31.265439 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4ac82a9-6fb4-4728-8719-ccac05070e04 None admin] REQUEST_METHOD: `GET` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:41:31.265920 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4ac82a9-6fb4-4728-8719-ccac05070e04 None admin] SCRIPT_NAME: `/identity` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:41:31.266382 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4ac82a9-6fb4-4728-8719-ccac05070e04 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:41:31.267338 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4ac82a9-6fb4-4728-8719-ccac05070e04 None admin] RBAC: Adding query filter params (group.id=df4ab391f1e040fd93d08113e416b125, role.id=6bcd095c76b341e186ea8caa11f5fa31, scope.project.id=7e18b3e4745c4afeaafeb826dc0445e0) {{(pid=82025) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 19:41:31.267864 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4ac82a9-6fb4-4728-8719-ccac05070e04 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=82025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:41:31.269519 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4ac82a9-6fb4-4728-8719-ccac05070e04 None admin] RBAC: Authorization granted {{(pid=82025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:41:31.275785 dv-cinder-828806-6-smb devstack@keystone.service[82025]: [pid: 82025|app: 0|req: 181/361] 10.222.0.33 () {56 vars in 1376 bytes} [Tue Sep 13 19:41:31 2022] GET /identity/v3/role_assignments?group.id=df4ab391f1e040fd93d08113e416b125&scope.project.id=7e18b3e4745c4afeaafeb826dc0445e0&role.id=6bcd095c76b341e186ea8caa11f5fa31 => generated 260 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 19:41:31.276968 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4ac82a9-6fb4-4728-8719-ccac05070e04 None admin] Authenticating user token {{(pid=82025) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:41:31.287515 dv-cinder-828806-6-smb devstack@keystone.service[82026]: [pid: 82026|app: 0|req: 181/362] 10.222.0.33 () {58 vars in 1282 bytes} [Tue Sep 13 19:41:30 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 365 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 13 19:41:31.290357 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG dbcounter [-] [82026] Writing DB stats keystone:SELECT=100 {{(pid=82026) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:41:31.303065 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb7c5cab-19b4-4d00-9c29-c301542de909 None admin] Authenticating user token {{(pid=82026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:41:31.443771 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4ac82a9-6fb4-4728-8719-ccac05070e04 None admin] Validating token access rules against request {{(pid=82025) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:41:31.476431 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb7c5cab-19b4-4d00-9c29-c301542de909 None admin] Validating token access rules against request {{(pid=82026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:41:31.499022 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-651b65a1-04a8-4d06-b7a5-46e5fb7fe5ac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57539b6a6f3b4d589f5f5e1d211cd6a0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82025) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:41:31.500527 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-651b65a1-04a8-4d06-b7a5-46e5fb7fe5ac None admin] REQUEST_METHOD: `GET` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:41:31.500815 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-651b65a1-04a8-4d06-b7a5-46e5fb7fe5ac None admin] SCRIPT_NAME: `/identity` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:41:31.501094 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-651b65a1-04a8-4d06-b7a5-46e5fb7fe5ac None admin] PATH_INFO: `/v3/projects/7e18b3e4745c4afeaafeb826dc0445e0` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:41:31.502357 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-651b65a1-04a8-4d06-b7a5-46e5fb7fe5ac None admin] RBAC: Authorizing `identity:get_project(project_id=7e18b3e4745c4afeaafeb826dc0445e0)` {{(pid=82025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:41:31.504032 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-651b65a1-04a8-4d06-b7a5-46e5fb7fe5ac None admin] RBAC: Authorization granted {{(pid=82025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:41:31.506100 dv-cinder-828806-6-smb devstack@keystone.service[82025]: [pid: 82025|app: 0|req: 182/363] 10.222.0.33 () {56 vars in 1186 bytes} [Tue Sep 13 19:41:31 2022] GET /identity/v3/projects/7e18b3e4745c4afeaafeb826dc0445e0 => generated 298 bytes in 229 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 19:41:31.507022 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-651b65a1-04a8-4d06-b7a5-46e5fb7fe5ac None admin] Authenticating user token {{(pid=82025) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:41:31.535881 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a7ab996-fb82-43cb-b91f-f36d0cb273bd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57539b6a6f3b4d589f5f5e1d211cd6a0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:41:31.536536 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a7ab996-fb82-43cb-b91f-f36d0cb273bd None admin] REQUEST_METHOD: `GET` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:41:31.536818 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a7ab996-fb82-43cb-b91f-f36d0cb273bd None admin] SCRIPT_NAME: `/identity` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:41:31.537091 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a7ab996-fb82-43cb-b91f-f36d0cb273bd None admin] PATH_INFO: `/v3/projects/bee3101ec8f84efa9f84a402c3c3cbbe` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:41:31.538458 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a7ab996-fb82-43cb-b91f-f36d0cb273bd None admin] RBAC: Authorizing `identity:get_project(project_id=bee3101ec8f84efa9f84a402c3c3cbbe)` {{(pid=82026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:41:31.540729 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a7ab996-fb82-43cb-b91f-f36d0cb273bd None admin] RBAC: Authorization granted {{(pid=82026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:41:31.543542 dv-cinder-828806-6-smb devstack@keystone.service[82026]: [pid: 82026|app: 0|req: 182/364] 10.222.0.33 () {56 vars in 1186 bytes} [Tue Sep 13 19:41:31 2022] GET /identity/v3/projects/bee3101ec8f84efa9f84a402c3c3cbbe => generated 302 bytes in 246 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 19:41:31.544633 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a7ab996-fb82-43cb-b91f-f36d0cb273bd None admin] Authenticating user token {{(pid=82026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:41:31.560313 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG dbcounter [-] [82025] Writing DB stats keystone:SELECT=100 {{(pid=82025) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:41:31.630641 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG dbcounter [-] [82026] Writing DB stats keystone:SELECT=100 {{(pid=82026) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:41:31.645366 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-651b65a1-04a8-4d06-b7a5-46e5fb7fe5ac None admin] Validating token access rules against request {{(pid=82025) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:41:31.682882 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a7ab996-fb82-43cb-b91f-f36d0cb273bd None admin] Validating token access rules against request {{(pid=82026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:41:31.695290 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16fb9da5-5fe4-4ef9-bd62-b2435d8d78c3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57539b6a6f3b4d589f5f5e1d211cd6a0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82025) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:41:31.696068 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16fb9da5-5fe4-4ef9-bd62-b2435d8d78c3 None admin] REQUEST_METHOD: `GET` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:41:31.696461 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16fb9da5-5fe4-4ef9-bd62-b2435d8d78c3 None admin] SCRIPT_NAME: `/identity` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:41:31.696924 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16fb9da5-5fe4-4ef9-bd62-b2435d8d78c3 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:41:31.709691 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16fb9da5-5fe4-4ef9-bd62-b2435d8d78c3 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=82025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 13 19:41:31.716435 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application [None req-16fb9da5-5fe4-4ef9-bd62-b2435d8d78c3 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 13 19:41:31.716435 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 19:41:31.716435 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 19:41:31.716435 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 19:41:31.716435 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 19:41:31.716435 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 19:41:31.716435 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 19:41:31.716435 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 19:41:31.716435 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 19:41:31.716435 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 19:41:31.716435 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 19:41:31.716435 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 19:41:31.716435 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 13 19:41:31.716435 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 13 19:41:31.716435 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 13 19:41:31.716435 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 13 19:41:31.717414 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 13 19:41:31.717414 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 13 19:41:31.717414 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 13 19:41:31.717414 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 13 19:41:31.717414 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 19:41:31.717414 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 19:41:31.717414 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 19:41:31.717414 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 19:41:31.717414 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 19:41:31.717414 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 19:41:31.717414 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 19:41:31.717414 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application with Lock( Sep 13 19:41:31.717414 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 19:41:31.717414 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application return self._enter() Sep 13 19:41:31.717414 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 19:41:31.717414 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 19:41:31.719329 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 19:41:31.719329 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application return self.creator() Sep 13 19:41:31.719329 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 19:41:31.719329 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application created_value = creator( Sep 13 19:41:31.719329 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 13 19:41:31.719329 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 13 19:41:31.719329 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 13 19:41:31.719329 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 13 19:41:31.719329 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 13 19:41:31.719329 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 13 19:41:31.719329 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 13 19:41:31.719329 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application Sep 13 19:41:31.719329 dv-cinder-828806-6-smb devstack@keystone.service[82025]: [pid: 82025|app: 0|req: 183/365] 10.222.0.33 () {56 vars in 1114 bytes} [Tue Sep 13 19:41:31 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 211 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 19:41:31.719329 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16fb9da5-5fe4-4ef9-bd62-b2435d8d78c3 None admin] Authenticating user token {{(pid=82025) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:41:31.726846 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1b82000-8e67-488b-bb51-8c860441047f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57539b6a6f3b4d589f5f5e1d211cd6a0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:41:31.727525 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1b82000-8e67-488b-bb51-8c860441047f None admin] REQUEST_METHOD: `GET` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:41:31.727811 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1b82000-8e67-488b-bb51-8c860441047f None admin] SCRIPT_NAME: `/identity` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:41:31.728092 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1b82000-8e67-488b-bb51-8c860441047f None admin] PATH_INFO: `/v3/roles/admin` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:41:31.746413 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1b82000-8e67-488b-bb51-8c860441047f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=82026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 13 19:41:31.753823 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application [None req-e1b82000-8e67-488b-bb51-8c860441047f None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 13 19:41:31.753823 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 19:41:31.753823 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 19:41:31.753823 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 19:41:31.753823 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 19:41:31.753823 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 19:41:31.753823 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 19:41:31.753823 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 19:41:31.753823 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 19:41:31.753823 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 19:41:31.753823 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 19:41:31.753823 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 19:41:31.753823 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 13 19:41:31.753823 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 13 19:41:31.753823 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 13 19:41:31.753823 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 13 19:41:31.754728 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 13 19:41:31.754728 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 13 19:41:31.754728 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 13 19:41:31.754728 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 13 19:41:31.754728 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 19:41:31.754728 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 19:41:31.754728 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 19:41:31.754728 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 19:41:31.754728 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 19:41:31.754728 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 19:41:31.754728 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 19:41:31.754728 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application with Lock( Sep 13 19:41:31.754728 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 19:41:31.754728 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application return self._enter() Sep 13 19:41:31.754728 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 19:41:31.754728 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 19:41:31.755572 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 19:41:31.755572 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application return self.creator() Sep 13 19:41:31.755572 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 19:41:31.755572 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application created_value = creator( Sep 13 19:41:31.755572 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 13 19:41:31.755572 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 13 19:41:31.755572 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 13 19:41:31.755572 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 13 19:41:31.755572 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 13 19:41:31.755572 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 13 19:41:31.755572 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 13 19:41:31.755572 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application Sep 13 19:41:31.755572 dv-cinder-828806-6-smb devstack@keystone.service[82026]: [pid: 82026|app: 0|req: 183/366] 10.222.0.33 () {56 vars in 1096 bytes} [Tue Sep 13 19:41:31 2022] GET /identity/v3/roles/admin => generated 83 bytes in 211 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 19:41:31.760223 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1b82000-8e67-488b-bb51-8c860441047f None admin] Authenticating user token {{(pid=82026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:41:31.862688 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16fb9da5-5fe4-4ef9-bd62-b2435d8d78c3 None admin] Validating token access rules against request {{(pid=82025) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:41:31.864911 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG dbcounter [-] [82025] Writing DB stats keystone:SELECT=100 {{(pid=82025) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:41:31.885598 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1b82000-8e67-488b-bb51-8c860441047f None admin] Validating token access rules against request {{(pid=82026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:41:31.909173 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0818b3a2-7b41-49d0-a322-d300b4598126 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57539b6a6f3b4d589f5f5e1d211cd6a0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82025) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:41:31.909814 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0818b3a2-7b41-49d0-a322-d300b4598126 None admin] REQUEST_METHOD: `GET` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:41:31.910094 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0818b3a2-7b41-49d0-a322-d300b4598126 None admin] SCRIPT_NAME: `/identity` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:41:31.910366 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0818b3a2-7b41-49d0-a322-d300b4598126 None admin] PATH_INFO: `/v3/groups/df4ab391f1e040fd93d08113e416b125` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:41:31.911975 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0818b3a2-7b41-49d0-a322-d300b4598126 None admin] RBAC: Authorizing `identity:get_group(group_id=df4ab391f1e040fd93d08113e416b125)` {{(pid=82025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:41:31.913902 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0818b3a2-7b41-49d0-a322-d300b4598126 None admin] RBAC: Authorization granted {{(pid=82025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:41:31.915784 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG dbcounter [-] [82026] Writing DB stats keystone:SELECT=100 {{(pid=82026) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:41:31.916457 dv-cinder-828806-6-smb devstack@keystone.service[82025]: [pid: 82025|app: 0|req: 184/367] 10.222.0.33 () {56 vars in 1180 bytes} [Tue Sep 13 19:41:31 2022] GET /identity/v3/groups/df4ab391f1e040fd93d08113e416b125 => generated 226 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 19:41:31.917408 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0818b3a2-7b41-49d0-a322-d300b4598126 None admin] Authenticating user token {{(pid=82025) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:41:31.928594 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9afc82a9-dbc9-4767-b55c-55aa80b6ead0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57539b6a6f3b4d589f5f5e1d211cd6a0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:41:31.929302 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9afc82a9-dbc9-4767-b55c-55aa80b6ead0 None admin] REQUEST_METHOD: `GET` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:41:31.929930 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9afc82a9-dbc9-4767-b55c-55aa80b6ead0 None admin] SCRIPT_NAME: `/identity` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:41:31.930216 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9afc82a9-dbc9-4767-b55c-55aa80b6ead0 None admin] PATH_INFO: `/v3/groups/df4ab391f1e040fd93d08113e416b125` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:41:31.931771 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9afc82a9-dbc9-4767-b55c-55aa80b6ead0 None admin] RBAC: Authorizing `identity:get_group(group_id=df4ab391f1e040fd93d08113e416b125)` {{(pid=82026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:41:31.933518 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9afc82a9-dbc9-4767-b55c-55aa80b6ead0 None admin] RBAC: Authorization granted {{(pid=82026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:41:31.935469 dv-cinder-828806-6-smb devstack@keystone.service[82026]: [pid: 82026|app: 0|req: 184/368] 10.222.0.33 () {56 vars in 1180 bytes} [Tue Sep 13 19:41:31 2022] GET /identity/v3/groups/df4ab391f1e040fd93d08113e416b125 => generated 226 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 19:41:31.937031 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9afc82a9-dbc9-4767-b55c-55aa80b6ead0 None admin] Authenticating user token {{(pid=82026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:41:32.058225 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0818b3a2-7b41-49d0-a322-d300b4598126 None admin] Validating token access rules against request {{(pid=82025) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:41:32.070947 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9afc82a9-dbc9-4767-b55c-55aa80b6ead0 None admin] Validating token access rules against request {{(pid=82026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:41:32.105816 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35b4a13c-fc42-45ac-b962-b7d65255b32f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57539b6a6f3b4d589f5f5e1d211cd6a0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82025) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:41:32.106954 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35b4a13c-fc42-45ac-b962-b7d65255b32f None admin] REQUEST_METHOD: `GET` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:41:32.107462 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35b4a13c-fc42-45ac-b962-b7d65255b32f None admin] SCRIPT_NAME: `/identity` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:41:32.108502 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35b4a13c-fc42-45ac-b962-b7d65255b32f None admin] PATH_INFO: `/v3/roles` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:41:32.109388 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35b4a13c-fc42-45ac-b962-b7d65255b32f None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=82025) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 19:41:32.109769 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35b4a13c-fc42-45ac-b962-b7d65255b32f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:41:32.111269 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35b4a13c-fc42-45ac-b962-b7d65255b32f None admin] RBAC: Authorization granted {{(pid=82025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:41:32.121607 dv-cinder-828806-6-smb devstack@keystone.service[82025]: [pid: 82025|app: 0|req: 185/369] 10.222.0.33 () {56 vars in 1111 bytes} [Tue Sep 13 19:41:31 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 19:41:32.121777 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c9373ec-2598-4ba9-b4d7-21df6ee6b122 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57539b6a6f3b4d589f5f5e1d211cd6a0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:41:32.122153 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c9373ec-2598-4ba9-b4d7-21df6ee6b122 None admin] REQUEST_METHOD: `GET` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:41:32.122258 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35b4a13c-fc42-45ac-b962-b7d65255b32f None admin] Authenticating user token {{(pid=82025) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:41:32.122437 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c9373ec-2598-4ba9-b4d7-21df6ee6b122 None admin] SCRIPT_NAME: `/identity` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:41:32.122710 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c9373ec-2598-4ba9-b4d7-21df6ee6b122 None admin] PATH_INFO: `/v3/roles` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:41:32.123446 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c9373ec-2598-4ba9-b4d7-21df6ee6b122 None admin] RBAC: Adding query filter params (name=admin) {{(pid=82026) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 19:41:32.123766 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c9373ec-2598-4ba9-b4d7-21df6ee6b122 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:41:32.125480 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c9373ec-2598-4ba9-b4d7-21df6ee6b122 None admin] RBAC: Authorization granted {{(pid=82026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:41:32.136567 dv-cinder-828806-6-smb devstack@keystone.service[82026]: [pid: 82026|app: 0|req: 185/370] 10.222.0.33 () {56 vars in 1099 bytes} [Tue Sep 13 19:41:31 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 19:41:32.137538 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c9373ec-2598-4ba9-b4d7-21df6ee6b122 None admin] Authenticating user token {{(pid=82026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:41:32.165844 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG dbcounter [-] [82025] Writing DB stats keystone:SELECT=100 {{(pid=82025) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:41:32.213863 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG dbcounter [-] [82026] Writing DB stats keystone:SELECT=100 {{(pid=82026) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:41:32.262089 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35b4a13c-fc42-45ac-b962-b7d65255b32f None admin] Validating token access rules against request {{(pid=82025) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:41:32.280915 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c9373ec-2598-4ba9-b4d7-21df6ee6b122 None admin] Validating token access rules against request {{(pid=82026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:41:32.311430 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5c0cc96-5151-455a-82b1-e4e2524a6a4d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57539b6a6f3b4d589f5f5e1d211cd6a0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82025) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:41:32.311983 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5c0cc96-5151-455a-82b1-e4e2524a6a4d None admin] REQUEST_METHOD: `GET` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:41:32.312274 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5c0cc96-5151-455a-82b1-e4e2524a6a4d None admin] SCRIPT_NAME: `/identity` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:41:32.312580 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5c0cc96-5151-455a-82b1-e4e2524a6a4d None admin] PATH_INFO: `/v3/role_assignments` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:41:32.313301 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5c0cc96-5151-455a-82b1-e4e2524a6a4d None admin] RBAC: Adding query filter params (group.id=df4ab391f1e040fd93d08113e416b125, role.id=3618ab638a65401f82333da7596d1daf, scope.project.id=7e18b3e4745c4afeaafeb826dc0445e0) {{(pid=82025) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 19:41:32.313619 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5c0cc96-5151-455a-82b1-e4e2524a6a4d None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=82025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:41:32.315069 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5c0cc96-5151-455a-82b1-e4e2524a6a4d None admin] RBAC: Authorization granted {{(pid=82025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:41:32.322453 dv-cinder-828806-6-smb devstack@keystone.service[82025]: [pid: 82025|app: 0|req: 186/371] 10.222.0.33 () {56 vars in 1376 bytes} [Tue Sep 13 19:41:32 2022] GET /identity/v3/role_assignments?group.id=df4ab391f1e040fd93d08113e416b125&scope.project.id=7e18b3e4745c4afeaafeb826dc0445e0&role.id=3618ab638a65401f82333da7596d1daf => generated 260 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 19:41:32.323972 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5c0cc96-5151-455a-82b1-e4e2524a6a4d None admin] Authenticating user token {{(pid=82025) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:41:32.339236 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8972f2b7-915e-440b-84fa-6ba355408426 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57539b6a6f3b4d589f5f5e1d211cd6a0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:41:32.339979 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8972f2b7-915e-440b-84fa-6ba355408426 None admin] REQUEST_METHOD: `GET` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:41:32.340515 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8972f2b7-915e-440b-84fa-6ba355408426 None admin] SCRIPT_NAME: `/identity` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:41:32.340869 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8972f2b7-915e-440b-84fa-6ba355408426 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:41:32.342730 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8972f2b7-915e-440b-84fa-6ba355408426 None admin] RBAC: Adding query filter params (group.id=df4ab391f1e040fd93d08113e416b125, role.id=3618ab638a65401f82333da7596d1daf, scope.project.id=bee3101ec8f84efa9f84a402c3c3cbbe) {{(pid=82026) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 19:41:32.343398 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8972f2b7-915e-440b-84fa-6ba355408426 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=82026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:41:32.345269 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8972f2b7-915e-440b-84fa-6ba355408426 None admin] RBAC: Authorization granted {{(pid=82026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:41:32.354484 dv-cinder-828806-6-smb devstack@keystone.service[82026]: [pid: 82026|app: 0|req: 186/372] 10.222.0.33 () {56 vars in 1376 bytes} [Tue Sep 13 19:41:32 2022] GET /identity/v3/role_assignments?group.id=df4ab391f1e040fd93d08113e416b125&scope.project.id=bee3101ec8f84efa9f84a402c3c3cbbe&role.id=3618ab638a65401f82333da7596d1daf => generated 260 bytes in 217 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 19:41:32.355238 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8972f2b7-915e-440b-84fa-6ba355408426 None admin] Authenticating user token {{(pid=82026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:41:32.455305 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG dbcounter [-] [82025] Writing DB stats keystone:SELECT=100 {{(pid=82025) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:41:32.461876 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5c0cc96-5151-455a-82b1-e4e2524a6a4d None admin] Validating token access rules against request {{(pid=82025) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:41:32.519018 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11381bdb-78f2-450a-899b-84fa77c6e7e1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57539b6a6f3b4d589f5f5e1d211cd6a0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82025) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:41:32.519689 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11381bdb-78f2-450a-899b-84fa77c6e7e1 None admin] REQUEST_METHOD: `GET` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:41:32.519858 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8972f2b7-915e-440b-84fa-6ba355408426 None admin] Validating token access rules against request {{(pid=82026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:41:32.520009 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11381bdb-78f2-450a-899b-84fa77c6e7e1 None admin] SCRIPT_NAME: `/identity` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:41:32.520246 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11381bdb-78f2-450a-899b-84fa77c6e7e1 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:41:32.544285 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG dbcounter [-] [82026] Writing DB stats keystone:SELECT=100 {{(pid=82026) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:41:32.588127 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56c69202-d494-4d04-baaf-77e1129dc76c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57539b6a6f3b4d589f5f5e1d211cd6a0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:41:32.588685 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56c69202-d494-4d04-baaf-77e1129dc76c None admin] REQUEST_METHOD: `GET` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:41:32.588978 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56c69202-d494-4d04-baaf-77e1129dc76c None admin] SCRIPT_NAME: `/identity` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:41:32.589259 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56c69202-d494-4d04-baaf-77e1129dc76c None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:41:32.627259 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11381bdb-78f2-450a-899b-84fa77c6e7e1 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=82025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:41:32.629143 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11381bdb-78f2-450a-899b-84fa77c6e7e1 None admin] RBAC: Authorization granted {{(pid=82025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:41:32.692499 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56c69202-d494-4d04-baaf-77e1129dc76c None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=82026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:41:32.693972 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56c69202-d494-4d04-baaf-77e1129dc76c None admin] RBAC: Authorization granted {{(pid=82026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:41:32.808433 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG dbcounter [-] [82025] Writing DB stats keystone:SELECT=100 {{(pid=82025) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:41:32.816347 dv-cinder-828806-6-smb devstack@keystone.service[82025]: [pid: 82025|app: 0|req: 187/373] 10.222.0.33 () {58 vars in 1282 bytes} [Tue Sep 13 19:41:32 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 493 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 13 19:41:32.822338 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11381bdb-78f2-450a-899b-84fa77c6e7e1 None admin] Authenticating user token {{(pid=82025) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:41:32.856513 dv-cinder-828806-6-smb devstack@keystone.service[82026]: [pid: 82026|app: 0|req: 187/374] 10.222.0.33 () {58 vars in 1282 bytes} [Tue Sep 13 19:41:32 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 501 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 13 19:41:32.862290 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56c69202-d494-4d04-baaf-77e1129dc76c None admin] Authenticating user token {{(pid=82026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:41:32.890373 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG dbcounter [-] [82026] Writing DB stats keystone:SELECT=100 {{(pid=82026) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:41:32.985117 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11381bdb-78f2-450a-899b-84fa77c6e7e1 None admin] Validating token access rules against request {{(pid=82025) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:41:33.042508 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56c69202-d494-4d04-baaf-77e1129dc76c None admin] Validating token access rules against request {{(pid=82026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:41:33.059214 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfe0827d-d985-4a7f-b2a6-d9c5eece25b5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57539b6a6f3b4d589f5f5e1d211cd6a0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82025) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:41:33.060146 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfe0827d-d985-4a7f-b2a6-d9c5eece25b5 None admin] REQUEST_METHOD: `GET` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:41:33.060603 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfe0827d-d985-4a7f-b2a6-d9c5eece25b5 None admin] SCRIPT_NAME: `/identity` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:41:33.061662 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfe0827d-d985-4a7f-b2a6-d9c5eece25b5 None admin] PATH_INFO: `/v3/projects/bee3101ec8f84efa9f84a402c3c3cbbe` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:41:33.064108 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfe0827d-d985-4a7f-b2a6-d9c5eece25b5 None admin] RBAC: Authorizing `identity:get_project(project_id=bee3101ec8f84efa9f84a402c3c3cbbe)` {{(pid=82025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:41:33.065811 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfe0827d-d985-4a7f-b2a6-d9c5eece25b5 None admin] RBAC: Authorization granted {{(pid=82025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:41:33.075135 dv-cinder-828806-6-smb devstack@keystone.service[82025]: [pid: 82025|app: 0|req: 188/375] 10.222.0.33 () {56 vars in 1186 bytes} [Tue Sep 13 19:41:32 2022] GET /identity/v3/projects/bee3101ec8f84efa9f84a402c3c3cbbe => generated 302 bytes in 248 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 19:41:33.080793 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfe0827d-d985-4a7f-b2a6-d9c5eece25b5 None admin] Authenticating user token {{(pid=82025) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:41:33.119495 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ce5749d-a9fe-45df-b3c5-d37d6a769668 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57539b6a6f3b4d589f5f5e1d211cd6a0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:41:33.120416 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ce5749d-a9fe-45df-b3c5-d37d6a769668 None admin] REQUEST_METHOD: `GET` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:41:33.120878 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ce5749d-a9fe-45df-b3c5-d37d6a769668 None admin] SCRIPT_NAME: `/identity` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:41:33.121331 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ce5749d-a9fe-45df-b3c5-d37d6a769668 None admin] PATH_INFO: `/v3/projects/b454f707d20347ada3d82aa85495635e` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:41:33.122782 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ce5749d-a9fe-45df-b3c5-d37d6a769668 None admin] RBAC: Authorizing `identity:get_project(project_id=b454f707d20347ada3d82aa85495635e)` {{(pid=82026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:41:33.125922 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ce5749d-a9fe-45df-b3c5-d37d6a769668 None admin] RBAC: Authorization granted {{(pid=82026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:41:33.128562 dv-cinder-828806-6-smb devstack@keystone.service[82026]: [pid: 82026|app: 0|req: 188/376] 10.222.0.33 () {56 vars in 1186 bytes} [Tue Sep 13 19:41:32 2022] GET /identity/v3/projects/b454f707d20347ada3d82aa85495635e => generated 344 bytes in 267 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 19:41:33.134673 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ce5749d-a9fe-45df-b3c5-d37d6a769668 None admin] Authenticating user token {{(pid=82026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:41:33.202187 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG dbcounter [-] [82025] Writing DB stats keystone:SELECT=100 {{(pid=82025) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:41:33.258769 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfe0827d-d985-4a7f-b2a6-d9c5eece25b5 None admin] Validating token access rules against request {{(pid=82025) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:41:33.307537 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8582cd0b-a58a-4f41-ae58-2639d8a67f63 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57539b6a6f3b4d589f5f5e1d211cd6a0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82025) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:41:33.308478 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8582cd0b-a58a-4f41-ae58-2639d8a67f63 None admin] REQUEST_METHOD: `GET` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:41:33.309173 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG dbcounter [-] [82026] Writing DB stats keystone:SELECT=100 {{(pid=82026) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:41:33.309473 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8582cd0b-a58a-4f41-ae58-2639d8a67f63 None admin] SCRIPT_NAME: `/identity` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:41:33.310060 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8582cd0b-a58a-4f41-ae58-2639d8a67f63 None admin] PATH_INFO: `/v3/groups/df4ab391f1e040fd93d08113e416b125` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:41:33.313045 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8582cd0b-a58a-4f41-ae58-2639d8a67f63 None admin] RBAC: Authorizing `identity:get_group(group_id=df4ab391f1e040fd93d08113e416b125)` {{(pid=82025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:41:33.314605 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8582cd0b-a58a-4f41-ae58-2639d8a67f63 None admin] RBAC: Authorization granted {{(pid=82025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:41:33.323897 dv-cinder-828806-6-smb devstack@keystone.service[82025]: [pid: 82025|app: 0|req: 189/377] 10.222.0.33 () {56 vars in 1180 bytes} [Tue Sep 13 19:41:33 2022] GET /identity/v3/groups/df4ab391f1e040fd93d08113e416b125 => generated 226 bytes in 243 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 19:41:33.324799 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8582cd0b-a58a-4f41-ae58-2639d8a67f63 None admin] Authenticating user token {{(pid=82025) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:41:33.342547 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ce5749d-a9fe-45df-b3c5-d37d6a769668 None admin] Validating token access rules against request {{(pid=82026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:41:33.393956 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4fd9e05-a852-47f6-a3e1-cee5ea2a7753 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57539b6a6f3b4d589f5f5e1d211cd6a0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:41:33.394521 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4fd9e05-a852-47f6-a3e1-cee5ea2a7753 None admin] REQUEST_METHOD: `GET` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:41:33.394810 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4fd9e05-a852-47f6-a3e1-cee5ea2a7753 None admin] SCRIPT_NAME: `/identity` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:41:33.395121 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4fd9e05-a852-47f6-a3e1-cee5ea2a7753 None admin] PATH_INFO: `/v3/groups/f9af76a4bd6148d7945469c0549779ae` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:41:33.400731 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4fd9e05-a852-47f6-a3e1-cee5ea2a7753 None admin] RBAC: Authorizing `identity:get_group(group_id=f9af76a4bd6148d7945469c0549779ae)` {{(pid=82026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:41:33.402217 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4fd9e05-a852-47f6-a3e1-cee5ea2a7753 None admin] RBAC: Authorization granted {{(pid=82026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:41:33.404969 dv-cinder-828806-6-smb devstack@keystone.service[82026]: [pid: 82026|app: 0|req: 189/378] 10.222.0.33 () {56 vars in 1180 bytes} [Tue Sep 13 19:41:33 2022] GET /identity/v3/groups/f9af76a4bd6148d7945469c0549779ae => generated 229 bytes in 270 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 19:41:33.411188 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4fd9e05-a852-47f6-a3e1-cee5ea2a7753 None admin] Authenticating user token {{(pid=82026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:41:33.547537 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8582cd0b-a58a-4f41-ae58-2639d8a67f63 None admin] Validating token access rules against request {{(pid=82025) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:41:33.607457 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG dbcounter [-] [82025] Writing DB stats keystone:SELECT=100 {{(pid=82025) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:41:33.610080 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4fd9e05-a852-47f6-a3e1-cee5ea2a7753 None admin] Validating token access rules against request {{(pid=82026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:41:33.621602 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-312c6b42-533f-468f-9422-5d8fd6df002a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57539b6a6f3b4d589f5f5e1d211cd6a0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82025) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:41:33.622229 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-312c6b42-533f-468f-9422-5d8fd6df002a None admin] REQUEST_METHOD: `GET` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:41:33.622510 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-312c6b42-533f-468f-9422-5d8fd6df002a None admin] SCRIPT_NAME: `/identity` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:41:33.622778 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-312c6b42-533f-468f-9422-5d8fd6df002a None admin] PATH_INFO: `/v3/role_assignments` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:41:33.625310 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-312c6b42-533f-468f-9422-5d8fd6df002a None admin] RBAC: Adding query filter params (group.id=df4ab391f1e040fd93d08113e416b125, role.id=6bcd095c76b341e186ea8caa11f5fa31, scope.project.id=bee3101ec8f84efa9f84a402c3c3cbbe) {{(pid=82025) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 19:41:33.625310 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-312c6b42-533f-468f-9422-5d8fd6df002a None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=82025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:41:33.625877 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-312c6b42-533f-468f-9422-5d8fd6df002a None admin] RBAC: Authorization granted {{(pid=82025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:41:33.636228 dv-cinder-828806-6-smb devstack@keystone.service[82025]: [pid: 82025|app: 0|req: 190/379] 10.222.0.33 () {56 vars in 1376 bytes} [Tue Sep 13 19:41:33 2022] GET /identity/v3/role_assignments?group.id=df4ab391f1e040fd93d08113e416b125&scope.project.id=bee3101ec8f84efa9f84a402c3c3cbbe&role.id=6bcd095c76b341e186ea8caa11f5fa31 => generated 260 bytes in 311 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 19:41:33.671655 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eba5a5a0-e935-4dff-901a-f02b803bbf49 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57539b6a6f3b4d589f5f5e1d211cd6a0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:41:33.672646 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eba5a5a0-e935-4dff-901a-f02b803bbf49 None admin] REQUEST_METHOD: `GET` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:41:33.673151 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eba5a5a0-e935-4dff-901a-f02b803bbf49 None admin] SCRIPT_NAME: `/identity` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:41:33.673637 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eba5a5a0-e935-4dff-901a-f02b803bbf49 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:41:33.674591 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eba5a5a0-e935-4dff-901a-f02b803bbf49 None admin] RBAC: Adding query filter params (group.id=f9af76a4bd6148d7945469c0549779ae, role.id=e5af7d5baa93469e9e486ef21c85474e, scope.project.id=b454f707d20347ada3d82aa85495635e) {{(pid=82026) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 19:41:33.675194 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eba5a5a0-e935-4dff-901a-f02b803bbf49 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=82026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:41:33.676857 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eba5a5a0-e935-4dff-901a-f02b803bbf49 None admin] RBAC: Authorization granted {{(pid=82026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:41:33.688386 dv-cinder-828806-6-smb devstack@keystone.service[82026]: [pid: 82026|app: 0|req: 190/380] 10.222.0.33 () {56 vars in 1376 bytes} [Tue Sep 13 19:41:33 2022] GET /identity/v3/role_assignments?group.id=f9af76a4bd6148d7945469c0549779ae&scope.project.id=b454f707d20347ada3d82aa85495635e&role.id=e5af7d5baa93469e9e486ef21c85474e => generated 260 bytes in 277 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 19:41:33.976742 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cccbc45-3a6e-499e-8805-4dacc185db5d None None] REQUEST_METHOD: `GET` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:41:33.977079 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cccbc45-3a6e-499e-8805-4dacc185db5d None None] SCRIPT_NAME: `/identity` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:41:33.977255 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cccbc45-3a6e-499e-8805-4dacc185db5d None None] PATH_INFO: `/` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:41:33.978689 dv-cinder-828806-6-smb devstack@keystone.service[82025]: [pid: 82025|app: 0|req: 191/381] 10.222.0.33 () {54 vars in 927 bytes} [Tue Sep 13 19:41:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 19:41:33.985014 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a40a03af-9049-4453-be49-a701d49d7290 None None] REQUEST_METHOD: `POST` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:41:33.985553 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a40a03af-9049-4453-be49-a701d49d7290 None None] SCRIPT_NAME: `/identity` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:41:33.986023 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a40a03af-9049-4453-be49-a701d49d7290 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:41:34.006800 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.auth.core [None req-a40a03af-9049-4453-be49-a701d49d7290 None None] MFA Rules not processed for user `57539b6a6f3b4d589f5f5e1d211cd6a0`. Rule list: `[]` (Enabled: `True`). {{(pid=82026) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 19:41:34.008378 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.common.fernet_utils [None req-a40a03af-9049-4453-be49-a701d49d7290 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82026) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 19:41:34.018611 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG dbcounter [-] [82026] Writing DB stats keystone:SELECT=100 {{(pid=82026) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:41:34.079106 dv-cinder-828806-6-smb devstack@keystone.service[82026]: [pid: 82026|app: 0|req: 191/382] 10.222.0.33 () {58 vars in 1024 bytes} [Tue Sep 13 19:41:33 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 13 19:41:34.422921 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cccbc45-3a6e-499e-8805-4dacc185db5d None None] Authenticating user token {{(pid=82025) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:41:34.552896 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cccbc45-3a6e-499e-8805-4dacc185db5d None None] Validating token access rules against request {{(pid=82025) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:41:34.587935 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61c367fe-7485-4494-a8c2-803eaea43624 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57539b6a6f3b4d589f5f5e1d211cd6a0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82025) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:41:34.588980 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61c367fe-7485-4494-a8c2-803eaea43624 None admin] REQUEST_METHOD: `GET` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:41:34.589459 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61c367fe-7485-4494-a8c2-803eaea43624 None admin] SCRIPT_NAME: `/identity` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:41:34.589924 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61c367fe-7485-4494-a8c2-803eaea43624 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:41:34.601410 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61c367fe-7485-4494-a8c2-803eaea43624 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=82025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 13 19:41:34.607082 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application [None req-61c367fe-7485-4494-a8c2-803eaea43624 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 13 19:41:34.607082 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 19:41:34.607082 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 19:41:34.607082 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 19:41:34.607082 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 19:41:34.607082 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 19:41:34.607082 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 19:41:34.607082 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 19:41:34.607082 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 19:41:34.607082 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 19:41:34.607082 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 19:41:34.607082 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 19:41:34.607082 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 13 19:41:34.607082 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 13 19:41:34.607082 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 13 19:41:34.607082 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 13 19:41:34.608042 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 13 19:41:34.608042 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 13 19:41:34.608042 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 13 19:41:34.608042 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 13 19:41:34.608042 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 19:41:34.608042 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 19:41:34.608042 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 19:41:34.608042 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 19:41:34.608042 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 19:41:34.608042 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 19:41:34.608042 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 19:41:34.608042 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application with Lock( Sep 13 19:41:34.608042 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 19:41:34.608042 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application return self._enter() Sep 13 19:41:34.608042 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 19:41:34.608042 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 19:41:34.608853 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 19:41:34.608853 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application return self.creator() Sep 13 19:41:34.608853 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 19:41:34.608853 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application created_value = creator( Sep 13 19:41:34.608853 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 13 19:41:34.608853 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 13 19:41:34.608853 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 13 19:41:34.608853 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 13 19:41:34.608853 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 13 19:41:34.608853 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 13 19:41:34.608853 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 13 19:41:34.608853 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application Sep 13 19:41:34.611412 dv-cinder-828806-6-smb devstack@keystone.service[82025]: [pid: 82025|app: 0|req: 192/383] 10.222.0.33 () {56 vars in 1114 bytes} [Tue Sep 13 19:41:34 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 19:41:34.620325 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a40a03af-9049-4453-be49-a701d49d7290 None None] Authenticating user token {{(pid=82026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:41:34.740067 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a40a03af-9049-4453-be49-a701d49d7290 None None] Validating token access rules against request {{(pid=82026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:41:34.783674 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6241a94a-9ce1-4972-a5d4-4bb8078aa913 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57539b6a6f3b4d589f5f5e1d211cd6a0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:41:34.784671 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6241a94a-9ce1-4972-a5d4-4bb8078aa913 None admin] REQUEST_METHOD: `GET` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:41:34.785147 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6241a94a-9ce1-4972-a5d4-4bb8078aa913 None admin] SCRIPT_NAME: `/identity` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:41:34.785623 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6241a94a-9ce1-4972-a5d4-4bb8078aa913 None admin] PATH_INFO: `/v3/roles` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:41:34.786505 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6241a94a-9ce1-4972-a5d4-4bb8078aa913 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=82026) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 19:41:34.787017 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6241a94a-9ce1-4972-a5d4-4bb8078aa913 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:41:34.788723 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6241a94a-9ce1-4972-a5d4-4bb8078aa913 None admin] RBAC: Authorization granted {{(pid=82026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:41:34.805891 dv-cinder-828806-6-smb devstack@keystone.service[82026]: [pid: 82026|app: 0|req: 192/384] 10.222.0.33 () {56 vars in 1111 bytes} [Tue Sep 13 19:41:34 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 19:41:34.811767 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61c367fe-7485-4494-a8c2-803eaea43624 None admin] Authenticating user token {{(pid=82025) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:41:34.877629 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG dbcounter [-] [82025] Writing DB stats keystone:SELECT=100 {{(pid=82025) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:41:34.932463 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61c367fe-7485-4494-a8c2-803eaea43624 None admin] Validating token access rules against request {{(pid=82025) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:41:34.982178 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0783429b-4d3f-4bc5-b7e2-b16140f117a6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57539b6a6f3b4d589f5f5e1d211cd6a0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82025) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:41:34.984051 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0783429b-4d3f-4bc5-b7e2-b16140f117a6 None admin] REQUEST_METHOD: `GET` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:41:34.984533 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0783429b-4d3f-4bc5-b7e2-b16140f117a6 None admin] SCRIPT_NAME: `/identity` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:41:34.985006 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0783429b-4d3f-4bc5-b7e2-b16140f117a6 None admin] PATH_INFO: `/v3/groups/df4ab391f1e040fd93d08113e416b125` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:41:34.991770 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0783429b-4d3f-4bc5-b7e2-b16140f117a6 None admin] RBAC: Authorizing `identity:get_group(group_id=df4ab391f1e040fd93d08113e416b125)` {{(pid=82025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:41:34.993499 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0783429b-4d3f-4bc5-b7e2-b16140f117a6 None admin] RBAC: Authorization granted {{(pid=82025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:41:34.995521 dv-cinder-828806-6-smb devstack@keystone.service[82025]: [pid: 82025|app: 0|req: 193/385] 10.222.0.33 () {56 vars in 1180 bytes} [Tue Sep 13 19:41:34 2022] GET /identity/v3/groups/df4ab391f1e040fd93d08113e416b125 => generated 226 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 13 19:41:35.001769 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6241a94a-9ce1-4972-a5d4-4bb8078aa913 None admin] Authenticating user token {{(pid=82026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:41:35.012286 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3617cf93-2522-4dd6-8d2a-0ef6e834da1f None None] REQUEST_METHOD: `GET` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:41:35.012450 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG dbcounter [-] [82026] Writing DB stats keystone:SELECT=100 {{(pid=82026) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:41:35.014778 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3617cf93-2522-4dd6-8d2a-0ef6e834da1f None None] SCRIPT_NAME: `/identity` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:41:35.015338 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3617cf93-2522-4dd6-8d2a-0ef6e834da1f None None] PATH_INFO: `/` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:41:35.018716 dv-cinder-828806-6-smb devstack@keystone.service[82025]: [pid: 82025|app: 0|req: 194/386] 10.222.0.33 () {54 vars in 927 bytes} [Tue Sep 13 19:41:35 2022] GET /identity => generated 270 bytes in 12 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 19:41:35.023425 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6a4db26-8993-4de6-a030-b77d44eebfd5 None None] REQUEST_METHOD: `POST` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:41:35.023923 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6a4db26-8993-4de6-a030-b77d44eebfd5 None None] SCRIPT_NAME: `/identity` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:41:35.024478 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6a4db26-8993-4de6-a030-b77d44eebfd5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:41:35.053421 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.auth.core [None req-a6a4db26-8993-4de6-a030-b77d44eebfd5 None None] MFA Rules not processed for user `57539b6a6f3b4d589f5f5e1d211cd6a0`. Rule list: `[]` (Enabled: `True`). {{(pid=82025) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 19:41:35.054653 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.fernet_utils [None req-a6a4db26-8993-4de6-a030-b77d44eebfd5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82025) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 19:41:35.150047 dv-cinder-828806-6-smb devstack@keystone.service[82025]: [pid: 82025|app: 0|req: 195/387] 10.222.0.33 () {58 vars in 1024 bytes} [Tue Sep 13 19:41:35 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 13 19:41:35.151065 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6241a94a-9ce1-4972-a5d4-4bb8078aa913 None admin] Validating token access rules against request {{(pid=82026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:41:35.151933 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2977e413-b2c3-4424-ab07-be58cb571fdf None None] REQUEST_METHOD: `GET` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:41:35.152685 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2977e413-b2c3-4424-ab07-be58cb571fdf None None] SCRIPT_NAME: `/identity` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:41:35.153150 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2977e413-b2c3-4424-ab07-be58cb571fdf None None] PATH_INFO: `/` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:41:35.155309 dv-cinder-828806-6-smb devstack@keystone.service[82025]: [pid: 82025|app: 0|req: 196/388] 10.222.0.33 () {54 vars in 927 bytes} [Tue Sep 13 19:41:35 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 19:41:35.161055 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04f67493-a3a9-4293-b933-9c0fb32b775f None None] REQUEST_METHOD: `POST` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:41:35.161345 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04f67493-a3a9-4293-b933-9c0fb32b775f None None] SCRIPT_NAME: `/identity` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:41:35.161625 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04f67493-a3a9-4293-b933-9c0fb32b775f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:41:35.182635 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.auth.core [None req-04f67493-a3a9-4293-b933-9c0fb32b775f None None] MFA Rules not processed for user `57539b6a6f3b4d589f5f5e1d211cd6a0`. Rule list: `[]` (Enabled: `True`). {{(pid=82025) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 19:41:35.183862 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.fernet_utils [None req-04f67493-a3a9-4293-b933-9c0fb32b775f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82025) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 19:41:35.210693 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed25044c-8d8d-46d7-84fa-1b8ab7006523 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57539b6a6f3b4d589f5f5e1d211cd6a0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:41:35.211358 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed25044c-8d8d-46d7-84fa-1b8ab7006523 None admin] REQUEST_METHOD: `GET` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:41:35.211938 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed25044c-8d8d-46d7-84fa-1b8ab7006523 None admin] SCRIPT_NAME: `/identity` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:41:35.212178 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed25044c-8d8d-46d7-84fa-1b8ab7006523 None admin] PATH_INFO: `/v3/projects/7e18b3e4745c4afeaafeb826dc0445e0` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:41:35.216009 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed25044c-8d8d-46d7-84fa-1b8ab7006523 None admin] RBAC: Authorizing `identity:get_project(project_id=7e18b3e4745c4afeaafeb826dc0445e0)` {{(pid=82026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:41:35.217767 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed25044c-8d8d-46d7-84fa-1b8ab7006523 None admin] RBAC: Authorization granted {{(pid=82026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:41:35.219539 dv-cinder-828806-6-smb devstack@keystone.service[82026]: [pid: 82026|app: 0|req: 193/389] 10.222.0.33 () {56 vars in 1186 bytes} [Tue Sep 13 19:41:35 2022] GET /identity/v3/projects/7e18b3e4745c4afeaafeb826dc0445e0 => generated 298 bytes in 218 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 19:41:35.225442 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed25044c-8d8d-46d7-84fa-1b8ab7006523 None admin] Authenticating user token {{(pid=82026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:41:35.278029 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG dbcounter [-] [82025] Writing DB stats keystone:SELECT=100 {{(pid=82025) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:41:35.317451 dv-cinder-828806-6-smb devstack@keystone.service[82025]: [pid: 82025|app: 0|req: 197/390] 10.222.0.33 () {58 vars in 1024 bytes} [Tue Sep 13 19:41:35 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 157 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 13 19:41:35.374782 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG dbcounter [-] [82026] Writing DB stats keystone:SELECT=100 {{(pid=82026) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:41:35.406880 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed25044c-8d8d-46d7-84fa-1b8ab7006523 None admin] Validating token access rules against request {{(pid=82026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:41:35.442031 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4da2fad-6630-41dd-9b98-e8d00f510b10 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57539b6a6f3b4d589f5f5e1d211cd6a0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:41:35.442704 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4da2fad-6630-41dd-9b98-e8d00f510b10 None admin] REQUEST_METHOD: `PUT` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:41:35.442994 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4da2fad-6630-41dd-9b98-e8d00f510b10 None admin] SCRIPT_NAME: `/identity` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:41:35.443306 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4da2fad-6630-41dd-9b98-e8d00f510b10 None admin] PATH_INFO: `/v3/projects/7e18b3e4745c4afeaafeb826dc0445e0/groups/df4ab391f1e040fd93d08113e416b125/roles/6bcd095c76b341e186ea8caa11f5fa31` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:41:35.445565 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4da2fad-6630-41dd-9b98-e8d00f510b10 None admin] RBAC: Authorizing `identity:create_grant(project_id=7e18b3e4745c4afeaafeb826dc0445e0, group_id=df4ab391f1e040fd93d08113e416b125, role_id=6bcd095c76b341e186ea8caa11f5fa31)` {{(pid=82026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:41:35.447310 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4da2fad-6630-41dd-9b98-e8d00f510b10 None admin] RBAC: Authorization granted {{(pid=82026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:41:35.469919 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04f67493-a3a9-4293-b933-9c0fb32b775f None None] Authenticating user token {{(pid=82025) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:41:35.570643 dv-cinder-828806-6-smb devstack@keystone.service[82026]: [pid: 82026|app: 0|req: 194/391] 10.222.0.33 () {58 vars in 1442 bytes} [Tue Sep 13 19:41:35 2022] PUT /identity/v3/projects/7e18b3e4745c4afeaafeb826dc0445e0/groups/df4ab391f1e040fd93d08113e416b125/roles/6bcd095c76b341e186ea8caa11f5fa31 => generated 0 bytes in 339 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 19:41:35.591605 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04f67493-a3a9-4293-b933-9c0fb32b775f None None] Validating token access rules against request {{(pid=82025) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:41:35.643599 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-733c8299-d6aa-4a0a-b5aa-f7d90b80ff5a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57539b6a6f3b4d589f5f5e1d211cd6a0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82025) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:41:35.644258 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-733c8299-d6aa-4a0a-b5aa-f7d90b80ff5a None admin] REQUEST_METHOD: `GET` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:41:35.644589 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-733c8299-d6aa-4a0a-b5aa-f7d90b80ff5a None admin] SCRIPT_NAME: `/identity` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:41:35.644871 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-733c8299-d6aa-4a0a-b5aa-f7d90b80ff5a None admin] PATH_INFO: `/v3/roles/member` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:41:35.661076 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-733c8299-d6aa-4a0a-b5aa-f7d90b80ff5a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=82025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 13 19:41:35.666206 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application [None req-733c8299-d6aa-4a0a-b5aa-f7d90b80ff5a None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 13 19:41:35.666206 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 19:41:35.666206 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 19:41:35.666206 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 19:41:35.666206 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 19:41:35.666206 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 19:41:35.666206 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 19:41:35.666206 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 19:41:35.666206 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 19:41:35.666206 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 19:41:35.666206 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 19:41:35.666206 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 19:41:35.666206 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 13 19:41:35.666206 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 13 19:41:35.666206 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 13 19:41:35.666206 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 13 19:41:35.667243 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 13 19:41:35.667243 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 13 19:41:35.667243 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 13 19:41:35.667243 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 13 19:41:35.667243 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 19:41:35.667243 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 19:41:35.667243 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 19:41:35.667243 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 19:41:35.667243 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 19:41:35.667243 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 19:41:35.667243 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 19:41:35.667243 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application with Lock( Sep 13 19:41:35.667243 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 19:41:35.667243 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application return self._enter() Sep 13 19:41:35.667243 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 19:41:35.667243 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 19:41:35.668100 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 19:41:35.668100 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application return self.creator() Sep 13 19:41:35.668100 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 19:41:35.668100 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application created_value = creator( Sep 13 19:41:35.668100 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 13 19:41:35.668100 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 13 19:41:35.668100 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 13 19:41:35.668100 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 13 19:41:35.668100 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 13 19:41:35.668100 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 13 19:41:35.668100 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 13 19:41:35.668100 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application Sep 13 19:41:35.668100 dv-cinder-828806-6-smb devstack@keystone.service[82025]: [pid: 82025|app: 0|req: 198/392] 10.222.0.33 () {56 vars in 1099 bytes} [Tue Sep 13 19:41:35 2022] GET /identity/v3/roles/member => generated 84 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 19:41:35.676669 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4da2fad-6630-41dd-9b98-e8d00f510b10 None admin] Authenticating user token {{(pid=82026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:41:35.708230 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-733c8299-d6aa-4a0a-b5aa-f7d90b80ff5a None admin] Authenticating user token {{(pid=82025) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:41:35.804381 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG dbcounter [-] [82025] Writing DB stats keystone:SELECT=100 {{(pid=82025) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:41:35.861180 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4da2fad-6630-41dd-9b98-e8d00f510b10 None admin] Validating token access rules against request {{(pid=82026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:41:35.870514 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-733c8299-d6aa-4a0a-b5aa-f7d90b80ff5a None admin] Validating token access rules against request {{(pid=82025) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:41:35.898152 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3797dbf-6c0e-4235-b59a-932ec5f76207 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57539b6a6f3b4d589f5f5e1d211cd6a0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:41:35.899002 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3797dbf-6c0e-4235-b59a-932ec5f76207 None admin] REQUEST_METHOD: `GET` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:41:35.899467 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3797dbf-6c0e-4235-b59a-932ec5f76207 None admin] SCRIPT_NAME: `/identity` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:41:35.899890 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3797dbf-6c0e-4235-b59a-932ec5f76207 None admin] PATH_INFO: `/v3/roles` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:41:35.900700 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3797dbf-6c0e-4235-b59a-932ec5f76207 None admin] RBAC: Adding query filter params (name=member) {{(pid=82026) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 19:41:35.901143 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3797dbf-6c0e-4235-b59a-932ec5f76207 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:41:35.902707 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3797dbf-6c0e-4235-b59a-932ec5f76207 None admin] RBAC: Authorization granted {{(pid=82026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:41:35.904326 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG dbcounter [-] [82026] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82026) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:41:35.909970 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38a545d2-057d-4914-883a-96298e28340a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57539b6a6f3b4d589f5f5e1d211cd6a0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82025) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:41:35.916196 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38a545d2-057d-4914-883a-96298e28340a None admin] REQUEST_METHOD: `GET` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:41:35.916196 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38a545d2-057d-4914-883a-96298e28340a None admin] SCRIPT_NAME: `/identity` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:41:35.916196 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38a545d2-057d-4914-883a-96298e28340a None admin] PATH_INFO: `/v3/roles/member` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:41:35.916496 dv-cinder-828806-6-smb devstack@keystone.service[82026]: [pid: 82026|app: 0|req: 195/393] 10.222.0.33 () {56 vars in 1101 bytes} [Tue Sep 13 19:41:35 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 240 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 19:41:35.921966 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3797dbf-6c0e-4235-b59a-932ec5f76207 None admin] Authenticating user token {{(pid=82026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:41:35.934470 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38a545d2-057d-4914-883a-96298e28340a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=82025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 13 19:41:35.939951 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application [None req-38a545d2-057d-4914-883a-96298e28340a None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 13 19:41:35.939951 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 19:41:35.939951 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 19:41:35.939951 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 19:41:35.939951 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 19:41:35.939951 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 19:41:35.939951 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 19:41:35.939951 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 19:41:35.939951 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 19:41:35.939951 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 19:41:35.939951 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 19:41:35.939951 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 19:41:35.939951 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 13 19:41:35.939951 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 13 19:41:35.939951 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 13 19:41:35.939951 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 13 19:41:35.940862 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 13 19:41:35.940862 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 13 19:41:35.940862 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 13 19:41:35.940862 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 13 19:41:35.940862 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 19:41:35.940862 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 19:41:35.940862 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 19:41:35.940862 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 19:41:35.940862 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 19:41:35.940862 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 19:41:35.940862 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 19:41:35.940862 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application with Lock( Sep 13 19:41:35.940862 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 19:41:35.940862 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application return self._enter() Sep 13 19:41:35.940862 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 19:41:35.940862 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 19:41:35.941672 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 19:41:35.941672 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application return self.creator() Sep 13 19:41:35.941672 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 19:41:35.941672 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application created_value = creator( Sep 13 19:41:35.941672 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 13 19:41:35.941672 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 13 19:41:35.941672 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 13 19:41:35.941672 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 13 19:41:35.941672 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 13 19:41:35.941672 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 13 19:41:35.941672 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 13 19:41:35.941672 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application Sep 13 19:41:35.941672 dv-cinder-828806-6-smb devstack@keystone.service[82025]: [pid: 82025|app: 0|req: 199/394] 10.222.0.33 () {56 vars in 1099 bytes} [Tue Sep 13 19:41:35 2022] GET /identity/v3/roles/member => generated 84 bytes in 233 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 13 19:41:35.947715 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38a545d2-057d-4914-883a-96298e28340a None admin] Authenticating user token {{(pid=82025) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:41:36.055935 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3797dbf-6c0e-4235-b59a-932ec5f76207 None admin] Validating token access rules against request {{(pid=82026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:41:36.094278 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b021261a-7dd6-4f7d-bd59-0138ef4460dd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57539b6a6f3b4d589f5f5e1d211cd6a0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:41:36.094901 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b021261a-7dd6-4f7d-bd59-0138ef4460dd None admin] REQUEST_METHOD: `GET` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:41:36.095231 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b021261a-7dd6-4f7d-bd59-0138ef4460dd None admin] SCRIPT_NAME: `/identity` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:41:36.095508 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b021261a-7dd6-4f7d-bd59-0138ef4460dd None admin] PATH_INFO: `/v3/groups/df4ab391f1e040fd93d08113e416b125` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:41:36.096719 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b021261a-7dd6-4f7d-bd59-0138ef4460dd None admin] RBAC: Authorizing `identity:get_group(group_id=df4ab391f1e040fd93d08113e416b125)` {{(pid=82026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:41:36.098158 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b021261a-7dd6-4f7d-bd59-0138ef4460dd None admin] RBAC: Authorization granted {{(pid=82026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:41:36.104905 dv-cinder-828806-6-smb devstack@keystone.service[82026]: [pid: 82026|app: 0|req: 196/395] 10.222.0.33 () {56 vars in 1180 bytes} [Tue Sep 13 19:41:35 2022] GET /identity/v3/groups/df4ab391f1e040fd93d08113e416b125 => generated 226 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 19:41:36.105989 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b021261a-7dd6-4f7d-bd59-0138ef4460dd None admin] Authenticating user token {{(pid=82026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:41:36.178018 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38a545d2-057d-4914-883a-96298e28340a None admin] Validating token access rules against request {{(pid=82025) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:41:36.182794 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG dbcounter [-] [82026] Writing DB stats keystone:SELECT=100 {{(pid=82026) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:41:36.186937 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG dbcounter [-] [82025] Writing DB stats keystone:SELECT=100 {{(pid=82025) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:41:36.241059 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b021261a-7dd6-4f7d-bd59-0138ef4460dd None admin] Validating token access rules against request {{(pid=82026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:41:36.271971 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f339cb72-c804-43b6-a460-6ed933e158b8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57539b6a6f3b4d589f5f5e1d211cd6a0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82025) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:41:36.274229 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f339cb72-c804-43b6-a460-6ed933e158b8 None admin] REQUEST_METHOD: `GET` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:41:36.276066 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f339cb72-c804-43b6-a460-6ed933e158b8 None admin] SCRIPT_NAME: `/identity` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:41:36.276513 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f339cb72-c804-43b6-a460-6ed933e158b8 None admin] PATH_INFO: `/v3/roles` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:41:36.288826 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f339cb72-c804-43b6-a460-6ed933e158b8 None admin] RBAC: Adding query filter params (name=member) {{(pid=82025) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 19:41:36.290138 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f339cb72-c804-43b6-a460-6ed933e158b8 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:41:36.291779 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f339cb72-c804-43b6-a460-6ed933e158b8 None admin] RBAC: Authorization granted {{(pid=82025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:41:36.307540 dv-cinder-828806-6-smb devstack@keystone.service[82025]: [pid: 82025|app: 0|req: 200/396] 10.222.0.33 () {56 vars in 1101 bytes} [Tue Sep 13 19:41:35 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 360 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 19:41:36.313395 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f339cb72-c804-43b6-a460-6ed933e158b8 None admin] Authenticating user token {{(pid=82025) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:41:36.340365 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f1ffc72-250a-44e0-9092-16702bf17de7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57539b6a6f3b4d589f5f5e1d211cd6a0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:41:36.341024 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f1ffc72-250a-44e0-9092-16702bf17de7 None admin] REQUEST_METHOD: `GET` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:41:36.341311 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f1ffc72-250a-44e0-9092-16702bf17de7 None admin] SCRIPT_NAME: `/identity` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:41:36.341591 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f1ffc72-250a-44e0-9092-16702bf17de7 None admin] PATH_INFO: `/v3/projects/7e18b3e4745c4afeaafeb826dc0445e0` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:41:36.343047 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f1ffc72-250a-44e0-9092-16702bf17de7 None admin] RBAC: Authorizing `identity:get_project(project_id=7e18b3e4745c4afeaafeb826dc0445e0)` {{(pid=82026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:41:36.344632 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f1ffc72-250a-44e0-9092-16702bf17de7 None admin] RBAC: Authorization granted {{(pid=82026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:41:36.346724 dv-cinder-828806-6-smb devstack@keystone.service[82026]: [pid: 82026|app: 0|req: 197/397] 10.222.0.33 () {56 vars in 1186 bytes} [Tue Sep 13 19:41:36 2022] GET /identity/v3/projects/7e18b3e4745c4afeaafeb826dc0445e0 => generated 298 bytes in 241 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 13 19:41:36.348148 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5f015d3-e1ad-4de7-98ab-bfdb7d91f73e None None] REQUEST_METHOD: `GET` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:41:36.356775 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5f015d3-e1ad-4de7-98ab-bfdb7d91f73e None None] SCRIPT_NAME: `/identity` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:41:36.356775 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5f015d3-e1ad-4de7-98ab-bfdb7d91f73e None None] PATH_INFO: `/` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:41:36.356775 dv-cinder-828806-6-smb devstack@keystone.service[82026]: [pid: 82026|app: 0|req: 198/398] 10.222.0.33 () {54 vars in 927 bytes} [Tue Sep 13 19:41:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 19:41:36.356775 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5f015d3-e1ad-4de7-98ab-bfdb7d91f73e None None] Authenticating user token {{(pid=82026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:41:36.433661 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f339cb72-c804-43b6-a460-6ed933e158b8 None admin] Validating token access rules against request {{(pid=82025) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:41:36.480599 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f593dac2-d79a-494a-9aee-33b4b55989e8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57539b6a6f3b4d589f5f5e1d211cd6a0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82025) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:41:36.481241 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f593dac2-d79a-494a-9aee-33b4b55989e8 None admin] REQUEST_METHOD: `GET` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:41:36.481525 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f593dac2-d79a-494a-9aee-33b4b55989e8 None admin] SCRIPT_NAME: `/identity` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:41:36.481822 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f593dac2-d79a-494a-9aee-33b4b55989e8 None admin] PATH_INFO: `/v3/groups/df4ab391f1e040fd93d08113e416b125` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:41:36.483738 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f593dac2-d79a-494a-9aee-33b4b55989e8 None admin] RBAC: Authorizing `identity:get_group(group_id=df4ab391f1e040fd93d08113e416b125)` {{(pid=82025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:41:36.484593 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5f015d3-e1ad-4de7-98ab-bfdb7d91f73e None None] Validating token access rules against request {{(pid=82026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:41:36.485183 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f593dac2-d79a-494a-9aee-33b4b55989e8 None admin] RBAC: Authorization granted {{(pid=82025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:41:36.490952 dv-cinder-828806-6-smb devstack@keystone.service[82025]: [pid: 82025|app: 0|req: 201/399] 10.222.0.33 () {56 vars in 1180 bytes} [Tue Sep 13 19:41:36 2022] GET /identity/v3/groups/df4ab391f1e040fd93d08113e416b125 => generated 226 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 13 19:41:36.490952 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-195233b1-a919-4c55-a74a-d1f9e6fa6bf1 None None] REQUEST_METHOD: `POST` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:41:36.490952 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-195233b1-a919-4c55-a74a-d1f9e6fa6bf1 None None] SCRIPT_NAME: `/identity` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:41:36.490952 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-195233b1-a919-4c55-a74a-d1f9e6fa6bf1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:41:36.508480 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.auth.core [None req-195233b1-a919-4c55-a74a-d1f9e6fa6bf1 None None] MFA Rules not processed for user `57539b6a6f3b4d589f5f5e1d211cd6a0`. Rule list: `[]` (Enabled: `True`). {{(pid=82025) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 19:41:36.509673 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.fernet_utils [None req-195233b1-a919-4c55-a74a-d1f9e6fa6bf1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82025) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 19:41:36.530603 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG dbcounter [-] [82026] Writing DB stats keystone:SELECT=100 {{(pid=82026) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:41:36.538597 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-861b0237-41b9-4a6a-b1af-f4cc16039870 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57539b6a6f3b4d589f5f5e1d211cd6a0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:41:36.539380 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG dbcounter [-] [82025] Writing DB stats keystone:SELECT=100 {{(pid=82025) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:41:36.540721 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-861b0237-41b9-4a6a-b1af-f4cc16039870 None admin] REQUEST_METHOD: `PUT` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:41:36.551323 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-861b0237-41b9-4a6a-b1af-f4cc16039870 None admin] SCRIPT_NAME: `/identity` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:41:36.551323 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-861b0237-41b9-4a6a-b1af-f4cc16039870 None admin] PATH_INFO: `/v3/projects/7e18b3e4745c4afeaafeb826dc0445e0/groups/df4ab391f1e040fd93d08113e416b125/roles/3618ab638a65401f82333da7596d1daf` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:41:36.551323 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-861b0237-41b9-4a6a-b1af-f4cc16039870 None admin] RBAC: Authorizing `identity:create_grant(project_id=7e18b3e4745c4afeaafeb826dc0445e0, group_id=df4ab391f1e040fd93d08113e416b125, role_id=3618ab638a65401f82333da7596d1daf)` {{(pid=82026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:41:36.551323 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-861b0237-41b9-4a6a-b1af-f4cc16039870 None admin] RBAC: Authorization granted {{(pid=82026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:41:36.582756 dv-cinder-828806-6-smb devstack@keystone.service[82025]: [pid: 82025|app: 0|req: 202/400] 10.222.0.33 () {58 vars in 1024 bytes} [Tue Sep 13 19:41:36 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 13 19:41:36.583468 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-195233b1-a919-4c55-a74a-d1f9e6fa6bf1 None None] Authenticating user token {{(pid=82025) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:41:36.635974 dv-cinder-828806-6-smb devstack@keystone.service[82026]: [pid: 82026|app: 0|req: 199/401] 10.222.0.33 () {58 vars in 1442 bytes} [Tue Sep 13 19:41:36 2022] PUT /identity/v3/projects/7e18b3e4745c4afeaafeb826dc0445e0/groups/df4ab391f1e040fd93d08113e416b125/roles/3618ab638a65401f82333da7596d1daf => generated 0 bytes in 281 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 19:41:36.715833 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-195233b1-a919-4c55-a74a-d1f9e6fa6bf1 None None] Validating token access rules against request {{(pid=82025) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:41:36.756036 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cf81643-ee8c-43c6-a159-fdeb50e73fc5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57539b6a6f3b4d589f5f5e1d211cd6a0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82025) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:41:36.757183 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cf81643-ee8c-43c6-a159-fdeb50e73fc5 None admin] REQUEST_METHOD: `GET` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:41:36.757738 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cf81643-ee8c-43c6-a159-fdeb50e73fc5 None admin] SCRIPT_NAME: `/identity` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:41:36.758315 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cf81643-ee8c-43c6-a159-fdeb50e73fc5 None admin] PATH_INFO: `/v3/projects/bee3101ec8f84efa9f84a402c3c3cbbe` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:41:36.759925 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cf81643-ee8c-43c6-a159-fdeb50e73fc5 None admin] RBAC: Authorizing `identity:get_project(project_id=bee3101ec8f84efa9f84a402c3c3cbbe)` {{(pid=82025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:41:36.761647 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cf81643-ee8c-43c6-a159-fdeb50e73fc5 None admin] RBAC: Authorization granted {{(pid=82025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:41:36.763698 dv-cinder-828806-6-smb devstack@keystone.service[82025]: [pid: 82025|app: 0|req: 203/402] 10.222.0.33 () {56 vars in 1186 bytes} [Tue Sep 13 19:41:36 2022] GET /identity/v3/projects/bee3101ec8f84efa9f84a402c3c3cbbe => generated 302 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 19:41:36.770457 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-861b0237-41b9-4a6a-b1af-f4cc16039870 None admin] Authenticating user token {{(pid=82026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:41:36.779524 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0be6e485-4b21-40a9-a564-fb9c41c38bc7 None None] REQUEST_METHOD: `GET` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:41:36.780143 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0be6e485-4b21-40a9-a564-fb9c41c38bc7 None None] SCRIPT_NAME: `/identity` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:41:36.780388 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0be6e485-4b21-40a9-a564-fb9c41c38bc7 None None] PATH_INFO: `/` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:41:36.782232 dv-cinder-828806-6-smb devstack@keystone.service[82025]: [pid: 82025|app: 0|req: 204/403] 10.222.0.33 () {54 vars in 927 bytes} [Tue Sep 13 19:41:36 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 19:41:36.787933 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ec2b2c3-a992-4478-9899-6bd4aee79a79 None None] REQUEST_METHOD: `POST` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:41:36.788264 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ec2b2c3-a992-4478-9899-6bd4aee79a79 None None] SCRIPT_NAME: `/identity` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:41:36.788486 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ec2b2c3-a992-4478-9899-6bd4aee79a79 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:41:36.806948 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.auth.core [None req-7ec2b2c3-a992-4478-9899-6bd4aee79a79 None None] MFA Rules not processed for user `57539b6a6f3b4d589f5f5e1d211cd6a0`. Rule list: `[]` (Enabled: `True`). {{(pid=82025) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 19:41:36.808222 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.fernet_utils [None req-7ec2b2c3-a992-4478-9899-6bd4aee79a79 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82025) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 19:41:36.843532 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG dbcounter [-] [82025] Writing DB stats keystone:SELECT=100 {{(pid=82025) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:41:36.903375 dv-cinder-828806-6-smb devstack@keystone.service[82025]: [pid: 82025|app: 0|req: 205/404] 10.222.0.33 () {58 vars in 1024 bytes} [Tue Sep 13 19:41:36 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 13 19:41:36.909573 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ec2b2c3-a992-4478-9899-6bd4aee79a79 None None] Authenticating user token {{(pid=82025) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:41:36.911180 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-861b0237-41b9-4a6a-b1af-f4cc16039870 None admin] Validating token access rules against request {{(pid=82026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:41:36.958206 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa064d1f-730c-4036-9ad9-83824e8446e1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57539b6a6f3b4d589f5f5e1d211cd6a0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:41:36.958886 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa064d1f-730c-4036-9ad9-83824e8446e1 None admin] REQUEST_METHOD: `PUT` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:41:36.959207 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa064d1f-730c-4036-9ad9-83824e8446e1 None admin] SCRIPT_NAME: `/identity` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:41:36.959489 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa064d1f-730c-4036-9ad9-83824e8446e1 None admin] PATH_INFO: `/v3/projects/bee3101ec8f84efa9f84a402c3c3cbbe/groups/df4ab391f1e040fd93d08113e416b125/roles/3618ab638a65401f82333da7596d1daf` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:41:36.962312 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa064d1f-730c-4036-9ad9-83824e8446e1 None admin] RBAC: Authorizing `identity:create_grant(project_id=bee3101ec8f84efa9f84a402c3c3cbbe, group_id=df4ab391f1e040fd93d08113e416b125, role_id=3618ab638a65401f82333da7596d1daf)` {{(pid=82026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:41:36.964094 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa064d1f-730c-4036-9ad9-83824e8446e1 None admin] RBAC: Authorization granted {{(pid=82026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:41:37.026891 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ec2b2c3-a992-4478-9899-6bd4aee79a79 None None] Validating token access rules against request {{(pid=82025) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:41:37.066127 dv-cinder-828806-6-smb devstack@keystone.service[82026]: [pid: 82026|app: 0|req: 200/405] 10.222.0.33 () {58 vars in 1442 bytes} [Tue Sep 13 19:41:36 2022] PUT /identity/v3/projects/bee3101ec8f84efa9f84a402c3c3cbbe/groups/df4ab391f1e040fd93d08113e416b125/roles/3618ab638a65401f82333da7596d1daf => generated 0 bytes in 296 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 13 19:41:37.072991 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bcf1670-488f-4fa5-a4ce-90d62ee1ddff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57539b6a6f3b4d589f5f5e1d211cd6a0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82025) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:41:37.074091 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bcf1670-488f-4fa5-a4ce-90d62ee1ddff None admin] REQUEST_METHOD: `GET` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:41:37.074552 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bcf1670-488f-4fa5-a4ce-90d62ee1ddff None admin] SCRIPT_NAME: `/identity` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:41:37.075022 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bcf1670-488f-4fa5-a4ce-90d62ee1ddff None admin] PATH_INFO: `/v3/roles/admin` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:41:37.089200 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bcf1670-488f-4fa5-a4ce-90d62ee1ddff None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=82025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 13 19:41:37.095585 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application [None req-7bcf1670-488f-4fa5-a4ce-90d62ee1ddff None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 13 19:41:37.095585 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 19:41:37.095585 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 19:41:37.095585 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 19:41:37.095585 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 19:41:37.095585 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 19:41:37.095585 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 19:41:37.095585 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 19:41:37.095585 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 19:41:37.095585 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 19:41:37.095585 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 19:41:37.095585 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 19:41:37.095585 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 13 19:41:37.095585 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 13 19:41:37.095585 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 13 19:41:37.095585 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 13 19:41:37.096523 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 13 19:41:37.096523 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 13 19:41:37.096523 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 13 19:41:37.096523 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 13 19:41:37.096523 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 19:41:37.096523 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 19:41:37.096523 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 19:41:37.096523 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 19:41:37.096523 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 19:41:37.096523 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 19:41:37.096523 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 19:41:37.096523 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application with Lock( Sep 13 19:41:37.096523 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 19:41:37.096523 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application return self._enter() Sep 13 19:41:37.096523 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 19:41:37.096523 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 19:41:37.097448 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 19:41:37.097448 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application return self.creator() Sep 13 19:41:37.097448 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 19:41:37.097448 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application created_value = creator( Sep 13 19:41:37.097448 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 13 19:41:37.097448 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 13 19:41:37.097448 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 13 19:41:37.097448 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 13 19:41:37.097448 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 13 19:41:37.097448 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 13 19:41:37.097448 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 13 19:41:37.097448 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application Sep 13 19:41:37.100263 dv-cinder-828806-6-smb devstack@keystone.service[82025]: [pid: 82025|app: 0|req: 206/406] 10.222.0.33 () {56 vars in 1096 bytes} [Tue Sep 13 19:41:36 2022] GET /identity/v3/roles/admin => generated 83 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 13 19:41:37.106591 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa064d1f-730c-4036-9ad9-83824e8446e1 None admin] Authenticating user token {{(pid=82026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:41:37.183892 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG dbcounter [-] [82026] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=82026) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:41:37.239562 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa064d1f-730c-4036-9ad9-83824e8446e1 None admin] Validating token access rules against request {{(pid=82026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:41:37.262704 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bcf1670-488f-4fa5-a4ce-90d62ee1ddff None admin] Authenticating user token {{(pid=82025) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:41:37.286878 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d112974a-2233-4a4d-8e74-f4f8884670bb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57539b6a6f3b4d589f5f5e1d211cd6a0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:41:37.287506 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d112974a-2233-4a4d-8e74-f4f8884670bb None admin] REQUEST_METHOD: `GET` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:41:37.287789 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d112974a-2233-4a4d-8e74-f4f8884670bb None admin] SCRIPT_NAME: `/identity` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:41:37.288068 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d112974a-2233-4a4d-8e74-f4f8884670bb None admin] PATH_INFO: `/v3/roles` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:41:37.288818 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d112974a-2233-4a4d-8e74-f4f8884670bb None admin] RBAC: Adding query filter params (name=admin) {{(pid=82026) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 19:41:37.289125 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d112974a-2233-4a4d-8e74-f4f8884670bb None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:41:37.290508 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d112974a-2233-4a4d-8e74-f4f8884670bb None admin] RBAC: Authorization granted {{(pid=82026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:41:37.300472 dv-cinder-828806-6-smb devstack@keystone.service[82026]: [pid: 82026|app: 0|req: 201/407] 10.222.0.33 () {56 vars in 1099 bytes} [Tue Sep 13 19:41:37 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 19:41:37.306062 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d112974a-2233-4a4d-8e74-f4f8884670bb None admin] Authenticating user token {{(pid=82026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:41:37.306228 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG dbcounter [-] [82025] Writing DB stats keystone:SELECT=100 {{(pid=82025) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:41:37.400772 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bcf1670-488f-4fa5-a4ce-90d62ee1ddff None admin] Validating token access rules against request {{(pid=82025) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:41:37.428189 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d112974a-2233-4a4d-8e74-f4f8884670bb None admin] Validating token access rules against request {{(pid=82026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:41:37.450637 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG dbcounter [-] [82026] Writing DB stats keystone:SELECT=100 {{(pid=82026) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:41:37.464040 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7461fbbf-7214-4e4f-9a5d-ca10f383173d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57539b6a6f3b4d589f5f5e1d211cd6a0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:41:37.468245 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7461fbbf-7214-4e4f-9a5d-ca10f383173d None admin] REQUEST_METHOD: `GET` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:41:37.468245 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7461fbbf-7214-4e4f-9a5d-ca10f383173d None admin] SCRIPT_NAME: `/identity` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:41:37.468245 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7461fbbf-7214-4e4f-9a5d-ca10f383173d None admin] PATH_INFO: `/v3/groups/f9af76a4bd6148d7945469c0549779ae` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:41:37.468245 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7461fbbf-7214-4e4f-9a5d-ca10f383173d None admin] RBAC: Authorizing `identity:get_group(group_id=f9af76a4bd6148d7945469c0549779ae)` {{(pid=82026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:41:37.468810 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7461fbbf-7214-4e4f-9a5d-ca10f383173d None admin] RBAC: Authorization granted {{(pid=82026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:41:37.469433 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cabe79b5-1d9e-4297-9faf-6f7b694a62d9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57539b6a6f3b4d589f5f5e1d211cd6a0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82025) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:41:37.470081 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cabe79b5-1d9e-4297-9faf-6f7b694a62d9 None admin] REQUEST_METHOD: `GET` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:41:37.470366 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cabe79b5-1d9e-4297-9faf-6f7b694a62d9 None admin] SCRIPT_NAME: `/identity` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:41:37.470640 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cabe79b5-1d9e-4297-9faf-6f7b694a62d9 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:41:37.471121 dv-cinder-828806-6-smb devstack@keystone.service[82026]: [pid: 82026|app: 0|req: 202/408] 10.222.0.33 () {56 vars in 1180 bytes} [Tue Sep 13 19:41:37 2022] GET /identity/v3/groups/f9af76a4bd6148d7945469c0549779ae => generated 229 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 19:41:37.480757 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7461fbbf-7214-4e4f-9a5d-ca10f383173d None admin] Authenticating user token {{(pid=82026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:41:37.495274 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cabe79b5-1d9e-4297-9faf-6f7b694a62d9 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=82025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 13 19:41:37.502703 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application [None req-cabe79b5-1d9e-4297-9faf-6f7b694a62d9 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 13 19:41:37.502703 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 19:41:37.502703 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 19:41:37.502703 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 19:41:37.502703 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 19:41:37.502703 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 19:41:37.502703 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 19:41:37.502703 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 19:41:37.502703 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 19:41:37.502703 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 19:41:37.502703 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 19:41:37.502703 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 19:41:37.502703 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 13 19:41:37.502703 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 13 19:41:37.502703 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 13 19:41:37.502703 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 13 19:41:37.503650 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 13 19:41:37.503650 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 13 19:41:37.503650 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 13 19:41:37.503650 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 13 19:41:37.503650 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 19:41:37.503650 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 19:41:37.503650 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 19:41:37.503650 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 19:41:37.503650 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 19:41:37.503650 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 19:41:37.503650 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 19:41:37.503650 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application with Lock( Sep 13 19:41:37.503650 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 19:41:37.503650 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application return self._enter() Sep 13 19:41:37.503650 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 19:41:37.503650 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 19:41:37.504448 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 19:41:37.504448 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application return self.creator() Sep 13 19:41:37.504448 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 19:41:37.504448 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application created_value = creator( Sep 13 19:41:37.504448 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 13 19:41:37.504448 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 13 19:41:37.504448 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 13 19:41:37.504448 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 13 19:41:37.504448 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 13 19:41:37.504448 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 13 19:41:37.504448 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 13 19:41:37.504448 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application Sep 13 19:41:37.504448 dv-cinder-828806-6-smb devstack@keystone.service[82025]: [pid: 82025|app: 0|req: 207/409] 10.222.0.33 () {56 vars in 1114 bytes} [Tue Sep 13 19:41:37 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 242 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 13 19:41:37.511918 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cabe79b5-1d9e-4297-9faf-6f7b694a62d9 None admin] Authenticating user token {{(pid=82025) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:41:37.611559 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7461fbbf-7214-4e4f-9a5d-ca10f383173d None admin] Validating token access rules against request {{(pid=82026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:41:37.652548 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b899a5cb-ca9f-4fe9-92df-7d651c415bf9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57539b6a6f3b4d589f5f5e1d211cd6a0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:41:37.653486 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b899a5cb-ca9f-4fe9-92df-7d651c415bf9 None admin] REQUEST_METHOD: `GET` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:41:37.653975 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b899a5cb-ca9f-4fe9-92df-7d651c415bf9 None admin] SCRIPT_NAME: `/identity` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:41:37.654435 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b899a5cb-ca9f-4fe9-92df-7d651c415bf9 None admin] PATH_INFO: `/v3/projects/b454f707d20347ada3d82aa85495635e` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:41:37.657348 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b899a5cb-ca9f-4fe9-92df-7d651c415bf9 None admin] RBAC: Authorizing `identity:get_project(project_id=b454f707d20347ada3d82aa85495635e)` {{(pid=82026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:41:37.659180 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b899a5cb-ca9f-4fe9-92df-7d651c415bf9 None admin] RBAC: Authorization granted {{(pid=82026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:41:37.662177 dv-cinder-828806-6-smb devstack@keystone.service[82026]: [pid: 82026|app: 0|req: 203/410] 10.222.0.33 () {56 vars in 1186 bytes} [Tue Sep 13 19:41:37 2022] GET /identity/v3/projects/b454f707d20347ada3d82aa85495635e => generated 344 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 19:41:37.669924 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b899a5cb-ca9f-4fe9-92df-7d651c415bf9 None admin] Authenticating user token {{(pid=82026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:41:37.704572 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG dbcounter [-] [82025] Writing DB stats keystone:SELECT=100 {{(pid=82025) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:41:37.736896 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG dbcounter [-] [82026] Writing DB stats keystone:SELECT=100 {{(pid=82026) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:41:37.745795 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cabe79b5-1d9e-4297-9faf-6f7b694a62d9 None admin] Validating token access rules against request {{(pid=82025) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:41:37.822626 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7048c3b3-1dd6-4da9-9440-125898397d43 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57539b6a6f3b4d589f5f5e1d211cd6a0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82025) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:41:37.824525 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7048c3b3-1dd6-4da9-9440-125898397d43 None admin] REQUEST_METHOD: `GET` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:41:37.826155 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7048c3b3-1dd6-4da9-9440-125898397d43 None admin] SCRIPT_NAME: `/identity` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:41:37.826633 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7048c3b3-1dd6-4da9-9440-125898397d43 None admin] PATH_INFO: `/v3/roles` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:41:37.828508 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7048c3b3-1dd6-4da9-9440-125898397d43 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=82025) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 19:41:37.829927 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7048c3b3-1dd6-4da9-9440-125898397d43 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:41:37.831970 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7048c3b3-1dd6-4da9-9440-125898397d43 None admin] RBAC: Authorization granted {{(pid=82025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:41:37.838286 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b899a5cb-ca9f-4fe9-92df-7d651c415bf9 None admin] Validating token access rules against request {{(pid=82026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:41:37.853957 dv-cinder-828806-6-smb devstack@keystone.service[82025]: [pid: 82025|app: 0|req: 208/411] 10.222.0.33 () {56 vars in 1111 bytes} [Tue Sep 13 19:41:37 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 342 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 19:41:37.860698 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7048c3b3-1dd6-4da9-9440-125898397d43 None admin] Authenticating user token {{(pid=82025) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:41:37.920407 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb98e0a9-a0c8-437c-a35a-51d9f4bdc141 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57539b6a6f3b4d589f5f5e1d211cd6a0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:41:37.922750 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb98e0a9-a0c8-437c-a35a-51d9f4bdc141 None admin] REQUEST_METHOD: `PUT` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:41:37.923252 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb98e0a9-a0c8-437c-a35a-51d9f4bdc141 None admin] SCRIPT_NAME: `/identity` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:41:37.925564 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb98e0a9-a0c8-437c-a35a-51d9f4bdc141 None admin] PATH_INFO: `/v3/projects/b454f707d20347ada3d82aa85495635e/groups/f9af76a4bd6148d7945469c0549779ae/roles/e5af7d5baa93469e9e486ef21c85474e` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:41:37.930929 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb98e0a9-a0c8-437c-a35a-51d9f4bdc141 None admin] RBAC: Authorizing `identity:create_grant(project_id=b454f707d20347ada3d82aa85495635e, group_id=f9af76a4bd6148d7945469c0549779ae, role_id=e5af7d5baa93469e9e486ef21c85474e)` {{(pid=82026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:41:37.932676 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb98e0a9-a0c8-437c-a35a-51d9f4bdc141 None admin] RBAC: Authorization granted {{(pid=82026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:41:38.011134 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7048c3b3-1dd6-4da9-9440-125898397d43 None admin] Validating token access rules against request {{(pid=82025) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:41:38.013172 dv-cinder-828806-6-smb devstack@keystone.service[82026]: [pid: 82026|app: 0|req: 204/412] 10.222.0.33 () {58 vars in 1442 bytes} [Tue Sep 13 19:41:37 2022] PUT /identity/v3/projects/b454f707d20347ada3d82aa85495635e/groups/f9af76a4bd6148d7945469c0549779ae/roles/e5af7d5baa93469e9e486ef21c85474e => generated 0 bytes in 343 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 19:41:38.080019 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcce4c99-24de-406d-a151-1a2897ac29b0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57539b6a6f3b4d589f5f5e1d211cd6a0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82025) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:41:38.080666 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcce4c99-24de-406d-a151-1a2897ac29b0 None admin] REQUEST_METHOD: `GET` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:41:38.080951 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcce4c99-24de-406d-a151-1a2897ac29b0 None admin] SCRIPT_NAME: `/identity` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:41:38.081229 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcce4c99-24de-406d-a151-1a2897ac29b0 None admin] PATH_INFO: `/v3/groups/df4ab391f1e040fd93d08113e416b125` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:41:38.082346 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcce4c99-24de-406d-a151-1a2897ac29b0 None admin] RBAC: Authorizing `identity:get_group(group_id=df4ab391f1e040fd93d08113e416b125)` {{(pid=82025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:41:38.083831 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcce4c99-24de-406d-a151-1a2897ac29b0 None admin] RBAC: Authorization granted {{(pid=82025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:41:38.085714 dv-cinder-828806-6-smb devstack@keystone.service[82025]: [pid: 82025|app: 0|req: 209/413] 10.222.0.33 () {56 vars in 1180 bytes} [Tue Sep 13 19:41:37 2022] GET /identity/v3/groups/df4ab391f1e040fd93d08113e416b125 => generated 226 bytes in 225 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 19:41:38.091432 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb98e0a9-a0c8-437c-a35a-51d9f4bdc141 None admin] Authenticating user token {{(pid=82026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:41:38.259617 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb98e0a9-a0c8-437c-a35a-51d9f4bdc141 None admin] Validating token access rules against request {{(pid=82026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:41:38.273086 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG dbcounter [-] [82026] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82026) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:41:38.313934 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f899a70-b1f4-4698-ac06-03d4703fcc82 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57539b6a6f3b4d589f5f5e1d211cd6a0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:41:38.314571 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f899a70-b1f4-4698-ac06-03d4703fcc82 None admin] REQUEST_METHOD: `GET` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:41:38.314854 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f899a70-b1f4-4698-ac06-03d4703fcc82 None admin] SCRIPT_NAME: `/identity` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:41:38.315196 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f899a70-b1f4-4698-ac06-03d4703fcc82 None admin] PATH_INFO: `/v3/projects/bee3101ec8f84efa9f84a402c3c3cbbe` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:41:38.316590 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f899a70-b1f4-4698-ac06-03d4703fcc82 None admin] RBAC: Authorizing `identity:get_project(project_id=bee3101ec8f84efa9f84a402c3c3cbbe)` {{(pid=82026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:41:38.319004 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f899a70-b1f4-4698-ac06-03d4703fcc82 None admin] RBAC: Authorization granted {{(pid=82026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:41:38.321143 dv-cinder-828806-6-smb devstack@keystone.service[82026]: [pid: 82026|app: 0|req: 205/414] 10.222.0.33 () {56 vars in 1186 bytes} [Tue Sep 13 19:41:38 2022] GET /identity/v3/projects/bee3101ec8f84efa9f84a402c3c3cbbe => generated 302 bytes in 230 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 19:41:38.326789 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcce4c99-24de-406d-a151-1a2897ac29b0 None admin] Authenticating user token {{(pid=82025) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:41:38.347710 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG dbcounter [-] [82025] Writing DB stats keystone:SELECT=100 {{(pid=82025) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:41:38.420010 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acb4ecf8-ef71-4597-89af-0b201abd89a6 None None] REQUEST_METHOD: `GET` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:41:38.420947 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acb4ecf8-ef71-4597-89af-0b201abd89a6 None None] SCRIPT_NAME: `/identity` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:41:38.421454 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acb4ecf8-ef71-4597-89af-0b201abd89a6 None None] PATH_INFO: `/` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:41:38.423704 dv-cinder-828806-6-smb devstack@keystone.service[82026]: [pid: 82026|app: 0|req: 206/415] 10.222.0.33 () {54 vars in 927 bytes} [Tue Sep 13 19:41:38 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 13 19:41:38.434748 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fed2cffe-54a7-4a67-99ec-6f3ea35981db None None] REQUEST_METHOD: `POST` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:41:38.435343 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fed2cffe-54a7-4a67-99ec-6f3ea35981db None None] SCRIPT_NAME: `/identity` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:41:38.435815 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fed2cffe-54a7-4a67-99ec-6f3ea35981db None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:41:38.444239 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcce4c99-24de-406d-a151-1a2897ac29b0 None admin] Validating token access rules against request {{(pid=82025) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:41:38.472050 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.auth.core [None req-fed2cffe-54a7-4a67-99ec-6f3ea35981db None None] MFA Rules not processed for user `57539b6a6f3b4d589f5f5e1d211cd6a0`. Rule list: `[]` (Enabled: `True`). {{(pid=82026) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 19:41:38.473605 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.common.fernet_utils [None req-fed2cffe-54a7-4a67-99ec-6f3ea35981db None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82026) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 19:41:38.483521 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d7e1d09-4a74-4baa-8f83-86e309221381 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57539b6a6f3b4d589f5f5e1d211cd6a0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82025) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:41:38.483521 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d7e1d09-4a74-4baa-8f83-86e309221381 None admin] REQUEST_METHOD: `PUT` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:41:38.483748 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d7e1d09-4a74-4baa-8f83-86e309221381 None admin] SCRIPT_NAME: `/identity` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:41:38.483981 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d7e1d09-4a74-4baa-8f83-86e309221381 None admin] PATH_INFO: `/v3/projects/bee3101ec8f84efa9f84a402c3c3cbbe/groups/df4ab391f1e040fd93d08113e416b125/roles/6bcd095c76b341e186ea8caa11f5fa31` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:41:38.486186 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d7e1d09-4a74-4baa-8f83-86e309221381 None admin] RBAC: Authorizing `identity:create_grant(project_id=bee3101ec8f84efa9f84a402c3c3cbbe, group_id=df4ab391f1e040fd93d08113e416b125, role_id=6bcd095c76b341e186ea8caa11f5fa31)` {{(pid=82025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:41:38.487785 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d7e1d09-4a74-4baa-8f83-86e309221381 None admin] RBAC: Authorization granted {{(pid=82025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:41:38.552555 dv-cinder-828806-6-smb devstack@keystone.service[82025]: [pid: 82025|app: 0|req: 210/416] 10.222.0.33 () {58 vars in 1442 bytes} [Tue Sep 13 19:41:38 2022] PUT /identity/v3/projects/bee3101ec8f84efa9f84a402c3c3cbbe/groups/df4ab391f1e040fd93d08113e416b125/roles/6bcd095c76b341e186ea8caa11f5fa31 => generated 0 bytes in 226 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 19:41:38.571462 dv-cinder-828806-6-smb devstack@keystone.service[82026]: [pid: 82026|app: 0|req: 207/417] 10.222.0.33 () {58 vars in 1024 bytes} [Tue Sep 13 19:41:38 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 137 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 13 19:41:38.854686 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d7e1d09-4a74-4baa-8f83-86e309221381 None admin] Authenticating user token {{(pid=82025) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:41:38.933506 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG dbcounter [-] [82025] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82025) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:41:38.967138 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d7e1d09-4a74-4baa-8f83-86e309221381 None admin] Validating token access rules against request {{(pid=82025) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:41:39.007914 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbea3b6f-4f46-4169-8c5c-2de27888cd5b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57539b6a6f3b4d589f5f5e1d211cd6a0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82025) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:41:39.008553 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbea3b6f-4f46-4169-8c5c-2de27888cd5b None admin] REQUEST_METHOD: `GET` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:41:39.008841 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbea3b6f-4f46-4169-8c5c-2de27888cd5b None admin] SCRIPT_NAME: `/identity` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:41:39.009118 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbea3b6f-4f46-4169-8c5c-2de27888cd5b None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:41:39.021090 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbea3b6f-4f46-4169-8c5c-2de27888cd5b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=82025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 13 19:41:39.026709 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application [None req-bbea3b6f-4f46-4169-8c5c-2de27888cd5b None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 13 19:41:39.026709 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 19:41:39.026709 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 19:41:39.026709 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 19:41:39.026709 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 19:41:39.026709 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 19:41:39.026709 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 19:41:39.026709 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 19:41:39.026709 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 19:41:39.026709 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 19:41:39.026709 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 19:41:39.026709 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 19:41:39.026709 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 13 19:41:39.026709 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 13 19:41:39.026709 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 13 19:41:39.026709 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 13 19:41:39.027814 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 13 19:41:39.027814 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 13 19:41:39.027814 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 13 19:41:39.027814 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 13 19:41:39.027814 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 19:41:39.027814 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 19:41:39.027814 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 19:41:39.027814 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 19:41:39.027814 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 19:41:39.027814 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 19:41:39.027814 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 19:41:39.027814 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application with Lock( Sep 13 19:41:39.027814 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 19:41:39.027814 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application return self._enter() Sep 13 19:41:39.027814 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 19:41:39.027814 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 19:41:39.028822 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 19:41:39.028822 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application return self.creator() Sep 13 19:41:39.028822 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 19:41:39.028822 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application created_value = creator( Sep 13 19:41:39.028822 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 13 19:41:39.028822 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 13 19:41:39.028822 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 13 19:41:39.028822 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 13 19:41:39.028822 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 13 19:41:39.028822 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 13 19:41:39.028822 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 13 19:41:39.028822 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application Sep 13 19:41:39.032319 dv-cinder-828806-6-smb devstack@keystone.service[82025]: [pid: 82025|app: 0|req: 211/418] 10.222.0.33 () {56 vars in 1114 bytes} [Tue Sep 13 19:41:38 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 19:41:39.038106 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fed2cffe-54a7-4a67-99ec-6f3ea35981db None None] Authenticating user token {{(pid=82026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:41:39.182629 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fed2cffe-54a7-4a67-99ec-6f3ea35981db None None] Validating token access rules against request {{(pid=82026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:41:39.193728 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG dbcounter [-] [82026] Writing DB stats keystone:SELECT=100 {{(pid=82026) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:41:39.238749 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07f74379-e9bb-47fd-9d88-6c8923dd2d64 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57539b6a6f3b4d589f5f5e1d211cd6a0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:41:39.239464 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07f74379-e9bb-47fd-9d88-6c8923dd2d64 None admin] REQUEST_METHOD: `GET` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:41:39.239747 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07f74379-e9bb-47fd-9d88-6c8923dd2d64 None admin] SCRIPT_NAME: `/identity` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:41:39.240026 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07f74379-e9bb-47fd-9d88-6c8923dd2d64 None admin] PATH_INFO: `/v3/roles` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:41:39.240716 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07f74379-e9bb-47fd-9d88-6c8923dd2d64 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=82026) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 19:41:39.241027 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07f74379-e9bb-47fd-9d88-6c8923dd2d64 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:41:39.242419 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07f74379-e9bb-47fd-9d88-6c8923dd2d64 None admin] RBAC: Authorization granted {{(pid=82026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:41:39.252698 dv-cinder-828806-6-smb devstack@keystone.service[82026]: [pid: 82026|app: 0|req: 208/419] 10.222.0.33 () {56 vars in 1111 bytes} [Tue Sep 13 19:41:39 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 215 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 19:41:39.258405 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbea3b6f-4f46-4169-8c5c-2de27888cd5b None admin] Authenticating user token {{(pid=82025) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:41:39.380476 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbea3b6f-4f46-4169-8c5c-2de27888cd5b None admin] Validating token access rules against request {{(pid=82025) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:41:39.404597 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1041940-603e-4c59-8783-4692290e0ba0 None None] REQUEST_METHOD: `GET` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:41:39.405563 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1041940-603e-4c59-8783-4692290e0ba0 None None] SCRIPT_NAME: `/identity` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:41:39.406050 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1041940-603e-4c59-8783-4692290e0ba0 None None] PATH_INFO: `/` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:41:39.407640 dv-cinder-828806-6-smb devstack@keystone.service[82026]: [pid: 82026|app: 0|req: 209/420] 10.222.0.33 () {54 vars in 927 bytes} [Tue Sep 13 19:41:39 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 19:41:39.413326 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-851b16c2-e345-4db4-b893-f415dbfba168 None None] REQUEST_METHOD: `POST` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:41:39.413923 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-851b16c2-e345-4db4-b893-f415dbfba168 None None] SCRIPT_NAME: `/identity` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:41:39.414415 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-851b16c2-e345-4db4-b893-f415dbfba168 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:41:39.451100 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG dbcounter [-] [82025] Writing DB stats keystone:SELECT=100 {{(pid=82025) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:41:39.459495 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d905197-3688-4473-9301-bd7fec1faeec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57539b6a6f3b4d589f5f5e1d211cd6a0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82025) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:41:39.462068 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d905197-3688-4473-9301-bd7fec1faeec None admin] REQUEST_METHOD: `GET` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:41:39.462068 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d905197-3688-4473-9301-bd7fec1faeec None admin] SCRIPT_NAME: `/identity` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:41:39.462068 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d905197-3688-4473-9301-bd7fec1faeec None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:41:39.462969 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.auth.core [None req-851b16c2-e345-4db4-b893-f415dbfba168 None None] MFA Rules not processed for user `57539b6a6f3b4d589f5f5e1d211cd6a0`. Rule list: `[]` (Enabled: `True`). {{(pid=82026) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 19:41:39.464180 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.common.fernet_utils [None req-851b16c2-e345-4db4-b893-f415dbfba168 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82026) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 19:41:39.570534 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d905197-3688-4473-9301-bd7fec1faeec None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=82025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:41:39.572014 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d905197-3688-4473-9301-bd7fec1faeec None admin] RBAC: Authorization granted {{(pid=82025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:41:39.604388 dv-cinder-828806-6-smb devstack@keystone.service[82026]: [pid: 82026|app: 0|req: 210/421] 10.222.0.33 () {58 vars in 1024 bytes} [Tue Sep 13 19:41:39 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 192 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 13 19:41:39.720029 dv-cinder-828806-6-smb devstack@keystone.service[82025]: [pid: 82025|app: 0|req: 212/422] 10.222.0.33 () {58 vars in 1282 bytes} [Tue Sep 13 19:41:39 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 462 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 13 19:41:39.726207 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-851b16c2-e345-4db4-b893-f415dbfba168 None None] Authenticating user token {{(pid=82026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:41:39.860158 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG dbcounter [-] [82026] Writing DB stats keystone:SELECT=100 {{(pid=82026) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:41:39.863407 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1687e661-d7a9-4834-9b92-cfd8961a67a5 None None] REQUEST_METHOD: `GET` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:41:39.864312 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1687e661-d7a9-4834-9b92-cfd8961a67a5 None None] SCRIPT_NAME: `/identity` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:41:39.864427 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-851b16c2-e345-4db4-b893-f415dbfba168 None None] Validating token access rules against request {{(pid=82026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:41:39.864900 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1687e661-d7a9-4834-9b92-cfd8961a67a5 None None] PATH_INFO: `/` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:41:39.867516 dv-cinder-828806-6-smb devstack@keystone.service[82025]: [pid: 82025|app: 0|req: 213/423] 10.222.0.33 () {54 vars in 927 bytes} [Tue Sep 13 19:41:39 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 13 19:41:39.873002 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92c8b36a-7212-47e7-9520-b4eb07c08e9b None None] REQUEST_METHOD: `POST` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:41:39.873291 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92c8b36a-7212-47e7-9520-b4eb07c08e9b None None] SCRIPT_NAME: `/identity` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:41:39.873573 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92c8b36a-7212-47e7-9520-b4eb07c08e9b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:41:39.900653 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31acc2c5-6e76-4945-9e30-eb22d8549381 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57539b6a6f3b4d589f5f5e1d211cd6a0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:41:39.901287 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31acc2c5-6e76-4945-9e30-eb22d8549381 None admin] REQUEST_METHOD: `GET` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:41:39.901567 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31acc2c5-6e76-4945-9e30-eb22d8549381 None admin] SCRIPT_NAME: `/identity` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:41:39.901840 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31acc2c5-6e76-4945-9e30-eb22d8549381 None admin] PATH_INFO: `/v3/projects/7e18b3e4745c4afeaafeb826dc0445e0` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:41:39.902531 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.auth.core [None req-92c8b36a-7212-47e7-9520-b4eb07c08e9b None None] MFA Rules not processed for user `57539b6a6f3b4d589f5f5e1d211cd6a0`. Rule list: `[]` (Enabled: `True`). {{(pid=82025) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 19:41:39.902954 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31acc2c5-6e76-4945-9e30-eb22d8549381 None admin] RBAC: Authorizing `identity:get_project(project_id=7e18b3e4745c4afeaafeb826dc0445e0)` {{(pid=82026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:41:39.903810 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.fernet_utils [None req-92c8b36a-7212-47e7-9520-b4eb07c08e9b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82025) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 19:41:39.904587 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31acc2c5-6e76-4945-9e30-eb22d8549381 None admin] RBAC: Authorization granted {{(pid=82026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:41:39.911145 dv-cinder-828806-6-smb devstack@keystone.service[82026]: [pid: 82026|app: 0|req: 211/424] 10.222.0.33 () {56 vars in 1186 bytes} [Tue Sep 13 19:41:39 2022] GET /identity/v3/projects/7e18b3e4745c4afeaafeb826dc0445e0 => generated 298 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 19:41:39.913186 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31acc2c5-6e76-4945-9e30-eb22d8549381 None admin] Authenticating user token {{(pid=82026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:41:39.953911 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG dbcounter [-] [82025] Writing DB stats keystone:SELECT=100 {{(pid=82025) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:41:40.002895 dv-cinder-828806-6-smb devstack@keystone.service[82025]: [pid: 82025|app: 0|req: 214/425] 10.222.0.33 () {58 vars in 1024 bytes} [Tue Sep 13 19:41:39 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 13 19:41:40.003790 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92c8b36a-7212-47e7-9520-b4eb07c08e9b None None] Authenticating user token {{(pid=82025) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:41:40.043331 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31acc2c5-6e76-4945-9e30-eb22d8549381 None admin] Validating token access rules against request {{(pid=82026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:41:40.107676 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ec77bf2-8115-4f20-911b-11629d90913c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57539b6a6f3b4d589f5f5e1d211cd6a0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:41:40.108947 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ec77bf2-8115-4f20-911b-11629d90913c None admin] REQUEST_METHOD: `GET` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:41:40.109233 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ec77bf2-8115-4f20-911b-11629d90913c None admin] SCRIPT_NAME: `/identity` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:41:40.109508 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ec77bf2-8115-4f20-911b-11629d90913c None admin] PATH_INFO: `/v3/groups/df4ab391f1e040fd93d08113e416b125` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:41:40.110875 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ec77bf2-8115-4f20-911b-11629d90913c None admin] RBAC: Authorizing `identity:get_group(group_id=df4ab391f1e040fd93d08113e416b125)` {{(pid=82026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:41:40.112350 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ec77bf2-8115-4f20-911b-11629d90913c None admin] RBAC: Authorization granted {{(pid=82026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:41:40.120767 dv-cinder-828806-6-smb devstack@keystone.service[82026]: [pid: 82026|app: 0|req: 212/426] 10.222.0.33 () {56 vars in 1180 bytes} [Tue Sep 13 19:41:39 2022] GET /identity/v3/groups/df4ab391f1e040fd93d08113e416b125 => generated 226 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 13 19:41:40.125682 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ec77bf2-8115-4f20-911b-11629d90913c None admin] Authenticating user token {{(pid=82026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:41:40.188237 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG dbcounter [-] [82026] Writing DB stats keystone:SELECT=100 {{(pid=82026) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:41:40.190512 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92c8b36a-7212-47e7-9520-b4eb07c08e9b None None] Validating token access rules against request {{(pid=82025) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:41:40.264035 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf91b03e-bac9-47d3-83df-d578afc572c3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57539b6a6f3b4d589f5f5e1d211cd6a0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82025) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:41:40.264664 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf91b03e-bac9-47d3-83df-d578afc572c3 None admin] REQUEST_METHOD: `GET` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:41:40.264997 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf91b03e-bac9-47d3-83df-d578afc572c3 None admin] SCRIPT_NAME: `/identity` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:41:40.265273 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf91b03e-bac9-47d3-83df-d578afc572c3 None admin] PATH_INFO: `/v3/roles/member` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:41:40.276322 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf91b03e-bac9-47d3-83df-d578afc572c3 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=82025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 13 19:41:40.276969 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ec77bf2-8115-4f20-911b-11629d90913c None admin] Validating token access rules against request {{(pid=82026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:41:40.282730 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application [None req-cf91b03e-bac9-47d3-83df-d578afc572c3 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 13 19:41:40.282730 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 19:41:40.282730 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 19:41:40.282730 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 19:41:40.282730 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 19:41:40.282730 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 19:41:40.282730 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 19:41:40.282730 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 19:41:40.282730 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 19:41:40.282730 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 19:41:40.282730 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 19:41:40.282730 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 19:41:40.282730 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 13 19:41:40.282730 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 13 19:41:40.282730 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 13 19:41:40.282730 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 13 19:41:40.283704 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 13 19:41:40.283704 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 13 19:41:40.283704 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 13 19:41:40.283704 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 13 19:41:40.283704 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 19:41:40.283704 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 19:41:40.283704 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 19:41:40.283704 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 19:41:40.283704 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 19:41:40.283704 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 19:41:40.283704 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 19:41:40.283704 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application with Lock( Sep 13 19:41:40.283704 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 19:41:40.283704 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application return self._enter() Sep 13 19:41:40.283704 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 19:41:40.283704 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 19:41:40.284509 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 19:41:40.284509 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application return self.creator() Sep 13 19:41:40.284509 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 19:41:40.284509 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application created_value = creator( Sep 13 19:41:40.284509 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 13 19:41:40.284509 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 13 19:41:40.284509 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 13 19:41:40.284509 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 13 19:41:40.284509 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 13 19:41:40.284509 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 13 19:41:40.284509 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 13 19:41:40.284509 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application Sep 13 19:41:40.284509 dv-cinder-828806-6-smb devstack@keystone.service[82025]: [pid: 82025|app: 0|req: 215/427] 10.222.0.33 () {56 vars in 1099 bytes} [Tue Sep 13 19:41:40 2022] GET /identity/v3/roles/member => generated 84 bytes in 280 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 19:41:40.295572 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf91b03e-bac9-47d3-83df-d578afc572c3 None admin] Authenticating user token {{(pid=82025) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:41:40.316348 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG dbcounter [-] [82025] Writing DB stats keystone:SELECT=100 {{(pid=82025) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:41:40.353750 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e7f1992-2af6-491d-97e2-0eec17765237 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57539b6a6f3b4d589f5f5e1d211cd6a0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:41:40.354397 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e7f1992-2af6-491d-97e2-0eec17765237 None admin] REQUEST_METHOD: `GET` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:41:40.354683 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e7f1992-2af6-491d-97e2-0eec17765237 None admin] SCRIPT_NAME: `/identity` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:41:40.354958 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e7f1992-2af6-491d-97e2-0eec17765237 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:41:40.355978 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e7f1992-2af6-491d-97e2-0eec17765237 None admin] RBAC: Adding query filter params (group.id=df4ab391f1e040fd93d08113e416b125, role.id=6bcd095c76b341e186ea8caa11f5fa31, scope.project.id=7e18b3e4745c4afeaafeb826dc0445e0) {{(pid=82026) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 19:41:40.356290 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e7f1992-2af6-491d-97e2-0eec17765237 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=82026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:41:40.358975 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e7f1992-2af6-491d-97e2-0eec17765237 None admin] RBAC: Authorization granted {{(pid=82026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:41:40.371194 dv-cinder-828806-6-smb devstack@keystone.service[82026]: [pid: 82026|app: 0|req: 213/428] 10.222.0.33 () {56 vars in 1376 bytes} [Tue Sep 13 19:41:40 2022] GET /identity/v3/role_assignments?group.id=df4ab391f1e040fd93d08113e416b125&scope.project.id=7e18b3e4745c4afeaafeb826dc0445e0&role.id=6bcd095c76b341e186ea8caa11f5fa31 => generated 611 bytes in 244 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 13 19:41:40.372508 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e7f1992-2af6-491d-97e2-0eec17765237 None admin] Authenticating user token {{(pid=82026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:41:40.412907 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf91b03e-bac9-47d3-83df-d578afc572c3 None admin] Validating token access rules against request {{(pid=82025) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:41:40.454870 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3e0e4b0-e7a1-4d20-b753-c44078669a59 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57539b6a6f3b4d589f5f5e1d211cd6a0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82025) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:41:40.455894 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3e0e4b0-e7a1-4d20-b753-c44078669a59 None admin] REQUEST_METHOD: `GET` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:41:40.456381 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3e0e4b0-e7a1-4d20-b753-c44078669a59 None admin] SCRIPT_NAME: `/identity` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:41:40.456880 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3e0e4b0-e7a1-4d20-b753-c44078669a59 None admin] PATH_INFO: `/v3/roles` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:41:40.457780 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3e0e4b0-e7a1-4d20-b753-c44078669a59 None admin] RBAC: Adding query filter params (name=member) {{(pid=82025) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 19:41:40.458313 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3e0e4b0-e7a1-4d20-b753-c44078669a59 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:41:40.460152 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3e0e4b0-e7a1-4d20-b753-c44078669a59 None admin] RBAC: Authorization granted {{(pid=82025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:41:40.471750 dv-cinder-828806-6-smb devstack@keystone.service[82025]: [pid: 82025|app: 0|req: 216/429] 10.222.0.33 () {56 vars in 1101 bytes} [Tue Sep 13 19:41:40 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 13 19:41:40.484156 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3e0e4b0-e7a1-4d20-b753-c44078669a59 None admin] Authenticating user token {{(pid=82025) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:41:40.547385 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG dbcounter [-] [82026] Writing DB stats keystone:SELECT=100 {{(pid=82026) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:41:40.550304 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e7f1992-2af6-491d-97e2-0eec17765237 None admin] Validating token access rules against request {{(pid=82026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:41:40.598183 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG dbcounter [-] [82025] Writing DB stats keystone:SELECT=100 {{(pid=82025) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:41:40.619023 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3e0e4b0-e7a1-4d20-b753-c44078669a59 None admin] Validating token access rules against request {{(pid=82025) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:41:40.628779 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1be046af-ecb4-48ad-b4bd-875b07412ab7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57539b6a6f3b4d589f5f5e1d211cd6a0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:41:40.629454 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1be046af-ecb4-48ad-b4bd-875b07412ab7 None admin] REQUEST_METHOD: `GET` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:41:40.629740 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1be046af-ecb4-48ad-b4bd-875b07412ab7 None admin] SCRIPT_NAME: `/identity` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:41:40.630021 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1be046af-ecb4-48ad-b4bd-875b07412ab7 None admin] PATH_INFO: `/v3/roles/member` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:41:40.658288 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1be046af-ecb4-48ad-b4bd-875b07412ab7 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=82026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 13 19:41:40.661143 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4765e6c0-a739-4fb5-8ace-86be09721ce8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57539b6a6f3b4d589f5f5e1d211cd6a0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82025) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:41:40.662057 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4765e6c0-a739-4fb5-8ace-86be09721ce8 None admin] REQUEST_METHOD: `GET` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:41:40.662542 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4765e6c0-a739-4fb5-8ace-86be09721ce8 None admin] SCRIPT_NAME: `/identity` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:41:40.663020 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4765e6c0-a739-4fb5-8ace-86be09721ce8 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:41:40.663231 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application [None req-1be046af-ecb4-48ad-b4bd-875b07412ab7 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 13 19:41:40.663231 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 19:41:40.663231 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 19:41:40.663231 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 19:41:40.663231 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 19:41:40.663231 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 19:41:40.663231 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 19:41:40.663231 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 19:41:40.663231 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 19:41:40.663231 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 19:41:40.663231 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 19:41:40.663231 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 19:41:40.663231 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 13 19:41:40.663231 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 13 19:41:40.663231 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 13 19:41:40.663231 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 13 19:41:40.664090 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 13 19:41:40.664090 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 13 19:41:40.664090 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 13 19:41:40.664090 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 13 19:41:40.664090 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 19:41:40.664090 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 19:41:40.664090 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 19:41:40.664090 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 19:41:40.664090 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 19:41:40.664090 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 19:41:40.664090 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 19:41:40.664090 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application with Lock( Sep 13 19:41:40.664090 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 19:41:40.664090 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application return self._enter() Sep 13 19:41:40.664090 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 19:41:40.664090 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 19:41:40.664943 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 19:41:40.664943 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application return self.creator() Sep 13 19:41:40.664943 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 19:41:40.664943 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application created_value = creator( Sep 13 19:41:40.664943 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 13 19:41:40.664943 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 13 19:41:40.664943 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 13 19:41:40.664943 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 13 19:41:40.664943 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 13 19:41:40.664943 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 13 19:41:40.664943 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 13 19:41:40.664943 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application Sep 13 19:41:40.669264 dv-cinder-828806-6-smb devstack@keystone.service[82026]: [pid: 82026|app: 0|req: 214/430] 10.222.0.33 () {56 vars in 1099 bytes} [Tue Sep 13 19:41:40 2022] GET /identity/v3/roles/member => generated 84 bytes in 293 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 19:41:40.670127 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1be046af-ecb4-48ad-b4bd-875b07412ab7 None admin] Authenticating user token {{(pid=82026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:41:40.753391 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4765e6c0-a739-4fb5-8ace-86be09721ce8 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=82025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:41:40.755291 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4765e6c0-a739-4fb5-8ace-86be09721ce8 None admin] RBAC: Authorization granted {{(pid=82025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:41:40.831461 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1be046af-ecb4-48ad-b4bd-875b07412ab7 None admin] Validating token access rules against request {{(pid=82026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:41:40.873403 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG dbcounter [-] [82025] Writing DB stats keystone:SELECT=100 {{(pid=82025) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:41:40.876738 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36e59f35-9869-45ef-81ce-9b8e015ebd64 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57539b6a6f3b4d589f5f5e1d211cd6a0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:41:40.877598 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36e59f35-9869-45ef-81ce-9b8e015ebd64 None admin] REQUEST_METHOD: `GET` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:41:40.878095 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36e59f35-9869-45ef-81ce-9b8e015ebd64 None admin] SCRIPT_NAME: `/identity` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:41:40.878553 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36e59f35-9869-45ef-81ce-9b8e015ebd64 None admin] PATH_INFO: `/v3/roles` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:41:40.879494 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36e59f35-9869-45ef-81ce-9b8e015ebd64 None admin] RBAC: Adding query filter params (name=member) {{(pid=82026) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 19:41:40.880093 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36e59f35-9869-45ef-81ce-9b8e015ebd64 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:41:40.881859 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36e59f35-9869-45ef-81ce-9b8e015ebd64 None admin] RBAC: Authorization granted {{(pid=82026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:41:40.891225 dv-cinder-828806-6-smb devstack@keystone.service[82025]: [pid: 82025|app: 0|req: 217/431] 10.222.0.33 () {58 vars in 1282 bytes} [Tue Sep 13 19:41:40 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 406 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 13 19:41:40.896717 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4765e6c0-a739-4fb5-8ace-86be09721ce8 None admin] Authenticating user token {{(pid=82025) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:41:40.900850 dv-cinder-828806-6-smb devstack@keystone.service[82026]: [pid: 82026|app: 0|req: 215/432] 10.222.0.33 () {56 vars in 1101 bytes} [Tue Sep 13 19:41:40 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 231 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 19:41:40.908700 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36e59f35-9869-45ef-81ce-9b8e015ebd64 None admin] Authenticating user token {{(pid=82026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:41:40.936902 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG dbcounter [-] [82026] Writing DB stats keystone:SELECT=100 {{(pid=82026) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:41:41.013430 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4765e6c0-a739-4fb5-8ace-86be09721ce8 None admin] Validating token access rules against request {{(pid=82025) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:41:41.013909 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36e59f35-9869-45ef-81ce-9b8e015ebd64 None admin] Validating token access rules against request {{(pid=82026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:41:41.048590 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca3c7c9e-a165-46e3-8a59-2ac6709c7345 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57539b6a6f3b4d589f5f5e1d211cd6a0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:41:41.049249 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca3c7c9e-a165-46e3-8a59-2ac6709c7345 None admin] REQUEST_METHOD: `GET` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:41:41.049488 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca3c7c9e-a165-46e3-8a59-2ac6709c7345 None admin] SCRIPT_NAME: `/identity` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:41:41.049771 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca3c7c9e-a165-46e3-8a59-2ac6709c7345 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:41:41.051326 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f65a4dd2-de47-4bec-84ed-e0e4723fe402 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57539b6a6f3b4d589f5f5e1d211cd6a0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82025) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:41:41.052197 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f65a4dd2-de47-4bec-84ed-e0e4723fe402 None admin] REQUEST_METHOD: `GET` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:41:41.052739 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f65a4dd2-de47-4bec-84ed-e0e4723fe402 None admin] SCRIPT_NAME: `/identity` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:41:41.053325 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f65a4dd2-de47-4bec-84ed-e0e4723fe402 None admin] PATH_INFO: `/v3/projects/7e18b3e4745c4afeaafeb826dc0445e0` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:41:41.054518 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f65a4dd2-de47-4bec-84ed-e0e4723fe402 None admin] RBAC: Authorizing `identity:get_project(project_id=7e18b3e4745c4afeaafeb826dc0445e0)` {{(pid=82025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:41:41.056008 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f65a4dd2-de47-4bec-84ed-e0e4723fe402 None admin] RBAC: Authorization granted {{(pid=82025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:41:41.062177 dv-cinder-828806-6-smb devstack@keystone.service[82025]: [pid: 82025|app: 0|req: 218/433] 10.222.0.33 () {56 vars in 1186 bytes} [Tue Sep 13 19:41:40 2022] GET /identity/v3/projects/7e18b3e4745c4afeaafeb826dc0445e0 => generated 298 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 19:41:41.062177 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc1447c8-2fcf-4b92-92f3-303abb1b90c7 None None] REQUEST_METHOD: `GET` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:41:41.062177 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc1447c8-2fcf-4b92-92f3-303abb1b90c7 None None] SCRIPT_NAME: `/identity` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:41:41.062177 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc1447c8-2fcf-4b92-92f3-303abb1b90c7 None None] PATH_INFO: `/` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:41:41.062177 dv-cinder-828806-6-smb devstack@keystone.service[82025]: [pid: 82025|app: 0|req: 219/434] 10.222.0.33 () {54 vars in 927 bytes} [Tue Sep 13 19:41:41 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 19:41:41.064452 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc1447c8-2fcf-4b92-92f3-303abb1b90c7 None None] Authenticating user token {{(pid=82025) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:41:41.122931 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca3c7c9e-a165-46e3-8a59-2ac6709c7345 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=82026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:41:41.123150 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG dbcounter [-] [82025] Writing DB stats keystone:SELECT=100 {{(pid=82025) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:41:41.125219 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca3c7c9e-a165-46e3-8a59-2ac6709c7345 None admin] RBAC: Authorization granted {{(pid=82026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:41:41.148280 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG dbcounter [-] [82026] Writing DB stats keystone:SELECT=100 {{(pid=82026) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:41:41.182724 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc1447c8-2fcf-4b92-92f3-303abb1b90c7 None None] Validating token access rules against request {{(pid=82025) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:41:41.224652 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f2fca6c-f4b4-4715-81c6-e6b4cc0e7e44 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57539b6a6f3b4d589f5f5e1d211cd6a0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82025) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:41:41.225712 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f2fca6c-f4b4-4715-81c6-e6b4cc0e7e44 None admin] REQUEST_METHOD: `GET` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:41:41.226203 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f2fca6c-f4b4-4715-81c6-e6b4cc0e7e44 None admin] SCRIPT_NAME: `/identity` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:41:41.226667 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f2fca6c-f4b4-4715-81c6-e6b4cc0e7e44 None admin] PATH_INFO: `/v3/groups/df4ab391f1e040fd93d08113e416b125` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:41:41.228127 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f2fca6c-f4b4-4715-81c6-e6b4cc0e7e44 None admin] RBAC: Authorizing `identity:get_group(group_id=df4ab391f1e040fd93d08113e416b125)` {{(pid=82025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:41:41.228715 dv-cinder-828806-6-smb devstack@keystone.service[82026]: [pid: 82026|app: 0|req: 216/435] 10.222.0.33 () {58 vars in 1282 bytes} [Tue Sep 13 19:41:40 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 320 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Sep 13 19:41:41.229971 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f2fca6c-f4b4-4715-81c6-e6b4cc0e7e44 None admin] RBAC: Authorization granted {{(pid=82025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:41:41.231895 dv-cinder-828806-6-smb devstack@keystone.service[82025]: [pid: 82025|app: 0|req: 220/436] 10.222.0.33 () {56 vars in 1180 bytes} [Tue Sep 13 19:41:41 2022] GET /identity/v3/groups/df4ab391f1e040fd93d08113e416b125 => generated 226 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 19:41:41.235513 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9c28db0-3949-4258-8b56-2c8a59de30ef None None] REQUEST_METHOD: `POST` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:41:41.235807 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9c28db0-3949-4258-8b56-2c8a59de30ef None None] SCRIPT_NAME: `/identity` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:41:41.236091 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9c28db0-3949-4258-8b56-2c8a59de30ef None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:41:41.238720 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f2fca6c-f4b4-4715-81c6-e6b4cc0e7e44 None admin] Authenticating user token {{(pid=82025) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:41:41.254097 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.auth.core [None req-c9c28db0-3949-4258-8b56-2c8a59de30ef None None] MFA Rules not processed for user `57539b6a6f3b4d589f5f5e1d211cd6a0`. Rule list: `[]` (Enabled: `True`). {{(pid=82026) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 19:41:41.255340 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.common.fernet_utils [None req-c9c28db0-3949-4258-8b56-2c8a59de30ef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82026) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 19:41:41.329212 dv-cinder-828806-6-smb devstack@keystone.service[82026]: [pid: 82026|app: 0|req: 217/437] 10.222.0.33 () {58 vars in 1024 bytes} [Tue Sep 13 19:41:41 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 13 19:41:41.330053 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9c28db0-3949-4258-8b56-2c8a59de30ef None None] Authenticating user token {{(pid=82026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:41:41.353955 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f2fca6c-f4b4-4715-81c6-e6b4cc0e7e44 None admin] Validating token access rules against request {{(pid=82025) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:41:41.376137 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG dbcounter [-] [82025] Writing DB stats keystone:SELECT=100 {{(pid=82025) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:41:41.385582 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG dbcounter [-] [82026] Writing DB stats keystone:SELECT=100 {{(pid=82026) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:41:41.391414 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1e6b855-4bd8-47b5-ad47-e02b97f4605e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57539b6a6f3b4d589f5f5e1d211cd6a0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82025) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:41:41.392108 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1e6b855-4bd8-47b5-ad47-e02b97f4605e None admin] REQUEST_METHOD: `GET` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:41:41.392390 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1e6b855-4bd8-47b5-ad47-e02b97f4605e None admin] SCRIPT_NAME: `/identity` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:41:41.392666 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1e6b855-4bd8-47b5-ad47-e02b97f4605e None admin] PATH_INFO: `/v3/projects/bee3101ec8f84efa9f84a402c3c3cbbe` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:41:41.393808 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1e6b855-4bd8-47b5-ad47-e02b97f4605e None admin] RBAC: Authorizing `identity:get_project(project_id=bee3101ec8f84efa9f84a402c3c3cbbe)` {{(pid=82025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:41:41.395267 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1e6b855-4bd8-47b5-ad47-e02b97f4605e None admin] RBAC: Authorization granted {{(pid=82025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:41:41.401484 dv-cinder-828806-6-smb devstack@keystone.service[82025]: [pid: 82025|app: 0|req: 221/438] 10.222.0.33 () {56 vars in 1186 bytes} [Tue Sep 13 19:41:41 2022] GET /identity/v3/projects/bee3101ec8f84efa9f84a402c3c3cbbe => generated 302 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 19:41:41.401484 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0f6985b-fc62-43fc-9913-e09858d2a7f0 None None] REQUEST_METHOD: `GET` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:41:41.401484 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0f6985b-fc62-43fc-9913-e09858d2a7f0 None None] SCRIPT_NAME: `/identity` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:41:41.401484 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0f6985b-fc62-43fc-9913-e09858d2a7f0 None None] PATH_INFO: `/` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:41:41.401484 dv-cinder-828806-6-smb devstack@keystone.service[82025]: [pid: 82025|app: 0|req: 222/439] 10.222.0.33 () {54 vars in 927 bytes} [Tue Sep 13 19:41:41 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 19:41:41.404814 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0f6985b-fc62-43fc-9913-e09858d2a7f0 None None] Authenticating user token {{(pid=82025) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:41:41.437668 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9c28db0-3949-4258-8b56-2c8a59de30ef None None] Validating token access rules against request {{(pid=82026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:41:41.477682 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9def7181-494c-4cee-8ad0-8e4691059d7c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57539b6a6f3b4d589f5f5e1d211cd6a0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:41:41.478752 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9def7181-494c-4cee-8ad0-8e4691059d7c None admin] REQUEST_METHOD: `GET` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:41:41.479236 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9def7181-494c-4cee-8ad0-8e4691059d7c None admin] SCRIPT_NAME: `/identity` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:41:41.479665 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9def7181-494c-4cee-8ad0-8e4691059d7c None admin] PATH_INFO: `/v3/role_assignments` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:41:41.480797 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9def7181-494c-4cee-8ad0-8e4691059d7c None admin] RBAC: Adding query filter params (group.id=df4ab391f1e040fd93d08113e416b125, role.id=3618ab638a65401f82333da7596d1daf, scope.project.id=7e18b3e4745c4afeaafeb826dc0445e0) {{(pid=82026) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 19:41:41.481262 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9def7181-494c-4cee-8ad0-8e4691059d7c None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=82026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:41:41.483827 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9def7181-494c-4cee-8ad0-8e4691059d7c None admin] RBAC: Authorization granted {{(pid=82026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:41:41.491750 dv-cinder-828806-6-smb devstack@keystone.service[82026]: [pid: 82026|app: 0|req: 218/440] 10.222.0.33 () {56 vars in 1376 bytes} [Tue Sep 13 19:41:41 2022] GET /identity/v3/role_assignments?group.id=df4ab391f1e040fd93d08113e416b125&scope.project.id=7e18b3e4745c4afeaafeb826dc0445e0&role.id=3618ab638a65401f82333da7596d1daf => generated 611 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 19:41:41.493103 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f4e2140-fdd5-426e-9c76-4cef006e4858 None None] REQUEST_METHOD: `POST` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:41:41.493540 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f4e2140-fdd5-426e-9c76-4cef006e4858 None None] SCRIPT_NAME: `/identity` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:41:41.493993 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f4e2140-fdd5-426e-9c76-4cef006e4858 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:41:41.535308 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.auth.core [None req-3f4e2140-fdd5-426e-9c76-4cef006e4858 None None] MFA Rules not processed for user `57539b6a6f3b4d589f5f5e1d211cd6a0`. Rule list: `[]` (Enabled: `True`). {{(pid=82026) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 19:41:41.537135 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.common.fernet_utils [None req-3f4e2140-fdd5-426e-9c76-4cef006e4858 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82026) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 19:41:41.538527 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0f6985b-fc62-43fc-9913-e09858d2a7f0 None None] Validating token access rules against request {{(pid=82025) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:41:41.578601 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d28861d7-33a7-47dc-916b-5c46222d5232 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57539b6a6f3b4d589f5f5e1d211cd6a0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82025) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:41:41.579534 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d28861d7-33a7-47dc-916b-5c46222d5232 None admin] REQUEST_METHOD: `GET` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:41:41.580000 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d28861d7-33a7-47dc-916b-5c46222d5232 None admin] SCRIPT_NAME: `/identity` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:41:41.580598 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d28861d7-33a7-47dc-916b-5c46222d5232 None admin] PATH_INFO: `/v3/groups/df4ab391f1e040fd93d08113e416b125` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:41:41.582032 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d28861d7-33a7-47dc-916b-5c46222d5232 None admin] RBAC: Authorizing `identity:get_group(group_id=df4ab391f1e040fd93d08113e416b125)` {{(pid=82025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:41:41.583725 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d28861d7-33a7-47dc-916b-5c46222d5232 None admin] RBAC: Authorization granted {{(pid=82025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:41:41.590641 dv-cinder-828806-6-smb devstack@keystone.service[82025]: [pid: 82025|app: 0|req: 223/441] 10.222.0.33 () {56 vars in 1180 bytes} [Tue Sep 13 19:41:41 2022] GET /identity/v3/groups/df4ab391f1e040fd93d08113e416b125 => generated 226 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 19:41:41.591946 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d28861d7-33a7-47dc-916b-5c46222d5232 None admin] Authenticating user token {{(pid=82025) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:41:41.623626 dv-cinder-828806-6-smb devstack@keystone.service[82026]: [pid: 82026|app: 0|req: 219/442] 10.222.0.33 () {58 vars in 1024 bytes} [Tue Sep 13 19:41:41 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 13 19:41:41.625564 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f4e2140-fdd5-426e-9c76-4cef006e4858 None None] Authenticating user token {{(pid=82026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:41:41.665109 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG dbcounter [-] [82025] Writing DB stats keystone:SELECT=100 {{(pid=82025) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:41:41.682686 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG dbcounter [-] [82026] Writing DB stats keystone:SELECT=100 {{(pid=82026) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:41:41.734486 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d28861d7-33a7-47dc-916b-5c46222d5232 None admin] Validating token access rules against request {{(pid=82025) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:41:41.748179 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f4e2140-fdd5-426e-9c76-4cef006e4858 None None] Validating token access rules against request {{(pid=82026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:41:41.778880 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07d8d5a7-3daf-4e67-9875-ef27b43265f0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57539b6a6f3b4d589f5f5e1d211cd6a0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82025) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:41:41.778880 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07d8d5a7-3daf-4e67-9875-ef27b43265f0 None admin] REQUEST_METHOD: `GET` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:41:41.779211 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07d8d5a7-3daf-4e67-9875-ef27b43265f0 None admin] SCRIPT_NAME: `/identity` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:41:41.779286 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07d8d5a7-3daf-4e67-9875-ef27b43265f0 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:41:41.780542 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07d8d5a7-3daf-4e67-9875-ef27b43265f0 None admin] RBAC: Adding query filter params (group.id=df4ab391f1e040fd93d08113e416b125, role.id=3618ab638a65401f82333da7596d1daf, scope.project.id=bee3101ec8f84efa9f84a402c3c3cbbe) {{(pid=82025) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 19:41:41.780852 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07d8d5a7-3daf-4e67-9875-ef27b43265f0 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=82025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:41:41.782501 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07d8d5a7-3daf-4e67-9875-ef27b43265f0 None admin] RBAC: Authorization granted {{(pid=82025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:41:41.797420 dv-cinder-828806-6-smb devstack@keystone.service[82025]: [pid: 82025|app: 0|req: 224/443] 10.222.0.33 () {56 vars in 1376 bytes} [Tue Sep 13 19:41:41 2022] GET /identity/v3/role_assignments?group.id=df4ab391f1e040fd93d08113e416b125&scope.project.id=bee3101ec8f84efa9f84a402c3c3cbbe&role.id=3618ab638a65401f82333da7596d1daf => generated 611 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 19:41:41.805020 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9898fda-dbf9-4ded-8314-40c1e8fa73f6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57539b6a6f3b4d589f5f5e1d211cd6a0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:41:41.806058 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9898fda-dbf9-4ded-8314-40c1e8fa73f6 None admin] REQUEST_METHOD: `GET` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:41:41.806572 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9898fda-dbf9-4ded-8314-40c1e8fa73f6 None admin] SCRIPT_NAME: `/identity` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:41:41.807120 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9898fda-dbf9-4ded-8314-40c1e8fa73f6 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:41:41.820556 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9898fda-dbf9-4ded-8314-40c1e8fa73f6 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=82026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 13 19:41:41.827926 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application [None req-f9898fda-dbf9-4ded-8314-40c1e8fa73f6 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 13 19:41:41.827926 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 19:41:41.827926 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 19:41:41.827926 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 19:41:41.827926 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 19:41:41.827926 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 19:41:41.827926 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 19:41:41.827926 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 19:41:41.827926 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 19:41:41.827926 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 19:41:41.827926 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 19:41:41.827926 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 19:41:41.827926 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 13 19:41:41.827926 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 13 19:41:41.827926 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 13 19:41:41.827926 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 13 19:41:41.829086 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 13 19:41:41.829086 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 13 19:41:41.829086 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 13 19:41:41.829086 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 13 19:41:41.829086 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 19:41:41.829086 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 19:41:41.829086 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 19:41:41.829086 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 19:41:41.829086 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 19:41:41.829086 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 19:41:41.829086 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 19:41:41.829086 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application with Lock( Sep 13 19:41:41.829086 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 19:41:41.829086 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application return self._enter() Sep 13 19:41:41.829086 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 19:41:41.829086 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 19:41:41.829897 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 19:41:41.829897 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application return self.creator() Sep 13 19:41:41.829897 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 19:41:41.829897 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application created_value = creator( Sep 13 19:41:41.829897 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 13 19:41:41.829897 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 13 19:41:41.829897 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 13 19:41:41.829897 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 13 19:41:41.829897 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 13 19:41:41.829897 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 13 19:41:41.829897 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 13 19:41:41.829897 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application Sep 13 19:41:41.831673 dv-cinder-828806-6-smb devstack@keystone.service[82026]: [pid: 82026|app: 0|req: 220/444] 10.222.0.33 () {56 vars in 1096 bytes} [Tue Sep 13 19:41:41 2022] GET /identity/v3/roles/admin => generated 83 bytes in 206 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 19:41:41.833906 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07d8d5a7-3daf-4e67-9875-ef27b43265f0 None admin] Authenticating user token {{(pid=82025) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:41:41.909307 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9898fda-dbf9-4ded-8314-40c1e8fa73f6 None admin] Authenticating user token {{(pid=82026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:41:41.972527 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07d8d5a7-3daf-4e67-9875-ef27b43265f0 None admin] Validating token access rules against request {{(pid=82025) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:41:42.000455 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG dbcounter [-] [82025] Writing DB stats keystone:SELECT=100 {{(pid=82025) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:41:42.013976 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe71bb2a-e1c7-42d9-b213-fa2f6d8e996c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57539b6a6f3b4d589f5f5e1d211cd6a0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82025) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:41:42.015801 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe71bb2a-e1c7-42d9-b213-fa2f6d8e996c None admin] REQUEST_METHOD: `GET` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:41:42.019236 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe71bb2a-e1c7-42d9-b213-fa2f6d8e996c None admin] SCRIPT_NAME: `/identity` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:41:42.019236 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe71bb2a-e1c7-42d9-b213-fa2f6d8e996c None admin] PATH_INFO: `/v3/roles` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:41:42.019236 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe71bb2a-e1c7-42d9-b213-fa2f6d8e996c None admin] RBAC: Adding query filter params (name=admin) {{(pid=82025) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 19:41:42.019236 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe71bb2a-e1c7-42d9-b213-fa2f6d8e996c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:41:42.019236 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe71bb2a-e1c7-42d9-b213-fa2f6d8e996c None admin] RBAC: Authorization granted {{(pid=82025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:41:42.030915 dv-cinder-828806-6-smb devstack@keystone.service[82025]: [pid: 82025|app: 0|req: 225/445] 10.222.0.33 () {56 vars in 1099 bytes} [Tue Sep 13 19:41:41 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 19:41:42.037086 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe71bb2a-e1c7-42d9-b213-fa2f6d8e996c None admin] Authenticating user token {{(pid=82025) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:41:42.037933 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9898fda-dbf9-4ded-8314-40c1e8fa73f6 None admin] Validating token access rules against request {{(pid=82026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:41:42.052909 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG dbcounter [-] [82026] Writing DB stats keystone:SELECT=100 {{(pid=82026) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:41:42.078712 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-545b546d-f0c5-40bf-8fb7-73a21d932c71 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57539b6a6f3b4d589f5f5e1d211cd6a0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:41:42.079424 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-545b546d-f0c5-40bf-8fb7-73a21d932c71 None admin] REQUEST_METHOD: `GET` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:41:42.079710 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-545b546d-f0c5-40bf-8fb7-73a21d932c71 None admin] SCRIPT_NAME: `/identity` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:41:42.079988 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-545b546d-f0c5-40bf-8fb7-73a21d932c71 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:41:42.094122 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-545b546d-f0c5-40bf-8fb7-73a21d932c71 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=82026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 13 19:41:42.099073 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application [None req-545b546d-f0c5-40bf-8fb7-73a21d932c71 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 13 19:41:42.099073 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 19:41:42.099073 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 19:41:42.099073 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 19:41:42.099073 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 19:41:42.099073 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 19:41:42.099073 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 19:41:42.099073 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 19:41:42.099073 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 19:41:42.099073 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 19:41:42.099073 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 19:41:42.099073 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 19:41:42.099073 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 13 19:41:42.099073 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 13 19:41:42.099073 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 13 19:41:42.099073 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 13 19:41:42.100068 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 13 19:41:42.100068 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 13 19:41:42.100068 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 13 19:41:42.100068 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 13 19:41:42.100068 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 19:41:42.100068 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 19:41:42.100068 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 19:41:42.100068 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 19:41:42.100068 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 19:41:42.100068 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 19:41:42.100068 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 19:41:42.100068 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application with Lock( Sep 13 19:41:42.100068 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 19:41:42.100068 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application return self._enter() Sep 13 19:41:42.100068 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 19:41:42.100068 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 19:41:42.100973 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 19:41:42.100973 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application return self.creator() Sep 13 19:41:42.100973 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 19:41:42.100973 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application created_value = creator( Sep 13 19:41:42.100973 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 13 19:41:42.100973 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 13 19:41:42.100973 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 13 19:41:42.100973 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 13 19:41:42.100973 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 13 19:41:42.100973 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 13 19:41:42.100973 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 13 19:41:42.100973 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application Sep 13 19:41:42.100973 dv-cinder-828806-6-smb devstack@keystone.service[82026]: [pid: 82026|app: 0|req: 221/446] 10.222.0.33 () {56 vars in 1114 bytes} [Tue Sep 13 19:41:41 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 13 19:41:42.106364 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-545b546d-f0c5-40bf-8fb7-73a21d932c71 None admin] Authenticating user token {{(pid=82026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:41:42.164423 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe71bb2a-e1c7-42d9-b213-fa2f6d8e996c None admin] Validating token access rules against request {{(pid=82025) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:41:42.203539 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-747d636e-1164-467a-8cf2-47f6978bc1a6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57539b6a6f3b4d589f5f5e1d211cd6a0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82025) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:41:42.204148 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-747d636e-1164-467a-8cf2-47f6978bc1a6 None admin] REQUEST_METHOD: `GET` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:41:42.204427 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-747d636e-1164-467a-8cf2-47f6978bc1a6 None admin] SCRIPT_NAME: `/identity` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:41:42.204700 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-747d636e-1164-467a-8cf2-47f6978bc1a6 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:41:42.235027 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-545b546d-f0c5-40bf-8fb7-73a21d932c71 None admin] Validating token access rules against request {{(pid=82026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:41:42.266103 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG dbcounter [-] [82025] Writing DB stats keystone:SELECT=100 {{(pid=82025) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:41:42.278937 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f02e9680-35c9-4805-b3d8-0bafbf8f2ed4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57539b6a6f3b4d589f5f5e1d211cd6a0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:41:42.279588 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f02e9680-35c9-4805-b3d8-0bafbf8f2ed4 None admin] REQUEST_METHOD: `GET` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:41:42.279876 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f02e9680-35c9-4805-b3d8-0bafbf8f2ed4 None admin] SCRIPT_NAME: `/identity` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:41:42.280640 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f02e9680-35c9-4805-b3d8-0bafbf8f2ed4 None admin] PATH_INFO: `/v3/roles` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:41:42.283652 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f02e9680-35c9-4805-b3d8-0bafbf8f2ed4 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=82026) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 19:41:42.283652 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f02e9680-35c9-4805-b3d8-0bafbf8f2ed4 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:41:42.283652 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f02e9680-35c9-4805-b3d8-0bafbf8f2ed4 None admin] RBAC: Authorization granted {{(pid=82026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:41:42.290002 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-747d636e-1164-467a-8cf2-47f6978bc1a6 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=82025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:41:42.291995 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-747d636e-1164-467a-8cf2-47f6978bc1a6 None admin] RBAC: Authorization granted {{(pid=82025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:41:42.296794 dv-cinder-828806-6-smb devstack@keystone.service[82026]: [pid: 82026|app: 0|req: 222/447] 10.222.0.33 () {56 vars in 1111 bytes} [Tue Sep 13 19:41:42 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 19:41:42.302333 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f02e9680-35c9-4805-b3d8-0bafbf8f2ed4 None admin] Authenticating user token {{(pid=82026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:41:42.334908 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG dbcounter [-] [82026] Writing DB stats keystone:SELECT=100 {{(pid=82026) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:41:42.401662 dv-cinder-828806-6-smb devstack@keystone.service[82025]: [pid: 82025|app: 0|req: 226/448] 10.222.0.33 () {58 vars in 1282 bytes} [Tue Sep 13 19:41:42 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 365 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 13 19:41:42.408179 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-747d636e-1164-467a-8cf2-47f6978bc1a6 None admin] Authenticating user token {{(pid=82025) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:41:42.409622 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f02e9680-35c9-4805-b3d8-0bafbf8f2ed4 None admin] Validating token access rules against request {{(pid=82026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:41:42.443708 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1aabcf9b-1209-4b34-a355-8be320bcb24a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57539b6a6f3b4d589f5f5e1d211cd6a0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:41:42.444306 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aabcf9b-1209-4b34-a355-8be320bcb24a None admin] REQUEST_METHOD: `GET` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:41:42.444600 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aabcf9b-1209-4b34-a355-8be320bcb24a None admin] SCRIPT_NAME: `/identity` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:41:42.444858 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aabcf9b-1209-4b34-a355-8be320bcb24a None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:41:42.490920 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG dbcounter [-] [82025] Writing DB stats keystone:SELECT=100 {{(pid=82025) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:41:42.509674 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-747d636e-1164-467a-8cf2-47f6978bc1a6 None admin] Validating token access rules against request {{(pid=82025) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:41:42.512201 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1aabcf9b-1209-4b34-a355-8be320bcb24a None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=82026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:41:42.513859 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1aabcf9b-1209-4b34-a355-8be320bcb24a None admin] RBAC: Authorization granted {{(pid=82026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:41:42.540664 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG dbcounter [-] [82026] Writing DB stats keystone:SELECT=100 {{(pid=82026) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:41:42.544943 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7d05c1d-54a7-4c83-bf8c-fb19b9d364c0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57539b6a6f3b4d589f5f5e1d211cd6a0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82025) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:41:42.545586 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7d05c1d-54a7-4c83-bf8c-fb19b9d364c0 None admin] REQUEST_METHOD: `GET` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:41:42.545915 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7d05c1d-54a7-4c83-bf8c-fb19b9d364c0 None admin] SCRIPT_NAME: `/identity` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:41:42.546191 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7d05c1d-54a7-4c83-bf8c-fb19b9d364c0 None admin] PATH_INFO: `/v3/projects/b454f707d20347ada3d82aa85495635e` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:41:42.547333 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7d05c1d-54a7-4c83-bf8c-fb19b9d364c0 None admin] RBAC: Authorizing `identity:get_project(project_id=b454f707d20347ada3d82aa85495635e)` {{(pid=82025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:41:42.548789 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7d05c1d-54a7-4c83-bf8c-fb19b9d364c0 None admin] RBAC: Authorization granted {{(pid=82025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:41:42.550391 dv-cinder-828806-6-smb devstack@keystone.service[82025]: [pid: 82025|app: 0|req: 227/449] 10.222.0.33 () {56 vars in 1186 bytes} [Tue Sep 13 19:41:42 2022] GET /identity/v3/projects/b454f707d20347ada3d82aa85495635e => generated 344 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 13 19:41:42.555788 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7d05c1d-54a7-4c83-bf8c-fb19b9d364c0 None admin] Authenticating user token {{(pid=82025) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:41:42.611850 dv-cinder-828806-6-smb devstack@keystone.service[82026]: [pid: 82026|app: 0|req: 223/450] 10.222.0.33 () {58 vars in 1282 bytes} [Tue Sep 13 19:41:42 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 310 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Sep 13 19:41:42.617365 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1aabcf9b-1209-4b34-a355-8be320bcb24a None admin] Authenticating user token {{(pid=82026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:41:42.658385 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7d05c1d-54a7-4c83-bf8c-fb19b9d364c0 None admin] Validating token access rules against request {{(pid=82025) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:41:42.692029 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f81553e8-3f68-4c75-a12f-b25e60ffe4a9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57539b6a6f3b4d589f5f5e1d211cd6a0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82025) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:41:42.692692 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f81553e8-3f68-4c75-a12f-b25e60ffe4a9 None admin] REQUEST_METHOD: `GET` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:41:42.692984 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f81553e8-3f68-4c75-a12f-b25e60ffe4a9 None admin] SCRIPT_NAME: `/identity` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:41:42.693259 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f81553e8-3f68-4c75-a12f-b25e60ffe4a9 None admin] PATH_INFO: `/v3/groups/f9af76a4bd6148d7945469c0549779ae` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:41:42.694567 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f81553e8-3f68-4c75-a12f-b25e60ffe4a9 None admin] RBAC: Authorizing `identity:get_group(group_id=f9af76a4bd6148d7945469c0549779ae)` {{(pid=82025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:41:42.696400 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f81553e8-3f68-4c75-a12f-b25e60ffe4a9 None admin] RBAC: Authorization granted {{(pid=82025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:41:42.697959 dv-cinder-828806-6-smb devstack@keystone.service[82025]: [pid: 82025|app: 0|req: 228/451] 10.222.0.33 () {56 vars in 1180 bytes} [Tue Sep 13 19:41:42 2022] GET /identity/v3/groups/f9af76a4bd6148d7945469c0549779ae => generated 229 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 13 19:41:42.703760 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f81553e8-3f68-4c75-a12f-b25e60ffe4a9 None admin] Authenticating user token {{(pid=82025) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:41:42.712636 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1aabcf9b-1209-4b34-a355-8be320bcb24a None admin] Validating token access rules against request {{(pid=82026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:41:42.721976 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG dbcounter [-] [82025] Writing DB stats keystone:SELECT=100 {{(pid=82025) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:41:42.740479 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG dbcounter [-] [82026] Writing DB stats keystone:SELECT=100 {{(pid=82026) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:41:42.755730 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75cf9103-5c98-4ffe-9570-1c8eb532f541 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57539b6a6f3b4d589f5f5e1d211cd6a0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:41:42.756293 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75cf9103-5c98-4ffe-9570-1c8eb532f541 None admin] REQUEST_METHOD: `GET` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:41:42.756575 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75cf9103-5c98-4ffe-9570-1c8eb532f541 None admin] SCRIPT_NAME: `/identity` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:41:42.756848 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75cf9103-5c98-4ffe-9570-1c8eb532f541 None admin] PATH_INFO: `/v3/projects/bee3101ec8f84efa9f84a402c3c3cbbe` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:41:42.757993 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75cf9103-5c98-4ffe-9570-1c8eb532f541 None admin] RBAC: Authorizing `identity:get_project(project_id=bee3101ec8f84efa9f84a402c3c3cbbe)` {{(pid=82026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:41:42.759544 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75cf9103-5c98-4ffe-9570-1c8eb532f541 None admin] RBAC: Authorization granted {{(pid=82026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:41:42.761159 dv-cinder-828806-6-smb devstack@keystone.service[82026]: [pid: 82026|app: 0|req: 224/452] 10.222.0.33 () {56 vars in 1186 bytes} [Tue Sep 13 19:41:42 2022] GET /identity/v3/projects/bee3101ec8f84efa9f84a402c3c3cbbe => generated 302 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 13 19:41:42.767670 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75cf9103-5c98-4ffe-9570-1c8eb532f541 None admin] Authenticating user token {{(pid=82026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:41:42.817223 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f81553e8-3f68-4c75-a12f-b25e60ffe4a9 None admin] Validating token access rules against request {{(pid=82025) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:41:42.852395 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f59f874-d18f-406e-9856-45bdea690afb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57539b6a6f3b4d589f5f5e1d211cd6a0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82025) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:41:42.852997 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f59f874-d18f-406e-9856-45bdea690afb None admin] REQUEST_METHOD: `GET` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:41:42.853282 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f59f874-d18f-406e-9856-45bdea690afb None admin] SCRIPT_NAME: `/identity` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:41:42.853561 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f59f874-d18f-406e-9856-45bdea690afb None admin] PATH_INFO: `/v3/role_assignments` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:41:42.854292 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f59f874-d18f-406e-9856-45bdea690afb None admin] RBAC: Adding query filter params (group.id=f9af76a4bd6148d7945469c0549779ae, role.id=e5af7d5baa93469e9e486ef21c85474e, scope.project.id=b454f707d20347ada3d82aa85495635e) {{(pid=82025) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 19:41:42.854608 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f59f874-d18f-406e-9856-45bdea690afb None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=82025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:41:42.856113 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f59f874-d18f-406e-9856-45bdea690afb None admin] RBAC: Authorization granted {{(pid=82025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:41:42.862512 dv-cinder-828806-6-smb devstack@keystone.service[82025]: [pid: 82025|app: 0|req: 229/453] 10.222.0.33 () {56 vars in 1376 bytes} [Tue Sep 13 19:41:42 2022] GET /identity/v3/role_assignments?group.id=f9af76a4bd6148d7945469c0549779ae&scope.project.id=b454f707d20347ada3d82aa85495635e&role.id=e5af7d5baa93469e9e486ef21c85474e => generated 611 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 13 19:41:42.867572 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75cf9103-5c98-4ffe-9570-1c8eb532f541 None admin] Validating token access rules against request {{(pid=82026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:41:42.904296 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52dc46a4-5ce0-48a7-94d3-73c982a81731 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57539b6a6f3b4d589f5f5e1d211cd6a0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:41:42.904936 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52dc46a4-5ce0-48a7-94d3-73c982a81731 None admin] REQUEST_METHOD: `GET` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:41:42.905508 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52dc46a4-5ce0-48a7-94d3-73c982a81731 None admin] SCRIPT_NAME: `/identity` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:41:42.905782 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52dc46a4-5ce0-48a7-94d3-73c982a81731 None admin] PATH_INFO: `/v3/groups/df4ab391f1e040fd93d08113e416b125` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:41:42.906942 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52dc46a4-5ce0-48a7-94d3-73c982a81731 None admin] RBAC: Authorizing `identity:get_group(group_id=df4ab391f1e040fd93d08113e416b125)` {{(pid=82026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:41:42.908427 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52dc46a4-5ce0-48a7-94d3-73c982a81731 None admin] RBAC: Authorization granted {{(pid=82026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:41:42.910021 dv-cinder-828806-6-smb devstack@keystone.service[82026]: [pid: 82026|app: 0|req: 225/454] 10.222.0.33 () {56 vars in 1180 bytes} [Tue Sep 13 19:41:42 2022] GET /identity/v3/groups/df4ab391f1e040fd93d08113e416b125 => generated 226 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 13 19:41:42.915935 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f59f874-d18f-406e-9856-45bdea690afb None admin] Authenticating user token {{(pid=82025) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:41:43.002995 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG dbcounter [-] [82025] Writing DB stats keystone:SELECT=100 {{(pid=82025) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:41:43.021962 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f59f874-d18f-406e-9856-45bdea690afb None admin] Validating token access rules against request {{(pid=82025) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:41:43.057322 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8725cec8-9604-4218-94c8-eaec972e6aee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57539b6a6f3b4d589f5f5e1d211cd6a0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82025) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:41:43.057925 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8725cec8-9604-4218-94c8-eaec972e6aee None admin] REQUEST_METHOD: `GET` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:41:43.058207 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8725cec8-9604-4218-94c8-eaec972e6aee None admin] SCRIPT_NAME: `/identity` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:41:43.058484 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8725cec8-9604-4218-94c8-eaec972e6aee None admin] PATH_INFO: `/v3/role_assignments` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:41:43.059512 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8725cec8-9604-4218-94c8-eaec972e6aee None admin] RBAC: Adding query filter params (group.id=df4ab391f1e040fd93d08113e416b125, role.id=6bcd095c76b341e186ea8caa11f5fa31, scope.project.id=bee3101ec8f84efa9f84a402c3c3cbbe) {{(pid=82025) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 19:41:43.059835 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8725cec8-9604-4218-94c8-eaec972e6aee None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=82025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:41:43.061868 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8725cec8-9604-4218-94c8-eaec972e6aee None admin] RBAC: Authorization granted {{(pid=82025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:41:43.067767 dv-cinder-828806-6-smb devstack@keystone.service[82025]: [pid: 82025|app: 0|req: 230/455] 10.222.0.33 () {56 vars in 1376 bytes} [Tue Sep 13 19:41:42 2022] GET /identity/v3/role_assignments?group.id=df4ab391f1e040fd93d08113e416b125&scope.project.id=bee3101ec8f84efa9f84a402c3c3cbbe&role.id=6bcd095c76b341e186ea8caa11f5fa31 => generated 611 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 13 19:41:45.748723 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e895e7e-cc9f-4981-91a2-e0ba6cf4ee22 None None] REQUEST_METHOD: `GET` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:41:45.749964 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e895e7e-cc9f-4981-91a2-e0ba6cf4ee22 None None] SCRIPT_NAME: `/identity` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:41:45.749964 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e895e7e-cc9f-4981-91a2-e0ba6cf4ee22 None None] PATH_INFO: `/` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:41:45.751440 dv-cinder-828806-6-smb devstack@keystone.service[82026]: [pid: 82026|app: 0|req: 226/456] 10.222.0.33 () {54 vars in 927 bytes} [Tue Sep 13 19:41:45 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 19:41:45.769110 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f3ffd89-3c6c-48a1-bb11-20ccb6dc1a33 None None] REQUEST_METHOD: `POST` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:41:45.770057 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f3ffd89-3c6c-48a1-bb11-20ccb6dc1a33 None None] SCRIPT_NAME: `/identity` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:41:45.770535 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f3ffd89-3c6c-48a1-bb11-20ccb6dc1a33 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:41:45.797243 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.auth.core [None req-4f3ffd89-3c6c-48a1-bb11-20ccb6dc1a33 None None] MFA Rules not processed for user `57539b6a6f3b4d589f5f5e1d211cd6a0`. Rule list: `[]` (Enabled: `True`). {{(pid=82025) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 19:41:45.798826 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.fernet_utils [None req-4f3ffd89-3c6c-48a1-bb11-20ccb6dc1a33 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82025) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 19:41:45.901187 dv-cinder-828806-6-smb devstack@keystone.service[82025]: [pid: 82025|app: 0|req: 231/457] 10.222.0.33 () {58 vars in 1024 bytes} [Tue Sep 13 19:41:45 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 133 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 13 19:41:46.156087 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54d389d2-ccec-4a63-889b-185109462546 None None] REQUEST_METHOD: `GET` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:41:46.156774 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54d389d2-ccec-4a63-889b-185109462546 None None] SCRIPT_NAME: `/identity` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:41:46.157259 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54d389d2-ccec-4a63-889b-185109462546 None None] PATH_INFO: `/` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:41:46.159167 dv-cinder-828806-6-smb devstack@keystone.service[82026]: [pid: 82026|app: 0|req: 227/458] 10.222.0.33 () {54 vars in 927 bytes} [Tue Sep 13 19:41:46 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 19:41:46.164167 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97d90c5d-3f4b-404e-8fa0-aeddf0ce08e2 None None] REQUEST_METHOD: `POST` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:41:46.164732 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97d90c5d-3f4b-404e-8fa0-aeddf0ce08e2 None None] SCRIPT_NAME: `/identity` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:41:46.165209 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97d90c5d-3f4b-404e-8fa0-aeddf0ce08e2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:41:46.170542 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc5553f8-ab4c-4830-adbf-9dee58fb6163 None None] REQUEST_METHOD: `GET` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:41:46.171431 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc5553f8-ab4c-4830-adbf-9dee58fb6163 None None] SCRIPT_NAME: `/identity` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:41:46.171865 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc5553f8-ab4c-4830-adbf-9dee58fb6163 None None] PATH_INFO: `/` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:41:46.177120 dv-cinder-828806-6-smb devstack@keystone.service[82026]: [pid: 82026|app: 0|req: 228/459] 10.222.0.33 () {54 vars in 927 bytes} [Tue Sep 13 19:41:46 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 19:41:46.178502 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31568b47-80c6-48e6-acb7-ad26b60ea34a None None] REQUEST_METHOD: `POST` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:41:46.178796 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31568b47-80c6-48e6-acb7-ad26b60ea34a None None] SCRIPT_NAME: `/identity` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:41:46.179122 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31568b47-80c6-48e6-acb7-ad26b60ea34a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:41:46.196026 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.auth.core [None req-97d90c5d-3f4b-404e-8fa0-aeddf0ce08e2 None None] MFA Rules not processed for user `57539b6a6f3b4d589f5f5e1d211cd6a0`. Rule list: `[]` (Enabled: `True`). {{(pid=82025) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 19:41:46.197545 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.fernet_utils [None req-97d90c5d-3f4b-404e-8fa0-aeddf0ce08e2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82025) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 19:41:46.206469 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.auth.core [None req-31568b47-80c6-48e6-acb7-ad26b60ea34a None None] MFA Rules not processed for user `57539b6a6f3b4d589f5f5e1d211cd6a0`. Rule list: `[]` (Enabled: `True`). {{(pid=82026) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 19:41:46.207973 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.common.fernet_utils [None req-31568b47-80c6-48e6-acb7-ad26b60ea34a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82026) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 19:41:46.305567 dv-cinder-828806-6-smb devstack@keystone.service[82025]: [pid: 82025|app: 0|req: 232/460] 10.222.0.33 () {58 vars in 1024 bytes} [Tue Sep 13 19:41:46 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 142 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 13 19:41:46.312210 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97d90c5d-3f4b-404e-8fa0-aeddf0ce08e2 None None] Authenticating user token {{(pid=82025) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:41:46.320690 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG dbcounter [-] [82026] Writing DB stats keystone:SELECT=100 {{(pid=82026) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:41:46.323898 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG dbcounter [-] [82025] Writing DB stats keystone:SELECT=100 {{(pid=82025) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:41:46.330310 dv-cinder-828806-6-smb devstack@keystone.service[82026]: [pid: 82026|app: 0|req: 229/461] 10.222.0.33 () {58 vars in 1024 bytes} [Tue Sep 13 19:41:46 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 152 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 13 19:41:46.474842 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97d90c5d-3f4b-404e-8fa0-aeddf0ce08e2 None None] Validating token access rules against request {{(pid=82025) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:41:46.522118 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e147a21-f8de-43c1-8333-abd886ceb6b2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57539b6a6f3b4d589f5f5e1d211cd6a0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82025) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:41:46.522757 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e147a21-f8de-43c1-8333-abd886ceb6b2 None admin] REQUEST_METHOD: `GET` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:41:46.523063 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e147a21-f8de-43c1-8333-abd886ceb6b2 None admin] SCRIPT_NAME: `/identity` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:41:46.523345 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e147a21-f8de-43c1-8333-abd886ceb6b2 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:41:46.539539 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e147a21-f8de-43c1-8333-abd886ceb6b2 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=82025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:41:46.540984 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e147a21-f8de-43c1-8333-abd886ceb6b2 None admin] RBAC: Authorization granted {{(pid=82025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:41:46.561075 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application [None req-8e147a21-f8de-43c1-8333-abd886ceb6b2 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 13 19:41:46.561075 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 19:41:46.561075 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 19:41:46.561075 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 19:41:46.561075 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 19:41:46.561075 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 19:41:46.561075 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 19:41:46.561075 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 19:41:46.561075 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 19:41:46.561075 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 19:41:46.561075 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 19:41:46.561075 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 19:41:46.561075 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 13 19:41:46.561075 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 13 19:41:46.561075 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 13 19:41:46.561075 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 13 19:41:46.562682 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 19:41:46.562682 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 19:41:46.562682 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 19:41:46.562682 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 19:41:46.562682 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 19:41:46.562682 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 19:41:46.562682 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 19:41:46.562682 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application with Lock( Sep 13 19:41:46.562682 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 19:41:46.562682 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application return self._enter() Sep 13 19:41:46.562682 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 19:41:46.562682 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 19:41:46.562682 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 19:41:46.562682 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application return self.creator() Sep 13 19:41:46.562682 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 19:41:46.562682 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application created_value = creator( Sep 13 19:41:46.562682 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 13 19:41:46.563558 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 13 19:41:46.563558 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 13 19:41:46.563558 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application Sep 13 19:41:46.565282 dv-cinder-828806-6-smb devstack@keystone.service[82025]: [pid: 82025|app: 0|req: 233/462] 10.222.0.33 () {56 vars in 1108 bytes} [Tue Sep 13 19:41:46 2022] GET /identity/v3/domains/Default => generated 87 bytes in 254 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 19:41:46.571447 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31568b47-80c6-48e6-acb7-ad26b60ea34a None None] Authenticating user token {{(pid=82026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:41:46.618886 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e147a21-f8de-43c1-8333-abd886ceb6b2 None admin] Authenticating user token {{(pid=82025) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:41:46.720796 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG dbcounter [-] [82025] Writing DB stats keystone:SELECT=100 {{(pid=82025) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:41:46.736385 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31568b47-80c6-48e6-acb7-ad26b60ea34a None None] Validating token access rules against request {{(pid=82026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:41:46.772566 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e147a21-f8de-43c1-8333-abd886ceb6b2 None admin] Validating token access rules against request {{(pid=82025) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:41:46.774762 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7243cb67-562c-4c23-8506-bd5e06645cca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57539b6a6f3b4d589f5f5e1d211cd6a0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:41:46.775974 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7243cb67-562c-4c23-8506-bd5e06645cca None admin] REQUEST_METHOD: `GET` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:41:46.776515 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7243cb67-562c-4c23-8506-bd5e06645cca None admin] SCRIPT_NAME: `/identity` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:41:46.777007 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7243cb67-562c-4c23-8506-bd5e06645cca None admin] PATH_INFO: `/v3/domains` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:41:46.777969 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7243cb67-562c-4c23-8506-bd5e06645cca None admin] RBAC: Adding query filter params (name=Default) {{(pid=82026) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 19:41:46.778525 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7243cb67-562c-4c23-8506-bd5e06645cca None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:41:46.780613 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7243cb67-562c-4c23-8506-bd5e06645cca None admin] RBAC: Authorization granted {{(pid=82026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:41:46.799405 dv-cinder-828806-6-smb devstack@keystone.service[82026]: [pid: 82026|app: 0|req: 230/463] 10.222.0.33 () {56 vars in 1109 bytes} [Tue Sep 13 19:41:46 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 223 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 19:41:46.801755 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7243cb67-562c-4c23-8506-bd5e06645cca None admin] Authenticating user token {{(pid=82026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:41:46.818575 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66159e75-14fe-4dd1-a1bc-7ee68dcdc125 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57539b6a6f3b4d589f5f5e1d211cd6a0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82025) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:41:46.819258 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66159e75-14fe-4dd1-a1bc-7ee68dcdc125 None admin] REQUEST_METHOD: `GET` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:41:46.819545 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66159e75-14fe-4dd1-a1bc-7ee68dcdc125 None admin] SCRIPT_NAME: `/identity` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:41:46.819830 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66159e75-14fe-4dd1-a1bc-7ee68dcdc125 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:41:46.834558 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66159e75-14fe-4dd1-a1bc-7ee68dcdc125 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=82025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:41:46.836873 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66159e75-14fe-4dd1-a1bc-7ee68dcdc125 None admin] RBAC: Authorization granted {{(pid=82025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:41:46.857132 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application [None req-66159e75-14fe-4dd1-a1bc-7ee68dcdc125 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 13 19:41:46.857132 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 19:41:46.857132 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 19:41:46.857132 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 19:41:46.857132 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 19:41:46.857132 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 19:41:46.857132 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 19:41:46.857132 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 19:41:46.857132 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 19:41:46.857132 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 19:41:46.857132 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 19:41:46.857132 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 19:41:46.857132 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 13 19:41:46.857132 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 13 19:41:46.857132 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 13 19:41:46.857132 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 13 19:41:46.858076 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 19:41:46.858076 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 19:41:46.858076 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 19:41:46.858076 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 19:41:46.858076 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 19:41:46.858076 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 19:41:46.858076 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 19:41:46.858076 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application with Lock( Sep 13 19:41:46.858076 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 19:41:46.858076 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application return self._enter() Sep 13 19:41:46.858076 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 19:41:46.858076 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 19:41:46.858076 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 19:41:46.858076 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application return self.creator() Sep 13 19:41:46.858076 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 19:41:46.858076 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application created_value = creator( Sep 13 19:41:46.858076 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 13 19:41:46.859500 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 13 19:41:46.859500 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 13 19:41:46.859500 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application Sep 13 19:41:46.863169 dv-cinder-828806-6-smb devstack@keystone.service[82025]: [pid: 82025|app: 0|req: 234/464] 10.222.0.33 () {56 vars in 1108 bytes} [Tue Sep 13 19:41:46 2022] GET /identity/v3/domains/Default => generated 87 bytes in 240 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 19:41:46.864196 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66159e75-14fe-4dd1-a1bc-7ee68dcdc125 None admin] Authenticating user token {{(pid=82025) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:41:46.871314 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG dbcounter [-] [82026] Writing DB stats keystone:SELECT=100 {{(pid=82026) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:41:46.920184 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7243cb67-562c-4c23-8506-bd5e06645cca None admin] Validating token access rules against request {{(pid=82026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:41:46.956966 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d253564-9378-4687-8e11-5d1d71beea64 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57539b6a6f3b4d589f5f5e1d211cd6a0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:41:46.957602 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d253564-9378-4687-8e11-5d1d71beea64 None admin] REQUEST_METHOD: `GET` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:41:46.957885 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d253564-9378-4687-8e11-5d1d71beea64 None admin] SCRIPT_NAME: `/identity` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:41:46.958159 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d253564-9378-4687-8e11-5d1d71beea64 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:41:46.970935 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d253564-9378-4687-8e11-5d1d71beea64 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=82026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:41:46.972551 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d253564-9378-4687-8e11-5d1d71beea64 None admin] RBAC: Authorization granted {{(pid=82026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:41:46.981578 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66159e75-14fe-4dd1-a1bc-7ee68dcdc125 None admin] Validating token access rules against request {{(pid=82025) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:41:46.987904 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application [None req-3d253564-9378-4687-8e11-5d1d71beea64 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 13 19:41:46.987904 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 19:41:46.987904 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 19:41:46.987904 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 19:41:46.987904 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 19:41:46.987904 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 19:41:46.987904 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 19:41:46.987904 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 19:41:46.987904 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 19:41:46.987904 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 19:41:46.987904 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 19:41:46.987904 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 19:41:46.987904 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 13 19:41:46.987904 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 13 19:41:46.987904 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 13 19:41:46.987904 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 13 19:41:46.988790 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 19:41:46.988790 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 19:41:46.988790 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 19:41:46.988790 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 19:41:46.988790 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 19:41:46.988790 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 19:41:46.988790 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 19:41:46.988790 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application with Lock( Sep 13 19:41:46.988790 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 19:41:46.988790 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application return self._enter() Sep 13 19:41:46.988790 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 19:41:46.988790 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 19:41:46.988790 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 19:41:46.988790 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application return self.creator() Sep 13 19:41:46.988790 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 19:41:46.988790 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application created_value = creator( Sep 13 19:41:46.988790 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 13 19:41:46.989639 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 13 19:41:46.989639 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 13 19:41:46.989639 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application Sep 13 19:41:46.989639 dv-cinder-828806-6-smb devstack@keystone.service[82026]: [pid: 82026|app: 0|req: 231/465] 10.222.0.33 () {56 vars in 1108 bytes} [Tue Sep 13 19:41:46 2022] GET /identity/v3/domains/Default => generated 87 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 19:41:46.989860 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d253564-9378-4687-8e11-5d1d71beea64 None admin] Authenticating user token {{(pid=82026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:41:46.996372 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG dbcounter [-] [82025] Writing DB stats keystone:SELECT=100 {{(pid=82025) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:41:47.024492 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44454a10-8c66-4e91-93d3-c3b8f1ba79f0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57539b6a6f3b4d589f5f5e1d211cd6a0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82025) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:41:47.025104 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44454a10-8c66-4e91-93d3-c3b8f1ba79f0 None admin] REQUEST_METHOD: `POST` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:41:47.025390 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44454a10-8c66-4e91-93d3-c3b8f1ba79f0 None admin] SCRIPT_NAME: `/identity` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:41:47.025668 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44454a10-8c66-4e91-93d3-c3b8f1ba79f0 None admin] PATH_INFO: `/v3/users` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:41:47.026317 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44454a10-8c66-4e91-93d3-c3b8f1ba79f0 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=82025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:41:47.027792 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44454a10-8c66-4e91-93d3-c3b8f1ba79f0 None admin] RBAC: Authorization granted {{(pid=82025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:41:47.093206 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d253564-9378-4687-8e11-5d1d71beea64 None admin] Validating token access rules against request {{(pid=82026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:41:47.100068 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG dbcounter [-] [82026] Writing DB stats keystone:SELECT=100 {{(pid=82026) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:41:47.127731 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f871980-0e3f-40e3-897d-30531b748ed3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57539b6a6f3b4d589f5f5e1d211cd6a0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:41:47.128627 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f871980-0e3f-40e3-897d-30531b748ed3 None admin] REQUEST_METHOD: `GET` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:41:47.128907 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f871980-0e3f-40e3-897d-30531b748ed3 None admin] SCRIPT_NAME: `/identity` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:41:47.129339 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f871980-0e3f-40e3-897d-30531b748ed3 None admin] PATH_INFO: `/v3/domains` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:41:47.129991 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f871980-0e3f-40e3-897d-30531b748ed3 None admin] RBAC: Adding query filter params (name=Default) {{(pid=82026) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 19:41:47.130295 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f871980-0e3f-40e3-897d-30531b748ed3 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:41:47.131709 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f871980-0e3f-40e3-897d-30531b748ed3 None admin] RBAC: Authorization granted {{(pid=82026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:41:47.137306 dv-cinder-828806-6-smb devstack@keystone.service[82025]: [pid: 82025|app: 0|req: 235/466] 10.222.0.33 () {60 vars in 1132 bytes} [Tue Sep 13 19:41:46 2022] POST /identity/v3/users => generated 246 bytes in 269 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 13 19:41:47.137306 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f92f036b-b002-4a8e-8b70-6b6e976a96bf None None] REQUEST_METHOD: `GET` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:41:47.137306 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f92f036b-b002-4a8e-8b70-6b6e976a96bf None None] SCRIPT_NAME: `/identity` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:41:47.137306 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f92f036b-b002-4a8e-8b70-6b6e976a96bf None None] PATH_INFO: `/` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:41:47.137306 dv-cinder-828806-6-smb devstack@keystone.service[82025]: [pid: 82025|app: 0|req: 236/467] 10.222.0.33 () {54 vars in 927 bytes} [Tue Sep 13 19:41:47 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 19:41:47.137306 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f92f036b-b002-4a8e-8b70-6b6e976a96bf None None] Authenticating user token {{(pid=82025) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:41:47.158727 dv-cinder-828806-6-smb devstack@keystone.service[82026]: [pid: 82026|app: 0|req: 232/468] 10.222.0.33 () {56 vars in 1109 bytes} [Tue Sep 13 19:41:46 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 19:41:47.160061 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ae60e02-9dfd-46e1-a8f3-adba2561504b None None] REQUEST_METHOD: `POST` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:41:47.160357 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ae60e02-9dfd-46e1-a8f3-adba2561504b None None] SCRIPT_NAME: `/identity` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:41:47.160700 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ae60e02-9dfd-46e1-a8f3-adba2561504b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:41:47.183004 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.auth.core [None req-3ae60e02-9dfd-46e1-a8f3-adba2561504b None None] MFA Rules not processed for user `57539b6a6f3b4d589f5f5e1d211cd6a0`. Rule list: `[]` (Enabled: `True`). {{(pid=82026) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 19:41:47.184568 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.common.fernet_utils [None req-3ae60e02-9dfd-46e1-a8f3-adba2561504b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82026) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 19:41:47.271614 dv-cinder-828806-6-smb devstack@keystone.service[82026]: [pid: 82026|app: 0|req: 233/469] 10.222.0.33 () {58 vars in 1024 bytes} [Tue Sep 13 19:41:47 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 13 19:41:47.272627 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ae60e02-9dfd-46e1-a8f3-adba2561504b None None] Authenticating user token {{(pid=82026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:41:47.282794 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f92f036b-b002-4a8e-8b70-6b6e976a96bf None None] Validating token access rules against request {{(pid=82025) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:41:47.328253 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-490d3e74-4be0-4d8c-98ce-8350cacaeb44 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57539b6a6f3b4d589f5f5e1d211cd6a0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82025) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:41:47.328880 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-490d3e74-4be0-4d8c-98ce-8350cacaeb44 None admin] REQUEST_METHOD: `GET` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:41:47.329166 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-490d3e74-4be0-4d8c-98ce-8350cacaeb44 None admin] SCRIPT_NAME: `/identity` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:41:47.329444 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-490d3e74-4be0-4d8c-98ce-8350cacaeb44 None admin] PATH_INFO: `/v3/domains` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:41:47.330109 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-490d3e74-4be0-4d8c-98ce-8350cacaeb44 None admin] RBAC: Adding query filter params (name=Default) {{(pid=82025) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 19:41:47.330427 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-490d3e74-4be0-4d8c-98ce-8350cacaeb44 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:41:47.331851 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-490d3e74-4be0-4d8c-98ce-8350cacaeb44 None admin] RBAC: Authorization granted {{(pid=82025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:41:47.346402 dv-cinder-828806-6-smb devstack@keystone.service[82025]: [pid: 82025|app: 0|req: 237/470] 10.222.0.33 () {56 vars in 1109 bytes} [Tue Sep 13 19:41:47 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 19:41:47.347994 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-235b36ed-5e4b-4e83-82d1-f6e4c2166c0c None None] REQUEST_METHOD: `GET` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:41:47.349068 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-235b36ed-5e4b-4e83-82d1-f6e4c2166c0c None None] SCRIPT_NAME: `/identity` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:41:47.349068 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-235b36ed-5e4b-4e83-82d1-f6e4c2166c0c None None] PATH_INFO: `/` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:41:47.350157 dv-cinder-828806-6-smb devstack@keystone.service[82025]: [pid: 82025|app: 0|req: 238/471] 10.222.0.33 () {54 vars in 927 bytes} [Tue Sep 13 19:41:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 19:41:47.351640 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-235b36ed-5e4b-4e83-82d1-f6e4c2166c0c None None] Authenticating user token {{(pid=82025) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:41:47.382635 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG dbcounter [-] [82025] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=82025) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:41:47.413569 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG dbcounter [-] [82026] Writing DB stats keystone:SELECT=100 {{(pid=82026) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:41:47.423773 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ae60e02-9dfd-46e1-a8f3-adba2561504b None None] Validating token access rules against request {{(pid=82026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:41:47.466936 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-466fa73b-0375-4494-8c2b-f25219a3df12 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57539b6a6f3b4d589f5f5e1d211cd6a0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:41:47.468183 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-466fa73b-0375-4494-8c2b-f25219a3df12 None admin] REQUEST_METHOD: `POST` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:41:47.468183 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-466fa73b-0375-4494-8c2b-f25219a3df12 None admin] SCRIPT_NAME: `/identity` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:41:47.468183 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-466fa73b-0375-4494-8c2b-f25219a3df12 None admin] PATH_INFO: `/v3/users` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:41:47.468973 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-466fa73b-0375-4494-8c2b-f25219a3df12 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=82026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:41:47.470418 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-466fa73b-0375-4494-8c2b-f25219a3df12 None admin] RBAC: Authorization granted {{(pid=82026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:41:47.478496 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-235b36ed-5e4b-4e83-82d1-f6e4c2166c0c None None] Validating token access rules against request {{(pid=82025) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:41:47.516605 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97d5af77-3505-420e-8990-9abbf27814fa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57539b6a6f3b4d589f5f5e1d211cd6a0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82025) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:41:47.517299 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97d5af77-3505-420e-8990-9abbf27814fa None admin] REQUEST_METHOD: `POST` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:41:47.517656 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97d5af77-3505-420e-8990-9abbf27814fa None admin] SCRIPT_NAME: `/identity` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:41:47.518031 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97d5af77-3505-420e-8990-9abbf27814fa None admin] PATH_INFO: `/v3/users` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:41:47.518782 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97d5af77-3505-420e-8990-9abbf27814fa None admin] RBAC: Authorizing `identity:create_user()` {{(pid=82025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:41:47.520341 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97d5af77-3505-420e-8990-9abbf27814fa None admin] RBAC: Authorization granted {{(pid=82025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:41:47.542851 dv-cinder-828806-6-smb devstack@keystone.service[82026]: [pid: 82026|app: 0|req: 234/472] 10.222.0.33 () {60 vars in 1132 bytes} [Tue Sep 13 19:41:47 2022] POST /identity/v3/users => generated 248 bytes in 270 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 13 19:41:47.543914 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63a7bf5a-21d2-409c-8f35-d1b7256c8ac7 None None] REQUEST_METHOD: `POST` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:41:47.544341 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63a7bf5a-21d2-409c-8f35-d1b7256c8ac7 None None] SCRIPT_NAME: `/identity` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:41:47.544743 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63a7bf5a-21d2-409c-8f35-d1b7256c8ac7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:41:47.567646 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.auth.core [None req-63a7bf5a-21d2-409c-8f35-d1b7256c8ac7 None None] MFA Rules not processed for user `57539b6a6f3b4d589f5f5e1d211cd6a0`. Rule list: `[]` (Enabled: `True`). {{(pid=82026) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 19:41:47.574365 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.common.fernet_utils [None req-63a7bf5a-21d2-409c-8f35-d1b7256c8ac7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82026) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 19:41:47.644215 dv-cinder-828806-6-smb devstack@keystone.service[82025]: [pid: 82025|app: 0|req: 239/473] 10.222.0.33 () {60 vars in 1132 bytes} [Tue Sep 13 19:41:47 2022] POST /identity/v3/users => generated 248 bytes in 292 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 13 19:41:47.645451 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97d5af77-3505-420e-8990-9abbf27814fa None admin] Authenticating user token {{(pid=82025) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:41:47.673226 dv-cinder-828806-6-smb devstack@keystone.service[82026]: [pid: 82026|app: 0|req: 235/474] 10.222.0.33 () {58 vars in 1024 bytes} [Tue Sep 13 19:41:47 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 13 19:41:47.788730 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG dbcounter [-] [82025] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=82025) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:41:47.814210 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97d5af77-3505-420e-8990-9abbf27814fa None admin] Validating token access rules against request {{(pid=82025) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:41:47.851816 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9740d0c6-188b-42b7-a0da-626a39b4c3dd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57539b6a6f3b4d589f5f5e1d211cd6a0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82025) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:41:47.852453 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9740d0c6-188b-42b7-a0da-626a39b4c3dd None admin] REQUEST_METHOD: `GET` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:41:47.852736 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9740d0c6-188b-42b7-a0da-626a39b4c3dd None admin] SCRIPT_NAME: `/identity` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:41:47.853015 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9740d0c6-188b-42b7-a0da-626a39b4c3dd None admin] PATH_INFO: `/v3/domains/Default` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:41:47.864167 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9740d0c6-188b-42b7-a0da-626a39b4c3dd None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=82025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:41:47.865635 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9740d0c6-188b-42b7-a0da-626a39b4c3dd None admin] RBAC: Authorization granted {{(pid=82025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:41:47.880990 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application [None req-9740d0c6-188b-42b7-a0da-626a39b4c3dd None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 13 19:41:47.880990 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 19:41:47.880990 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 19:41:47.880990 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 19:41:47.880990 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 19:41:47.880990 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 19:41:47.880990 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 19:41:47.880990 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 19:41:47.880990 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 19:41:47.880990 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 19:41:47.880990 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 19:41:47.880990 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 19:41:47.880990 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 13 19:41:47.880990 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 13 19:41:47.880990 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 13 19:41:47.880990 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 13 19:41:47.888405 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 19:41:47.888405 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 19:41:47.888405 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 19:41:47.888405 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 19:41:47.888405 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 19:41:47.888405 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 19:41:47.888405 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 19:41:47.888405 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application with Lock( Sep 13 19:41:47.888405 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 19:41:47.888405 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application return self._enter() Sep 13 19:41:47.888405 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 19:41:47.888405 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 19:41:47.888405 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 19:41:47.888405 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application return self.creator() Sep 13 19:41:47.888405 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 19:41:47.888405 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application created_value = creator( Sep 13 19:41:47.888405 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 13 19:41:47.889242 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 13 19:41:47.889242 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 13 19:41:47.889242 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application Sep 13 19:41:47.889242 dv-cinder-828806-6-smb devstack@keystone.service[82025]: [pid: 82025|app: 0|req: 240/475] 10.222.0.33 () {56 vars in 1108 bytes} [Tue Sep 13 19:41:47 2022] GET /identity/v3/domains/Default => generated 87 bytes in 238 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 19:41:47.891592 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63a7bf5a-21d2-409c-8f35-d1b7256c8ac7 None None] Authenticating user token {{(pid=82026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:41:48.012635 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG dbcounter [-] [82026] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=82026) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:41:48.033329 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63a7bf5a-21d2-409c-8f35-d1b7256c8ac7 None None] Validating token access rules against request {{(pid=82026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:41:48.054887 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9740d0c6-188b-42b7-a0da-626a39b4c3dd None admin] Authenticating user token {{(pid=82025) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:41:48.087445 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31622d73-3812-4d62-851f-410abfee2137 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57539b6a6f3b4d589f5f5e1d211cd6a0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:41:48.087984 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31622d73-3812-4d62-851f-410abfee2137 None admin] REQUEST_METHOD: `GET` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:41:48.088260 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31622d73-3812-4d62-851f-410abfee2137 None admin] SCRIPT_NAME: `/identity` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:41:48.088530 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31622d73-3812-4d62-851f-410abfee2137 None admin] PATH_INFO: `/v3/domains` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:41:48.089183 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31622d73-3812-4d62-851f-410abfee2137 None admin] RBAC: Adding query filter params (name=Default) {{(pid=82026) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 19:41:48.089486 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31622d73-3812-4d62-851f-410abfee2137 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:41:48.090877 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31622d73-3812-4d62-851f-410abfee2137 None admin] RBAC: Authorization granted {{(pid=82026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:41:48.112971 dv-cinder-828806-6-smb devstack@keystone.service[82026]: [pid: 82026|app: 0|req: 236/476] 10.222.0.33 () {56 vars in 1109 bytes} [Tue Sep 13 19:41:47 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 225 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 19:41:48.121481 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31622d73-3812-4d62-851f-410abfee2137 None admin] Authenticating user token {{(pid=82026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:41:48.242217 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9740d0c6-188b-42b7-a0da-626a39b4c3dd None admin] Validating token access rules against request {{(pid=82025) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:41:48.299056 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31622d73-3812-4d62-851f-410abfee2137 None admin] Validating token access rules against request {{(pid=82026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:41:48.334193 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31a2b6d7-dad1-4f00-a593-e8a626c47851 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57539b6a6f3b4d589f5f5e1d211cd6a0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:41:48.334801 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31a2b6d7-dad1-4f00-a593-e8a626c47851 None admin] REQUEST_METHOD: `POST` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:41:48.335117 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31a2b6d7-dad1-4f00-a593-e8a626c47851 None admin] SCRIPT_NAME: `/identity` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:41:48.335396 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31a2b6d7-dad1-4f00-a593-e8a626c47851 None admin] PATH_INFO: `/v3/users` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:41:48.336049 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31a2b6d7-dad1-4f00-a593-e8a626c47851 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=82026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:41:48.337197 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce0cdb54-6ae7-4711-93f0-9c6f4befa126 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57539b6a6f3b4d589f5f5e1d211cd6a0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82025) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:41:48.337660 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31a2b6d7-dad1-4f00-a593-e8a626c47851 None admin] RBAC: Authorization granted {{(pid=82026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:41:48.337824 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce0cdb54-6ae7-4711-93f0-9c6f4befa126 None admin] REQUEST_METHOD: `POST` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:41:48.338100 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce0cdb54-6ae7-4711-93f0-9c6f4befa126 None admin] SCRIPT_NAME: `/identity` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:41:48.338382 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce0cdb54-6ae7-4711-93f0-9c6f4befa126 None admin] PATH_INFO: `/v3/roles` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:41:48.339128 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce0cdb54-6ae7-4711-93f0-9c6f4befa126 None admin] RBAC: Authorizing `identity:create_role()` {{(pid=82025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:41:48.340496 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce0cdb54-6ae7-4711-93f0-9c6f4befa126 None admin] RBAC: Authorization granted {{(pid=82025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:41:48.344379 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG dbcounter [-] [82025] Writing DB stats keystone:SELECT=100 {{(pid=82025) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:41:48.396714 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.sql.core [None req-ce0cdb54-6ae7-4711-93f0-9c6f4befa126 None admin] Conflict role: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") Sep 13 19:41:48.396714 dv-cinder-828806-6-smb devstack@keystone.service[82025]: [SQL: INSERT INTO `role` (id, name, description, extra) VALUES (%(id)s, %(name)s, %(description)s, %(extra)s)] Sep 13 19:41:48.396714 dv-cinder-828806-6-smb devstack@keystone.service[82025]: [parameters: {'id': '13685940a21441deabe9b280130488b0', 'name': 'anotherrole', 'description': None, 'extra': '{}'}] Sep 13 19:41:48.396714 dv-cinder-828806-6-smb devstack@keystone.service[82025]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=82025) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Sep 13 19:41:48.413237 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application [None req-ce0cdb54-6ae7-4711-93f0-9c6f4befa126 None admin] Conflict occurred attempting to store role - Duplicate entry found with name anotherrole.: keystone.exception.Conflict: Conflict occurred attempting to store role - Duplicate entry found with name anotherrole. Sep 13 19:41:48.413237 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 19:41:48.413237 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Sep 13 19:41:48.413237 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application self.dialect.do_execute( Sep 13 19:41:48.413237 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Sep 13 19:41:48.413237 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Sep 13 19:41:48.413237 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Sep 13 19:41:48.413237 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application result = self._query(query) Sep 13 19:41:48.413237 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Sep 13 19:41:48.413237 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application conn.query(q) Sep 13 19:41:48.413237 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Sep 13 19:41:48.413237 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Sep 13 19:41:48.413237 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Sep 13 19:41:48.413237 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application result.read() Sep 13 19:41:48.413237 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Sep 13 19:41:48.414131 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Sep 13 19:41:48.414131 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Sep 13 19:41:48.414131 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application packet.raise_for_error() Sep 13 19:41:48.414131 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Sep 13 19:41:48.414131 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Sep 13 19:41:48.414131 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Sep 13 19:41:48.414131 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Sep 13 19:41:48.414131 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") Sep 13 19:41:48.414131 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application Sep 13 19:41:48.414131 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: Sep 13 19:41:48.414131 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application Sep 13 19:41:48.414131 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 19:41:48.414131 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Sep 13 19:41:48.414131 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application return method(*args, **kwargs) Sep 13 19:41:48.414131 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 33, in create_role Sep 13 19:41:48.414131 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application return ref.to_dict() Sep 13 19:41:48.414131 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Sep 13 19:41:48.414131 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application next(self.gen) Sep 13 19:41:48.415089 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope Sep 13 19:41:48.415089 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application yield resource Sep 13 19:41:48.415089 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Sep 13 19:41:48.415089 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application next(self.gen) Sep 13 19:41:48.415089 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session Sep 13 19:41:48.415089 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application self.session.rollback() Sep 13 19:41:48.415089 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Sep 13 19:41:48.415089 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application self.force_reraise() Sep 13 19:41:48.415089 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Sep 13 19:41:48.415089 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application raise self.value Sep 13 19:41:48.415089 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session Sep 13 19:41:48.415089 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Sep 13 19:41:48.415089 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction Sep 13 19:41:48.415089 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application session.commit() Sep 13 19:41:48.415089 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1451, in commit Sep 13 19:41:48.415089 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Sep 13 19:41:48.415089 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Sep 13 19:41:48.415988 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application self._prepare_impl() Sep 13 19:41:48.415988 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Sep 13 19:41:48.415988 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application self.session.flush() Sep 13 19:41:48.415988 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Sep 13 19:41:48.415988 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application self._flush(objects) Sep 13 19:41:48.415988 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Sep 13 19:41:48.415988 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Sep 13 19:41:48.415988 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Sep 13 19:41:48.415988 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application compat.raise_( Sep 13 19:41:48.415988 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Sep 13 19:41:48.415988 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application raise exception Sep 13 19:41:48.415988 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Sep 13 19:41:48.415988 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application flush_context.execute() Sep 13 19:41:48.415988 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Sep 13 19:41:48.415988 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application rec.execute(self) Sep 13 19:41:48.415988 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Sep 13 19:41:48.415988 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( Sep 13 19:41:48.416896 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Sep 13 19:41:48.416896 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application _emit_insert_statements( Sep 13 19:41:48.416896 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1097, in _emit_insert_statements Sep 13 19:41:48.416896 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application c = connection._execute_20( Sep 13 19:41:48.416896 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1705, in _execute_20 Sep 13 19:41:48.416896 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) Sep 13 19:41:48.416896 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 333, in _execute_on_connection Sep 13 19:41:48.416896 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application return connection._execute_clauseelement( Sep 13 19:41:48.416896 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1572, in _execute_clauseelement Sep 13 19:41:48.416896 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application ret = self._execute_context( Sep 13 19:41:48.416896 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1943, in _execute_context Sep 13 19:41:48.416896 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application self._handle_dbapi_exception( Sep 13 19:41:48.416896 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2122, in _handle_dbapi_exception Sep 13 19:41:48.416896 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) Sep 13 19:41:48.416896 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Sep 13 19:41:48.416896 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application raise exception Sep 13 19:41:48.417699 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Sep 13 19:41:48.417699 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application self.dialect.do_execute( Sep 13 19:41:48.417699 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Sep 13 19:41:48.417699 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Sep 13 19:41:48.417699 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Sep 13 19:41:48.417699 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application result = self._query(query) Sep 13 19:41:48.417699 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Sep 13 19:41:48.417699 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application conn.query(q) Sep 13 19:41:48.417699 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Sep 13 19:41:48.417699 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Sep 13 19:41:48.417699 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Sep 13 19:41:48.417699 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application result.read() Sep 13 19:41:48.417699 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Sep 13 19:41:48.417699 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Sep 13 19:41:48.417699 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Sep 13 19:41:48.417699 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application packet.raise_for_error() Sep 13 19:41:48.418522 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Sep 13 19:41:48.418522 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Sep 13 19:41:48.418522 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Sep 13 19:41:48.418522 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Sep 13 19:41:48.418522 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") Sep 13 19:41:48.418522 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application [SQL: INSERT INTO `role` (id, name, description, extra) VALUES (%(id)s, %(name)s, %(description)s, %(extra)s)] Sep 13 19:41:48.418522 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application [parameters: {'id': '13685940a21441deabe9b280130488b0', 'name': 'anotherrole', 'description': None, 'extra': '{}'}] Sep 13 19:41:48.418522 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) Sep 13 19:41:48.418522 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application Sep 13 19:41:48.418522 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 13 19:41:48.418522 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application Sep 13 19:41:48.418522 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 19:41:48.418522 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 19:41:48.418522 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 19:41:48.418522 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 19:41:48.418522 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 19:41:48.421453 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 19:41:48.421453 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 19:41:48.421453 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 19:41:48.421453 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 19:41:48.421453 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 19:41:48.421453 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 19:41:48.421453 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 115, in post Sep 13 19:41:48.421453 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application ref = PROVIDERS.role_api.create_role( Sep 13 19:41:48.421453 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 19:41:48.421453 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 19:41:48.421453 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1298, in create_role Sep 13 19:41:48.421453 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application ret = self.driver.create_role(role_id, role) Sep 13 19:41:48.421453 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper Sep 13 19:41:48.421453 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, Sep 13 19:41:48.421453 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store role - Duplicate entry found with name anotherrole. Sep 13 19:41:48.421453 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application Sep 13 19:41:48.435529 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG dbcounter [-] [82026] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=82026) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:41:48.435609 dv-cinder-828806-6-smb devstack@keystone.service[82025]: [pid: 82025|app: 0|req: 241/477] 10.222.0.33 () {60 vars in 1131 bytes} [Tue Sep 13 19:41:48 2022] POST /identity/v3/roles => generated 144 bytes in 360 msecs (HTTP/1.1 409) 5 headers in 183 bytes (2 switches on core 0) Sep 13 19:41:48.435609 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce0cdb54-6ae7-4711-93f0-9c6f4befa126 None admin] Authenticating user token {{(pid=82025) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:41:48.435727 dv-cinder-828806-6-smb devstack@keystone.service[82026]: [pid: 82026|app: 0|req: 237/478] 10.222.0.33 () {60 vars in 1132 bytes} [Tue Sep 13 19:41:48 2022] POST /identity/v3/users => generated 249 bytes in 309 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 13 19:41:48.607603 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce0cdb54-6ae7-4711-93f0-9c6f4befa126 None admin] Validating token access rules against request {{(pid=82025) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:41:48.669557 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c9a0aec-dc2c-424e-a8ea-0a08a83e3a10 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57539b6a6f3b4d589f5f5e1d211cd6a0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82025) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:41:48.670206 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c9a0aec-dc2c-424e-a8ea-0a08a83e3a10 None admin] REQUEST_METHOD: `GET` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:41:48.670486 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c9a0aec-dc2c-424e-a8ea-0a08a83e3a10 None admin] SCRIPT_NAME: `/identity` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:41:48.670873 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c9a0aec-dc2c-424e-a8ea-0a08a83e3a10 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:41:48.691589 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c9a0aec-dc2c-424e-a8ea-0a08a83e3a10 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=82025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 13 19:41:48.697025 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application [None req-0c9a0aec-dc2c-424e-a8ea-0a08a83e3a10 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 13 19:41:48.697025 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 19:41:48.697025 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 19:41:48.697025 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 19:41:48.697025 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 19:41:48.697025 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 19:41:48.697025 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 19:41:48.697025 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 19:41:48.697025 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 19:41:48.697025 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 19:41:48.697025 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 19:41:48.697025 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 19:41:48.697025 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 13 19:41:48.697025 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 13 19:41:48.697025 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 13 19:41:48.697025 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 13 19:41:48.697965 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 13 19:41:48.697965 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 13 19:41:48.697965 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 13 19:41:48.697965 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 13 19:41:48.697965 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 19:41:48.697965 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 19:41:48.697965 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 19:41:48.697965 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 19:41:48.697965 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 19:41:48.697965 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 19:41:48.697965 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 19:41:48.697965 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application with Lock( Sep 13 19:41:48.697965 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 19:41:48.697965 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application return self._enter() Sep 13 19:41:48.697965 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 19:41:48.697965 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 19:41:48.698765 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 19:41:48.698765 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application return self.creator() Sep 13 19:41:48.698765 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 19:41:48.698765 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application created_value = creator( Sep 13 19:41:48.698765 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 13 19:41:48.698765 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 13 19:41:48.698765 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 13 19:41:48.698765 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 13 19:41:48.698765 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 13 19:41:48.698765 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 13 19:41:48.698765 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 13 19:41:48.698765 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application Sep 13 19:41:48.698765 dv-cinder-828806-6-smb devstack@keystone.service[82025]: [pid: 82025|app: 0|req: 242/479] 10.222.0.33 () {56 vars in 1114 bytes} [Tue Sep 13 19:41:48 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 275 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 19:41:48.708218 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31a2b6d7-dad1-4f00-a593-e8a626c47851 None admin] Authenticating user token {{(pid=82026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:41:48.850518 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31a2b6d7-dad1-4f00-a593-e8a626c47851 None admin] Validating token access rules against request {{(pid=82026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:41:48.886231 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca44dbca-c3de-4eb0-80a3-0723eff5bd2c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57539b6a6f3b4d589f5f5e1d211cd6a0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:41:48.886772 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca44dbca-c3de-4eb0-80a3-0723eff5bd2c None admin] REQUEST_METHOD: `GET` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:41:48.887087 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca44dbca-c3de-4eb0-80a3-0723eff5bd2c None admin] SCRIPT_NAME: `/identity` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:41:48.887376 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca44dbca-c3de-4eb0-80a3-0723eff5bd2c None admin] PATH_INFO: `/v3/roles` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:41:48.888053 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca44dbca-c3de-4eb0-80a3-0723eff5bd2c None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=82026) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 19:41:48.888365 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca44dbca-c3de-4eb0-80a3-0723eff5bd2c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:41:48.890348 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca44dbca-c3de-4eb0-80a3-0723eff5bd2c None admin] RBAC: Authorization granted {{(pid=82026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:41:48.898816 dv-cinder-828806-6-smb devstack@keystone.service[82026]: [pid: 82026|app: 0|req: 238/480] 10.222.0.33 () {56 vars in 1111 bytes} [Tue Sep 13 19:41:48 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 19:41:49.795591 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7014130a-f22c-4f96-942f-f53f50e79569 None None] REQUEST_METHOD: `GET` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:41:49.796284 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7014130a-f22c-4f96-942f-f53f50e79569 None None] SCRIPT_NAME: `/identity` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:41:49.796284 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7014130a-f22c-4f96-942f-f53f50e79569 None None] PATH_INFO: `/` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:41:49.797756 dv-cinder-828806-6-smb devstack@keystone.service[82025]: [pid: 82025|app: 0|req: 243/481] 10.222.0.33 () {54 vars in 927 bytes} [Tue Sep 13 19:41:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 19:41:49.803876 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ab3a3dc-0894-4236-8bc2-2d692d28b677 None None] REQUEST_METHOD: `POST` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:41:49.803876 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ab3a3dc-0894-4236-8bc2-2d692d28b677 None None] SCRIPT_NAME: `/identity` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:41:49.804448 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ab3a3dc-0894-4236-8bc2-2d692d28b677 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:41:49.828791 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.auth.core [None req-7ab3a3dc-0894-4236-8bc2-2d692d28b677 None None] MFA Rules not processed for user `57539b6a6f3b4d589f5f5e1d211cd6a0`. Rule list: `[]` (Enabled: `True`). {{(pid=82026) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 19:41:49.829988 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.common.fernet_utils [None req-7ab3a3dc-0894-4236-8bc2-2d692d28b677 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82026) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 19:41:49.896126 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG dbcounter [-] [82026] Writing DB stats keystone:SELECT=100 {{(pid=82026) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:41:49.911840 dv-cinder-828806-6-smb devstack@keystone.service[82026]: [pid: 82026|app: 0|req: 239/482] 10.222.0.33 () {58 vars in 1024 bytes} [Tue Sep 13 19:41:49 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 13 19:41:50.206007 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0f14dfa-2257-4aba-bd36-ad7a29cd2a1d None None] REQUEST_METHOD: `GET` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:41:50.206350 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0f14dfa-2257-4aba-bd36-ad7a29cd2a1d None None] SCRIPT_NAME: `/identity` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:41:50.206481 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0f14dfa-2257-4aba-bd36-ad7a29cd2a1d None None] PATH_INFO: `/` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:41:50.208142 dv-cinder-828806-6-smb devstack@keystone.service[82025]: [pid: 82025|app: 0|req: 244/483] 10.222.0.33 () {54 vars in 927 bytes} [Tue Sep 13 19:41:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 19:41:50.213620 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3a6107c-f3ca-4951-990b-b0816b8b5f83 None None] REQUEST_METHOD: `POST` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:41:50.213918 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3a6107c-f3ca-4951-990b-b0816b8b5f83 None None] SCRIPT_NAME: `/identity` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:41:50.214200 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3a6107c-f3ca-4951-990b-b0816b8b5f83 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:41:50.244264 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.auth.core [None req-e3a6107c-f3ca-4951-990b-b0816b8b5f83 None None] MFA Rules not processed for user `57539b6a6f3b4d589f5f5e1d211cd6a0`. Rule list: `[]` (Enabled: `True`). {{(pid=82026) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 19:41:50.245533 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.common.fernet_utils [None req-e3a6107c-f3ca-4951-990b-b0816b8b5f83 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82026) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 19:41:50.331027 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0f14dfa-2257-4aba-bd36-ad7a29cd2a1d None None] Authenticating user token {{(pid=82025) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:41:50.355298 dv-cinder-828806-6-smb devstack@keystone.service[82026]: [pid: 82026|app: 0|req: 240/484] 10.222.0.33 () {58 vars in 1024 bytes} [Tue Sep 13 19:41:50 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 141 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 13 19:41:50.375506 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1116e04b-f75a-48eb-8008-031b406879b0 None None] REQUEST_METHOD: `GET` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:41:50.375804 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1116e04b-f75a-48eb-8008-031b406879b0 None None] SCRIPT_NAME: `/identity` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:41:50.376071 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1116e04b-f75a-48eb-8008-031b406879b0 None None] PATH_INFO: `/` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:41:50.378578 dv-cinder-828806-6-smb devstack@keystone.service[82026]: [pid: 82026|app: 0|req: 241/485] 10.222.0.33 () {54 vars in 927 bytes} [Tue Sep 13 19:41:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 19:41:50.384276 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15119db2-9ca1-4110-95ad-7abc185ff023 None None] REQUEST_METHOD: `POST` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:41:50.384558 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15119db2-9ca1-4110-95ad-7abc185ff023 None None] SCRIPT_NAME: `/identity` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:41:50.384835 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15119db2-9ca1-4110-95ad-7abc185ff023 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:41:50.416797 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.auth.core [None req-15119db2-9ca1-4110-95ad-7abc185ff023 None None] MFA Rules not processed for user `57539b6a6f3b4d589f5f5e1d211cd6a0`. Rule list: `[]` (Enabled: `True`). {{(pid=82026) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 19:41:50.418370 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.common.fernet_utils [None req-15119db2-9ca1-4110-95ad-7abc185ff023 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82026) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 19:41:50.424768 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG dbcounter [-] [82025] Writing DB stats keystone:INSERT=1,keystone:SELECT=99 {{(pid=82025) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:41:50.505339 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0f14dfa-2257-4aba-bd36-ad7a29cd2a1d None None] Validating token access rules against request {{(pid=82025) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:41:50.554756 dv-cinder-828806-6-smb devstack@keystone.service[82026]: [pid: 82026|app: 0|req: 242/486] 10.222.0.33 () {58 vars in 1024 bytes} [Tue Sep 13 19:41:50 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 171 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 13 19:41:50.559629 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce838eb7-1bd1-4fc1-8c66-cbfbf06ac632 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57539b6a6f3b4d589f5f5e1d211cd6a0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82025) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:41:50.560324 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce838eb7-1bd1-4fc1-8c66-cbfbf06ac632 None admin] REQUEST_METHOD: `GET` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:41:50.560661 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce838eb7-1bd1-4fc1-8c66-cbfbf06ac632 None admin] SCRIPT_NAME: `/identity` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:41:50.561005 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce838eb7-1bd1-4fc1-8c66-cbfbf06ac632 None admin] PATH_INFO: `/v3/roles/service` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:41:50.572424 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce838eb7-1bd1-4fc1-8c66-cbfbf06ac632 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=82025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 13 19:41:50.578255 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application [None req-ce838eb7-1bd1-4fc1-8c66-cbfbf06ac632 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 13 19:41:50.578255 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 19:41:50.578255 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 19:41:50.578255 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 19:41:50.578255 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 19:41:50.578255 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 19:41:50.578255 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 19:41:50.578255 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 19:41:50.578255 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 19:41:50.578255 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 19:41:50.578255 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 19:41:50.578255 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 19:41:50.578255 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 13 19:41:50.578255 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 13 19:41:50.578255 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 13 19:41:50.578255 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 13 19:41:50.579322 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 13 19:41:50.579322 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 13 19:41:50.579322 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 13 19:41:50.579322 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 13 19:41:50.579322 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 19:41:50.579322 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 19:41:50.579322 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 19:41:50.579322 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 19:41:50.579322 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 19:41:50.579322 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 19:41:50.579322 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 19:41:50.579322 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application with Lock( Sep 13 19:41:50.579322 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 19:41:50.579322 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application return self._enter() Sep 13 19:41:50.579322 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 19:41:50.579322 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 19:41:50.580134 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 19:41:50.580134 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application return self.creator() Sep 13 19:41:50.580134 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 19:41:50.580134 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application created_value = creator( Sep 13 19:41:50.580134 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 13 19:41:50.580134 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 13 19:41:50.580134 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 13 19:41:50.580134 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 13 19:41:50.580134 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 13 19:41:50.580134 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 13 19:41:50.580134 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 13 19:41:50.580134 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application Sep 13 19:41:50.580134 dv-cinder-828806-6-smb devstack@keystone.service[82025]: [pid: 82025|app: 0|req: 245/487] 10.222.0.33 () {56 vars in 1102 bytes} [Tue Sep 13 19:41:50 2022] GET /identity/v3/roles/service => generated 85 bytes in 249 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 19:41:50.587565 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15119db2-9ca1-4110-95ad-7abc185ff023 None None] Authenticating user token {{(pid=82026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:41:50.656950 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG dbcounter [-] [82026] Writing DB stats keystone:SELECT=100 {{(pid=82026) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:41:50.691293 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce838eb7-1bd1-4fc1-8c66-cbfbf06ac632 None admin] Authenticating user token {{(pid=82025) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:41:50.709674 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15119db2-9ca1-4110-95ad-7abc185ff023 None None] Validating token access rules against request {{(pid=82026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:41:50.773721 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd475a6b-d47c-4ed7-9ea8-93d8f35e9e2e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57539b6a6f3b4d589f5f5e1d211cd6a0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:41:50.774316 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd475a6b-d47c-4ed7-9ea8-93d8f35e9e2e None admin] REQUEST_METHOD: `GET` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:41:50.774658 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd475a6b-d47c-4ed7-9ea8-93d8f35e9e2e None admin] SCRIPT_NAME: `/identity` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:41:50.774944 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd475a6b-d47c-4ed7-9ea8-93d8f35e9e2e None admin] PATH_INFO: `/v3/roles` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:41:50.775663 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd475a6b-d47c-4ed7-9ea8-93d8f35e9e2e None admin] RBAC: Adding query filter params (name=service) {{(pid=82026) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 19:41:50.775975 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd475a6b-d47c-4ed7-9ea8-93d8f35e9e2e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:41:50.777376 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd475a6b-d47c-4ed7-9ea8-93d8f35e9e2e None admin] RBAC: Authorization granted {{(pid=82026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:41:50.788969 dv-cinder-828806-6-smb devstack@keystone.service[82026]: [pid: 82026|app: 0|req: 243/488] 10.222.0.33 () {56 vars in 1103 bytes} [Tue Sep 13 19:41:50 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 19:41:50.795222 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd475a6b-d47c-4ed7-9ea8-93d8f35e9e2e None admin] Authenticating user token {{(pid=82026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:41:50.813403 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce838eb7-1bd1-4fc1-8c66-cbfbf06ac632 None admin] Validating token access rules against request {{(pid=82025) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:41:50.849324 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG dbcounter [-] [82025] Writing DB stats keystone:SELECT=100 {{(pid=82025) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:41:50.850236 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a71501e3-61cb-4686-9e95-b7160f30589f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57539b6a6f3b4d589f5f5e1d211cd6a0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82025) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:41:50.850873 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a71501e3-61cb-4686-9e95-b7160f30589f None admin] REQUEST_METHOD: `GET` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:41:50.851189 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a71501e3-61cb-4686-9e95-b7160f30589f None admin] SCRIPT_NAME: `/identity` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:41:50.851464 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a71501e3-61cb-4686-9e95-b7160f30589f None admin] PATH_INFO: `/v3/roles/service` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:41:50.870772 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a71501e3-61cb-4686-9e95-b7160f30589f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=82025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 13 19:41:50.877336 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application [None req-a71501e3-61cb-4686-9e95-b7160f30589f None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 13 19:41:50.877336 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 19:41:50.877336 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 19:41:50.877336 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 19:41:50.877336 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 19:41:50.877336 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 19:41:50.877336 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 19:41:50.877336 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 19:41:50.877336 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 19:41:50.877336 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 19:41:50.877336 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 19:41:50.877336 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 19:41:50.877336 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 13 19:41:50.877336 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 13 19:41:50.877336 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 13 19:41:50.877336 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 13 19:41:50.878226 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 13 19:41:50.878226 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 13 19:41:50.878226 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 13 19:41:50.878226 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 13 19:41:50.878226 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 19:41:50.878226 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 19:41:50.878226 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 19:41:50.878226 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 19:41:50.878226 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 19:41:50.878226 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 19:41:50.878226 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 19:41:50.878226 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application with Lock( Sep 13 19:41:50.878226 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 19:41:50.878226 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application return self._enter() Sep 13 19:41:50.878226 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 19:41:50.878226 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 19:41:50.879012 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 19:41:50.879012 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application return self.creator() Sep 13 19:41:50.879012 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 19:41:50.879012 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application created_value = creator( Sep 13 19:41:50.879012 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 13 19:41:50.879012 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 13 19:41:50.879012 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 13 19:41:50.879012 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 13 19:41:50.879012 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 13 19:41:50.879012 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 13 19:41:50.879012 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 13 19:41:50.879012 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application Sep 13 19:41:50.879012 dv-cinder-828806-6-smb devstack@keystone.service[82025]: [pid: 82025|app: 0|req: 246/489] 10.222.0.33 () {56 vars in 1102 bytes} [Tue Sep 13 19:41:50 2022] GET /identity/v3/roles/service => generated 85 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 13 19:41:50.890876 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a71501e3-61cb-4686-9e95-b7160f30589f None admin] Authenticating user token {{(pid=82025) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:41:51.001794 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd475a6b-d47c-4ed7-9ea8-93d8f35e9e2e None admin] Validating token access rules against request {{(pid=82026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:41:51.017431 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG dbcounter [-] [82026] Writing DB stats keystone:SELECT=100 {{(pid=82026) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:41:51.045714 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f50bc149-ef2e-441d-a352-a96bae078e2e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57539b6a6f3b4d589f5f5e1d211cd6a0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:41:51.047615 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f50bc149-ef2e-441d-a352-a96bae078e2e None admin] REQUEST_METHOD: `GET` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:41:51.048024 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f50bc149-ef2e-441d-a352-a96bae078e2e None admin] SCRIPT_NAME: `/identity` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:41:51.048405 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f50bc149-ef2e-441d-a352-a96bae078e2e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:41:51.049699 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a71501e3-61cb-4686-9e95-b7160f30589f None admin] Validating token access rules against request {{(pid=82025) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:41:51.062795 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f50bc149-ef2e-441d-a352-a96bae078e2e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=82026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:41:51.064741 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f50bc149-ef2e-441d-a352-a96bae078e2e None admin] RBAC: Authorization granted {{(pid=82026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:41:51.085446 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application [None req-f50bc149-ef2e-441d-a352-a96bae078e2e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 13 19:41:51.085446 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 19:41:51.085446 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 19:41:51.085446 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 19:41:51.085446 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 19:41:51.085446 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 19:41:51.085446 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 19:41:51.085446 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 19:41:51.085446 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 19:41:51.085446 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 19:41:51.085446 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 19:41:51.085446 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 19:41:51.085446 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 13 19:41:51.085446 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 13 19:41:51.085446 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 13 19:41:51.085446 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 13 19:41:51.086610 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 19:41:51.086610 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 19:41:51.086610 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 19:41:51.086610 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 19:41:51.086610 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 19:41:51.086610 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 19:41:51.086610 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 19:41:51.086610 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application with Lock( Sep 13 19:41:51.086610 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 19:41:51.086610 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application return self._enter() Sep 13 19:41:51.086610 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 19:41:51.086610 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 19:41:51.086610 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 19:41:51.086610 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application return self.creator() Sep 13 19:41:51.086610 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 19:41:51.086610 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application created_value = creator( Sep 13 19:41:51.086610 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 13 19:41:51.087731 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 13 19:41:51.087731 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 13 19:41:51.087731 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application Sep 13 19:41:51.089289 dv-cinder-828806-6-smb devstack@keystone.service[82026]: [pid: 82026|app: 0|req: 244/490] 10.222.0.33 () {56 vars in 1108 bytes} [Tue Sep 13 19:41:50 2022] GET /identity/v3/domains/Default => generated 87 bytes in 295 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 19:41:51.094653 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f50bc149-ef2e-441d-a352-a96bae078e2e None admin] Authenticating user token {{(pid=82026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:41:51.099226 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c4577f9-afcb-4459-812e-568d1c5fc474 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57539b6a6f3b4d589f5f5e1d211cd6a0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82025) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:41:51.100026 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c4577f9-afcb-4459-812e-568d1c5fc474 None admin] REQUEST_METHOD: `GET` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:41:51.100526 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c4577f9-afcb-4459-812e-568d1c5fc474 None admin] SCRIPT_NAME: `/identity` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:41:51.100950 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c4577f9-afcb-4459-812e-568d1c5fc474 None admin] PATH_INFO: `/v3/roles` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:41:51.101786 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c4577f9-afcb-4459-812e-568d1c5fc474 None admin] RBAC: Adding query filter params (name=service) {{(pid=82025) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 19:41:51.102236 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c4577f9-afcb-4459-812e-568d1c5fc474 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:41:51.103895 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c4577f9-afcb-4459-812e-568d1c5fc474 None admin] RBAC: Authorization granted {{(pid=82025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:41:51.114208 dv-cinder-828806-6-smb devstack@keystone.service[82025]: [pid: 82025|app: 0|req: 247/491] 10.222.0.33 () {56 vars in 1103 bytes} [Tue Sep 13 19:41:50 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 227 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 19:41:51.115458 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c4577f9-afcb-4459-812e-568d1c5fc474 None admin] Authenticating user token {{(pid=82025) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:41:51.165703 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG dbcounter [-] [82025] Writing DB stats keystone:SELECT=100 {{(pid=82025) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:41:51.221967 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f50bc149-ef2e-441d-a352-a96bae078e2e None admin] Validating token access rules against request {{(pid=82026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:41:51.243683 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c4577f9-afcb-4459-812e-568d1c5fc474 None admin] Validating token access rules against request {{(pid=82025) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:41:51.260457 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bb5171c-96cf-4434-9b70-90c3e0a3eea0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57539b6a6f3b4d589f5f5e1d211cd6a0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:41:51.261579 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bb5171c-96cf-4434-9b70-90c3e0a3eea0 None admin] REQUEST_METHOD: `GET` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:41:51.262128 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bb5171c-96cf-4434-9b70-90c3e0a3eea0 None admin] SCRIPT_NAME: `/identity` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:41:51.262659 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bb5171c-96cf-4434-9b70-90c3e0a3eea0 None admin] PATH_INFO: `/v3/roles/service` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:41:51.275585 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bb5171c-96cf-4434-9b70-90c3e0a3eea0 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=82026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 13 19:41:51.288655 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c1a59f5-3349-4529-a0f9-6753ab1fc567 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57539b6a6f3b4d589f5f5e1d211cd6a0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82025) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:41:51.289280 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c1a59f5-3349-4529-a0f9-6753ab1fc567 None admin] REQUEST_METHOD: `GET` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:41:51.289563 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c1a59f5-3349-4529-a0f9-6753ab1fc567 None admin] SCRIPT_NAME: `/identity` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:41:51.289845 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c1a59f5-3349-4529-a0f9-6753ab1fc567 None admin] PATH_INFO: `/v3/domains` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:41:51.290495 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c1a59f5-3349-4529-a0f9-6753ab1fc567 None admin] RBAC: Adding query filter params (name=Default) {{(pid=82025) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 19:41:51.291052 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c1a59f5-3349-4529-a0f9-6753ab1fc567 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:41:51.292419 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c1a59f5-3349-4529-a0f9-6753ab1fc567 None admin] RBAC: Authorization granted {{(pid=82025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:41:51.292784 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application [None req-0bb5171c-96cf-4434-9b70-90c3e0a3eea0 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 13 19:41:51.292784 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 19:41:51.292784 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 19:41:51.292784 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 19:41:51.292784 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 19:41:51.292784 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 19:41:51.292784 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 19:41:51.292784 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 19:41:51.292784 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 19:41:51.292784 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 19:41:51.292784 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 19:41:51.292784 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 19:41:51.292784 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 13 19:41:51.292784 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 13 19:41:51.292784 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 13 19:41:51.292784 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 13 19:41:51.293648 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 13 19:41:51.293648 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 13 19:41:51.293648 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 13 19:41:51.293648 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 13 19:41:51.293648 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 19:41:51.293648 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 19:41:51.293648 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 19:41:51.293648 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 19:41:51.293648 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 19:41:51.293648 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 19:41:51.293648 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 19:41:51.293648 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application with Lock( Sep 13 19:41:51.293648 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 19:41:51.293648 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application return self._enter() Sep 13 19:41:51.293648 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 19:41:51.293648 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 19:41:51.294501 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 19:41:51.294501 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application return self.creator() Sep 13 19:41:51.294501 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 19:41:51.294501 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application created_value = creator( Sep 13 19:41:51.294501 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 13 19:41:51.294501 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 13 19:41:51.294501 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 13 19:41:51.294501 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 13 19:41:51.294501 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 13 19:41:51.294501 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 13 19:41:51.294501 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 13 19:41:51.294501 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application Sep 13 19:41:51.298544 dv-cinder-828806-6-smb devstack@keystone.service[82026]: [pid: 82026|app: 0|req: 245/492] 10.222.0.33 () {56 vars in 1102 bytes} [Tue Sep 13 19:41:51 2022] GET /identity/v3/roles/service => generated 85 bytes in 207 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 19:41:51.300526 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bb5171c-96cf-4434-9b70-90c3e0a3eea0 None admin] Authenticating user token {{(pid=82026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:41:51.321698 dv-cinder-828806-6-smb devstack@keystone.service[82025]: [pid: 82025|app: 0|req: 248/493] 10.222.0.33 () {56 vars in 1109 bytes} [Tue Sep 13 19:41:51 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 19:41:51.321698 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c1a59f5-3349-4529-a0f9-6753ab1fc567 None admin] Authenticating user token {{(pid=82025) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:41:51.348817 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG dbcounter [-] [82026] Writing DB stats keystone:SELECT=100 {{(pid=82026) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:41:51.455554 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bb5171c-96cf-4434-9b70-90c3e0a3eea0 None admin] Validating token access rules against request {{(pid=82026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:41:51.455869 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG dbcounter [-] [82025] Writing DB stats keystone:SELECT=100 {{(pid=82025) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:41:51.461054 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c1a59f5-3349-4529-a0f9-6753ab1fc567 None admin] Validating token access rules against request {{(pid=82025) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:41:51.494926 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-179aed44-6fc8-44da-8383-60da41b550c7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57539b6a6f3b4d589f5f5e1d211cd6a0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:41:51.495595 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-179aed44-6fc8-44da-8383-60da41b550c7 None admin] REQUEST_METHOD: `GET` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:41:51.495882 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-179aed44-6fc8-44da-8383-60da41b550c7 None admin] SCRIPT_NAME: `/identity` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:41:51.496160 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-179aed44-6fc8-44da-8383-60da41b550c7 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:41:51.497904 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b259c7a-78b4-4ccd-8028-bcd84a5062e1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57539b6a6f3b4d589f5f5e1d211cd6a0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82025) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:41:51.498394 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b259c7a-78b4-4ccd-8028-bcd84a5062e1 None admin] REQUEST_METHOD: `GET` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:41:51.498674 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b259c7a-78b4-4ccd-8028-bcd84a5062e1 None admin] SCRIPT_NAME: `/identity` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:41:51.499878 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b259c7a-78b4-4ccd-8028-bcd84a5062e1 None admin] PATH_INFO: `/v3/roles` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:41:51.500198 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b259c7a-78b4-4ccd-8028-bcd84a5062e1 None admin] RBAC: Adding query filter params (name=service) {{(pid=82025) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 19:41:51.500503 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b259c7a-78b4-4ccd-8028-bcd84a5062e1 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:41:51.501865 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b259c7a-78b4-4ccd-8028-bcd84a5062e1 None admin] RBAC: Authorization granted {{(pid=82025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:41:51.507985 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-179aed44-6fc8-44da-8383-60da41b550c7 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=82026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:41:51.509425 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-179aed44-6fc8-44da-8383-60da41b550c7 None admin] RBAC: Authorization granted {{(pid=82026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:41:51.510666 dv-cinder-828806-6-smb devstack@keystone.service[82025]: [pid: 82025|app: 0|req: 249/494] 10.222.0.33 () {56 vars in 1103 bytes} [Tue Sep 13 19:41:51 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 19:41:51.511279 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b259c7a-78b4-4ccd-8028-bcd84a5062e1 None admin] Authenticating user token {{(pid=82025) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:41:51.528921 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application [None req-179aed44-6fc8-44da-8383-60da41b550c7 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 13 19:41:51.528921 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 19:41:51.528921 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 19:41:51.528921 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 19:41:51.528921 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 19:41:51.528921 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 19:41:51.528921 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 19:41:51.528921 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 19:41:51.528921 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 19:41:51.528921 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 19:41:51.528921 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 19:41:51.528921 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 19:41:51.528921 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 13 19:41:51.528921 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 13 19:41:51.528921 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 13 19:41:51.528921 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 13 19:41:51.529890 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 19:41:51.529890 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 19:41:51.529890 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 19:41:51.529890 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 19:41:51.529890 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 19:41:51.529890 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 19:41:51.529890 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 19:41:51.529890 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application with Lock( Sep 13 19:41:51.529890 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 19:41:51.529890 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application return self._enter() Sep 13 19:41:51.529890 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 19:41:51.529890 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 19:41:51.529890 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 19:41:51.529890 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application return self.creator() Sep 13 19:41:51.529890 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 19:41:51.529890 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application created_value = creator( Sep 13 19:41:51.529890 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 13 19:41:51.531579 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 13 19:41:51.531579 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 13 19:41:51.531579 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application Sep 13 19:41:51.532245 dv-cinder-828806-6-smb devstack@keystone.service[82026]: [pid: 82026|app: 0|req: 246/495] 10.222.0.33 () {56 vars in 1108 bytes} [Tue Sep 13 19:41:51 2022] GET /identity/v3/domains/Default => generated 87 bytes in 232 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 19:41:51.533166 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-211b3b46-9577-401d-ab4e-d63905edb984 None None] REQUEST_METHOD: `GET` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:41:51.533458 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-211b3b46-9577-401d-ab4e-d63905edb984 None None] SCRIPT_NAME: `/identity` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:41:51.533736 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-211b3b46-9577-401d-ab4e-d63905edb984 None None] PATH_INFO: `/` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:41:51.535215 dv-cinder-828806-6-smb devstack@keystone.service[82026]: [pid: 82026|app: 0|req: 247/496] 10.222.0.33 () {54 vars in 927 bytes} [Tue Sep 13 19:41:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 19:41:51.535712 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-211b3b46-9577-401d-ab4e-d63905edb984 None None] Authenticating user token {{(pid=82026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:41:51.626353 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG dbcounter [-] [82026] Writing DB stats keystone:SELECT=100 {{(pid=82026) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:41:51.634949 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b259c7a-78b4-4ccd-8028-bcd84a5062e1 None admin] Validating token access rules against request {{(pid=82025) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:41:51.654052 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-211b3b46-9577-401d-ab4e-d63905edb984 None None] Validating token access rules against request {{(pid=82026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:41:51.673987 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1ad067d-e8ee-4446-b48a-e89ca1bfaa4c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57539b6a6f3b4d589f5f5e1d211cd6a0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82025) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:41:51.674761 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1ad067d-e8ee-4446-b48a-e89ca1bfaa4c None admin] REQUEST_METHOD: `GET` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:41:51.675077 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1ad067d-e8ee-4446-b48a-e89ca1bfaa4c None admin] SCRIPT_NAME: `/identity` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:41:51.675513 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1ad067d-e8ee-4446-b48a-e89ca1bfaa4c None admin] PATH_INFO: `/v3/users/nova` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:41:51.683495 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1ad067d-e8ee-4446-b48a-e89ca1bfaa4c None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=82025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:41:51.684966 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1ad067d-e8ee-4446-b48a-e89ca1bfaa4c None admin] RBAC: Authorization granted {{(pid=82025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:41:51.693393 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f283b0e0-e0cf-488b-8fa1-64cf841c8248 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57539b6a6f3b4d589f5f5e1d211cd6a0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:41:51.694022 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f283b0e0-e0cf-488b-8fa1-64cf841c8248 None admin] REQUEST_METHOD: `GET` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:41:51.694308 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f283b0e0-e0cf-488b-8fa1-64cf841c8248 None admin] SCRIPT_NAME: `/identity` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:41:51.694584 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f283b0e0-e0cf-488b-8fa1-64cf841c8248 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:41:51.698385 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application [None req-f1ad067d-e8ee-4446-b48a-e89ca1bfaa4c None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Sep 13 19:41:51.698385 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 19:41:51.698385 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 19:41:51.698385 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 19:41:51.698385 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 19:41:51.698385 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 19:41:51.698385 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 19:41:51.698385 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 19:41:51.698385 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 19:41:51.698385 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 19:41:51.698385 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 19:41:51.698385 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 19:41:51.698385 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 13 19:41:51.698385 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 13 19:41:51.698385 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 13 19:41:51.698385 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 13 19:41:51.699297 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 19:41:51.699297 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 19:41:51.699297 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 13 19:41:51.699297 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 13 19:41:51.699297 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 13 19:41:51.699297 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 13 19:41:51.699297 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 19:41:51.699297 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 19:41:51.699297 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 19:41:51.699297 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 19:41:51.699297 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 19:41:51.699297 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application with Lock( Sep 13 19:41:51.699297 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 19:41:51.699297 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application return self._enter() Sep 13 19:41:51.699297 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 19:41:51.699297 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 19:41:51.699297 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 19:41:51.699297 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application return self.creator() Sep 13 19:41:51.705796 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 19:41:51.705796 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application created_value = creator( Sep 13 19:41:51.705796 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 13 19:41:51.705796 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 13 19:41:51.705796 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 13 19:41:51.705796 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 13 19:41:51.705796 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 13 19:41:51.705796 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 13 19:41:51.705796 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Sep 13 19:41:51.705796 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application Sep 13 19:41:51.705796 dv-cinder-828806-6-smb devstack@keystone.service[82025]: [pid: 82025|app: 0|req: 250/497] 10.222.0.33 () {56 vars in 1093 bytes} [Tue Sep 13 19:41:51 2022] GET /identity/v3/users/nova => generated 82 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 19:41:51.705796 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1ad067d-e8ee-4446-b48a-e89ca1bfaa4c None admin] Authenticating user token {{(pid=82025) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:41:51.711627 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f283b0e0-e0cf-488b-8fa1-64cf841c8248 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=82026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:41:51.713225 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f283b0e0-e0cf-488b-8fa1-64cf841c8248 None admin] RBAC: Authorization granted {{(pid=82026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:41:51.728361 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application [None req-f283b0e0-e0cf-488b-8fa1-64cf841c8248 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 13 19:41:51.728361 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 19:41:51.728361 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 19:41:51.728361 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 19:41:51.728361 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 19:41:51.728361 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 19:41:51.728361 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 19:41:51.728361 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 19:41:51.728361 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 19:41:51.728361 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 19:41:51.728361 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 19:41:51.728361 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 19:41:51.728361 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 13 19:41:51.728361 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 13 19:41:51.728361 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 13 19:41:51.728361 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 13 19:41:51.729292 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 19:41:51.729292 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 19:41:51.729292 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 19:41:51.729292 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 19:41:51.729292 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 19:41:51.729292 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 19:41:51.729292 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 19:41:51.729292 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application with Lock( Sep 13 19:41:51.729292 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 19:41:51.729292 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application return self._enter() Sep 13 19:41:51.729292 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 19:41:51.729292 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 19:41:51.729292 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 19:41:51.729292 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application return self.creator() Sep 13 19:41:51.729292 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 19:41:51.729292 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application created_value = creator( Sep 13 19:41:51.729292 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 13 19:41:51.730195 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 13 19:41:51.730195 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 13 19:41:51.730195 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application Sep 13 19:41:51.732702 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG dbcounter [-] [82025] Writing DB stats keystone:SELECT=100 {{(pid=82025) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:41:51.734082 dv-cinder-828806-6-smb devstack@keystone.service[82026]: [pid: 82026|app: 0|req: 248/498] 10.222.0.33 () {56 vars in 1108 bytes} [Tue Sep 13 19:41:51 2022] GET /identity/v3/domains/Default => generated 87 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 19:41:51.735379 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3165a1c1-dc1e-45f8-867d-9c4d0502fa3a None None] REQUEST_METHOD: `POST` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:41:51.735670 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3165a1c1-dc1e-45f8-867d-9c4d0502fa3a None None] SCRIPT_NAME: `/identity` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:41:51.735954 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3165a1c1-dc1e-45f8-867d-9c4d0502fa3a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:41:51.755886 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.auth.core [None req-3165a1c1-dc1e-45f8-867d-9c4d0502fa3a None None] MFA Rules not processed for user `57539b6a6f3b4d589f5f5e1d211cd6a0`. Rule list: `[]` (Enabled: `True`). {{(pid=82026) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 19:41:51.757081 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.common.fernet_utils [None req-3165a1c1-dc1e-45f8-867d-9c4d0502fa3a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82026) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 19:41:51.810969 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1ad067d-e8ee-4446-b48a-e89ca1bfaa4c None admin] Validating token access rules against request {{(pid=82025) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:41:51.824031 dv-cinder-828806-6-smb devstack@keystone.service[82026]: [pid: 82026|app: 0|req: 249/499] 10.222.0.33 () {58 vars in 1024 bytes} [Tue Sep 13 19:41:51 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 13 19:41:51.824866 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3165a1c1-dc1e-45f8-867d-9c4d0502fa3a None None] Authenticating user token {{(pid=82026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:41:51.859263 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78effe7e-7338-41af-837b-df2283681f88 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57539b6a6f3b4d589f5f5e1d211cd6a0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82025) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:41:51.859962 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78effe7e-7338-41af-837b-df2283681f88 None admin] REQUEST_METHOD: `GET` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:41:51.860283 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78effe7e-7338-41af-837b-df2283681f88 None admin] SCRIPT_NAME: `/identity` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:41:51.860510 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78effe7e-7338-41af-837b-df2283681f88 None admin] PATH_INFO: `/v3/domains` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:41:51.861613 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78effe7e-7338-41af-837b-df2283681f88 None admin] RBAC: Adding query filter params (name=Default) {{(pid=82025) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 19:41:51.861613 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78effe7e-7338-41af-837b-df2283681f88 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:41:51.862790 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78effe7e-7338-41af-837b-df2283681f88 None admin] RBAC: Authorization granted {{(pid=82025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:41:51.880291 dv-cinder-828806-6-smb devstack@keystone.service[82025]: [pid: 82025|app: 0|req: 251/500] 10.222.0.33 () {56 vars in 1109 bytes} [Tue Sep 13 19:41:51 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 19:41:51.880291 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78effe7e-7338-41af-837b-df2283681f88 None admin] Authenticating user token {{(pid=82025) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:41:51.892924 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG dbcounter [-] [82026] Writing DB stats keystone:SELECT=100 {{(pid=82026) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:41:51.938870 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3165a1c1-dc1e-45f8-867d-9c4d0502fa3a None None] Validating token access rules against request {{(pid=82026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:41:51.971316 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG dbcounter [-] [82025] Writing DB stats keystone:SELECT=100 {{(pid=82025) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:41:51.973383 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e04cae97-ded6-496f-9e5d-b5ce7ac69031 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57539b6a6f3b4d589f5f5e1d211cd6a0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:41:51.973994 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e04cae97-ded6-496f-9e5d-b5ce7ac69031 None admin] REQUEST_METHOD: `GET` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:41:51.974281 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e04cae97-ded6-496f-9e5d-b5ce7ac69031 None admin] SCRIPT_NAME: `/identity` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:41:51.974559 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e04cae97-ded6-496f-9e5d-b5ce7ac69031 None admin] PATH_INFO: `/v3/users` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:41:51.975316 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e04cae97-ded6-496f-9e5d-b5ce7ac69031 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=82026) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 19:41:51.975625 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e04cae97-ded6-496f-9e5d-b5ce7ac69031 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=82026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:41:51.977063 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e04cae97-ded6-496f-9e5d-b5ce7ac69031 None admin] RBAC: Authorization granted {{(pid=82026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:41:51.992319 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78effe7e-7338-41af-837b-df2283681f88 None admin] Validating token access rules against request {{(pid=82025) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:41:52.014256 dv-cinder-828806-6-smb devstack@keystone.service[82026]: [pid: 82026|app: 0|req: 250/501] 10.222.0.33 () {56 vars in 1133 bytes} [Tue Sep 13 19:41:51 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 19:41:52.016699 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91c5f9ae-94de-49c8-98a1-415f14afa071 None None] REQUEST_METHOD: `GET` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:41:52.016989 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91c5f9ae-94de-49c8-98a1-415f14afa071 None None] SCRIPT_NAME: `/identity` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:41:52.017266 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91c5f9ae-94de-49c8-98a1-415f14afa071 None None] PATH_INFO: `/` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:41:52.018678 dv-cinder-828806-6-smb devstack@keystone.service[82026]: [pid: 82026|app: 0|req: 251/502] 10.222.0.33 () {54 vars in 927 bytes} [Tue Sep 13 19:41:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 19:41:52.020199 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91c5f9ae-94de-49c8-98a1-415f14afa071 None None] Authenticating user token {{(pid=82026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:41:52.040199 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d190b0d0-55a2-437b-a224-6f08d5853043 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57539b6a6f3b4d589f5f5e1d211cd6a0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82025) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:41:52.040803 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d190b0d0-55a2-437b-a224-6f08d5853043 None admin] REQUEST_METHOD: `GET` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:41:52.041092 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d190b0d0-55a2-437b-a224-6f08d5853043 None admin] SCRIPT_NAME: `/identity` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:41:52.041367 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d190b0d0-55a2-437b-a224-6f08d5853043 None admin] PATH_INFO: `/v3/domains` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:41:52.042002 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d190b0d0-55a2-437b-a224-6f08d5853043 None admin] RBAC: Adding query filter params (name=Default) {{(pid=82025) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 19:41:52.042428 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d190b0d0-55a2-437b-a224-6f08d5853043 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:41:52.043683 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d190b0d0-55a2-437b-a224-6f08d5853043 None admin] RBAC: Authorization granted {{(pid=82025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:41:52.056617 dv-cinder-828806-6-smb devstack@keystone.service[82025]: [pid: 82025|app: 0|req: 252/503] 10.222.0.33 () {56 vars in 1109 bytes} [Tue Sep 13 19:41:51 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 19:41:52.057296 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d190b0d0-55a2-437b-a224-6f08d5853043 None admin] Authenticating user token {{(pid=82025) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:41:52.132257 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91c5f9ae-94de-49c8-98a1-415f14afa071 None None] Validating token access rules against request {{(pid=82026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:41:52.148789 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG dbcounter [-] [82026] Writing DB stats keystone:SELECT=100 {{(pid=82026) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:41:52.161730 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d190b0d0-55a2-437b-a224-6f08d5853043 None admin] Validating token access rules against request {{(pid=82025) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:41:52.166729 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9393c63c-c846-4a5c-9a47-0133e9f1e670 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57539b6a6f3b4d589f5f5e1d211cd6a0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:41:52.167503 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9393c63c-c846-4a5c-9a47-0133e9f1e670 None admin] REQUEST_METHOD: `GET` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:41:52.167703 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9393c63c-c846-4a5c-9a47-0133e9f1e670 None admin] SCRIPT_NAME: `/identity` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:41:52.167978 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9393c63c-c846-4a5c-9a47-0133e9f1e670 None admin] PATH_INFO: `/v3/users/cinder` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:41:52.174917 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9393c63c-c846-4a5c-9a47-0133e9f1e670 None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=82026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:41:52.176402 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9393c63c-c846-4a5c-9a47-0133e9f1e670 None admin] RBAC: Authorization granted {{(pid=82026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:41:52.189665 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application [None req-9393c63c-c846-4a5c-9a47-0133e9f1e670 None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Sep 13 19:41:52.189665 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 19:41:52.189665 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 19:41:52.189665 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 19:41:52.189665 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 19:41:52.189665 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 19:41:52.189665 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 19:41:52.189665 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 19:41:52.189665 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 19:41:52.189665 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 19:41:52.189665 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 19:41:52.189665 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 19:41:52.189665 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 13 19:41:52.189665 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 13 19:41:52.189665 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 13 19:41:52.189665 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 13 19:41:52.190648 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 19:41:52.190648 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 19:41:52.190648 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 13 19:41:52.190648 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 13 19:41:52.190648 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 13 19:41:52.190648 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 13 19:41:52.190648 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 19:41:52.190648 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 19:41:52.190648 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 19:41:52.190648 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 19:41:52.190648 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 19:41:52.190648 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application with Lock( Sep 13 19:41:52.190648 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 19:41:52.190648 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application return self._enter() Sep 13 19:41:52.190648 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 19:41:52.190648 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 19:41:52.190648 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 19:41:52.190648 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application return self.creator() Sep 13 19:41:52.191628 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 19:41:52.191628 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application created_value = creator( Sep 13 19:41:52.191628 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 13 19:41:52.191628 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 13 19:41:52.191628 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 13 19:41:52.191628 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 13 19:41:52.191628 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 13 19:41:52.191628 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 13 19:41:52.191628 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Sep 13 19:41:52.191628 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application Sep 13 19:41:52.191628 dv-cinder-828806-6-smb devstack@keystone.service[82026]: [pid: 82026|app: 0|req: 252/504] 10.222.0.33 () {56 vars in 1099 bytes} [Tue Sep 13 19:41:52 2022] GET /identity/v3/users/cinder => generated 84 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 19:41:52.192240 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7394636e-580e-4113-a929-9514c3e0a598 None None] REQUEST_METHOD: `POST` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:41:52.192524 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7394636e-580e-4113-a929-9514c3e0a598 None None] SCRIPT_NAME: `/identity` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:41:52.192796 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7394636e-580e-4113-a929-9514c3e0a598 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:41:52.199088 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c1e7ca7-6a78-4f16-b9ab-002a8ca0d720 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57539b6a6f3b4d589f5f5e1d211cd6a0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82025) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:41:52.199705 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c1e7ca7-6a78-4f16-b9ab-002a8ca0d720 None admin] REQUEST_METHOD: `GET` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:41:52.199989 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c1e7ca7-6a78-4f16-b9ab-002a8ca0d720 None admin] SCRIPT_NAME: `/identity` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:41:52.200267 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c1e7ca7-6a78-4f16-b9ab-002a8ca0d720 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:41:52.210584 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.auth.core [None req-7394636e-580e-4113-a929-9514c3e0a598 None None] MFA Rules not processed for user `57539b6a6f3b4d589f5f5e1d211cd6a0`. Rule list: `[]` (Enabled: `True`). {{(pid=82026) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 19:41:52.211803 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.common.fernet_utils [None req-7394636e-580e-4113-a929-9514c3e0a598 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82026) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 19:41:52.212713 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG dbcounter [-] [82025] Writing DB stats keystone:SELECT=100 {{(pid=82025) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:41:52.270102 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c1e7ca7-6a78-4f16-b9ab-002a8ca0d720 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=82025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:41:52.271592 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c1e7ca7-6a78-4f16-b9ab-002a8ca0d720 None admin] RBAC: Authorization granted {{(pid=82025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:41:52.279617 dv-cinder-828806-6-smb devstack@keystone.service[82026]: [pid: 82026|app: 0|req: 253/505] 10.222.0.33 () {58 vars in 1024 bytes} [Tue Sep 13 19:41:52 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 13 19:41:52.281255 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7394636e-580e-4113-a929-9514c3e0a598 None None] Authenticating user token {{(pid=82026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:41:52.383487 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7394636e-580e-4113-a929-9514c3e0a598 None None] Validating token access rules against request {{(pid=82026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:41:52.389562 dv-cinder-828806-6-smb devstack@keystone.service[82025]: [pid: 82025|app: 0|req: 253/506] 10.222.0.33 () {58 vars in 1282 bytes} [Tue Sep 13 19:41:52 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 333 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 13 19:41:52.390728 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG dbcounter [-] [82026] Writing DB stats keystone:SELECT=100 {{(pid=82026) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:41:52.391729 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c1e7ca7-6a78-4f16-b9ab-002a8ca0d720 None admin] Authenticating user token {{(pid=82025) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:41:52.423611 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b6e9179-e9a2-4960-b2b9-1ed07d18bcf9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57539b6a6f3b4d589f5f5e1d211cd6a0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:41:52.424598 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b6e9179-e9a2-4960-b2b9-1ed07d18bcf9 None admin] REQUEST_METHOD: `GET` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:41:52.425052 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b6e9179-e9a2-4960-b2b9-1ed07d18bcf9 None admin] SCRIPT_NAME: `/identity` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:41:52.425769 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b6e9179-e9a2-4960-b2b9-1ed07d18bcf9 None admin] PATH_INFO: `/v3/users/glance` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:41:52.433261 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b6e9179-e9a2-4960-b2b9-1ed07d18bcf9 None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=82026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:41:52.435009 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b6e9179-e9a2-4960-b2b9-1ed07d18bcf9 None admin] RBAC: Authorization granted {{(pid=82026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:41:52.436247 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG dbcounter [-] [82025] Writing DB stats keystone:SELECT=100 {{(pid=82025) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:41:52.448788 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application [None req-0b6e9179-e9a2-4960-b2b9-1ed07d18bcf9 None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Sep 13 19:41:52.448788 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 19:41:52.448788 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 19:41:52.448788 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 19:41:52.448788 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 19:41:52.448788 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 19:41:52.448788 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 19:41:52.448788 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 19:41:52.448788 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 19:41:52.448788 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 19:41:52.448788 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 19:41:52.448788 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 19:41:52.448788 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 13 19:41:52.448788 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 13 19:41:52.448788 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 13 19:41:52.448788 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 13 19:41:52.449701 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 19:41:52.449701 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 19:41:52.449701 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 13 19:41:52.449701 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 13 19:41:52.449701 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 13 19:41:52.449701 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 13 19:41:52.449701 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 19:41:52.449701 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 19:41:52.449701 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 19:41:52.449701 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 19:41:52.449701 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 19:41:52.449701 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application with Lock( Sep 13 19:41:52.449701 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 19:41:52.449701 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application return self._enter() Sep 13 19:41:52.449701 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 19:41:52.449701 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 19:41:52.449701 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 19:41:52.449701 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application return self.creator() Sep 13 19:41:52.450587 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 19:41:52.450587 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application created_value = creator( Sep 13 19:41:52.450587 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 13 19:41:52.450587 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 13 19:41:52.450587 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 13 19:41:52.450587 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 13 19:41:52.450587 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 13 19:41:52.450587 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 13 19:41:52.450587 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. Sep 13 19:41:52.450587 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application Sep 13 19:41:52.450587 dv-cinder-828806-6-smb devstack@keystone.service[82026]: [pid: 82026|app: 0|req: 254/507] 10.222.0.33 () {56 vars in 1099 bytes} [Tue Sep 13 19:41:52 2022] GET /identity/v3/users/glance => generated 84 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 19:41:52.452115 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b6e9179-e9a2-4960-b2b9-1ed07d18bcf9 None admin] Authenticating user token {{(pid=82026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:41:52.501910 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c1e7ca7-6a78-4f16-b9ab-002a8ca0d720 None admin] Validating token access rules against request {{(pid=82025) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:41:52.539471 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31d40633-ed74-49af-ac1a-d3e4bb0a48dc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57539b6a6f3b4d589f5f5e1d211cd6a0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82025) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:41:52.540468 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31d40633-ed74-49af-ac1a-d3e4bb0a48dc None admin] REQUEST_METHOD: `GET` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:41:52.540750 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31d40633-ed74-49af-ac1a-d3e4bb0a48dc None admin] SCRIPT_NAME: `/identity` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:41:52.541172 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31d40633-ed74-49af-ac1a-d3e4bb0a48dc None admin] PATH_INFO: `/v3/roles/service` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:41:52.552007 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31d40633-ed74-49af-ac1a-d3e4bb0a48dc None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=82025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 13 19:41:52.556784 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application [None req-31d40633-ed74-49af-ac1a-d3e4bb0a48dc None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 13 19:41:52.556784 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 19:41:52.556784 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 19:41:52.556784 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 19:41:52.556784 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 19:41:52.556784 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 19:41:52.556784 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 19:41:52.556784 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 19:41:52.556784 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 19:41:52.556784 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 19:41:52.556784 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 19:41:52.556784 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 19:41:52.556784 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 13 19:41:52.556784 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 13 19:41:52.556784 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 13 19:41:52.556784 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 13 19:41:52.557660 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 13 19:41:52.557660 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 13 19:41:52.557660 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 13 19:41:52.557660 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 13 19:41:52.557660 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 19:41:52.557660 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 19:41:52.557660 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 19:41:52.557660 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 19:41:52.557660 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 19:41:52.557660 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 19:41:52.557660 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 19:41:52.557660 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application with Lock( Sep 13 19:41:52.557660 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 19:41:52.557660 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application return self._enter() Sep 13 19:41:52.557660 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 19:41:52.557660 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 19:41:52.558463 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 19:41:52.558463 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application return self.creator() Sep 13 19:41:52.558463 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 19:41:52.558463 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application created_value = creator( Sep 13 19:41:52.558463 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 13 19:41:52.558463 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 13 19:41:52.558463 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 13 19:41:52.558463 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 13 19:41:52.558463 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 13 19:41:52.558463 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 13 19:41:52.558463 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 13 19:41:52.558463 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application Sep 13 19:41:52.558463 dv-cinder-828806-6-smb devstack@keystone.service[82025]: [pid: 82025|app: 0|req: 254/508] 10.222.0.33 () {56 vars in 1102 bytes} [Tue Sep 13 19:41:52 2022] GET /identity/v3/roles/service => generated 85 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 19:41:52.559149 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b6e9179-e9a2-4960-b2b9-1ed07d18bcf9 None admin] Validating token access rules against request {{(pid=82026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:41:52.559234 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31d40633-ed74-49af-ac1a-d3e4bb0a48dc None admin] Authenticating user token {{(pid=82025) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:41:52.592612 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9660f29-5b3a-4a95-b77e-7aab8f36331b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57539b6a6f3b4d589f5f5e1d211cd6a0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:41:52.593243 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9660f29-5b3a-4a95-b77e-7aab8f36331b None admin] REQUEST_METHOD: `GET` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:41:52.593528 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9660f29-5b3a-4a95-b77e-7aab8f36331b None admin] SCRIPT_NAME: `/identity` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:41:52.593795 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9660f29-5b3a-4a95-b77e-7aab8f36331b None admin] PATH_INFO: `/v3/users` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:41:52.594515 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9660f29-5b3a-4a95-b77e-7aab8f36331b None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=82026) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 19:41:52.594817 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9660f29-5b3a-4a95-b77e-7aab8f36331b None admin] RBAC: Authorizing `identity:list_users()` {{(pid=82026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:41:52.596268 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9660f29-5b3a-4a95-b77e-7aab8f36331b None admin] RBAC: Authorization granted {{(pid=82026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:41:52.613264 dv-cinder-828806-6-smb devstack@keystone.service[82026]: [pid: 82026|app: 0|req: 255/509] 10.222.0.33 () {56 vars in 1137 bytes} [Tue Sep 13 19:41:52 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 19:41:52.614115 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9660f29-5b3a-4a95-b77e-7aab8f36331b None admin] Authenticating user token {{(pid=82026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:41:52.638521 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG dbcounter [-] [82026] Writing DB stats keystone:SELECT=100 {{(pid=82026) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:41:52.660682 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31d40633-ed74-49af-ac1a-d3e4bb0a48dc None admin] Validating token access rules against request {{(pid=82025) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:41:52.662332 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG dbcounter [-] [82025] Writing DB stats keystone:SELECT=100 {{(pid=82025) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:41:52.697925 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-696ebe30-5112-41ce-8171-0fc730d3314f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57539b6a6f3b4d589f5f5e1d211cd6a0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82025) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:41:52.698547 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-696ebe30-5112-41ce-8171-0fc730d3314f None admin] REQUEST_METHOD: `GET` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:41:52.698831 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-696ebe30-5112-41ce-8171-0fc730d3314f None admin] SCRIPT_NAME: `/identity` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:41:52.699141 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-696ebe30-5112-41ce-8171-0fc730d3314f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:41:52.710235 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-696ebe30-5112-41ce-8171-0fc730d3314f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=82025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:41:52.711704 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-696ebe30-5112-41ce-8171-0fc730d3314f None admin] RBAC: Authorization granted {{(pid=82025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:41:52.713903 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9660f29-5b3a-4a95-b77e-7aab8f36331b None admin] Validating token access rules against request {{(pid=82026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:41:52.727620 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application [None req-696ebe30-5112-41ce-8171-0fc730d3314f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 13 19:41:52.727620 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 19:41:52.727620 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 19:41:52.727620 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 19:41:52.727620 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 19:41:52.727620 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 19:41:52.727620 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 19:41:52.727620 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 19:41:52.727620 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 19:41:52.727620 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 19:41:52.727620 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 19:41:52.727620 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 19:41:52.727620 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 13 19:41:52.727620 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 13 19:41:52.727620 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 13 19:41:52.727620 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 13 19:41:52.728553 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 19:41:52.728553 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 19:41:52.728553 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 19:41:52.728553 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 19:41:52.728553 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 19:41:52.728553 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 19:41:52.728553 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 19:41:52.728553 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application with Lock( Sep 13 19:41:52.728553 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 19:41:52.728553 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application return self._enter() Sep 13 19:41:52.728553 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 19:41:52.728553 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 19:41:52.728553 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 19:41:52.728553 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application return self.creator() Sep 13 19:41:52.728553 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 19:41:52.728553 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application created_value = creator( Sep 13 19:41:52.728553 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 13 19:41:52.729418 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 13 19:41:52.729418 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 13 19:41:52.729418 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application Sep 13 19:41:52.729418 dv-cinder-828806-6-smb devstack@keystone.service[82025]: [pid: 82025|app: 0|req: 255/510] 10.222.0.33 () {56 vars in 1108 bytes} [Tue Sep 13 19:41:52 2022] GET /identity/v3/domains/Default => generated 87 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 19:41:52.729629 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-696ebe30-5112-41ce-8171-0fc730d3314f None admin] Authenticating user token {{(pid=82025) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:41:52.752489 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2653546c-9f61-4e99-b92f-e0bb28a95f04 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57539b6a6f3b4d589f5f5e1d211cd6a0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:41:52.753096 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2653546c-9f61-4e99-b92f-e0bb28a95f04 None admin] REQUEST_METHOD: `GET` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:41:52.753376 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2653546c-9f61-4e99-b92f-e0bb28a95f04 None admin] SCRIPT_NAME: `/identity` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:41:52.753650 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2653546c-9f61-4e99-b92f-e0bb28a95f04 None admin] PATH_INFO: `/v3/users` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:41:52.754372 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2653546c-9f61-4e99-b92f-e0bb28a95f04 None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=82026) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 19:41:52.754675 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2653546c-9f61-4e99-b92f-e0bb28a95f04 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=82026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:41:52.756137 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2653546c-9f61-4e99-b92f-e0bb28a95f04 None admin] RBAC: Authorization granted {{(pid=82026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:41:52.778119 dv-cinder-828806-6-smb devstack@keystone.service[82026]: [pid: 82026|app: 0|req: 256/511] 10.222.0.33 () {56 vars in 1137 bytes} [Tue Sep 13 19:41:52 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 19:41:52.778119 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2653546c-9f61-4e99-b92f-e0bb28a95f04 None admin] Authenticating user token {{(pid=82026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:41:52.831422 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-696ebe30-5112-41ce-8171-0fc730d3314f None admin] Validating token access rules against request {{(pid=82025) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:41:52.865140 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa665022-f274-4353-9221-7352a829f628 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57539b6a6f3b4d589f5f5e1d211cd6a0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82025) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:41:52.866032 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa665022-f274-4353-9221-7352a829f628 None admin] REQUEST_METHOD: `GET` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:41:52.866032 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa665022-f274-4353-9221-7352a829f628 None admin] SCRIPT_NAME: `/identity` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:41:52.866303 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa665022-f274-4353-9221-7352a829f628 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:41:52.866815 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG dbcounter [-] [82026] Writing DB stats keystone:SELECT=100 {{(pid=82026) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:41:52.878500 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa665022-f274-4353-9221-7352a829f628 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=82025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:41:52.883451 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa665022-f274-4353-9221-7352a829f628 None admin] RBAC: Authorization granted {{(pid=82025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:41:52.885431 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2653546c-9f61-4e99-b92f-e0bb28a95f04 None admin] Validating token access rules against request {{(pid=82026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:41:52.894675 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application [None req-fa665022-f274-4353-9221-7352a829f628 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 13 19:41:52.894675 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 19:41:52.894675 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 19:41:52.894675 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 19:41:52.894675 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 19:41:52.894675 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 19:41:52.894675 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 19:41:52.894675 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 19:41:52.894675 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 19:41:52.894675 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 19:41:52.894675 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 19:41:52.894675 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 19:41:52.894675 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 13 19:41:52.894675 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 13 19:41:52.894675 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 13 19:41:52.894675 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 13 19:41:52.895607 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 19:41:52.895607 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 19:41:52.895607 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 19:41:52.895607 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 19:41:52.895607 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 19:41:52.895607 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 19:41:52.895607 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 19:41:52.895607 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application with Lock( Sep 13 19:41:52.895607 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 19:41:52.895607 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application return self._enter() Sep 13 19:41:52.895607 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 19:41:52.895607 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 19:41:52.895607 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 19:41:52.895607 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application return self.creator() Sep 13 19:41:52.895607 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 19:41:52.895607 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application created_value = creator( Sep 13 19:41:52.895607 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 13 19:41:52.896442 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 13 19:41:52.896442 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 13 19:41:52.896442 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application Sep 13 19:41:52.896442 dv-cinder-828806-6-smb devstack@keystone.service[82025]: [pid: 82025|app: 0|req: 256/512] 10.222.0.33 () {56 vars in 1108 bytes} [Tue Sep 13 19:41:52 2022] GET /identity/v3/domains/Default => generated 87 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 19:41:52.896666 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa665022-f274-4353-9221-7352a829f628 None admin] Authenticating user token {{(pid=82025) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:41:52.906032 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG dbcounter [-] [82025] Writing DB stats keystone:SELECT=100 {{(pid=82025) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:41:52.925287 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4578928-7581-4294-83fd-2d0b298df553 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57539b6a6f3b4d589f5f5e1d211cd6a0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:41:52.925894 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4578928-7581-4294-83fd-2d0b298df553 None admin] REQUEST_METHOD: `GET` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:41:52.926177 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4578928-7581-4294-83fd-2d0b298df553 None admin] SCRIPT_NAME: `/identity` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:41:52.926453 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4578928-7581-4294-83fd-2d0b298df553 None admin] PATH_INFO: `/v3/roles` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:41:52.927148 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4578928-7581-4294-83fd-2d0b298df553 None admin] RBAC: Adding query filter params (name=service) {{(pid=82026) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 19:41:52.927468 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4578928-7581-4294-83fd-2d0b298df553 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:41:52.928874 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4578928-7581-4294-83fd-2d0b298df553 None admin] RBAC: Authorization granted {{(pid=82026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:41:52.936805 dv-cinder-828806-6-smb devstack@keystone.service[82026]: [pid: 82026|app: 0|req: 257/513] 10.222.0.33 () {56 vars in 1103 bytes} [Tue Sep 13 19:41:52 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 19:41:52.937593 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4578928-7581-4294-83fd-2d0b298df553 None admin] Authenticating user token {{(pid=82026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:41:52.996648 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa665022-f274-4353-9221-7352a829f628 None admin] Validating token access rules against request {{(pid=82025) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:41:53.032349 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-012cf702-5340-4498-9d23-43dd16a113fb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57539b6a6f3b4d589f5f5e1d211cd6a0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82025) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:41:53.032951 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-012cf702-5340-4498-9d23-43dd16a113fb None admin] REQUEST_METHOD: `GET` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:41:53.033239 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-012cf702-5340-4498-9d23-43dd16a113fb None admin] SCRIPT_NAME: `/identity` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:41:53.033523 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-012cf702-5340-4498-9d23-43dd16a113fb None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:41:53.036433 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4578928-7581-4294-83fd-2d0b298df553 None admin] Validating token access rules against request {{(pid=82026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:41:53.069189 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2971e89-b534-4400-9768-74183ef8ade7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57539b6a6f3b4d589f5f5e1d211cd6a0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:41:53.069779 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2971e89-b534-4400-9768-74183ef8ade7 None admin] REQUEST_METHOD: `GET` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:41:53.070059 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2971e89-b534-4400-9768-74183ef8ade7 None admin] SCRIPT_NAME: `/identity` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:41:53.070338 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2971e89-b534-4400-9768-74183ef8ade7 None admin] PATH_INFO: `/v3/domains` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:41:53.070970 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2971e89-b534-4400-9768-74183ef8ade7 None admin] RBAC: Adding query filter params (name=Default) {{(pid=82026) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 19:41:53.071305 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2971e89-b534-4400-9768-74183ef8ade7 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:41:53.072685 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2971e89-b534-4400-9768-74183ef8ade7 None admin] RBAC: Authorization granted {{(pid=82026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:41:53.084404 dv-cinder-828806-6-smb devstack@keystone.service[82026]: [pid: 82026|app: 0|req: 258/514] 10.222.0.33 () {56 vars in 1109 bytes} [Tue Sep 13 19:41:52 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 19:41:53.085692 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2971e89-b534-4400-9768-74183ef8ade7 None admin] Authenticating user token {{(pid=82026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:41:53.090084 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG dbcounter [-] [82026] Writing DB stats keystone:SELECT=100 {{(pid=82026) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:41:53.100969 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-012cf702-5340-4498-9d23-43dd16a113fb None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=82025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:41:53.102407 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-012cf702-5340-4498-9d23-43dd16a113fb None admin] RBAC: Authorization granted {{(pid=82025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:41:53.111377 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG dbcounter [-] [82025] Writing DB stats keystone:SELECT=100 {{(pid=82025) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:41:53.186600 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2971e89-b534-4400-9768-74183ef8ade7 None admin] Validating token access rules against request {{(pid=82026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:41:53.203583 dv-cinder-828806-6-smb devstack@keystone.service[82025]: [pid: 82025|app: 0|req: 257/515] 10.222.0.33 () {58 vars in 1282 bytes} [Tue Sep 13 19:41:52 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 307 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 13 19:41:53.204424 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-012cf702-5340-4498-9d23-43dd16a113fb None admin] Authenticating user token {{(pid=82025) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:41:53.220168 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1939632f-9c57-40fb-832c-03e5b64e2921 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57539b6a6f3b4d589f5f5e1d211cd6a0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:41:53.220778 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1939632f-9c57-40fb-832c-03e5b64e2921 None admin] REQUEST_METHOD: `GET` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:41:53.221065 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1939632f-9c57-40fb-832c-03e5b64e2921 None admin] SCRIPT_NAME: `/identity` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:41:53.221343 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1939632f-9c57-40fb-832c-03e5b64e2921 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:41:53.288468 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1939632f-9c57-40fb-832c-03e5b64e2921 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=82026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:41:53.289514 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1939632f-9c57-40fb-832c-03e5b64e2921 None admin] RBAC: Authorization granted {{(pid=82026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:41:53.292360 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG dbcounter [-] [82026] Writing DB stats keystone:SELECT=100 {{(pid=82026) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:41:53.310255 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-012cf702-5340-4498-9d23-43dd16a113fb None admin] Validating token access rules against request {{(pid=82025) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:41:53.321643 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG dbcounter [-] [82025] Writing DB stats keystone:SELECT=100 {{(pid=82025) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:41:53.350958 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1da700c8-d952-47fb-a5d6-faaa5f92eb7a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57539b6a6f3b4d589f5f5e1d211cd6a0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82025) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:41:53.351594 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1da700c8-d952-47fb-a5d6-faaa5f92eb7a None admin] REQUEST_METHOD: `GET` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:41:53.351878 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1da700c8-d952-47fb-a5d6-faaa5f92eb7a None admin] SCRIPT_NAME: `/identity` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:41:53.352156 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1da700c8-d952-47fb-a5d6-faaa5f92eb7a None admin] PATH_INFO: `/v3/domains` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:41:53.352800 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1da700c8-d952-47fb-a5d6-faaa5f92eb7a None admin] RBAC: Adding query filter params (name=Default) {{(pid=82025) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 19:41:53.353114 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1da700c8-d952-47fb-a5d6-faaa5f92eb7a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:41:53.354487 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1da700c8-d952-47fb-a5d6-faaa5f92eb7a None admin] RBAC: Authorization granted {{(pid=82025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:41:53.367215 dv-cinder-828806-6-smb devstack@keystone.service[82025]: [pid: 82025|app: 0|req: 258/516] 10.222.0.33 () {56 vars in 1109 bytes} [Tue Sep 13 19:41:53 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 19:41:53.368003 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1da700c8-d952-47fb-a5d6-faaa5f92eb7a None admin] Authenticating user token {{(pid=82025) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:41:53.392389 dv-cinder-828806-6-smb devstack@keystone.service[82026]: [pid: 82026|app: 0|req: 259/517] 10.222.0.33 () {58 vars in 1282 bytes} [Tue Sep 13 19:41:53 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 307 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 13 19:41:53.393232 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1939632f-9c57-40fb-832c-03e5b64e2921 None admin] Authenticating user token {{(pid=82026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:41:53.474036 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1da700c8-d952-47fb-a5d6-faaa5f92eb7a None admin] Validating token access rules against request {{(pid=82025) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:41:53.498316 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1939632f-9c57-40fb-832c-03e5b64e2921 None admin] Validating token access rules against request {{(pid=82026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:41:53.500799 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG dbcounter [-] [82026] Writing DB stats keystone:SELECT=100 {{(pid=82026) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:41:53.508456 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b29d879-266e-4e41-a548-ed9ec938fe69 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57539b6a6f3b4d589f5f5e1d211cd6a0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82025) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:41:53.509080 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b29d879-266e-4e41-a548-ed9ec938fe69 None admin] REQUEST_METHOD: `GET` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:41:53.509362 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b29d879-266e-4e41-a548-ed9ec938fe69 None admin] SCRIPT_NAME: `/identity` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:41:53.509639 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b29d879-266e-4e41-a548-ed9ec938fe69 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:41:53.520812 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b29d879-266e-4e41-a548-ed9ec938fe69 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=82025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:41:53.522314 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b29d879-266e-4e41-a548-ed9ec938fe69 None admin] RBAC: Authorization granted {{(pid=82025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:41:53.534136 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2652a44f-a69b-402d-8c2f-a2fe16f10530 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57539b6a6f3b4d589f5f5e1d211cd6a0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:41:53.534761 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2652a44f-a69b-402d-8c2f-a2fe16f10530 None admin] REQUEST_METHOD: `GET` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:41:53.535062 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2652a44f-a69b-402d-8c2f-a2fe16f10530 None admin] SCRIPT_NAME: `/identity` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:41:53.535352 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2652a44f-a69b-402d-8c2f-a2fe16f10530 None admin] PATH_INFO: `/v3/projects/service` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:41:53.536793 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application [None req-4b29d879-266e-4e41-a548-ed9ec938fe69 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 13 19:41:53.536793 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 19:41:53.536793 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 19:41:53.536793 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 19:41:53.536793 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 19:41:53.536793 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 19:41:53.536793 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 19:41:53.536793 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 19:41:53.536793 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 19:41:53.536793 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 19:41:53.536793 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 19:41:53.536793 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 19:41:53.536793 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 13 19:41:53.536793 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 13 19:41:53.536793 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 13 19:41:53.536793 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 13 19:41:53.537638 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 19:41:53.537638 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 19:41:53.537638 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 19:41:53.537638 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 19:41:53.537638 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 19:41:53.537638 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 19:41:53.537638 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 19:41:53.537638 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application with Lock( Sep 13 19:41:53.537638 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 19:41:53.537638 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application return self._enter() Sep 13 19:41:53.537638 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 19:41:53.537638 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 19:41:53.537638 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 19:41:53.537638 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application return self.creator() Sep 13 19:41:53.537638 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 19:41:53.537638 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application created_value = creator( Sep 13 19:41:53.537638 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 13 19:41:53.538497 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 13 19:41:53.538497 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 13 19:41:53.538497 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application Sep 13 19:41:53.538497 dv-cinder-828806-6-smb devstack@keystone.service[82025]: [pid: 82025|app: 0|req: 259/518] 10.222.0.33 () {56 vars in 1108 bytes} [Tue Sep 13 19:41:53 2022] GET /identity/v3/domains/Default => generated 87 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 19:41:53.538717 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b29d879-266e-4e41-a548-ed9ec938fe69 None admin] Authenticating user token {{(pid=82025) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:41:53.544068 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2652a44f-a69b-402d-8c2f-a2fe16f10530 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=82026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:41:53.545516 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2652a44f-a69b-402d-8c2f-a2fe16f10530 None admin] RBAC: Authorization granted {{(pid=82026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:41:53.558476 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application [None req-2652a44f-a69b-402d-8c2f-a2fe16f10530 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 13 19:41:53.558476 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 19:41:53.558476 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 19:41:53.558476 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 19:41:53.558476 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 19:41:53.558476 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 19:41:53.558476 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 19:41:53.558476 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 19:41:53.558476 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 19:41:53.558476 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 19:41:53.558476 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 19:41:53.558476 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 19:41:53.558476 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 13 19:41:53.558476 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 13 19:41:53.558476 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 13 19:41:53.559594 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 13 19:41:53.559594 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 19:41:53.559594 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 19:41:53.559594 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 19:41:53.559594 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 19:41:53.559594 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 19:41:53.559594 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 19:41:53.559594 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 19:41:53.559594 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application with Lock( Sep 13 19:41:53.559594 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 19:41:53.559594 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application return self._enter() Sep 13 19:41:53.559594 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 19:41:53.559594 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 19:41:53.559594 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 19:41:53.559594 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application return self.creator() Sep 13 19:41:53.559594 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 19:41:53.559594 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application created_value = creator( Sep 13 19:41:53.560441 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 13 19:41:53.560441 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 13 19:41:53.560441 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 13 19:41:53.560441 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 13 19:41:53.560441 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 13 19:41:53.560441 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 13 19:41:53.560441 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 13 19:41:53.560441 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application Sep 13 19:41:53.560441 dv-cinder-828806-6-smb devstack@keystone.service[82026]: [pid: 82026|app: 0|req: 260/519] 10.222.0.33 () {56 vars in 1111 bytes} [Tue Sep 13 19:41:53 2022] GET /identity/v3/projects/service => generated 88 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 19:41:53.560911 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2652a44f-a69b-402d-8c2f-a2fe16f10530 None admin] Authenticating user token {{(pid=82026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:41:53.566014 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG dbcounter [-] [82025] Writing DB stats keystone:SELECT=100 {{(pid=82025) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:41:53.654028 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b29d879-266e-4e41-a548-ed9ec938fe69 None admin] Validating token access rules against request {{(pid=82025) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:41:53.666114 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2652a44f-a69b-402d-8c2f-a2fe16f10530 None admin] Validating token access rules against request {{(pid=82026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:41:53.690005 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4482ffd1-73b2-443a-b542-0787511dd0ed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57539b6a6f3b4d589f5f5e1d211cd6a0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82025) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:41:53.690631 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4482ffd1-73b2-443a-b542-0787511dd0ed None admin] REQUEST_METHOD: `GET` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:41:53.690915 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4482ffd1-73b2-443a-b542-0787511dd0ed None admin] SCRIPT_NAME: `/identity` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:41:53.691231 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4482ffd1-73b2-443a-b542-0787511dd0ed None admin] PATH_INFO: `/v3/domains/Default` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:41:53.701695 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbafa191-6683-4f28-a666-916b71fad036 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57539b6a6f3b4d589f5f5e1d211cd6a0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:41:53.701849 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4482ffd1-73b2-443a-b542-0787511dd0ed None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=82025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:41:53.702354 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbafa191-6683-4f28-a666-916b71fad036 None admin] REQUEST_METHOD: `POST` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:41:53.702647 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbafa191-6683-4f28-a666-916b71fad036 None admin] SCRIPT_NAME: `/identity` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:41:53.702929 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbafa191-6683-4f28-a666-916b71fad036 None admin] PATH_INFO: `/v3/users` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:41:53.703319 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4482ffd1-73b2-443a-b542-0787511dd0ed None admin] RBAC: Authorization granted {{(pid=82025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:41:53.703619 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbafa191-6683-4f28-a666-916b71fad036 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=82026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:41:53.705060 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbafa191-6683-4f28-a666-916b71fad036 None admin] RBAC: Authorization granted {{(pid=82026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:41:53.717006 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application [None req-4482ffd1-73b2-443a-b542-0787511dd0ed None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 13 19:41:53.717006 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 19:41:53.717006 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 19:41:53.717006 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 19:41:53.717006 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 19:41:53.717006 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 19:41:53.717006 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 19:41:53.717006 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 19:41:53.717006 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 19:41:53.717006 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 19:41:53.717006 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 19:41:53.717006 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 19:41:53.717006 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 13 19:41:53.717006 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 13 19:41:53.717006 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 13 19:41:53.717006 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 13 19:41:53.718221 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 19:41:53.718221 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 19:41:53.718221 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 19:41:53.718221 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 19:41:53.718221 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 19:41:53.718221 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 19:41:53.718221 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 19:41:53.718221 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application with Lock( Sep 13 19:41:53.718221 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 19:41:53.718221 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application return self._enter() Sep 13 19:41:53.718221 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 19:41:53.718221 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 19:41:53.718221 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 19:41:53.718221 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application return self.creator() Sep 13 19:41:53.718221 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 19:41:53.718221 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application created_value = creator( Sep 13 19:41:53.718221 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 13 19:41:53.719369 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 13 19:41:53.719369 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 13 19:41:53.719369 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application Sep 13 19:41:53.719369 dv-cinder-828806-6-smb devstack@keystone.service[82025]: [pid: 82025|app: 0|req: 260/520] 10.222.0.33 () {56 vars in 1108 bytes} [Tue Sep 13 19:41:53 2022] GET /identity/v3/domains/Default => generated 87 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 19:41:53.719369 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4482ffd1-73b2-443a-b542-0787511dd0ed None admin] Authenticating user token {{(pid=82025) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:41:53.779978 dv-cinder-828806-6-smb devstack@keystone.service[82026]: [pid: 82026|app: 0|req: 261/521] 10.222.0.33 () {60 vars in 1132 bytes} [Tue Sep 13 19:41:53 2022] POST /identity/v3/users => generated 247 bytes in 219 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 13 19:41:53.781527 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbafa191-6683-4f28-a666-916b71fad036 None admin] Authenticating user token {{(pid=82026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:41:53.798126 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG dbcounter [-] [82025] Writing DB stats keystone:SELECT=100 {{(pid=82025) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:41:53.811160 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG dbcounter [-] [82026] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=82026) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:41:53.834469 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4482ffd1-73b2-443a-b542-0787511dd0ed None admin] Validating token access rules against request {{(pid=82025) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:41:53.879871 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea2cd130-7b89-46f0-8974-ed79116b030d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57539b6a6f3b4d589f5f5e1d211cd6a0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82025) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:41:53.881587 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea2cd130-7b89-46f0-8974-ed79116b030d None admin] REQUEST_METHOD: `GET` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:41:53.882093 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea2cd130-7b89-46f0-8974-ed79116b030d None admin] SCRIPT_NAME: `/identity` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:41:53.883060 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea2cd130-7b89-46f0-8974-ed79116b030d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:41:53.897912 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea2cd130-7b89-46f0-8974-ed79116b030d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=82025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:41:53.899597 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea2cd130-7b89-46f0-8974-ed79116b030d None admin] RBAC: Authorization granted {{(pid=82025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:41:53.906684 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbafa191-6683-4f28-a666-916b71fad036 None admin] Validating token access rules against request {{(pid=82026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:41:53.919496 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application [None req-ea2cd130-7b89-46f0-8974-ed79116b030d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 13 19:41:53.919496 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 19:41:53.919496 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 19:41:53.919496 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 19:41:53.919496 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 19:41:53.919496 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 19:41:53.919496 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 19:41:53.919496 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 19:41:53.919496 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 19:41:53.919496 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 19:41:53.919496 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 19:41:53.919496 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 19:41:53.919496 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 13 19:41:53.919496 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 13 19:41:53.919496 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 13 19:41:53.919496 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 13 19:41:53.920514 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 19:41:53.920514 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 19:41:53.920514 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 19:41:53.920514 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 19:41:53.920514 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 19:41:53.920514 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 19:41:53.920514 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 19:41:53.920514 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application with Lock( Sep 13 19:41:53.920514 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 19:41:53.920514 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application return self._enter() Sep 13 19:41:53.920514 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 19:41:53.920514 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 19:41:53.920514 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 19:41:53.920514 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application return self.creator() Sep 13 19:41:53.920514 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 19:41:53.920514 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application created_value = creator( Sep 13 19:41:53.920514 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 13 19:41:53.922053 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 13 19:41:53.922053 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 13 19:41:53.922053 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application Sep 13 19:41:53.922053 dv-cinder-828806-6-smb devstack@keystone.service[82025]: [pid: 82025|app: 0|req: 261/522] 10.222.0.33 () {56 vars in 1108 bytes} [Tue Sep 13 19:41:53 2022] GET /identity/v3/domains/Default => generated 87 bytes in 202 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 19:41:53.922053 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea2cd130-7b89-46f0-8974-ed79116b030d None admin] Authenticating user token {{(pid=82025) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:41:53.949825 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e970253e-f575-4ba8-9e82-22919af6e1f6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57539b6a6f3b4d589f5f5e1d211cd6a0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:41:53.950442 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e970253e-f575-4ba8-9e82-22919af6e1f6 None admin] REQUEST_METHOD: `GET` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:41:53.950730 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e970253e-f575-4ba8-9e82-22919af6e1f6 None admin] SCRIPT_NAME: `/identity` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:41:53.951014 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e970253e-f575-4ba8-9e82-22919af6e1f6 None admin] PATH_INFO: `/v3/domains` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:41:53.951699 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e970253e-f575-4ba8-9e82-22919af6e1f6 None admin] RBAC: Adding query filter params (name=Default) {{(pid=82026) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 19:41:53.952012 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e970253e-f575-4ba8-9e82-22919af6e1f6 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:41:53.953455 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e970253e-f575-4ba8-9e82-22919af6e1f6 None admin] RBAC: Authorization granted {{(pid=82026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:41:53.967330 dv-cinder-828806-6-smb devstack@keystone.service[82026]: [pid: 82026|app: 0|req: 262/523] 10.222.0.33 () {56 vars in 1109 bytes} [Tue Sep 13 19:41:53 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 19:41:53.967330 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e970253e-f575-4ba8-9e82-22919af6e1f6 None admin] Authenticating user token {{(pid=82026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:41:54.047103 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea2cd130-7b89-46f0-8974-ed79116b030d None admin] Validating token access rules against request {{(pid=82025) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:41:54.066771 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG dbcounter [-] [82026] Writing DB stats keystone:SELECT=100 {{(pid=82026) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:41:54.072035 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG dbcounter [-] [82025] Writing DB stats keystone:SELECT=100 {{(pid=82025) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:41:54.084245 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df7b2bb4-5e55-43ae-b850-0d4081b7f840 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57539b6a6f3b4d589f5f5e1d211cd6a0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82025) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:41:54.085630 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df7b2bb4-5e55-43ae-b850-0d4081b7f840 None admin] REQUEST_METHOD: `GET` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:41:54.086093 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df7b2bb4-5e55-43ae-b850-0d4081b7f840 None admin] SCRIPT_NAME: `/identity` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:41:54.086541 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df7b2bb4-5e55-43ae-b850-0d4081b7f840 None admin] PATH_INFO: `/v3/projects` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:41:54.087342 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e970253e-f575-4ba8-9e82-22919af6e1f6 None admin] Validating token access rules against request {{(pid=82026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:41:54.087666 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df7b2bb4-5e55-43ae-b850-0d4081b7f840 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=82025) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 19:41:54.088147 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df7b2bb4-5e55-43ae-b850-0d4081b7f840 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=82025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:41:54.089849 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df7b2bb4-5e55-43ae-b850-0d4081b7f840 None admin] RBAC: Authorization granted {{(pid=82025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:41:54.111095 dv-cinder-828806-6-smb devstack@keystone.service[82025]: [pid: 82025|app: 0|req: 262/524] 10.222.0.33 () {56 vars in 1148 bytes} [Tue Sep 13 19:41:53 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 19:41:54.112281 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df7b2bb4-5e55-43ae-b850-0d4081b7f840 None admin] Authenticating user token {{(pid=82025) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:41:54.124502 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6075e14-4f1a-46ca-8257-fd400c24f087 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57539b6a6f3b4d589f5f5e1d211cd6a0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:41:54.125117 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6075e14-4f1a-46ca-8257-fd400c24f087 None admin] REQUEST_METHOD: `GET` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:41:54.125402 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6075e14-4f1a-46ca-8257-fd400c24f087 None admin] SCRIPT_NAME: `/identity` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:41:54.125679 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6075e14-4f1a-46ca-8257-fd400c24f087 None admin] PATH_INFO: `/v3/domains` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:41:54.126321 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6075e14-4f1a-46ca-8257-fd400c24f087 None admin] RBAC: Adding query filter params (name=Default) {{(pid=82026) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 19:41:54.126625 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6075e14-4f1a-46ca-8257-fd400c24f087 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:41:54.128026 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6075e14-4f1a-46ca-8257-fd400c24f087 None admin] RBAC: Authorization granted {{(pid=82026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:41:54.144815 dv-cinder-828806-6-smb devstack@keystone.service[82026]: [pid: 82026|app: 0|req: 263/525] 10.222.0.33 () {56 vars in 1109 bytes} [Tue Sep 13 19:41:53 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 19:41:54.144815 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6075e14-4f1a-46ca-8257-fd400c24f087 None admin] Authenticating user token {{(pid=82026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:41:54.226428 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df7b2bb4-5e55-43ae-b850-0d4081b7f840 None admin] Validating token access rules against request {{(pid=82025) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:41:54.244939 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6075e14-4f1a-46ca-8257-fd400c24f087 None admin] Validating token access rules against request {{(pid=82026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:41:54.268100 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0217c220-6cc8-4ca6-a199-19ea0fc03b42 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57539b6a6f3b4d589f5f5e1d211cd6a0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82025) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:41:54.268814 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0217c220-6cc8-4ca6-a199-19ea0fc03b42 None admin] REQUEST_METHOD: `GET` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:41:54.269101 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0217c220-6cc8-4ca6-a199-19ea0fc03b42 None admin] SCRIPT_NAME: `/identity` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:41:54.269473 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0217c220-6cc8-4ca6-a199-19ea0fc03b42 None admin] PATH_INFO: `/v3/domains` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:41:54.270130 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0217c220-6cc8-4ca6-a199-19ea0fc03b42 None admin] RBAC: Adding query filter params (name=Default) {{(pid=82025) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 19:41:54.270436 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0217c220-6cc8-4ca6-a199-19ea0fc03b42 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:41:54.271839 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0217c220-6cc8-4ca6-a199-19ea0fc03b42 None admin] RBAC: Authorization granted {{(pid=82025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:41:54.283918 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a4c3eda-14a6-4177-8132-08cfbe22faf6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57539b6a6f3b4d589f5f5e1d211cd6a0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:41:54.284563 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a4c3eda-14a6-4177-8132-08cfbe22faf6 None admin] REQUEST_METHOD: `GET` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:41:54.284846 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a4c3eda-14a6-4177-8132-08cfbe22faf6 None admin] SCRIPT_NAME: `/identity` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:41:54.285121 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a4c3eda-14a6-4177-8132-08cfbe22faf6 None admin] PATH_INFO: `/v3/users/neutron` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:41:54.291170 dv-cinder-828806-6-smb devstack@keystone.service[82025]: [pid: 82025|app: 0|req: 263/526] 10.222.0.33 () {56 vars in 1109 bytes} [Tue Sep 13 19:41:54 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 19:41:54.292277 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0217c220-6cc8-4ca6-a199-19ea0fc03b42 None admin] Authenticating user token {{(pid=82025) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:41:54.299524 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a4c3eda-14a6-4177-8132-08cfbe22faf6 None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=82026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:41:54.300925 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a4c3eda-14a6-4177-8132-08cfbe22faf6 None admin] RBAC: Authorization granted {{(pid=82026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:41:54.304176 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG dbcounter [-] [82026] Writing DB stats keystone:SELECT=100 {{(pid=82026) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:41:54.313520 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application [None req-8a4c3eda-14a6-4177-8132-08cfbe22faf6 None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Sep 13 19:41:54.313520 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 19:41:54.313520 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 19:41:54.313520 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 19:41:54.313520 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 19:41:54.313520 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 19:41:54.313520 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 19:41:54.313520 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 19:41:54.313520 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 19:41:54.313520 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 19:41:54.313520 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 19:41:54.313520 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 19:41:54.313520 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 13 19:41:54.313520 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 13 19:41:54.313520 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 13 19:41:54.313520 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 13 19:41:54.321932 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 19:41:54.321932 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 19:41:54.321932 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 13 19:41:54.321932 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 13 19:41:54.321932 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 13 19:41:54.321932 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 13 19:41:54.321932 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 19:41:54.321932 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 19:41:54.321932 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 19:41:54.321932 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 19:41:54.321932 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 19:41:54.321932 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application with Lock( Sep 13 19:41:54.321932 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 19:41:54.321932 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application return self._enter() Sep 13 19:41:54.321932 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 19:41:54.321932 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 19:41:54.321932 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 19:41:54.321932 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application return self.creator() Sep 13 19:41:54.322812 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 19:41:54.322812 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application created_value = creator( Sep 13 19:41:54.322812 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 13 19:41:54.322812 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 13 19:41:54.322812 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 13 19:41:54.322812 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 13 19:41:54.322812 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 13 19:41:54.322812 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 13 19:41:54.322812 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. Sep 13 19:41:54.322812 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application Sep 13 19:41:54.322812 dv-cinder-828806-6-smb devstack@keystone.service[82026]: [pid: 82026|app: 0|req: 264/527] 10.222.0.33 () {56 vars in 1102 bytes} [Tue Sep 13 19:41:54 2022] GET /identity/v3/users/neutron => generated 85 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 19:41:54.322812 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a4c3eda-14a6-4177-8132-08cfbe22faf6 None admin] Authenticating user token {{(pid=82026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:41:54.345263 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG dbcounter [-] [82025] Writing DB stats keystone:SELECT=100 {{(pid=82025) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:41:54.405750 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0217c220-6cc8-4ca6-a199-19ea0fc03b42 None admin] Validating token access rules against request {{(pid=82025) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:41:54.417469 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a4c3eda-14a6-4177-8132-08cfbe22faf6 None admin] Validating token access rules against request {{(pid=82026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:41:54.440446 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06e12abd-3df2-4ff9-9887-f7dea0256b56 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57539b6a6f3b4d589f5f5e1d211cd6a0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82025) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:41:54.441053 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06e12abd-3df2-4ff9-9887-f7dea0256b56 None admin] REQUEST_METHOD: `GET` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:41:54.441335 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06e12abd-3df2-4ff9-9887-f7dea0256b56 None admin] SCRIPT_NAME: `/identity` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:41:54.441616 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06e12abd-3df2-4ff9-9887-f7dea0256b56 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:41:54.442339 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06e12abd-3df2-4ff9-9887-f7dea0256b56 None admin] RBAC: Adding query filter params (role.id=47ee826cd5f148c19f293f9470f906da, scope.project.id=c8c6fba0f15b4d6a84ff601919b7b8e4, user.id=e66e7034abed4e0bad1f4137520c1e70) {{(pid=82025) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 19:41:54.442657 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06e12abd-3df2-4ff9-9887-f7dea0256b56 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=82025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:41:54.444125 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06e12abd-3df2-4ff9-9887-f7dea0256b56 None admin] RBAC: Authorization granted {{(pid=82025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:41:54.450077 dv-cinder-828806-6-smb devstack@keystone.service[82025]: [pid: 82025|app: 0|req: 264/528] 10.222.0.33 () {56 vars in 1374 bytes} [Tue Sep 13 19:41:54 2022] GET /identity/v3/role_assignments?user.id=e66e7034abed4e0bad1f4137520c1e70&scope.project.id=c8c6fba0f15b4d6a84ff601919b7b8e4&role.id=47ee826cd5f148c19f293f9470f906da => generated 259 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 19:41:54.450878 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06e12abd-3df2-4ff9-9887-f7dea0256b56 None admin] Authenticating user token {{(pid=82025) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:41:54.461361 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91dafa03-0289-49c8-bb3f-377ba987c522 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57539b6a6f3b4d589f5f5e1d211cd6a0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:41:54.462075 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91dafa03-0289-49c8-bb3f-377ba987c522 None admin] REQUEST_METHOD: `GET` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:41:54.462356 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91dafa03-0289-49c8-bb3f-377ba987c522 None admin] SCRIPT_NAME: `/identity` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:41:54.462678 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91dafa03-0289-49c8-bb3f-377ba987c522 None admin] PATH_INFO: `/v3/projects/service` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:41:54.470996 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91dafa03-0289-49c8-bb3f-377ba987c522 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=82026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:41:54.472626 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91dafa03-0289-49c8-bb3f-377ba987c522 None admin] RBAC: Authorization granted {{(pid=82026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:41:54.486966 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application [None req-91dafa03-0289-49c8-bb3f-377ba987c522 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 13 19:41:54.486966 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 19:41:54.486966 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 19:41:54.486966 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 19:41:54.486966 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 19:41:54.486966 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 19:41:54.486966 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 19:41:54.486966 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 19:41:54.486966 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 19:41:54.486966 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 19:41:54.486966 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 19:41:54.486966 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 19:41:54.486966 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 13 19:41:54.486966 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 13 19:41:54.486966 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 13 19:41:54.487917 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 13 19:41:54.487917 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 19:41:54.487917 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 19:41:54.487917 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 19:41:54.487917 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 19:41:54.487917 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 19:41:54.487917 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 19:41:54.487917 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 19:41:54.487917 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application with Lock( Sep 13 19:41:54.487917 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 19:41:54.487917 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application return self._enter() Sep 13 19:41:54.487917 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 19:41:54.487917 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 19:41:54.487917 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 19:41:54.487917 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application return self.creator() Sep 13 19:41:54.487917 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 19:41:54.487917 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application created_value = creator( Sep 13 19:41:54.488808 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 13 19:41:54.488808 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 13 19:41:54.488808 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 13 19:41:54.488808 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 13 19:41:54.488808 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 13 19:41:54.488808 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 13 19:41:54.488808 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 13 19:41:54.488808 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application Sep 13 19:41:54.493242 dv-cinder-828806-6-smb devstack@keystone.service[82026]: [pid: 82026|app: 0|req: 265/529] 10.222.0.33 () {56 vars in 1111 bytes} [Tue Sep 13 19:41:54 2022] GET /identity/v3/projects/service => generated 88 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 19:41:54.494084 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91dafa03-0289-49c8-bb3f-377ba987c522 None admin] Authenticating user token {{(pid=82026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:41:54.578678 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG dbcounter [-] [82026] Writing DB stats keystone:SELECT=100 {{(pid=82026) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:41:54.591793 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06e12abd-3df2-4ff9-9887-f7dea0256b56 None admin] Validating token access rules against request {{(pid=82025) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:41:54.604132 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG dbcounter [-] [82025] Writing DB stats keystone:SELECT=100 {{(pid=82025) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:41:54.626800 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91dafa03-0289-49c8-bb3f-377ba987c522 None admin] Validating token access rules against request {{(pid=82026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:41:54.641428 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02ef7707-ade9-4eb2-977a-e45e0ac98596 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57539b6a6f3b4d589f5f5e1d211cd6a0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82025) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:41:54.642732 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02ef7707-ade9-4eb2-977a-e45e0ac98596 None admin] REQUEST_METHOD: `GET` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:41:54.643193 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02ef7707-ade9-4eb2-977a-e45e0ac98596 None admin] SCRIPT_NAME: `/identity` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:41:54.643617 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02ef7707-ade9-4eb2-977a-e45e0ac98596 None admin] PATH_INFO: `/v3/projects/service` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:41:54.653235 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02ef7707-ade9-4eb2-977a-e45e0ac98596 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=82025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:41:54.655088 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02ef7707-ade9-4eb2-977a-e45e0ac98596 None admin] RBAC: Authorization granted {{(pid=82025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:41:54.666662 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25385537-24d4-4251-9b56-74e1a1557995 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57539b6a6f3b4d589f5f5e1d211cd6a0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:41:54.667465 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25385537-24d4-4251-9b56-74e1a1557995 None admin] REQUEST_METHOD: `GET` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:41:54.667856 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25385537-24d4-4251-9b56-74e1a1557995 None admin] SCRIPT_NAME: `/identity` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:41:54.668227 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25385537-24d4-4251-9b56-74e1a1557995 None admin] PATH_INFO: `/v3/users` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:41:54.669080 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25385537-24d4-4251-9b56-74e1a1557995 None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=82026) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 19:41:54.669490 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25385537-24d4-4251-9b56-74e1a1557995 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=82026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:41:54.671133 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25385537-24d4-4251-9b56-74e1a1557995 None admin] RBAC: Authorization granted {{(pid=82026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:41:54.672518 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application [None req-02ef7707-ade9-4eb2-977a-e45e0ac98596 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 13 19:41:54.672518 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 19:41:54.672518 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 19:41:54.672518 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 19:41:54.672518 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 19:41:54.672518 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 19:41:54.672518 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 19:41:54.672518 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 19:41:54.672518 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 19:41:54.672518 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 19:41:54.672518 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 19:41:54.672518 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 19:41:54.672518 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 13 19:41:54.672518 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 13 19:41:54.672518 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 13 19:41:54.673446 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 13 19:41:54.673446 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 19:41:54.673446 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 19:41:54.673446 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 19:41:54.673446 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 19:41:54.673446 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 19:41:54.673446 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 19:41:54.673446 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 19:41:54.673446 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application with Lock( Sep 13 19:41:54.673446 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 19:41:54.673446 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application return self._enter() Sep 13 19:41:54.673446 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 19:41:54.673446 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 19:41:54.673446 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 19:41:54.673446 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application return self.creator() Sep 13 19:41:54.673446 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 19:41:54.673446 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application created_value = creator( Sep 13 19:41:54.674296 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 13 19:41:54.674296 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 13 19:41:54.674296 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 13 19:41:54.674296 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 13 19:41:54.674296 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 13 19:41:54.674296 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 13 19:41:54.674296 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 13 19:41:54.674296 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application Sep 13 19:41:54.676792 dv-cinder-828806-6-smb devstack@keystone.service[82025]: [pid: 82025|app: 0|req: 265/530] 10.222.0.33 () {56 vars in 1111 bytes} [Tue Sep 13 19:41:54 2022] GET /identity/v3/projects/service => generated 88 bytes in 226 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 19:41:54.677881 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02ef7707-ade9-4eb2-977a-e45e0ac98596 None admin] Authenticating user token {{(pid=82025) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:41:54.694284 dv-cinder-828806-6-smb devstack@keystone.service[82026]: [pid: 82026|app: 0|req: 266/531] 10.222.0.33 () {56 vars in 1139 bytes} [Tue Sep 13 19:41:54 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 19:41:54.695472 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25385537-24d4-4251-9b56-74e1a1557995 None admin] Authenticating user token {{(pid=82026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:41:54.799444 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02ef7707-ade9-4eb2-977a-e45e0ac98596 None admin] Validating token access rules against request {{(pid=82025) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:41:54.834315 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25385537-24d4-4251-9b56-74e1a1557995 None admin] Validating token access rules against request {{(pid=82026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:41:54.839992 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95aad01b-4549-4024-b0c7-0e6be47f83e0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57539b6a6f3b4d589f5f5e1d211cd6a0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82025) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:41:54.840836 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95aad01b-4549-4024-b0c7-0e6be47f83e0 None admin] REQUEST_METHOD: `GET` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:41:54.841303 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95aad01b-4549-4024-b0c7-0e6be47f83e0 None admin] SCRIPT_NAME: `/identity` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:41:54.841759 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95aad01b-4549-4024-b0c7-0e6be47f83e0 None admin] PATH_INFO: `/v3/projects` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:41:54.842694 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95aad01b-4549-4024-b0c7-0e6be47f83e0 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=82025) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 19:41:54.843334 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95aad01b-4549-4024-b0c7-0e6be47f83e0 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=82025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:41:54.844988 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95aad01b-4549-4024-b0c7-0e6be47f83e0 None admin] RBAC: Authorization granted {{(pid=82025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:41:54.852051 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG dbcounter [-] [82026] Writing DB stats keystone:SELECT=100 {{(pid=82026) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:41:54.858110 dv-cinder-828806-6-smb devstack@keystone.service[82025]: [pid: 82025|app: 0|req: 266/532] 10.222.0.33 () {56 vars in 1148 bytes} [Tue Sep 13 19:41:54 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 19:41:54.863998 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95aad01b-4549-4024-b0c7-0e6be47f83e0 None admin] Authenticating user token {{(pid=82025) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:41:54.873207 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f949984-d88b-4b99-ae1a-66fcb85c6e7a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57539b6a6f3b4d589f5f5e1d211cd6a0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:41:54.873820 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f949984-d88b-4b99-ae1a-66fcb85c6e7a None admin] REQUEST_METHOD: `GET` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:41:54.874106 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f949984-d88b-4b99-ae1a-66fcb85c6e7a None admin] SCRIPT_NAME: `/identity` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:41:54.875179 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f949984-d88b-4b99-ae1a-66fcb85c6e7a None admin] PATH_INFO: `/v3/projects` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:41:54.875892 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f949984-d88b-4b99-ae1a-66fcb85c6e7a None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=82026) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 19:41:54.876469 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f949984-d88b-4b99-ae1a-66fcb85c6e7a None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=82026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:41:54.880452 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f949984-d88b-4b99-ae1a-66fcb85c6e7a None admin] RBAC: Authorization granted {{(pid=82026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:41:54.903508 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG dbcounter [-] [82025] Writing DB stats keystone:SELECT=100 {{(pid=82025) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:41:54.910494 dv-cinder-828806-6-smb devstack@keystone.service[82026]: [pid: 82026|app: 0|req: 267/533] 10.222.0.33 () {56 vars in 1148 bytes} [Tue Sep 13 19:41:54 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 215 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 19:41:54.911909 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f949984-d88b-4b99-ae1a-66fcb85c6e7a None admin] Authenticating user token {{(pid=82026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:41:54.984151 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95aad01b-4549-4024-b0c7-0e6be47f83e0 None admin] Validating token access rules against request {{(pid=82025) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:41:55.028420 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef16aad1-c53f-4be1-aa93-276736b7f132 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57539b6a6f3b4d589f5f5e1d211cd6a0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82025) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:41:55.029388 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef16aad1-c53f-4be1-aa93-276736b7f132 None admin] REQUEST_METHOD: `GET` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:41:55.030410 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef16aad1-c53f-4be1-aa93-276736b7f132 None admin] SCRIPT_NAME: `/identity` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:41:55.031168 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef16aad1-c53f-4be1-aa93-276736b7f132 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:41:55.042676 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f949984-d88b-4b99-ae1a-66fcb85c6e7a None admin] Validating token access rules against request {{(pid=82026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:41:55.078972 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46c9a736-e91c-4996-8a57-05a4ec5e82fc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57539b6a6f3b4d589f5f5e1d211cd6a0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:41:55.079632 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46c9a736-e91c-4996-8a57-05a4ec5e82fc None admin] REQUEST_METHOD: `GET` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:41:55.079880 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46c9a736-e91c-4996-8a57-05a4ec5e82fc None admin] SCRIPT_NAME: `/identity` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:41:55.080154 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46c9a736-e91c-4996-8a57-05a4ec5e82fc None admin] PATH_INFO: `/v3/role_assignments` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:41:55.080883 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46c9a736-e91c-4996-8a57-05a4ec5e82fc None admin] RBAC: Adding query filter params (role.id=47ee826cd5f148c19f293f9470f906da, scope.project.id=c8c6fba0f15b4d6a84ff601919b7b8e4, user.id=46024fc6167f4321818b1bed27a521a0) {{(pid=82026) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 19:41:55.081195 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46c9a736-e91c-4996-8a57-05a4ec5e82fc None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=82026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:41:55.082640 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46c9a736-e91c-4996-8a57-05a4ec5e82fc None admin] RBAC: Authorization granted {{(pid=82026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:41:55.096552 dv-cinder-828806-6-smb devstack@keystone.service[82026]: [pid: 82026|app: 0|req: 268/534] 10.222.0.33 () {56 vars in 1374 bytes} [Tue Sep 13 19:41:54 2022] GET /identity/v3/role_assignments?user.id=46024fc6167f4321818b1bed27a521a0&scope.project.id=c8c6fba0f15b4d6a84ff601919b7b8e4&role.id=47ee826cd5f148c19f293f9470f906da => generated 259 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 19:41:55.097844 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46c9a736-e91c-4996-8a57-05a4ec5e82fc None admin] Authenticating user token {{(pid=82026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:41:55.152448 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef16aad1-c53f-4be1-aa93-276736b7f132 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=82025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:41:55.154359 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef16aad1-c53f-4be1-aa93-276736b7f132 None admin] RBAC: Authorization granted {{(pid=82025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:41:55.194116 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG dbcounter [-] [82026] Writing DB stats keystone:SELECT=100 {{(pid=82026) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:41:55.215455 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG dbcounter [-] [82025] Writing DB stats keystone:SELECT=100 {{(pid=82025) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:41:55.276291 dv-cinder-828806-6-smb devstack@keystone.service[82025]: [pid: 82025|app: 0|req: 267/535] 10.222.0.33 () {58 vars in 1282 bytes} [Tue Sep 13 19:41:54 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 412 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 13 19:41:55.284071 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef16aad1-c53f-4be1-aa93-276736b7f132 None admin] Authenticating user token {{(pid=82025) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:41:55.331395 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46c9a736-e91c-4996-8a57-05a4ec5e82fc None admin] Validating token access rules against request {{(pid=82026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:41:55.394252 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef16aad1-c53f-4be1-aa93-276736b7f132 None admin] Validating token access rules against request {{(pid=82025) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:41:55.394940 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1344e1fb-ad39-437d-b5c7-40b4d2ad7b22 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57539b6a6f3b4d589f5f5e1d211cd6a0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:41:55.396858 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1344e1fb-ad39-437d-b5c7-40b4d2ad7b22 None admin] REQUEST_METHOD: `GET` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:41:55.397143 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1344e1fb-ad39-437d-b5c7-40b4d2ad7b22 None admin] SCRIPT_NAME: `/identity` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:41:55.397423 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1344e1fb-ad39-437d-b5c7-40b4d2ad7b22 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:41:55.398998 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1344e1fb-ad39-437d-b5c7-40b4d2ad7b22 None admin] RBAC: Adding query filter params (role.id=47ee826cd5f148c19f293f9470f906da, scope.project.id=c8c6fba0f15b4d6a84ff601919b7b8e4, user.id=f7b2421bf1f84193a29f79709d1d5a19) {{(pid=82026) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 19:41:55.399410 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1344e1fb-ad39-437d-b5c7-40b4d2ad7b22 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=82026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:41:55.400880 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1344e1fb-ad39-437d-b5c7-40b4d2ad7b22 None admin] RBAC: Authorization granted {{(pid=82026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:41:55.409943 dv-cinder-828806-6-smb devstack@keystone.service[82026]: [pid: 82026|app: 0|req: 269/536] 10.222.0.33 () {56 vars in 1374 bytes} [Tue Sep 13 19:41:55 2022] GET /identity/v3/role_assignments?user.id=f7b2421bf1f84193a29f79709d1d5a19&scope.project.id=c8c6fba0f15b4d6a84ff601919b7b8e4&role.id=47ee826cd5f148c19f293f9470f906da => generated 259 bytes in 312 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 19:41:55.431836 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG dbcounter [-] [82025] Writing DB stats keystone:SELECT=100 {{(pid=82025) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:41:55.448718 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-813bd5bd-503e-4d5b-9ae7-034321f80500 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57539b6a6f3b4d589f5f5e1d211cd6a0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82025) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:41:55.449686 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-813bd5bd-503e-4d5b-9ae7-034321f80500 None admin] REQUEST_METHOD: `GET` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:41:55.450145 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-813bd5bd-503e-4d5b-9ae7-034321f80500 None admin] SCRIPT_NAME: `/identity` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:41:55.450619 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-813bd5bd-503e-4d5b-9ae7-034321f80500 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:41:55.473176 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-813bd5bd-503e-4d5b-9ae7-034321f80500 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=82025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:41:55.475089 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-813bd5bd-503e-4d5b-9ae7-034321f80500 None admin] RBAC: Authorization granted {{(pid=82025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:41:55.500088 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application [None req-813bd5bd-503e-4d5b-9ae7-034321f80500 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 13 19:41:55.500088 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 19:41:55.500088 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 19:41:55.500088 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 19:41:55.500088 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 19:41:55.500088 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 19:41:55.500088 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 19:41:55.500088 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 19:41:55.500088 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 19:41:55.500088 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 19:41:55.500088 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 19:41:55.500088 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 19:41:55.500088 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 13 19:41:55.500088 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 13 19:41:55.500088 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 13 19:41:55.500088 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 13 19:41:55.501300 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 19:41:55.501300 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 19:41:55.501300 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 19:41:55.501300 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 19:41:55.501300 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 19:41:55.501300 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 19:41:55.501300 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 19:41:55.501300 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application with Lock( Sep 13 19:41:55.501300 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 19:41:55.501300 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application return self._enter() Sep 13 19:41:55.501300 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 19:41:55.501300 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 19:41:55.501300 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 19:41:55.501300 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application return self.creator() Sep 13 19:41:55.501300 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 19:41:55.501300 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application created_value = creator( Sep 13 19:41:55.501300 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 13 19:41:55.502126 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 13 19:41:55.502126 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 13 19:41:55.502126 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application Sep 13 19:41:55.504171 dv-cinder-828806-6-smb devstack@keystone.service[82025]: [pid: 82025|app: 0|req: 268/537] 10.222.0.33 () {56 vars in 1108 bytes} [Tue Sep 13 19:41:55 2022] GET /identity/v3/domains/Default => generated 87 bytes in 221 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 19:41:55.512227 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1344e1fb-ad39-437d-b5c7-40b4d2ad7b22 None admin] Authenticating user token {{(pid=82026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:41:55.644873 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1344e1fb-ad39-437d-b5c7-40b4d2ad7b22 None admin] Validating token access rules against request {{(pid=82026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:41:55.655489 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG dbcounter [-] [82026] Writing DB stats keystone:SELECT=100 {{(pid=82026) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:41:55.688526 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1132fb98-93a9-4052-871c-6abba7450a4a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57539b6a6f3b4d589f5f5e1d211cd6a0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:41:55.689470 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1132fb98-93a9-4052-871c-6abba7450a4a None admin] REQUEST_METHOD: `GET` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:41:55.690039 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1132fb98-93a9-4052-871c-6abba7450a4a None admin] SCRIPT_NAME: `/identity` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:41:55.690322 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1132fb98-93a9-4052-871c-6abba7450a4a None admin] PATH_INFO: `/v3/domains` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:41:55.690970 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1132fb98-93a9-4052-871c-6abba7450a4a None admin] RBAC: Adding query filter params (name=Default) {{(pid=82026) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 19:41:55.691780 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1132fb98-93a9-4052-871c-6abba7450a4a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:41:55.693219 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1132fb98-93a9-4052-871c-6abba7450a4a None admin] RBAC: Authorization granted {{(pid=82026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:41:55.705823 dv-cinder-828806-6-smb devstack@keystone.service[82026]: [pid: 82026|app: 0|req: 270/538] 10.222.0.33 () {56 vars in 1109 bytes} [Tue Sep 13 19:41:55 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 19:41:55.710873 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-813bd5bd-503e-4d5b-9ae7-034321f80500 None admin] Authenticating user token {{(pid=82025) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:41:55.852342 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-813bd5bd-503e-4d5b-9ae7-034321f80500 None admin] Validating token access rules against request {{(pid=82025) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:41:55.891152 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e604e7a0-6097-4049-86b1-35df0bac17db None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57539b6a6f3b4d589f5f5e1d211cd6a0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82025) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:41:55.891792 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e604e7a0-6097-4049-86b1-35df0bac17db None admin] REQUEST_METHOD: `GET` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:41:55.892078 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e604e7a0-6097-4049-86b1-35df0bac17db None admin] SCRIPT_NAME: `/identity` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:41:55.892357 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e604e7a0-6097-4049-86b1-35df0bac17db None admin] PATH_INFO: `/v3/projects/service` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:41:55.908291 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e604e7a0-6097-4049-86b1-35df0bac17db None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=82025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:41:55.911206 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e604e7a0-6097-4049-86b1-35df0bac17db None admin] RBAC: Authorization granted {{(pid=82025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:41:55.931960 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application [None req-e604e7a0-6097-4049-86b1-35df0bac17db None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 13 19:41:55.931960 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 19:41:55.931960 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 19:41:55.931960 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 19:41:55.931960 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 19:41:55.931960 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 19:41:55.931960 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 19:41:55.931960 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 19:41:55.931960 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 19:41:55.931960 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 19:41:55.931960 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 19:41:55.931960 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 19:41:55.931960 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 13 19:41:55.931960 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 13 19:41:55.931960 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 13 19:41:55.932863 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 13 19:41:55.932863 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 19:41:55.932863 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 19:41:55.932863 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 19:41:55.932863 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 19:41:55.932863 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 19:41:55.932863 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 19:41:55.932863 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 19:41:55.932863 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application with Lock( Sep 13 19:41:55.932863 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 19:41:55.932863 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application return self._enter() Sep 13 19:41:55.932863 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 19:41:55.932863 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 19:41:55.932863 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 19:41:55.932863 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application return self.creator() Sep 13 19:41:55.932863 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 19:41:55.932863 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application created_value = creator( Sep 13 19:41:55.933712 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 13 19:41:55.933712 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 13 19:41:55.933712 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 13 19:41:55.933712 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 13 19:41:55.933712 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 13 19:41:55.933712 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 13 19:41:55.933712 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 13 19:41:55.933712 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application Sep 13 19:41:55.933712 dv-cinder-828806-6-smb devstack@keystone.service[82025]: [pid: 82025|app: 0|req: 269/539] 10.222.0.33 () {56 vars in 1111 bytes} [Tue Sep 13 19:41:55 2022] GET /identity/v3/projects/service => generated 88 bytes in 223 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 19:41:55.939878 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1132fb98-93a9-4052-871c-6abba7450a4a None admin] Authenticating user token {{(pid=82026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:41:56.055931 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1132fb98-93a9-4052-871c-6abba7450a4a None admin] Validating token access rules against request {{(pid=82026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:41:56.095002 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93c20005-afdc-4bf7-afcb-7af4cd47f1a2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57539b6a6f3b4d589f5f5e1d211cd6a0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:41:56.095661 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93c20005-afdc-4bf7-afcb-7af4cd47f1a2 None admin] REQUEST_METHOD: `GET` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:41:56.095919 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93c20005-afdc-4bf7-afcb-7af4cd47f1a2 None admin] SCRIPT_NAME: `/identity` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:41:56.096202 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93c20005-afdc-4bf7-afcb-7af4cd47f1a2 None admin] PATH_INFO: `/v3/projects` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:41:56.096903 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93c20005-afdc-4bf7-afcb-7af4cd47f1a2 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=82026) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 19:41:56.097217 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93c20005-afdc-4bf7-afcb-7af4cd47f1a2 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=82026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:41:56.098655 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93c20005-afdc-4bf7-afcb-7af4cd47f1a2 None admin] RBAC: Authorization granted {{(pid=82026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:41:56.111820 dv-cinder-828806-6-smb devstack@keystone.service[82026]: [pid: 82026|app: 0|req: 271/540] 10.222.0.33 () {56 vars in 1148 bytes} [Tue Sep 13 19:41:55 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 19:41:56.120217 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e604e7a0-6097-4049-86b1-35df0bac17db None admin] Authenticating user token {{(pid=82025) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:41:56.173235 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG dbcounter [-] [82025] Writing DB stats keystone:SELECT=100 {{(pid=82025) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:41:56.251958 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e604e7a0-6097-4049-86b1-35df0bac17db None admin] Validating token access rules against request {{(pid=82025) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:41:56.256307 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c6d6783-9a3e-4c10-aa68-7c648f467af4 None None] REQUEST_METHOD: `GET` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:41:56.256619 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c6d6783-9a3e-4c10-aa68-7c648f467af4 None None] SCRIPT_NAME: `/identity` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:41:56.256870 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c6d6783-9a3e-4c10-aa68-7c648f467af4 None None] PATH_INFO: `/` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:41:56.258487 dv-cinder-828806-6-smb devstack@keystone.service[82026]: [pid: 82026|app: 0|req: 272/541] 10.222.0.33 () {54 vars in 927 bytes} [Tue Sep 13 19:41:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 19:41:56.263353 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae0119b5-01cf-49d4-8d4e-83701e9ca914 None None] REQUEST_METHOD: `POST` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:41:56.263644 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae0119b5-01cf-49d4-8d4e-83701e9ca914 None None] SCRIPT_NAME: `/identity` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:41:56.263926 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae0119b5-01cf-49d4-8d4e-83701e9ca914 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:41:56.293975 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.auth.core [None req-ae0119b5-01cf-49d4-8d4e-83701e9ca914 None None] MFA Rules not processed for user `57539b6a6f3b4d589f5f5e1d211cd6a0`. Rule list: `[]` (Enabled: `True`). {{(pid=82026) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 19:41:56.295458 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.common.fernet_utils [None req-ae0119b5-01cf-49d4-8d4e-83701e9ca914 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82026) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 19:41:56.320785 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-062da394-9844-46b9-bebf-afb7e25ea3c6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57539b6a6f3b4d589f5f5e1d211cd6a0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82025) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:41:56.321460 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-062da394-9844-46b9-bebf-afb7e25ea3c6 None admin] REQUEST_METHOD: `GET` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:41:56.321775 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-062da394-9844-46b9-bebf-afb7e25ea3c6 None admin] SCRIPT_NAME: `/identity` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:41:56.322031 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-062da394-9844-46b9-bebf-afb7e25ea3c6 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:41:56.322773 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-062da394-9844-46b9-bebf-afb7e25ea3c6 None admin] RBAC: Adding query filter params (role.id=47ee826cd5f148c19f293f9470f906da, scope.project.id=c8c6fba0f15b4d6a84ff601919b7b8e4, user.id=023a2c79c2444611b3d431928e56685d) {{(pid=82025) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 19:41:56.323117 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-062da394-9844-46b9-bebf-afb7e25ea3c6 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=82025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:41:56.324669 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-062da394-9844-46b9-bebf-afb7e25ea3c6 None admin] RBAC: Authorization granted {{(pid=82025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:41:56.331724 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG dbcounter [-] [82026] Writing DB stats keystone:SELECT=100 {{(pid=82026) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:41:56.337102 dv-cinder-828806-6-smb devstack@keystone.service[82025]: [pid: 82025|app: 0|req: 270/542] 10.222.0.33 () {56 vars in 1374 bytes} [Tue Sep 13 19:41:56 2022] GET /identity/v3/role_assignments?user.id=023a2c79c2444611b3d431928e56685d&scope.project.id=c8c6fba0f15b4d6a84ff601919b7b8e4&role.id=47ee826cd5f148c19f293f9470f906da => generated 259 bytes in 217 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 19:41:56.396404 dv-cinder-828806-6-smb devstack@keystone.service[82026]: [pid: 82026|app: 0|req: 273/543] 10.222.0.33 () {58 vars in 1024 bytes} [Tue Sep 13 19:41:56 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 134 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 13 19:41:56.818511 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-062da394-9844-46b9-bebf-afb7e25ea3c6 None admin] Authenticating user token {{(pid=82025) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:41:56.997526 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-062da394-9844-46b9-bebf-afb7e25ea3c6 None admin] Validating token access rules against request {{(pid=82025) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:41:56.999751 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG dbcounter [-] [82025] Writing DB stats keystone:SELECT=100 {{(pid=82025) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:41:57.049315 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d1376bb-2435-4cad-91d9-15f5b70644e8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57539b6a6f3b4d589f5f5e1d211cd6a0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82025) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:41:57.049952 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d1376bb-2435-4cad-91d9-15f5b70644e8 None admin] REQUEST_METHOD: `GET` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:41:57.050237 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d1376bb-2435-4cad-91d9-15f5b70644e8 None admin] SCRIPT_NAME: `/identity` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:41:57.050514 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d1376bb-2435-4cad-91d9-15f5b70644e8 None admin] PATH_INFO: `/v3/roles/service` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:41:57.065395 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d1376bb-2435-4cad-91d9-15f5b70644e8 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=82025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 13 19:41:57.071646 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application [None req-1d1376bb-2435-4cad-91d9-15f5b70644e8 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 13 19:41:57.071646 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 19:41:57.071646 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 19:41:57.071646 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 19:41:57.071646 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 19:41:57.071646 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 19:41:57.071646 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 19:41:57.071646 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 19:41:57.071646 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 19:41:57.071646 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 19:41:57.071646 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 19:41:57.071646 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 19:41:57.071646 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 13 19:41:57.071646 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 13 19:41:57.071646 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 13 19:41:57.071646 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 13 19:41:57.072503 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 13 19:41:57.072503 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 13 19:41:57.072503 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 13 19:41:57.072503 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 13 19:41:57.072503 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 19:41:57.072503 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 19:41:57.072503 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 19:41:57.072503 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 19:41:57.072503 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 19:41:57.072503 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 19:41:57.072503 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 19:41:57.072503 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application with Lock( Sep 13 19:41:57.072503 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 19:41:57.072503 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application return self._enter() Sep 13 19:41:57.072503 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 19:41:57.072503 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 19:41:57.073304 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 19:41:57.073304 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application return self.creator() Sep 13 19:41:57.073304 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 19:41:57.073304 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application created_value = creator( Sep 13 19:41:57.073304 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 13 19:41:57.073304 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 13 19:41:57.073304 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 13 19:41:57.073304 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 13 19:41:57.073304 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 13 19:41:57.073304 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 13 19:41:57.073304 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 13 19:41:57.073304 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application Sep 13 19:41:57.076528 dv-cinder-828806-6-smb devstack@keystone.service[82025]: [pid: 82025|app: 0|req: 271/544] 10.222.0.33 () {56 vars in 1102 bytes} [Tue Sep 13 19:41:56 2022] GET /identity/v3/roles/service => generated 85 bytes in 255 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 19:41:57.079088 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-627eef21-5db3-4bb4-b9f8-3bbcbe8bbda2 None None] REQUEST_METHOD: `GET` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:41:57.079387 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-627eef21-5db3-4bb4-b9f8-3bbcbe8bbda2 None None] SCRIPT_NAME: `/identity` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:41:57.079664 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-627eef21-5db3-4bb4-b9f8-3bbcbe8bbda2 None None] PATH_INFO: `/` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:41:57.080643 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d1376bb-2435-4cad-91d9-15f5b70644e8 None admin] Authenticating user token {{(pid=82025) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:41:57.081275 dv-cinder-828806-6-smb devstack@keystone.service[82026]: [pid: 82026|app: 0|req: 274/545] 10.222.0.33 () {54 vars in 927 bytes} [Tue Sep 13 19:41:57 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 19:41:57.086265 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f0ba640-79d2-49e7-bba3-ad6d73dfd51f None None] REQUEST_METHOD: `POST` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:41:57.086559 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f0ba640-79d2-49e7-bba3-ad6d73dfd51f None None] SCRIPT_NAME: `/identity` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:41:57.086846 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f0ba640-79d2-49e7-bba3-ad6d73dfd51f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:41:57.107387 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.auth.core [None req-1f0ba640-79d2-49e7-bba3-ad6d73dfd51f None None] MFA Rules not processed for user `57539b6a6f3b4d589f5f5e1d211cd6a0`. Rule list: `[]` (Enabled: `True`). {{(pid=82026) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 19:41:57.108616 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.common.fernet_utils [None req-1f0ba640-79d2-49e7-bba3-ad6d73dfd51f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82026) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 19:41:57.187154 dv-cinder-828806-6-smb devstack@keystone.service[82026]: [pid: 82026|app: 0|req: 275/546] 10.222.0.33 () {58 vars in 1024 bytes} [Tue Sep 13 19:41:57 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 13 19:41:57.252162 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d1376bb-2435-4cad-91d9-15f5b70644e8 None admin] Validating token access rules against request {{(pid=82025) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:41:57.328002 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca180c0c-618d-4b95-ae3d-73f455adaed6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57539b6a6f3b4d589f5f5e1d211cd6a0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82025) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:41:57.328543 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca180c0c-618d-4b95-ae3d-73f455adaed6 None admin] REQUEST_METHOD: `GET` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:41:57.328831 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca180c0c-618d-4b95-ae3d-73f455adaed6 None admin] SCRIPT_NAME: `/identity` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:41:57.329098 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca180c0c-618d-4b95-ae3d-73f455adaed6 None admin] PATH_INFO: `/v3/roles` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:41:57.329775 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca180c0c-618d-4b95-ae3d-73f455adaed6 None admin] RBAC: Adding query filter params (name=service) {{(pid=82025) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 19:41:57.330079 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca180c0c-618d-4b95-ae3d-73f455adaed6 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:41:57.331477 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca180c0c-618d-4b95-ae3d-73f455adaed6 None admin] RBAC: Authorization granted {{(pid=82025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:41:57.340448 dv-cinder-828806-6-smb devstack@keystone.service[82025]: [pid: 82025|app: 0|req: 272/547] 10.222.0.33 () {56 vars in 1103 bytes} [Tue Sep 13 19:41:57 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 260 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 19:41:57.346786 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f0ba640-79d2-49e7-bba3-ad6d73dfd51f None None] Authenticating user token {{(pid=82026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:41:57.465348 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG dbcounter [-] [82026] Writing DB stats keystone:SELECT=100 {{(pid=82026) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:41:57.481237 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f0ba640-79d2-49e7-bba3-ad6d73dfd51f None None] Validating token access rules against request {{(pid=82026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:41:57.502037 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca180c0c-618d-4b95-ae3d-73f455adaed6 None admin] Authenticating user token {{(pid=82025) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:41:57.527737 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b08e1977-0655-4e56-9822-7eeed4c3d366 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57539b6a6f3b4d589f5f5e1d211cd6a0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:41:57.528864 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b08e1977-0655-4e56-9822-7eeed4c3d366 None admin] REQUEST_METHOD: `GET` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:41:57.529587 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b08e1977-0655-4e56-9822-7eeed4c3d366 None admin] SCRIPT_NAME: `/identity` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:41:57.530196 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b08e1977-0655-4e56-9822-7eeed4c3d366 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:41:57.543429 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG dbcounter [-] [82025] Writing DB stats keystone:SELECT=100 {{(pid=82025) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:41:57.544417 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b08e1977-0655-4e56-9822-7eeed4c3d366 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=82026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:41:57.546173 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b08e1977-0655-4e56-9822-7eeed4c3d366 None admin] RBAC: Authorization granted {{(pid=82026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:41:57.570352 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application [None req-b08e1977-0655-4e56-9822-7eeed4c3d366 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 13 19:41:57.570352 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 19:41:57.570352 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 19:41:57.570352 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 19:41:57.570352 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 19:41:57.570352 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 19:41:57.570352 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 19:41:57.570352 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 19:41:57.570352 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 19:41:57.570352 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 19:41:57.570352 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 19:41:57.570352 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 19:41:57.570352 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 13 19:41:57.570352 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 13 19:41:57.570352 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 13 19:41:57.570352 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 13 19:41:57.571682 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 19:41:57.571682 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 19:41:57.571682 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 19:41:57.571682 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 19:41:57.571682 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 19:41:57.571682 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 19:41:57.571682 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 19:41:57.571682 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application with Lock( Sep 13 19:41:57.571682 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 19:41:57.571682 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application return self._enter() Sep 13 19:41:57.571682 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 19:41:57.571682 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 19:41:57.571682 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 19:41:57.571682 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application return self.creator() Sep 13 19:41:57.571682 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 19:41:57.571682 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application created_value = creator( Sep 13 19:41:57.571682 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 13 19:41:57.573300 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 13 19:41:57.573300 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 13 19:41:57.573300 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application Sep 13 19:41:57.576172 dv-cinder-828806-6-smb devstack@keystone.service[82026]: [pid: 82026|app: 0|req: 276/548] 10.222.0.33 () {56 vars in 1108 bytes} [Tue Sep 13 19:41:57 2022] GET /identity/v3/domains/Default => generated 87 bytes in 230 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 19:41:57.585937 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b08e1977-0655-4e56-9822-7eeed4c3d366 None admin] Authenticating user token {{(pid=82026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:41:57.662282 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca180c0c-618d-4b95-ae3d-73f455adaed6 None admin] Validating token access rules against request {{(pid=82025) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:41:57.701304 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6f977fe-ff7a-471a-8a4d-d436cc27b7e1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57539b6a6f3b4d589f5f5e1d211cd6a0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82025) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:41:57.701937 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6f977fe-ff7a-471a-8a4d-d436cc27b7e1 None admin] REQUEST_METHOD: `GET` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:41:57.702223 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6f977fe-ff7a-471a-8a4d-d436cc27b7e1 None admin] SCRIPT_NAME: `/identity` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:41:57.702621 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6f977fe-ff7a-471a-8a4d-d436cc27b7e1 None admin] PATH_INFO: `/v3/roles/service` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:41:57.714228 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6f977fe-ff7a-471a-8a4d-d436cc27b7e1 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=82025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 13 19:41:57.720446 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application [None req-f6f977fe-ff7a-471a-8a4d-d436cc27b7e1 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 13 19:41:57.720446 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 19:41:57.720446 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 19:41:57.720446 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 19:41:57.720446 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 19:41:57.720446 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 19:41:57.720446 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 19:41:57.720446 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 19:41:57.720446 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 19:41:57.720446 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 19:41:57.720446 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 19:41:57.720446 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 19:41:57.720446 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 13 19:41:57.720446 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 13 19:41:57.720446 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 13 19:41:57.720446 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 13 19:41:57.721347 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 13 19:41:57.721347 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 13 19:41:57.721347 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 13 19:41:57.721347 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 13 19:41:57.721347 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 19:41:57.721347 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 19:41:57.721347 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 19:41:57.721347 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 19:41:57.721347 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 19:41:57.721347 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 19:41:57.721347 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 19:41:57.721347 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application with Lock( Sep 13 19:41:57.721347 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 19:41:57.721347 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application return self._enter() Sep 13 19:41:57.721347 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 19:41:57.721347 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 19:41:57.722159 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 19:41:57.722159 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application return self.creator() Sep 13 19:41:57.722159 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 19:41:57.722159 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application created_value = creator( Sep 13 19:41:57.722159 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 13 19:41:57.722159 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 13 19:41:57.722159 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 13 19:41:57.722159 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 13 19:41:57.722159 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 13 19:41:57.722159 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 13 19:41:57.722159 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 13 19:41:57.722159 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application Sep 13 19:41:57.726541 dv-cinder-828806-6-smb devstack@keystone.service[82025]: [pid: 82025|app: 0|req: 273/549] 10.222.0.33 () {56 vars in 1102 bytes} [Tue Sep 13 19:41:57 2022] GET /identity/v3/roles/service => generated 85 bytes in 220 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 13 19:41:57.728118 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6f977fe-ff7a-471a-8a4d-d436cc27b7e1 None admin] Authenticating user token {{(pid=82025) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:41:57.774346 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b08e1977-0655-4e56-9822-7eeed4c3d366 None admin] Validating token access rules against request {{(pid=82026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:41:57.810262 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f805e575-8118-4fbd-ba50-ecac0ee13e8b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57539b6a6f3b4d589f5f5e1d211cd6a0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:41:57.811254 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f805e575-8118-4fbd-ba50-ecac0ee13e8b None admin] REQUEST_METHOD: `GET` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:41:57.812307 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f805e575-8118-4fbd-ba50-ecac0ee13e8b None admin] SCRIPT_NAME: `/identity` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:41:57.813021 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f805e575-8118-4fbd-ba50-ecac0ee13e8b None admin] PATH_INFO: `/v3/domains` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:41:57.814002 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f805e575-8118-4fbd-ba50-ecac0ee13e8b None admin] RBAC: Adding query filter params (name=Default) {{(pid=82026) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 19:41:57.814564 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f805e575-8118-4fbd-ba50-ecac0ee13e8b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:41:57.816370 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f805e575-8118-4fbd-ba50-ecac0ee13e8b None admin] RBAC: Authorization granted {{(pid=82026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:41:57.823506 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG dbcounter [-] [82026] Writing DB stats keystone:SELECT=100 {{(pid=82026) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:41:57.823842 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG dbcounter [-] [82025] Writing DB stats keystone:SELECT=100 {{(pid=82025) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:41:57.830788 dv-cinder-828806-6-smb devstack@keystone.service[82026]: [pid: 82026|app: 0|req: 277/550] 10.222.0.33 () {56 vars in 1109 bytes} [Tue Sep 13 19:41:57 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 245 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 19:41:57.836199 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f805e575-8118-4fbd-ba50-ecac0ee13e8b None admin] Authenticating user token {{(pid=82026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:41:57.841656 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6f977fe-ff7a-471a-8a4d-d436cc27b7e1 None admin] Validating token access rules against request {{(pid=82025) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:41:57.902819 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a55aa4c7-2ba7-434b-a441-419f63b2ffdd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57539b6a6f3b4d589f5f5e1d211cd6a0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82025) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:41:57.905208 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a55aa4c7-2ba7-434b-a441-419f63b2ffdd None admin] REQUEST_METHOD: `GET` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:41:57.905531 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a55aa4c7-2ba7-434b-a441-419f63b2ffdd None admin] SCRIPT_NAME: `/identity` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:41:57.906678 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a55aa4c7-2ba7-434b-a441-419f63b2ffdd None admin] PATH_INFO: `/v3/roles` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:41:57.907562 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a55aa4c7-2ba7-434b-a441-419f63b2ffdd None admin] RBAC: Adding query filter params (name=service) {{(pid=82025) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 19:41:57.909206 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a55aa4c7-2ba7-434b-a441-419f63b2ffdd None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:41:57.910629 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a55aa4c7-2ba7-434b-a441-419f63b2ffdd None admin] RBAC: Authorization granted {{(pid=82025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:41:57.933691 dv-cinder-828806-6-smb devstack@keystone.service[82025]: [pid: 82025|app: 0|req: 274/551] 10.222.0.33 () {56 vars in 1103 bytes} [Tue Sep 13 19:41:57 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 19:41:57.940595 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a55aa4c7-2ba7-434b-a441-419f63b2ffdd None admin] Authenticating user token {{(pid=82025) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:41:58.027597 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f805e575-8118-4fbd-ba50-ecac0ee13e8b None admin] Validating token access rules against request {{(pid=82026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:41:58.080267 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3973c59c-198e-4f7a-8742-f91716eace8d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57539b6a6f3b4d589f5f5e1d211cd6a0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:41:58.081269 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3973c59c-198e-4f7a-8742-f91716eace8d None admin] REQUEST_METHOD: `GET` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:41:58.081763 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3973c59c-198e-4f7a-8742-f91716eace8d None admin] SCRIPT_NAME: `/identity` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:41:58.082232 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3973c59c-198e-4f7a-8742-f91716eace8d None admin] PATH_INFO: `/v3/users/swift` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:41:58.090049 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3973c59c-198e-4f7a-8742-f91716eace8d None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=82026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:41:58.091770 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3973c59c-198e-4f7a-8742-f91716eace8d None admin] RBAC: Authorization granted {{(pid=82026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:41:58.104640 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application [None req-3973c59c-198e-4f7a-8742-f91716eace8d None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Sep 13 19:41:58.104640 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 19:41:58.104640 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 19:41:58.104640 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 19:41:58.104640 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 19:41:58.104640 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 19:41:58.104640 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 19:41:58.104640 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 19:41:58.104640 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 19:41:58.104640 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 19:41:58.104640 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 19:41:58.104640 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 19:41:58.104640 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 13 19:41:58.104640 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 13 19:41:58.104640 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 13 19:41:58.104640 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 13 19:41:58.105631 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 19:41:58.105631 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 19:41:58.105631 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 13 19:41:58.105631 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 13 19:41:58.105631 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 13 19:41:58.105631 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 13 19:41:58.105631 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 19:41:58.105631 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 19:41:58.105631 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 19:41:58.105631 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 19:41:58.105631 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 19:41:58.105631 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application with Lock( Sep 13 19:41:58.105631 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 19:41:58.105631 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application return self._enter() Sep 13 19:41:58.105631 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 19:41:58.105631 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 19:41:58.105631 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 19:41:58.105631 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application return self.creator() Sep 13 19:41:58.106552 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 19:41:58.106552 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application created_value = creator( Sep 13 19:41:58.106552 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 13 19:41:58.106552 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 13 19:41:58.106552 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 13 19:41:58.106552 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 13 19:41:58.106552 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 13 19:41:58.106552 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 13 19:41:58.106552 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Sep 13 19:41:58.106552 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application Sep 13 19:41:58.107672 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a55aa4c7-2ba7-434b-a441-419f63b2ffdd None admin] Validating token access rules against request {{(pid=82025) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:41:58.110208 dv-cinder-828806-6-smb devstack@keystone.service[82026]: [pid: 82026|app: 0|req: 278/552] 10.222.0.33 () {56 vars in 1096 bytes} [Tue Sep 13 19:41:57 2022] GET /identity/v3/users/swift => generated 83 bytes in 274 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 13 19:41:58.112070 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19d81b40-6697-486b-853f-330c3cfca65e None None] REQUEST_METHOD: `GET` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:41:58.112555 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19d81b40-6697-486b-853f-330c3cfca65e None None] SCRIPT_NAME: `/identity` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:41:58.113043 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19d81b40-6697-486b-853f-330c3cfca65e None None] PATH_INFO: `/` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:41:58.114720 dv-cinder-828806-6-smb devstack@keystone.service[82026]: [pid: 82026|app: 0|req: 279/553] 10.222.0.33 () {54 vars in 927 bytes} [Tue Sep 13 19:41:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 19:41:58.115678 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19d81b40-6697-486b-853f-330c3cfca65e None None] Authenticating user token {{(pid=82026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:41:58.152524 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0249a97-5c86-4cf3-9f40-99a0577a46f8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57539b6a6f3b4d589f5f5e1d211cd6a0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82025) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:41:58.153153 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0249a97-5c86-4cf3-9f40-99a0577a46f8 None admin] REQUEST_METHOD: `GET` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:41:58.153440 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0249a97-5c86-4cf3-9f40-99a0577a46f8 None admin] SCRIPT_NAME: `/identity` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:41:58.153717 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0249a97-5c86-4cf3-9f40-99a0577a46f8 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:41:58.164998 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0249a97-5c86-4cf3-9f40-99a0577a46f8 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=82025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:41:58.166445 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0249a97-5c86-4cf3-9f40-99a0577a46f8 None admin] RBAC: Authorization granted {{(pid=82025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:41:58.173172 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG dbcounter [-] [82025] Writing DB stats keystone:SELECT=100 {{(pid=82025) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:41:58.180617 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG dbcounter [-] [82026] Writing DB stats keystone:SELECT=100 {{(pid=82026) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:41:58.182665 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application [None req-b0249a97-5c86-4cf3-9f40-99a0577a46f8 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 13 19:41:58.182665 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 19:41:58.182665 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 19:41:58.182665 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 19:41:58.182665 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 19:41:58.182665 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 19:41:58.182665 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 19:41:58.182665 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 19:41:58.182665 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 19:41:58.182665 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 19:41:58.182665 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 19:41:58.182665 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 19:41:58.182665 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 13 19:41:58.182665 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 13 19:41:58.182665 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 13 19:41:58.182665 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 13 19:41:58.183607 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 19:41:58.183607 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 19:41:58.183607 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 19:41:58.183607 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 19:41:58.183607 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 19:41:58.183607 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 19:41:58.183607 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 19:41:58.183607 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application with Lock( Sep 13 19:41:58.183607 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 19:41:58.183607 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application return self._enter() Sep 13 19:41:58.183607 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 19:41:58.183607 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 19:41:58.183607 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 19:41:58.183607 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application return self.creator() Sep 13 19:41:58.183607 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 19:41:58.183607 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application created_value = creator( Sep 13 19:41:58.183607 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 13 19:41:58.184485 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 13 19:41:58.184485 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 13 19:41:58.184485 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application Sep 13 19:41:58.184485 dv-cinder-828806-6-smb devstack@keystone.service[82025]: [pid: 82025|app: 0|req: 275/554] 10.222.0.33 () {56 vars in 1108 bytes} [Tue Sep 13 19:41:57 2022] GET /identity/v3/domains/Default => generated 87 bytes in 243 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 19:41:58.184485 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce871058-9d3f-4c2d-8c36-7a0c82ed1be8 None None] REQUEST_METHOD: `POST` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:41:58.184485 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce871058-9d3f-4c2d-8c36-7a0c82ed1be8 None None] SCRIPT_NAME: `/identity` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:41:58.184818 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce871058-9d3f-4c2d-8c36-7a0c82ed1be8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:41:58.203498 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.auth.core [None req-ce871058-9d3f-4c2d-8c36-7a0c82ed1be8 None None] MFA Rules not processed for user `57539b6a6f3b4d589f5f5e1d211cd6a0`. Rule list: `[]` (Enabled: `True`). {{(pid=82025) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 19:41:58.204705 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.fernet_utils [None req-ce871058-9d3f-4c2d-8c36-7a0c82ed1be8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82025) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 19:41:58.228618 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19d81b40-6697-486b-853f-330c3cfca65e None None] Validating token access rules against request {{(pid=82026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:41:58.266224 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f693b07e-3b41-46c0-ba16-29933874f652 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57539b6a6f3b4d589f5f5e1d211cd6a0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:41:58.266826 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f693b07e-3b41-46c0-ba16-29933874f652 None admin] REQUEST_METHOD: `GET` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:41:58.267145 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f693b07e-3b41-46c0-ba16-29933874f652 None admin] SCRIPT_NAME: `/identity` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:41:58.267426 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f693b07e-3b41-46c0-ba16-29933874f652 None admin] PATH_INFO: `/v3/users` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:41:58.268212 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f693b07e-3b41-46c0-ba16-29933874f652 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=82026) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 19:41:58.268526 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f693b07e-3b41-46c0-ba16-29933874f652 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=82026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:41:58.269949 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f693b07e-3b41-46c0-ba16-29933874f652 None admin] RBAC: Authorization granted {{(pid=82026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:41:58.275991 dv-cinder-828806-6-smb devstack@keystone.service[82025]: [pid: 82025|app: 0|req: 276/555] 10.222.0.33 () {58 vars in 1024 bytes} [Tue Sep 13 19:41:58 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 13 19:41:58.277918 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f79f28c-e6f8-4921-8b56-f6254ee7c3b1 None None] REQUEST_METHOD: `GET` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:41:58.278388 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f79f28c-e6f8-4921-8b56-f6254ee7c3b1 None None] SCRIPT_NAME: `/identity` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:41:58.278852 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f79f28c-e6f8-4921-8b56-f6254ee7c3b1 None None] PATH_INFO: `/` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:41:58.287421 dv-cinder-828806-6-smb devstack@keystone.service[82025]: [pid: 82025|app: 0|req: 277/556] 10.222.0.33 () {54 vars in 927 bytes} [Tue Sep 13 19:41:58 2022] GET /identity => generated 270 bytes in 11 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 19:41:58.288590 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f79f28c-e6f8-4921-8b56-f6254ee7c3b1 None None] Authenticating user token {{(pid=82025) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:41:58.305275 dv-cinder-828806-6-smb devstack@keystone.service[82026]: [pid: 82026|app: 0|req: 280/557] 10.222.0.33 () {56 vars in 1135 bytes} [Tue Sep 13 19:41:58 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 19:41:58.305275 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6b647b3-3fec-4166-b7cf-f1da406ec9f7 None None] REQUEST_METHOD: `POST` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:41:58.305275 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6b647b3-3fec-4166-b7cf-f1da406ec9f7 None None] SCRIPT_NAME: `/identity` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:41:58.305275 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6b647b3-3fec-4166-b7cf-f1da406ec9f7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:41:58.326154 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.auth.core [None req-e6b647b3-3fec-4166-b7cf-f1da406ec9f7 None None] MFA Rules not processed for user `57539b6a6f3b4d589f5f5e1d211cd6a0`. Rule list: `[]` (Enabled: `True`). {{(pid=82026) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 19:41:58.331200 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.common.fernet_utils [None req-e6b647b3-3fec-4166-b7cf-f1da406ec9f7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82026) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 19:41:58.410438 dv-cinder-828806-6-smb devstack@keystone.service[82026]: [pid: 82026|app: 0|req: 281/558] 10.222.0.33 () {58 vars in 1024 bytes} [Tue Sep 13 19:41:58 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 13 19:41:58.411549 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6b647b3-3fec-4166-b7cf-f1da406ec9f7 None None] Authenticating user token {{(pid=82026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:41:58.420522 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f79f28c-e6f8-4921-8b56-f6254ee7c3b1 None None] Validating token access rules against request {{(pid=82025) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:41:58.469904 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG dbcounter [-] [82025] Writing DB stats keystone:SELECT=100 {{(pid=82025) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:41:58.472190 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG dbcounter [-] [82026] Writing DB stats keystone:SELECT=100 {{(pid=82026) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:41:58.491453 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5274d46e-db91-47f5-88be-72cea4588329 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57539b6a6f3b4d589f5f5e1d211cd6a0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82025) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:41:58.497146 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5274d46e-db91-47f5-88be-72cea4588329 None admin] REQUEST_METHOD: `GET` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:41:58.497146 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5274d46e-db91-47f5-88be-72cea4588329 None admin] SCRIPT_NAME: `/identity` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:41:58.497146 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5274d46e-db91-47f5-88be-72cea4588329 None admin] PATH_INFO: `/v3/domains` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:41:58.497146 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5274d46e-db91-47f5-88be-72cea4588329 None admin] RBAC: Adding query filter params (name=Default) {{(pid=82025) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 19:41:58.497146 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5274d46e-db91-47f5-88be-72cea4588329 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:41:58.497146 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5274d46e-db91-47f5-88be-72cea4588329 None admin] RBAC: Authorization granted {{(pid=82025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:41:58.521151 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6b647b3-3fec-4166-b7cf-f1da406ec9f7 None None] Validating token access rules against request {{(pid=82026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:41:58.521332 dv-cinder-828806-6-smb devstack@keystone.service[82025]: [pid: 82025|app: 0|req: 278/559] 10.222.0.33 () {56 vars in 1109 bytes} [Tue Sep 13 19:41:58 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 233 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 19:41:58.527817 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5274d46e-db91-47f5-88be-72cea4588329 None admin] Authenticating user token {{(pid=82025) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:41:58.561729 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05f4ab6e-3f45-4e6e-aa08-b2d9c8360aba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57539b6a6f3b4d589f5f5e1d211cd6a0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:41:58.563972 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05f4ab6e-3f45-4e6e-aa08-b2d9c8360aba None admin] REQUEST_METHOD: `GET` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:41:58.564408 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05f4ab6e-3f45-4e6e-aa08-b2d9c8360aba None admin] SCRIPT_NAME: `/identity` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:41:58.564915 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05f4ab6e-3f45-4e6e-aa08-b2d9c8360aba None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:41:58.655385 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05f4ab6e-3f45-4e6e-aa08-b2d9c8360aba None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=82026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:41:58.659231 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05f4ab6e-3f45-4e6e-aa08-b2d9c8360aba None admin] RBAC: Authorization granted {{(pid=82026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:41:58.697157 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5274d46e-db91-47f5-88be-72cea4588329 None admin] Validating token access rules against request {{(pid=82025) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:41:58.712957 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG dbcounter [-] [82026] Writing DB stats keystone:SELECT=100 {{(pid=82026) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:41:58.739920 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36f2819d-eeb7-4d09-96b2-cb925d6fe270 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57539b6a6f3b4d589f5f5e1d211cd6a0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82025) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:41:58.740867 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36f2819d-eeb7-4d09-96b2-cb925d6fe270 None admin] REQUEST_METHOD: `GET` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:41:58.741293 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36f2819d-eeb7-4d09-96b2-cb925d6fe270 None admin] SCRIPT_NAME: `/identity` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:41:58.741808 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36f2819d-eeb7-4d09-96b2-cb925d6fe270 None admin] PATH_INFO: `/v3/users/nova` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:41:58.750864 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36f2819d-eeb7-4d09-96b2-cb925d6fe270 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=82025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:41:58.753285 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36f2819d-eeb7-4d09-96b2-cb925d6fe270 None admin] RBAC: Authorization granted {{(pid=82025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:41:58.768097 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application [None req-36f2819d-eeb7-4d09-96b2-cb925d6fe270 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Sep 13 19:41:58.768097 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 19:41:58.768097 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 19:41:58.768097 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 19:41:58.768097 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 19:41:58.768097 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 19:41:58.768097 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 19:41:58.768097 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 19:41:58.768097 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 19:41:58.768097 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 19:41:58.768097 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 19:41:58.768097 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 19:41:58.768097 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 13 19:41:58.768097 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 13 19:41:58.768097 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 13 19:41:58.768097 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 13 19:41:58.769257 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 19:41:58.769257 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 19:41:58.769257 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 13 19:41:58.769257 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 13 19:41:58.769257 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 13 19:41:58.769257 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 13 19:41:58.769257 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 19:41:58.769257 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 19:41:58.769257 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 19:41:58.769257 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 19:41:58.769257 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 19:41:58.769257 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application with Lock( Sep 13 19:41:58.769257 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 19:41:58.769257 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application return self._enter() Sep 13 19:41:58.769257 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 19:41:58.769257 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 19:41:58.769257 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 19:41:58.769257 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application return self.creator() Sep 13 19:41:58.770407 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 19:41:58.770407 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application created_value = creator( Sep 13 19:41:58.770407 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 13 19:41:58.770407 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 13 19:41:58.770407 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 13 19:41:58.770407 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 13 19:41:58.770407 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 13 19:41:58.770407 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 13 19:41:58.770407 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Sep 13 19:41:58.770407 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application Sep 13 19:41:58.772772 dv-cinder-828806-6-smb devstack@keystone.service[82025]: [pid: 82025|app: 0|req: 279/560] 10.222.0.33 () {56 vars in 1093 bytes} [Tue Sep 13 19:41:58 2022] GET /identity/v3/users/nova => generated 82 bytes in 245 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 13 19:41:58.773684 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36f2819d-eeb7-4d09-96b2-cb925d6fe270 None admin] Authenticating user token {{(pid=82025) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:41:58.774531 dv-cinder-828806-6-smb devstack@keystone.service[82026]: [pid: 82026|app: 0|req: 282/561] 10.222.0.33 () {58 vars in 1282 bytes} [Tue Sep 13 19:41:58 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 363 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 13 19:41:58.775680 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05f4ab6e-3f45-4e6e-aa08-b2d9c8360aba None admin] Authenticating user token {{(pid=82026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:41:58.830915 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG dbcounter [-] [82025] Writing DB stats keystone:SELECT=100 {{(pid=82025) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:41:58.884126 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05f4ab6e-3f45-4e6e-aa08-b2d9c8360aba None admin] Validating token access rules against request {{(pid=82026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:41:58.898125 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36f2819d-eeb7-4d09-96b2-cb925d6fe270 None admin] Validating token access rules against request {{(pid=82025) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:41:58.926636 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a1c1115-e8dd-4037-b9db-230a0d75b700 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57539b6a6f3b4d589f5f5e1d211cd6a0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:41:58.927325 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a1c1115-e8dd-4037-b9db-230a0d75b700 None admin] REQUEST_METHOD: `GET` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:41:58.927607 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a1c1115-e8dd-4037-b9db-230a0d75b700 None admin] SCRIPT_NAME: `/identity` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:41:58.927882 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a1c1115-e8dd-4037-b9db-230a0d75b700 None admin] PATH_INFO: `/v3/roles/service` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:41:58.939478 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a1c1115-e8dd-4037-b9db-230a0d75b700 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=82026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 13 19:41:58.940923 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00a49cd4-79d8-4191-ab19-f77e5b0b5c67 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57539b6a6f3b4d589f5f5e1d211cd6a0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82025) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:41:58.941773 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00a49cd4-79d8-4191-ab19-f77e5b0b5c67 None admin] REQUEST_METHOD: `GET` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:41:58.942289 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00a49cd4-79d8-4191-ab19-f77e5b0b5c67 None admin] SCRIPT_NAME: `/identity` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:41:58.942760 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00a49cd4-79d8-4191-ab19-f77e5b0b5c67 None admin] PATH_INFO: `/v3/roles/service` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:41:58.944345 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application [None req-4a1c1115-e8dd-4037-b9db-230a0d75b700 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 13 19:41:58.944345 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 19:41:58.944345 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 19:41:58.944345 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 19:41:58.944345 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 19:41:58.944345 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 19:41:58.944345 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 19:41:58.944345 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 19:41:58.944345 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 19:41:58.944345 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 19:41:58.944345 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 19:41:58.944345 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 19:41:58.944345 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 13 19:41:58.944345 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 13 19:41:58.944345 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 13 19:41:58.944345 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 13 19:41:58.945245 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 13 19:41:58.945245 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 13 19:41:58.945245 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 13 19:41:58.945245 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 13 19:41:58.945245 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 19:41:58.945245 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 19:41:58.945245 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 19:41:58.945245 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 19:41:58.945245 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 19:41:58.945245 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 19:41:58.945245 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 19:41:58.945245 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application with Lock( Sep 13 19:41:58.945245 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 19:41:58.945245 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application return self._enter() Sep 13 19:41:58.945245 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 19:41:58.945245 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 19:41:58.946071 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 19:41:58.946071 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application return self.creator() Sep 13 19:41:58.946071 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 19:41:58.946071 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application created_value = creator( Sep 13 19:41:58.946071 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 13 19:41:58.946071 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 13 19:41:58.946071 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 13 19:41:58.946071 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 13 19:41:58.946071 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 13 19:41:58.946071 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 13 19:41:58.946071 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 13 19:41:58.946071 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application Sep 13 19:41:58.946071 dv-cinder-828806-6-smb devstack@keystone.service[82026]: [pid: 82026|app: 0|req: 283/562] 10.222.0.33 () {56 vars in 1102 bytes} [Tue Sep 13 19:41:58 2022] GET /identity/v3/roles/service => generated 85 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 19:41:58.946833 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a1c1115-e8dd-4037-b9db-230a0d75b700 None admin] Authenticating user token {{(pid=82026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:41:58.959067 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG dbcounter [-] [82026] Writing DB stats keystone:SELECT=100 {{(pid=82026) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:41:58.961457 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00a49cd4-79d8-4191-ab19-f77e5b0b5c67 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=82025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 13 19:41:58.966965 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application [None req-00a49cd4-79d8-4191-ab19-f77e5b0b5c67 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 13 19:41:58.966965 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 19:41:58.966965 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 19:41:58.966965 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 19:41:58.966965 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 19:41:58.966965 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 19:41:58.966965 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 19:41:58.966965 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 19:41:58.966965 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 19:41:58.966965 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 19:41:58.966965 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 19:41:58.966965 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 19:41:58.966965 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 13 19:41:58.966965 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 13 19:41:58.966965 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 13 19:41:58.966965 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 13 19:41:58.972691 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 13 19:41:58.972691 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 13 19:41:58.972691 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 13 19:41:58.972691 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 13 19:41:58.972691 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 19:41:58.972691 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 19:41:58.972691 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 19:41:58.972691 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 19:41:58.972691 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 19:41:58.972691 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 19:41:58.972691 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 19:41:58.972691 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application with Lock( Sep 13 19:41:58.972691 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 19:41:58.972691 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application return self._enter() Sep 13 19:41:58.972691 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 19:41:58.972691 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 19:41:58.973703 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 19:41:58.973703 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application return self.creator() Sep 13 19:41:58.973703 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 19:41:58.973703 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application created_value = creator( Sep 13 19:41:58.973703 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 13 19:41:58.973703 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 13 19:41:58.973703 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 13 19:41:58.973703 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 13 19:41:58.973703 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 13 19:41:58.973703 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 13 19:41:58.973703 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 13 19:41:58.973703 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application Sep 13 19:41:58.973703 dv-cinder-828806-6-smb devstack@keystone.service[82025]: [pid: 82025|app: 0|req: 280/563] 10.222.0.33 () {56 vars in 1102 bytes} [Tue Sep 13 19:41:58 2022] GET /identity/v3/roles/service => generated 85 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 19:41:58.973703 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00a49cd4-79d8-4191-ab19-f77e5b0b5c67 None admin] Authenticating user token {{(pid=82025) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:41:59.058848 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a1c1115-e8dd-4037-b9db-230a0d75b700 None admin] Validating token access rules against request {{(pid=82026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:41:59.076425 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00a49cd4-79d8-4191-ab19-f77e5b0b5c67 None admin] Validating token access rules against request {{(pid=82025) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:41:59.085171 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG dbcounter [-] [82025] Writing DB stats keystone:SELECT=100 {{(pid=82025) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:41:59.091176 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e39ac89-7d11-4783-a15f-eb9550de2aab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57539b6a6f3b4d589f5f5e1d211cd6a0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:41:59.091877 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e39ac89-7d11-4783-a15f-eb9550de2aab None admin] REQUEST_METHOD: `GET` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:41:59.092202 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e39ac89-7d11-4783-a15f-eb9550de2aab None admin] SCRIPT_NAME: `/identity` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:41:59.092460 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e39ac89-7d11-4783-a15f-eb9550de2aab None admin] PATH_INFO: `/v3/domains/Default` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:41:59.103148 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e39ac89-7d11-4783-a15f-eb9550de2aab None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=82026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:41:59.104598 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e39ac89-7d11-4783-a15f-eb9550de2aab None admin] RBAC: Authorization granted {{(pid=82026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:41:59.110239 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70c4f9ed-45e4-483c-b256-bc2e7137487d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57539b6a6f3b4d589f5f5e1d211cd6a0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82025) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:41:59.110850 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70c4f9ed-45e4-483c-b256-bc2e7137487d None admin] REQUEST_METHOD: `GET` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:41:59.111180 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70c4f9ed-45e4-483c-b256-bc2e7137487d None admin] SCRIPT_NAME: `/identity` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:41:59.111461 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70c4f9ed-45e4-483c-b256-bc2e7137487d None admin] PATH_INFO: `/v3/users` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:41:59.112191 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70c4f9ed-45e4-483c-b256-bc2e7137487d None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=82025) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 19:41:59.112499 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70c4f9ed-45e4-483c-b256-bc2e7137487d None admin] RBAC: Authorizing `identity:list_users()` {{(pid=82025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:41:59.113921 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70c4f9ed-45e4-483c-b256-bc2e7137487d None admin] RBAC: Authorization granted {{(pid=82025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:41:59.120084 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application [None req-5e39ac89-7d11-4783-a15f-eb9550de2aab None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 13 19:41:59.120084 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 19:41:59.120084 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 19:41:59.120084 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 19:41:59.120084 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 19:41:59.120084 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 19:41:59.120084 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 19:41:59.120084 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 19:41:59.120084 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 19:41:59.120084 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 19:41:59.120084 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 19:41:59.120084 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 19:41:59.120084 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 13 19:41:59.120084 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 13 19:41:59.120084 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 13 19:41:59.120084 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 13 19:41:59.126168 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 19:41:59.126168 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 19:41:59.126168 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 19:41:59.126168 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 19:41:59.126168 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 19:41:59.126168 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 19:41:59.126168 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 19:41:59.126168 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application with Lock( Sep 13 19:41:59.126168 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 19:41:59.126168 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application return self._enter() Sep 13 19:41:59.126168 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 19:41:59.126168 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 19:41:59.126168 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 19:41:59.126168 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application return self.creator() Sep 13 19:41:59.126168 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 19:41:59.126168 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application created_value = creator( Sep 13 19:41:59.126168 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 13 19:41:59.127186 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 13 19:41:59.127186 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 13 19:41:59.127186 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application Sep 13 19:41:59.127186 dv-cinder-828806-6-smb devstack@keystone.service[82026]: [pid: 82026|app: 0|req: 284/564] 10.222.0.33 () {56 vars in 1108 bytes} [Tue Sep 13 19:41:58 2022] GET /identity/v3/domains/Default => generated 87 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 19:41:59.127186 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e39ac89-7d11-4783-a15f-eb9550de2aab None admin] Authenticating user token {{(pid=82026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:41:59.153573 dv-cinder-828806-6-smb devstack@keystone.service[82025]: [pid: 82025|app: 0|req: 281/565] 10.222.0.33 () {56 vars in 1133 bytes} [Tue Sep 13 19:41:58 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 19:41:59.154622 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70c4f9ed-45e4-483c-b256-bc2e7137487d None admin] Authenticating user token {{(pid=82025) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:41:59.180016 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG dbcounter [-] [82026] Writing DB stats keystone:SELECT=100 {{(pid=82026) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:41:59.220916 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e39ac89-7d11-4783-a15f-eb9550de2aab None admin] Validating token access rules against request {{(pid=82026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:41:59.252869 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70c4f9ed-45e4-483c-b256-bc2e7137487d None admin] Validating token access rules against request {{(pid=82025) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:41:59.253022 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b1d6d57-6260-42d6-9878-11624838536c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57539b6a6f3b4d589f5f5e1d211cd6a0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:41:59.253613 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b1d6d57-6260-42d6-9878-11624838536c None admin] REQUEST_METHOD: `GET` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:41:59.253893 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b1d6d57-6260-42d6-9878-11624838536c None admin] SCRIPT_NAME: `/identity` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:41:59.254170 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b1d6d57-6260-42d6-9878-11624838536c None admin] PATH_INFO: `/v3/roles` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:41:59.254825 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b1d6d57-6260-42d6-9878-11624838536c None admin] RBAC: Adding query filter params (name=service) {{(pid=82026) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 19:41:59.255159 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b1d6d57-6260-42d6-9878-11624838536c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:41:59.256525 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b1d6d57-6260-42d6-9878-11624838536c None admin] RBAC: Authorization granted {{(pid=82026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:41:59.264172 dv-cinder-828806-6-smb devstack@keystone.service[82026]: [pid: 82026|app: 0|req: 285/566] 10.222.0.33 () {56 vars in 1103 bytes} [Tue Sep 13 19:41:59 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 19:41:59.265621 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f57fccea-ec3d-4812-8bb0-bcd38f304e92 None None] REQUEST_METHOD: `GET` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:41:59.265985 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f57fccea-ec3d-4812-8bb0-bcd38f304e92 None None] SCRIPT_NAME: `/identity` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:41:59.266198 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f57fccea-ec3d-4812-8bb0-bcd38f304e92 None None] PATH_INFO: `/` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:41:59.267588 dv-cinder-828806-6-smb devstack@keystone.service[82026]: [pid: 82026|app: 0|req: 286/567] 10.222.0.33 () {54 vars in 927 bytes} [Tue Sep 13 19:41:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 19:41:59.268113 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f57fccea-ec3d-4812-8bb0-bcd38f304e92 None None] Authenticating user token {{(pid=82026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:41:59.291259 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00ee9122-d087-4674-a4bb-a33a0a9a9b5d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57539b6a6f3b4d589f5f5e1d211cd6a0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82025) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:41:59.291876 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00ee9122-d087-4674-a4bb-a33a0a9a9b5d None admin] REQUEST_METHOD: `GET` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:41:59.292160 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00ee9122-d087-4674-a4bb-a33a0a9a9b5d None admin] SCRIPT_NAME: `/identity` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:41:59.292442 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00ee9122-d087-4674-a4bb-a33a0a9a9b5d None admin] PATH_INFO: `/v3/roles` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:41:59.293114 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00ee9122-d087-4674-a4bb-a33a0a9a9b5d None admin] RBAC: Adding query filter params (name=service) {{(pid=82025) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 19:41:59.293420 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00ee9122-d087-4674-a4bb-a33a0a9a9b5d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:41:59.294778 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00ee9122-d087-4674-a4bb-a33a0a9a9b5d None admin] RBAC: Authorization granted {{(pid=82025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:41:59.303630 dv-cinder-828806-6-smb devstack@keystone.service[82025]: [pid: 82025|app: 0|req: 282/568] 10.222.0.33 () {56 vars in 1103 bytes} [Tue Sep 13 19:41:59 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 19:41:59.304467 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00ee9122-d087-4674-a4bb-a33a0a9a9b5d None admin] Authenticating user token {{(pid=82025) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:41:59.334763 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG dbcounter [-] [82025] Writing DB stats keystone:SELECT=100 {{(pid=82025) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:41:59.375298 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f57fccea-ec3d-4812-8bb0-bcd38f304e92 None None] Validating token access rules against request {{(pid=82026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:41:59.394916 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG dbcounter [-] [82026] Writing DB stats keystone:SELECT=100 {{(pid=82026) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:41:59.405025 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00ee9122-d087-4674-a4bb-a33a0a9a9b5d None admin] Validating token access rules against request {{(pid=82025) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:41:59.409742 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b95ea3f4-88ab-4fc4-b61c-1e674afc7eef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57539b6a6f3b4d589f5f5e1d211cd6a0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:41:59.410347 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b95ea3f4-88ab-4fc4-b61c-1e674afc7eef None admin] REQUEST_METHOD: `GET` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:41:59.410629 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b95ea3f4-88ab-4fc4-b61c-1e674afc7eef None admin] SCRIPT_NAME: `/identity` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:41:59.410902 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b95ea3f4-88ab-4fc4-b61c-1e674afc7eef None admin] PATH_INFO: `/v3/domains` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:41:59.411583 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b95ea3f4-88ab-4fc4-b61c-1e674afc7eef None admin] RBAC: Adding query filter params (name=Default) {{(pid=82026) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 19:41:59.411887 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b95ea3f4-88ab-4fc4-b61c-1e674afc7eef None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:41:59.413266 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b95ea3f4-88ab-4fc4-b61c-1e674afc7eef None admin] RBAC: Authorization granted {{(pid=82026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:41:59.430227 dv-cinder-828806-6-smb devstack@keystone.service[82026]: [pid: 82026|app: 0|req: 287/569] 10.222.0.33 () {56 vars in 1109 bytes} [Tue Sep 13 19:41:59 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 19:41:59.430227 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d31c9ad9-f74f-42cb-bcb3-f77fb6ba1174 None None] REQUEST_METHOD: `POST` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:41:59.430227 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d31c9ad9-f74f-42cb-bcb3-f77fb6ba1174 None None] SCRIPT_NAME: `/identity` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:41:59.430227 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d31c9ad9-f74f-42cb-bcb3-f77fb6ba1174 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:41:59.439788 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e7fac15-a010-4f2a-9a2c-8da85bb466b4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57539b6a6f3b4d589f5f5e1d211cd6a0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82025) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:41:59.440415 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e7fac15-a010-4f2a-9a2c-8da85bb466b4 None admin] REQUEST_METHOD: `GET` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:41:59.440706 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e7fac15-a010-4f2a-9a2c-8da85bb466b4 None admin] SCRIPT_NAME: `/identity` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:41:59.440984 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e7fac15-a010-4f2a-9a2c-8da85bb466b4 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:41:59.446320 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.auth.core [None req-d31c9ad9-f74f-42cb-bcb3-f77fb6ba1174 None None] MFA Rules not processed for user `57539b6a6f3b4d589f5f5e1d211cd6a0`. Rule list: `[]` (Enabled: `True`). {{(pid=82026) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 19:41:59.447535 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.common.fernet_utils [None req-d31c9ad9-f74f-42cb-bcb3-f77fb6ba1174 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82026) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 19:41:59.451415 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e7fac15-a010-4f2a-9a2c-8da85bb466b4 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=82025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:41:59.453657 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e7fac15-a010-4f2a-9a2c-8da85bb466b4 None admin] RBAC: Authorization granted {{(pid=82025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:41:59.467621 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application [None req-0e7fac15-a010-4f2a-9a2c-8da85bb466b4 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 13 19:41:59.467621 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 19:41:59.467621 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 19:41:59.467621 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 19:41:59.467621 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 19:41:59.467621 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 19:41:59.467621 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 19:41:59.467621 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 19:41:59.467621 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 19:41:59.467621 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 19:41:59.467621 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 19:41:59.467621 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 19:41:59.467621 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 13 19:41:59.467621 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 13 19:41:59.467621 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 13 19:41:59.467621 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 13 19:41:59.469201 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 19:41:59.469201 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 19:41:59.469201 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 19:41:59.469201 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 19:41:59.469201 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 19:41:59.469201 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 19:41:59.469201 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 19:41:59.469201 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application with Lock( Sep 13 19:41:59.469201 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 19:41:59.469201 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application return self._enter() Sep 13 19:41:59.469201 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 19:41:59.469201 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 19:41:59.469201 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 19:41:59.469201 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application return self.creator() Sep 13 19:41:59.469201 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 19:41:59.469201 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application created_value = creator( Sep 13 19:41:59.469201 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 13 19:41:59.470090 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 13 19:41:59.470090 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 13 19:41:59.470090 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application Sep 13 19:41:59.470090 dv-cinder-828806-6-smb devstack@keystone.service[82025]: [pid: 82025|app: 0|req: 283/570] 10.222.0.33 () {56 vars in 1108 bytes} [Tue Sep 13 19:41:59 2022] GET /identity/v3/domains/Default => generated 87 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 19:41:59.470441 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e7fac15-a010-4f2a-9a2c-8da85bb466b4 None admin] Authenticating user token {{(pid=82025) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:41:59.514546 dv-cinder-828806-6-smb devstack@keystone.service[82026]: [pid: 82026|app: 0|req: 288/571] 10.222.0.33 () {58 vars in 1024 bytes} [Tue Sep 13 19:41:59 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 13 19:41:59.515936 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d31c9ad9-f74f-42cb-bcb3-f77fb6ba1174 None None] Authenticating user token {{(pid=82026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:41:59.556715 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG dbcounter [-] [82025] Writing DB stats keystone:SELECT=100 {{(pid=82025) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:41:59.576989 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e7fac15-a010-4f2a-9a2c-8da85bb466b4 None admin] Validating token access rules against request {{(pid=82025) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:41:59.612818 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2646ca0c-37a3-4ecb-8394-fbc8c7e44e90 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57539b6a6f3b4d589f5f5e1d211cd6a0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82025) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:41:59.613446 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2646ca0c-37a3-4ecb-8394-fbc8c7e44e90 None admin] REQUEST_METHOD: `GET` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:41:59.613728 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2646ca0c-37a3-4ecb-8394-fbc8c7e44e90 None admin] SCRIPT_NAME: `/identity` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:41:59.614005 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2646ca0c-37a3-4ecb-8394-fbc8c7e44e90 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:41:59.615222 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d31c9ad9-f74f-42cb-bcb3-f77fb6ba1174 None None] Validating token access rules against request {{(pid=82026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:41:59.626036 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG dbcounter [-] [82026] Writing DB stats keystone:SELECT=100 {{(pid=82026) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:41:59.626414 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2646ca0c-37a3-4ecb-8394-fbc8c7e44e90 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=82025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:41:59.628195 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2646ca0c-37a3-4ecb-8394-fbc8c7e44e90 None admin] RBAC: Authorization granted {{(pid=82025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:41:59.647881 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application [None req-2646ca0c-37a3-4ecb-8394-fbc8c7e44e90 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 13 19:41:59.647881 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 19:41:59.647881 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 19:41:59.647881 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 19:41:59.647881 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 19:41:59.647881 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 19:41:59.647881 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 19:41:59.647881 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 19:41:59.647881 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 19:41:59.647881 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 19:41:59.647881 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 19:41:59.647881 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 19:41:59.647881 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 13 19:41:59.647881 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 13 19:41:59.647881 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 13 19:41:59.647881 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 13 19:41:59.648880 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 19:41:59.648880 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 19:41:59.648880 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 19:41:59.648880 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 19:41:59.648880 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 19:41:59.648880 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 19:41:59.648880 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 19:41:59.648880 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application with Lock( Sep 13 19:41:59.648880 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 19:41:59.648880 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application return self._enter() Sep 13 19:41:59.648880 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 19:41:59.648880 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 19:41:59.648880 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 19:41:59.648880 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application return self.creator() Sep 13 19:41:59.648880 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 19:41:59.648880 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application created_value = creator( Sep 13 19:41:59.648880 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 13 19:41:59.649775 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 13 19:41:59.649775 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 13 19:41:59.649775 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application Sep 13 19:41:59.649775 dv-cinder-828806-6-smb devstack@keystone.service[82025]: [pid: 82025|app: 0|req: 284/572] 10.222.0.33 () {56 vars in 1108 bytes} [Tue Sep 13 19:41:59 2022] GET /identity/v3/domains/Default => generated 87 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 19:41:59.649775 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2646ca0c-37a3-4ecb-8394-fbc8c7e44e90 None admin] Authenticating user token {{(pid=82025) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:41:59.656436 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc4823c2-ad94-4fdf-b01b-f78477fe83fe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57539b6a6f3b4d589f5f5e1d211cd6a0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:41:59.657185 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc4823c2-ad94-4fdf-b01b-f78477fe83fe None admin] REQUEST_METHOD: `GET` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:41:59.657523 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc4823c2-ad94-4fdf-b01b-f78477fe83fe None admin] SCRIPT_NAME: `/identity` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:41:59.658229 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc4823c2-ad94-4fdf-b01b-f78477fe83fe None admin] PATH_INFO: `/v3/domains/Default` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:41:59.669318 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc4823c2-ad94-4fdf-b01b-f78477fe83fe None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=82026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:41:59.670989 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc4823c2-ad94-4fdf-b01b-f78477fe83fe None admin] RBAC: Authorization granted {{(pid=82026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:41:59.686114 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application [None req-cc4823c2-ad94-4fdf-b01b-f78477fe83fe None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 13 19:41:59.686114 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 19:41:59.686114 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 19:41:59.686114 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 19:41:59.686114 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 19:41:59.686114 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 19:41:59.686114 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 19:41:59.686114 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 19:41:59.686114 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 19:41:59.686114 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 19:41:59.686114 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 19:41:59.686114 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 19:41:59.686114 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 13 19:41:59.686114 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 13 19:41:59.686114 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 13 19:41:59.686114 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 13 19:41:59.687245 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 19:41:59.687245 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 19:41:59.687245 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 19:41:59.687245 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 19:41:59.687245 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 19:41:59.687245 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 19:41:59.687245 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 19:41:59.687245 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application with Lock( Sep 13 19:41:59.687245 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 19:41:59.687245 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application return self._enter() Sep 13 19:41:59.687245 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 19:41:59.687245 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 19:41:59.687245 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 19:41:59.687245 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application return self.creator() Sep 13 19:41:59.687245 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 19:41:59.687245 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application created_value = creator( Sep 13 19:41:59.687245 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 13 19:41:59.688335 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 13 19:41:59.688335 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 13 19:41:59.688335 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application Sep 13 19:41:59.688335 dv-cinder-828806-6-smb devstack@keystone.service[82026]: [pid: 82026|app: 0|req: 289/573] 10.222.0.33 () {56 vars in 1108 bytes} [Tue Sep 13 19:41:59 2022] GET /identity/v3/domains/Default => generated 87 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 19:41:59.688579 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc4823c2-ad94-4fdf-b01b-f78477fe83fe None admin] Authenticating user token {{(pid=82026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:41:59.760562 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2646ca0c-37a3-4ecb-8394-fbc8c7e44e90 None admin] Validating token access rules against request {{(pid=82025) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:41:59.791781 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc4823c2-ad94-4fdf-b01b-f78477fe83fe None admin] Validating token access rules against request {{(pid=82026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:41:59.793280 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG dbcounter [-] [82025] Writing DB stats keystone:SELECT=100 {{(pid=82025) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:41:59.798998 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d5d8635-adbf-4635-b43b-c10a1a254535 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57539b6a6f3b4d589f5f5e1d211cd6a0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82025) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:41:59.799690 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d5d8635-adbf-4635-b43b-c10a1a254535 None admin] REQUEST_METHOD: `GET` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:41:59.799975 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d5d8635-adbf-4635-b43b-c10a1a254535 None admin] SCRIPT_NAME: `/identity` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:41:59.800252 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d5d8635-adbf-4635-b43b-c10a1a254535 None admin] PATH_INFO: `/v3/projects/service` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:41:59.807759 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d5d8635-adbf-4635-b43b-c10a1a254535 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=82025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:41:59.809212 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d5d8635-adbf-4635-b43b-c10a1a254535 None admin] RBAC: Authorization granted {{(pid=82025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:41:59.820546 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application [None req-7d5d8635-adbf-4635-b43b-c10a1a254535 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 13 19:41:59.820546 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 19:41:59.820546 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 19:41:59.820546 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 19:41:59.820546 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 19:41:59.820546 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 19:41:59.820546 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 19:41:59.820546 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 19:41:59.820546 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 19:41:59.820546 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 19:41:59.820546 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 19:41:59.820546 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 19:41:59.820546 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 13 19:41:59.820546 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 13 19:41:59.820546 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 13 19:41:59.821608 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 13 19:41:59.821608 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 19:41:59.821608 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 19:41:59.821608 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 19:41:59.821608 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 19:41:59.821608 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 19:41:59.821608 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 19:41:59.821608 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 19:41:59.821608 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application with Lock( Sep 13 19:41:59.821608 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 19:41:59.821608 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application return self._enter() Sep 13 19:41:59.821608 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 19:41:59.821608 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 19:41:59.821608 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 19:41:59.821608 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application return self.creator() Sep 13 19:41:59.821608 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 19:41:59.821608 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application created_value = creator( Sep 13 19:41:59.822509 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 13 19:41:59.822509 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 13 19:41:59.822509 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 13 19:41:59.822509 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 13 19:41:59.822509 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 13 19:41:59.822509 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 13 19:41:59.822509 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 13 19:41:59.822509 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application Sep 13 19:41:59.825711 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5b1f632-d167-4f3c-942c-9c92cc865039 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57539b6a6f3b4d589f5f5e1d211cd6a0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:41:59.826373 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5b1f632-d167-4f3c-942c-9c92cc865039 None admin] REQUEST_METHOD: `GET` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:41:59.826672 dv-cinder-828806-6-smb devstack@keystone.service[82025]: [pid: 82025|app: 0|req: 285/574] 10.222.0.33 () {56 vars in 1111 bytes} [Tue Sep 13 19:41:59 2022] GET /identity/v3/projects/service => generated 88 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 19:41:59.826793 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5b1f632-d167-4f3c-942c-9c92cc865039 None admin] SCRIPT_NAME: `/identity` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:41:59.826881 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5b1f632-d167-4f3c-942c-9c92cc865039 None admin] PATH_INFO: `/v3/domains` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:41:59.827441 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d5d8635-adbf-4635-b43b-c10a1a254535 None admin] Authenticating user token {{(pid=82025) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:41:59.827597 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5b1f632-d167-4f3c-942c-9c92cc865039 None admin] RBAC: Adding query filter params (name=Default) {{(pid=82026) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 19:41:59.827838 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5b1f632-d167-4f3c-942c-9c92cc865039 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:41:59.829190 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5b1f632-d167-4f3c-942c-9c92cc865039 None admin] RBAC: Authorization granted {{(pid=82026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:41:59.840676 dv-cinder-828806-6-smb devstack@keystone.service[82026]: [pid: 82026|app: 0|req: 290/575] 10.222.0.33 () {56 vars in 1109 bytes} [Tue Sep 13 19:41:59 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 19:41:59.841481 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5b1f632-d167-4f3c-942c-9c92cc865039 None admin] Authenticating user token {{(pid=82026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:41:59.865373 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG dbcounter [-] [82026] Writing DB stats keystone:SELECT=100 {{(pid=82026) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:41:59.930272 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d5d8635-adbf-4635-b43b-c10a1a254535 None admin] Validating token access rules against request {{(pid=82025) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:41:59.942546 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5b1f632-d167-4f3c-942c-9c92cc865039 None admin] Validating token access rules against request {{(pid=82026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:41:59.962760 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06a925cc-6e03-4572-9e41-8294626a1379 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57539b6a6f3b4d589f5f5e1d211cd6a0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82025) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:41:59.963395 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06a925cc-6e03-4572-9e41-8294626a1379 None admin] REQUEST_METHOD: `GET` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:41:59.963681 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06a925cc-6e03-4572-9e41-8294626a1379 None admin] SCRIPT_NAME: `/identity` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:41:59.963959 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06a925cc-6e03-4572-9e41-8294626a1379 None admin] PATH_INFO: `/v3/domains` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:41:59.964599 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06a925cc-6e03-4572-9e41-8294626a1379 None admin] RBAC: Adding query filter params (name=Default) {{(pid=82025) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 19:41:59.964906 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06a925cc-6e03-4572-9e41-8294626a1379 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:41:59.966264 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06a925cc-6e03-4572-9e41-8294626a1379 None admin] RBAC: Authorization granted {{(pid=82025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:41:59.977333 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb1f5718-e2d6-4cb6-b385-0f8ab7784214 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57539b6a6f3b4d589f5f5e1d211cd6a0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:41:59.977936 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb1f5718-e2d6-4cb6-b385-0f8ab7784214 None admin] REQUEST_METHOD: `GET` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:41:59.978224 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb1f5718-e2d6-4cb6-b385-0f8ab7784214 None admin] SCRIPT_NAME: `/identity` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:41:59.978505 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb1f5718-e2d6-4cb6-b385-0f8ab7784214 None admin] PATH_INFO: `/v3/domains` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:41:59.978591 dv-cinder-828806-6-smb devstack@keystone.service[82025]: [pid: 82025|app: 0|req: 286/576] 10.222.0.33 () {56 vars in 1109 bytes} [Tue Sep 13 19:41:59 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 19:41:59.979182 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb1f5718-e2d6-4cb6-b385-0f8ab7784214 None admin] RBAC: Adding query filter params (name=Default) {{(pid=82026) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 19:41:59.979374 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06a925cc-6e03-4572-9e41-8294626a1379 None admin] Authenticating user token {{(pid=82025) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:41:59.979505 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb1f5718-e2d6-4cb6-b385-0f8ab7784214 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:41:59.980873 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb1f5718-e2d6-4cb6-b385-0f8ab7784214 None admin] RBAC: Authorization granted {{(pid=82026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:41:59.993859 dv-cinder-828806-6-smb devstack@keystone.service[82026]: [pid: 82026|app: 0|req: 291/577] 10.222.0.33 () {56 vars in 1109 bytes} [Tue Sep 13 19:41:59 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 19:41:59.994749 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb1f5718-e2d6-4cb6-b385-0f8ab7784214 None admin] Authenticating user token {{(pid=82026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:42:00.031847 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG dbcounter [-] [82025] Writing DB stats keystone:SELECT=100 {{(pid=82025) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:42:00.077318 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG dbcounter [-] [82026] Writing DB stats keystone:SELECT=100 {{(pid=82026) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:42:00.078326 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06a925cc-6e03-4572-9e41-8294626a1379 None admin] Validating token access rules against request {{(pid=82025) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:42:00.095283 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb1f5718-e2d6-4cb6-b385-0f8ab7784214 None admin] Validating token access rules against request {{(pid=82026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:42:00.113638 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e59f16b-d354-47b6-855f-ccc9e114883b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57539b6a6f3b4d589f5f5e1d211cd6a0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82025) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:42:00.114261 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e59f16b-d354-47b6-855f-ccc9e114883b None admin] REQUEST_METHOD: `GET` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:42:00.114549 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e59f16b-d354-47b6-855f-ccc9e114883b None admin] SCRIPT_NAME: `/identity` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:42:00.114828 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e59f16b-d354-47b6-855f-ccc9e114883b None admin] PATH_INFO: `/v3/roles/service` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:42:00.125355 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e59f16b-d354-47b6-855f-ccc9e114883b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=82025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 13 19:42:00.128244 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86d756e1-af86-44cd-81a0-c992cc76909c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57539b6a6f3b4d589f5f5e1d211cd6a0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:42:00.128846 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86d756e1-af86-44cd-81a0-c992cc76909c None admin] REQUEST_METHOD: `GET` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:42:00.129148 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86d756e1-af86-44cd-81a0-c992cc76909c None admin] SCRIPT_NAME: `/identity` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:42:00.129411 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86d756e1-af86-44cd-81a0-c992cc76909c None admin] PATH_INFO: `/v3/projects` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:42:00.130091 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86d756e1-af86-44cd-81a0-c992cc76909c None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=82026) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 19:42:00.130398 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86d756e1-af86-44cd-81a0-c992cc76909c None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=82026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:42:00.130711 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application [None req-3e59f16b-d354-47b6-855f-ccc9e114883b None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 13 19:42:00.130711 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 19:42:00.130711 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 19:42:00.130711 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 19:42:00.130711 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 19:42:00.130711 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 19:42:00.130711 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 19:42:00.130711 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 19:42:00.130711 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 19:42:00.130711 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 19:42:00.130711 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 19:42:00.130711 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 19:42:00.130711 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 13 19:42:00.130711 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 13 19:42:00.130711 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 13 19:42:00.130711 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 13 19:42:00.131824 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 13 19:42:00.131824 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 13 19:42:00.131824 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 13 19:42:00.131824 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 13 19:42:00.131824 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 19:42:00.131824 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 19:42:00.131824 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 19:42:00.131824 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 19:42:00.131824 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 19:42:00.131824 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 19:42:00.131824 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 19:42:00.131824 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application with Lock( Sep 13 19:42:00.131824 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 19:42:00.131824 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application return self._enter() Sep 13 19:42:00.131824 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 19:42:00.131824 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 19:42:00.135973 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 19:42:00.135973 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application return self.creator() Sep 13 19:42:00.135973 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 19:42:00.135973 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application created_value = creator( Sep 13 19:42:00.135973 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 13 19:42:00.135973 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 13 19:42:00.135973 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 13 19:42:00.135973 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 13 19:42:00.135973 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 13 19:42:00.135973 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 13 19:42:00.135973 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 13 19:42:00.135973 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application Sep 13 19:42:00.136613 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86d756e1-af86-44cd-81a0-c992cc76909c None admin] RBAC: Authorization granted {{(pid=82026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:42:00.136689 dv-cinder-828806-6-smb devstack@keystone.service[82025]: [pid: 82025|app: 0|req: 287/578] 10.222.0.33 () {56 vars in 1102 bytes} [Tue Sep 13 19:41:59 2022] GET /identity/v3/roles/service => generated 85 bytes in 153 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 19:42:00.136689 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e59f16b-d354-47b6-855f-ccc9e114883b None admin] Authenticating user token {{(pid=82025) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:42:00.144839 dv-cinder-828806-6-smb devstack@keystone.service[82026]: [pid: 82026|app: 0|req: 292/579] 10.222.0.33 () {56 vars in 1148 bytes} [Tue Sep 13 19:41:59 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 19:42:00.146147 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86d756e1-af86-44cd-81a0-c992cc76909c None admin] Authenticating user token {{(pid=82026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:42:00.235584 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e59f16b-d354-47b6-855f-ccc9e114883b None admin] Validating token access rules against request {{(pid=82025) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:42:00.244882 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86d756e1-af86-44cd-81a0-c992cc76909c None admin] Validating token access rules against request {{(pid=82026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:42:00.248356 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG dbcounter [-] [82025] Writing DB stats keystone:SELECT=100 {{(pid=82025) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:42:00.269893 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9f92338-24d3-4cd0-bead-1b5cdbf52662 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57539b6a6f3b4d589f5f5e1d211cd6a0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82025) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:42:00.270517 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9f92338-24d3-4cd0-bead-1b5cdbf52662 None admin] REQUEST_METHOD: `GET` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:42:00.270807 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9f92338-24d3-4cd0-bead-1b5cdbf52662 None admin] SCRIPT_NAME: `/identity` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:42:00.271117 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9f92338-24d3-4cd0-bead-1b5cdbf52662 None admin] PATH_INFO: `/v3/projects/service` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:42:00.277657 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9f92338-24d3-4cd0-bead-1b5cdbf52662 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=82025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:42:00.278643 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abd8fba9-abf2-4f63-aac4-9d48aae4ed21 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57539b6a6f3b4d589f5f5e1d211cd6a0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:42:00.279132 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9f92338-24d3-4cd0-bead-1b5cdbf52662 None admin] RBAC: Authorization granted {{(pid=82025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:42:00.279321 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abd8fba9-abf2-4f63-aac4-9d48aae4ed21 None admin] REQUEST_METHOD: `GET` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:42:00.279572 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abd8fba9-abf2-4f63-aac4-9d48aae4ed21 None admin] SCRIPT_NAME: `/identity` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:42:00.279967 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abd8fba9-abf2-4f63-aac4-9d48aae4ed21 None admin] PATH_INFO: `/v3/users/cinder` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:42:00.288521 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abd8fba9-abf2-4f63-aac4-9d48aae4ed21 None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=82026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:42:00.289947 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abd8fba9-abf2-4f63-aac4-9d48aae4ed21 None admin] RBAC: Authorization granted {{(pid=82026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:42:00.293074 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application [None req-f9f92338-24d3-4cd0-bead-1b5cdbf52662 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 13 19:42:00.293074 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 19:42:00.293074 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 19:42:00.293074 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 19:42:00.293074 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 19:42:00.293074 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 19:42:00.293074 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 19:42:00.293074 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 19:42:00.293074 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 19:42:00.293074 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 19:42:00.293074 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 19:42:00.293074 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 19:42:00.293074 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 13 19:42:00.293074 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 13 19:42:00.293074 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 13 19:42:00.294133 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 13 19:42:00.294133 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 19:42:00.294133 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 19:42:00.294133 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 19:42:00.294133 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 19:42:00.294133 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 19:42:00.294133 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 19:42:00.294133 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 19:42:00.294133 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application with Lock( Sep 13 19:42:00.294133 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 19:42:00.294133 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application return self._enter() Sep 13 19:42:00.294133 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 19:42:00.294133 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 19:42:00.294133 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 19:42:00.294133 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application return self.creator() Sep 13 19:42:00.294133 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 19:42:00.294133 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application created_value = creator( Sep 13 19:42:00.295177 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 13 19:42:00.295177 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 13 19:42:00.295177 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 13 19:42:00.295177 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 13 19:42:00.295177 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 13 19:42:00.295177 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 13 19:42:00.295177 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 13 19:42:00.295177 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application Sep 13 19:42:00.295177 dv-cinder-828806-6-smb devstack@keystone.service[82025]: [pid: 82025|app: 0|req: 288/580] 10.222.0.33 () {56 vars in 1111 bytes} [Tue Sep 13 19:42:00 2022] GET /identity/v3/projects/service => generated 88 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 19:42:00.295177 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9f92338-24d3-4cd0-bead-1b5cdbf52662 None admin] Authenticating user token {{(pid=82025) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:42:00.301812 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application [None req-abd8fba9-abf2-4f63-aac4-9d48aae4ed21 None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Sep 13 19:42:00.301812 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 19:42:00.301812 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 19:42:00.301812 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 19:42:00.301812 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 19:42:00.301812 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 19:42:00.301812 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 19:42:00.301812 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 19:42:00.301812 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 19:42:00.301812 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 19:42:00.301812 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 19:42:00.301812 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 19:42:00.301812 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 13 19:42:00.301812 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 13 19:42:00.301812 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 13 19:42:00.301812 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 13 19:42:00.302779 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 19:42:00.302779 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 19:42:00.302779 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 13 19:42:00.302779 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 13 19:42:00.302779 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 13 19:42:00.302779 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 13 19:42:00.302779 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 19:42:00.302779 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 19:42:00.302779 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 19:42:00.302779 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 19:42:00.302779 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 19:42:00.302779 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application with Lock( Sep 13 19:42:00.302779 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 19:42:00.302779 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application return self._enter() Sep 13 19:42:00.302779 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 19:42:00.302779 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 19:42:00.302779 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 19:42:00.302779 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application return self.creator() Sep 13 19:42:00.308955 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 19:42:00.308955 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application created_value = creator( Sep 13 19:42:00.308955 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 13 19:42:00.308955 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 13 19:42:00.308955 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 13 19:42:00.308955 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 13 19:42:00.308955 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 13 19:42:00.308955 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 13 19:42:00.308955 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Sep 13 19:42:00.308955 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application Sep 13 19:42:00.308955 dv-cinder-828806-6-smb devstack@keystone.service[82026]: [pid: 82026|app: 0|req: 293/581] 10.222.0.33 () {56 vars in 1099 bytes} [Tue Sep 13 19:42:00 2022] GET /identity/v3/users/cinder => generated 84 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 19:42:00.308955 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abd8fba9-abf2-4f63-aac4-9d48aae4ed21 None admin] Authenticating user token {{(pid=82026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:42:00.308955 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG dbcounter [-] [82026] Writing DB stats keystone:SELECT=100 {{(pid=82026) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:42:00.395822 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9f92338-24d3-4cd0-bead-1b5cdbf52662 None admin] Validating token access rules against request {{(pid=82025) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:42:00.404639 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abd8fba9-abf2-4f63-aac4-9d48aae4ed21 None admin] Validating token access rules against request {{(pid=82026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:42:00.429493 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-216fdc9f-6c43-4d88-9fb2-c7f41658a332 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57539b6a6f3b4d589f5f5e1d211cd6a0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82025) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:42:00.430117 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-216fdc9f-6c43-4d88-9fb2-c7f41658a332 None admin] REQUEST_METHOD: `GET` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:42:00.430406 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-216fdc9f-6c43-4d88-9fb2-c7f41658a332 None admin] SCRIPT_NAME: `/identity` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:42:00.430688 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-216fdc9f-6c43-4d88-9fb2-c7f41658a332 None admin] PATH_INFO: `/v3/users/glance` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:42:00.437880 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd3e4997-e909-4e1c-8d9a-105bdd539b5b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57539b6a6f3b4d589f5f5e1d211cd6a0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:42:00.438485 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd3e4997-e909-4e1c-8d9a-105bdd539b5b None admin] REQUEST_METHOD: `GET` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:42:00.438736 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-216fdc9f-6c43-4d88-9fb2-c7f41658a332 None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=82025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:42:00.438836 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd3e4997-e909-4e1c-8d9a-105bdd539b5b None admin] SCRIPT_NAME: `/identity` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:42:00.439028 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd3e4997-e909-4e1c-8d9a-105bdd539b5b None admin] PATH_INFO: `/v3/roles` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:42:00.439710 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd3e4997-e909-4e1c-8d9a-105bdd539b5b None admin] RBAC: Adding query filter params (name=service) {{(pid=82026) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 19:42:00.440018 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd3e4997-e909-4e1c-8d9a-105bdd539b5b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:42:00.440233 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-216fdc9f-6c43-4d88-9fb2-c7f41658a332 None admin] RBAC: Authorization granted {{(pid=82025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:42:00.441373 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd3e4997-e909-4e1c-8d9a-105bdd539b5b None admin] RBAC: Authorization granted {{(pid=82026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:42:00.449260 dv-cinder-828806-6-smb devstack@keystone.service[82026]: [pid: 82026|app: 0|req: 294/582] 10.222.0.33 () {56 vars in 1103 bytes} [Tue Sep 13 19:42:00 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 19:42:00.449936 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd3e4997-e909-4e1c-8d9a-105bdd539b5b None admin] Authenticating user token {{(pid=82026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:42:00.451781 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application [None req-216fdc9f-6c43-4d88-9fb2-c7f41658a332 None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Sep 13 19:42:00.451781 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 19:42:00.451781 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 19:42:00.451781 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 19:42:00.451781 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 19:42:00.451781 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 19:42:00.451781 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 19:42:00.451781 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 19:42:00.451781 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 19:42:00.451781 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 19:42:00.451781 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 19:42:00.451781 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 19:42:00.451781 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 13 19:42:00.451781 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 13 19:42:00.451781 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 13 19:42:00.451781 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 13 19:42:00.452666 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 19:42:00.452666 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 19:42:00.452666 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 13 19:42:00.452666 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 13 19:42:00.452666 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 13 19:42:00.452666 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 13 19:42:00.452666 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 19:42:00.452666 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 19:42:00.452666 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 19:42:00.452666 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 19:42:00.452666 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 19:42:00.452666 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application with Lock( Sep 13 19:42:00.452666 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 19:42:00.452666 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application return self._enter() Sep 13 19:42:00.452666 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 19:42:00.452666 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 19:42:00.452666 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 19:42:00.452666 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application return self.creator() Sep 13 19:42:00.453610 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 19:42:00.453610 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application created_value = creator( Sep 13 19:42:00.453610 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 13 19:42:00.453610 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 13 19:42:00.453610 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 13 19:42:00.453610 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 13 19:42:00.453610 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 13 19:42:00.453610 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 13 19:42:00.453610 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. Sep 13 19:42:00.453610 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application Sep 13 19:42:00.457390 dv-cinder-828806-6-smb devstack@keystone.service[82025]: [pid: 82025|app: 0|req: 289/583] 10.222.0.33 () {56 vars in 1099 bytes} [Tue Sep 13 19:42:00 2022] GET /identity/v3/users/glance => generated 84 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 19:42:00.458112 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-216fdc9f-6c43-4d88-9fb2-c7f41658a332 None admin] Authenticating user token {{(pid=82025) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:42:00.490554 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG dbcounter [-] [82025] Writing DB stats keystone:SELECT=100 {{(pid=82025) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:42:00.513658 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG dbcounter [-] [82026] Writing DB stats keystone:SELECT=100 {{(pid=82026) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:42:00.551640 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd3e4997-e909-4e1c-8d9a-105bdd539b5b None admin] Validating token access rules against request {{(pid=82026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:42:00.558852 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-216fdc9f-6c43-4d88-9fb2-c7f41658a332 None admin] Validating token access rules against request {{(pid=82025) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:42:00.587476 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adb28b80-4cf3-4180-b310-bbcdeb978681 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57539b6a6f3b4d589f5f5e1d211cd6a0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:42:00.588079 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adb28b80-4cf3-4180-b310-bbcdeb978681 None admin] REQUEST_METHOD: `GET` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:42:00.588357 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adb28b80-4cf3-4180-b310-bbcdeb978681 None admin] SCRIPT_NAME: `/identity` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:42:00.588630 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adb28b80-4cf3-4180-b310-bbcdeb978681 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:42:00.589348 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adb28b80-4cf3-4180-b310-bbcdeb978681 None admin] RBAC: Adding query filter params (role.id=47ee826cd5f148c19f293f9470f906da, scope.project.id=c8c6fba0f15b4d6a84ff601919b7b8e4, user.id=fa5a83574f7f424c805e130c462d5969) {{(pid=82026) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 19:42:00.589654 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adb28b80-4cf3-4180-b310-bbcdeb978681 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=82026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:42:00.591120 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adb28b80-4cf3-4180-b310-bbcdeb978681 None admin] RBAC: Authorization granted {{(pid=82026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:42:00.592463 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-282d7e9e-3308-4329-a5c6-e5d180e25657 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57539b6a6f3b4d589f5f5e1d211cd6a0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82025) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:42:00.593590 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-282d7e9e-3308-4329-a5c6-e5d180e25657 None admin] REQUEST_METHOD: `GET` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:42:00.594082 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-282d7e9e-3308-4329-a5c6-e5d180e25657 None admin] SCRIPT_NAME: `/identity` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:42:00.594380 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-282d7e9e-3308-4329-a5c6-e5d180e25657 None admin] PATH_INFO: `/v3/projects` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:42:00.595092 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-282d7e9e-3308-4329-a5c6-e5d180e25657 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=82025) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 19:42:00.595463 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-282d7e9e-3308-4329-a5c6-e5d180e25657 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=82025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:42:00.596884 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-282d7e9e-3308-4329-a5c6-e5d180e25657 None admin] RBAC: Authorization granted {{(pid=82025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:42:00.597264 dv-cinder-828806-6-smb devstack@keystone.service[82026]: [pid: 82026|app: 0|req: 295/584] 10.222.0.33 () {56 vars in 1374 bytes} [Tue Sep 13 19:42:00 2022] GET /identity/v3/role_assignments?user.id=fa5a83574f7f424c805e130c462d5969&scope.project.id=c8c6fba0f15b4d6a84ff601919b7b8e4&role.id=47ee826cd5f148c19f293f9470f906da => generated 259 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 19:42:00.598035 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adb28b80-4cf3-4180-b310-bbcdeb978681 None admin] Authenticating user token {{(pid=82026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:42:00.614808 dv-cinder-828806-6-smb devstack@keystone.service[82025]: [pid: 82025|app: 0|req: 290/585] 10.222.0.33 () {56 vars in 1148 bytes} [Tue Sep 13 19:42:00 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 19:42:00.614808 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-282d7e9e-3308-4329-a5c6-e5d180e25657 None admin] Authenticating user token {{(pid=82025) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:42:00.722280 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG dbcounter [-] [82025] Writing DB stats keystone:SELECT=100 {{(pid=82025) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:42:00.729559 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adb28b80-4cf3-4180-b310-bbcdeb978681 None admin] Validating token access rules against request {{(pid=82026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:42:00.731396 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-282d7e9e-3308-4329-a5c6-e5d180e25657 None admin] Validating token access rules against request {{(pid=82025) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:42:00.760062 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG dbcounter [-] [82026] Writing DB stats keystone:SELECT=100 {{(pid=82026) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:42:00.769127 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06db45ee-467c-4bd9-9b76-bc590c481594 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57539b6a6f3b4d589f5f5e1d211cd6a0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:42:00.769871 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06db45ee-467c-4bd9-9b76-bc590c481594 None admin] REQUEST_METHOD: `GET` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:42:00.770160 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06db45ee-467c-4bd9-9b76-bc590c481594 None admin] SCRIPT_NAME: `/identity` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:42:00.770570 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06db45ee-467c-4bd9-9b76-bc590c481594 None admin] PATH_INFO: `/v3/users` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:42:00.771291 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06db45ee-467c-4bd9-9b76-bc590c481594 None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=82026) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 19:42:00.771604 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06db45ee-467c-4bd9-9b76-bc590c481594 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=82026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:42:00.772505 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b93f17cb-62c4-4a8c-b327-7c5712246ad1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57539b6a6f3b4d589f5f5e1d211cd6a0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82025) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:42:00.773069 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06db45ee-467c-4bd9-9b76-bc590c481594 None admin] RBAC: Authorization granted {{(pid=82026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:42:00.773165 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b93f17cb-62c4-4a8c-b327-7c5712246ad1 None admin] REQUEST_METHOD: `GET` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:42:00.773428 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b93f17cb-62c4-4a8c-b327-7c5712246ad1 None admin] SCRIPT_NAME: `/identity` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:42:00.773713 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b93f17cb-62c4-4a8c-b327-7c5712246ad1 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:42:00.785589 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b93f17cb-62c4-4a8c-b327-7c5712246ad1 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=82025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:42:00.787078 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b93f17cb-62c4-4a8c-b327-7c5712246ad1 None admin] RBAC: Authorization granted {{(pid=82025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:42:00.794180 dv-cinder-828806-6-smb devstack@keystone.service[82026]: [pid: 82026|app: 0|req: 296/586] 10.222.0.33 () {56 vars in 1137 bytes} [Tue Sep 13 19:42:00 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 19:42:00.795127 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06db45ee-467c-4bd9-9b76-bc590c481594 None admin] Authenticating user token {{(pid=82026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:42:00.804576 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application [None req-b93f17cb-62c4-4a8c-b327-7c5712246ad1 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 13 19:42:00.804576 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 19:42:00.804576 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 19:42:00.804576 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 19:42:00.804576 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 19:42:00.804576 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 19:42:00.804576 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 19:42:00.804576 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 19:42:00.804576 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 19:42:00.804576 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 19:42:00.804576 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 19:42:00.804576 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 19:42:00.804576 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 13 19:42:00.804576 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 13 19:42:00.804576 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 13 19:42:00.804576 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 13 19:42:00.805546 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 19:42:00.805546 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 19:42:00.805546 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 19:42:00.805546 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 19:42:00.805546 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 19:42:00.805546 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 19:42:00.805546 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 19:42:00.805546 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application with Lock( Sep 13 19:42:00.805546 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 19:42:00.805546 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application return self._enter() Sep 13 19:42:00.805546 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 19:42:00.805546 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 19:42:00.805546 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 19:42:00.805546 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application return self.creator() Sep 13 19:42:00.805546 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 19:42:00.805546 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application created_value = creator( Sep 13 19:42:00.805546 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 13 19:42:00.806426 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 13 19:42:00.806426 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 13 19:42:00.806426 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application Sep 13 19:42:00.806426 dv-cinder-828806-6-smb devstack@keystone.service[82025]: [pid: 82025|app: 0|req: 291/587] 10.222.0.33 () {56 vars in 1108 bytes} [Tue Sep 13 19:42:00 2022] GET /identity/v3/domains/Default => generated 87 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 19:42:00.806647 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b93f17cb-62c4-4a8c-b327-7c5712246ad1 None admin] Authenticating user token {{(pid=82025) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:42:00.909000 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06db45ee-467c-4bd9-9b76-bc590c481594 None admin] Validating token access rules against request {{(pid=82026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:42:00.926503 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b93f17cb-62c4-4a8c-b327-7c5712246ad1 None admin] Validating token access rules against request {{(pid=82025) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:42:00.948603 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73d16323-02bf-4f72-b7a0-1cbd93880ac8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57539b6a6f3b4d589f5f5e1d211cd6a0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:42:00.949489 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73d16323-02bf-4f72-b7a0-1cbd93880ac8 None admin] REQUEST_METHOD: `GET` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:42:00.949768 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73d16323-02bf-4f72-b7a0-1cbd93880ac8 None admin] SCRIPT_NAME: `/identity` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:42:00.950037 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73d16323-02bf-4f72-b7a0-1cbd93880ac8 None admin] PATH_INFO: `/v3/users` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:42:00.951528 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73d16323-02bf-4f72-b7a0-1cbd93880ac8 None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=82026) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 19:42:00.951841 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73d16323-02bf-4f72-b7a0-1cbd93880ac8 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=82026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:42:00.954973 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73d16323-02bf-4f72-b7a0-1cbd93880ac8 None admin] RBAC: Authorization granted {{(pid=82026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:42:00.962239 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f396eb8a-aba9-48fe-aaf2-e7e9531107b1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57539b6a6f3b4d589f5f5e1d211cd6a0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82025) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:42:00.962903 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f396eb8a-aba9-48fe-aaf2-e7e9531107b1 None admin] REQUEST_METHOD: `PUT` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:42:00.963217 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f396eb8a-aba9-48fe-aaf2-e7e9531107b1 None admin] SCRIPT_NAME: `/identity` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:42:00.963503 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f396eb8a-aba9-48fe-aaf2-e7e9531107b1 None admin] PATH_INFO: `/v3/projects/c8c6fba0f15b4d6a84ff601919b7b8e4/users/e66e7034abed4e0bad1f4137520c1e70/roles/47ee826cd5f148c19f293f9470f906da` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:42:00.975781 dv-cinder-828806-6-smb devstack@keystone.service[82026]: [pid: 82026|app: 0|req: 297/588] 10.222.0.33 () {56 vars in 1137 bytes} [Tue Sep 13 19:42:00 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 19:42:00.976549 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73d16323-02bf-4f72-b7a0-1cbd93880ac8 None admin] Authenticating user token {{(pid=82026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:42:00.985533 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f396eb8a-aba9-48fe-aaf2-e7e9531107b1 None admin] RBAC: Authorizing `identity:create_grant(project_id=c8c6fba0f15b4d6a84ff601919b7b8e4, user_id=e66e7034abed4e0bad1f4137520c1e70, role_id=47ee826cd5f148c19f293f9470f906da)` {{(pid=82025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:42:00.987147 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f396eb8a-aba9-48fe-aaf2-e7e9531107b1 None admin] RBAC: Authorization granted {{(pid=82025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:42:01.000197 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG dbcounter [-] [82025] Writing DB stats keystone:SELECT=100 {{(pid=82025) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:42:01.035239 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG dbcounter [-] [82026] Writing DB stats keystone:SELECT=100 {{(pid=82026) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:42:01.071086 dv-cinder-828806-6-smb devstack@keystone.service[82025]: [pid: 82025|app: 0|req: 292/589] 10.222.0.33 () {58 vars in 1439 bytes} [Tue Sep 13 19:42:00 2022] PUT /identity/v3/projects/c8c6fba0f15b4d6a84ff601919b7b8e4/users/e66e7034abed4e0bad1f4137520c1e70/roles/47ee826cd5f148c19f293f9470f906da => generated 0 bytes in 258 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 19:42:01.071086 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f396eb8a-aba9-48fe-aaf2-e7e9531107b1 None admin] Authenticating user token {{(pid=82025) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:42:01.101451 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73d16323-02bf-4f72-b7a0-1cbd93880ac8 None admin] Validating token access rules against request {{(pid=82026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:42:01.140791 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9418650f-7eef-408b-a0ae-731af3d42287 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57539b6a6f3b4d589f5f5e1d211cd6a0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:42:01.141510 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9418650f-7eef-408b-a0ae-731af3d42287 None admin] REQUEST_METHOD: `GET` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:42:01.141750 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9418650f-7eef-408b-a0ae-731af3d42287 None admin] SCRIPT_NAME: `/identity` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:42:01.142028 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9418650f-7eef-408b-a0ae-731af3d42287 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:42:01.156895 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9418650f-7eef-408b-a0ae-731af3d42287 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=82026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:42:01.159003 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9418650f-7eef-408b-a0ae-731af3d42287 None admin] RBAC: Authorization granted {{(pid=82026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:42:01.181585 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application [None req-9418650f-7eef-408b-a0ae-731af3d42287 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 13 19:42:01.181585 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 19:42:01.181585 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 19:42:01.181585 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 19:42:01.181585 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 19:42:01.181585 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 19:42:01.181585 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 19:42:01.181585 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 19:42:01.181585 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 19:42:01.181585 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 19:42:01.181585 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 19:42:01.181585 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 19:42:01.181585 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 13 19:42:01.181585 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 13 19:42:01.181585 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 13 19:42:01.181585 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 13 19:42:01.182610 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 19:42:01.182610 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 19:42:01.182610 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 19:42:01.182610 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 19:42:01.182610 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 19:42:01.182610 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 19:42:01.182610 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 19:42:01.182610 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application with Lock( Sep 13 19:42:01.182610 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 19:42:01.182610 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application return self._enter() Sep 13 19:42:01.182610 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 19:42:01.182610 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 19:42:01.182610 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 19:42:01.182610 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application return self.creator() Sep 13 19:42:01.182610 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 19:42:01.182610 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application created_value = creator( Sep 13 19:42:01.182610 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 13 19:42:01.183536 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 13 19:42:01.183536 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 13 19:42:01.183536 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application Sep 13 19:42:01.185395 dv-cinder-828806-6-smb devstack@keystone.service[82026]: [pid: 82026|app: 0|req: 298/590] 10.222.0.33 () {56 vars in 1108 bytes} [Tue Sep 13 19:42:00 2022] GET /identity/v3/domains/Default => generated 87 bytes in 208 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 19:42:01.185395 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9418650f-7eef-408b-a0ae-731af3d42287 None admin] Authenticating user token {{(pid=82026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:42:01.222329 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f396eb8a-aba9-48fe-aaf2-e7e9531107b1 None admin] Validating token access rules against request {{(pid=82025) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:42:01.268456 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7e68fef-9db9-49b1-8c22-0ba75a5d67e5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57539b6a6f3b4d589f5f5e1d211cd6a0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82025) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:42:01.268998 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7e68fef-9db9-49b1-8c22-0ba75a5d67e5 None admin] REQUEST_METHOD: `GET` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:42:01.269284 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7e68fef-9db9-49b1-8c22-0ba75a5d67e5 None admin] SCRIPT_NAME: `/identity` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:42:01.269563 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7e68fef-9db9-49b1-8c22-0ba75a5d67e5 None admin] PATH_INFO: `/v3/domains` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:42:01.270389 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7e68fef-9db9-49b1-8c22-0ba75a5d67e5 None admin] RBAC: Adding query filter params (name=Default) {{(pid=82025) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 19:42:01.270699 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7e68fef-9db9-49b1-8c22-0ba75a5d67e5 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:42:01.272895 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7e68fef-9db9-49b1-8c22-0ba75a5d67e5 None admin] RBAC: Authorization granted {{(pid=82025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:42:01.295172 dv-cinder-828806-6-smb devstack@keystone.service[82025]: [pid: 82025|app: 0|req: 293/591] 10.222.0.33 () {56 vars in 1109 bytes} [Tue Sep 13 19:42:01 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 227 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 19:42:01.295172 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7e68fef-9db9-49b1-8c22-0ba75a5d67e5 None admin] Authenticating user token {{(pid=82025) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:42:01.310639 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG dbcounter [-] [82026] Writing DB stats keystone:SELECT=100 {{(pid=82026) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:42:01.322154 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9418650f-7eef-408b-a0ae-731af3d42287 None admin] Validating token access rules against request {{(pid=82026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:42:01.360170 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG dbcounter [-] [82025] Writing DB stats keystone:INSERT=1,keystone:SELECT=99 {{(pid=82025) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:42:01.368881 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e7569ed-f842-460a-b5ec-bedc7369aeb4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57539b6a6f3b4d589f5f5e1d211cd6a0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:42:01.369539 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e7569ed-f842-460a-b5ec-bedc7369aeb4 None admin] REQUEST_METHOD: `GET` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:42:01.369826 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e7569ed-f842-460a-b5ec-bedc7369aeb4 None admin] SCRIPT_NAME: `/identity` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:42:01.370104 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e7569ed-f842-460a-b5ec-bedc7369aeb4 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:42:01.383728 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e7569ed-f842-460a-b5ec-bedc7369aeb4 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=82026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:42:01.385694 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e7569ed-f842-460a-b5ec-bedc7369aeb4 None admin] RBAC: Authorization granted {{(pid=82026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:42:01.411792 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application [None req-4e7569ed-f842-460a-b5ec-bedc7369aeb4 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 13 19:42:01.411792 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 19:42:01.411792 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 19:42:01.411792 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 19:42:01.411792 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 19:42:01.411792 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 19:42:01.411792 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 19:42:01.411792 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 19:42:01.411792 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 19:42:01.411792 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 19:42:01.411792 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 19:42:01.411792 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 19:42:01.411792 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 13 19:42:01.411792 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 13 19:42:01.411792 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 13 19:42:01.411792 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 13 19:42:01.412798 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 19:42:01.412798 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 19:42:01.412798 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 19:42:01.412798 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 19:42:01.412798 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 19:42:01.412798 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 19:42:01.412798 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 19:42:01.412798 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application with Lock( Sep 13 19:42:01.412798 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 19:42:01.412798 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application return self._enter() Sep 13 19:42:01.412798 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 19:42:01.412798 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 19:42:01.412798 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 19:42:01.412798 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application return self.creator() Sep 13 19:42:01.412798 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 19:42:01.412798 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application created_value = creator( Sep 13 19:42:01.412798 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 13 19:42:01.413737 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 13 19:42:01.413737 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 13 19:42:01.413737 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application Sep 13 19:42:01.419875 dv-cinder-828806-6-smb devstack@keystone.service[82026]: [pid: 82026|app: 0|req: 299/592] 10.222.0.33 () {56 vars in 1108 bytes} [Tue Sep 13 19:42:01 2022] GET /identity/v3/domains/Default => generated 87 bytes in 231 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 19:42:01.419875 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e7569ed-f842-460a-b5ec-bedc7369aeb4 None admin] Authenticating user token {{(pid=82026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:42:01.423150 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7e68fef-9db9-49b1-8c22-0ba75a5d67e5 None admin] Validating token access rules against request {{(pid=82025) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:42:01.464827 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2bc327f-3c88-4196-a0f6-a3de5e8edc91 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57539b6a6f3b4d589f5f5e1d211cd6a0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82025) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:42:01.465451 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2bc327f-3c88-4196-a0f6-a3de5e8edc91 None admin] REQUEST_METHOD: `GET` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:42:01.465738 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2bc327f-3c88-4196-a0f6-a3de5e8edc91 None admin] SCRIPT_NAME: `/identity` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:42:01.466015 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2bc327f-3c88-4196-a0f6-a3de5e8edc91 None admin] PATH_INFO: `/v3/domains` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:42:01.466939 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2bc327f-3c88-4196-a0f6-a3de5e8edc91 None admin] RBAC: Adding query filter params (name=Default) {{(pid=82025) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 19:42:01.467208 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2bc327f-3c88-4196-a0f6-a3de5e8edc91 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:42:01.468745 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2bc327f-3c88-4196-a0f6-a3de5e8edc91 None admin] RBAC: Authorization granted {{(pid=82025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:42:01.486816 dv-cinder-828806-6-smb devstack@keystone.service[82025]: [pid: 82025|app: 0|req: 294/593] 10.222.0.33 () {56 vars in 1109 bytes} [Tue Sep 13 19:42:01 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 19:42:01.486816 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2bc327f-3c88-4196-a0f6-a3de5e8edc91 None admin] Authenticating user token {{(pid=82025) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:42:01.537240 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e7569ed-f842-460a-b5ec-bedc7369aeb4 None admin] Validating token access rules against request {{(pid=82026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:42:01.572997 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc4bb77a-b475-4acc-a574-5aa9f47b12e4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57539b6a6f3b4d589f5f5e1d211cd6a0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:42:01.574041 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc4bb77a-b475-4acc-a574-5aa9f47b12e4 None admin] REQUEST_METHOD: `GET` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:42:01.574496 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc4bb77a-b475-4acc-a574-5aa9f47b12e4 None admin] SCRIPT_NAME: `/identity` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:42:01.575011 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc4bb77a-b475-4acc-a574-5aa9f47b12e4 None admin] PATH_INFO: `/v3/users/neutron` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:42:01.583405 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc4bb77a-b475-4acc-a574-5aa9f47b12e4 None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=82026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:42:01.585129 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc4bb77a-b475-4acc-a574-5aa9f47b12e4 None admin] RBAC: Authorization granted {{(pid=82026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:42:01.597379 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application [None req-fc4bb77a-b475-4acc-a574-5aa9f47b12e4 None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Sep 13 19:42:01.597379 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 19:42:01.597379 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 19:42:01.597379 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 19:42:01.597379 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 19:42:01.597379 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 19:42:01.597379 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 19:42:01.597379 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 19:42:01.597379 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 19:42:01.597379 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 19:42:01.597379 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 19:42:01.597379 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 19:42:01.597379 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 13 19:42:01.597379 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 13 19:42:01.597379 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 13 19:42:01.597379 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 13 19:42:01.598328 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 19:42:01.598328 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 19:42:01.598328 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 13 19:42:01.598328 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 13 19:42:01.598328 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 13 19:42:01.598328 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 13 19:42:01.598328 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 19:42:01.598328 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 19:42:01.598328 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 19:42:01.598328 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 19:42:01.598328 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 19:42:01.598328 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application with Lock( Sep 13 19:42:01.598328 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 19:42:01.598328 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application return self._enter() Sep 13 19:42:01.598328 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 19:42:01.598328 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 19:42:01.598328 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 19:42:01.598328 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application return self.creator() Sep 13 19:42:01.599278 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 19:42:01.599278 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application created_value = creator( Sep 13 19:42:01.599278 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 13 19:42:01.599278 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 13 19:42:01.599278 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 13 19:42:01.599278 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 13 19:42:01.599278 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 13 19:42:01.599278 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 13 19:42:01.599278 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. Sep 13 19:42:01.599278 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application Sep 13 19:42:01.599816 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2bc327f-3c88-4196-a0f6-a3de5e8edc91 None admin] Validating token access rules against request {{(pid=82025) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:42:01.601920 dv-cinder-828806-6-smb devstack@keystone.service[82026]: [pid: 82026|app: 0|req: 300/594] 10.222.0.33 () {56 vars in 1102 bytes} [Tue Sep 13 19:42:01 2022] GET /identity/v3/users/neutron => generated 85 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 19:42:01.602863 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc4bb77a-b475-4acc-a574-5aa9f47b12e4 None admin] Authenticating user token {{(pid=82026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:42:01.617371 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG dbcounter [-] [82026] Writing DB stats keystone:SELECT=100 {{(pid=82026) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:42:01.619267 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG dbcounter [-] [82025] Writing DB stats keystone:SELECT=100 {{(pid=82025) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:42:01.640946 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0828d6ac-45d2-49be-b63e-d8052e3ec970 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57539b6a6f3b4d589f5f5e1d211cd6a0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82025) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:42:01.641462 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0828d6ac-45d2-49be-b63e-d8052e3ec970 None admin] REQUEST_METHOD: `GET` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:42:01.641661 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0828d6ac-45d2-49be-b63e-d8052e3ec970 None admin] SCRIPT_NAME: `/identity` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:42:01.641934 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0828d6ac-45d2-49be-b63e-d8052e3ec970 None admin] PATH_INFO: `/v3/domains` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:42:01.642707 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0828d6ac-45d2-49be-b63e-d8052e3ec970 None admin] RBAC: Adding query filter params (name=Default) {{(pid=82025) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 19:42:01.643020 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0828d6ac-45d2-49be-b63e-d8052e3ec970 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:42:01.644449 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0828d6ac-45d2-49be-b63e-d8052e3ec970 None admin] RBAC: Authorization granted {{(pid=82025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:42:01.658307 dv-cinder-828806-6-smb devstack@keystone.service[82025]: [pid: 82025|app: 0|req: 295/595] 10.222.0.33 () {56 vars in 1109 bytes} [Tue Sep 13 19:42:01 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 19:42:01.662766 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0828d6ac-45d2-49be-b63e-d8052e3ec970 None admin] Authenticating user token {{(pid=82025) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:42:01.721932 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc4bb77a-b475-4acc-a574-5aa9f47b12e4 None admin] Validating token access rules against request {{(pid=82026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:42:01.756405 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b4805b2-22c6-4d16-8b12-f2416d0a0a86 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57539b6a6f3b4d589f5f5e1d211cd6a0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:42:01.757369 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b4805b2-22c6-4d16-8b12-f2416d0a0a86 None admin] REQUEST_METHOD: `GET` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:42:01.757827 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b4805b2-22c6-4d16-8b12-f2416d0a0a86 None admin] SCRIPT_NAME: `/identity` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:42:01.758557 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b4805b2-22c6-4d16-8b12-f2416d0a0a86 None admin] PATH_INFO: `/v3/projects/service` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:42:01.766564 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b4805b2-22c6-4d16-8b12-f2416d0a0a86 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=82026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:42:01.768348 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b4805b2-22c6-4d16-8b12-f2416d0a0a86 None admin] RBAC: Authorization granted {{(pid=82026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:42:01.771699 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0828d6ac-45d2-49be-b63e-d8052e3ec970 None admin] Validating token access rules against request {{(pid=82025) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:42:01.780375 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application [None req-1b4805b2-22c6-4d16-8b12-f2416d0a0a86 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 13 19:42:01.780375 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 19:42:01.780375 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 19:42:01.780375 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 19:42:01.780375 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 19:42:01.780375 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 19:42:01.780375 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 19:42:01.780375 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 19:42:01.780375 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 19:42:01.780375 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 19:42:01.780375 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 19:42:01.780375 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 19:42:01.780375 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 13 19:42:01.780375 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 13 19:42:01.780375 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 13 19:42:01.782320 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 13 19:42:01.782320 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 19:42:01.782320 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 19:42:01.782320 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 19:42:01.782320 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 19:42:01.782320 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 19:42:01.782320 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 19:42:01.782320 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 19:42:01.782320 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application with Lock( Sep 13 19:42:01.782320 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 19:42:01.782320 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application return self._enter() Sep 13 19:42:01.782320 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 19:42:01.782320 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 19:42:01.782320 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 19:42:01.782320 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application return self.creator() Sep 13 19:42:01.782320 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 19:42:01.782320 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application created_value = creator( Sep 13 19:42:01.783227 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 13 19:42:01.783227 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 13 19:42:01.783227 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 13 19:42:01.783227 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 13 19:42:01.783227 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 13 19:42:01.783227 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 13 19:42:01.783227 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 13 19:42:01.783227 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application Sep 13 19:42:01.789950 dv-cinder-828806-6-smb devstack@keystone.service[82026]: [pid: 82026|app: 0|req: 301/596] 10.222.0.33 () {56 vars in 1111 bytes} [Tue Sep 13 19:42:01 2022] GET /identity/v3/projects/service => generated 88 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 19:42:01.790934 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b4805b2-22c6-4d16-8b12-f2416d0a0a86 None admin] Authenticating user token {{(pid=82026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:42:01.808943 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d028e83-d01d-4317-a341-21fd26fb70a3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57539b6a6f3b4d589f5f5e1d211cd6a0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82025) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:42:01.809554 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d028e83-d01d-4317-a341-21fd26fb70a3 None admin] REQUEST_METHOD: `GET` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:42:01.809839 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d028e83-d01d-4317-a341-21fd26fb70a3 None admin] SCRIPT_NAME: `/identity` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:42:01.810156 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d028e83-d01d-4317-a341-21fd26fb70a3 None admin] PATH_INFO: `/v3/users` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:42:01.810991 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d028e83-d01d-4317-a341-21fd26fb70a3 None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=82025) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 19:42:01.811336 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d028e83-d01d-4317-a341-21fd26fb70a3 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=82025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:42:01.813611 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d028e83-d01d-4317-a341-21fd26fb70a3 None admin] RBAC: Authorization granted {{(pid=82025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:42:01.838757 dv-cinder-828806-6-smb devstack@keystone.service[82025]: [pid: 82025|app: 0|req: 296/597] 10.222.0.33 () {56 vars in 1139 bytes} [Tue Sep 13 19:42:01 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 19:42:01.839802 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d028e83-d01d-4317-a341-21fd26fb70a3 None admin] Authenticating user token {{(pid=82025) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:42:01.863391 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG dbcounter [-] [82026] Writing DB stats keystone:SELECT=100 {{(pid=82026) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:42:01.898886 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b4805b2-22c6-4d16-8b12-f2416d0a0a86 None admin] Validating token access rules against request {{(pid=82026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:42:01.915448 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG dbcounter [-] [82025] Writing DB stats keystone:SELECT=100 {{(pid=82025) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:42:01.936291 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e053dfa1-f2d4-48af-97af-50f8bfffce56 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57539b6a6f3b4d589f5f5e1d211cd6a0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:42:01.938018 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e053dfa1-f2d4-48af-97af-50f8bfffce56 None admin] REQUEST_METHOD: `GET` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:42:01.938501 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e053dfa1-f2d4-48af-97af-50f8bfffce56 None admin] SCRIPT_NAME: `/identity` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:42:01.938979 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e053dfa1-f2d4-48af-97af-50f8bfffce56 None admin] PATH_INFO: `/v3/projects/service` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:42:01.946707 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e053dfa1-f2d4-48af-97af-50f8bfffce56 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=82026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:42:01.948464 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e053dfa1-f2d4-48af-97af-50f8bfffce56 None admin] RBAC: Authorization granted {{(pid=82026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:42:01.954767 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d028e83-d01d-4317-a341-21fd26fb70a3 None admin] Validating token access rules against request {{(pid=82025) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:42:01.961367 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application [None req-e053dfa1-f2d4-48af-97af-50f8bfffce56 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 13 19:42:01.961367 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 19:42:01.961367 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 19:42:01.961367 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 19:42:01.961367 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 19:42:01.961367 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 19:42:01.961367 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 19:42:01.961367 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 19:42:01.961367 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 19:42:01.961367 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 19:42:01.961367 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 19:42:01.961367 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 19:42:01.961367 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 13 19:42:01.961367 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 13 19:42:01.961367 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 13 19:42:01.962249 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 13 19:42:01.962249 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 19:42:01.962249 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 19:42:01.962249 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 19:42:01.962249 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 19:42:01.962249 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 19:42:01.962249 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 19:42:01.962249 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 19:42:01.962249 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application with Lock( Sep 13 19:42:01.962249 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 19:42:01.962249 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application return self._enter() Sep 13 19:42:01.962249 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 19:42:01.962249 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 19:42:01.962249 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 19:42:01.962249 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application return self.creator() Sep 13 19:42:01.962249 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 19:42:01.962249 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application created_value = creator( Sep 13 19:42:01.963208 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 13 19:42:01.963208 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 13 19:42:01.963208 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 13 19:42:01.963208 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 13 19:42:01.963208 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 13 19:42:01.963208 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 13 19:42:01.963208 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 13 19:42:01.963208 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application Sep 13 19:42:01.970162 dv-cinder-828806-6-smb devstack@keystone.service[82026]: [pid: 82026|app: 0|req: 302/598] 10.222.0.33 () {56 vars in 1111 bytes} [Tue Sep 13 19:42:01 2022] GET /identity/v3/projects/service => generated 88 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 19:42:01.971324 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e053dfa1-f2d4-48af-97af-50f8bfffce56 None admin] Authenticating user token {{(pid=82026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:42:01.993356 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b209726-0d64-4549-9cfc-34f778c180a4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57539b6a6f3b4d589f5f5e1d211cd6a0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82025) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:42:01.993967 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b209726-0d64-4549-9cfc-34f778c180a4 None admin] REQUEST_METHOD: `GET` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:42:01.994248 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b209726-0d64-4549-9cfc-34f778c180a4 None admin] SCRIPT_NAME: `/identity` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:42:01.994525 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b209726-0d64-4549-9cfc-34f778c180a4 None admin] PATH_INFO: `/v3/projects` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:42:01.995302 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b209726-0d64-4549-9cfc-34f778c180a4 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=82025) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 19:42:01.995617 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b209726-0d64-4549-9cfc-34f778c180a4 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=82025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:42:01.997193 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b209726-0d64-4549-9cfc-34f778c180a4 None admin] RBAC: Authorization granted {{(pid=82025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:42:02.016781 dv-cinder-828806-6-smb devstack@keystone.service[82025]: [pid: 82025|app: 0|req: 297/599] 10.222.0.33 () {56 vars in 1148 bytes} [Tue Sep 13 19:42:01 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 19:42:02.017665 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b209726-0d64-4549-9cfc-34f778c180a4 None admin] Authenticating user token {{(pid=82025) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:42:02.082727 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e053dfa1-f2d4-48af-97af-50f8bfffce56 None admin] Validating token access rules against request {{(pid=82026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:42:02.112579 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG dbcounter [-] [82026] Writing DB stats keystone:SELECT=100 {{(pid=82026) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:42:02.120044 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca2ed124-0b63-46cd-8dce-0dc61d1e2104 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57539b6a6f3b4d589f5f5e1d211cd6a0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:42:02.121046 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca2ed124-0b63-46cd-8dce-0dc61d1e2104 None admin] REQUEST_METHOD: `GET` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:42:02.121524 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca2ed124-0b63-46cd-8dce-0dc61d1e2104 None admin] SCRIPT_NAME: `/identity` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:42:02.122008 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca2ed124-0b63-46cd-8dce-0dc61d1e2104 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:42:02.133557 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca2ed124-0b63-46cd-8dce-0dc61d1e2104 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=82026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:42:02.135301 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca2ed124-0b63-46cd-8dce-0dc61d1e2104 None admin] RBAC: Authorization granted {{(pid=82026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:42:02.138986 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b209726-0d64-4549-9cfc-34f778c180a4 None admin] Validating token access rules against request {{(pid=82025) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:42:02.150166 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application [None req-ca2ed124-0b63-46cd-8dce-0dc61d1e2104 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 13 19:42:02.150166 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 19:42:02.150166 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 19:42:02.150166 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 19:42:02.150166 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 19:42:02.150166 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 19:42:02.150166 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 19:42:02.150166 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 19:42:02.150166 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 19:42:02.150166 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 19:42:02.150166 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 19:42:02.150166 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 19:42:02.150166 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 13 19:42:02.150166 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 13 19:42:02.150166 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 13 19:42:02.150166 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 13 19:42:02.151671 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 19:42:02.151671 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 19:42:02.151671 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 19:42:02.151671 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 19:42:02.151671 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 19:42:02.151671 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 19:42:02.151671 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 19:42:02.151671 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application with Lock( Sep 13 19:42:02.151671 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 19:42:02.151671 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application return self._enter() Sep 13 19:42:02.151671 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 19:42:02.151671 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 19:42:02.151671 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 19:42:02.151671 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application return self.creator() Sep 13 19:42:02.151671 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 19:42:02.151671 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application created_value = creator( Sep 13 19:42:02.151671 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 13 19:42:02.152567 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 13 19:42:02.152567 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 13 19:42:02.152567 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application Sep 13 19:42:02.154474 dv-cinder-828806-6-smb devstack@keystone.service[82026]: [pid: 82026|app: 0|req: 303/600] 10.222.0.33 () {56 vars in 1108 bytes} [Tue Sep 13 19:42:01 2022] GET /identity/v3/domains/Default => generated 87 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 19:42:02.155542 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca2ed124-0b63-46cd-8dce-0dc61d1e2104 None admin] Authenticating user token {{(pid=82026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:42:02.185524 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3a86ea3-214e-412d-823d-0133737e15b0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57539b6a6f3b4d589f5f5e1d211cd6a0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82025) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:42:02.186165 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3a86ea3-214e-412d-823d-0133737e15b0 None admin] REQUEST_METHOD: `GET` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:42:02.186751 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3a86ea3-214e-412d-823d-0133737e15b0 None admin] SCRIPT_NAME: `/identity` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:42:02.187646 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3a86ea3-214e-412d-823d-0133737e15b0 None admin] PATH_INFO: `/v3/projects` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:42:02.188734 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3a86ea3-214e-412d-823d-0133737e15b0 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=82025) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 19:42:02.189067 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3a86ea3-214e-412d-823d-0133737e15b0 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=82025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:42:02.190949 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3a86ea3-214e-412d-823d-0133737e15b0 None admin] RBAC: Authorization granted {{(pid=82025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:42:02.211064 dv-cinder-828806-6-smb devstack@keystone.service[82025]: [pid: 82025|app: 0|req: 298/601] 10.222.0.33 () {56 vars in 1148 bytes} [Tue Sep 13 19:42:02 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 19:42:02.211064 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3a86ea3-214e-412d-823d-0133737e15b0 None admin] Authenticating user token {{(pid=82025) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:42:02.211991 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG dbcounter [-] [82025] Writing DB stats keystone:SELECT=100 {{(pid=82025) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:42:02.270963 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca2ed124-0b63-46cd-8dce-0dc61d1e2104 None admin] Validating token access rules against request {{(pid=82026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:42:02.310497 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23d413a1-420e-4430-9ef8-1113d813cd52 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57539b6a6f3b4d589f5f5e1d211cd6a0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:42:02.311324 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23d413a1-420e-4430-9ef8-1113d813cd52 None admin] REQUEST_METHOD: `PUT` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:42:02.311595 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23d413a1-420e-4430-9ef8-1113d813cd52 None admin] SCRIPT_NAME: `/identity` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:42:02.311867 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23d413a1-420e-4430-9ef8-1113d813cd52 None admin] PATH_INFO: `/v3/projects/c8c6fba0f15b4d6a84ff601919b7b8e4/users/46024fc6167f4321818b1bed27a521a0/roles/47ee826cd5f148c19f293f9470f906da` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:42:02.327283 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23d413a1-420e-4430-9ef8-1113d813cd52 None admin] RBAC: Authorizing `identity:create_grant(project_id=c8c6fba0f15b4d6a84ff601919b7b8e4, user_id=46024fc6167f4321818b1bed27a521a0, role_id=47ee826cd5f148c19f293f9470f906da)` {{(pid=82026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:42:02.328894 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23d413a1-420e-4430-9ef8-1113d813cd52 None admin] RBAC: Authorization granted {{(pid=82026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:42:02.342227 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3a86ea3-214e-412d-823d-0133737e15b0 None admin] Validating token access rules against request {{(pid=82025) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:42:02.379337 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a108cba9-7587-4ab3-8ebd-2bb8823f23bf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57539b6a6f3b4d589f5f5e1d211cd6a0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82025) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:42:02.380334 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a108cba9-7587-4ab3-8ebd-2bb8823f23bf None admin] REQUEST_METHOD: `GET` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:42:02.380818 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a108cba9-7587-4ab3-8ebd-2bb8823f23bf None admin] SCRIPT_NAME: `/identity` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:42:02.381307 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a108cba9-7587-4ab3-8ebd-2bb8823f23bf None admin] PATH_INFO: `/v3/domains` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:42:02.382150 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a108cba9-7587-4ab3-8ebd-2bb8823f23bf None admin] RBAC: Adding query filter params (name=Default) {{(pid=82025) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 19:42:02.382639 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a108cba9-7587-4ab3-8ebd-2bb8823f23bf None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:42:02.384241 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a108cba9-7587-4ab3-8ebd-2bb8823f23bf None admin] RBAC: Authorization granted {{(pid=82025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:42:02.396750 dv-cinder-828806-6-smb devstack@keystone.service[82025]: [pid: 82025|app: 0|req: 299/602] 10.222.0.33 () {56 vars in 1109 bytes} [Tue Sep 13 19:42:02 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 19:42:02.397795 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a108cba9-7587-4ab3-8ebd-2bb8823f23bf None admin] Authenticating user token {{(pid=82025) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:42:02.417418 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG dbcounter [-] [82025] Writing DB stats keystone:SELECT=100 {{(pid=82025) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:42:02.429135 dv-cinder-828806-6-smb devstack@keystone.service[82026]: [pid: 82026|app: 0|req: 304/603] 10.222.0.33 () {58 vars in 1439 bytes} [Tue Sep 13 19:42:02 2022] PUT /identity/v3/projects/c8c6fba0f15b4d6a84ff601919b7b8e4/users/46024fc6167f4321818b1bed27a521a0/roles/47ee826cd5f148c19f293f9470f906da => generated 0 bytes in 268 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 19:42:02.430238 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23d413a1-420e-4430-9ef8-1113d813cd52 None admin] Authenticating user token {{(pid=82026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:42:02.489727 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG dbcounter [-] [82026] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82026) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:42:02.523884 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a108cba9-7587-4ab3-8ebd-2bb8823f23bf None admin] Validating token access rules against request {{(pid=82025) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:42:02.573116 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70831851-eae6-446b-8958-7843d6af138d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57539b6a6f3b4d589f5f5e1d211cd6a0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82025) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:42:02.574138 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70831851-eae6-446b-8958-7843d6af138d None admin] REQUEST_METHOD: `PUT` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:42:02.574653 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70831851-eae6-446b-8958-7843d6af138d None admin] SCRIPT_NAME: `/identity` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:42:02.575103 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70831851-eae6-446b-8958-7843d6af138d None admin] PATH_INFO: `/v3/projects/c8c6fba0f15b4d6a84ff601919b7b8e4/users/f7b2421bf1f84193a29f79709d1d5a19/roles/47ee826cd5f148c19f293f9470f906da` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:42:02.603859 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70831851-eae6-446b-8958-7843d6af138d None admin] RBAC: Authorizing `identity:create_grant(project_id=c8c6fba0f15b4d6a84ff601919b7b8e4, user_id=f7b2421bf1f84193a29f79709d1d5a19, role_id=47ee826cd5f148c19f293f9470f906da)` {{(pid=82025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:42:02.606501 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70831851-eae6-446b-8958-7843d6af138d None admin] RBAC: Authorization granted {{(pid=82025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:42:02.635110 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23d413a1-420e-4430-9ef8-1113d813cd52 None admin] Validating token access rules against request {{(pid=82026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:42:02.678065 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da57dd58-cc05-4ac9-883f-9d3e60ce8a25 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57539b6a6f3b4d589f5f5e1d211cd6a0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:42:02.678821 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da57dd58-cc05-4ac9-883f-9d3e60ce8a25 None admin] REQUEST_METHOD: `GET` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:42:02.679169 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da57dd58-cc05-4ac9-883f-9d3e60ce8a25 None admin] SCRIPT_NAME: `/identity` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:42:02.679451 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da57dd58-cc05-4ac9-883f-9d3e60ce8a25 None admin] PATH_INFO: `/v3/projects/service` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:42:02.687485 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da57dd58-cc05-4ac9-883f-9d3e60ce8a25 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=82026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:42:02.689308 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da57dd58-cc05-4ac9-883f-9d3e60ce8a25 None admin] RBAC: Authorization granted {{(pid=82026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:42:02.701470 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application [None req-da57dd58-cc05-4ac9-883f-9d3e60ce8a25 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 13 19:42:02.701470 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 19:42:02.701470 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 19:42:02.701470 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 19:42:02.701470 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 19:42:02.701470 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 19:42:02.701470 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 19:42:02.701470 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 19:42:02.701470 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 19:42:02.701470 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 19:42:02.701470 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 19:42:02.701470 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 19:42:02.701470 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 13 19:42:02.701470 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 13 19:42:02.701470 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 13 19:42:02.702394 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 13 19:42:02.702394 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 19:42:02.702394 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 19:42:02.702394 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 19:42:02.702394 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 19:42:02.702394 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 19:42:02.702394 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 19:42:02.702394 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 19:42:02.702394 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application with Lock( Sep 13 19:42:02.702394 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 19:42:02.702394 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application return self._enter() Sep 13 19:42:02.702394 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 19:42:02.702394 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 19:42:02.702394 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 19:42:02.702394 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application return self.creator() Sep 13 19:42:02.702394 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 19:42:02.702394 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application created_value = creator( Sep 13 19:42:02.704070 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 13 19:42:02.704070 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 13 19:42:02.704070 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 13 19:42:02.704070 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 13 19:42:02.704070 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 13 19:42:02.704070 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 13 19:42:02.704070 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 13 19:42:02.704070 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application Sep 13 19:42:02.704070 dv-cinder-828806-6-smb devstack@keystone.service[82026]: [pid: 82026|app: 0|req: 305/604] 10.222.0.33 () {56 vars in 1111 bytes} [Tue Sep 13 19:42:02 2022] GET /identity/v3/projects/service => generated 88 bytes in 274 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 19:42:02.713459 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da57dd58-cc05-4ac9-883f-9d3e60ce8a25 None admin] Authenticating user token {{(pid=82026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:42:02.716963 dv-cinder-828806-6-smb devstack@keystone.service[82025]: [pid: 82025|app: 0|req: 300/605] 10.222.0.33 () {58 vars in 1439 bytes} [Tue Sep 13 19:42:02 2022] PUT /identity/v3/projects/c8c6fba0f15b4d6a84ff601919b7b8e4/users/f7b2421bf1f84193a29f79709d1d5a19/roles/47ee826cd5f148c19f293f9470f906da => generated 0 bytes in 319 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 19:42:02.834910 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG dbcounter [-] [82026] Writing DB stats keystone:SELECT=100 {{(pid=82026) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:42:02.850298 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da57dd58-cc05-4ac9-883f-9d3e60ce8a25 None admin] Validating token access rules against request {{(pid=82026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:42:02.906219 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48028d79-dc9c-417b-88ca-e8abb7a1e5f8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57539b6a6f3b4d589f5f5e1d211cd6a0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:42:02.907129 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48028d79-dc9c-417b-88ca-e8abb7a1e5f8 None admin] REQUEST_METHOD: `GET` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:42:02.907420 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48028d79-dc9c-417b-88ca-e8abb7a1e5f8 None admin] SCRIPT_NAME: `/identity` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:42:02.907696 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48028d79-dc9c-417b-88ca-e8abb7a1e5f8 None admin] PATH_INFO: `/v3/projects` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:42:02.908414 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48028d79-dc9c-417b-88ca-e8abb7a1e5f8 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=82026) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 19:42:02.908721 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48028d79-dc9c-417b-88ca-e8abb7a1e5f8 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=82026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:42:02.910189 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48028d79-dc9c-417b-88ca-e8abb7a1e5f8 None admin] RBAC: Authorization granted {{(pid=82026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:42:02.924256 dv-cinder-828806-6-smb devstack@keystone.service[82026]: [pid: 82026|app: 0|req: 306/606] 10.222.0.33 () {56 vars in 1148 bytes} [Tue Sep 13 19:42:02 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 211 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 13 19:42:02.930248 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70831851-eae6-446b-8958-7843d6af138d None admin] Authenticating user token {{(pid=82025) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:42:02.943546 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9cf21ef-99ae-44f0-912b-0b1e3374174b None None] REQUEST_METHOD: `GET` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:42:02.943858 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9cf21ef-99ae-44f0-912b-0b1e3374174b None None] SCRIPT_NAME: `/identity` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:42:02.944117 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9cf21ef-99ae-44f0-912b-0b1e3374174b None None] PATH_INFO: `/` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:42:02.945766 dv-cinder-828806-6-smb devstack@keystone.service[82026]: [pid: 82026|app: 0|req: 307/607] 10.222.0.33 () {54 vars in 927 bytes} [Tue Sep 13 19:42:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 13 19:42:02.951890 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65028712-119a-4395-908f-a396a8faaca6 None None] REQUEST_METHOD: `POST` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:42:02.952182 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65028712-119a-4395-908f-a396a8faaca6 None None] SCRIPT_NAME: `/identity` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:42:02.952465 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65028712-119a-4395-908f-a396a8faaca6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:42:02.990779 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.auth.core [None req-65028712-119a-4395-908f-a396a8faaca6 None None] MFA Rules not processed for user `57539b6a6f3b4d589f5f5e1d211cd6a0`. Rule list: `[]` (Enabled: `True`). {{(pid=82026) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 19:42:02.993041 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.common.fernet_utils [None req-65028712-119a-4395-908f-a396a8faaca6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82026) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 19:42:03.034834 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG dbcounter [-] [82025] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82025) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:42:03.081611 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70831851-eae6-446b-8958-7843d6af138d None admin] Validating token access rules against request {{(pid=82025) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:42:03.102163 dv-cinder-828806-6-smb devstack@keystone.service[82026]: [pid: 82026|app: 0|req: 308/608] 10.222.0.33 () {58 vars in 1024 bytes} [Tue Sep 13 19:42:02 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 151 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 13 19:42:03.122570 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea4f009e-9ee5-4691-a5ee-9155ec42d415 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57539b6a6f3b4d589f5f5e1d211cd6a0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82025) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:42:03.123314 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea4f009e-9ee5-4691-a5ee-9155ec42d415 None admin] REQUEST_METHOD: `PUT` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:42:03.123603 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea4f009e-9ee5-4691-a5ee-9155ec42d415 None admin] SCRIPT_NAME: `/identity` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:42:03.123880 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea4f009e-9ee5-4691-a5ee-9155ec42d415 None admin] PATH_INFO: `/v3/projects/c8c6fba0f15b4d6a84ff601919b7b8e4/users/023a2c79c2444611b3d431928e56685d/roles/47ee826cd5f148c19f293f9470f906da` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:42:03.140991 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea4f009e-9ee5-4691-a5ee-9155ec42d415 None admin] RBAC: Authorizing `identity:create_grant(project_id=c8c6fba0f15b4d6a84ff601919b7b8e4, user_id=023a2c79c2444611b3d431928e56685d, role_id=47ee826cd5f148c19f293f9470f906da)` {{(pid=82025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:42:03.142639 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea4f009e-9ee5-4691-a5ee-9155ec42d415 None admin] RBAC: Authorization granted {{(pid=82025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:42:03.215756 dv-cinder-828806-6-smb devstack@keystone.service[82025]: [pid: 82025|app: 0|req: 301/609] 10.222.0.33 () {58 vars in 1439 bytes} [Tue Sep 13 19:42:02 2022] PUT /identity/v3/projects/c8c6fba0f15b4d6a84ff601919b7b8e4/users/023a2c79c2444611b3d431928e56685d/roles/47ee826cd5f148c19f293f9470f906da => generated 0 bytes in 286 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 19:42:03.527412 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e90b567f-d4eb-4171-ac35-f07b5b52585b None None] REQUEST_METHOD: `GET` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:42:03.527412 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e90b567f-d4eb-4171-ac35-f07b5b52585b None None] SCRIPT_NAME: `/identity` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:42:03.527412 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e90b567f-d4eb-4171-ac35-f07b5b52585b None None] PATH_INFO: `/` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:42:03.528773 dv-cinder-828806-6-smb devstack@keystone.service[82026]: [pid: 82026|app: 0|req: 309/610] 10.222.0.33 () {54 vars in 927 bytes} [Tue Sep 13 19:42:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 19:42:03.530847 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea4f009e-9ee5-4691-a5ee-9155ec42d415 None admin] Authenticating user token {{(pid=82025) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:42:03.537530 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3487222-1e28-4118-9a48-e181d8581989 None None] REQUEST_METHOD: `POST` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:42:03.538114 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3487222-1e28-4118-9a48-e181d8581989 None None] SCRIPT_NAME: `/identity` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:42:03.538620 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3487222-1e28-4118-9a48-e181d8581989 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:42:03.568075 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.auth.core [None req-f3487222-1e28-4118-9a48-e181d8581989 None None] MFA Rules not processed for user `57539b6a6f3b4d589f5f5e1d211cd6a0`. Rule list: `[]` (Enabled: `True`). {{(pid=82026) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 19:42:03.569619 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.common.fernet_utils [None req-f3487222-1e28-4118-9a48-e181d8581989 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82026) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 19:42:03.662239 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea4f009e-9ee5-4691-a5ee-9155ec42d415 None admin] Validating token access rules against request {{(pid=82025) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:42:03.677299 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG dbcounter [-] [82025] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82025) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:42:03.702293 dv-cinder-828806-6-smb devstack@keystone.service[82026]: [pid: 82026|app: 0|req: 310/611] 10.222.0.33 () {58 vars in 1024 bytes} [Tue Sep 13 19:42:03 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 13 19:42:03.708806 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb88a4bd-7c81-40e4-8d8f-40df0125589b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57539b6a6f3b4d589f5f5e1d211cd6a0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82025) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:42:03.709716 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb88a4bd-7c81-40e4-8d8f-40df0125589b None admin] REQUEST_METHOD: `GET` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:42:03.710199 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb88a4bd-7c81-40e4-8d8f-40df0125589b None admin] SCRIPT_NAME: `/identity` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:42:03.710711 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb88a4bd-7c81-40e4-8d8f-40df0125589b None admin] PATH_INFO: `/v3/roles/service` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:42:03.735646 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb88a4bd-7c81-40e4-8d8f-40df0125589b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=82025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 13 19:42:03.740839 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application [None req-cb88a4bd-7c81-40e4-8d8f-40df0125589b None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 13 19:42:03.740839 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 19:42:03.740839 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 19:42:03.740839 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 19:42:03.740839 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 19:42:03.740839 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 19:42:03.740839 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 19:42:03.740839 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 19:42:03.740839 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 19:42:03.740839 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 19:42:03.740839 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 19:42:03.740839 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 19:42:03.740839 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 13 19:42:03.740839 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 13 19:42:03.740839 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 13 19:42:03.740839 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 13 19:42:03.741751 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 13 19:42:03.741751 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 13 19:42:03.741751 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 13 19:42:03.741751 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 13 19:42:03.741751 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 19:42:03.741751 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 19:42:03.741751 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 19:42:03.741751 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 19:42:03.741751 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 19:42:03.741751 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 19:42:03.741751 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 19:42:03.741751 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application with Lock( Sep 13 19:42:03.741751 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 19:42:03.741751 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application return self._enter() Sep 13 19:42:03.741751 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 19:42:03.741751 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 19:42:03.742583 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 19:42:03.742583 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application return self.creator() Sep 13 19:42:03.742583 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 19:42:03.742583 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application created_value = creator( Sep 13 19:42:03.742583 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 13 19:42:03.742583 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 13 19:42:03.742583 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 13 19:42:03.742583 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 13 19:42:03.742583 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 13 19:42:03.742583 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 13 19:42:03.742583 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 13 19:42:03.742583 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application Sep 13 19:42:03.745218 dv-cinder-828806-6-smb devstack@keystone.service[82025]: [pid: 82025|app: 0|req: 302/612] 10.222.0.33 () {56 vars in 1102 bytes} [Tue Sep 13 19:42:03 2022] GET /identity/v3/roles/service => generated 85 bytes in 215 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 19:42:03.751347 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3487222-1e28-4118-9a48-e181d8581989 None None] Authenticating user token {{(pid=82026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:42:03.768072 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG dbcounter [-] [82026] Writing DB stats keystone:SELECT=100 {{(pid=82026) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:42:03.917732 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3487222-1e28-4118-9a48-e181d8581989 None None] Validating token access rules against request {{(pid=82026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:42:03.966150 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26d206b3-35fb-4195-8507-129bf2a6f5eb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57539b6a6f3b4d589f5f5e1d211cd6a0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:42:03.967175 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26d206b3-35fb-4195-8507-129bf2a6f5eb None admin] REQUEST_METHOD: `GET` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:42:03.967680 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26d206b3-35fb-4195-8507-129bf2a6f5eb None admin] SCRIPT_NAME: `/identity` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:42:03.968174 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26d206b3-35fb-4195-8507-129bf2a6f5eb None admin] PATH_INFO: `/v3/roles` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:42:03.969614 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26d206b3-35fb-4195-8507-129bf2a6f5eb None admin] RBAC: Adding query filter params (name=service) {{(pid=82026) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 19:42:03.970130 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26d206b3-35fb-4195-8507-129bf2a6f5eb None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:42:03.971738 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26d206b3-35fb-4195-8507-129bf2a6f5eb None admin] RBAC: Authorization granted {{(pid=82026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:42:03.987894 dv-cinder-828806-6-smb devstack@keystone.service[82026]: [pid: 82026|app: 0|req: 311/613] 10.222.0.33 () {56 vars in 1103 bytes} [Tue Sep 13 19:42:03 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 237 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 19:42:03.992975 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb88a4bd-7c81-40e4-8d8f-40df0125589b None admin] Authenticating user token {{(pid=82025) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:42:04.020009 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26d206b3-35fb-4195-8507-129bf2a6f5eb None admin] Authenticating user token {{(pid=82026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:42:04.111232 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG dbcounter [-] [82026] Writing DB stats keystone:SELECT=100 {{(pid=82026) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:42:04.148898 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26d206b3-35fb-4195-8507-129bf2a6f5eb None admin] Validating token access rules against request {{(pid=82026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:42:04.193866 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb88a4bd-7c81-40e4-8d8f-40df0125589b None admin] Validating token access rules against request {{(pid=82025) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:42:04.216452 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-406ebe10-0b6f-4b67-ba04-01991a6bb0c6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57539b6a6f3b4d589f5f5e1d211cd6a0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:42:04.217452 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-406ebe10-0b6f-4b67-ba04-01991a6bb0c6 None admin] REQUEST_METHOD: `GET` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:42:04.217938 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-406ebe10-0b6f-4b67-ba04-01991a6bb0c6 None admin] SCRIPT_NAME: `/identity` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:42:04.218482 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-406ebe10-0b6f-4b67-ba04-01991a6bb0c6 None admin] PATH_INFO: `/v3/roles/service` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:42:04.237432 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-406ebe10-0b6f-4b67-ba04-01991a6bb0c6 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=82026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 13 19:42:04.244973 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application [None req-406ebe10-0b6f-4b67-ba04-01991a6bb0c6 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 13 19:42:04.244973 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 19:42:04.244973 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 19:42:04.244973 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 19:42:04.244973 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 19:42:04.244973 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 19:42:04.244973 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 19:42:04.244973 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 19:42:04.244973 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 19:42:04.244973 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 19:42:04.244973 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 19:42:04.244973 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 19:42:04.244973 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 13 19:42:04.244973 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 13 19:42:04.244973 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 13 19:42:04.244973 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 13 19:42:04.245905 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 13 19:42:04.245905 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 13 19:42:04.245905 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 13 19:42:04.245905 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 13 19:42:04.245905 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 19:42:04.245905 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 19:42:04.245905 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 19:42:04.245905 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 19:42:04.245905 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 19:42:04.245905 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 19:42:04.245905 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 19:42:04.245905 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application with Lock( Sep 13 19:42:04.245905 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 19:42:04.245905 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application return self._enter() Sep 13 19:42:04.245905 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 19:42:04.245905 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 19:42:04.246759 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 19:42:04.246759 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application return self.creator() Sep 13 19:42:04.246759 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 19:42:04.246759 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application created_value = creator( Sep 13 19:42:04.246759 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 13 19:42:04.246759 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 13 19:42:04.246759 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 13 19:42:04.246759 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 13 19:42:04.246759 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 13 19:42:04.246759 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 13 19:42:04.246759 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 13 19:42:04.246759 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application Sep 13 19:42:04.253605 dv-cinder-828806-6-smb devstack@keystone.service[82026]: [pid: 82026|app: 0|req: 312/614] 10.222.0.33 () {56 vars in 1102 bytes} [Tue Sep 13 19:42:04 2022] GET /identity/v3/roles/service => generated 85 bytes in 233 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 13 19:42:04.257584 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-406ebe10-0b6f-4b67-ba04-01991a6bb0c6 None admin] Authenticating user token {{(pid=82026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:42:04.269322 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fedf5bb2-a354-44c1-9952-e4141d3bf4e9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57539b6a6f3b4d589f5f5e1d211cd6a0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82025) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:42:04.270335 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fedf5bb2-a354-44c1-9952-e4141d3bf4e9 None admin] REQUEST_METHOD: `GET` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:42:04.270819 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fedf5bb2-a354-44c1-9952-e4141d3bf4e9 None admin] SCRIPT_NAME: `/identity` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:42:04.271329 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fedf5bb2-a354-44c1-9952-e4141d3bf4e9 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:42:04.297165 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fedf5bb2-a354-44c1-9952-e4141d3bf4e9 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=82025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:42:04.298926 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fedf5bb2-a354-44c1-9952-e4141d3bf4e9 None admin] RBAC: Authorization granted {{(pid=82025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:42:04.315267 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application [None req-fedf5bb2-a354-44c1-9952-e4141d3bf4e9 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 13 19:42:04.315267 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 19:42:04.315267 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 19:42:04.315267 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 19:42:04.315267 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 19:42:04.315267 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 19:42:04.315267 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 19:42:04.315267 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 19:42:04.315267 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 19:42:04.315267 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 19:42:04.315267 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 19:42:04.315267 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 19:42:04.315267 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 13 19:42:04.315267 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 13 19:42:04.315267 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 13 19:42:04.315267 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 13 19:42:04.316255 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 19:42:04.316255 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 19:42:04.316255 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 19:42:04.316255 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 19:42:04.316255 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 19:42:04.316255 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 19:42:04.316255 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 19:42:04.316255 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application with Lock( Sep 13 19:42:04.316255 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 19:42:04.316255 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application return self._enter() Sep 13 19:42:04.316255 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 19:42:04.316255 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 19:42:04.316255 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 19:42:04.316255 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application return self.creator() Sep 13 19:42:04.316255 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 19:42:04.316255 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application created_value = creator( Sep 13 19:42:04.316255 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 13 19:42:04.317154 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 13 19:42:04.317154 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 13 19:42:04.317154 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application Sep 13 19:42:04.319665 dv-cinder-828806-6-smb devstack@keystone.service[82025]: [pid: 82025|app: 0|req: 303/615] 10.222.0.33 () {56 vars in 1108 bytes} [Tue Sep 13 19:42:03 2022] GET /identity/v3/domains/Default => generated 87 bytes in 327 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 19:42:04.324604 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fedf5bb2-a354-44c1-9952-e4141d3bf4e9 None admin] Authenticating user token {{(pid=82025) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:42:04.395405 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG dbcounter [-] [82025] Writing DB stats keystone:SELECT=100 {{(pid=82025) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:42:04.492721 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-406ebe10-0b6f-4b67-ba04-01991a6bb0c6 None admin] Validating token access rules against request {{(pid=82026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:42:04.539775 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fedf5bb2-a354-44c1-9952-e4141d3bf4e9 None admin] Validating token access rules against request {{(pid=82025) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:42:04.546295 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG dbcounter [-] [82026] Writing DB stats keystone:SELECT=100 {{(pid=82026) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:42:04.557774 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b1a2af3-1956-4bdc-9c32-e94aca2006c0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57539b6a6f3b4d589f5f5e1d211cd6a0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:42:04.560322 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b1a2af3-1956-4bdc-9c32-e94aca2006c0 None admin] REQUEST_METHOD: `GET` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:42:04.560322 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b1a2af3-1956-4bdc-9c32-e94aca2006c0 None admin] SCRIPT_NAME: `/identity` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:42:04.560322 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b1a2af3-1956-4bdc-9c32-e94aca2006c0 None admin] PATH_INFO: `/v3/roles` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:42:04.560322 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b1a2af3-1956-4bdc-9c32-e94aca2006c0 None admin] RBAC: Adding query filter params (name=service) {{(pid=82026) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 19:42:04.560322 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b1a2af3-1956-4bdc-9c32-e94aca2006c0 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:42:04.561386 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b1a2af3-1956-4bdc-9c32-e94aca2006c0 None admin] RBAC: Authorization granted {{(pid=82026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:42:04.571342 dv-cinder-828806-6-smb devstack@keystone.service[82026]: [pid: 82026|app: 0|req: 313/616] 10.222.0.33 () {56 vars in 1103 bytes} [Tue Sep 13 19:42:04 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 314 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 19:42:04.577056 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b1a2af3-1956-4bdc-9c32-e94aca2006c0 None admin] Authenticating user token {{(pid=82026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:42:04.630410 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f09f35c-2e8c-4ecb-a423-7d70e5f82325 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57539b6a6f3b4d589f5f5e1d211cd6a0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82025) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:42:04.631048 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f09f35c-2e8c-4ecb-a423-7d70e5f82325 None admin] REQUEST_METHOD: `GET` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:42:04.631333 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f09f35c-2e8c-4ecb-a423-7d70e5f82325 None admin] SCRIPT_NAME: `/identity` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:42:04.631608 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f09f35c-2e8c-4ecb-a423-7d70e5f82325 None admin] PATH_INFO: `/v3/domains` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:42:04.632255 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f09f35c-2e8c-4ecb-a423-7d70e5f82325 None admin] RBAC: Adding query filter params (name=Default) {{(pid=82025) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 19:42:04.632558 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f09f35c-2e8c-4ecb-a423-7d70e5f82325 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:42:04.633922 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f09f35c-2e8c-4ecb-a423-7d70e5f82325 None admin] RBAC: Authorization granted {{(pid=82025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:42:04.665479 dv-cinder-828806-6-smb devstack@keystone.service[82025]: [pid: 82025|app: 0|req: 304/617] 10.222.0.33 () {56 vars in 1109 bytes} [Tue Sep 13 19:42:04 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 341 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 19:42:04.670847 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f09f35c-2e8c-4ecb-a423-7d70e5f82325 None admin] Authenticating user token {{(pid=82025) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:42:04.684458 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b1a2af3-1956-4bdc-9c32-e94aca2006c0 None admin] Validating token access rules against request {{(pid=82026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:42:04.726856 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f70e4cc4-9852-4da1-ba47-f4d0a11d9a87 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57539b6a6f3b4d589f5f5e1d211cd6a0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:42:04.727629 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f70e4cc4-9852-4da1-ba47-f4d0a11d9a87 None admin] REQUEST_METHOD: `GET` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:42:04.727921 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f70e4cc4-9852-4da1-ba47-f4d0a11d9a87 None admin] SCRIPT_NAME: `/identity` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:42:04.728195 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f70e4cc4-9852-4da1-ba47-f4d0a11d9a87 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:42:04.739534 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f70e4cc4-9852-4da1-ba47-f4d0a11d9a87 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=82026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:42:04.741175 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f70e4cc4-9852-4da1-ba47-f4d0a11d9a87 None admin] RBAC: Authorization granted {{(pid=82026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:42:04.757110 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application [None req-f70e4cc4-9852-4da1-ba47-f4d0a11d9a87 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 13 19:42:04.757110 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 19:42:04.757110 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 19:42:04.757110 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 19:42:04.757110 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 19:42:04.757110 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 19:42:04.757110 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 19:42:04.757110 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 19:42:04.757110 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 19:42:04.757110 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 19:42:04.757110 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 19:42:04.757110 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 19:42:04.757110 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 13 19:42:04.757110 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 13 19:42:04.757110 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 13 19:42:04.757110 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 13 19:42:04.759435 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 19:42:04.759435 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 19:42:04.759435 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 19:42:04.759435 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 19:42:04.759435 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 19:42:04.759435 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 19:42:04.759435 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 19:42:04.759435 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application with Lock( Sep 13 19:42:04.759435 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 19:42:04.759435 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application return self._enter() Sep 13 19:42:04.759435 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 19:42:04.759435 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 19:42:04.759435 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 19:42:04.759435 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application return self.creator() Sep 13 19:42:04.759435 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 19:42:04.759435 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application created_value = creator( Sep 13 19:42:04.759435 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 13 19:42:04.761697 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 13 19:42:04.761697 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 13 19:42:04.761697 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application Sep 13 19:42:04.761697 dv-cinder-828806-6-smb devstack@keystone.service[82026]: [pid: 82026|app: 0|req: 314/618] 10.222.0.33 () {56 vars in 1108 bytes} [Tue Sep 13 19:42:04 2022] GET /identity/v3/domains/Default => generated 87 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 13 19:42:04.767055 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f70e4cc4-9852-4da1-ba47-f4d0a11d9a87 None admin] Authenticating user token {{(pid=82026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:42:04.832795 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG dbcounter [-] [82025] Writing DB stats keystone:SELECT=100 {{(pid=82025) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:42:04.844132 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG dbcounter [-] [82026] Writing DB stats keystone:SELECT=100 {{(pid=82026) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:42:04.862194 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f09f35c-2e8c-4ecb-a423-7d70e5f82325 None admin] Validating token access rules against request {{(pid=82025) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:42:04.910451 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e1551d0-89a1-46f2-9da0-13c0c370e51d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57539b6a6f3b4d589f5f5e1d211cd6a0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82025) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:42:04.910451 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e1551d0-89a1-46f2-9da0-13c0c370e51d None admin] REQUEST_METHOD: `GET` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:42:04.911510 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e1551d0-89a1-46f2-9da0-13c0c370e51d None admin] SCRIPT_NAME: `/identity` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:42:04.911510 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e1551d0-89a1-46f2-9da0-13c0c370e51d None admin] PATH_INFO: `/v3/users/swift` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:42:04.920505 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e1551d0-89a1-46f2-9da0-13c0c370e51d None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=82025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:42:04.922780 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e1551d0-89a1-46f2-9da0-13c0c370e51d None admin] RBAC: Authorization granted {{(pid=82025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:42:04.935107 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application [None req-7e1551d0-89a1-46f2-9da0-13c0c370e51d None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Sep 13 19:42:04.935107 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 19:42:04.935107 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 19:42:04.935107 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 19:42:04.935107 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 19:42:04.935107 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 19:42:04.935107 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 19:42:04.935107 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 19:42:04.935107 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 19:42:04.935107 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 19:42:04.935107 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 19:42:04.935107 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 19:42:04.935107 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 13 19:42:04.935107 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 13 19:42:04.935107 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 13 19:42:04.935107 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 13 19:42:04.938006 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 19:42:04.938006 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 19:42:04.938006 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 13 19:42:04.938006 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 13 19:42:04.938006 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 13 19:42:04.938006 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 13 19:42:04.938006 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 19:42:04.938006 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 19:42:04.938006 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 19:42:04.938006 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 19:42:04.938006 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 19:42:04.938006 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application with Lock( Sep 13 19:42:04.938006 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 19:42:04.938006 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application return self._enter() Sep 13 19:42:04.938006 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 19:42:04.938006 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 19:42:04.938006 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 19:42:04.938006 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application return self.creator() Sep 13 19:42:04.940051 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 19:42:04.940051 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application created_value = creator( Sep 13 19:42:04.940051 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 13 19:42:04.940051 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 13 19:42:04.940051 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 13 19:42:04.940051 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 13 19:42:04.940051 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 13 19:42:04.940051 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 13 19:42:04.940051 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Sep 13 19:42:04.940051 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application Sep 13 19:42:04.940051 dv-cinder-828806-6-smb devstack@keystone.service[82025]: [pid: 82025|app: 0|req: 305/619] 10.222.0.33 () {56 vars in 1096 bytes} [Tue Sep 13 19:42:04 2022] GET /identity/v3/users/swift => generated 83 bytes in 266 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 13 19:42:04.948533 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e1551d0-89a1-46f2-9da0-13c0c370e51d None admin] Authenticating user token {{(pid=82025) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:42:04.966907 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f70e4cc4-9852-4da1-ba47-f4d0a11d9a87 None admin] Validating token access rules against request {{(pid=82026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:42:05.020373 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-130d95c5-181a-4566-8b89-4113b9d88e90 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57539b6a6f3b4d589f5f5e1d211cd6a0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:42:05.021349 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-130d95c5-181a-4566-8b89-4113b9d88e90 None admin] REQUEST_METHOD: `GET` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:42:05.021835 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-130d95c5-181a-4566-8b89-4113b9d88e90 None admin] SCRIPT_NAME: `/identity` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:42:05.022497 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-130d95c5-181a-4566-8b89-4113b9d88e90 None admin] PATH_INFO: `/v3/domains` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:42:05.023408 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-130d95c5-181a-4566-8b89-4113b9d88e90 None admin] RBAC: Adding query filter params (name=Default) {{(pid=82026) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 19:42:05.023936 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-130d95c5-181a-4566-8b89-4113b9d88e90 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:42:05.025622 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-130d95c5-181a-4566-8b89-4113b9d88e90 None admin] RBAC: Authorization granted {{(pid=82026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:42:05.045842 dv-cinder-828806-6-smb devstack@keystone.service[82026]: [pid: 82026|app: 0|req: 315/620] 10.222.0.33 () {56 vars in 1109 bytes} [Tue Sep 13 19:42:04 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 282 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 19:42:05.051843 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-130d95c5-181a-4566-8b89-4113b9d88e90 None admin] Authenticating user token {{(pid=82026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:42:05.143354 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e1551d0-89a1-46f2-9da0-13c0c370e51d None admin] Validating token access rules against request {{(pid=82025) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:42:05.179468 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-847abba6-c561-4404-8fc4-677b250859d1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57539b6a6f3b4d589f5f5e1d211cd6a0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82025) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:42:05.180441 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-847abba6-c561-4404-8fc4-677b250859d1 None admin] REQUEST_METHOD: `GET` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:42:05.180928 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-847abba6-c561-4404-8fc4-677b250859d1 None admin] SCRIPT_NAME: `/identity` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:42:05.181418 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-847abba6-c561-4404-8fc4-677b250859d1 None admin] PATH_INFO: `/v3/users` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:42:05.182344 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-847abba6-c561-4404-8fc4-677b250859d1 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=82025) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 19:42:05.182905 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-847abba6-c561-4404-8fc4-677b250859d1 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=82025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:42:05.184692 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-847abba6-c561-4404-8fc4-677b250859d1 None admin] RBAC: Authorization granted {{(pid=82025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:42:05.191532 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-130d95c5-181a-4566-8b89-4113b9d88e90 None admin] Validating token access rules against request {{(pid=82026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:42:05.199524 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG dbcounter [-] [82026] Writing DB stats keystone:SELECT=100 {{(pid=82026) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:42:05.204912 dv-cinder-828806-6-smb devstack@keystone.service[82025]: [pid: 82025|app: 0|req: 306/621] 10.222.0.33 () {56 vars in 1135 bytes} [Tue Sep 13 19:42:04 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 257 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 19:42:05.206467 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbbb2494-1f5c-4586-b1c2-89283fc20af9 None None] REQUEST_METHOD: `GET` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:42:05.206977 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbbb2494-1f5c-4586-b1c2-89283fc20af9 None None] SCRIPT_NAME: `/identity` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:42:05.207490 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbbb2494-1f5c-4586-b1c2-89283fc20af9 None None] PATH_INFO: `/` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:42:05.209610 dv-cinder-828806-6-smb devstack@keystone.service[82025]: [pid: 82025|app: 0|req: 307/622] 10.222.0.33 () {54 vars in 927 bytes} [Tue Sep 13 19:42:05 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 19:42:05.219788 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbbb2494-1f5c-4586-b1c2-89283fc20af9 None None] Authenticating user token {{(pid=82025) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:42:05.219788 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG dbcounter [-] [82025] Writing DB stats keystone:SELECT=100 {{(pid=82025) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:42:05.233404 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b3149b8-1cc4-42f9-a71c-052a714b5008 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57539b6a6f3b4d589f5f5e1d211cd6a0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:42:05.234670 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b3149b8-1cc4-42f9-a71c-052a714b5008 None admin] REQUEST_METHOD: `GET` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:42:05.234670 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b3149b8-1cc4-42f9-a71c-052a714b5008 None admin] SCRIPT_NAME: `/identity` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:42:05.234967 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b3149b8-1cc4-42f9-a71c-052a714b5008 None admin] PATH_INFO: `/v3/users/nova` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:42:05.242530 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b3149b8-1cc4-42f9-a71c-052a714b5008 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=82026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:42:05.244182 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b3149b8-1cc4-42f9-a71c-052a714b5008 None admin] RBAC: Authorization granted {{(pid=82026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:42:05.257975 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application [None req-0b3149b8-1cc4-42f9-a71c-052a714b5008 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Sep 13 19:42:05.257975 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 19:42:05.257975 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 19:42:05.257975 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 19:42:05.257975 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 19:42:05.257975 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 19:42:05.257975 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 19:42:05.257975 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 19:42:05.257975 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 19:42:05.257975 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 19:42:05.257975 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 19:42:05.257975 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 19:42:05.257975 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 13 19:42:05.257975 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 13 19:42:05.257975 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 13 19:42:05.257975 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 13 19:42:05.258984 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 19:42:05.258984 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 19:42:05.258984 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 13 19:42:05.258984 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 13 19:42:05.258984 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 13 19:42:05.258984 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 13 19:42:05.258984 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 19:42:05.258984 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 19:42:05.258984 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 19:42:05.258984 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 19:42:05.258984 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 19:42:05.258984 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application with Lock( Sep 13 19:42:05.258984 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 19:42:05.258984 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application return self._enter() Sep 13 19:42:05.258984 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 19:42:05.258984 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 19:42:05.258984 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 19:42:05.258984 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application return self.creator() Sep 13 19:42:05.259946 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 19:42:05.259946 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application created_value = creator( Sep 13 19:42:05.259946 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 13 19:42:05.259946 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 13 19:42:05.259946 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 13 19:42:05.259946 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 13 19:42:05.259946 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 13 19:42:05.259946 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 13 19:42:05.259946 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Sep 13 19:42:05.259946 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application Sep 13 19:42:05.259946 dv-cinder-828806-6-smb devstack@keystone.service[82026]: [pid: 82026|app: 0|req: 316/623] 10.222.0.33 () {56 vars in 1093 bytes} [Tue Sep 13 19:42:05 2022] GET /identity/v3/users/nova => generated 82 bytes in 208 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 13 19:42:05.261009 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a27f3469-fdcd-4eb0-9a3b-a655436e99a3 None None] REQUEST_METHOD: `POST` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:42:05.261171 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a27f3469-fdcd-4eb0-9a3b-a655436e99a3 None None] SCRIPT_NAME: `/identity` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:42:05.261431 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a27f3469-fdcd-4eb0-9a3b-a655436e99a3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:42:05.294710 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.auth.core [None req-a27f3469-fdcd-4eb0-9a3b-a655436e99a3 None None] MFA Rules not processed for user `57539b6a6f3b4d589f5f5e1d211cd6a0`. Rule list: `[]` (Enabled: `True`). {{(pid=82026) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 19:42:05.295501 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.common.fernet_utils [None req-a27f3469-fdcd-4eb0-9a3b-a655436e99a3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82026) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 19:42:05.327264 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbbb2494-1f5c-4586-b1c2-89283fc20af9 None None] Validating token access rules against request {{(pid=82025) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:42:05.368632 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d974f835-8406-48d2-b9b1-516aeccb886e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57539b6a6f3b4d589f5f5e1d211cd6a0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82025) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:42:05.369672 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d974f835-8406-48d2-b9b1-516aeccb886e None admin] REQUEST_METHOD: `GET` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:42:05.370186 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d974f835-8406-48d2-b9b1-516aeccb886e None admin] SCRIPT_NAME: `/identity` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:42:05.370667 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d974f835-8406-48d2-b9b1-516aeccb886e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:42:05.377837 dv-cinder-828806-6-smb devstack@keystone.service[82026]: [pid: 82026|app: 0|req: 317/624] 10.222.0.33 () {58 vars in 1024 bytes} [Tue Sep 13 19:42:05 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 13 19:42:05.378737 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a27f3469-fdcd-4eb0-9a3b-a655436e99a3 None None] Authenticating user token {{(pid=82026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:42:05.383925 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d974f835-8406-48d2-b9b1-516aeccb886e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=82025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:42:05.385656 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d974f835-8406-48d2-b9b1-516aeccb886e None admin] RBAC: Authorization granted {{(pid=82025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:42:05.402620 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application [None req-d974f835-8406-48d2-b9b1-516aeccb886e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 13 19:42:05.402620 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 19:42:05.402620 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 19:42:05.402620 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 19:42:05.402620 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 19:42:05.402620 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 19:42:05.402620 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 19:42:05.402620 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 19:42:05.402620 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 19:42:05.402620 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 19:42:05.402620 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 19:42:05.402620 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 19:42:05.402620 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 13 19:42:05.402620 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 13 19:42:05.402620 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 13 19:42:05.402620 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 13 19:42:05.403689 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 19:42:05.403689 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 19:42:05.403689 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 19:42:05.403689 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 19:42:05.403689 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 19:42:05.403689 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 19:42:05.403689 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 19:42:05.403689 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application with Lock( Sep 13 19:42:05.403689 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 19:42:05.403689 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application return self._enter() Sep 13 19:42:05.403689 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 19:42:05.403689 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 19:42:05.403689 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 19:42:05.403689 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application return self.creator() Sep 13 19:42:05.403689 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 19:42:05.403689 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application created_value = creator( Sep 13 19:42:05.403689 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 13 19:42:05.404585 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 13 19:42:05.404585 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 13 19:42:05.404585 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application Sep 13 19:42:05.407529 dv-cinder-828806-6-smb devstack@keystone.service[82025]: [pid: 82025|app: 0|req: 308/625] 10.222.0.33 () {56 vars in 1108 bytes} [Tue Sep 13 19:42:05 2022] GET /identity/v3/domains/Default => generated 87 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 19:42:05.419076 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d974f835-8406-48d2-b9b1-516aeccb886e None admin] Authenticating user token {{(pid=82025) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:42:05.524428 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG dbcounter [-] [82025] Writing DB stats keystone:SELECT=100 {{(pid=82025) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:42:05.525544 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG dbcounter [-] [82026] Writing DB stats keystone:SELECT=100 {{(pid=82026) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:42:05.534075 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a27f3469-fdcd-4eb0-9a3b-a655436e99a3 None None] Validating token access rules against request {{(pid=82026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:42:05.575229 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d974f835-8406-48d2-b9b1-516aeccb886e None admin] Validating token access rules against request {{(pid=82025) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:42:05.576781 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d86963b-e43c-4919-b0b9-a91b575c83e3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57539b6a6f3b4d589f5f5e1d211cd6a0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:42:05.577509 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d86963b-e43c-4919-b0b9-a91b575c83e3 None admin] REQUEST_METHOD: `GET` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:42:05.578743 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d86963b-e43c-4919-b0b9-a91b575c83e3 None admin] SCRIPT_NAME: `/identity` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:42:05.579262 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d86963b-e43c-4919-b0b9-a91b575c83e3 None admin] PATH_INFO: `/v3/users` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:42:05.580907 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d86963b-e43c-4919-b0b9-a91b575c83e3 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=82026) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 19:42:05.581341 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d86963b-e43c-4919-b0b9-a91b575c83e3 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=82026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:42:05.582879 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d86963b-e43c-4919-b0b9-a91b575c83e3 None admin] RBAC: Authorization granted {{(pid=82026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:42:05.607958 dv-cinder-828806-6-smb devstack@keystone.service[82026]: [pid: 82026|app: 0|req: 318/626] 10.222.0.33 () {56 vars in 1133 bytes} [Tue Sep 13 19:42:05 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 227 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 19:42:05.607958 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d9ba509-c07e-4276-aade-848b1c777a2f None None] REQUEST_METHOD: `GET` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:42:05.607958 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d9ba509-c07e-4276-aade-848b1c777a2f None None] SCRIPT_NAME: `/identity` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:42:05.607958 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d9ba509-c07e-4276-aade-848b1c777a2f None None] PATH_INFO: `/` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:42:05.614270 dv-cinder-828806-6-smb devstack@keystone.service[82026]: [pid: 82026|app: 0|req: 319/627] 10.222.0.33 () {54 vars in 927 bytes} [Tue Sep 13 19:42:05 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 19:42:05.615203 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d9ba509-c07e-4276-aade-848b1c777a2f None None] Authenticating user token {{(pid=82026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:42:05.626100 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e877b55c-f44b-4529-a224-454680d8ad1d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57539b6a6f3b4d589f5f5e1d211cd6a0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82025) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:42:05.627053 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e877b55c-f44b-4529-a224-454680d8ad1d None admin] REQUEST_METHOD: `GET` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:42:05.627529 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e877b55c-f44b-4529-a224-454680d8ad1d None admin] SCRIPT_NAME: `/identity` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:42:05.627985 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e877b55c-f44b-4529-a224-454680d8ad1d None admin] PATH_INFO: `/v3/domains` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:42:05.628840 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e877b55c-f44b-4529-a224-454680d8ad1d None admin] RBAC: Adding query filter params (name=Default) {{(pid=82025) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 19:42:05.629406 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e877b55c-f44b-4529-a224-454680d8ad1d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:42:05.631093 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e877b55c-f44b-4529-a224-454680d8ad1d None admin] RBAC: Authorization granted {{(pid=82025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:42:05.650235 dv-cinder-828806-6-smb devstack@keystone.service[82025]: [pid: 82025|app: 0|req: 309/628] 10.222.0.33 () {56 vars in 1109 bytes} [Tue Sep 13 19:42:05 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 232 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 19:42:05.650235 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94255ccc-f0bd-4c7e-bb9e-d8ccf6cba554 None None] REQUEST_METHOD: `POST` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:42:05.650235 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94255ccc-f0bd-4c7e-bb9e-d8ccf6cba554 None None] SCRIPT_NAME: `/identity` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:42:05.650235 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94255ccc-f0bd-4c7e-bb9e-d8ccf6cba554 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:42:05.676976 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.auth.core [None req-94255ccc-f0bd-4c7e-bb9e-d8ccf6cba554 None None] MFA Rules not processed for user `57539b6a6f3b4d589f5f5e1d211cd6a0`. Rule list: `[]` (Enabled: `True`). {{(pid=82025) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 19:42:05.679357 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.fernet_utils [None req-94255ccc-f0bd-4c7e-bb9e-d8ccf6cba554 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82025) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 19:42:05.744317 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d9ba509-c07e-4276-aade-848b1c777a2f None None] Validating token access rules against request {{(pid=82026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:42:05.773065 dv-cinder-828806-6-smb devstack@keystone.service[82025]: [pid: 82025|app: 0|req: 310/629] 10.222.0.33 () {58 vars in 1024 bytes} [Tue Sep 13 19:42:05 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 13 19:42:05.774375 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94255ccc-f0bd-4c7e-bb9e-d8ccf6cba554 None None] Authenticating user token {{(pid=82025) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:42:05.796350 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9c931f4-0e09-4f86-9135-e518efbf1293 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57539b6a6f3b4d589f5f5e1d211cd6a0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:42:05.797544 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9c931f4-0e09-4f86-9135-e518efbf1293 None admin] REQUEST_METHOD: `GET` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:42:05.797830 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9c931f4-0e09-4f86-9135-e518efbf1293 None admin] SCRIPT_NAME: `/identity` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:42:05.798104 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9c931f4-0e09-4f86-9135-e518efbf1293 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:42:05.831211 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG dbcounter [-] [82026] Writing DB stats keystone:SELECT=100 {{(pid=82026) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:42:05.835783 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG dbcounter [-] [82025] Writing DB stats keystone:SELECT=100 {{(pid=82025) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:42:05.881523 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9c931f4-0e09-4f86-9135-e518efbf1293 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=82026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:42:05.883383 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9c931f4-0e09-4f86-9135-e518efbf1293 None admin] RBAC: Authorization granted {{(pid=82026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:42:05.898448 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94255ccc-f0bd-4c7e-bb9e-d8ccf6cba554 None None] Validating token access rules against request {{(pid=82025) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:42:05.934271 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2c47b62-9537-4e8d-957c-dc04bea37d0f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57539b6a6f3b4d589f5f5e1d211cd6a0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82025) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:42:05.934898 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2c47b62-9537-4e8d-957c-dc04bea37d0f None admin] REQUEST_METHOD: `GET` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:42:05.935214 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2c47b62-9537-4e8d-957c-dc04bea37d0f None admin] SCRIPT_NAME: `/identity` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:42:05.935491 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2c47b62-9537-4e8d-957c-dc04bea37d0f None admin] PATH_INFO: `/v3/projects/service` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:42:05.943095 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2c47b62-9537-4e8d-957c-dc04bea37d0f None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=82025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:42:05.944528 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2c47b62-9537-4e8d-957c-dc04bea37d0f None admin] RBAC: Authorization granted {{(pid=82025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:42:05.956447 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application [None req-d2c47b62-9537-4e8d-957c-dc04bea37d0f None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 13 19:42:05.956447 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 19:42:05.956447 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 19:42:05.956447 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 19:42:05.956447 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 19:42:05.956447 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 19:42:05.956447 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 19:42:05.956447 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 19:42:05.956447 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 19:42:05.956447 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 19:42:05.956447 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 19:42:05.956447 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 19:42:05.956447 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 13 19:42:05.956447 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 13 19:42:05.956447 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 13 19:42:05.957359 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 13 19:42:05.957359 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 19:42:05.957359 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 19:42:05.957359 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 19:42:05.957359 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 19:42:05.957359 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 19:42:05.957359 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 19:42:05.957359 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 19:42:05.957359 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application with Lock( Sep 13 19:42:05.957359 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 19:42:05.957359 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application return self._enter() Sep 13 19:42:05.957359 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 19:42:05.957359 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 19:42:05.957359 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 19:42:05.957359 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application return self.creator() Sep 13 19:42:05.957359 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 19:42:05.957359 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application created_value = creator( Sep 13 19:42:05.958819 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 13 19:42:05.958819 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 13 19:42:05.958819 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 13 19:42:05.958819 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 13 19:42:05.958819 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 13 19:42:05.958819 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 13 19:42:05.958819 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 13 19:42:05.958819 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application Sep 13 19:42:05.958819 dv-cinder-828806-6-smb devstack@keystone.service[82025]: [pid: 82025|app: 0|req: 311/630] 10.222.0.33 () {56 vars in 1111 bytes} [Tue Sep 13 19:42:05 2022] GET /identity/v3/projects/service => generated 88 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 19:42:05.958819 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2c47b62-9537-4e8d-957c-dc04bea37d0f None admin] Authenticating user token {{(pid=82025) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:42:05.996600 dv-cinder-828806-6-smb devstack@keystone.service[82026]: [pid: 82026|app: 0|req: 320/631] 10.222.0.33 () {58 vars in 1282 bytes} [Tue Sep 13 19:42:05 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 382 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 13 19:42:05.997860 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f2654aa-b068-464d-893f-582ff6065673 None None] REQUEST_METHOD: `GET` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:42:05.998148 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f2654aa-b068-464d-893f-582ff6065673 None None] SCRIPT_NAME: `/identity` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:42:05.998424 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f2654aa-b068-464d-893f-582ff6065673 None None] PATH_INFO: `/` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:42:06.004504 dv-cinder-828806-6-smb devstack@keystone.service[82026]: [pid: 82026|app: 0|req: 321/632] 10.222.0.33 () {54 vars in 927 bytes} [Tue Sep 13 19:42:05 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 19:42:06.005297 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f2654aa-b068-464d-893f-582ff6065673 None None] Authenticating user token {{(pid=82026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:42:06.074525 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG dbcounter [-] [82026] Writing DB stats keystone:SELECT=100 {{(pid=82026) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:42:06.077662 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2c47b62-9537-4e8d-957c-dc04bea37d0f None admin] Validating token access rules against request {{(pid=82025) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:42:06.081485 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG dbcounter [-] [82025] Writing DB stats keystone:SELECT=100 {{(pid=82025) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:42:06.116219 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1cb3ed3-67d9-46d9-9cc9-3a0cbdbe9614 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57539b6a6f3b4d589f5f5e1d211cd6a0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82025) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:42:06.116847 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1cb3ed3-67d9-46d9-9cc9-3a0cbdbe9614 None admin] REQUEST_METHOD: `GET` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:42:06.117140 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1cb3ed3-67d9-46d9-9cc9-3a0cbdbe9614 None admin] SCRIPT_NAME: `/identity` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:42:06.117412 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1cb3ed3-67d9-46d9-9cc9-3a0cbdbe9614 None admin] PATH_INFO: `/v3/roles/service` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:42:06.124265 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f2654aa-b068-464d-893f-582ff6065673 None None] Validating token access rules against request {{(pid=82026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:42:06.127543 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1cb3ed3-67d9-46d9-9cc9-3a0cbdbe9614 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=82025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 13 19:42:06.132512 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application [None req-c1cb3ed3-67d9-46d9-9cc9-3a0cbdbe9614 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 13 19:42:06.132512 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 19:42:06.132512 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 19:42:06.132512 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 19:42:06.132512 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 19:42:06.132512 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 19:42:06.132512 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 19:42:06.132512 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 19:42:06.132512 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 19:42:06.132512 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 19:42:06.132512 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 19:42:06.132512 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 19:42:06.132512 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 13 19:42:06.132512 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 13 19:42:06.132512 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 13 19:42:06.132512 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 13 19:42:06.133696 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 13 19:42:06.133696 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 13 19:42:06.133696 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 13 19:42:06.133696 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 13 19:42:06.133696 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 19:42:06.133696 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 19:42:06.133696 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 19:42:06.133696 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 19:42:06.133696 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 19:42:06.133696 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 19:42:06.133696 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 19:42:06.133696 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application with Lock( Sep 13 19:42:06.133696 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 19:42:06.133696 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application return self._enter() Sep 13 19:42:06.133696 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 19:42:06.133696 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 19:42:06.134565 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 19:42:06.134565 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application return self.creator() Sep 13 19:42:06.134565 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 19:42:06.134565 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application created_value = creator( Sep 13 19:42:06.134565 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 13 19:42:06.134565 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 13 19:42:06.134565 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 13 19:42:06.134565 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 13 19:42:06.134565 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 13 19:42:06.134565 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 13 19:42:06.134565 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 13 19:42:06.134565 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application Sep 13 19:42:06.134565 dv-cinder-828806-6-smb devstack@keystone.service[82025]: [pid: 82025|app: 0|req: 312/633] 10.222.0.33 () {56 vars in 1102 bytes} [Tue Sep 13 19:42:05 2022] GET /identity/v3/roles/service => generated 85 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 19:42:06.134565 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1cb3ed3-67d9-46d9-9cc9-3a0cbdbe9614 None admin] Authenticating user token {{(pid=82025) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:42:06.161689 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da74a639-35c4-4370-8829-4c054a8b7467 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57539b6a6f3b4d589f5f5e1d211cd6a0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:42:06.162291 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da74a639-35c4-4370-8829-4c054a8b7467 None admin] REQUEST_METHOD: `GET` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:42:06.162584 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da74a639-35c4-4370-8829-4c054a8b7467 None admin] SCRIPT_NAME: `/identity` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:42:06.162856 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da74a639-35c4-4370-8829-4c054a8b7467 None admin] PATH_INFO: `/v3/projects` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:42:06.163576 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da74a639-35c4-4370-8829-4c054a8b7467 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=82026) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 19:42:06.163884 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da74a639-35c4-4370-8829-4c054a8b7467 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=82026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:42:06.165309 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da74a639-35c4-4370-8829-4c054a8b7467 None admin] RBAC: Authorization granted {{(pid=82026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:42:06.176477 dv-cinder-828806-6-smb devstack@keystone.service[82026]: [pid: 82026|app: 0|req: 322/634] 10.222.0.33 () {56 vars in 1148 bytes} [Tue Sep 13 19:42:06 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 19:42:06.177642 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95cb1794-f271-405a-a4d1-e0c1ac880334 None None] REQUEST_METHOD: `POST` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:42:06.177917 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95cb1794-f271-405a-a4d1-e0c1ac880334 None None] SCRIPT_NAME: `/identity` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:42:06.178200 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95cb1794-f271-405a-a4d1-e0c1ac880334 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:42:06.196335 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.auth.core [None req-95cb1794-f271-405a-a4d1-e0c1ac880334 None None] MFA Rules not processed for user `57539b6a6f3b4d589f5f5e1d211cd6a0`. Rule list: `[]` (Enabled: `True`). {{(pid=82026) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 19:42:06.197528 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.common.fernet_utils [None req-95cb1794-f271-405a-a4d1-e0c1ac880334 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82026) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 19:42:06.233757 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1cb3ed3-67d9-46d9-9cc9-3a0cbdbe9614 None admin] Validating token access rules against request {{(pid=82025) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:42:06.261006 dv-cinder-828806-6-smb devstack@keystone.service[82026]: [pid: 82026|app: 0|req: 323/635] 10.222.0.33 () {58 vars in 1024 bytes} [Tue Sep 13 19:42:06 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 13 19:42:06.261854 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95cb1794-f271-405a-a4d1-e0c1ac880334 None None] Authenticating user token {{(pid=82026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:42:06.266674 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88d749dc-4238-40dc-a2e8-125c77c869f6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57539b6a6f3b4d589f5f5e1d211cd6a0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82025) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:42:06.267321 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88d749dc-4238-40dc-a2e8-125c77c869f6 None admin] REQUEST_METHOD: `GET` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:42:06.267602 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88d749dc-4238-40dc-a2e8-125c77c869f6 None admin] SCRIPT_NAME: `/identity` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:42:06.267877 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88d749dc-4238-40dc-a2e8-125c77c869f6 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:42:06.278518 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88d749dc-4238-40dc-a2e8-125c77c869f6 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=82025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:42:06.280567 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88d749dc-4238-40dc-a2e8-125c77c869f6 None admin] RBAC: Authorization granted {{(pid=82025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:42:06.296066 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application [None req-88d749dc-4238-40dc-a2e8-125c77c869f6 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 13 19:42:06.296066 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 19:42:06.296066 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 19:42:06.296066 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 19:42:06.296066 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 19:42:06.296066 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 19:42:06.296066 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 19:42:06.296066 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 19:42:06.296066 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 19:42:06.296066 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 19:42:06.296066 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 19:42:06.296066 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 19:42:06.296066 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 13 19:42:06.296066 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 13 19:42:06.296066 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 13 19:42:06.296066 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 13 19:42:06.297071 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 19:42:06.297071 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 19:42:06.297071 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 19:42:06.297071 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 19:42:06.297071 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 19:42:06.297071 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 19:42:06.297071 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 19:42:06.297071 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application with Lock( Sep 13 19:42:06.297071 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 19:42:06.297071 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application return self._enter() Sep 13 19:42:06.297071 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 19:42:06.297071 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 19:42:06.297071 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 19:42:06.297071 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application return self.creator() Sep 13 19:42:06.297071 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 19:42:06.297071 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application created_value = creator( Sep 13 19:42:06.297071 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 13 19:42:06.297984 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 13 19:42:06.297984 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 13 19:42:06.297984 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application Sep 13 19:42:06.297984 dv-cinder-828806-6-smb devstack@keystone.service[82025]: [pid: 82025|app: 0|req: 313/636] 10.222.0.33 () {56 vars in 1108 bytes} [Tue Sep 13 19:42:06 2022] GET /identity/v3/domains/Default => generated 87 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 19:42:06.298679 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88d749dc-4238-40dc-a2e8-125c77c869f6 None admin] Authenticating user token {{(pid=82025) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:42:06.389380 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95cb1794-f271-405a-a4d1-e0c1ac880334 None None] Validating token access rules against request {{(pid=82026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:42:06.404207 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88d749dc-4238-40dc-a2e8-125c77c869f6 None admin] Validating token access rules against request {{(pid=82025) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:42:06.430582 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2f09cf5-0a95-41db-93de-6b41b47591c3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57539b6a6f3b4d589f5f5e1d211cd6a0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:42:06.431240 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2f09cf5-0a95-41db-93de-6b41b47591c3 None admin] REQUEST_METHOD: `GET` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:42:06.431531 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2f09cf5-0a95-41db-93de-6b41b47591c3 None admin] SCRIPT_NAME: `/identity` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:42:06.431807 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2f09cf5-0a95-41db-93de-6b41b47591c3 None admin] PATH_INFO: `/v3/roles/service` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:42:06.440516 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5d27118-a591-462f-92fc-3613e42de56a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57539b6a6f3b4d589f5f5e1d211cd6a0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82025) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:42:06.441192 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5d27118-a591-462f-92fc-3613e42de56a None admin] REQUEST_METHOD: `GET` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:42:06.441502 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5d27118-a591-462f-92fc-3613e42de56a None admin] SCRIPT_NAME: `/identity` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:42:06.441803 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5d27118-a591-462f-92fc-3613e42de56a None admin] PATH_INFO: `/v3/roles` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:42:06.441918 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2f09cf5-0a95-41db-93de-6b41b47591c3 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=82026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 13 19:42:06.442755 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5d27118-a591-462f-92fc-3613e42de56a None admin] RBAC: Adding query filter params (name=service) {{(pid=82025) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 19:42:06.443606 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5d27118-a591-462f-92fc-3613e42de56a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:42:06.445465 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5d27118-a591-462f-92fc-3613e42de56a None admin] RBAC: Authorization granted {{(pid=82025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:42:06.446679 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application [None req-f2f09cf5-0a95-41db-93de-6b41b47591c3 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 13 19:42:06.446679 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 19:42:06.446679 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 19:42:06.446679 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 19:42:06.446679 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 19:42:06.446679 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 19:42:06.446679 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 19:42:06.446679 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 19:42:06.446679 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 19:42:06.446679 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 19:42:06.446679 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 19:42:06.446679 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 19:42:06.446679 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 13 19:42:06.446679 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 13 19:42:06.446679 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 13 19:42:06.446679 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 13 19:42:06.447659 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 13 19:42:06.447659 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 13 19:42:06.447659 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 13 19:42:06.447659 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 13 19:42:06.447659 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 19:42:06.447659 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 19:42:06.447659 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 19:42:06.447659 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 19:42:06.447659 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 19:42:06.447659 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 19:42:06.447659 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 19:42:06.447659 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application with Lock( Sep 13 19:42:06.447659 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 19:42:06.447659 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application return self._enter() Sep 13 19:42:06.447659 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 19:42:06.447659 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 19:42:06.448526 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 19:42:06.448526 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application return self.creator() Sep 13 19:42:06.448526 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 19:42:06.448526 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application created_value = creator( Sep 13 19:42:06.448526 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 13 19:42:06.448526 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 13 19:42:06.448526 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 13 19:42:06.448526 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 13 19:42:06.448526 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 13 19:42:06.448526 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 13 19:42:06.448526 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 13 19:42:06.448526 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application Sep 13 19:42:06.448526 dv-cinder-828806-6-smb devstack@keystone.service[82026]: [pid: 82026|app: 0|req: 324/637] 10.222.0.33 () {56 vars in 1102 bytes} [Tue Sep 13 19:42:06 2022] GET /identity/v3/roles/service => generated 85 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 19:42:06.449211 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2f09cf5-0a95-41db-93de-6b41b47591c3 None admin] Authenticating user token {{(pid=82026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:42:06.458156 dv-cinder-828806-6-smb devstack@keystone.service[82025]: [pid: 82025|app: 0|req: 314/638] 10.222.0.33 () {56 vars in 1103 bytes} [Tue Sep 13 19:42:06 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 19:42:06.459102 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5d27118-a591-462f-92fc-3613e42de56a None admin] Authenticating user token {{(pid=82025) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:42:06.479661 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG dbcounter [-] [82026] Writing DB stats keystone:SELECT=100 {{(pid=82026) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:42:06.507841 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG dbcounter [-] [82025] Writing DB stats keystone:SELECT=100 {{(pid=82025) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:42:06.557699 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2f09cf5-0a95-41db-93de-6b41b47591c3 None admin] Validating token access rules against request {{(pid=82026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:42:06.560121 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG dbcounter [-] [82026] Writing DB stats keystone:SELECT=100 {{(pid=82026) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:42:06.565513 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG dbcounter [-] [82025] Writing DB stats keystone:SELECT=100 {{(pid=82025) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:42:06.568301 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5d27118-a591-462f-92fc-3613e42de56a None admin] Validating token access rules against request {{(pid=82025) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:42:06.592490 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-229eca0d-0d1a-4488-81e6-f3676cd62d5d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57539b6a6f3b4d589f5f5e1d211cd6a0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:42:06.593971 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-229eca0d-0d1a-4488-81e6-f3676cd62d5d None admin] REQUEST_METHOD: `PUT` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:42:06.594252 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-229eca0d-0d1a-4488-81e6-f3676cd62d5d None admin] SCRIPT_NAME: `/identity` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:42:06.594539 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-229eca0d-0d1a-4488-81e6-f3676cd62d5d None admin] PATH_INFO: `/v3/projects/c8c6fba0f15b4d6a84ff601919b7b8e4/users/fa5a83574f7f424c805e130c462d5969/roles/47ee826cd5f148c19f293f9470f906da` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:42:06.601947 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36f7d5c0-af18-4efd-9297-7405a5dd2d3e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57539b6a6f3b4d589f5f5e1d211cd6a0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82025) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:42:06.604928 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36f7d5c0-af18-4efd-9297-7405a5dd2d3e None admin] REQUEST_METHOD: `GET` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:42:06.604928 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36f7d5c0-af18-4efd-9297-7405a5dd2d3e None admin] SCRIPT_NAME: `/identity` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:42:06.604928 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36f7d5c0-af18-4efd-9297-7405a5dd2d3e None admin] PATH_INFO: `/v3/domains` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:42:06.604928 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36f7d5c0-af18-4efd-9297-7405a5dd2d3e None admin] RBAC: Adding query filter params (name=Default) {{(pid=82025) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 19:42:06.604928 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36f7d5c0-af18-4efd-9297-7405a5dd2d3e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:42:06.605428 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36f7d5c0-af18-4efd-9297-7405a5dd2d3e None admin] RBAC: Authorization granted {{(pid=82025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:42:06.609543 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-229eca0d-0d1a-4488-81e6-f3676cd62d5d None admin] RBAC: Authorizing `identity:create_grant(project_id=c8c6fba0f15b4d6a84ff601919b7b8e4, user_id=fa5a83574f7f424c805e130c462d5969, role_id=47ee826cd5f148c19f293f9470f906da)` {{(pid=82026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:42:06.610942 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-229eca0d-0d1a-4488-81e6-f3676cd62d5d None admin] RBAC: Authorization granted {{(pid=82026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:42:06.617672 dv-cinder-828806-6-smb devstack@keystone.service[82025]: [pid: 82025|app: 0|req: 315/639] 10.222.0.33 () {56 vars in 1109 bytes} [Tue Sep 13 19:42:06 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 19:42:06.618471 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36f7d5c0-af18-4efd-9297-7405a5dd2d3e None admin] Authenticating user token {{(pid=82025) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:42:06.669474 dv-cinder-828806-6-smb devstack@keystone.service[82026]: [pid: 82026|app: 0|req: 325/640] 10.222.0.33 () {58 vars in 1439 bytes} [Tue Sep 13 19:42:06 2022] PUT /identity/v3/projects/c8c6fba0f15b4d6a84ff601919b7b8e4/users/fa5a83574f7f424c805e130c462d5969/roles/47ee826cd5f148c19f293f9470f906da => generated 0 bytes in 221 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 19:42:06.670292 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-229eca0d-0d1a-4488-81e6-f3676cd62d5d None admin] Authenticating user token {{(pid=82026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:42:06.732685 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36f7d5c0-af18-4efd-9297-7405a5dd2d3e None admin] Validating token access rules against request {{(pid=82025) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:42:06.780778 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2ff890a-ac5d-43d5-88bd-ad5d97c17a85 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57539b6a6f3b4d589f5f5e1d211cd6a0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82025) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:42:06.782564 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2ff890a-ac5d-43d5-88bd-ad5d97c17a85 None admin] REQUEST_METHOD: `GET` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:42:06.783080 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2ff890a-ac5d-43d5-88bd-ad5d97c17a85 None admin] SCRIPT_NAME: `/identity` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:42:06.783544 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2ff890a-ac5d-43d5-88bd-ad5d97c17a85 None admin] PATH_INFO: `/v3/roles` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:42:06.784284 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2ff890a-ac5d-43d5-88bd-ad5d97c17a85 None admin] RBAC: Adding query filter params (name=service) {{(pid=82025) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 19:42:06.784599 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2ff890a-ac5d-43d5-88bd-ad5d97c17a85 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:42:06.785984 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2ff890a-ac5d-43d5-88bd-ad5d97c17a85 None admin] RBAC: Authorization granted {{(pid=82025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:42:06.791657 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG dbcounter [-] [82025] Writing DB stats keystone:SELECT=100 {{(pid=82025) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:42:06.798594 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-229eca0d-0d1a-4488-81e6-f3676cd62d5d None admin] Validating token access rules against request {{(pid=82026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:42:06.799435 dv-cinder-828806-6-smb devstack@keystone.service[82025]: [pid: 82025|app: 0|req: 316/641] 10.222.0.33 () {56 vars in 1103 bytes} [Tue Sep 13 19:42:06 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 19:42:06.800911 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2ff890a-ac5d-43d5-88bd-ad5d97c17a85 None admin] Authenticating user token {{(pid=82025) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:42:06.836773 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78fc68d0-6db3-497b-9413-c3854cf2e598 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57539b6a6f3b4d589f5f5e1d211cd6a0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:42:06.837734 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78fc68d0-6db3-497b-9413-c3854cf2e598 None admin] REQUEST_METHOD: `GET` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:42:06.838014 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78fc68d0-6db3-497b-9413-c3854cf2e598 None admin] SCRIPT_NAME: `/identity` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:42:06.838295 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78fc68d0-6db3-497b-9413-c3854cf2e598 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:42:06.852840 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78fc68d0-6db3-497b-9413-c3854cf2e598 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=82026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:42:06.854900 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78fc68d0-6db3-497b-9413-c3854cf2e598 None admin] RBAC: Authorization granted {{(pid=82026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:42:06.870229 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application [None req-78fc68d0-6db3-497b-9413-c3854cf2e598 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 13 19:42:06.870229 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 19:42:06.870229 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 19:42:06.870229 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 19:42:06.870229 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 19:42:06.870229 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 19:42:06.870229 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 19:42:06.870229 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 19:42:06.870229 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 19:42:06.870229 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 19:42:06.870229 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 19:42:06.870229 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 19:42:06.870229 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 13 19:42:06.870229 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 13 19:42:06.870229 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 13 19:42:06.870229 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 13 19:42:06.871259 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 19:42:06.871259 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 19:42:06.871259 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 19:42:06.871259 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 19:42:06.871259 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 19:42:06.871259 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 19:42:06.871259 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 19:42:06.871259 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application with Lock( Sep 13 19:42:06.871259 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 19:42:06.871259 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application return self._enter() Sep 13 19:42:06.871259 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 19:42:06.871259 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 19:42:06.871259 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 19:42:06.871259 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application return self.creator() Sep 13 19:42:06.871259 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 19:42:06.871259 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application created_value = creator( Sep 13 19:42:06.871259 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 13 19:42:06.872152 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 13 19:42:06.872152 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 13 19:42:06.872152 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application Sep 13 19:42:06.872152 dv-cinder-828806-6-smb devstack@keystone.service[82026]: [pid: 82026|app: 0|req: 326/642] 10.222.0.33 () {56 vars in 1108 bytes} [Tue Sep 13 19:42:06 2022] GET /identity/v3/domains/Default => generated 87 bytes in 201 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 19:42:06.872152 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78fc68d0-6db3-497b-9413-c3854cf2e598 None admin] Authenticating user token {{(pid=82026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:42:06.884141 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG dbcounter [-] [82026] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82026) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:42:06.930770 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2ff890a-ac5d-43d5-88bd-ad5d97c17a85 None admin] Validating token access rules against request {{(pid=82025) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:42:06.975655 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c6feb76-cd3e-4784-a24e-1d802a916d0d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57539b6a6f3b4d589f5f5e1d211cd6a0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82025) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:42:06.976530 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c6feb76-cd3e-4784-a24e-1d802a916d0d None admin] REQUEST_METHOD: `GET` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:42:06.976956 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c6feb76-cd3e-4784-a24e-1d802a916d0d None admin] SCRIPT_NAME: `/identity` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:42:06.977401 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c6feb76-cd3e-4784-a24e-1d802a916d0d None admin] PATH_INFO: `/v3/roles/service` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:42:06.988411 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c6feb76-cd3e-4784-a24e-1d802a916d0d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=82025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 13 19:42:06.991952 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78fc68d0-6db3-497b-9413-c3854cf2e598 None admin] Validating token access rules against request {{(pid=82026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:42:06.994983 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application [None req-8c6feb76-cd3e-4784-a24e-1d802a916d0d None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 13 19:42:06.994983 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 19:42:06.994983 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 19:42:06.994983 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 19:42:06.994983 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 19:42:06.994983 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 19:42:06.994983 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 19:42:06.994983 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 19:42:06.994983 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 19:42:06.994983 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 19:42:06.994983 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 19:42:06.994983 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 19:42:06.994983 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 13 19:42:06.994983 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 13 19:42:06.994983 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 13 19:42:06.994983 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 13 19:42:06.996195 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 13 19:42:06.996195 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 13 19:42:06.996195 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 13 19:42:06.996195 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 13 19:42:06.996195 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 19:42:06.996195 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 19:42:06.996195 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 19:42:06.996195 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 19:42:06.996195 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 19:42:06.996195 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 19:42:06.996195 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 19:42:06.996195 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application with Lock( Sep 13 19:42:06.996195 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 19:42:06.996195 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application return self._enter() Sep 13 19:42:06.996195 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 19:42:06.996195 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 19:42:06.997229 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 19:42:06.997229 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application return self.creator() Sep 13 19:42:06.997229 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 19:42:06.997229 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application created_value = creator( Sep 13 19:42:06.997229 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 13 19:42:06.997229 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 13 19:42:06.997229 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 13 19:42:06.997229 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 13 19:42:06.997229 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 13 19:42:06.997229 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 13 19:42:06.997229 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 13 19:42:06.997229 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application Sep 13 19:42:06.999243 dv-cinder-828806-6-smb devstack@keystone.service[82025]: [pid: 82025|app: 0|req: 317/643] 10.222.0.33 () {56 vars in 1102 bytes} [Tue Sep 13 19:42:06 2022] GET /identity/v3/roles/service => generated 85 bytes in 199 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 19:42:07.000211 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c6feb76-cd3e-4784-a24e-1d802a916d0d None admin] Authenticating user token {{(pid=82025) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:42:07.036679 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dc9352d-a775-4b36-ba81-b865bdc1ff21 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57539b6a6f3b4d589f5f5e1d211cd6a0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:42:07.037320 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dc9352d-a775-4b36-ba81-b865bdc1ff21 None admin] REQUEST_METHOD: `GET` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:42:07.037607 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dc9352d-a775-4b36-ba81-b865bdc1ff21 None admin] SCRIPT_NAME: `/identity` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:42:07.037887 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dc9352d-a775-4b36-ba81-b865bdc1ff21 None admin] PATH_INFO: `/v3/projects/service` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:42:07.044867 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dc9352d-a775-4b36-ba81-b865bdc1ff21 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=82026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:42:07.046333 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dc9352d-a775-4b36-ba81-b865bdc1ff21 None admin] RBAC: Authorization granted {{(pid=82026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:42:07.058345 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application [None req-7dc9352d-a775-4b36-ba81-b865bdc1ff21 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 13 19:42:07.058345 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 19:42:07.058345 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 19:42:07.058345 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 19:42:07.058345 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 19:42:07.058345 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 19:42:07.058345 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 19:42:07.058345 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 19:42:07.058345 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 19:42:07.058345 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 19:42:07.058345 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 19:42:07.058345 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 19:42:07.058345 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 13 19:42:07.058345 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 13 19:42:07.058345 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 13 19:42:07.059475 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 13 19:42:07.059475 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 19:42:07.059475 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 19:42:07.059475 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 19:42:07.059475 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 19:42:07.059475 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 19:42:07.059475 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 19:42:07.059475 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 19:42:07.059475 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application with Lock( Sep 13 19:42:07.059475 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 19:42:07.059475 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application return self._enter() Sep 13 19:42:07.059475 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 19:42:07.059475 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 19:42:07.059475 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 19:42:07.059475 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application return self.creator() Sep 13 19:42:07.059475 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 19:42:07.059475 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application created_value = creator( Sep 13 19:42:07.060523 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 13 19:42:07.060523 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 13 19:42:07.060523 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 13 19:42:07.060523 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 13 19:42:07.060523 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 13 19:42:07.060523 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 13 19:42:07.060523 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 13 19:42:07.060523 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application Sep 13 19:42:07.060523 dv-cinder-828806-6-smb devstack@keystone.service[82026]: [pid: 82026|app: 0|req: 327/644] 10.222.0.33 () {56 vars in 1111 bytes} [Tue Sep 13 19:42:06 2022] GET /identity/v3/projects/service => generated 88 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 19:42:07.061021 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dc9352d-a775-4b36-ba81-b865bdc1ff21 None admin] Authenticating user token {{(pid=82026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:42:07.077292 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG dbcounter [-] [82025] Writing DB stats keystone:SELECT=100 {{(pid=82025) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:42:07.121268 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c6feb76-cd3e-4784-a24e-1d802a916d0d None admin] Validating token access rules against request {{(pid=82025) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:42:07.130805 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG dbcounter [-] [82026] Writing DB stats keystone:SELECT=100 {{(pid=82026) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:42:07.160256 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1db7637a-0759-4d64-88a5-cfe784029092 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57539b6a6f3b4d589f5f5e1d211cd6a0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82025) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:42:07.161117 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1db7637a-0759-4d64-88a5-cfe784029092 None admin] REQUEST_METHOD: `GET` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:42:07.161499 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1db7637a-0759-4d64-88a5-cfe784029092 None admin] SCRIPT_NAME: `/identity` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:42:07.161822 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1db7637a-0759-4d64-88a5-cfe784029092 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:42:07.167159 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dc9352d-a775-4b36-ba81-b865bdc1ff21 None admin] Validating token access rules against request {{(pid=82026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:42:07.173387 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1db7637a-0759-4d64-88a5-cfe784029092 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=82025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:42:07.174898 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1db7637a-0759-4d64-88a5-cfe784029092 None admin] RBAC: Authorization granted {{(pid=82025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:42:07.189927 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application [None req-1db7637a-0759-4d64-88a5-cfe784029092 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 13 19:42:07.189927 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 19:42:07.189927 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 19:42:07.189927 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 19:42:07.189927 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 19:42:07.189927 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 19:42:07.189927 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 19:42:07.189927 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 19:42:07.189927 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 19:42:07.189927 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 19:42:07.189927 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 19:42:07.189927 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 19:42:07.189927 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 13 19:42:07.189927 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 13 19:42:07.189927 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 13 19:42:07.189927 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 13 19:42:07.191312 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 19:42:07.191312 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 19:42:07.191312 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 19:42:07.191312 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 19:42:07.191312 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 19:42:07.191312 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 19:42:07.191312 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 19:42:07.191312 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application with Lock( Sep 13 19:42:07.191312 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 19:42:07.191312 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application return self._enter() Sep 13 19:42:07.191312 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 19:42:07.191312 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 19:42:07.191312 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 19:42:07.191312 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application return self.creator() Sep 13 19:42:07.191312 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 19:42:07.191312 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application created_value = creator( Sep 13 19:42:07.191312 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 13 19:42:07.192414 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 13 19:42:07.192414 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 13 19:42:07.192414 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application Sep 13 19:42:07.195490 dv-cinder-828806-6-smb devstack@keystone.service[82025]: [pid: 82025|app: 0|req: 318/645] 10.222.0.33 () {56 vars in 1108 bytes} [Tue Sep 13 19:42:06 2022] GET /identity/v3/domains/Default => generated 87 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 19:42:07.196210 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1db7637a-0759-4d64-88a5-cfe784029092 None admin] Authenticating user token {{(pid=82025) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:42:07.206767 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e4610d5-fad6-45ba-a39d-814ef755573c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57539b6a6f3b4d589f5f5e1d211cd6a0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:42:07.207586 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e4610d5-fad6-45ba-a39d-814ef755573c None admin] REQUEST_METHOD: `GET` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:42:07.207962 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e4610d5-fad6-45ba-a39d-814ef755573c None admin] SCRIPT_NAME: `/identity` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:42:07.208340 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e4610d5-fad6-45ba-a39d-814ef755573c None admin] PATH_INFO: `/v3/domains` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:42:07.209088 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e4610d5-fad6-45ba-a39d-814ef755573c None admin] RBAC: Adding query filter params (name=Default) {{(pid=82026) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 19:42:07.209505 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e4610d5-fad6-45ba-a39d-814ef755573c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:42:07.210885 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e4610d5-fad6-45ba-a39d-814ef755573c None admin] RBAC: Authorization granted {{(pid=82026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:42:07.228123 dv-cinder-828806-6-smb devstack@keystone.service[82026]: [pid: 82026|app: 0|req: 328/646] 10.222.0.33 () {56 vars in 1109 bytes} [Tue Sep 13 19:42:07 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 19:42:07.228123 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e4610d5-fad6-45ba-a39d-814ef755573c None admin] Authenticating user token {{(pid=82026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:42:07.310027 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1db7637a-0759-4d64-88a5-cfe784029092 None admin] Validating token access rules against request {{(pid=82025) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:42:07.323981 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG dbcounter [-] [82025] Writing DB stats keystone:SELECT=100 {{(pid=82025) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:42:07.338369 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e4610d5-fad6-45ba-a39d-814ef755573c None admin] Validating token access rules against request {{(pid=82026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:42:07.351252 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bf31b85-56a8-4cf6-81b1-ef273cb583ce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57539b6a6f3b4d589f5f5e1d211cd6a0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82025) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:42:07.351252 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bf31b85-56a8-4cf6-81b1-ef273cb583ce None admin] REQUEST_METHOD: `GET` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:42:07.351252 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bf31b85-56a8-4cf6-81b1-ef273cb583ce None admin] SCRIPT_NAME: `/identity` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:42:07.351661 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bf31b85-56a8-4cf6-81b1-ef273cb583ce None admin] PATH_INFO: `/v3/roles` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:42:07.352740 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bf31b85-56a8-4cf6-81b1-ef273cb583ce None admin] RBAC: Adding query filter params (name=service) {{(pid=82025) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 19:42:07.353671 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bf31b85-56a8-4cf6-81b1-ef273cb583ce None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:42:07.355494 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bf31b85-56a8-4cf6-81b1-ef273cb583ce None admin] RBAC: Authorization granted {{(pid=82025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:42:07.365564 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG dbcounter [-] [82026] Writing DB stats keystone:SELECT=100 {{(pid=82026) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:42:07.368540 dv-cinder-828806-6-smb devstack@keystone.service[82025]: [pid: 82025|app: 0|req: 319/647] 10.222.0.33 () {56 vars in 1103 bytes} [Tue Sep 13 19:42:07 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 19:42:07.369952 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bf31b85-56a8-4cf6-81b1-ef273cb583ce None admin] Authenticating user token {{(pid=82025) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:42:07.377491 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8e1765a-4af9-4ce1-815c-e88f9803065a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57539b6a6f3b4d589f5f5e1d211cd6a0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:42:07.378143 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8e1765a-4af9-4ce1-815c-e88f9803065a None admin] REQUEST_METHOD: `GET` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:42:07.378428 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8e1765a-4af9-4ce1-815c-e88f9803065a None admin] SCRIPT_NAME: `/identity` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:42:07.378705 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8e1765a-4af9-4ce1-815c-e88f9803065a None admin] PATH_INFO: `/v3/projects` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:42:07.379461 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8e1765a-4af9-4ce1-815c-e88f9803065a None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=82026) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 19:42:07.379801 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8e1765a-4af9-4ce1-815c-e88f9803065a None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=82026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:42:07.381338 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8e1765a-4af9-4ce1-815c-e88f9803065a None admin] RBAC: Authorization granted {{(pid=82026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:42:07.398800 dv-cinder-828806-6-smb devstack@keystone.service[82026]: [pid: 82026|app: 0|req: 329/648] 10.222.0.33 () {56 vars in 1148 bytes} [Tue Sep 13 19:42:07 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 19:42:07.398800 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8e1765a-4af9-4ce1-815c-e88f9803065a None admin] Authenticating user token {{(pid=82026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:42:07.489462 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bf31b85-56a8-4cf6-81b1-ef273cb583ce None admin] Validating token access rules against request {{(pid=82025) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:42:07.522627 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8e1765a-4af9-4ce1-815c-e88f9803065a None admin] Validating token access rules against request {{(pid=82026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:42:07.528075 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee1c10bc-5700-43de-8314-6be3b6a63eba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57539b6a6f3b4d589f5f5e1d211cd6a0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82025) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:42:07.528691 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee1c10bc-5700-43de-8314-6be3b6a63eba None admin] REQUEST_METHOD: `GET` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:42:07.528980 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee1c10bc-5700-43de-8314-6be3b6a63eba None admin] SCRIPT_NAME: `/identity` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:42:07.529264 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee1c10bc-5700-43de-8314-6be3b6a63eba None admin] PATH_INFO: `/v3/domains` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:42:07.530078 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee1c10bc-5700-43de-8314-6be3b6a63eba None admin] RBAC: Adding query filter params (name=Default) {{(pid=82025) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 19:42:07.530395 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee1c10bc-5700-43de-8314-6be3b6a63eba None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:42:07.532133 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee1c10bc-5700-43de-8314-6be3b6a63eba None admin] RBAC: Authorization granted {{(pid=82025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:42:07.544905 dv-cinder-828806-6-smb devstack@keystone.service[82025]: [pid: 82025|app: 0|req: 320/649] 10.222.0.33 () {56 vars in 1109 bytes} [Tue Sep 13 19:42:07 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 19:42:07.545787 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee1c10bc-5700-43de-8314-6be3b6a63eba None admin] Authenticating user token {{(pid=82025) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:42:07.563738 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bccb7157-3622-43f2-9e1c-cefc88e3c4b4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57539b6a6f3b4d589f5f5e1d211cd6a0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:42:07.564458 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bccb7157-3622-43f2-9e1c-cefc88e3c4b4 None admin] REQUEST_METHOD: `GET` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:42:07.564747 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bccb7157-3622-43f2-9e1c-cefc88e3c4b4 None admin] SCRIPT_NAME: `/identity` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:42:07.565026 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bccb7157-3622-43f2-9e1c-cefc88e3c4b4 None admin] PATH_INFO: `/v3/users/cinder` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:42:07.576794 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bccb7157-3622-43f2-9e1c-cefc88e3c4b4 None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=82026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:42:07.579118 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bccb7157-3622-43f2-9e1c-cefc88e3c4b4 None admin] RBAC: Authorization granted {{(pid=82026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:42:07.591836 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG dbcounter [-] [82025] Writing DB stats keystone:SELECT=100 {{(pid=82025) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:42:07.593462 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application [None req-bccb7157-3622-43f2-9e1c-cefc88e3c4b4 None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Sep 13 19:42:07.593462 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 19:42:07.593462 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 19:42:07.593462 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 19:42:07.593462 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 19:42:07.593462 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 19:42:07.593462 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 19:42:07.593462 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 19:42:07.593462 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 19:42:07.593462 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 19:42:07.593462 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 19:42:07.593462 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 19:42:07.593462 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 13 19:42:07.593462 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 13 19:42:07.593462 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 13 19:42:07.593462 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 13 19:42:07.596345 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 19:42:07.596345 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 19:42:07.596345 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 13 19:42:07.596345 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 13 19:42:07.596345 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 13 19:42:07.596345 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 13 19:42:07.596345 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 19:42:07.596345 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 19:42:07.596345 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 19:42:07.596345 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 19:42:07.596345 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 19:42:07.596345 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application with Lock( Sep 13 19:42:07.596345 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 19:42:07.596345 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application return self._enter() Sep 13 19:42:07.596345 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 19:42:07.596345 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 19:42:07.596345 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 19:42:07.596345 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application return self.creator() Sep 13 19:42:07.597314 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 19:42:07.597314 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application created_value = creator( Sep 13 19:42:07.597314 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 13 19:42:07.597314 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 13 19:42:07.597314 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 13 19:42:07.597314 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 13 19:42:07.597314 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 13 19:42:07.597314 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 13 19:42:07.597314 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Sep 13 19:42:07.597314 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application Sep 13 19:42:07.599466 dv-cinder-828806-6-smb devstack@keystone.service[82026]: [pid: 82026|app: 0|req: 330/650] 10.222.0.33 () {56 vars in 1099 bytes} [Tue Sep 13 19:42:07 2022] GET /identity/v3/users/cinder => generated 84 bytes in 205 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 19:42:07.600404 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bccb7157-3622-43f2-9e1c-cefc88e3c4b4 None admin] Authenticating user token {{(pid=82026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:42:07.661485 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG dbcounter [-] [82026] Writing DB stats keystone:SELECT=100 {{(pid=82026) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:42:07.702444 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee1c10bc-5700-43de-8314-6be3b6a63eba None admin] Validating token access rules against request {{(pid=82025) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:42:07.734554 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bccb7157-3622-43f2-9e1c-cefc88e3c4b4 None admin] Validating token access rules against request {{(pid=82026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:42:07.750633 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0fe5339-c1f2-4577-97f2-303e6a552fba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57539b6a6f3b4d589f5f5e1d211cd6a0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82025) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:42:07.751225 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0fe5339-c1f2-4577-97f2-303e6a552fba None admin] REQUEST_METHOD: `GET` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:42:07.751511 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0fe5339-c1f2-4577-97f2-303e6a552fba None admin] SCRIPT_NAME: `/identity` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:42:07.752749 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0fe5339-c1f2-4577-97f2-303e6a552fba None admin] PATH_INFO: `/v3/domains/Default` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:42:07.770871 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0fe5339-c1f2-4577-97f2-303e6a552fba None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=82025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:42:07.772427 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e225b17b-ca89-45c0-9a38-5c3d8091ee6e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57539b6a6f3b4d589f5f5e1d211cd6a0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:42:07.773041 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e225b17b-ca89-45c0-9a38-5c3d8091ee6e None admin] REQUEST_METHOD: `GET` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:42:07.773329 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e225b17b-ca89-45c0-9a38-5c3d8091ee6e None admin] SCRIPT_NAME: `/identity` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:42:07.773505 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0fe5339-c1f2-4577-97f2-303e6a552fba None admin] RBAC: Authorization granted {{(pid=82025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:42:07.773601 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e225b17b-ca89-45c0-9a38-5c3d8091ee6e None admin] PATH_INFO: `/v3/role_assignments` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:42:07.774326 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e225b17b-ca89-45c0-9a38-5c3d8091ee6e None admin] RBAC: Adding query filter params (role.id=47ee826cd5f148c19f293f9470f906da, scope.project.id=c8c6fba0f15b4d6a84ff601919b7b8e4, user.id=e66e7034abed4e0bad1f4137520c1e70) {{(pid=82026) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 19:42:07.774642 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e225b17b-ca89-45c0-9a38-5c3d8091ee6e None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=82026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:42:07.776101 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e225b17b-ca89-45c0-9a38-5c3d8091ee6e None admin] RBAC: Authorization granted {{(pid=82026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:42:07.790684 dv-cinder-828806-6-smb devstack@keystone.service[82026]: [pid: 82026|app: 0|req: 331/651] 10.222.0.33 () {56 vars in 1374 bytes} [Tue Sep 13 19:42:07 2022] GET /identity/v3/role_assignments?user.id=e66e7034abed4e0bad1f4137520c1e70&scope.project.id=c8c6fba0f15b4d6a84ff601919b7b8e4&role.id=47ee826cd5f148c19f293f9470f906da => generated 608 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 19:42:07.790684 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e225b17b-ca89-45c0-9a38-5c3d8091ee6e None admin] Authenticating user token {{(pid=82026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:42:07.802478 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application [None req-a0fe5339-c1f2-4577-97f2-303e6a552fba None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 13 19:42:07.802478 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 19:42:07.802478 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 19:42:07.802478 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 19:42:07.802478 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 19:42:07.802478 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 19:42:07.802478 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 19:42:07.802478 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 19:42:07.802478 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 19:42:07.802478 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 19:42:07.802478 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 19:42:07.802478 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 19:42:07.802478 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 13 19:42:07.802478 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 13 19:42:07.802478 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 13 19:42:07.802478 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 13 19:42:07.803779 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 19:42:07.803779 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 19:42:07.803779 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 19:42:07.803779 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 19:42:07.803779 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 19:42:07.803779 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 19:42:07.803779 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 19:42:07.803779 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application with Lock( Sep 13 19:42:07.803779 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 19:42:07.803779 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application return self._enter() Sep 13 19:42:07.803779 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 19:42:07.803779 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 19:42:07.803779 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 19:42:07.803779 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application return self.creator() Sep 13 19:42:07.803779 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 19:42:07.803779 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application created_value = creator( Sep 13 19:42:07.803779 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 13 19:42:07.804898 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 13 19:42:07.804898 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 13 19:42:07.804898 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application Sep 13 19:42:07.809340 dv-cinder-828806-6-smb devstack@keystone.service[82025]: [pid: 82025|app: 0|req: 321/652] 10.222.0.33 () {56 vars in 1108 bytes} [Tue Sep 13 19:42:07 2022] GET /identity/v3/domains/Default => generated 87 bytes in 264 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 19:42:07.810863 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0fe5339-c1f2-4577-97f2-303e6a552fba None admin] Authenticating user token {{(pid=82025) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:42:07.930260 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG dbcounter [-] [82025] Writing DB stats keystone:SELECT=100 {{(pid=82025) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:42:07.938236 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e225b17b-ca89-45c0-9a38-5c3d8091ee6e None admin] Validating token access rules against request {{(pid=82026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:42:07.947262 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0fe5339-c1f2-4577-97f2-303e6a552fba None admin] Validating token access rules against request {{(pid=82025) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:42:07.954050 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG dbcounter [-] [82026] Writing DB stats keystone:SELECT=100 {{(pid=82026) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:42:07.993247 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ada42b50-5dbf-4775-8a94-d88edf2a12db None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57539b6a6f3b4d589f5f5e1d211cd6a0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:42:07.995569 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ada42b50-5dbf-4775-8a94-d88edf2a12db None admin] REQUEST_METHOD: `GET` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:42:07.996114 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ada42b50-5dbf-4775-8a94-d88edf2a12db None admin] SCRIPT_NAME: `/identity` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:42:07.997541 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ada42b50-5dbf-4775-8a94-d88edf2a12db None admin] PATH_INFO: `/v3/users/glance` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:42:07.999075 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07ab7668-ba00-4868-9bd1-c7fe8717c49e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57539b6a6f3b4d589f5f5e1d211cd6a0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82025) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:42:08.000614 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07ab7668-ba00-4868-9bd1-c7fe8717c49e None admin] REQUEST_METHOD: `GET` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:42:08.001069 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07ab7668-ba00-4868-9bd1-c7fe8717c49e None admin] SCRIPT_NAME: `/identity` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:42:08.001291 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07ab7668-ba00-4868-9bd1-c7fe8717c49e None admin] PATH_INFO: `/v3/users` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:42:08.003597 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07ab7668-ba00-4868-9bd1-c7fe8717c49e None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=82025) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 19:42:08.003963 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07ab7668-ba00-4868-9bd1-c7fe8717c49e None admin] RBAC: Authorizing `identity:list_users()` {{(pid=82025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:42:08.005448 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07ab7668-ba00-4868-9bd1-c7fe8717c49e None admin] RBAC: Authorization granted {{(pid=82025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:42:08.012792 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ada42b50-5dbf-4775-8a94-d88edf2a12db None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=82026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:42:08.017052 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ada42b50-5dbf-4775-8a94-d88edf2a12db None admin] RBAC: Authorization granted {{(pid=82026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:42:08.028814 dv-cinder-828806-6-smb devstack@keystone.service[82025]: [pid: 82025|app: 0|req: 322/653] 10.222.0.33 () {56 vars in 1137 bytes} [Tue Sep 13 19:42:07 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 217 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 19:42:08.028814 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07ab7668-ba00-4868-9bd1-c7fe8717c49e None admin] Authenticating user token {{(pid=82025) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:42:08.039176 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application [None req-ada42b50-5dbf-4775-8a94-d88edf2a12db None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Sep 13 19:42:08.039176 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 19:42:08.039176 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 19:42:08.039176 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 19:42:08.039176 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 19:42:08.039176 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 19:42:08.039176 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 19:42:08.039176 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 19:42:08.039176 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 19:42:08.039176 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 19:42:08.039176 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 19:42:08.039176 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 19:42:08.039176 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 13 19:42:08.039176 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 13 19:42:08.039176 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 13 19:42:08.039176 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 13 19:42:08.040246 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 19:42:08.040246 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 19:42:08.040246 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 13 19:42:08.040246 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 13 19:42:08.040246 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 13 19:42:08.040246 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 13 19:42:08.040246 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 19:42:08.040246 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 19:42:08.040246 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 19:42:08.040246 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 19:42:08.040246 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 19:42:08.040246 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application with Lock( Sep 13 19:42:08.040246 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 19:42:08.040246 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application return self._enter() Sep 13 19:42:08.040246 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 19:42:08.040246 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 19:42:08.040246 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 19:42:08.040246 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application return self.creator() Sep 13 19:42:08.041196 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 19:42:08.041196 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application created_value = creator( Sep 13 19:42:08.041196 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 13 19:42:08.041196 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 13 19:42:08.041196 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 13 19:42:08.041196 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 13 19:42:08.041196 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 13 19:42:08.041196 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 13 19:42:08.041196 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. Sep 13 19:42:08.041196 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application Sep 13 19:42:08.041196 dv-cinder-828806-6-smb devstack@keystone.service[82026]: [pid: 82026|app: 0|req: 332/654] 10.222.0.33 () {56 vars in 1099 bytes} [Tue Sep 13 19:42:07 2022] GET /identity/v3/users/glance => generated 84 bytes in 257 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 19:42:08.041795 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ada42b50-5dbf-4775-8a94-d88edf2a12db None admin] Authenticating user token {{(pid=82026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:42:08.192858 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ada42b50-5dbf-4775-8a94-d88edf2a12db None admin] Validating token access rules against request {{(pid=82026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:42:08.210781 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07ab7668-ba00-4868-9bd1-c7fe8717c49e None admin] Validating token access rules against request {{(pid=82025) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:42:08.244434 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ee24b1b-b131-4369-aa54-2b06d96f7bff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57539b6a6f3b4d589f5f5e1d211cd6a0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:42:08.245578 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ee24b1b-b131-4369-aa54-2b06d96f7bff None admin] REQUEST_METHOD: `GET` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:42:08.246347 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ee24b1b-b131-4369-aa54-2b06d96f7bff None admin] SCRIPT_NAME: `/identity` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:42:08.247158 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ee24b1b-b131-4369-aa54-2b06d96f7bff None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:42:08.256411 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed82e4e1-f32a-49e6-a5ef-c34ea2fa6eb1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57539b6a6f3b4d589f5f5e1d211cd6a0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82025) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:42:08.257240 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed82e4e1-f32a-49e6-a5ef-c34ea2fa6eb1 None admin] REQUEST_METHOD: `GET` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:42:08.257666 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed82e4e1-f32a-49e6-a5ef-c34ea2fa6eb1 None admin] SCRIPT_NAME: `/identity` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:42:08.258097 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed82e4e1-f32a-49e6-a5ef-c34ea2fa6eb1 None admin] PATH_INFO: `/v3/domains` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:42:08.258899 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed82e4e1-f32a-49e6-a5ef-c34ea2fa6eb1 None admin] RBAC: Adding query filter params (name=Default) {{(pid=82025) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 19:42:08.259373 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed82e4e1-f32a-49e6-a5ef-c34ea2fa6eb1 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:42:08.260873 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed82e4e1-f32a-49e6-a5ef-c34ea2fa6eb1 None admin] RBAC: Authorization granted {{(pid=82025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:42:08.276569 dv-cinder-828806-6-smb devstack@keystone.service[82025]: [pid: 82025|app: 0|req: 323/655] 10.222.0.33 () {56 vars in 1109 bytes} [Tue Sep 13 19:42:08 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 249 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 19:42:08.277684 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed82e4e1-f32a-49e6-a5ef-c34ea2fa6eb1 None admin] Authenticating user token {{(pid=82025) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:42:08.291509 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG dbcounter [-] [82025] Writing DB stats keystone:SELECT=100 {{(pid=82025) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:42:08.324942 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG dbcounter [-] [82026] Writing DB stats keystone:SELECT=100 {{(pid=82026) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:42:08.368558 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ee24b1b-b131-4369-aa54-2b06d96f7bff None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=82026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:42:08.371022 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ee24b1b-b131-4369-aa54-2b06d96f7bff None admin] RBAC: Authorization granted {{(pid=82026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:42:08.450722 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed82e4e1-f32a-49e6-a5ef-c34ea2fa6eb1 None admin] Validating token access rules against request {{(pid=82025) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:42:08.504146 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c74131a-fb0a-473b-88c8-c2b442cd4340 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57539b6a6f3b4d589f5f5e1d211cd6a0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82025) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:42:08.506337 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c74131a-fb0a-473b-88c8-c2b442cd4340 None admin] REQUEST_METHOD: `GET` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:42:08.506761 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c74131a-fb0a-473b-88c8-c2b442cd4340 None admin] SCRIPT_NAME: `/identity` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:42:08.507025 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c74131a-fb0a-473b-88c8-c2b442cd4340 None admin] PATH_INFO: `/v3/users` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:42:08.507869 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c74131a-fb0a-473b-88c8-c2b442cd4340 None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=82025) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 19:42:08.508251 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c74131a-fb0a-473b-88c8-c2b442cd4340 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=82025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:42:08.509874 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c74131a-fb0a-473b-88c8-c2b442cd4340 None admin] RBAC: Authorization granted {{(pid=82025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:42:08.516518 dv-cinder-828806-6-smb devstack@keystone.service[82026]: [pid: 82026|app: 0|req: 333/656] 10.222.0.33 () {58 vars in 1282 bytes} [Tue Sep 13 19:42:08 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 474 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 13 19:42:08.517375 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ee24b1b-b131-4369-aa54-2b06d96f7bff None admin] Authenticating user token {{(pid=82026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:42:08.542395 dv-cinder-828806-6-smb devstack@keystone.service[82025]: [pid: 82025|app: 0|req: 324/657] 10.222.0.33 () {56 vars in 1137 bytes} [Tue Sep 13 19:42:08 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 265 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 19:42:08.543916 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c74131a-fb0a-473b-88c8-c2b442cd4340 None admin] Authenticating user token {{(pid=82025) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:42:08.612104 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG dbcounter [-] [82026] Writing DB stats keystone:SELECT=100 {{(pid=82026) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:42:08.631695 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG dbcounter [-] [82025] Writing DB stats keystone:SELECT=100 {{(pid=82025) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:42:08.643218 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ee24b1b-b131-4369-aa54-2b06d96f7bff None admin] Validating token access rules against request {{(pid=82026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:42:08.682417 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c81c3856-6ac6-425b-833c-5546d5c24d42 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57539b6a6f3b4d589f5f5e1d211cd6a0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:42:08.683104 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c81c3856-6ac6-425b-833c-5546d5c24d42 None admin] REQUEST_METHOD: `GET` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:42:08.683394 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c81c3856-6ac6-425b-833c-5546d5c24d42 None admin] SCRIPT_NAME: `/identity` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:42:08.683668 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c81c3856-6ac6-425b-833c-5546d5c24d42 None admin] PATH_INFO: `/v3/users/neutron` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:42:08.686419 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c74131a-fb0a-473b-88c8-c2b442cd4340 None admin] Validating token access rules against request {{(pid=82025) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:42:08.693414 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c81c3856-6ac6-425b-833c-5546d5c24d42 None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=82026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:42:08.694872 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c81c3856-6ac6-425b-833c-5546d5c24d42 None admin] RBAC: Authorization granted {{(pid=82026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:42:08.710377 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application [None req-c81c3856-6ac6-425b-833c-5546d5c24d42 None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Sep 13 19:42:08.710377 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 19:42:08.710377 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 19:42:08.710377 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 19:42:08.710377 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 19:42:08.710377 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 19:42:08.710377 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 19:42:08.710377 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 19:42:08.710377 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 19:42:08.710377 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 19:42:08.710377 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 19:42:08.710377 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 19:42:08.710377 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 13 19:42:08.710377 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 13 19:42:08.710377 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 13 19:42:08.710377 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 13 19:42:08.711397 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 19:42:08.711397 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 19:42:08.711397 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 13 19:42:08.711397 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 13 19:42:08.711397 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 13 19:42:08.711397 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 13 19:42:08.711397 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 19:42:08.711397 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 19:42:08.711397 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 19:42:08.711397 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 19:42:08.711397 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 19:42:08.711397 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application with Lock( Sep 13 19:42:08.711397 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 19:42:08.711397 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application return self._enter() Sep 13 19:42:08.711397 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 19:42:08.711397 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 19:42:08.711397 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 19:42:08.711397 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application return self.creator() Sep 13 19:42:08.712330 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 19:42:08.712330 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application created_value = creator( Sep 13 19:42:08.712330 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 13 19:42:08.712330 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 13 19:42:08.712330 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 13 19:42:08.712330 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 13 19:42:08.712330 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 13 19:42:08.712330 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 13 19:42:08.712330 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. Sep 13 19:42:08.712330 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application Sep 13 19:42:08.716652 dv-cinder-828806-6-smb devstack@keystone.service[82026]: [pid: 82026|app: 0|req: 334/658] 10.222.0.33 () {56 vars in 1102 bytes} [Tue Sep 13 19:42:08 2022] GET /identity/v3/users/neutron => generated 85 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 19:42:08.717501 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c81c3856-6ac6-425b-833c-5546d5c24d42 None admin] Authenticating user token {{(pid=82026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:42:08.738359 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f43e3a64-731d-40a0-a892-15dceee9d8ba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57539b6a6f3b4d589f5f5e1d211cd6a0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82025) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:42:08.739945 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f43e3a64-731d-40a0-a892-15dceee9d8ba None admin] REQUEST_METHOD: `GET` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:42:08.740771 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f43e3a64-731d-40a0-a892-15dceee9d8ba None admin] SCRIPT_NAME: `/identity` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:42:08.741280 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f43e3a64-731d-40a0-a892-15dceee9d8ba None admin] PATH_INFO: `/v3/domains/Default` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:42:08.756556 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f43e3a64-731d-40a0-a892-15dceee9d8ba None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=82025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:42:08.759309 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f43e3a64-731d-40a0-a892-15dceee9d8ba None admin] RBAC: Authorization granted {{(pid=82025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:42:08.785365 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application [None req-f43e3a64-731d-40a0-a892-15dceee9d8ba None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 13 19:42:08.785365 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 19:42:08.785365 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 19:42:08.785365 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 19:42:08.785365 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 19:42:08.785365 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 19:42:08.785365 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 19:42:08.785365 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 19:42:08.785365 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 19:42:08.785365 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 19:42:08.785365 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 19:42:08.785365 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 19:42:08.785365 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 13 19:42:08.785365 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 13 19:42:08.785365 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 13 19:42:08.785365 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 13 19:42:08.786387 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 19:42:08.786387 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 19:42:08.786387 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 19:42:08.786387 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 19:42:08.786387 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 19:42:08.786387 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 19:42:08.786387 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 19:42:08.786387 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application with Lock( Sep 13 19:42:08.786387 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 19:42:08.786387 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application return self._enter() Sep 13 19:42:08.786387 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 19:42:08.786387 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 19:42:08.786387 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 19:42:08.786387 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application return self.creator() Sep 13 19:42:08.786387 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 19:42:08.786387 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application created_value = creator( Sep 13 19:42:08.786387 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 13 19:42:08.787298 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 13 19:42:08.787298 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 13 19:42:08.787298 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application Sep 13 19:42:08.793470 dv-cinder-828806-6-smb devstack@keystone.service[82025]: [pid: 82025|app: 0|req: 325/659] 10.222.0.33 () {56 vars in 1108 bytes} [Tue Sep 13 19:42:08 2022] GET /identity/v3/domains/Default => generated 87 bytes in 245 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 19:42:08.793470 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f43e3a64-731d-40a0-a892-15dceee9d8ba None admin] Authenticating user token {{(pid=82025) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:42:08.847923 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c81c3856-6ac6-425b-833c-5546d5c24d42 None admin] Validating token access rules against request {{(pid=82026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:42:08.886813 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG dbcounter [-] [82026] Writing DB stats keystone:SELECT=100 {{(pid=82026) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:42:08.894188 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22f2dba4-4b66-4a8a-b875-1ac1b1e092a9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57539b6a6f3b4d589f5f5e1d211cd6a0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:42:08.895385 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22f2dba4-4b66-4a8a-b875-1ac1b1e092a9 None admin] REQUEST_METHOD: `GET` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:42:08.896038 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22f2dba4-4b66-4a8a-b875-1ac1b1e092a9 None admin] SCRIPT_NAME: `/identity` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:42:08.896528 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22f2dba4-4b66-4a8a-b875-1ac1b1e092a9 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:42:08.919956 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f43e3a64-731d-40a0-a892-15dceee9d8ba None admin] Validating token access rules against request {{(pid=82025) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:42:08.936338 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG dbcounter [-] [82025] Writing DB stats keystone:SELECT=100 {{(pid=82025) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:42:08.969131 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-382d58ec-3baf-4552-9013-56aabca55fa3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57539b6a6f3b4d589f5f5e1d211cd6a0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82025) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:42:08.969751 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-382d58ec-3baf-4552-9013-56aabca55fa3 None admin] REQUEST_METHOD: `GET` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:42:08.970038 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-382d58ec-3baf-4552-9013-56aabca55fa3 None admin] SCRIPT_NAME: `/identity` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:42:08.970318 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-382d58ec-3baf-4552-9013-56aabca55fa3 None admin] PATH_INFO: `/v3/users` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:42:08.971122 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-382d58ec-3baf-4552-9013-56aabca55fa3 None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=82025) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 19:42:08.971402 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-382d58ec-3baf-4552-9013-56aabca55fa3 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=82025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:42:08.973149 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-382d58ec-3baf-4552-9013-56aabca55fa3 None admin] RBAC: Authorization granted {{(pid=82025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:42:08.981540 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22f2dba4-4b66-4a8a-b875-1ac1b1e092a9 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=82026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:42:08.983070 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22f2dba4-4b66-4a8a-b875-1ac1b1e092a9 None admin] RBAC: Authorization granted {{(pid=82026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:42:08.996993 dv-cinder-828806-6-smb devstack@keystone.service[82025]: [pid: 82025|app: 0|req: 326/660] 10.222.0.33 () {56 vars in 1139 bytes} [Tue Sep 13 19:42:08 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 19:42:08.997690 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-382d58ec-3baf-4552-9013-56aabca55fa3 None admin] Authenticating user token {{(pid=82025) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:42:09.109840 dv-cinder-828806-6-smb devstack@keystone.service[82026]: [pid: 82026|app: 0|req: 335/661] 10.222.0.33 () {58 vars in 1282 bytes} [Tue Sep 13 19:42:08 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 388 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 13 19:42:09.109840 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77b864a2-b1cc-4084-80ca-19e4031b54e1 None None] REQUEST_METHOD: `GET` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:42:09.109840 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77b864a2-b1cc-4084-80ca-19e4031b54e1 None None] SCRIPT_NAME: `/identity` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:42:09.109840 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77b864a2-b1cc-4084-80ca-19e4031b54e1 None None] PATH_INFO: `/` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:42:09.110660 dv-cinder-828806-6-smb devstack@keystone.service[82026]: [pid: 82026|app: 0|req: 336/662] 10.222.0.33 () {54 vars in 927 bytes} [Tue Sep 13 19:42:09 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 19:42:09.111643 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77b864a2-b1cc-4084-80ca-19e4031b54e1 None None] Authenticating user token {{(pid=82026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:42:09.123151 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-382d58ec-3baf-4552-9013-56aabca55fa3 None admin] Validating token access rules against request {{(pid=82025) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:42:09.142526 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG dbcounter [-] [82026] Writing DB stats keystone:SELECT=100 {{(pid=82026) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:42:09.162591 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-300d7689-fe0b-4dcc-8f5c-d32140ea4fda None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57539b6a6f3b4d589f5f5e1d211cd6a0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82025) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:42:09.163240 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-300d7689-fe0b-4dcc-8f5c-d32140ea4fda None admin] REQUEST_METHOD: `GET` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:42:09.163560 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-300d7689-fe0b-4dcc-8f5c-d32140ea4fda None admin] SCRIPT_NAME: `/identity` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:42:09.163799 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-300d7689-fe0b-4dcc-8f5c-d32140ea4fda None admin] PATH_INFO: `/v3/domains` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:42:09.164465 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-300d7689-fe0b-4dcc-8f5c-d32140ea4fda None admin] RBAC: Adding query filter params (name=Default) {{(pid=82025) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 19:42:09.164751 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-300d7689-fe0b-4dcc-8f5c-d32140ea4fda None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:42:09.166106 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-300d7689-fe0b-4dcc-8f5c-d32140ea4fda None admin] RBAC: Authorization granted {{(pid=82025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:42:09.182722 dv-cinder-828806-6-smb devstack@keystone.service[82025]: [pid: 82025|app: 0|req: 327/663] 10.222.0.33 () {56 vars in 1109 bytes} [Tue Sep 13 19:42:08 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 19:42:09.182722 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-300d7689-fe0b-4dcc-8f5c-d32140ea4fda None admin] Authenticating user token {{(pid=82025) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:42:09.216149 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG dbcounter [-] [82025] Writing DB stats keystone:SELECT=100 {{(pid=82025) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:42:09.218828 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77b864a2-b1cc-4084-80ca-19e4031b54e1 None None] Validating token access rules against request {{(pid=82026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:42:09.256514 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94b6e602-7e6c-4a2b-8429-551b1057aef4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57539b6a6f3b4d589f5f5e1d211cd6a0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:42:09.257122 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94b6e602-7e6c-4a2b-8429-551b1057aef4 None admin] REQUEST_METHOD: `GET` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:42:09.257405 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94b6e602-7e6c-4a2b-8429-551b1057aef4 None admin] SCRIPT_NAME: `/identity` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:42:09.257683 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94b6e602-7e6c-4a2b-8429-551b1057aef4 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:42:09.292118 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-300d7689-fe0b-4dcc-8f5c-d32140ea4fda None admin] Validating token access rules against request {{(pid=82025) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:42:09.330398 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9efa269-9da4-4b0d-ad72-b8a26d1b5121 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57539b6a6f3b4d589f5f5e1d211cd6a0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82025) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:42:09.331360 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9efa269-9da4-4b0d-ad72-b8a26d1b5121 None admin] REQUEST_METHOD: `GET` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:42:09.331583 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94b6e602-7e6c-4a2b-8429-551b1057aef4 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=82026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:42:09.332013 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9efa269-9da4-4b0d-ad72-b8a26d1b5121 None admin] SCRIPT_NAME: `/identity` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:42:09.332486 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9efa269-9da4-4b0d-ad72-b8a26d1b5121 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:42:09.333052 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94b6e602-7e6c-4a2b-8429-551b1057aef4 None admin] RBAC: Authorization granted {{(pid=82026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:42:09.345580 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9efa269-9da4-4b0d-ad72-b8a26d1b5121 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=82025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:42:09.347140 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9efa269-9da4-4b0d-ad72-b8a26d1b5121 None admin] RBAC: Authorization granted {{(pid=82025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:42:09.361713 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application [None req-f9efa269-9da4-4b0d-ad72-b8a26d1b5121 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 13 19:42:09.361713 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 19:42:09.361713 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 19:42:09.361713 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 19:42:09.361713 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 19:42:09.361713 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 19:42:09.361713 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 19:42:09.361713 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 19:42:09.361713 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 19:42:09.361713 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 19:42:09.361713 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 19:42:09.361713 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 19:42:09.361713 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 13 19:42:09.361713 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 13 19:42:09.361713 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 13 19:42:09.361713 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 13 19:42:09.362643 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 19:42:09.362643 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 19:42:09.362643 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 19:42:09.362643 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 19:42:09.362643 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 19:42:09.362643 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 19:42:09.362643 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 19:42:09.362643 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application with Lock( Sep 13 19:42:09.362643 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 19:42:09.362643 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application return self._enter() Sep 13 19:42:09.362643 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 19:42:09.362643 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 19:42:09.362643 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 19:42:09.362643 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application return self.creator() Sep 13 19:42:09.362643 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 19:42:09.362643 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application created_value = creator( Sep 13 19:42:09.362643 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 13 19:42:09.363593 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 13 19:42:09.363593 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 13 19:42:09.363593 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application Sep 13 19:42:09.363593 dv-cinder-828806-6-smb devstack@keystone.service[82025]: [pid: 82025|app: 0|req: 328/664] 10.222.0.33 () {56 vars in 1108 bytes} [Tue Sep 13 19:42:09 2022] GET /identity/v3/domains/Default => generated 87 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 19:42:09.364252 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a56fe8c-a881-45e7-89e7-5c80b3232ba1 None None] REQUEST_METHOD: `POST` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:42:09.364252 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a56fe8c-a881-45e7-89e7-5c80b3232ba1 None None] SCRIPT_NAME: `/identity` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:42:09.364485 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a56fe8c-a881-45e7-89e7-5c80b3232ba1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:42:09.370367 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG dbcounter [-] [82026] Writing DB stats keystone:SELECT=100 {{(pid=82026) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:42:09.382471 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.auth.core [None req-0a56fe8c-a881-45e7-89e7-5c80b3232ba1 None None] MFA Rules not processed for user `57539b6a6f3b4d589f5f5e1d211cd6a0`. Rule list: `[]` (Enabled: `True`). {{(pid=82025) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 19:42:09.383698 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.fernet_utils [None req-0a56fe8c-a881-45e7-89e7-5c80b3232ba1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82025) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 19:42:09.446405 dv-cinder-828806-6-smb devstack@keystone.service[82026]: [pid: 82026|app: 0|req: 337/665] 10.222.0.33 () {58 vars in 1282 bytes} [Tue Sep 13 19:42:09 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 335 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 13 19:42:09.447280 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94b6e602-7e6c-4a2b-8429-551b1057aef4 None admin] Authenticating user token {{(pid=82026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:42:09.460375 dv-cinder-828806-6-smb devstack@keystone.service[82025]: [pid: 82025|app: 0|req: 329/666] 10.222.0.33 () {58 vars in 1024 bytes} [Tue Sep 13 19:42:09 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 13 19:42:09.461752 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a56fe8c-a881-45e7-89e7-5c80b3232ba1 None None] Authenticating user token {{(pid=82025) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:42:09.478109 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG dbcounter [-] [82025] Writing DB stats keystone:SELECT=100 {{(pid=82025) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:42:09.572095 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a56fe8c-a881-45e7-89e7-5c80b3232ba1 None None] Validating token access rules against request {{(pid=82025) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:42:09.576124 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94b6e602-7e6c-4a2b-8429-551b1057aef4 None admin] Validating token access rules against request {{(pid=82026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:42:09.607803 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f9129ce-bfe2-4c62-b211-c5c82a186607 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57539b6a6f3b4d589f5f5e1d211cd6a0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82025) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:42:09.608407 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f9129ce-bfe2-4c62-b211-c5c82a186607 None admin] REQUEST_METHOD: `GET` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:42:09.608687 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f9129ce-bfe2-4c62-b211-c5c82a186607 None admin] SCRIPT_NAME: `/identity` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:42:09.608960 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f9129ce-bfe2-4c62-b211-c5c82a186607 None admin] PATH_INFO: `/v3/domains` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:42:09.609627 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f9129ce-bfe2-4c62-b211-c5c82a186607 None admin] RBAC: Adding query filter params (name=Default) {{(pid=82025) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 19:42:09.609929 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f9129ce-bfe2-4c62-b211-c5c82a186607 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:42:09.611319 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f9129ce-bfe2-4c62-b211-c5c82a186607 None admin] RBAC: Authorization granted {{(pid=82025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:42:09.620619 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG dbcounter [-] [82026] Writing DB stats keystone:SELECT=100 {{(pid=82026) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:42:09.627990 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08b097d6-e96a-4888-8b37-1c27b266c605 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57539b6a6f3b4d589f5f5e1d211cd6a0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:42:09.628837 dv-cinder-828806-6-smb devstack@keystone.service[82025]: [pid: 82025|app: 0|req: 330/667] 10.222.0.33 () {56 vars in 1109 bytes} [Tue Sep 13 19:42:09 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 19:42:09.629258 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08b097d6-e96a-4888-8b37-1c27b266c605 None admin] REQUEST_METHOD: `GET` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:42:09.629819 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08b097d6-e96a-4888-8b37-1c27b266c605 None admin] SCRIPT_NAME: `/identity` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:42:09.629926 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f9129ce-bfe2-4c62-b211-c5c82a186607 None admin] Authenticating user token {{(pid=82025) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:42:09.630365 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08b097d6-e96a-4888-8b37-1c27b266c605 None admin] PATH_INFO: `/v3/projects/service` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:42:09.639896 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08b097d6-e96a-4888-8b37-1c27b266c605 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=82026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:42:09.643117 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08b097d6-e96a-4888-8b37-1c27b266c605 None admin] RBAC: Authorization granted {{(pid=82026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:42:09.658868 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application [None req-08b097d6-e96a-4888-8b37-1c27b266c605 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 13 19:42:09.658868 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 19:42:09.658868 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 19:42:09.658868 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 19:42:09.658868 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 19:42:09.658868 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 19:42:09.658868 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 19:42:09.658868 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 19:42:09.658868 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 19:42:09.658868 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 19:42:09.658868 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 19:42:09.658868 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 19:42:09.658868 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 13 19:42:09.658868 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 13 19:42:09.658868 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 13 19:42:09.659892 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 13 19:42:09.659892 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 19:42:09.659892 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 19:42:09.659892 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 19:42:09.659892 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 19:42:09.659892 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 19:42:09.659892 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 19:42:09.659892 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 19:42:09.659892 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application with Lock( Sep 13 19:42:09.659892 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 19:42:09.659892 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application return self._enter() Sep 13 19:42:09.659892 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 19:42:09.659892 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 19:42:09.659892 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 19:42:09.659892 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application return self.creator() Sep 13 19:42:09.659892 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 19:42:09.659892 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application created_value = creator( Sep 13 19:42:09.660795 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 13 19:42:09.660795 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 13 19:42:09.660795 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 13 19:42:09.660795 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 13 19:42:09.660795 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 13 19:42:09.660795 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 13 19:42:09.660795 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 13 19:42:09.660795 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application Sep 13 19:42:09.664481 dv-cinder-828806-6-smb devstack@keystone.service[82026]: [pid: 82026|app: 0|req: 338/668] 10.222.0.33 () {56 vars in 1111 bytes} [Tue Sep 13 19:42:09 2022] GET /identity/v3/projects/service => generated 88 bytes in 217 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 19:42:09.665498 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08b097d6-e96a-4888-8b37-1c27b266c605 None admin] Authenticating user token {{(pid=82026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:42:09.718514 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG dbcounter [-] [82025] Writing DB stats keystone:SELECT=100 {{(pid=82025) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:42:09.746647 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f9129ce-bfe2-4c62-b211-c5c82a186607 None admin] Validating token access rules against request {{(pid=82025) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:42:09.785716 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08b097d6-e96a-4888-8b37-1c27b266c605 None admin] Validating token access rules against request {{(pid=82026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:42:09.786394 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6edbb9c-76b5-4030-8e85-fdcc7fee52b6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57539b6a6f3b4d589f5f5e1d211cd6a0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82025) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:42:09.787390 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6edbb9c-76b5-4030-8e85-fdcc7fee52b6 None admin] REQUEST_METHOD: `GET` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:42:09.787833 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6edbb9c-76b5-4030-8e85-fdcc7fee52b6 None admin] SCRIPT_NAME: `/identity` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:42:09.789002 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6edbb9c-76b5-4030-8e85-fdcc7fee52b6 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:42:09.803533 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6edbb9c-76b5-4030-8e85-fdcc7fee52b6 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=82025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:42:09.805184 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6edbb9c-76b5-4030-8e85-fdcc7fee52b6 None admin] RBAC: Authorization granted {{(pid=82025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:42:09.819594 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5d01179-2898-4fe8-bcec-d2f9b91bf765 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57539b6a6f3b4d589f5f5e1d211cd6a0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:42:09.820229 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5d01179-2898-4fe8-bcec-d2f9b91bf765 None admin] REQUEST_METHOD: `GET` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:42:09.820514 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5d01179-2898-4fe8-bcec-d2f9b91bf765 None admin] SCRIPT_NAME: `/identity` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:42:09.820789 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5d01179-2898-4fe8-bcec-d2f9b91bf765 None admin] PATH_INFO: `/v3/projects/service` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:42:09.824188 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application [None req-d6edbb9c-76b5-4030-8e85-fdcc7fee52b6 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 13 19:42:09.824188 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 19:42:09.824188 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 19:42:09.824188 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 19:42:09.824188 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 19:42:09.824188 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 19:42:09.824188 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 19:42:09.824188 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 19:42:09.824188 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 19:42:09.824188 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 19:42:09.824188 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 19:42:09.824188 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 19:42:09.824188 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 13 19:42:09.824188 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 13 19:42:09.824188 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 13 19:42:09.824188 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 13 19:42:09.825274 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 19:42:09.825274 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 19:42:09.825274 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 19:42:09.825274 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 19:42:09.825274 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 19:42:09.825274 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 19:42:09.825274 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 19:42:09.825274 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application with Lock( Sep 13 19:42:09.825274 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 19:42:09.825274 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application return self._enter() Sep 13 19:42:09.825274 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 19:42:09.825274 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 19:42:09.825274 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 19:42:09.825274 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application return self.creator() Sep 13 19:42:09.825274 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 19:42:09.825274 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application created_value = creator( Sep 13 19:42:09.825274 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 13 19:42:09.826387 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 13 19:42:09.826387 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 13 19:42:09.826387 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application Sep 13 19:42:09.827660 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5d01179-2898-4fe8-bcec-d2f9b91bf765 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=82026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:42:09.828210 dv-cinder-828806-6-smb devstack@keystone.service[82025]: [pid: 82025|app: 0|req: 331/669] 10.222.0.33 () {56 vars in 1108 bytes} [Tue Sep 13 19:42:09 2022] GET /identity/v3/domains/Default => generated 87 bytes in 199 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 19:42:09.829243 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6edbb9c-76b5-4030-8e85-fdcc7fee52b6 None admin] Authenticating user token {{(pid=82025) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:42:09.833090 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5d01179-2898-4fe8-bcec-d2f9b91bf765 None admin] RBAC: Authorization granted {{(pid=82026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:42:09.845814 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application [None req-b5d01179-2898-4fe8-bcec-d2f9b91bf765 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 13 19:42:09.845814 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 19:42:09.845814 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 19:42:09.845814 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 19:42:09.845814 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 19:42:09.845814 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 19:42:09.845814 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 19:42:09.845814 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 19:42:09.845814 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 19:42:09.845814 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 19:42:09.845814 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 19:42:09.845814 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 19:42:09.845814 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 13 19:42:09.845814 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 13 19:42:09.845814 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 13 19:42:09.846722 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 13 19:42:09.846722 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 19:42:09.846722 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 19:42:09.846722 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 19:42:09.846722 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 19:42:09.846722 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 19:42:09.846722 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 19:42:09.846722 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 19:42:09.846722 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application with Lock( Sep 13 19:42:09.846722 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 19:42:09.846722 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application return self._enter() Sep 13 19:42:09.846722 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 19:42:09.846722 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 19:42:09.846722 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 19:42:09.846722 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application return self.creator() Sep 13 19:42:09.846722 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 19:42:09.846722 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application created_value = creator( Sep 13 19:42:09.852700 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 13 19:42:09.852700 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 13 19:42:09.852700 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 13 19:42:09.852700 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 13 19:42:09.852700 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 13 19:42:09.852700 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 13 19:42:09.852700 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 13 19:42:09.852700 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application Sep 13 19:42:09.852700 dv-cinder-828806-6-smb devstack@keystone.service[82026]: [pid: 82026|app: 0|req: 339/670] 10.222.0.33 () {56 vars in 1111 bytes} [Tue Sep 13 19:42:09 2022] GET /identity/v3/projects/service => generated 88 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 19:42:09.852700 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5d01179-2898-4fe8-bcec-d2f9b91bf765 None admin] Authenticating user token {{(pid=82026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:42:09.906790 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG dbcounter [-] [82026] Writing DB stats keystone:SELECT=100 {{(pid=82026) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:42:09.945863 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6edbb9c-76b5-4030-8e85-fdcc7fee52b6 None admin] Validating token access rules against request {{(pid=82025) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:42:09.962985 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5d01179-2898-4fe8-bcec-d2f9b91bf765 None admin] Validating token access rules against request {{(pid=82026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:42:09.973372 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG dbcounter [-] [82025] Writing DB stats keystone:SELECT=100 {{(pid=82025) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:42:09.982303 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d05e95e1-c0cc-4287-b863-9b963e73b532 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57539b6a6f3b4d589f5f5e1d211cd6a0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82025) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:42:09.982947 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d05e95e1-c0cc-4287-b863-9b963e73b532 None admin] REQUEST_METHOD: `GET` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:42:09.983265 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d05e95e1-c0cc-4287-b863-9b963e73b532 None admin] SCRIPT_NAME: `/identity` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:42:09.983539 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d05e95e1-c0cc-4287-b863-9b963e73b532 None admin] PATH_INFO: `/v3/projects` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:42:09.987318 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d05e95e1-c0cc-4287-b863-9b963e73b532 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=82025) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 19:42:09.987318 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d05e95e1-c0cc-4287-b863-9b963e73b532 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=82025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:42:09.987318 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d05e95e1-c0cc-4287-b863-9b963e73b532 None admin] RBAC: Authorization granted {{(pid=82025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:42:09.998306 dv-cinder-828806-6-smb devstack@keystone.service[82025]: [pid: 82025|app: 0|req: 332/671] 10.222.0.33 () {56 vars in 1148 bytes} [Tue Sep 13 19:42:09 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 19:42:09.999145 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d05e95e1-c0cc-4287-b863-9b963e73b532 None admin] Authenticating user token {{(pid=82025) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:42:10.008173 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1f1a952-306c-467d-9e58-2d2ef9698fc7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57539b6a6f3b4d589f5f5e1d211cd6a0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:42:10.008820 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1f1a952-306c-467d-9e58-2d2ef9698fc7 None admin] REQUEST_METHOD: `GET` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:42:10.009101 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1f1a952-306c-467d-9e58-2d2ef9698fc7 None admin] SCRIPT_NAME: `/identity` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:42:10.009375 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1f1a952-306c-467d-9e58-2d2ef9698fc7 None admin] PATH_INFO: `/v3/roles/service` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:42:10.020374 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1f1a952-306c-467d-9e58-2d2ef9698fc7 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=82026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 13 19:42:10.025586 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application [None req-b1f1a952-306c-467d-9e58-2d2ef9698fc7 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 13 19:42:10.025586 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 19:42:10.025586 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 19:42:10.025586 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 19:42:10.025586 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 19:42:10.025586 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 19:42:10.025586 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 19:42:10.025586 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 19:42:10.025586 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 19:42:10.025586 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 19:42:10.025586 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 19:42:10.025586 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 19:42:10.025586 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 13 19:42:10.025586 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 13 19:42:10.025586 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 13 19:42:10.025586 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 13 19:42:10.026528 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 13 19:42:10.026528 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 13 19:42:10.026528 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 13 19:42:10.026528 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 13 19:42:10.026528 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 19:42:10.026528 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 19:42:10.026528 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 19:42:10.026528 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 19:42:10.026528 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 19:42:10.026528 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 19:42:10.026528 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 19:42:10.026528 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application with Lock( Sep 13 19:42:10.026528 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 19:42:10.026528 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application return self._enter() Sep 13 19:42:10.026528 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 19:42:10.026528 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 19:42:10.027418 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 19:42:10.027418 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application return self.creator() Sep 13 19:42:10.027418 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 19:42:10.027418 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application created_value = creator( Sep 13 19:42:10.027418 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 13 19:42:10.027418 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 13 19:42:10.027418 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 13 19:42:10.027418 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 13 19:42:10.027418 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 13 19:42:10.027418 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 13 19:42:10.027418 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 13 19:42:10.027418 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application Sep 13 19:42:10.027418 dv-cinder-828806-6-smb devstack@keystone.service[82026]: [pid: 82026|app: 0|req: 340/672] 10.222.0.33 () {56 vars in 1102 bytes} [Tue Sep 13 19:42:09 2022] GET /identity/v3/roles/service => generated 85 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 19:42:10.028563 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1f1a952-306c-467d-9e58-2d2ef9698fc7 None admin] Authenticating user token {{(pid=82026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:42:10.118034 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d05e95e1-c0cc-4287-b863-9b963e73b532 None admin] Validating token access rules against request {{(pid=82025) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:42:10.143175 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1f1a952-306c-467d-9e58-2d2ef9698fc7 None admin] Validating token access rules against request {{(pid=82026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:42:10.153786 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1944a7da-7235-4575-a3e6-1f71593a9233 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57539b6a6f3b4d589f5f5e1d211cd6a0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82025) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:42:10.154449 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1944a7da-7235-4575-a3e6-1f71593a9233 None admin] REQUEST_METHOD: `GET` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:42:10.154681 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1944a7da-7235-4575-a3e6-1f71593a9233 None admin] SCRIPT_NAME: `/identity` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:42:10.154958 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1944a7da-7235-4575-a3e6-1f71593a9233 None admin] PATH_INFO: `/v3/domains` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:42:10.155711 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG dbcounter [-] [82026] Writing DB stats keystone:SELECT=100 {{(pid=82026) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:42:10.155824 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1944a7da-7235-4575-a3e6-1f71593a9233 None admin] RBAC: Adding query filter params (name=Default) {{(pid=82025) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 19:42:10.156105 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1944a7da-7235-4575-a3e6-1f71593a9233 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:42:10.157892 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1944a7da-7235-4575-a3e6-1f71593a9233 None admin] RBAC: Authorization granted {{(pid=82025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:42:10.175524 dv-cinder-828806-6-smb devstack@keystone.service[82025]: [pid: 82025|app: 0|req: 333/673] 10.222.0.33 () {56 vars in 1109 bytes} [Tue Sep 13 19:42:09 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 19:42:10.175524 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1944a7da-7235-4575-a3e6-1f71593a9233 None admin] Authenticating user token {{(pid=82025) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:42:10.192819 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91d044c3-fcdc-4d34-94b7-406e4a793269 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57539b6a6f3b4d589f5f5e1d211cd6a0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:42:10.193439 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91d044c3-fcdc-4d34-94b7-406e4a793269 None admin] REQUEST_METHOD: `GET` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:42:10.193778 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91d044c3-fcdc-4d34-94b7-406e4a793269 None admin] SCRIPT_NAME: `/identity` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:42:10.194050 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91d044c3-fcdc-4d34-94b7-406e4a793269 None admin] PATH_INFO: `/v3/projects` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:42:10.194755 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91d044c3-fcdc-4d34-94b7-406e4a793269 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=82026) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 19:42:10.195152 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91d044c3-fcdc-4d34-94b7-406e4a793269 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=82026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:42:10.196624 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91d044c3-fcdc-4d34-94b7-406e4a793269 None admin] RBAC: Authorization granted {{(pid=82026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:42:10.209247 dv-cinder-828806-6-smb devstack@keystone.service[82026]: [pid: 82026|app: 0|req: 341/674] 10.222.0.33 () {56 vars in 1148 bytes} [Tue Sep 13 19:42:10 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 19:42:10.210067 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91d044c3-fcdc-4d34-94b7-406e4a793269 None admin] Authenticating user token {{(pid=82026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:42:10.229855 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG dbcounter [-] [82025] Writing DB stats keystone:SELECT=100 {{(pid=82025) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:42:10.300414 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1944a7da-7235-4575-a3e6-1f71593a9233 None admin] Validating token access rules against request {{(pid=82025) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:42:10.311792 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91d044c3-fcdc-4d34-94b7-406e4a793269 None admin] Validating token access rules against request {{(pid=82026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:42:10.333814 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc20c645-d9a3-4f85-8771-879ef8cbe9d9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57539b6a6f3b4d589f5f5e1d211cd6a0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82025) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:42:10.334426 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc20c645-d9a3-4f85-8771-879ef8cbe9d9 None admin] REQUEST_METHOD: `GET` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:42:10.334712 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc20c645-d9a3-4f85-8771-879ef8cbe9d9 None admin] SCRIPT_NAME: `/identity` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:42:10.334992 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc20c645-d9a3-4f85-8771-879ef8cbe9d9 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:42:10.335756 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc20c645-d9a3-4f85-8771-879ef8cbe9d9 None admin] RBAC: Adding query filter params (role.id=47ee826cd5f148c19f293f9470f906da, scope.project.id=c8c6fba0f15b4d6a84ff601919b7b8e4, user.id=46024fc6167f4321818b1bed27a521a0) {{(pid=82025) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 19:42:10.336072 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc20c645-d9a3-4f85-8771-879ef8cbe9d9 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=82025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:42:10.337494 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc20c645-d9a3-4f85-8771-879ef8cbe9d9 None admin] RBAC: Authorization granted {{(pid=82025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:42:10.343139 dv-cinder-828806-6-smb devstack@keystone.service[82025]: [pid: 82025|app: 0|req: 334/675] 10.222.0.33 () {56 vars in 1374 bytes} [Tue Sep 13 19:42:10 2022] GET /identity/v3/role_assignments?user.id=46024fc6167f4321818b1bed27a521a0&scope.project.id=c8c6fba0f15b4d6a84ff601919b7b8e4&role.id=47ee826cd5f148c19f293f9470f906da => generated 608 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 19:42:10.344776 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc20c645-d9a3-4f85-8771-879ef8cbe9d9 None admin] Authenticating user token {{(pid=82025) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:42:10.345768 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6df9a51d-ee1a-459b-bb7a-81d1ff78b40c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57539b6a6f3b4d589f5f5e1d211cd6a0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:42:10.346378 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6df9a51d-ee1a-459b-bb7a-81d1ff78b40c None admin] REQUEST_METHOD: `GET` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:42:10.346665 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6df9a51d-ee1a-459b-bb7a-81d1ff78b40c None admin] SCRIPT_NAME: `/identity` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:42:10.346944 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6df9a51d-ee1a-459b-bb7a-81d1ff78b40c None admin] PATH_INFO: `/v3/roles` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:42:10.347652 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6df9a51d-ee1a-459b-bb7a-81d1ff78b40c None admin] RBAC: Adding query filter params (name=service) {{(pid=82026) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 19:42:10.347962 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6df9a51d-ee1a-459b-bb7a-81d1ff78b40c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:42:10.349378 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6df9a51d-ee1a-459b-bb7a-81d1ff78b40c None admin] RBAC: Authorization granted {{(pid=82026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:42:10.371922 dv-cinder-828806-6-smb devstack@keystone.service[82026]: [pid: 82026|app: 0|req: 342/676] 10.222.0.33 () {56 vars in 1103 bytes} [Tue Sep 13 19:42:10 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 19:42:10.371922 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6df9a51d-ee1a-459b-bb7a-81d1ff78b40c None admin] Authenticating user token {{(pid=82026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:42:10.412855 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG dbcounter [-] [82026] Writing DB stats keystone:SELECT=100 {{(pid=82026) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:42:10.462472 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc20c645-d9a3-4f85-8771-879ef8cbe9d9 None admin] Validating token access rules against request {{(pid=82025) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:42:10.474173 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG dbcounter [-] [82025] Writing DB stats keystone:SELECT=100 {{(pid=82025) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:42:10.500549 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96bac91b-7699-4246-b07d-561458bacd4b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57539b6a6f3b4d589f5f5e1d211cd6a0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82025) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:42:10.501377 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96bac91b-7699-4246-b07d-561458bacd4b None admin] REQUEST_METHOD: `GET` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:42:10.501661 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96bac91b-7699-4246-b07d-561458bacd4b None admin] SCRIPT_NAME: `/identity` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:42:10.501942 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96bac91b-7699-4246-b07d-561458bacd4b None admin] PATH_INFO: `/v3/projects/service` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:42:10.504537 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6df9a51d-ee1a-459b-bb7a-81d1ff78b40c None admin] Validating token access rules against request {{(pid=82026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:42:10.509566 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96bac91b-7699-4246-b07d-561458bacd4b None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=82025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:42:10.511857 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96bac91b-7699-4246-b07d-561458bacd4b None admin] RBAC: Authorization granted {{(pid=82025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:42:10.524933 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application [None req-96bac91b-7699-4246-b07d-561458bacd4b None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 13 19:42:10.524933 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 19:42:10.524933 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 19:42:10.524933 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 19:42:10.524933 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 19:42:10.524933 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 19:42:10.524933 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 19:42:10.524933 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 19:42:10.524933 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 19:42:10.524933 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 19:42:10.524933 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 19:42:10.524933 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 19:42:10.524933 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 13 19:42:10.524933 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 13 19:42:10.524933 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 13 19:42:10.525871 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 13 19:42:10.525871 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 19:42:10.525871 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 19:42:10.525871 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 19:42:10.525871 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 19:42:10.525871 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 19:42:10.525871 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 19:42:10.525871 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 19:42:10.525871 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application with Lock( Sep 13 19:42:10.525871 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 19:42:10.525871 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application return self._enter() Sep 13 19:42:10.525871 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 19:42:10.525871 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 19:42:10.525871 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 19:42:10.525871 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application return self.creator() Sep 13 19:42:10.525871 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 19:42:10.525871 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application created_value = creator( Sep 13 19:42:10.526781 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 13 19:42:10.526781 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 13 19:42:10.526781 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 13 19:42:10.526781 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 13 19:42:10.526781 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 13 19:42:10.526781 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 13 19:42:10.526781 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 13 19:42:10.526781 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application Sep 13 19:42:10.526781 dv-cinder-828806-6-smb devstack@keystone.service[82025]: [pid: 82025|app: 0|req: 335/677] 10.222.0.33 () {56 vars in 1111 bytes} [Tue Sep 13 19:42:10 2022] GET /identity/v3/projects/service => generated 88 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 19:42:10.528068 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e860b4f7-7b11-4f3a-8395-28965516e89f None None] REQUEST_METHOD: `GET` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:42:10.528068 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e860b4f7-7b11-4f3a-8395-28965516e89f None None] SCRIPT_NAME: `/identity` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:42:10.528068 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e860b4f7-7b11-4f3a-8395-28965516e89f None None] PATH_INFO: `/` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:42:10.529361 dv-cinder-828806-6-smb devstack@keystone.service[82025]: [pid: 82025|app: 0|req: 336/678] 10.222.0.33 () {54 vars in 927 bytes} [Tue Sep 13 19:42:10 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 19:42:10.529905 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e860b4f7-7b11-4f3a-8395-28965516e89f None None] Authenticating user token {{(pid=82025) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:42:10.551521 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eab08273-0c9a-4c50-b8c9-93c25e5cc31f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57539b6a6f3b4d589f5f5e1d211cd6a0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:42:10.552139 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eab08273-0c9a-4c50-b8c9-93c25e5cc31f None admin] REQUEST_METHOD: `GET` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:42:10.552427 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eab08273-0c9a-4c50-b8c9-93c25e5cc31f None admin] SCRIPT_NAME: `/identity` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:42:10.552710 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eab08273-0c9a-4c50-b8c9-93c25e5cc31f None admin] PATH_INFO: `/v3/role_assignments` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:42:10.553439 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eab08273-0c9a-4c50-b8c9-93c25e5cc31f None admin] RBAC: Adding query filter params (role.id=47ee826cd5f148c19f293f9470f906da, scope.project.id=c8c6fba0f15b4d6a84ff601919b7b8e4, user.id=f7b2421bf1f84193a29f79709d1d5a19) {{(pid=82026) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 19:42:10.553777 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eab08273-0c9a-4c50-b8c9-93c25e5cc31f None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=82026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:42:10.555226 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eab08273-0c9a-4c50-b8c9-93c25e5cc31f None admin] RBAC: Authorization granted {{(pid=82026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:42:10.561219 dv-cinder-828806-6-smb devstack@keystone.service[82026]: [pid: 82026|app: 0|req: 343/679] 10.222.0.33 () {56 vars in 1374 bytes} [Tue Sep 13 19:42:10 2022] GET /identity/v3/role_assignments?user.id=f7b2421bf1f84193a29f79709d1d5a19&scope.project.id=c8c6fba0f15b4d6a84ff601919b7b8e4&role.id=47ee826cd5f148c19f293f9470f906da => generated 608 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 19:42:10.561938 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eab08273-0c9a-4c50-b8c9-93c25e5cc31f None admin] Authenticating user token {{(pid=82026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:42:10.657808 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e860b4f7-7b11-4f3a-8395-28965516e89f None None] Validating token access rules against request {{(pid=82025) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:42:10.695749 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6caa657-eeec-4707-bda5-e3aff23d09c3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57539b6a6f3b4d589f5f5e1d211cd6a0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82025) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:42:10.696299 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6caa657-eeec-4707-bda5-e3aff23d09c3 None admin] REQUEST_METHOD: `GET` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:42:10.696581 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6caa657-eeec-4707-bda5-e3aff23d09c3 None admin] SCRIPT_NAME: `/identity` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:42:10.696855 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6caa657-eeec-4707-bda5-e3aff23d09c3 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:42:10.698648 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG dbcounter [-] [82026] Writing DB stats keystone:SELECT=100 {{(pid=82026) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:42:10.708363 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eab08273-0c9a-4c50-b8c9-93c25e5cc31f None admin] Validating token access rules against request {{(pid=82026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:42:10.710026 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6caa657-eeec-4707-bda5-e3aff23d09c3 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=82025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:42:10.711534 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6caa657-eeec-4707-bda5-e3aff23d09c3 None admin] RBAC: Authorization granted {{(pid=82025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:42:10.728629 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application [None req-c6caa657-eeec-4707-bda5-e3aff23d09c3 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 13 19:42:10.728629 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 19:42:10.728629 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 19:42:10.728629 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 19:42:10.728629 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 19:42:10.728629 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 19:42:10.728629 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 19:42:10.728629 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 19:42:10.728629 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 19:42:10.728629 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 19:42:10.728629 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 19:42:10.728629 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 19:42:10.728629 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 13 19:42:10.728629 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 13 19:42:10.728629 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 13 19:42:10.728629 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 13 19:42:10.731528 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 19:42:10.731528 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 19:42:10.731528 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 19:42:10.731528 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 19:42:10.731528 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 19:42:10.731528 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 19:42:10.731528 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 19:42:10.731528 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application with Lock( Sep 13 19:42:10.731528 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 19:42:10.731528 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application return self._enter() Sep 13 19:42:10.731528 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 19:42:10.731528 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 19:42:10.731528 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 19:42:10.731528 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application return self.creator() Sep 13 19:42:10.731528 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 19:42:10.731528 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application created_value = creator( Sep 13 19:42:10.731528 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 13 19:42:10.732823 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 13 19:42:10.732823 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 13 19:42:10.732823 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application Sep 13 19:42:10.732823 dv-cinder-828806-6-smb devstack@keystone.service[82025]: [pid: 82025|app: 0|req: 337/680] 10.222.0.33 () {56 vars in 1108 bytes} [Tue Sep 13 19:42:10 2022] GET /identity/v3/domains/Default => generated 87 bytes in 200 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 19:42:10.732823 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9548d3e2-b6bd-4520-ba28-dc64852aa233 None None] REQUEST_METHOD: `POST` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:42:10.732823 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9548d3e2-b6bd-4520-ba28-dc64852aa233 None None] SCRIPT_NAME: `/identity` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:42:10.732823 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9548d3e2-b6bd-4520-ba28-dc64852aa233 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:42:10.755225 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.auth.core [None req-9548d3e2-b6bd-4520-ba28-dc64852aa233 None None] MFA Rules not processed for user `57539b6a6f3b4d589f5f5e1d211cd6a0`. Rule list: `[]` (Enabled: `True`). {{(pid=82025) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 19:42:10.756463 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.fernet_utils [None req-9548d3e2-b6bd-4520-ba28-dc64852aa233 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82025) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 19:42:10.759129 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50476cc0-1002-4c56-a23a-17b080cbaf39 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57539b6a6f3b4d589f5f5e1d211cd6a0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:42:10.759806 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50476cc0-1002-4c56-a23a-17b080cbaf39 None admin] REQUEST_METHOD: `GET` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:42:10.760090 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50476cc0-1002-4c56-a23a-17b080cbaf39 None admin] SCRIPT_NAME: `/identity` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:42:10.760366 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50476cc0-1002-4c56-a23a-17b080cbaf39 None admin] PATH_INFO: `/v3/projects` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:42:10.761067 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50476cc0-1002-4c56-a23a-17b080cbaf39 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=82026) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 19:42:10.761373 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50476cc0-1002-4c56-a23a-17b080cbaf39 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=82026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:42:10.763660 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50476cc0-1002-4c56-a23a-17b080cbaf39 None admin] RBAC: Authorization granted {{(pid=82026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:42:10.776873 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG dbcounter [-] [82025] Writing DB stats keystone:SELECT=100 {{(pid=82025) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:42:10.778092 dv-cinder-828806-6-smb devstack@keystone.service[82026]: [pid: 82026|app: 0|req: 344/681] 10.222.0.33 () {56 vars in 1148 bytes} [Tue Sep 13 19:42:10 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 216 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 19:42:10.779342 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50476cc0-1002-4c56-a23a-17b080cbaf39 None admin] Authenticating user token {{(pid=82026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:42:10.840538 dv-cinder-828806-6-smb devstack@keystone.service[82025]: [pid: 82025|app: 0|req: 338/682] 10.222.0.33 () {58 vars in 1024 bytes} [Tue Sep 13 19:42:10 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 13 19:42:10.841447 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9548d3e2-b6bd-4520-ba28-dc64852aa233 None None] Authenticating user token {{(pid=82025) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:42:10.915141 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50476cc0-1002-4c56-a23a-17b080cbaf39 None admin] Validating token access rules against request {{(pid=82026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:42:10.958392 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b42a5e7b-9ecd-4a83-86a7-83552d09fb31 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57539b6a6f3b4d589f5f5e1d211cd6a0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:42:10.958933 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b42a5e7b-9ecd-4a83-86a7-83552d09fb31 None admin] REQUEST_METHOD: `GET` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:42:10.959285 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b42a5e7b-9ecd-4a83-86a7-83552d09fb31 None admin] SCRIPT_NAME: `/identity` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:42:10.959568 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b42a5e7b-9ecd-4a83-86a7-83552d09fb31 None admin] PATH_INFO: `/v3/domains` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:42:10.960511 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b42a5e7b-9ecd-4a83-86a7-83552d09fb31 None admin] RBAC: Adding query filter params (name=Default) {{(pid=82026) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 19:42:10.960823 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b42a5e7b-9ecd-4a83-86a7-83552d09fb31 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:42:10.962393 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b42a5e7b-9ecd-4a83-86a7-83552d09fb31 None admin] RBAC: Authorization granted {{(pid=82026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:42:10.978652 dv-cinder-828806-6-smb devstack@keystone.service[82026]: [pid: 82026|app: 0|req: 345/683] 10.222.0.33 () {56 vars in 1109 bytes} [Tue Sep 13 19:42:10 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 19:42:10.985507 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b42a5e7b-9ecd-4a83-86a7-83552d09fb31 None admin] Authenticating user token {{(pid=82026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:42:10.989594 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9548d3e2-b6bd-4520-ba28-dc64852aa233 None None] Validating token access rules against request {{(pid=82025) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:42:11.008928 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG dbcounter [-] [82026] Writing DB stats keystone:SELECT=100 {{(pid=82026) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:42:11.029541 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0dca3af-d4fc-43b5-bac5-6e0178fcc9b2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57539b6a6f3b4d589f5f5e1d211cd6a0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82025) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:42:11.030268 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0dca3af-d4fc-43b5-bac5-6e0178fcc9b2 None admin] REQUEST_METHOD: `GET` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:42:11.030669 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0dca3af-d4fc-43b5-bac5-6e0178fcc9b2 None admin] SCRIPT_NAME: `/identity` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:42:11.031795 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0dca3af-d4fc-43b5-bac5-6e0178fcc9b2 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:42:11.032693 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0dca3af-d4fc-43b5-bac5-6e0178fcc9b2 None admin] RBAC: Adding query filter params (role.id=47ee826cd5f148c19f293f9470f906da, scope.project.id=c8c6fba0f15b4d6a84ff601919b7b8e4, user.id=023a2c79c2444611b3d431928e56685d) {{(pid=82025) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 19:42:11.033879 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0dca3af-d4fc-43b5-bac5-6e0178fcc9b2 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=82025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:42:11.034640 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0dca3af-d4fc-43b5-bac5-6e0178fcc9b2 None admin] RBAC: Authorization granted {{(pid=82025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:42:11.043148 dv-cinder-828806-6-smb devstack@keystone.service[82025]: [pid: 82025|app: 0|req: 339/684] 10.222.0.33 () {56 vars in 1374 bytes} [Tue Sep 13 19:42:10 2022] GET /identity/v3/role_assignments?user.id=023a2c79c2444611b3d431928e56685d&scope.project.id=c8c6fba0f15b4d6a84ff601919b7b8e4&role.id=47ee826cd5f148c19f293f9470f906da => generated 608 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 19:42:11.120587 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b42a5e7b-9ecd-4a83-86a7-83552d09fb31 None admin] Validating token access rules against request {{(pid=82026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:42:11.162127 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36bb2485-29aa-47eb-bdef-3e6dcfc6e195 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57539b6a6f3b4d589f5f5e1d211cd6a0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:42:11.163104 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36bb2485-29aa-47eb-bdef-3e6dcfc6e195 None admin] REQUEST_METHOD: `GET` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:42:11.163572 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36bb2485-29aa-47eb-bdef-3e6dcfc6e195 None admin] SCRIPT_NAME: `/identity` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:42:11.163986 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36bb2485-29aa-47eb-bdef-3e6dcfc6e195 None admin] PATH_INFO: `/v3/users/swift` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:42:11.171642 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36bb2485-29aa-47eb-bdef-3e6dcfc6e195 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=82026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:42:11.173777 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36bb2485-29aa-47eb-bdef-3e6dcfc6e195 None admin] RBAC: Authorization granted {{(pid=82026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:42:11.188279 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application [None req-36bb2485-29aa-47eb-bdef-3e6dcfc6e195 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Sep 13 19:42:11.188279 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 19:42:11.188279 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 19:42:11.188279 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 19:42:11.188279 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 19:42:11.188279 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 19:42:11.188279 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 19:42:11.188279 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 19:42:11.188279 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 19:42:11.188279 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 19:42:11.188279 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 19:42:11.188279 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 19:42:11.188279 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 13 19:42:11.188279 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 13 19:42:11.188279 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 13 19:42:11.188279 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 13 19:42:11.189436 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 19:42:11.189436 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 19:42:11.189436 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 13 19:42:11.189436 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 13 19:42:11.189436 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 13 19:42:11.189436 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 13 19:42:11.189436 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 19:42:11.189436 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 19:42:11.189436 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 19:42:11.189436 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 19:42:11.189436 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 19:42:11.189436 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application with Lock( Sep 13 19:42:11.189436 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 19:42:11.189436 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application return self._enter() Sep 13 19:42:11.189436 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 19:42:11.189436 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 19:42:11.189436 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 19:42:11.189436 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application return self.creator() Sep 13 19:42:11.190614 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 19:42:11.190614 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application created_value = creator( Sep 13 19:42:11.190614 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 13 19:42:11.190614 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 13 19:42:11.190614 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 13 19:42:11.190614 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 13 19:42:11.190614 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 13 19:42:11.190614 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 13 19:42:11.190614 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Sep 13 19:42:11.190614 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application Sep 13 19:42:11.192495 dv-cinder-828806-6-smb devstack@keystone.service[82026]: [pid: 82026|app: 0|req: 346/685] 10.222.0.33 () {56 vars in 1096 bytes} [Tue Sep 13 19:42:10 2022] GET /identity/v3/users/swift => generated 83 bytes in 207 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 19:42:11.198738 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0dca3af-d4fc-43b5-bac5-6e0178fcc9b2 None admin] Authenticating user token {{(pid=82025) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:42:11.220160 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG dbcounter [-] [82025] Writing DB stats keystone:SELECT=100 {{(pid=82025) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:42:11.231025 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36bb2485-29aa-47eb-bdef-3e6dcfc6e195 None admin] Authenticating user token {{(pid=82026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:42:11.353613 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0dca3af-d4fc-43b5-bac5-6e0178fcc9b2 None admin] Validating token access rules against request {{(pid=82025) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:42:11.372123 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG dbcounter [-] [82026] Writing DB stats keystone:SELECT=100 {{(pid=82026) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:42:11.398799 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d48a7cf-e611-4fec-b110-e26fe102ebe7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57539b6a6f3b4d589f5f5e1d211cd6a0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82025) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:42:11.399589 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d48a7cf-e611-4fec-b110-e26fe102ebe7 None admin] REQUEST_METHOD: `GET` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:42:11.399873 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d48a7cf-e611-4fec-b110-e26fe102ebe7 None admin] SCRIPT_NAME: `/identity` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:42:11.400152 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d48a7cf-e611-4fec-b110-e26fe102ebe7 None admin] PATH_INFO: `/v3/users` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:42:11.400905 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d48a7cf-e611-4fec-b110-e26fe102ebe7 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=82025) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 19:42:11.401220 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d48a7cf-e611-4fec-b110-e26fe102ebe7 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=82025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:42:11.402673 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d48a7cf-e611-4fec-b110-e26fe102ebe7 None admin] RBAC: Authorization granted {{(pid=82025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:42:11.404210 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36bb2485-29aa-47eb-bdef-3e6dcfc6e195 None admin] Validating token access rules against request {{(pid=82026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:42:11.427295 dv-cinder-828806-6-smb devstack@keystone.service[82025]: [pid: 82025|app: 0|req: 340/686] 10.222.0.33 () {56 vars in 1135 bytes} [Tue Sep 13 19:42:11 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 229 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 19:42:11.432742 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d48a7cf-e611-4fec-b110-e26fe102ebe7 None admin] Authenticating user token {{(pid=82025) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:42:11.446204 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-263ab18e-91ff-4ac2-893a-de6a0f88ff1a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57539b6a6f3b4d589f5f5e1d211cd6a0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:42:11.446204 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-263ab18e-91ff-4ac2-893a-de6a0f88ff1a None admin] REQUEST_METHOD: `GET` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:42:11.446489 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-263ab18e-91ff-4ac2-893a-de6a0f88ff1a None admin] SCRIPT_NAME: `/identity` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:42:11.446715 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-263ab18e-91ff-4ac2-893a-de6a0f88ff1a None admin] PATH_INFO: `/v3/roles/admin` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:42:11.459737 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-263ab18e-91ff-4ac2-893a-de6a0f88ff1a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=82026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 13 19:42:11.465395 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application [None req-263ab18e-91ff-4ac2-893a-de6a0f88ff1a None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 13 19:42:11.465395 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 19:42:11.465395 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 19:42:11.465395 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 19:42:11.465395 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 19:42:11.465395 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 19:42:11.465395 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 19:42:11.465395 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 19:42:11.465395 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 19:42:11.465395 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 19:42:11.465395 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 19:42:11.465395 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 19:42:11.465395 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 13 19:42:11.465395 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 13 19:42:11.465395 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 13 19:42:11.465395 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 13 19:42:11.466367 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 13 19:42:11.466367 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 13 19:42:11.466367 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 13 19:42:11.466367 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 13 19:42:11.466367 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 19:42:11.466367 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 19:42:11.466367 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 19:42:11.466367 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 19:42:11.466367 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 19:42:11.466367 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 19:42:11.466367 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 19:42:11.466367 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application with Lock( Sep 13 19:42:11.466367 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 19:42:11.466367 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application return self._enter() Sep 13 19:42:11.466367 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 19:42:11.466367 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 19:42:11.467256 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 19:42:11.467256 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application return self.creator() Sep 13 19:42:11.467256 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 19:42:11.467256 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application created_value = creator( Sep 13 19:42:11.467256 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 13 19:42:11.467256 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 13 19:42:11.467256 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 13 19:42:11.467256 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 13 19:42:11.467256 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 13 19:42:11.467256 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 13 19:42:11.467256 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 13 19:42:11.467256 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application Sep 13 19:42:11.467256 dv-cinder-828806-6-smb devstack@keystone.service[82026]: [pid: 82026|app: 0|req: 347/687] 10.222.0.33 () {56 vars in 1096 bytes} [Tue Sep 13 19:42:11 2022] GET /identity/v3/roles/admin => generated 83 bytes in 236 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 19:42:11.474430 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-263ab18e-91ff-4ac2-893a-de6a0f88ff1a None admin] Authenticating user token {{(pid=82026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:42:11.560881 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG dbcounter [-] [82025] Writing DB stats keystone:SELECT=100 {{(pid=82025) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:42:11.589696 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d48a7cf-e611-4fec-b110-e26fe102ebe7 None admin] Validating token access rules against request {{(pid=82025) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:42:11.637287 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79f46810-b303-490f-97cf-3cf64824ce98 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57539b6a6f3b4d589f5f5e1d211cd6a0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82025) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:42:11.638301 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79f46810-b303-490f-97cf-3cf64824ce98 None admin] REQUEST_METHOD: `GET` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:42:11.638787 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79f46810-b303-490f-97cf-3cf64824ce98 None admin] SCRIPT_NAME: `/identity` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:42:11.639314 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79f46810-b303-490f-97cf-3cf64824ce98 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:42:11.694705 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-263ab18e-91ff-4ac2-893a-de6a0f88ff1a None admin] Validating token access rules against request {{(pid=82026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:42:11.750883 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79f46810-b303-490f-97cf-3cf64824ce98 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=82025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:42:11.753060 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79f46810-b303-490f-97cf-3cf64824ce98 None admin] RBAC: Authorization granted {{(pid=82025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:42:11.793035 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f924c626-8d5d-45a7-aac0-e61f826792ce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57539b6a6f3b4d589f5f5e1d211cd6a0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:42:11.793595 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f924c626-8d5d-45a7-aac0-e61f826792ce None admin] REQUEST_METHOD: `GET` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:42:11.793676 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f924c626-8d5d-45a7-aac0-e61f826792ce None admin] SCRIPT_NAME: `/identity` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:42:11.793914 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f924c626-8d5d-45a7-aac0-e61f826792ce None admin] PATH_INFO: `/v3/roles` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:42:11.794600 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f924c626-8d5d-45a7-aac0-e61f826792ce None admin] RBAC: Adding query filter params (name=admin) {{(pid=82026) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 19:42:11.794907 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f924c626-8d5d-45a7-aac0-e61f826792ce None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:42:11.796322 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f924c626-8d5d-45a7-aac0-e61f826792ce None admin] RBAC: Authorization granted {{(pid=82026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:42:11.811395 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG dbcounter [-] [82026] Writing DB stats keystone:SELECT=100 {{(pid=82026) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:42:11.821836 dv-cinder-828806-6-smb devstack@keystone.service[82026]: [pid: 82026|app: 0|req: 348/688] 10.222.0.33 () {56 vars in 1099 bytes} [Tue Sep 13 19:42:11 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 348 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 13 19:42:11.827214 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f924c626-8d5d-45a7-aac0-e61f826792ce None admin] Authenticating user token {{(pid=82026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:42:11.846037 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG dbcounter [-] [82025] Writing DB stats keystone:SELECT=100 {{(pid=82025) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:42:11.876706 dv-cinder-828806-6-smb devstack@keystone.service[82025]: [pid: 82025|app: 0|req: 341/689] 10.222.0.33 () {58 vars in 1282 bytes} [Tue Sep 13 19:42:11 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 444 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 13 19:42:11.886562 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79f46810-b303-490f-97cf-3cf64824ce98 None admin] Authenticating user token {{(pid=82025) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:42:11.975425 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f924c626-8d5d-45a7-aac0-e61f826792ce None admin] Validating token access rules against request {{(pid=82026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:42:12.011355 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-318ed5f6-cee7-4d7c-aa29-79373aba68ed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57539b6a6f3b4d589f5f5e1d211cd6a0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:42:12.011975 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-318ed5f6-cee7-4d7c-aa29-79373aba68ed None admin] REQUEST_METHOD: `GET` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:42:12.012462 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-318ed5f6-cee7-4d7c-aa29-79373aba68ed None admin] SCRIPT_NAME: `/identity` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:42:12.012749 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-318ed5f6-cee7-4d7c-aa29-79373aba68ed None admin] PATH_INFO: `/v3/domains/Default` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:42:12.023306 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-318ed5f6-cee7-4d7c-aa29-79373aba68ed None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=82026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:42:12.024973 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-318ed5f6-cee7-4d7c-aa29-79373aba68ed None admin] RBAC: Authorization granted {{(pid=82026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:42:12.042610 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application [None req-318ed5f6-cee7-4d7c-aa29-79373aba68ed None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 13 19:42:12.042610 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 19:42:12.042610 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 19:42:12.042610 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 19:42:12.042610 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 19:42:12.042610 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 19:42:12.042610 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 19:42:12.042610 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 19:42:12.042610 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 19:42:12.042610 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 19:42:12.042610 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 19:42:12.042610 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 19:42:12.042610 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 13 19:42:12.042610 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 13 19:42:12.042610 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 13 19:42:12.042610 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 13 19:42:12.043597 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 19:42:12.043597 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 19:42:12.043597 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 19:42:12.043597 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 19:42:12.043597 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 19:42:12.043597 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 19:42:12.043597 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 19:42:12.043597 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application with Lock( Sep 13 19:42:12.043597 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 19:42:12.043597 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application return self._enter() Sep 13 19:42:12.043597 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 19:42:12.043597 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 19:42:12.043597 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 19:42:12.043597 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application return self.creator() Sep 13 19:42:12.043597 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 19:42:12.043597 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application created_value = creator( Sep 13 19:42:12.043597 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 13 19:42:12.045105 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 13 19:42:12.045105 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 13 19:42:12.045105 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application Sep 13 19:42:12.045105 dv-cinder-828806-6-smb devstack@keystone.service[82026]: [pid: 82026|app: 0|req: 349/690] 10.222.0.33 () {56 vars in 1108 bytes} [Tue Sep 13 19:42:11 2022] GET /identity/v3/domains/Default => generated 87 bytes in 217 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 19:42:12.050182 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-318ed5f6-cee7-4d7c-aa29-79373aba68ed None admin] Authenticating user token {{(pid=82026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:42:12.121661 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79f46810-b303-490f-97cf-3cf64824ce98 None admin] Validating token access rules against request {{(pid=82025) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:42:12.127883 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG dbcounter [-] [82026] Writing DB stats keystone:SELECT=100 {{(pid=82026) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:42:12.185862 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-318ed5f6-cee7-4d7c-aa29-79373aba68ed None admin] Validating token access rules against request {{(pid=82026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:42:12.213106 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-661b4bfa-1bf7-4112-b643-a071c49b9059 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57539b6a6f3b4d589f5f5e1d211cd6a0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82025) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:42:12.213761 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-661b4bfa-1bf7-4112-b643-a071c49b9059 None admin] REQUEST_METHOD: `GET` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:42:12.214049 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-661b4bfa-1bf7-4112-b643-a071c49b9059 None admin] SCRIPT_NAME: `/identity` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:42:12.214329 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-661b4bfa-1bf7-4112-b643-a071c49b9059 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:42:12.224140 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4125c65-5ed8-400e-bc25-b0eaa2690ad7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57539b6a6f3b4d589f5f5e1d211cd6a0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:42:12.225000 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4125c65-5ed8-400e-bc25-b0eaa2690ad7 None admin] REQUEST_METHOD: `GET` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:42:12.225452 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4125c65-5ed8-400e-bc25-b0eaa2690ad7 None admin] SCRIPT_NAME: `/identity` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:42:12.226015 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4125c65-5ed8-400e-bc25-b0eaa2690ad7 None admin] PATH_INFO: `/v3/domains` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:42:12.226874 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4125c65-5ed8-400e-bc25-b0eaa2690ad7 None admin] RBAC: Adding query filter params (name=Default) {{(pid=82026) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 19:42:12.227361 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4125c65-5ed8-400e-bc25-b0eaa2690ad7 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:42:12.228923 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4125c65-5ed8-400e-bc25-b0eaa2690ad7 None admin] RBAC: Authorization granted {{(pid=82026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:42:12.238984 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-661b4bfa-1bf7-4112-b643-a071c49b9059 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=82025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:42:12.240471 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-661b4bfa-1bf7-4112-b643-a071c49b9059 None admin] RBAC: Authorization granted {{(pid=82025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:42:12.242703 dv-cinder-828806-6-smb devstack@keystone.service[82026]: [pid: 82026|app: 0|req: 350/691] 10.222.0.33 () {56 vars in 1109 bytes} [Tue Sep 13 19:42:12 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 19:42:12.248390 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4125c65-5ed8-400e-bc25-b0eaa2690ad7 None admin] Authenticating user token {{(pid=82026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:42:12.283170 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application [None req-661b4bfa-1bf7-4112-b643-a071c49b9059 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 13 19:42:12.283170 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 19:42:12.283170 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 19:42:12.283170 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 19:42:12.283170 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 19:42:12.283170 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 19:42:12.283170 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 19:42:12.283170 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 19:42:12.283170 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 19:42:12.283170 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 19:42:12.283170 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 19:42:12.283170 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 19:42:12.283170 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 13 19:42:12.283170 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 13 19:42:12.283170 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 13 19:42:12.283170 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 13 19:42:12.284430 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 19:42:12.284430 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 19:42:12.284430 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 19:42:12.284430 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 19:42:12.284430 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 19:42:12.284430 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 19:42:12.284430 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 19:42:12.284430 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application with Lock( Sep 13 19:42:12.284430 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 19:42:12.284430 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application return self._enter() Sep 13 19:42:12.284430 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 19:42:12.284430 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 19:42:12.284430 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 19:42:12.284430 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application return self.creator() Sep 13 19:42:12.284430 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 19:42:12.284430 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application created_value = creator( Sep 13 19:42:12.284430 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 13 19:42:12.285550 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 13 19:42:12.285550 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 13 19:42:12.285550 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application Sep 13 19:42:12.285550 dv-cinder-828806-6-smb devstack@keystone.service[82025]: [pid: 82025|app: 0|req: 342/692] 10.222.0.33 () {56 vars in 1108 bytes} [Tue Sep 13 19:42:11 2022] GET /identity/v3/domains/Default => generated 87 bytes in 394 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 19:42:12.285550 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-661b4bfa-1bf7-4112-b643-a071c49b9059 None admin] Authenticating user token {{(pid=82025) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:42:12.356862 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG dbcounter [-] [82025] Writing DB stats keystone:SELECT=100 {{(pid=82025) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:42:12.387708 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4125c65-5ed8-400e-bc25-b0eaa2690ad7 None admin] Validating token access rules against request {{(pid=82026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:42:12.404663 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG dbcounter [-] [82026] Writing DB stats keystone:SELECT=100 {{(pid=82026) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:42:12.455741 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d516f8b-3052-4c99-beee-0ddb39e14a1b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57539b6a6f3b4d589f5f5e1d211cd6a0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:42:12.456388 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d516f8b-3052-4c99-beee-0ddb39e14a1b None admin] REQUEST_METHOD: `GET` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:42:12.456673 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d516f8b-3052-4c99-beee-0ddb39e14a1b None admin] SCRIPT_NAME: `/identity` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:42:12.456951 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d516f8b-3052-4c99-beee-0ddb39e14a1b None admin] PATH_INFO: `/v3/users/nova` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:42:12.474927 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d516f8b-3052-4c99-beee-0ddb39e14a1b None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=82026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:42:12.476436 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d516f8b-3052-4c99-beee-0ddb39e14a1b None admin] RBAC: Authorization granted {{(pid=82026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:42:12.503335 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application [None req-8d516f8b-3052-4c99-beee-0ddb39e14a1b None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Sep 13 19:42:12.503335 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 19:42:12.503335 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 19:42:12.503335 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 19:42:12.503335 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 19:42:12.503335 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 19:42:12.503335 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 19:42:12.503335 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 19:42:12.503335 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 19:42:12.503335 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 19:42:12.503335 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 19:42:12.503335 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 19:42:12.503335 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 13 19:42:12.503335 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 13 19:42:12.503335 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 13 19:42:12.503335 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 13 19:42:12.504513 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 19:42:12.504513 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 19:42:12.504513 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 13 19:42:12.504513 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 13 19:42:12.504513 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 13 19:42:12.504513 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 13 19:42:12.504513 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 19:42:12.504513 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 19:42:12.504513 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 19:42:12.504513 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 19:42:12.504513 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 19:42:12.504513 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application with Lock( Sep 13 19:42:12.504513 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 19:42:12.504513 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application return self._enter() Sep 13 19:42:12.504513 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 19:42:12.504513 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 19:42:12.504513 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 19:42:12.504513 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application return self.creator() Sep 13 19:42:12.505639 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 19:42:12.505639 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application created_value = creator( Sep 13 19:42:12.505639 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 13 19:42:12.505639 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 13 19:42:12.505639 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 13 19:42:12.505639 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 13 19:42:12.505639 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 13 19:42:12.505639 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 13 19:42:12.505639 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Sep 13 19:42:12.505639 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application Sep 13 19:42:12.513178 dv-cinder-828806-6-smb devstack@keystone.service[82026]: [pid: 82026|app: 0|req: 351/693] 10.222.0.33 () {56 vars in 1093 bytes} [Tue Sep 13 19:42:12 2022] GET /identity/v3/users/nova => generated 82 bytes in 265 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 19:42:12.516854 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-661b4bfa-1bf7-4112-b643-a071c49b9059 None admin] Validating token access rules against request {{(pid=82025) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:42:12.525890 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d516f8b-3052-4c99-beee-0ddb39e14a1b None admin] Authenticating user token {{(pid=82026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:42:12.612323 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7b07b84-e9fb-4b89-8a0b-e8479c70fdc1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57539b6a6f3b4d589f5f5e1d211cd6a0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82025) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:42:12.613070 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7b07b84-e9fb-4b89-8a0b-e8479c70fdc1 None admin] REQUEST_METHOD: `GET` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:42:12.613556 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7b07b84-e9fb-4b89-8a0b-e8479c70fdc1 None admin] SCRIPT_NAME: `/identity` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:42:12.613922 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7b07b84-e9fb-4b89-8a0b-e8479c70fdc1 None admin] PATH_INFO: `/v3/domains` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:42:12.614648 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7b07b84-e9fb-4b89-8a0b-e8479c70fdc1 None admin] RBAC: Adding query filter params (name=Default) {{(pid=82025) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 19:42:12.615027 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7b07b84-e9fb-4b89-8a0b-e8479c70fdc1 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:42:12.616472 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7b07b84-e9fb-4b89-8a0b-e8479c70fdc1 None admin] RBAC: Authorization granted {{(pid=82025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:42:12.645545 dv-cinder-828806-6-smb devstack@keystone.service[82025]: [pid: 82025|app: 0|req: 343/694] 10.222.0.33 () {56 vars in 1109 bytes} [Tue Sep 13 19:42:12 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 362 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 19:42:12.647503 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d516f8b-3052-4c99-beee-0ddb39e14a1b None admin] Validating token access rules against request {{(pid=82026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:42:12.650532 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7b07b84-e9fb-4b89-8a0b-e8479c70fdc1 None admin] Authenticating user token {{(pid=82025) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:42:12.688522 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6ee195e-4dad-4851-ba6c-4810e96fa221 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57539b6a6f3b4d589f5f5e1d211cd6a0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:42:12.688522 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6ee195e-4dad-4851-ba6c-4810e96fa221 None admin] REQUEST_METHOD: `GET` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:42:12.688932 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6ee195e-4dad-4851-ba6c-4810e96fa221 None admin] SCRIPT_NAME: `/identity` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:42:12.689084 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6ee195e-4dad-4851-ba6c-4810e96fa221 None admin] PATH_INFO: `/v3/users` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:42:12.690219 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6ee195e-4dad-4851-ba6c-4810e96fa221 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=82026) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 19:42:12.690535 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6ee195e-4dad-4851-ba6c-4810e96fa221 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=82026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:42:12.692312 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6ee195e-4dad-4851-ba6c-4810e96fa221 None admin] RBAC: Authorization granted {{(pid=82026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:42:12.714856 dv-cinder-828806-6-smb devstack@keystone.service[82026]: [pid: 82026|app: 0|req: 352/695] 10.222.0.33 () {56 vars in 1133 bytes} [Tue Sep 13 19:42:12 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 13 19:42:12.721226 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6ee195e-4dad-4851-ba6c-4810e96fa221 None admin] Authenticating user token {{(pid=82026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:42:12.756607 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG dbcounter [-] [82026] Writing DB stats keystone:SELECT=100 {{(pid=82026) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:42:12.840759 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG dbcounter [-] [82025] Writing DB stats keystone:SELECT=100 {{(pid=82025) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:42:12.864132 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7b07b84-e9fb-4b89-8a0b-e8479c70fdc1 None admin] Validating token access rules against request {{(pid=82025) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:42:12.874374 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6ee195e-4dad-4851-ba6c-4810e96fa221 None admin] Validating token access rules against request {{(pid=82026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:42:12.905604 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5172bd4-4f47-4d7e-a50e-03e6f6ce46dc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57539b6a6f3b4d589f5f5e1d211cd6a0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82025) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:42:12.907432 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5172bd4-4f47-4d7e-a50e-03e6f6ce46dc None admin] REQUEST_METHOD: `GET` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:42:12.908180 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5172bd4-4f47-4d7e-a50e-03e6f6ce46dc None admin] SCRIPT_NAME: `/identity` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:42:12.908466 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5172bd4-4f47-4d7e-a50e-03e6f6ce46dc None admin] PATH_INFO: `/v3/projects/service` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:42:12.916430 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5172bd4-4f47-4d7e-a50e-03e6f6ce46dc None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=82025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:42:12.918540 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5172bd4-4f47-4d7e-a50e-03e6f6ce46dc None admin] RBAC: Authorization granted {{(pid=82025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:42:12.927442 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8afe22c-b812-43c3-9a9d-6b640e65011e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57539b6a6f3b4d589f5f5e1d211cd6a0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:42:12.928060 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8afe22c-b812-43c3-9a9d-6b640e65011e None admin] REQUEST_METHOD: `GET` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:42:12.928348 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8afe22c-b812-43c3-9a9d-6b640e65011e None admin] SCRIPT_NAME: `/identity` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:42:12.928627 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8afe22c-b812-43c3-9a9d-6b640e65011e None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:42:12.931475 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application [None req-e5172bd4-4f47-4d7e-a50e-03e6f6ce46dc None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 13 19:42:12.931475 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 19:42:12.931475 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 19:42:12.931475 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 19:42:12.931475 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 19:42:12.931475 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 19:42:12.931475 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 19:42:12.931475 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 19:42:12.931475 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 19:42:12.931475 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 19:42:12.931475 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 19:42:12.931475 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 19:42:12.931475 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 13 19:42:12.931475 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 13 19:42:12.931475 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 13 19:42:12.932369 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 13 19:42:12.932369 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 19:42:12.932369 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 19:42:12.932369 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 19:42:12.932369 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 19:42:12.932369 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 19:42:12.932369 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 19:42:12.932369 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 19:42:12.932369 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application with Lock( Sep 13 19:42:12.932369 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 19:42:12.932369 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application return self._enter() Sep 13 19:42:12.932369 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 19:42:12.932369 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 19:42:12.932369 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 19:42:12.932369 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application return self.creator() Sep 13 19:42:12.932369 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 19:42:12.932369 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application created_value = creator( Sep 13 19:42:12.933309 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 13 19:42:12.933309 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 13 19:42:12.933309 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 13 19:42:12.933309 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 13 19:42:12.933309 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 13 19:42:12.933309 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 13 19:42:12.933309 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 13 19:42:12.933309 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application Sep 13 19:42:12.938734 dv-cinder-828806-6-smb devstack@keystone.service[82025]: [pid: 82025|app: 0|req: 344/696] 10.222.0.33 () {56 vars in 1111 bytes} [Tue Sep 13 19:42:12 2022] GET /identity/v3/projects/service => generated 88 bytes in 288 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 13 19:42:12.940070 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8944546c-7ad6-4da4-993b-26cf3905090e None None] REQUEST_METHOD: `GET` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:42:12.940404 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8944546c-7ad6-4da4-993b-26cf3905090e None None] SCRIPT_NAME: `/identity` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:42:12.940686 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8944546c-7ad6-4da4-993b-26cf3905090e None None] PATH_INFO: `/` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:42:12.942680 dv-cinder-828806-6-smb devstack@keystone.service[82025]: [pid: 82025|app: 0|req: 345/697] 10.222.0.33 () {54 vars in 927 bytes} [Tue Sep 13 19:42:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 19:42:12.943819 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8944546c-7ad6-4da4-993b-26cf3905090e None None] Authenticating user token {{(pid=82025) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:42:13.022982 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8afe22c-b812-43c3-9a9d-6b640e65011e None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=82026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:42:13.024491 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8afe22c-b812-43c3-9a9d-6b640e65011e None admin] RBAC: Authorization granted {{(pid=82026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:42:13.053050 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG dbcounter [-] [82026] Writing DB stats keystone:SELECT=100 {{(pid=82026) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:42:13.083701 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8944546c-7ad6-4da4-993b-26cf3905090e None None] Validating token access rules against request {{(pid=82025) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:42:13.120277 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-305b047c-090f-4cf5-a7e2-9ddc8bd58ffa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57539b6a6f3b4d589f5f5e1d211cd6a0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82025) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:42:13.120597 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-305b047c-090f-4cf5-a7e2-9ddc8bd58ffa None admin] REQUEST_METHOD: `GET` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:42:13.120828 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-305b047c-090f-4cf5-a7e2-9ddc8bd58ffa None admin] SCRIPT_NAME: `/identity` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:42:13.121105 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-305b047c-090f-4cf5-a7e2-9ddc8bd58ffa None admin] PATH_INFO: `/v3/projects` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:42:13.121797 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-305b047c-090f-4cf5-a7e2-9ddc8bd58ffa None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=82025) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 19:42:13.122105 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-305b047c-090f-4cf5-a7e2-9ddc8bd58ffa None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=82025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:42:13.123564 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-305b047c-090f-4cf5-a7e2-9ddc8bd58ffa None admin] RBAC: Authorization granted {{(pid=82025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:42:13.140613 dv-cinder-828806-6-smb devstack@keystone.service[82025]: [pid: 82025|app: 0|req: 346/698] 10.222.0.33 () {56 vars in 1148 bytes} [Tue Sep 13 19:42:12 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 19:42:13.140613 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2490988-c502-4d2c-b2a6-34b0f3afb39f None None] REQUEST_METHOD: `POST` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:42:13.140613 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2490988-c502-4d2c-b2a6-34b0f3afb39f None None] SCRIPT_NAME: `/identity` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:42:13.140613 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2490988-c502-4d2c-b2a6-34b0f3afb39f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:42:13.153913 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG dbcounter [-] [82025] Writing DB stats keystone:SELECT=100 {{(pid=82025) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:42:13.154470 dv-cinder-828806-6-smb devstack@keystone.service[82026]: [pid: 82026|app: 0|req: 353/699] 10.222.0.33 () {58 vars in 1282 bytes} [Tue Sep 13 19:42:12 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 434 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Sep 13 19:42:13.155586 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8afe22c-b812-43c3-9a9d-6b640e65011e None admin] Authenticating user token {{(pid=82026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:42:13.158803 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.auth.core [None req-f2490988-c502-4d2c-b2a6-34b0f3afb39f None None] MFA Rules not processed for user `57539b6a6f3b4d589f5f5e1d211cd6a0`. Rule list: `[]` (Enabled: `True`). {{(pid=82025) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 19:42:13.160652 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.fernet_utils [None req-f2490988-c502-4d2c-b2a6-34b0f3afb39f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82025) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 19:42:13.239087 dv-cinder-828806-6-smb devstack@keystone.service[82025]: [pid: 82025|app: 0|req: 347/700] 10.222.0.33 () {58 vars in 1024 bytes} [Tue Sep 13 19:42:13 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 13 19:42:13.239087 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2490988-c502-4d2c-b2a6-34b0f3afb39f None None] Authenticating user token {{(pid=82025) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:42:13.297639 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8afe22c-b812-43c3-9a9d-6b640e65011e None admin] Validating token access rules against request {{(pid=82026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:42:13.344488 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2490988-c502-4d2c-b2a6-34b0f3afb39f None None] Validating token access rules against request {{(pid=82025) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:42:13.353453 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG dbcounter [-] [82026] Writing DB stats keystone:SELECT=100 {{(pid=82026) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:42:13.363119 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cc9cd1b-2524-47ba-93cc-6c2ccaf6c7da None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57539b6a6f3b4d589f5f5e1d211cd6a0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:42:13.364110 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cc9cd1b-2524-47ba-93cc-6c2ccaf6c7da None admin] REQUEST_METHOD: `GET` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:42:13.364600 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cc9cd1b-2524-47ba-93cc-6c2ccaf6c7da None admin] SCRIPT_NAME: `/identity` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:42:13.365084 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cc9cd1b-2524-47ba-93cc-6c2ccaf6c7da None admin] PATH_INFO: `/v3/role_assignments` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:42:13.366045 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cc9cd1b-2524-47ba-93cc-6c2ccaf6c7da None admin] RBAC: Adding query filter params (role.id=47ee826cd5f148c19f293f9470f906da, scope.project.id=c8c6fba0f15b4d6a84ff601919b7b8e4, user.id=fa5a83574f7f424c805e130c462d5969) {{(pid=82026) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 19:42:13.366564 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cc9cd1b-2524-47ba-93cc-6c2ccaf6c7da None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=82026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:42:13.368365 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cc9cd1b-2524-47ba-93cc-6c2ccaf6c7da None admin] RBAC: Authorization granted {{(pid=82026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:42:13.375373 dv-cinder-828806-6-smb devstack@keystone.service[82026]: [pid: 82026|app: 0|req: 354/701] 10.222.0.33 () {56 vars in 1374 bytes} [Tue Sep 13 19:42:13 2022] GET /identity/v3/role_assignments?user.id=fa5a83574f7f424c805e130c462d5969&scope.project.id=c8c6fba0f15b4d6a84ff601919b7b8e4&role.id=47ee826cd5f148c19f293f9470f906da => generated 608 bytes in 220 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 19:42:13.388989 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78f62e36-32a1-428d-accd-f6a554d1891a None None] REQUEST_METHOD: `GET` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:42:13.389613 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78f62e36-32a1-428d-accd-f6a554d1891a None None] SCRIPT_NAME: `/identity` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:42:13.390121 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78f62e36-32a1-428d-accd-f6a554d1891a None None] PATH_INFO: `/` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:42:13.392298 dv-cinder-828806-6-smb devstack@keystone.service[82026]: [pid: 82026|app: 0|req: 355/702] 10.222.0.33 () {54 vars in 927 bytes} [Tue Sep 13 19:42:13 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 13 19:42:13.397816 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a693ce5-2c47-447e-9da3-88eec8d3f151 None None] REQUEST_METHOD: `POST` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:42:13.399368 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a693ce5-2c47-447e-9da3-88eec8d3f151 None None] SCRIPT_NAME: `/identity` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:42:13.399885 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a693ce5-2c47-447e-9da3-88eec8d3f151 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:42:13.404122 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bc5cc51-2f98-493d-988f-053c8a13dff3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57539b6a6f3b4d589f5f5e1d211cd6a0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82025) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:42:13.404756 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bc5cc51-2f98-493d-988f-053c8a13dff3 None admin] REQUEST_METHOD: `GET` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:42:13.405038 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bc5cc51-2f98-493d-988f-053c8a13dff3 None admin] SCRIPT_NAME: `/identity` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:42:13.405313 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bc5cc51-2f98-493d-988f-053c8a13dff3 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:42:13.411533 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG dbcounter [-] [82025] Writing DB stats keystone:SELECT=100 {{(pid=82025) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:42:13.430335 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bc5cc51-2f98-493d-988f-053c8a13dff3 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=82025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:42:13.432091 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bc5cc51-2f98-493d-988f-053c8a13dff3 None admin] RBAC: Authorization granted {{(pid=82025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:42:13.439634 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.auth.core [None req-6a693ce5-2c47-447e-9da3-88eec8d3f151 None None] MFA Rules not processed for user `57539b6a6f3b4d589f5f5e1d211cd6a0`. Rule list: `[]` (Enabled: `True`). {{(pid=82026) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 19:42:13.446106 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.common.fernet_utils [None req-6a693ce5-2c47-447e-9da3-88eec8d3f151 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82026) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 19:42:13.460185 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application [None req-9bc5cc51-2f98-493d-988f-053c8a13dff3 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 13 19:42:13.460185 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 19:42:13.460185 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 19:42:13.460185 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 19:42:13.460185 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 19:42:13.460185 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 19:42:13.460185 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 19:42:13.460185 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 19:42:13.460185 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 19:42:13.460185 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 19:42:13.460185 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 19:42:13.460185 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 19:42:13.460185 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 13 19:42:13.460185 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 13 19:42:13.460185 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 13 19:42:13.460185 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 13 19:42:13.461317 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 19:42:13.461317 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 19:42:13.461317 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 19:42:13.461317 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 19:42:13.461317 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 19:42:13.461317 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 19:42:13.461317 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 19:42:13.461317 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application with Lock( Sep 13 19:42:13.461317 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 19:42:13.461317 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application return self._enter() Sep 13 19:42:13.461317 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 19:42:13.461317 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 19:42:13.461317 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 19:42:13.461317 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application return self.creator() Sep 13 19:42:13.461317 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 19:42:13.461317 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application created_value = creator( Sep 13 19:42:13.461317 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 13 19:42:13.462201 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 13 19:42:13.462201 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 13 19:42:13.462201 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application Sep 13 19:42:13.464767 dv-cinder-828806-6-smb devstack@keystone.service[82025]: [pid: 82025|app: 0|req: 348/703] 10.222.0.33 () {56 vars in 1108 bytes} [Tue Sep 13 19:42:13 2022] GET /identity/v3/domains/Default => generated 87 bytes in 229 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 19:42:13.473259 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bc5cc51-2f98-493d-988f-053c8a13dff3 None admin] Authenticating user token {{(pid=82025) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:42:13.567515 dv-cinder-828806-6-smb devstack@keystone.service[82026]: [pid: 82026|app: 0|req: 356/704] 10.222.0.33 () {58 vars in 1024 bytes} [Tue Sep 13 19:42:13 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 170 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 13 19:42:13.629273 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a693ce5-2c47-447e-9da3-88eec8d3f151 None None] Authenticating user token {{(pid=82026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:42:13.641067 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bc5cc51-2f98-493d-988f-053c8a13dff3 None admin] Validating token access rules against request {{(pid=82025) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:42:13.690428 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2de1994f-3023-4c2a-89c6-f4f412133e83 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57539b6a6f3b4d589f5f5e1d211cd6a0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82025) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:42:13.691264 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2de1994f-3023-4c2a-89c6-f4f412133e83 None admin] REQUEST_METHOD: `GET` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:42:13.691575 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2de1994f-3023-4c2a-89c6-f4f412133e83 None admin] SCRIPT_NAME: `/identity` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:42:13.691826 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2de1994f-3023-4c2a-89c6-f4f412133e83 None admin] PATH_INFO: `/v3/domains` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:42:13.692508 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2de1994f-3023-4c2a-89c6-f4f412133e83 None admin] RBAC: Adding query filter params (name=Default) {{(pid=82025) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 19:42:13.692823 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2de1994f-3023-4c2a-89c6-f4f412133e83 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:42:13.694255 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2de1994f-3023-4c2a-89c6-f4f412133e83 None admin] RBAC: Authorization granted {{(pid=82025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:42:13.709669 dv-cinder-828806-6-smb devstack@keystone.service[82025]: [pid: 82025|app: 0|req: 349/705] 10.222.0.33 () {56 vars in 1109 bytes} [Tue Sep 13 19:42:13 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 237 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 19:42:13.720168 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2de1994f-3023-4c2a-89c6-f4f412133e83 None admin] Authenticating user token {{(pid=82025) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:42:13.762645 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a693ce5-2c47-447e-9da3-88eec8d3f151 None None] Validating token access rules against request {{(pid=82026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:42:13.775821 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG dbcounter [-] [82025] Writing DB stats keystone:SELECT=100 {{(pid=82025) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:42:13.790663 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG dbcounter [-] [82026] Writing DB stats keystone:SELECT=100 {{(pid=82026) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:42:13.803912 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ee2690f-d764-4410-9895-bf77439c0f61 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57539b6a6f3b4d589f5f5e1d211cd6a0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:42:13.804898 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ee2690f-d764-4410-9895-bf77439c0f61 None admin] REQUEST_METHOD: `GET` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:42:13.805402 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ee2690f-d764-4410-9895-bf77439c0f61 None admin] SCRIPT_NAME: `/identity` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:42:13.805911 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ee2690f-d764-4410-9895-bf77439c0f61 None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:42:13.806726 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ee2690f-d764-4410-9895-bf77439c0f61 None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=82026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:42:13.808407 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ee2690f-d764-4410-9895-bf77439c0f61 None admin] RBAC: Authorization granted {{(pid=82026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:42:13.824889 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application [None req-0ee2690f-d764-4410-9895-bf77439c0f61 None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Sep 13 19:42:13.824889 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 19:42:13.824889 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 13 19:42:13.824889 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 13 19:42:13.824889 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 13 19:42:13.824889 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 13 19:42:13.824889 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 13 19:42:13.824889 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 13 19:42:13.824889 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Sep 13 19:42:13.824889 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application Sep 13 19:42:13.824889 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 13 19:42:13.824889 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application Sep 13 19:42:13.824889 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 19:42:13.824889 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 19:42:13.824889 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 19:42:13.824889 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 19:42:13.824889 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 19:42:13.825966 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 19:42:13.825966 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 19:42:13.825966 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 19:42:13.825966 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 19:42:13.825966 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 19:42:13.825966 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 19:42:13.825966 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 13 19:42:13.825966 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 13 19:42:13.825966 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 13 19:42:13.825966 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 13 19:42:13.825966 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 19:42:13.825966 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 19:42:13.825966 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 19:42:13.825966 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 19:42:13.825966 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 19:42:13.825966 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 19:42:13.826820 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 19:42:13.826820 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application with Lock( Sep 13 19:42:13.826820 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 19:42:13.826820 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application return self._enter() Sep 13 19:42:13.826820 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 19:42:13.826820 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 19:42:13.826820 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 19:42:13.826820 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application return self.creator() Sep 13 19:42:13.826820 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 19:42:13.826820 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application created_value = creator( Sep 13 19:42:13.826820 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 13 19:42:13.826820 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 13 19:42:13.826820 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Sep 13 19:42:13.826820 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application Sep 13 19:42:13.833638 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2de1994f-3023-4c2a-89c6-f4f412133e83 None admin] Validating token access rules against request {{(pid=82025) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:42:13.833914 dv-cinder-828806-6-smb devstack@keystone.service[82026]: [pid: 82026|app: 0|req: 357/706] 10.222.0.33 () {56 vars in 1129 bytes} [Tue Sep 13 19:42:13 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 205 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 13 19:42:13.836103 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-992bdae6-dfc1-4891-8f35-3b95b5ceadae None None] REQUEST_METHOD: `GET` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:42:13.836689 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-992bdae6-dfc1-4891-8f35-3b95b5ceadae None None] SCRIPT_NAME: `/identity` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:42:13.837123 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-992bdae6-dfc1-4891-8f35-3b95b5ceadae None None] PATH_INFO: `/` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:42:13.839604 dv-cinder-828806-6-smb devstack@keystone.service[82026]: [pid: 82026|app: 0|req: 358/707] 10.222.0.33 () {54 vars in 927 bytes} [Tue Sep 13 19:42:13 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 19:42:13.842730 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-992bdae6-dfc1-4891-8f35-3b95b5ceadae None None] Authenticating user token {{(pid=82026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:42:13.874886 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a9842a5-7529-4244-857b-81148743c569 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57539b6a6f3b4d589f5f5e1d211cd6a0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82025) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:42:13.875840 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a9842a5-7529-4244-857b-81148743c569 None admin] REQUEST_METHOD: `GET` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:42:13.876124 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a9842a5-7529-4244-857b-81148743c569 None admin] SCRIPT_NAME: `/identity` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:42:13.876672 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a9842a5-7529-4244-857b-81148743c569 None admin] PATH_INFO: `/v3/projects/service` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:42:13.884322 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a9842a5-7529-4244-857b-81148743c569 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=82025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:42:13.885418 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a9842a5-7529-4244-857b-81148743c569 None admin] RBAC: Authorization granted {{(pid=82025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:42:13.901262 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application [None req-6a9842a5-7529-4244-857b-81148743c569 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 13 19:42:13.901262 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 19:42:13.901262 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 19:42:13.901262 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 19:42:13.901262 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 19:42:13.901262 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 19:42:13.901262 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 19:42:13.901262 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 19:42:13.901262 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 19:42:13.901262 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 19:42:13.901262 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 19:42:13.901262 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 19:42:13.901262 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 13 19:42:13.901262 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 13 19:42:13.901262 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 13 19:42:13.902429 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 13 19:42:13.902429 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 19:42:13.902429 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 19:42:13.902429 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 19:42:13.902429 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 19:42:13.902429 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 19:42:13.902429 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 19:42:13.902429 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 19:42:13.902429 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application with Lock( Sep 13 19:42:13.902429 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 19:42:13.902429 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application return self._enter() Sep 13 19:42:13.902429 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 19:42:13.902429 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 19:42:13.902429 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 19:42:13.902429 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application return self.creator() Sep 13 19:42:13.902429 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 19:42:13.902429 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application created_value = creator( Sep 13 19:42:13.903454 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 13 19:42:13.903454 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 13 19:42:13.903454 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 13 19:42:13.903454 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 13 19:42:13.903454 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 13 19:42:13.903454 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 13 19:42:13.903454 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 13 19:42:13.903454 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application Sep 13 19:42:13.903454 dv-cinder-828806-6-smb devstack@keystone.service[82025]: [pid: 82025|app: 0|req: 350/708] 10.222.0.33 () {56 vars in 1111 bytes} [Tue Sep 13 19:42:13 2022] GET /identity/v3/projects/service => generated 88 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 19:42:13.904031 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c43456d-9e77-45a7-a9ee-7bf94374ea1c None None] REQUEST_METHOD: `POST` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:42:13.904153 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c43456d-9e77-45a7-a9ee-7bf94374ea1c None None] SCRIPT_NAME: `/identity` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:42:13.904426 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c43456d-9e77-45a7-a9ee-7bf94374ea1c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:42:13.927315 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.auth.core [None req-1c43456d-9e77-45a7-a9ee-7bf94374ea1c None None] MFA Rules not processed for user `57539b6a6f3b4d589f5f5e1d211cd6a0`. Rule list: `[]` (Enabled: `True`). {{(pid=82025) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 19:42:13.928056 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.fernet_utils [None req-1c43456d-9e77-45a7-a9ee-7bf94374ea1c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82025) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 19:42:13.970340 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-992bdae6-dfc1-4891-8f35-3b95b5ceadae None None] Validating token access rules against request {{(pid=82026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:42:14.002783 dv-cinder-828806-6-smb devstack@keystone.service[82025]: [pid: 82025|app: 0|req: 351/709] 10.222.0.33 () {58 vars in 1024 bytes} [Tue Sep 13 19:42:13 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 13 19:42:14.003922 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c43456d-9e77-45a7-a9ee-7bf94374ea1c None None] Authenticating user token {{(pid=82025) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:42:14.023693 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-103aa0e0-4602-485f-a673-7e0677d6f570 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57539b6a6f3b4d589f5f5e1d211cd6a0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:42:14.024899 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-103aa0e0-4602-485f-a673-7e0677d6f570 None admin] REQUEST_METHOD: `GET` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:42:14.025421 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-103aa0e0-4602-485f-a673-7e0677d6f570 None admin] SCRIPT_NAME: `/identity` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:42:14.026297 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-103aa0e0-4602-485f-a673-7e0677d6f570 None admin] PATH_INFO: `/v3/services` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:42:14.027207 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-103aa0e0-4602-485f-a673-7e0677d6f570 None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=82026) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 19:42:14.027723 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-103aa0e0-4602-485f-a673-7e0677d6f570 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=82026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:42:14.029832 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-103aa0e0-4602-485f-a673-7e0677d6f570 None admin] RBAC: Authorization granted {{(pid=82026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:42:14.038092 dv-cinder-828806-6-smb devstack@keystone.service[82026]: [pid: 82026|app: 0|req: 359/710] 10.222.0.33 () {56 vars in 1124 bytes} [Tue Sep 13 19:42:13 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 13 19:42:14.039878 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-103aa0e0-4602-485f-a673-7e0677d6f570 None admin] Authenticating user token {{(pid=82026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:42:14.049865 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG dbcounter [-] [82025] Writing DB stats keystone:SELECT=100 {{(pid=82025) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:42:14.103364 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG dbcounter [-] [82026] Writing DB stats keystone:SELECT=100 {{(pid=82026) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:42:14.135947 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c43456d-9e77-45a7-a9ee-7bf94374ea1c None None] Validating token access rules against request {{(pid=82025) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:42:14.158066 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-103aa0e0-4602-485f-a673-7e0677d6f570 None admin] Validating token access rules against request {{(pid=82026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:42:14.176888 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-886af569-5aea-487d-b16c-9d7340043153 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57539b6a6f3b4d589f5f5e1d211cd6a0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82025) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:42:14.177859 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-886af569-5aea-487d-b16c-9d7340043153 None admin] REQUEST_METHOD: `GET` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:42:14.178371 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-886af569-5aea-487d-b16c-9d7340043153 None admin] SCRIPT_NAME: `/identity` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:42:14.178853 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-886af569-5aea-487d-b16c-9d7340043153 None admin] PATH_INFO: `/v3/projects` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:42:14.179772 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-886af569-5aea-487d-b16c-9d7340043153 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=82025) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 19:42:14.180288 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-886af569-5aea-487d-b16c-9d7340043153 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=82025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:42:14.182075 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-886af569-5aea-487d-b16c-9d7340043153 None admin] RBAC: Authorization granted {{(pid=82025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:42:14.194349 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-756769aa-3fa0-4976-859a-de5ec0edf2c4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57539b6a6f3b4d589f5f5e1d211cd6a0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:42:14.194830 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-756769aa-3fa0-4976-859a-de5ec0edf2c4 None admin] REQUEST_METHOD: `GET` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:42:14.195142 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-756769aa-3fa0-4976-859a-de5ec0edf2c4 None admin] SCRIPT_NAME: `/identity` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:42:14.195421 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-756769aa-3fa0-4976-859a-de5ec0edf2c4 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:42:14.204117 dv-cinder-828806-6-smb devstack@keystone.service[82025]: [pid: 82025|app: 0|req: 352/711] 10.222.0.33 () {56 vars in 1148 bytes} [Tue Sep 13 19:42:14 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 19:42:14.205321 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-886af569-5aea-487d-b16c-9d7340043153 None admin] Authenticating user token {{(pid=82025) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:42:14.207275 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-756769aa-3fa0-4976-859a-de5ec0edf2c4 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=82026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:42:14.208780 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-756769aa-3fa0-4976-859a-de5ec0edf2c4 None admin] RBAC: Authorization granted {{(pid=82026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:42:14.223831 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application [None req-756769aa-3fa0-4976-859a-de5ec0edf2c4 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 13 19:42:14.223831 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 19:42:14.223831 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 19:42:14.223831 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 19:42:14.223831 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 19:42:14.223831 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 19:42:14.223831 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 19:42:14.223831 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 19:42:14.223831 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 19:42:14.223831 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 19:42:14.223831 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 19:42:14.223831 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 19:42:14.223831 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 13 19:42:14.223831 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 13 19:42:14.223831 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 13 19:42:14.223831 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 13 19:42:14.224861 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 19:42:14.224861 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 19:42:14.224861 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 19:42:14.224861 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 19:42:14.224861 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 19:42:14.224861 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 19:42:14.224861 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 19:42:14.224861 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application with Lock( Sep 13 19:42:14.224861 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 19:42:14.224861 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application return self._enter() Sep 13 19:42:14.224861 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 19:42:14.224861 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 19:42:14.224861 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 19:42:14.224861 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application return self.creator() Sep 13 19:42:14.224861 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 19:42:14.224861 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application created_value = creator( Sep 13 19:42:14.224861 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 13 19:42:14.225757 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 13 19:42:14.225757 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 13 19:42:14.225757 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application Sep 13 19:42:14.225757 dv-cinder-828806-6-smb devstack@keystone.service[82026]: [pid: 82026|app: 0|req: 360/712] 10.222.0.33 () {56 vars in 1108 bytes} [Tue Sep 13 19:42:14 2022] GET /identity/v3/domains/Default => generated 87 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 19:42:14.226444 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-756769aa-3fa0-4976-859a-de5ec0edf2c4 None admin] Authenticating user token {{(pid=82026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:42:14.324327 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG dbcounter [-] [82025] Writing DB stats keystone:SELECT=100 {{(pid=82025) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:42:14.328974 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-886af569-5aea-487d-b16c-9d7340043153 None admin] Validating token access rules against request {{(pid=82025) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:42:14.332376 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-756769aa-3fa0-4976-859a-de5ec0edf2c4 None admin] Validating token access rules against request {{(pid=82026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:42:14.334083 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG dbcounter [-] [82026] Writing DB stats keystone:SELECT=100 {{(pid=82026) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:42:14.365135 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daf3b9bc-6e73-46ae-9b72-191a2f8e754e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57539b6a6f3b4d589f5f5e1d211cd6a0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82025) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:42:14.365904 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daf3b9bc-6e73-46ae-9b72-191a2f8e754e None admin] REQUEST_METHOD: `GET` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:42:14.366204 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daf3b9bc-6e73-46ae-9b72-191a2f8e754e None admin] SCRIPT_NAME: `/identity` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:42:14.366545 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daf3b9bc-6e73-46ae-9b72-191a2f8e754e None admin] PATH_INFO: `/v3/services` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:42:14.367276 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daf3b9bc-6e73-46ae-9b72-191a2f8e754e None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=82025) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 19:42:14.367588 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daf3b9bc-6e73-46ae-9b72-191a2f8e754e None admin] RBAC: Authorizing `identity:list_services()` {{(pid=82025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:42:14.367823 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-178f164d-abb1-4fbc-a8e1-8a13f7505386 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57539b6a6f3b4d589f5f5e1d211cd6a0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:42:14.368495 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-178f164d-abb1-4fbc-a8e1-8a13f7505386 None admin] REQUEST_METHOD: `GET` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:42:14.368774 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-178f164d-abb1-4fbc-a8e1-8a13f7505386 None admin] SCRIPT_NAME: `/identity` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:42:14.369007 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daf3b9bc-6e73-46ae-9b72-191a2f8e754e None admin] RBAC: Authorization granted {{(pid=82025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:42:14.369106 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-178f164d-abb1-4fbc-a8e1-8a13f7505386 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:42:14.369762 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-178f164d-abb1-4fbc-a8e1-8a13f7505386 None admin] RBAC: Adding query filter params (role.id=e5af7d5baa93469e9e486ef21c85474e, scope.project.id=c8c6fba0f15b4d6a84ff601919b7b8e4, user.id=e66e7034abed4e0bad1f4137520c1e70) {{(pid=82026) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 19:42:14.370073 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-178f164d-abb1-4fbc-a8e1-8a13f7505386 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=82026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:42:14.371637 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-178f164d-abb1-4fbc-a8e1-8a13f7505386 None admin] RBAC: Authorization granted {{(pid=82026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:42:14.374601 dv-cinder-828806-6-smb devstack@keystone.service[82025]: [pid: 82025|app: 0|req: 353/713] 10.222.0.33 () {56 vars in 1124 bytes} [Tue Sep 13 19:42:14 2022] GET /identity/v3/services?type=block-storage => generated 130 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 19:42:14.375598 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daf3b9bc-6e73-46ae-9b72-191a2f8e754e None admin] Authenticating user token {{(pid=82025) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:42:14.385220 dv-cinder-828806-6-smb devstack@keystone.service[82026]: [pid: 82026|app: 0|req: 361/714] 10.222.0.33 () {56 vars in 1374 bytes} [Tue Sep 13 19:42:14 2022] GET /identity/v3/role_assignments?user.id=e66e7034abed4e0bad1f4137520c1e70&scope.project.id=c8c6fba0f15b4d6a84ff601919b7b8e4&role.id=e5af7d5baa93469e9e486ef21c85474e => generated 259 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 19:42:14.387903 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-178f164d-abb1-4fbc-a8e1-8a13f7505386 None admin] Authenticating user token {{(pid=82026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:42:14.529030 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-178f164d-abb1-4fbc-a8e1-8a13f7505386 None admin] Validating token access rules against request {{(pid=82026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:42:14.565373 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daf3b9bc-6e73-46ae-9b72-191a2f8e754e None admin] Validating token access rules against request {{(pid=82025) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:42:14.585571 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93dfc122-58c4-4986-826f-2ffc328d3b4d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57539b6a6f3b4d589f5f5e1d211cd6a0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:42:14.586604 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93dfc122-58c4-4986-826f-2ffc328d3b4d None admin] REQUEST_METHOD: `GET` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:42:14.587154 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93dfc122-58c4-4986-826f-2ffc328d3b4d None admin] SCRIPT_NAME: `/identity` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:42:14.587639 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93dfc122-58c4-4986-826f-2ffc328d3b4d None admin] PATH_INFO: `/v3/services/network` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:42:14.588515 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93dfc122-58c4-4986-826f-2ffc328d3b4d None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=82026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:42:14.591352 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93dfc122-58c4-4986-826f-2ffc328d3b4d None admin] RBAC: Authorization granted {{(pid=82026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:42:14.610806 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application [None req-93dfc122-58c4-4986-826f-2ffc328d3b4d None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Sep 13 19:42:14.610806 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 19:42:14.610806 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 13 19:42:14.610806 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 13 19:42:14.610806 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 13 19:42:14.610806 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 13 19:42:14.610806 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 13 19:42:14.610806 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 13 19:42:14.610806 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Sep 13 19:42:14.610806 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application Sep 13 19:42:14.610806 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 13 19:42:14.610806 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application Sep 13 19:42:14.610806 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 19:42:14.610806 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 19:42:14.610806 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 19:42:14.610806 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 19:42:14.610806 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 19:42:14.611991 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 19:42:14.611991 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 19:42:14.611991 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 19:42:14.611991 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 19:42:14.611991 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 19:42:14.611991 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 19:42:14.611991 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 13 19:42:14.611991 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 13 19:42:14.611991 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 13 19:42:14.611991 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 13 19:42:14.611991 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 19:42:14.611991 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 19:42:14.611991 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 19:42:14.611991 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 19:42:14.611991 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 19:42:14.611991 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 19:42:14.612903 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 19:42:14.612903 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application with Lock( Sep 13 19:42:14.612903 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 19:42:14.612903 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application return self._enter() Sep 13 19:42:14.612903 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 19:42:14.612903 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 19:42:14.612903 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 19:42:14.612903 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application return self.creator() Sep 13 19:42:14.612903 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 19:42:14.612903 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application created_value = creator( Sep 13 19:42:14.612903 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 13 19:42:14.612903 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 13 19:42:14.612903 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Sep 13 19:42:14.612903 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application Sep 13 19:42:14.616543 dv-cinder-828806-6-smb devstack@keystone.service[82026]: [pid: 82026|app: 0|req: 362/715] 10.222.0.33 () {56 vars in 1111 bytes} [Tue Sep 13 19:42:14 2022] GET /identity/v3/services/network => generated 88 bytes in 231 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 19:42:14.624152 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93dfc122-58c4-4986-826f-2ffc328d3b4d None admin] Authenticating user token {{(pid=82026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:42:14.643571 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82a94707-d990-4c69-b122-3e2a612be823 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57539b6a6f3b4d589f5f5e1d211cd6a0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82025) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:42:14.644133 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82a94707-d990-4c69-b122-3e2a612be823 None admin] REQUEST_METHOD: `GET` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:42:14.644421 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82a94707-d990-4c69-b122-3e2a612be823 None admin] SCRIPT_NAME: `/identity` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:42:14.644702 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82a94707-d990-4c69-b122-3e2a612be823 None admin] PATH_INFO: `/v3/domains` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:42:14.645384 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82a94707-d990-4c69-b122-3e2a612be823 None admin] RBAC: Adding query filter params (name=Default) {{(pid=82025) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 19:42:14.645696 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82a94707-d990-4c69-b122-3e2a612be823 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:42:14.647309 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82a94707-d990-4c69-b122-3e2a612be823 None admin] RBAC: Authorization granted {{(pid=82025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:42:14.669048 dv-cinder-828806-6-smb devstack@keystone.service[82025]: [pid: 82025|app: 0|req: 354/716] 10.222.0.33 () {56 vars in 1109 bytes} [Tue Sep 13 19:42:14 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 290 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 19:42:14.670324 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG dbcounter [-] [82026] Writing DB stats keystone:SELECT=100 {{(pid=82026) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:42:14.671142 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82a94707-d990-4c69-b122-3e2a612be823 None admin] Authenticating user token {{(pid=82025) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:42:14.701592 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG dbcounter [-] [82025] Writing DB stats keystone:SELECT=100 {{(pid=82025) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:42:14.756878 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93dfc122-58c4-4986-826f-2ffc328d3b4d None admin] Validating token access rules against request {{(pid=82026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:42:14.787059 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82a94707-d990-4c69-b122-3e2a612be823 None admin] Validating token access rules against request {{(pid=82025) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:42:14.805314 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97ff3d07-e01b-4c6a-8b95-8e83e2315807 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57539b6a6f3b4d589f5f5e1d211cd6a0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:42:14.806288 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97ff3d07-e01b-4c6a-8b95-8e83e2315807 None admin] REQUEST_METHOD: `GET` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:42:14.806777 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97ff3d07-e01b-4c6a-8b95-8e83e2315807 None admin] SCRIPT_NAME: `/identity` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:42:14.807316 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97ff3d07-e01b-4c6a-8b95-8e83e2315807 None admin] PATH_INFO: `/v3/services` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:42:14.814353 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97ff3d07-e01b-4c6a-8b95-8e83e2315807 None admin] RBAC: Adding query filter params (name=network) {{(pid=82026) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 19:42:14.814980 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97ff3d07-e01b-4c6a-8b95-8e83e2315807 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=82026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:42:14.816660 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97ff3d07-e01b-4c6a-8b95-8e83e2315807 None admin] RBAC: Authorization granted {{(pid=82026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:42:14.822406 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb93a432-0ff3-4fe2-b8ba-17b24f741319 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57539b6a6f3b4d589f5f5e1d211cd6a0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82025) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:42:14.822898 dv-cinder-828806-6-smb devstack@keystone.service[82026]: [pid: 82026|app: 0|req: 363/717] 10.222.0.33 () {56 vars in 1112 bytes} [Tue Sep 13 19:42:14 2022] GET /identity/v3/services?name=network => generated 124 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 19:42:14.827097 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb93a432-0ff3-4fe2-b8ba-17b24f741319 None admin] REQUEST_METHOD: `POST` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:42:14.827097 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb93a432-0ff3-4fe2-b8ba-17b24f741319 None admin] SCRIPT_NAME: `/identity` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:42:14.827097 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb93a432-0ff3-4fe2-b8ba-17b24f741319 None admin] PATH_INFO: `/v3/users` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:42:14.827097 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb93a432-0ff3-4fe2-b8ba-17b24f741319 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=82025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:42:14.827097 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb93a432-0ff3-4fe2-b8ba-17b24f741319 None admin] RBAC: Authorization granted {{(pid=82025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:42:14.830353 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97ff3d07-e01b-4c6a-8b95-8e83e2315807 None admin] Authenticating user token {{(pid=82026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:42:14.935573 dv-cinder-828806-6-smb devstack@keystone.service[82025]: [pid: 82025|app: 0|req: 355/718] 10.222.0.33 () {60 vars in 1132 bytes} [Tue Sep 13 19:42:14 2022] POST /identity/v3/users => generated 254 bytes in 265 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 13 19:42:14.951256 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG dbcounter [-] [82026] Writing DB stats keystone:SELECT=100 {{(pid=82026) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:42:14.960265 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97ff3d07-e01b-4c6a-8b95-8e83e2315807 None admin] Validating token access rules against request {{(pid=82026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:42:15.004206 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49a315ab-a4f6-4125-8bfc-d9ab94271dda None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57539b6a6f3b4d589f5f5e1d211cd6a0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:42:15.004966 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49a315ab-a4f6-4125-8bfc-d9ab94271dda None admin] REQUEST_METHOD: `GET` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:42:15.005210 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49a315ab-a4f6-4125-8bfc-d9ab94271dda None admin] SCRIPT_NAME: `/identity` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:42:15.006307 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49a315ab-a4f6-4125-8bfc-d9ab94271dda None admin] PATH_INFO: `/v3/services` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:42:15.006307 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49a315ab-a4f6-4125-8bfc-d9ab94271dda None admin] RBAC: Adding query filter params (type=network) {{(pid=82026) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 19:42:15.006498 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49a315ab-a4f6-4125-8bfc-d9ab94271dda None admin] RBAC: Authorizing `identity:list_services()` {{(pid=82026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:42:15.007831 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49a315ab-a4f6-4125-8bfc-d9ab94271dda None admin] RBAC: Authorization granted {{(pid=82026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:42:15.014567 dv-cinder-828806-6-smb devstack@keystone.service[82026]: [pid: 82026|app: 0|req: 364/719] 10.222.0.33 () {56 vars in 1112 bytes} [Tue Sep 13 19:42:14 2022] GET /identity/v3/services?type=network => generated 124 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 19:42:16.042172 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6d0c0a5-ddb6-4088-aa13-82e7c94e4c28 None None] REQUEST_METHOD: `GET` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:42:16.042720 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6d0c0a5-ddb6-4088-aa13-82e7c94e4c28 None None] SCRIPT_NAME: `/identity` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:42:16.042720 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6d0c0a5-ddb6-4088-aa13-82e7c94e4c28 None None] PATH_INFO: `/` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:42:16.044394 dv-cinder-828806-6-smb devstack@keystone.service[82025]: [pid: 82025|app: 0|req: 356/720] 10.222.0.33 () {54 vars in 927 bytes} [Tue Sep 13 19:42:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 19:42:16.049600 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab578e1c-e7f3-4769-b2e0-760a64d7f5c7 None None] REQUEST_METHOD: `POST` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:42:16.050041 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab578e1c-e7f3-4769-b2e0-760a64d7f5c7 None None] SCRIPT_NAME: `/identity` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:42:16.050223 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab578e1c-e7f3-4769-b2e0-760a64d7f5c7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:42:16.072558 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.auth.core [None req-ab578e1c-e7f3-4769-b2e0-760a64d7f5c7 None None] MFA Rules not processed for user `57539b6a6f3b4d589f5f5e1d211cd6a0`. Rule list: `[]` (Enabled: `True`). {{(pid=82026) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 19:42:16.073770 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.common.fernet_utils [None req-ab578e1c-e7f3-4769-b2e0-760a64d7f5c7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82026) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 19:42:16.172110 dv-cinder-828806-6-smb devstack@keystone.service[82026]: [pid: 82026|app: 0|req: 365/721] 10.222.0.33 () {58 vars in 1024 bytes} [Tue Sep 13 19:42:16 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 13 19:42:16.571068 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6d0c0a5-ddb6-4088-aa13-82e7c94e4c28 None None] Authenticating user token {{(pid=82025) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:42:16.687337 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG dbcounter [-] [82025] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=82025) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:42:16.721068 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6d0c0a5-ddb6-4088-aa13-82e7c94e4c28 None None] Validating token access rules against request {{(pid=82025) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:42:16.768539 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75020ae7-7022-4102-b262-fe45c9563f4f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57539b6a6f3b4d589f5f5e1d211cd6a0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82025) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:42:16.769175 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75020ae7-7022-4102-b262-fe45c9563f4f None admin] REQUEST_METHOD: `GET` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:42:16.769456 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75020ae7-7022-4102-b262-fe45c9563f4f None admin] SCRIPT_NAME: `/identity` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:42:16.769734 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75020ae7-7022-4102-b262-fe45c9563f4f None admin] PATH_INFO: `/v3/roles/admin` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:42:16.787890 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75020ae7-7022-4102-b262-fe45c9563f4f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=82025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 13 19:42:16.792730 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application [None req-75020ae7-7022-4102-b262-fe45c9563f4f None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 13 19:42:16.792730 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 19:42:16.792730 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 19:42:16.792730 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 19:42:16.792730 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 19:42:16.792730 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 19:42:16.792730 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 19:42:16.792730 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 19:42:16.792730 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 19:42:16.792730 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 19:42:16.792730 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 19:42:16.792730 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 19:42:16.792730 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 13 19:42:16.792730 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 13 19:42:16.792730 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 13 19:42:16.792730 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 13 19:42:16.793647 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 13 19:42:16.793647 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 13 19:42:16.793647 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 13 19:42:16.793647 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 13 19:42:16.793647 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 19:42:16.793647 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 19:42:16.793647 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 19:42:16.793647 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 19:42:16.793647 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 19:42:16.793647 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 19:42:16.793647 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 19:42:16.793647 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application with Lock( Sep 13 19:42:16.793647 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 19:42:16.793647 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application return self._enter() Sep 13 19:42:16.793647 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 19:42:16.793647 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 19:42:16.794901 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 19:42:16.794901 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application return self.creator() Sep 13 19:42:16.794901 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 19:42:16.794901 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application created_value = creator( Sep 13 19:42:16.794901 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 13 19:42:16.794901 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 13 19:42:16.794901 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 13 19:42:16.794901 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 13 19:42:16.794901 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 13 19:42:16.794901 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 13 19:42:16.794901 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 13 19:42:16.794901 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application Sep 13 19:42:16.794901 dv-cinder-828806-6-smb devstack@keystone.service[82025]: [pid: 82025|app: 0|req: 357/722] 10.222.0.33 () {56 vars in 1096 bytes} [Tue Sep 13 19:42:16 2022] GET /identity/v3/roles/admin => generated 83 bytes in 224 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 19:42:16.800096 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab578e1c-e7f3-4769-b2e0-760a64d7f5c7 None None] Authenticating user token {{(pid=82026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:42:16.835186 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ada2e614-62f7-4483-85e5-6588fdfdcfe3 None None] REQUEST_METHOD: `GET` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:42:16.835186 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ada2e614-62f7-4483-85e5-6588fdfdcfe3 None None] SCRIPT_NAME: `/identity` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:42:16.835186 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ada2e614-62f7-4483-85e5-6588fdfdcfe3 None None] PATH_INFO: `/` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:42:16.836449 dv-cinder-828806-6-smb devstack@keystone.service[82025]: [pid: 82025|app: 0|req: 358/723] 10.222.0.33 () {54 vars in 927 bytes} [Tue Sep 13 19:42:16 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 19:42:16.842161 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d11c08c-b50e-4375-a070-d5f079a0af52 None None] REQUEST_METHOD: `POST` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:42:16.842557 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d11c08c-b50e-4375-a070-d5f079a0af52 None None] SCRIPT_NAME: `/identity` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:42:16.842834 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d11c08c-b50e-4375-a070-d5f079a0af52 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:42:16.867961 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.auth.core [None req-0d11c08c-b50e-4375-a070-d5f079a0af52 None None] MFA Rules not processed for user `57539b6a6f3b4d589f5f5e1d211cd6a0`. Rule list: `[]` (Enabled: `True`). {{(pid=82025) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 19:42:16.869226 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.fernet_utils [None req-0d11c08c-b50e-4375-a070-d5f079a0af52 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82025) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 19:42:16.990017 dv-cinder-828806-6-smb devstack@keystone.service[82025]: [pid: 82025|app: 0|req: 359/724] 10.222.0.33 () {58 vars in 1024 bytes} [Tue Sep 13 19:42:16 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 149 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 13 19:42:17.024469 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG dbcounter [-] [82026] Writing DB stats keystone:SELECT=100 {{(pid=82026) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:42:17.046092 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab578e1c-e7f3-4769-b2e0-760a64d7f5c7 None None] Validating token access rules against request {{(pid=82026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:42:17.099972 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cca2c90-e2e2-43dd-a210-cb79f1aca03b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57539b6a6f3b4d589f5f5e1d211cd6a0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:42:17.100601 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cca2c90-e2e2-43dd-a210-cb79f1aca03b None admin] REQUEST_METHOD: `GET` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:42:17.100828 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cca2c90-e2e2-43dd-a210-cb79f1aca03b None admin] SCRIPT_NAME: `/identity` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:42:17.101050 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cca2c90-e2e2-43dd-a210-cb79f1aca03b None admin] PATH_INFO: `/v3/roles` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:42:17.101724 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cca2c90-e2e2-43dd-a210-cb79f1aca03b None admin] RBAC: Adding query filter params (name=admin) {{(pid=82026) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 19:42:17.102032 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cca2c90-e2e2-43dd-a210-cb79f1aca03b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:42:17.103432 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cca2c90-e2e2-43dd-a210-cb79f1aca03b None admin] RBAC: Authorization granted {{(pid=82026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:42:17.118457 dv-cinder-828806-6-smb devstack@keystone.service[82026]: [pid: 82026|app: 0|req: 366/725] 10.222.0.33 () {56 vars in 1099 bytes} [Tue Sep 13 19:42:16 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 319 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 19:42:17.123689 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d11c08c-b50e-4375-a070-d5f079a0af52 None None] Authenticating user token {{(pid=82025) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:42:17.231236 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG dbcounter [-] [82025] Writing DB stats keystone:SELECT=100 {{(pid=82025) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:42:17.275775 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d11c08c-b50e-4375-a070-d5f079a0af52 None None] Validating token access rules against request {{(pid=82025) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:42:17.346952 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cca2c90-e2e2-43dd-a210-cb79f1aca03b None admin] Authenticating user token {{(pid=82026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:42:17.348919 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fff0808c-250c-4c87-a206-047e2a69911e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57539b6a6f3b4d589f5f5e1d211cd6a0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82025) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:42:17.349569 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fff0808c-250c-4c87-a206-047e2a69911e None admin] REQUEST_METHOD: `GET` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:42:17.349858 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fff0808c-250c-4c87-a206-047e2a69911e None admin] SCRIPT_NAME: `/identity` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:42:17.350241 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fff0808c-250c-4c87-a206-047e2a69911e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:42:17.374698 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fff0808c-250c-4c87-a206-047e2a69911e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=82025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:42:17.377047 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fff0808c-250c-4c87-a206-047e2a69911e None admin] RBAC: Authorization granted {{(pid=82025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:42:17.404662 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application [None req-fff0808c-250c-4c87-a206-047e2a69911e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 13 19:42:17.404662 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 19:42:17.404662 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 19:42:17.404662 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 19:42:17.404662 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 19:42:17.404662 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 19:42:17.404662 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 19:42:17.404662 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 19:42:17.404662 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 19:42:17.404662 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 19:42:17.404662 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 19:42:17.404662 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 19:42:17.404662 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 13 19:42:17.404662 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 13 19:42:17.404662 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 13 19:42:17.404662 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 13 19:42:17.405675 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 19:42:17.405675 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 19:42:17.405675 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 19:42:17.405675 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 19:42:17.405675 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 19:42:17.405675 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 19:42:17.405675 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 19:42:17.405675 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application with Lock( Sep 13 19:42:17.405675 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 19:42:17.405675 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application return self._enter() Sep 13 19:42:17.405675 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 19:42:17.405675 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 19:42:17.405675 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 19:42:17.405675 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application return self.creator() Sep 13 19:42:17.405675 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 19:42:17.405675 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application created_value = creator( Sep 13 19:42:17.405675 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 13 19:42:17.407344 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 13 19:42:17.407344 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 13 19:42:17.407344 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application Sep 13 19:42:17.408357 dv-cinder-828806-6-smb devstack@keystone.service[82025]: [pid: 82025|app: 0|req: 360/726] 10.222.0.33 () {56 vars in 1108 bytes} [Tue Sep 13 19:42:17 2022] GET /identity/v3/domains/Default => generated 87 bytes in 285 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 19:42:17.414562 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fff0808c-250c-4c87-a206-047e2a69911e None admin] Authenticating user token {{(pid=82025) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:42:17.511909 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cca2c90-e2e2-43dd-a210-cb79f1aca03b None admin] Validating token access rules against request {{(pid=82026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:42:17.554028 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fff0808c-250c-4c87-a206-047e2a69911e None admin] Validating token access rules against request {{(pid=82025) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:42:17.559694 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5d72540-a74a-492d-b2f9-095cb7a050c3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57539b6a6f3b4d589f5f5e1d211cd6a0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:42:17.560362 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5d72540-a74a-492d-b2f9-095cb7a050c3 None admin] REQUEST_METHOD: `POST` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:42:17.560648 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5d72540-a74a-492d-b2f9-095cb7a050c3 None admin] SCRIPT_NAME: `/identity` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:42:17.560983 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5d72540-a74a-492d-b2f9-095cb7a050c3 None admin] PATH_INFO: `/v3/services` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:42:17.562215 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5d72540-a74a-492d-b2f9-095cb7a050c3 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=82026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:42:17.564460 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5d72540-a74a-492d-b2f9-095cb7a050c3 None admin] RBAC: Authorization granted {{(pid=82026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:42:17.576712 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG dbcounter [-] [82025] Writing DB stats keystone:SELECT=100 {{(pid=82025) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:42:17.591363 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcb253ad-ae1b-4587-af65-787c829299cb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57539b6a6f3b4d589f5f5e1d211cd6a0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82025) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:42:17.593195 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcb253ad-ae1b-4587-af65-787c829299cb None admin] REQUEST_METHOD: `GET` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:42:17.593195 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcb253ad-ae1b-4587-af65-787c829299cb None admin] SCRIPT_NAME: `/identity` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:42:17.593195 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcb253ad-ae1b-4587-af65-787c829299cb None admin] PATH_INFO: `/v3/domains` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:42:17.593195 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcb253ad-ae1b-4587-af65-787c829299cb None admin] RBAC: Adding query filter params (name=Default) {{(pid=82025) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 19:42:17.593561 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcb253ad-ae1b-4587-af65-787c829299cb None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:42:17.595551 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcb253ad-ae1b-4587-af65-787c829299cb None admin] RBAC: Authorization granted {{(pid=82025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:42:17.612002 dv-cinder-828806-6-smb devstack@keystone.service[82025]: [pid: 82025|app: 0|req: 361/727] 10.222.0.33 () {56 vars in 1109 bytes} [Tue Sep 13 19:42:17 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 19:42:17.612002 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdaef376-3236-4776-918a-a3509bd08e3e None None] REQUEST_METHOD: `GET` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:42:17.612002 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdaef376-3236-4776-918a-a3509bd08e3e None None] SCRIPT_NAME: `/identity` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:42:17.612002 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdaef376-3236-4776-918a-a3509bd08e3e None None] PATH_INFO: `/` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:42:17.612002 dv-cinder-828806-6-smb devstack@keystone.service[82025]: [pid: 82025|app: 0|req: 362/728] 10.222.0.33 () {54 vars in 927 bytes} [Tue Sep 13 19:42:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 19:42:17.615825 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdaef376-3236-4776-918a-a3509bd08e3e None None] Authenticating user token {{(pid=82025) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:42:17.686303 dv-cinder-828806-6-smb devstack@keystone.service[82026]: [pid: 82026|app: 0|req: 367/729] 10.222.0.33 () {60 vars in 1141 bytes} [Tue Sep 13 19:42:17 2022] POST /identity/v3/services => generated 251 bytes in 340 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 13 19:42:17.689182 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-047592b2-4649-4b2d-b249-596c848c5c10 None None] REQUEST_METHOD: `POST` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:42:17.689706 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-047592b2-4649-4b2d-b249-596c848c5c10 None None] SCRIPT_NAME: `/identity` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:42:17.690259 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-047592b2-4649-4b2d-b249-596c848c5c10 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:42:17.715138 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.auth.core [None req-047592b2-4649-4b2d-b249-596c848c5c10 None None] MFA Rules not processed for user `57539b6a6f3b4d589f5f5e1d211cd6a0`. Rule list: `[]` (Enabled: `True`). {{(pid=82026) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 19:42:17.716917 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.common.fernet_utils [None req-047592b2-4649-4b2d-b249-596c848c5c10 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82026) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 19:42:17.722280 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG dbcounter [-] [82026] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82026) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:42:17.846651 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdaef376-3236-4776-918a-a3509bd08e3e None None] Validating token access rules against request {{(pid=82025) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:42:17.847878 dv-cinder-828806-6-smb devstack@keystone.service[82026]: [pid: 82026|app: 0|req: 368/730] 10.222.0.33 () {58 vars in 1024 bytes} [Tue Sep 13 19:42:17 2022] POST /identity/v3/auth/tokens => generated 903 bytes in 161 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 13 19:42:17.874910 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3087b08f-db89-4caa-a4a5-69455575deb2 None None] REQUEST_METHOD: `GET` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:42:17.876260 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3087b08f-db89-4caa-a4a5-69455575deb2 None None] SCRIPT_NAME: `/identity` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:42:17.876872 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3087b08f-db89-4caa-a4a5-69455575deb2 None None] PATH_INFO: `/` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:42:17.879366 dv-cinder-828806-6-smb devstack@keystone.service[82026]: [pid: 82026|app: 0|req: 369/731] 10.222.0.33 () {54 vars in 927 bytes} [Tue Sep 13 19:42:17 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 19:42:17.885295 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8294c941-46fe-4953-97fa-7f28adcf64bb None None] REQUEST_METHOD: `POST` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:42:17.886009 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8294c941-46fe-4953-97fa-7f28adcf64bb None None] SCRIPT_NAME: `/identity` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:42:17.886536 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8294c941-46fe-4953-97fa-7f28adcf64bb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:42:17.962033 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.auth.core [None req-8294c941-46fe-4953-97fa-7f28adcf64bb None None] MFA Rules not processed for user `57539b6a6f3b4d589f5f5e1d211cd6a0`. Rule list: `[]` (Enabled: `True`). {{(pid=82026) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 19:42:17.964446 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.common.fernet_utils [None req-8294c941-46fe-4953-97fa-7f28adcf64bb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82026) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 19:42:17.975801 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6233d97d-c724-40d2-9911-e28e5f8d57aa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57539b6a6f3b4d589f5f5e1d211cd6a0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82025) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:42:17.976453 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6233d97d-c724-40d2-9911-e28e5f8d57aa None admin] REQUEST_METHOD: `GET` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:42:17.976739 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6233d97d-c724-40d2-9911-e28e5f8d57aa None admin] SCRIPT_NAME: `/identity` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:42:17.977023 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6233d97d-c724-40d2-9911-e28e5f8d57aa None admin] PATH_INFO: `/v3/users/swift` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:42:17.995982 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6233d97d-c724-40d2-9911-e28e5f8d57aa None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=82025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:42:17.997860 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6233d97d-c724-40d2-9911-e28e5f8d57aa None admin] RBAC: Authorization granted {{(pid=82025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:42:18.021054 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application [None req-6233d97d-c724-40d2-9911-e28e5f8d57aa None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Sep 13 19:42:18.021054 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 19:42:18.021054 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 19:42:18.021054 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 19:42:18.021054 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 19:42:18.021054 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 19:42:18.021054 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 19:42:18.021054 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 19:42:18.021054 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 19:42:18.021054 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 19:42:18.021054 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 19:42:18.021054 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 19:42:18.021054 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 13 19:42:18.021054 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 13 19:42:18.021054 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 13 19:42:18.021054 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 13 19:42:18.022072 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 19:42:18.022072 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 19:42:18.022072 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 13 19:42:18.022072 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 13 19:42:18.022072 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 13 19:42:18.022072 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 13 19:42:18.022072 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 19:42:18.022072 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 19:42:18.022072 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 19:42:18.022072 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 19:42:18.022072 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 19:42:18.022072 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application with Lock( Sep 13 19:42:18.022072 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 19:42:18.022072 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application return self._enter() Sep 13 19:42:18.022072 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 19:42:18.022072 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 19:42:18.022072 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 19:42:18.022072 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application return self.creator() Sep 13 19:42:18.023005 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 19:42:18.023005 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application created_value = creator( Sep 13 19:42:18.023005 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 13 19:42:18.023005 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 13 19:42:18.023005 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 13 19:42:18.023005 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 13 19:42:18.023005 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 13 19:42:18.023005 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 13 19:42:18.023005 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Sep 13 19:42:18.023005 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application Sep 13 19:42:18.024880 dv-cinder-828806-6-smb devstack@keystone.service[82025]: [pid: 82025|app: 0|req: 363/732] 10.222.0.33 () {56 vars in 1096 bytes} [Tue Sep 13 19:42:17 2022] GET /identity/v3/users/swift => generated 83 bytes in 409 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 19:42:18.027439 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddc6c365-a562-42ff-a6b2-dc31d90d83bb None None] REQUEST_METHOD: `GET` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:42:18.027749 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddc6c365-a562-42ff-a6b2-dc31d90d83bb None None] SCRIPT_NAME: `/identity` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:42:18.028007 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddc6c365-a562-42ff-a6b2-dc31d90d83bb None None] PATH_INFO: `/` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:42:18.029640 dv-cinder-828806-6-smb devstack@keystone.service[82025]: [pid: 82025|app: 0|req: 364/733] 10.222.0.33 () {54 vars in 927 bytes} [Tue Sep 13 19:42:18 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 19:42:18.030638 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddc6c365-a562-42ff-a6b2-dc31d90d83bb None None] Authenticating user token {{(pid=82025) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:42:18.088785 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG dbcounter [-] [82025] Writing DB stats keystone:SELECT=100 {{(pid=82025) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:42:18.091681 dv-cinder-828806-6-smb devstack@keystone.service[82026]: [pid: 82026|app: 0|req: 370/734] 10.222.0.33 () {58 vars in 1024 bytes} [Tue Sep 13 19:42:17 2022] POST /identity/v3/auth/tokens => generated 903 bytes in 201 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 13 19:42:18.092918 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aceb7fb-52a1-4c48-89d2-d3c6680ef81a None None] REQUEST_METHOD: `POST` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:42:18.093196 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aceb7fb-52a1-4c48-89d2-d3c6680ef81a None None] SCRIPT_NAME: `/identity` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:42:18.093485 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aceb7fb-52a1-4c48-89d2-d3c6680ef81a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:42:18.135084 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.auth.core [None req-3aceb7fb-52a1-4c48-89d2-d3c6680ef81a None None] MFA Rules not processed for user `57539b6a6f3b4d589f5f5e1d211cd6a0`. Rule list: `[]` (Enabled: `True`). {{(pid=82026) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 19:42:18.144366 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.common.fernet_utils [None req-3aceb7fb-52a1-4c48-89d2-d3c6680ef81a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82026) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 19:42:18.239233 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddc6c365-a562-42ff-a6b2-dc31d90d83bb None None] Validating token access rules against request {{(pid=82025) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:42:18.271641 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG dbcounter [-] [82026] Writing DB stats keystone:SELECT=100 {{(pid=82026) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:42:18.301406 dv-cinder-828806-6-smb devstack@keystone.service[82026]: [pid: 82026|app: 0|req: 371/735] 10.222.0.33 () {58 vars in 1024 bytes} [Tue Sep 13 19:42:18 2022] POST /identity/v3/auth/tokens => generated 903 bytes in 209 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 13 19:42:18.302424 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3aceb7fb-52a1-4c48-89d2-d3c6680ef81a None None] Authenticating user token {{(pid=82026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:42:18.317642 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-049666e1-dfb5-4e98-89c5-62d9220c221f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57539b6a6f3b4d589f5f5e1d211cd6a0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82025) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:42:18.318271 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-049666e1-dfb5-4e98-89c5-62d9220c221f None admin] REQUEST_METHOD: `GET` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:42:18.318559 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-049666e1-dfb5-4e98-89c5-62d9220c221f None admin] SCRIPT_NAME: `/identity` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:42:18.318841 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-049666e1-dfb5-4e98-89c5-62d9220c221f None admin] PATH_INFO: `/v3/users` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:42:18.319666 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-049666e1-dfb5-4e98-89c5-62d9220c221f None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=82025) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 19:42:18.319980 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-049666e1-dfb5-4e98-89c5-62d9220c221f None admin] RBAC: Authorizing `identity:list_users()` {{(pid=82025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:42:18.321410 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-049666e1-dfb5-4e98-89c5-62d9220c221f None admin] RBAC: Authorization granted {{(pid=82025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:42:18.359199 dv-cinder-828806-6-smb devstack@keystone.service[82025]: [pid: 82025|app: 0|req: 365/736] 10.222.0.33 () {56 vars in 1135 bytes} [Tue Sep 13 19:42:18 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 325 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 19:42:18.364970 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-049666e1-dfb5-4e98-89c5-62d9220c221f None admin] Authenticating user token {{(pid=82025) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:42:18.493387 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG dbcounter [-] [82025] Writing DB stats keystone:SELECT=100 {{(pid=82025) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:42:18.496065 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3aceb7fb-52a1-4c48-89d2-d3c6680ef81a None None] Validating token access rules against request {{(pid=82026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:42:18.501882 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-049666e1-dfb5-4e98-89c5-62d9220c221f None admin] Validating token access rules against request {{(pid=82025) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:42:18.537437 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c15aa784-a793-4132-8e6c-724a0b97ad63 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57539b6a6f3b4d589f5f5e1d211cd6a0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82025) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:42:18.537660 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bf244bc-06e3-4b33-aef4-a4369f6b6f2c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57539b6a6f3b4d589f5f5e1d211cd6a0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:42:18.538052 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c15aa784-a793-4132-8e6c-724a0b97ad63 None admin] REQUEST_METHOD: `GET` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:42:18.538341 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c15aa784-a793-4132-8e6c-724a0b97ad63 None admin] SCRIPT_NAME: `/identity` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:42:18.538624 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c15aa784-a793-4132-8e6c-724a0b97ad63 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:42:18.538928 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bf244bc-06e3-4b33-aef4-a4369f6b6f2c None admin] REQUEST_METHOD: `GET` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:42:18.539368 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bf244bc-06e3-4b33-aef4-a4369f6b6f2c None admin] SCRIPT_NAME: `/identity` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:42:18.539798 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bf244bc-06e3-4b33-aef4-a4369f6b6f2c None admin] PATH_INFO: `/v3/roles/admin` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:42:18.551134 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bf244bc-06e3-4b33-aef4-a4369f6b6f2c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=82026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 13 19:42:18.556308 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application [None req-1bf244bc-06e3-4b33-aef4-a4369f6b6f2c None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 13 19:42:18.556308 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 19:42:18.556308 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 19:42:18.556308 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 19:42:18.556308 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 19:42:18.556308 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 19:42:18.556308 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 19:42:18.556308 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 19:42:18.556308 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 19:42:18.556308 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 19:42:18.556308 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 19:42:18.556308 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 19:42:18.556308 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 13 19:42:18.556308 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 13 19:42:18.556308 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 13 19:42:18.556308 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 13 19:42:18.557436 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 13 19:42:18.557436 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 13 19:42:18.557436 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 13 19:42:18.557436 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 13 19:42:18.557436 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 19:42:18.557436 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 19:42:18.557436 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 19:42:18.557436 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 19:42:18.557436 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 19:42:18.557436 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 19:42:18.557436 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 19:42:18.557436 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application with Lock( Sep 13 19:42:18.557436 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 19:42:18.557436 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application return self._enter() Sep 13 19:42:18.557436 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 19:42:18.557436 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 19:42:18.558493 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 19:42:18.558493 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application return self.creator() Sep 13 19:42:18.558493 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 19:42:18.558493 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application created_value = creator( Sep 13 19:42:18.558493 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 13 19:42:18.558493 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 13 19:42:18.558493 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 13 19:42:18.558493 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 13 19:42:18.558493 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 13 19:42:18.558493 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 13 19:42:18.558493 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 13 19:42:18.558493 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application Sep 13 19:42:18.560669 dv-cinder-828806-6-smb devstack@keystone.service[82026]: [pid: 82026|app: 0|req: 372/737] 10.222.0.33 () {56 vars in 1096 bytes} [Tue Sep 13 19:42:18 2022] GET /identity/v3/roles/admin => generated 83 bytes in 259 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 19:42:18.561600 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bf244bc-06e3-4b33-aef4-a4369f6b6f2c None admin] Authenticating user token {{(pid=82026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:42:18.612397 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c15aa784-a793-4132-8e6c-724a0b97ad63 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=82025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:42:18.613861 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c15aa784-a793-4132-8e6c-724a0b97ad63 None admin] RBAC: Authorization granted {{(pid=82025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:42:18.624613 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG dbcounter [-] [82026] Writing DB stats keystone:SELECT=100 {{(pid=82026) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:42:18.674040 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bf244bc-06e3-4b33-aef4-a4369f6b6f2c None admin] Validating token access rules against request {{(pid=82026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:42:18.710709 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58cd2e04-e9a9-4069-87e1-e4ec6268163a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57539b6a6f3b4d589f5f5e1d211cd6a0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:42:18.711638 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58cd2e04-e9a9-4069-87e1-e4ec6268163a None admin] REQUEST_METHOD: `POST` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:42:18.711774 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG dbcounter [-] [82025] Writing DB stats keystone:SELECT=100 {{(pid=82025) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:42:18.711922 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58cd2e04-e9a9-4069-87e1-e4ec6268163a None admin] SCRIPT_NAME: `/identity` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:42:18.712196 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58cd2e04-e9a9-4069-87e1-e4ec6268163a None admin] PATH_INFO: `/v3/services` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:42:18.712864 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58cd2e04-e9a9-4069-87e1-e4ec6268163a None admin] RBAC: Authorizing `identity:create_service()` {{(pid=82026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:42:18.714283 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58cd2e04-e9a9-4069-87e1-e4ec6268163a None admin] RBAC: Authorization granted {{(pid=82026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:42:18.720997 dv-cinder-828806-6-smb devstack@keystone.service[82025]: [pid: 82025|app: 0|req: 366/738] 10.222.0.33 () {58 vars in 1282 bytes} [Tue Sep 13 19:42:18 2022] GET /identity/v3/auth/tokens => generated 903 bytes in 356 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 13 19:42:18.721643 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c15aa784-a793-4132-8e6c-724a0b97ad63 None admin] Authenticating user token {{(pid=82025) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:42:18.804070 dv-cinder-828806-6-smb devstack@keystone.service[82026]: [pid: 82026|app: 0|req: 373/739] 10.222.0.33 () {60 vars in 1141 bytes} [Tue Sep 13 19:42:18 2022] POST /identity/v3/services => generated 240 bytes in 243 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 13 19:42:18.804994 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58cd2e04-e9a9-4069-87e1-e4ec6268163a None admin] Authenticating user token {{(pid=82026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:42:18.838592 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c15aa784-a793-4132-8e6c-724a0b97ad63 None admin] Validating token access rules against request {{(pid=82025) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:42:18.886984 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d8667fd-7e01-4d82-92e7-200dcf858a8b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57539b6a6f3b4d589f5f5e1d211cd6a0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82025) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:42:18.887908 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d8667fd-7e01-4d82-92e7-200dcf858a8b None admin] REQUEST_METHOD: `GET` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:42:18.888372 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d8667fd-7e01-4d82-92e7-200dcf858a8b None admin] SCRIPT_NAME: `/identity` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:42:18.888807 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d8667fd-7e01-4d82-92e7-200dcf858a8b None admin] PATH_INFO: `/v3/roles` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:42:18.889629 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d8667fd-7e01-4d82-92e7-200dcf858a8b None admin] RBAC: Adding query filter params (name=admin) {{(pid=82025) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 19:42:18.890091 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d8667fd-7e01-4d82-92e7-200dcf858a8b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:42:18.892515 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d8667fd-7e01-4d82-92e7-200dcf858a8b None admin] RBAC: Authorization granted {{(pid=82025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:42:18.907828 dv-cinder-828806-6-smb devstack@keystone.service[82025]: [pid: 82025|app: 0|req: 367/740] 10.222.0.33 () {56 vars in 1099 bytes} [Tue Sep 13 19:42:18 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 19:42:18.908402 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d8667fd-7e01-4d82-92e7-200dcf858a8b None admin] Authenticating user token {{(pid=82025) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:42:18.944992 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58cd2e04-e9a9-4069-87e1-e4ec6268163a None admin] Validating token access rules against request {{(pid=82026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:42:18.965109 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG dbcounter [-] [82026] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82026) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:42:18.982037 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG dbcounter [-] [82025] Writing DB stats keystone:SELECT=100 {{(pid=82025) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:42:18.987484 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46e12f08-7279-4246-8523-2cf51f284e69 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57539b6a6f3b4d589f5f5e1d211cd6a0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:42:18.988488 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46e12f08-7279-4246-8523-2cf51f284e69 None admin] REQUEST_METHOD: `GET` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:42:18.988975 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46e12f08-7279-4246-8523-2cf51f284e69 None admin] SCRIPT_NAME: `/identity` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:42:18.989453 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46e12f08-7279-4246-8523-2cf51f284e69 None admin] PATH_INFO: `/v3/roles/service` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:42:19.003323 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46e12f08-7279-4246-8523-2cf51f284e69 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=82026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 13 19:42:19.008719 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application [None req-46e12f08-7279-4246-8523-2cf51f284e69 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 13 19:42:19.008719 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 19:42:19.008719 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 19:42:19.008719 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 19:42:19.008719 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 19:42:19.008719 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 19:42:19.008719 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 19:42:19.008719 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 19:42:19.008719 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 19:42:19.008719 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 19:42:19.008719 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 19:42:19.008719 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 19:42:19.008719 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 13 19:42:19.008719 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 13 19:42:19.008719 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 13 19:42:19.008719 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 13 19:42:19.012468 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 13 19:42:19.012468 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 13 19:42:19.012468 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 13 19:42:19.012468 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 13 19:42:19.012468 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 19:42:19.012468 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 19:42:19.012468 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 19:42:19.012468 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 19:42:19.012468 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 19:42:19.012468 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 19:42:19.012468 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 19:42:19.012468 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application with Lock( Sep 13 19:42:19.012468 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 19:42:19.012468 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application return self._enter() Sep 13 19:42:19.012468 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 19:42:19.012468 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 19:42:19.013323 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 19:42:19.013323 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application return self.creator() Sep 13 19:42:19.013323 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 19:42:19.013323 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application created_value = creator( Sep 13 19:42:19.013323 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 13 19:42:19.013323 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 13 19:42:19.013323 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 13 19:42:19.013323 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 13 19:42:19.013323 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 13 19:42:19.013323 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 13 19:42:19.013323 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 13 19:42:19.013323 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application Sep 13 19:42:19.013323 dv-cinder-828806-6-smb devstack@keystone.service[82026]: [pid: 82026|app: 0|req: 374/741] 10.222.0.33 () {56 vars in 1102 bytes} [Tue Sep 13 19:42:18 2022] GET /identity/v3/roles/service => generated 85 bytes in 205 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 19:42:19.013323 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46e12f08-7279-4246-8523-2cf51f284e69 None admin] Authenticating user token {{(pid=82026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:42:19.055362 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d8667fd-7e01-4d82-92e7-200dcf858a8b None admin] Validating token access rules against request {{(pid=82025) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:42:19.092617 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42543a16-b9fd-45d2-91c2-66bc67f93fc0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57539b6a6f3b4d589f5f5e1d211cd6a0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82025) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:42:19.093401 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42543a16-b9fd-45d2-91c2-66bc67f93fc0 None admin] REQUEST_METHOD: `GET` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:42:19.093813 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42543a16-b9fd-45d2-91c2-66bc67f93fc0 None admin] SCRIPT_NAME: `/identity` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:42:19.094289 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42543a16-b9fd-45d2-91c2-66bc67f93fc0 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:42:19.115221 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42543a16-b9fd-45d2-91c2-66bc67f93fc0 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=82025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:42:19.117009 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42543a16-b9fd-45d2-91c2-66bc67f93fc0 None admin] RBAC: Authorization granted {{(pid=82025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:42:19.131678 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46e12f08-7279-4246-8523-2cf51f284e69 None admin] Validating token access rules against request {{(pid=82026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:42:19.133345 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application [None req-42543a16-b9fd-45d2-91c2-66bc67f93fc0 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 13 19:42:19.133345 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 19:42:19.133345 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 19:42:19.133345 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 19:42:19.133345 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 19:42:19.133345 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 19:42:19.133345 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 19:42:19.133345 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 19:42:19.133345 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 19:42:19.133345 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 19:42:19.133345 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 19:42:19.133345 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 19:42:19.133345 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 13 19:42:19.133345 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 13 19:42:19.133345 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 13 19:42:19.133345 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 13 19:42:19.134297 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 19:42:19.134297 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 19:42:19.134297 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 19:42:19.134297 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 19:42:19.134297 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 19:42:19.134297 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 19:42:19.134297 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 19:42:19.134297 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application with Lock( Sep 13 19:42:19.134297 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 19:42:19.134297 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application return self._enter() Sep 13 19:42:19.134297 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 19:42:19.134297 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 19:42:19.134297 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 19:42:19.134297 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application return self.creator() Sep 13 19:42:19.134297 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 19:42:19.134297 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application created_value = creator( Sep 13 19:42:19.134297 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 13 19:42:19.135243 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 13 19:42:19.135243 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 13 19:42:19.135243 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application Sep 13 19:42:19.137287 dv-cinder-828806-6-smb devstack@keystone.service[82025]: [pid: 82025|app: 0|req: 368/742] 10.222.0.33 () {56 vars in 1108 bytes} [Tue Sep 13 19:42:18 2022] GET /identity/v3/domains/Default => generated 87 bytes in 230 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 19:42:19.138393 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42543a16-b9fd-45d2-91c2-66bc67f93fc0 None admin] Authenticating user token {{(pid=82025) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:42:19.174171 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8628a2b5-5ef6-455a-ae5c-658dbdaebafb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57539b6a6f3b4d589f5f5e1d211cd6a0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:42:19.174844 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8628a2b5-5ef6-455a-ae5c-658dbdaebafb None admin] REQUEST_METHOD: `GET` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:42:19.175180 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8628a2b5-5ef6-455a-ae5c-658dbdaebafb None admin] SCRIPT_NAME: `/identity` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:42:19.175464 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8628a2b5-5ef6-455a-ae5c-658dbdaebafb None admin] PATH_INFO: `/v3/domains/Default` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:42:19.186725 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8628a2b5-5ef6-455a-ae5c-658dbdaebafb None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=82026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:42:19.188280 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8628a2b5-5ef6-455a-ae5c-658dbdaebafb None admin] RBAC: Authorization granted {{(pid=82026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:42:19.203782 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application [None req-8628a2b5-5ef6-455a-ae5c-658dbdaebafb None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 13 19:42:19.203782 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 19:42:19.203782 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 19:42:19.203782 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 19:42:19.203782 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 19:42:19.203782 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 19:42:19.203782 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 19:42:19.203782 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 19:42:19.203782 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 19:42:19.203782 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 19:42:19.203782 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 19:42:19.203782 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 19:42:19.203782 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 13 19:42:19.203782 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 13 19:42:19.203782 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 13 19:42:19.203782 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 13 19:42:19.204905 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 19:42:19.204905 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 19:42:19.204905 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 19:42:19.204905 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 19:42:19.204905 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 19:42:19.204905 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 19:42:19.204905 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 19:42:19.204905 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application with Lock( Sep 13 19:42:19.204905 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 19:42:19.204905 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application return self._enter() Sep 13 19:42:19.204905 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 19:42:19.204905 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 19:42:19.204905 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 19:42:19.204905 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application return self.creator() Sep 13 19:42:19.204905 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 19:42:19.204905 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application created_value = creator( Sep 13 19:42:19.204905 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 13 19:42:19.205823 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 13 19:42:19.205823 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 13 19:42:19.205823 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application Sep 13 19:42:19.205823 dv-cinder-828806-6-smb devstack@keystone.service[82026]: [pid: 82026|app: 0|req: 375/743] 10.222.0.33 () {56 vars in 1108 bytes} [Tue Sep 13 19:42:19 2022] GET /identity/v3/domains/Default => generated 87 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 19:42:19.210862 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8628a2b5-5ef6-455a-ae5c-658dbdaebafb None admin] Authenticating user token {{(pid=82026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:42:19.247445 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG dbcounter [-] [82026] Writing DB stats keystone:SELECT=100 {{(pid=82026) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:42:19.256701 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42543a16-b9fd-45d2-91c2-66bc67f93fc0 None admin] Validating token access rules against request {{(pid=82025) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:42:19.259767 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG dbcounter [-] [82025] Writing DB stats keystone:SELECT=100 {{(pid=82025) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:42:19.299199 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-361cd0d3-5215-4b4f-b280-8f3d61854473 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57539b6a6f3b4d589f5f5e1d211cd6a0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82025) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:42:19.299964 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-361cd0d3-5215-4b4f-b280-8f3d61854473 None admin] REQUEST_METHOD: `GET` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:42:19.300352 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-361cd0d3-5215-4b4f-b280-8f3d61854473 None admin] SCRIPT_NAME: `/identity` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:42:19.300744 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-361cd0d3-5215-4b4f-b280-8f3d61854473 None admin] PATH_INFO: `/v3/roles` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:42:19.301580 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-361cd0d3-5215-4b4f-b280-8f3d61854473 None admin] RBAC: Adding query filter params (name=service) {{(pid=82025) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 19:42:19.301994 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-361cd0d3-5215-4b4f-b280-8f3d61854473 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:42:19.303448 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-361cd0d3-5215-4b4f-b280-8f3d61854473 None admin] RBAC: Authorization granted {{(pid=82025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:42:19.313539 dv-cinder-828806-6-smb devstack@keystone.service[82025]: [pid: 82025|app: 0|req: 369/744] 10.222.0.33 () {56 vars in 1103 bytes} [Tue Sep 13 19:42:19 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 19:42:19.314526 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-361cd0d3-5215-4b4f-b280-8f3d61854473 None admin] Authenticating user token {{(pid=82025) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:42:19.320065 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8628a2b5-5ef6-455a-ae5c-658dbdaebafb None admin] Validating token access rules against request {{(pid=82026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:42:19.356153 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec4f1fad-3357-4708-aa7b-30b87e80d868 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57539b6a6f3b4d589f5f5e1d211cd6a0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:42:19.357040 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec4f1fad-3357-4708-aa7b-30b87e80d868 None admin] REQUEST_METHOD: `GET` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:42:19.357497 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec4f1fad-3357-4708-aa7b-30b87e80d868 None admin] SCRIPT_NAME: `/identity` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:42:19.357917 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec4f1fad-3357-4708-aa7b-30b87e80d868 None admin] PATH_INFO: `/v3/domains` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:42:19.358773 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec4f1fad-3357-4708-aa7b-30b87e80d868 None admin] RBAC: Adding query filter params (name=Default) {{(pid=82026) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 19:42:19.359343 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec4f1fad-3357-4708-aa7b-30b87e80d868 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:42:19.361266 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec4f1fad-3357-4708-aa7b-30b87e80d868 None admin] RBAC: Authorization granted {{(pid=82026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:42:19.373633 dv-cinder-828806-6-smb devstack@keystone.service[82026]: [pid: 82026|app: 0|req: 376/745] 10.222.0.33 () {56 vars in 1109 bytes} [Tue Sep 13 19:42:19 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 19:42:19.374806 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec4f1fad-3357-4708-aa7b-30b87e80d868 None admin] Authenticating user token {{(pid=82026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:42:19.424965 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-361cd0d3-5215-4b4f-b280-8f3d61854473 None admin] Validating token access rules against request {{(pid=82025) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:42:19.460822 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20d37c8d-6455-46dd-a645-ba5a4c683870 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57539b6a6f3b4d589f5f5e1d211cd6a0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82025) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:42:19.461414 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20d37c8d-6455-46dd-a645-ba5a4c683870 None admin] REQUEST_METHOD: `GET` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:42:19.461702 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20d37c8d-6455-46dd-a645-ba5a4c683870 None admin] SCRIPT_NAME: `/identity` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:42:19.461982 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20d37c8d-6455-46dd-a645-ba5a4c683870 None admin] PATH_INFO: `/v3/domains` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:42:19.462694 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20d37c8d-6455-46dd-a645-ba5a4c683870 None admin] RBAC: Adding query filter params (name=Default) {{(pid=82025) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 19:42:19.463028 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20d37c8d-6455-46dd-a645-ba5a4c683870 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:42:19.464478 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20d37c8d-6455-46dd-a645-ba5a4c683870 None admin] RBAC: Authorization granted {{(pid=82025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:42:19.481882 dv-cinder-828806-6-smb devstack@keystone.service[82025]: [pid: 82025|app: 0|req: 370/746] 10.222.0.33 () {56 vars in 1109 bytes} [Tue Sep 13 19:42:19 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 19:42:19.482061 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG dbcounter [-] [82026] Writing DB stats keystone:SELECT=100 {{(pid=82026) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:42:19.482145 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20d37c8d-6455-46dd-a645-ba5a4c683870 None admin] Authenticating user token {{(pid=82025) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:42:19.487109 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec4f1fad-3357-4708-aa7b-30b87e80d868 None admin] Validating token access rules against request {{(pid=82026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:42:19.508258 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG dbcounter [-] [82025] Writing DB stats keystone:SELECT=100 {{(pid=82025) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:42:19.523118 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d29c2d0f-a463-4f30-8a04-e85f7956e867 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57539b6a6f3b4d589f5f5e1d211cd6a0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:42:19.523883 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d29c2d0f-a463-4f30-8a04-e85f7956e867 None admin] REQUEST_METHOD: `GET` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:42:19.524311 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d29c2d0f-a463-4f30-8a04-e85f7956e867 None admin] SCRIPT_NAME: `/identity` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:42:19.524687 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d29c2d0f-a463-4f30-8a04-e85f7956e867 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:42:19.536385 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d29c2d0f-a463-4f30-8a04-e85f7956e867 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=82026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:42:19.538094 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d29c2d0f-a463-4f30-8a04-e85f7956e867 None admin] RBAC: Authorization granted {{(pid=82026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:42:19.554078 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application [None req-d29c2d0f-a463-4f30-8a04-e85f7956e867 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 13 19:42:19.554078 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 19:42:19.554078 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 19:42:19.554078 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 19:42:19.554078 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 19:42:19.554078 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 19:42:19.554078 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 19:42:19.554078 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 19:42:19.554078 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 19:42:19.554078 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 19:42:19.554078 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 19:42:19.554078 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 19:42:19.554078 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 13 19:42:19.554078 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 13 19:42:19.554078 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 13 19:42:19.554078 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 13 19:42:19.555292 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 19:42:19.555292 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 19:42:19.555292 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 19:42:19.555292 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 19:42:19.555292 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 19:42:19.555292 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 19:42:19.555292 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 19:42:19.555292 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application with Lock( Sep 13 19:42:19.555292 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 19:42:19.555292 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application return self._enter() Sep 13 19:42:19.555292 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 19:42:19.555292 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 19:42:19.555292 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 19:42:19.555292 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application return self.creator() Sep 13 19:42:19.555292 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 19:42:19.555292 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application created_value = creator( Sep 13 19:42:19.555292 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 13 19:42:19.556394 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 13 19:42:19.556394 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 13 19:42:19.556394 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application Sep 13 19:42:19.557802 dv-cinder-828806-6-smb devstack@keystone.service[82026]: [pid: 82026|app: 0|req: 377/747] 10.222.0.33 () {56 vars in 1108 bytes} [Tue Sep 13 19:42:19 2022] GET /identity/v3/domains/Default => generated 87 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 19:42:19.559411 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d29c2d0f-a463-4f30-8a04-e85f7956e867 None admin] Authenticating user token {{(pid=82026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:42:19.593328 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20d37c8d-6455-46dd-a645-ba5a4c683870 None admin] Validating token access rules against request {{(pid=82025) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:42:19.630993 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36e1df41-3c98-4675-9942-bd8c692e6344 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57539b6a6f3b4d589f5f5e1d211cd6a0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82025) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:42:19.631940 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36e1df41-3c98-4675-9942-bd8c692e6344 None admin] REQUEST_METHOD: `GET` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:42:19.632376 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36e1df41-3c98-4675-9942-bd8c692e6344 None admin] SCRIPT_NAME: `/identity` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:42:19.632801 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36e1df41-3c98-4675-9942-bd8c692e6344 None admin] PATH_INFO: `/v3/projects/service` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:42:19.641494 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36e1df41-3c98-4675-9942-bd8c692e6344 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=82025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:42:19.643568 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36e1df41-3c98-4675-9942-bd8c692e6344 None admin] RBAC: Authorization granted {{(pid=82025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:42:19.655989 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application [None req-36e1df41-3c98-4675-9942-bd8c692e6344 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 13 19:42:19.655989 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 19:42:19.655989 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 19:42:19.655989 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 19:42:19.655989 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 19:42:19.655989 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 19:42:19.655989 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 19:42:19.655989 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 19:42:19.655989 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 19:42:19.655989 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 19:42:19.655989 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 19:42:19.655989 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 19:42:19.655989 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 13 19:42:19.655989 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 13 19:42:19.655989 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 13 19:42:19.658004 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 13 19:42:19.658004 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 19:42:19.658004 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 19:42:19.658004 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 19:42:19.658004 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 19:42:19.658004 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 19:42:19.658004 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 19:42:19.658004 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 19:42:19.658004 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application with Lock( Sep 13 19:42:19.658004 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 19:42:19.658004 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application return self._enter() Sep 13 19:42:19.658004 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 19:42:19.658004 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 19:42:19.658004 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 19:42:19.658004 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application return self.creator() Sep 13 19:42:19.658004 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 19:42:19.658004 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application created_value = creator( Sep 13 19:42:19.659092 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 13 19:42:19.659092 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 13 19:42:19.659092 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 13 19:42:19.659092 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 13 19:42:19.659092 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 13 19:42:19.659092 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 13 19:42:19.659092 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 13 19:42:19.659092 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application Sep 13 19:42:19.661189 dv-cinder-828806-6-smb devstack@keystone.service[82025]: [pid: 82025|app: 0|req: 371/748] 10.222.0.33 () {56 vars in 1111 bytes} [Tue Sep 13 19:42:19 2022] GET /identity/v3/projects/service => generated 88 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 19:42:19.662229 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36e1df41-3c98-4675-9942-bd8c692e6344 None admin] Authenticating user token {{(pid=82025) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:42:19.668524 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d29c2d0f-a463-4f30-8a04-e85f7956e867 None admin] Validating token access rules against request {{(pid=82026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:42:19.705089 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ab89d17-7f0c-4d8d-8e6f-ea74b67e2d6b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57539b6a6f3b4d589f5f5e1d211cd6a0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:42:19.705908 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ab89d17-7f0c-4d8d-8e6f-ea74b67e2d6b None admin] REQUEST_METHOD: `GET` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:42:19.706290 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ab89d17-7f0c-4d8d-8e6f-ea74b67e2d6b None admin] SCRIPT_NAME: `/identity` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:42:19.706664 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ab89d17-7f0c-4d8d-8e6f-ea74b67e2d6b None admin] PATH_INFO: `/v3/users/nova` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:42:19.714826 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ab89d17-7f0c-4d8d-8e6f-ea74b67e2d6b None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=82026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:42:19.716454 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ab89d17-7f0c-4d8d-8e6f-ea74b67e2d6b None admin] RBAC: Authorization granted {{(pid=82026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:42:19.728761 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application [None req-9ab89d17-7f0c-4d8d-8e6f-ea74b67e2d6b None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Sep 13 19:42:19.728761 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 19:42:19.728761 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 19:42:19.728761 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 19:42:19.728761 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 19:42:19.728761 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 19:42:19.728761 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 19:42:19.728761 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 19:42:19.728761 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 19:42:19.728761 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 19:42:19.728761 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 19:42:19.728761 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 19:42:19.728761 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 13 19:42:19.728761 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 13 19:42:19.728761 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 13 19:42:19.728761 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 13 19:42:19.729928 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 19:42:19.729928 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 19:42:19.729928 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 13 19:42:19.729928 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 13 19:42:19.729928 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 13 19:42:19.729928 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 13 19:42:19.729928 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 19:42:19.729928 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 19:42:19.729928 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 19:42:19.729928 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 19:42:19.729928 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 19:42:19.729928 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application with Lock( Sep 13 19:42:19.729928 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 19:42:19.729928 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application return self._enter() Sep 13 19:42:19.729928 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 19:42:19.729928 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 19:42:19.729928 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 19:42:19.729928 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application return self.creator() Sep 13 19:42:19.731120 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 19:42:19.731120 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application created_value = creator( Sep 13 19:42:19.731120 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 13 19:42:19.731120 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 13 19:42:19.731120 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 13 19:42:19.731120 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 13 19:42:19.731120 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 13 19:42:19.731120 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 13 19:42:19.731120 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Sep 13 19:42:19.731120 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application Sep 13 19:42:19.734056 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG dbcounter [-] [82026] Writing DB stats keystone:SELECT=100 {{(pid=82026) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:42:19.737487 dv-cinder-828806-6-smb devstack@keystone.service[82026]: [pid: 82026|app: 0|req: 378/749] 10.222.0.33 () {56 vars in 1093 bytes} [Tue Sep 13 19:42:19 2022] GET /identity/v3/users/nova => generated 82 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 19:42:19.738466 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ab89d17-7f0c-4d8d-8e6f-ea74b67e2d6b None admin] Authenticating user token {{(pid=82026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:42:19.764669 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG dbcounter [-] [82025] Writing DB stats keystone:SELECT=100 {{(pid=82025) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:42:19.782204 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36e1df41-3c98-4675-9942-bd8c692e6344 None admin] Validating token access rules against request {{(pid=82025) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:42:19.818592 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3157f4cf-ab93-4914-9e33-a25a4c79c166 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57539b6a6f3b4d589f5f5e1d211cd6a0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82025) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:42:19.819518 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3157f4cf-ab93-4914-9e33-a25a4c79c166 None admin] REQUEST_METHOD: `GET` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:42:19.819951 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3157f4cf-ab93-4914-9e33-a25a4c79c166 None admin] SCRIPT_NAME: `/identity` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:42:19.820372 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3157f4cf-ab93-4914-9e33-a25a4c79c166 None admin] PATH_INFO: `/v3/domains` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:42:19.821166 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3157f4cf-ab93-4914-9e33-a25a4c79c166 None admin] RBAC: Adding query filter params (name=Default) {{(pid=82025) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 19:42:19.821686 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3157f4cf-ab93-4914-9e33-a25a4c79c166 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:42:19.823313 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3157f4cf-ab93-4914-9e33-a25a4c79c166 None admin] RBAC: Authorization granted {{(pid=82025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:42:19.837785 dv-cinder-828806-6-smb devstack@keystone.service[82025]: [pid: 82025|app: 0|req: 372/750] 10.222.0.33 () {56 vars in 1109 bytes} [Tue Sep 13 19:42:19 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 19:42:19.838942 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3157f4cf-ab93-4914-9e33-a25a4c79c166 None admin] Authenticating user token {{(pid=82025) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:42:19.846840 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ab89d17-7f0c-4d8d-8e6f-ea74b67e2d6b None admin] Validating token access rules against request {{(pid=82026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:42:19.892908 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aced8bad-ced6-4387-9ba7-0ce45130f6b3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57539b6a6f3b4d589f5f5e1d211cd6a0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:42:19.893491 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aced8bad-ced6-4387-9ba7-0ce45130f6b3 None admin] REQUEST_METHOD: `GET` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:42:19.893887 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aced8bad-ced6-4387-9ba7-0ce45130f6b3 None admin] SCRIPT_NAME: `/identity` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:42:19.894301 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aced8bad-ced6-4387-9ba7-0ce45130f6b3 None admin] PATH_INFO: `/v3/projects` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:42:19.895263 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aced8bad-ced6-4387-9ba7-0ce45130f6b3 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=82026) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 19:42:19.895876 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aced8bad-ced6-4387-9ba7-0ce45130f6b3 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=82026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:42:19.898688 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aced8bad-ced6-4387-9ba7-0ce45130f6b3 None admin] RBAC: Authorization granted {{(pid=82026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:42:19.913238 dv-cinder-828806-6-smb devstack@keystone.service[82026]: [pid: 82026|app: 0|req: 379/751] 10.222.0.33 () {56 vars in 1148 bytes} [Tue Sep 13 19:42:19 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 19:42:19.914329 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aced8bad-ced6-4387-9ba7-0ce45130f6b3 None admin] Authenticating user token {{(pid=82026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:42:19.955509 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3157f4cf-ab93-4914-9e33-a25a4c79c166 None admin] Validating token access rules against request {{(pid=82025) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:42:19.980149 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG dbcounter [-] [82026] Writing DB stats keystone:SELECT=100 {{(pid=82026) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:42:19.992428 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a069231-1c32-4218-b3e7-f8d54ca567fa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57539b6a6f3b4d589f5f5e1d211cd6a0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82025) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:42:19.993146 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a069231-1c32-4218-b3e7-f8d54ca567fa None admin] REQUEST_METHOD: `GET` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:42:19.993489 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a069231-1c32-4218-b3e7-f8d54ca567fa None admin] SCRIPT_NAME: `/identity` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:42:19.993838 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a069231-1c32-4218-b3e7-f8d54ca567fa None admin] PATH_INFO: `/v3/users` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:42:19.994564 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a069231-1c32-4218-b3e7-f8d54ca567fa None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=82025) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 19:42:19.994895 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a069231-1c32-4218-b3e7-f8d54ca567fa None admin] RBAC: Authorizing `identity:list_users()` {{(pid=82025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:42:19.996393 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a069231-1c32-4218-b3e7-f8d54ca567fa None admin] RBAC: Authorization granted {{(pid=82025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:42:20.020783 dv-cinder-828806-6-smb devstack@keystone.service[82025]: [pid: 82025|app: 0|req: 373/752] 10.222.0.33 () {56 vars in 1133 bytes} [Tue Sep 13 19:42:19 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 19:42:20.021839 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a069231-1c32-4218-b3e7-f8d54ca567fa None admin] Authenticating user token {{(pid=82025) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:42:20.025855 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG dbcounter [-] [82025] Writing DB stats keystone:SELECT=100 {{(pid=82025) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:42:20.032127 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aced8bad-ced6-4387-9ba7-0ce45130f6b3 None admin] Validating token access rules against request {{(pid=82026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:42:20.073969 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b981efa-cef4-43cc-a702-e8ab841a4462 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57539b6a6f3b4d589f5f5e1d211cd6a0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:42:20.074972 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b981efa-cef4-43cc-a702-e8ab841a4462 None admin] REQUEST_METHOD: `GET` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:42:20.075633 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b981efa-cef4-43cc-a702-e8ab841a4462 None admin] SCRIPT_NAME: `/identity` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:42:20.076119 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b981efa-cef4-43cc-a702-e8ab841a4462 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:42:20.084907 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b981efa-cef4-43cc-a702-e8ab841a4462 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=82026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:42:20.086712 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b981efa-cef4-43cc-a702-e8ab841a4462 None admin] RBAC: Authorization granted {{(pid=82026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:42:20.101694 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application [None req-6b981efa-cef4-43cc-a702-e8ab841a4462 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Sep 13 19:42:20.101694 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 19:42:20.101694 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 19:42:20.101694 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 19:42:20.101694 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 19:42:20.101694 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 19:42:20.101694 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 19:42:20.101694 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 19:42:20.101694 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 19:42:20.101694 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 19:42:20.101694 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 19:42:20.101694 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 19:42:20.101694 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 13 19:42:20.101694 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 13 19:42:20.101694 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 13 19:42:20.101694 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 13 19:42:20.102671 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 19:42:20.102671 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 19:42:20.102671 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 13 19:42:20.102671 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 13 19:42:20.102671 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 13 19:42:20.102671 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 13 19:42:20.102671 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 19:42:20.102671 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 19:42:20.102671 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 19:42:20.102671 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 19:42:20.102671 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 19:42:20.102671 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application with Lock( Sep 13 19:42:20.102671 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 19:42:20.102671 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application return self._enter() Sep 13 19:42:20.102671 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 19:42:20.102671 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 19:42:20.102671 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 19:42:20.102671 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application return self.creator() Sep 13 19:42:20.104520 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 19:42:20.104520 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application created_value = creator( Sep 13 19:42:20.104520 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 13 19:42:20.104520 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 13 19:42:20.104520 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 13 19:42:20.104520 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 13 19:42:20.104520 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 13 19:42:20.104520 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 13 19:42:20.104520 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Sep 13 19:42:20.104520 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application Sep 13 19:42:20.106993 dv-cinder-828806-6-smb devstack@keystone.service[82026]: [pid: 82026|app: 0|req: 380/753] 10.222.0.33 () {56 vars in 1117 bytes} [Tue Sep 13 19:42:19 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 19:42:20.108070 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b981efa-cef4-43cc-a702-e8ab841a4462 None admin] Authenticating user token {{(pid=82026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:42:20.134960 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a069231-1c32-4218-b3e7-f8d54ca567fa None admin] Validating token access rules against request {{(pid=82025) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:42:20.170827 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c757da2d-31a7-4978-96b3-120fa26ac989 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57539b6a6f3b4d589f5f5e1d211cd6a0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82025) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:42:20.171418 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c757da2d-31a7-4978-96b3-120fa26ac989 None admin] REQUEST_METHOD: `GET` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:42:20.171701 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c757da2d-31a7-4978-96b3-120fa26ac989 None admin] SCRIPT_NAME: `/identity` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:42:20.172593 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c757da2d-31a7-4978-96b3-120fa26ac989 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:42:20.173328 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c757da2d-31a7-4978-96b3-120fa26ac989 None admin] RBAC: Adding query filter params (role.id=e5af7d5baa93469e9e486ef21c85474e, scope.project.id=c8c6fba0f15b4d6a84ff601919b7b8e4, user.id=fa5a83574f7f424c805e130c462d5969) {{(pid=82025) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 19:42:20.173625 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c757da2d-31a7-4978-96b3-120fa26ac989 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=82025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:42:20.175076 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c757da2d-31a7-4978-96b3-120fa26ac989 None admin] RBAC: Authorization granted {{(pid=82025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:42:20.181054 dv-cinder-828806-6-smb devstack@keystone.service[82025]: [pid: 82025|app: 0|req: 374/754] 10.222.0.33 () {56 vars in 1374 bytes} [Tue Sep 13 19:42:20 2022] GET /identity/v3/role_assignments?user.id=fa5a83574f7f424c805e130c462d5969&scope.project.id=c8c6fba0f15b4d6a84ff601919b7b8e4&role.id=e5af7d5baa93469e9e486ef21c85474e => generated 259 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 19:42:20.181868 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c757da2d-31a7-4978-96b3-120fa26ac989 None admin] Authenticating user token {{(pid=82025) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:42:20.228129 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b981efa-cef4-43cc-a702-e8ab841a4462 None admin] Validating token access rules against request {{(pid=82026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:42:20.253717 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG dbcounter [-] [82026] Writing DB stats keystone:SELECT=100 {{(pid=82026) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:42:20.271958 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3852721-e3a5-4028-ae82-27a87628338c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57539b6a6f3b4d589f5f5e1d211cd6a0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:42:20.272606 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3852721-e3a5-4028-ae82-27a87628338c None admin] REQUEST_METHOD: `GET` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:42:20.272889 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3852721-e3a5-4028-ae82-27a87628338c None admin] SCRIPT_NAME: `/identity` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:42:20.273166 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3852721-e3a5-4028-ae82-27a87628338c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:42:20.292212 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG dbcounter [-] [82025] Writing DB stats keystone:SELECT=100 {{(pid=82025) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:42:20.298663 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3852721-e3a5-4028-ae82-27a87628338c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=82026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:42:20.300542 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3852721-e3a5-4028-ae82-27a87628338c None admin] RBAC: Authorization granted {{(pid=82026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:42:20.320476 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application [None req-c3852721-e3a5-4028-ae82-27a87628338c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 13 19:42:20.320476 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 19:42:20.320476 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 19:42:20.320476 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 19:42:20.320476 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 19:42:20.320476 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 19:42:20.320476 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 19:42:20.320476 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 19:42:20.320476 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 19:42:20.320476 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 19:42:20.320476 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 19:42:20.320476 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 19:42:20.320476 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 13 19:42:20.320476 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 13 19:42:20.320476 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 13 19:42:20.320476 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 13 19:42:20.321717 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 19:42:20.321717 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 19:42:20.321717 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 19:42:20.321717 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 19:42:20.321717 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 19:42:20.321717 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 19:42:20.321717 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 19:42:20.321717 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application with Lock( Sep 13 19:42:20.321717 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 19:42:20.321717 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application return self._enter() Sep 13 19:42:20.321717 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 19:42:20.321717 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 19:42:20.321717 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 19:42:20.321717 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application return self.creator() Sep 13 19:42:20.321717 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 19:42:20.321717 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application created_value = creator( Sep 13 19:42:20.321717 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 13 19:42:20.322815 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 13 19:42:20.322815 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 13 19:42:20.322815 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application Sep 13 19:42:20.324981 dv-cinder-828806-6-smb devstack@keystone.service[82026]: [pid: 82026|app: 0|req: 381/755] 10.222.0.33 () {56 vars in 1108 bytes} [Tue Sep 13 19:42:20 2022] GET /identity/v3/domains/Default => generated 87 bytes in 217 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 19:42:20.326832 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4986a06e-a61d-47cf-aa92-745a86e5ee64 None None] REQUEST_METHOD: `GET` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:42:20.327992 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4986a06e-a61d-47cf-aa92-745a86e5ee64 None None] SCRIPT_NAME: `/identity` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:42:20.329043 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4986a06e-a61d-47cf-aa92-745a86e5ee64 None None] PATH_INFO: `/` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:42:20.332304 dv-cinder-828806-6-smb devstack@keystone.service[82026]: [pid: 82026|app: 0|req: 382/756] 10.222.0.33 () {54 vars in 927 bytes} [Tue Sep 13 19:42:20 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 19:42:20.333549 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4986a06e-a61d-47cf-aa92-745a86e5ee64 None None] Authenticating user token {{(pid=82026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:42:20.340802 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c757da2d-31a7-4978-96b3-120fa26ac989 None admin] Validating token access rules against request {{(pid=82025) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:42:20.385858 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e91a9c7-feac-4baa-b0af-34e82f976f91 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57539b6a6f3b4d589f5f5e1d211cd6a0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82025) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:42:20.386551 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e91a9c7-feac-4baa-b0af-34e82f976f91 None admin] REQUEST_METHOD: `GET` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:42:20.386937 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e91a9c7-feac-4baa-b0af-34e82f976f91 None admin] SCRIPT_NAME: `/identity` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:42:20.387345 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e91a9c7-feac-4baa-b0af-34e82f976f91 None admin] PATH_INFO: `/v3/users` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:42:20.388855 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e91a9c7-feac-4baa-b0af-34e82f976f91 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=82025) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 19:42:20.388988 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e91a9c7-feac-4baa-b0af-34e82f976f91 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=82025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:42:20.393663 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e91a9c7-feac-4baa-b0af-34e82f976f91 None admin] RBAC: Authorization granted {{(pid=82025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:42:20.414611 dv-cinder-828806-6-smb devstack@keystone.service[82025]: [pid: 82025|app: 0|req: 375/757] 10.222.0.33 () {56 vars in 1149 bytes} [Tue Sep 13 19:42:20 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 233 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 19:42:20.416092 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92c71982-0ff8-4749-9c6d-51f22039a45d None None] REQUEST_METHOD: `POST` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:42:20.416570 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92c71982-0ff8-4749-9c6d-51f22039a45d None None] SCRIPT_NAME: `/identity` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:42:20.416948 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92c71982-0ff8-4749-9c6d-51f22039a45d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:42:20.440960 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.auth.core [None req-92c71982-0ff8-4749-9c6d-51f22039a45d None None] MFA Rules not processed for user `57539b6a6f3b4d589f5f5e1d211cd6a0`. Rule list: `[]` (Enabled: `True`). {{(pid=82025) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 19:42:20.442448 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.fernet_utils [None req-92c71982-0ff8-4749-9c6d-51f22039a45d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82025) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 19:42:20.464601 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4986a06e-a61d-47cf-aa92-745a86e5ee64 None None] Validating token access rules against request {{(pid=82026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:42:20.502350 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c3fd8b2-21a9-4d6c-9087-9e58bad72912 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57539b6a6f3b4d589f5f5e1d211cd6a0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:42:20.503227 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c3fd8b2-21a9-4d6c-9087-9e58bad72912 None admin] REQUEST_METHOD: `GET` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:42:20.503612 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c3fd8b2-21a9-4d6c-9087-9e58bad72912 None admin] SCRIPT_NAME: `/identity` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:42:20.504130 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c3fd8b2-21a9-4d6c-9087-9e58bad72912 None admin] PATH_INFO: `/v3/domains` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:42:20.504965 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c3fd8b2-21a9-4d6c-9087-9e58bad72912 None admin] RBAC: Adding query filter params (name=Default) {{(pid=82026) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 19:42:20.505383 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c3fd8b2-21a9-4d6c-9087-9e58bad72912 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:42:20.506964 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c3fd8b2-21a9-4d6c-9087-9e58bad72912 None admin] RBAC: Authorization granted {{(pid=82026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:42:20.521098 dv-cinder-828806-6-smb devstack@keystone.service[82026]: [pid: 82026|app: 0|req: 383/758] 10.222.0.33 () {56 vars in 1109 bytes} [Tue Sep 13 19:42:20 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 19:42:20.522094 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c3fd8b2-21a9-4d6c-9087-9e58bad72912 None admin] Authenticating user token {{(pid=82026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:42:20.529263 dv-cinder-828806-6-smb devstack@keystone.service[82025]: [pid: 82025|app: 0|req: 376/759] 10.222.0.33 () {58 vars in 1024 bytes} [Tue Sep 13 19:42:20 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 13 19:42:20.530207 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92c71982-0ff8-4749-9c6d-51f22039a45d None None] Authenticating user token {{(pid=82025) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:42:20.578182 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG dbcounter [-] [82026] Writing DB stats keystone:SELECT=100 {{(pid=82026) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:42:20.643515 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG dbcounter [-] [82025] Writing DB stats keystone:SELECT=100 {{(pid=82025) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:42:20.710962 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c3fd8b2-21a9-4d6c-9087-9e58bad72912 None admin] Validating token access rules against request {{(pid=82026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:42:20.711198 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92c71982-0ff8-4749-9c6d-51f22039a45d None None] Validating token access rules against request {{(pid=82025) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:42:20.777758 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b66bf32-d789-45a8-be24-a195b0aacc80 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57539b6a6f3b4d589f5f5e1d211cd6a0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:42:20.778950 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b66bf32-d789-45a8-be24-a195b0aacc80 None admin] REQUEST_METHOD: `GET` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:42:20.779635 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b66bf32-d789-45a8-be24-a195b0aacc80 None admin] SCRIPT_NAME: `/identity` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:42:20.780499 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b66bf32-d789-45a8-be24-a195b0aacc80 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:42:20.781277 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c50fa89b-cf59-499d-9dd5-0cbc263852bf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57539b6a6f3b4d589f5f5e1d211cd6a0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82025) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:42:20.783593 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c50fa89b-cf59-499d-9dd5-0cbc263852bf None admin] REQUEST_METHOD: `GET` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:42:20.784287 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c50fa89b-cf59-499d-9dd5-0cbc263852bf None admin] SCRIPT_NAME: `/identity` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:42:20.785406 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c50fa89b-cf59-499d-9dd5-0cbc263852bf None admin] PATH_INFO: `/v3/projects/service` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:42:20.796220 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c50fa89b-cf59-499d-9dd5-0cbc263852bf None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=82025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:42:20.797913 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c50fa89b-cf59-499d-9dd5-0cbc263852bf None admin] RBAC: Authorization granted {{(pid=82025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:42:20.811132 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application [None req-c50fa89b-cf59-499d-9dd5-0cbc263852bf None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 13 19:42:20.811132 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 19:42:20.811132 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 19:42:20.811132 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 19:42:20.811132 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 19:42:20.811132 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 19:42:20.811132 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 19:42:20.811132 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 19:42:20.811132 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 19:42:20.811132 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 19:42:20.811132 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 19:42:20.811132 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 19:42:20.811132 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 13 19:42:20.811132 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 13 19:42:20.811132 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 13 19:42:20.812231 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 13 19:42:20.812231 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 19:42:20.812231 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 19:42:20.812231 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 19:42:20.812231 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 19:42:20.812231 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 19:42:20.812231 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 19:42:20.812231 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 19:42:20.812231 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application with Lock( Sep 13 19:42:20.812231 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 19:42:20.812231 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application return self._enter() Sep 13 19:42:20.812231 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 19:42:20.812231 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 19:42:20.812231 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 19:42:20.812231 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application return self.creator() Sep 13 19:42:20.812231 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 19:42:20.812231 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application created_value = creator( Sep 13 19:42:20.813866 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 13 19:42:20.813866 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 13 19:42:20.813866 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 13 19:42:20.813866 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 13 19:42:20.813866 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 13 19:42:20.813866 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 13 19:42:20.813866 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 13 19:42:20.813866 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application Sep 13 19:42:20.819175 dv-cinder-828806-6-smb devstack@keystone.service[82025]: [pid: 82025|app: 0|req: 377/760] 10.222.0.33 () {56 vars in 1111 bytes} [Tue Sep 13 19:42:20 2022] GET /identity/v3/projects/service => generated 88 bytes in 285 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 19:42:20.820132 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c50fa89b-cf59-499d-9dd5-0cbc263852bf None admin] Authenticating user token {{(pid=82025) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:42:20.870862 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b66bf32-d789-45a8-be24-a195b0aacc80 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=82026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:42:20.872767 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b66bf32-d789-45a8-be24-a195b0aacc80 None admin] RBAC: Authorization granted {{(pid=82026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:42:20.920011 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG dbcounter [-] [82026] Writing DB stats keystone:SELECT=100 {{(pid=82026) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:42:20.939004 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c50fa89b-cf59-499d-9dd5-0cbc263852bf None admin] Validating token access rules against request {{(pid=82025) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:42:20.961972 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG dbcounter [-] [82025] Writing DB stats keystone:SELECT=100 {{(pid=82025) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:42:20.982821 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57c9e4fb-74f1-4d55-9a28-bdc11ff8889c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57539b6a6f3b4d589f5f5e1d211cd6a0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82025) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:42:20.983612 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57c9e4fb-74f1-4d55-9a28-bdc11ff8889c None admin] REQUEST_METHOD: `GET` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:42:20.983977 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57c9e4fb-74f1-4d55-9a28-bdc11ff8889c None admin] SCRIPT_NAME: `/identity` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:42:20.984330 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57c9e4fb-74f1-4d55-9a28-bdc11ff8889c None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:42:20.985725 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57c9e4fb-74f1-4d55-9a28-bdc11ff8889c None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=82025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:42:20.987244 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57c9e4fb-74f1-4d55-9a28-bdc11ff8889c None admin] RBAC: Authorization granted {{(pid=82025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:42:21.001296 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application [None req-57c9e4fb-74f1-4d55-9a28-bdc11ff8889c None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Sep 13 19:42:21.001296 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 19:42:21.001296 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 13 19:42:21.001296 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 13 19:42:21.001296 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 13 19:42:21.001296 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 13 19:42:21.001296 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 13 19:42:21.001296 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 13 19:42:21.001296 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Sep 13 19:42:21.001296 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application Sep 13 19:42:21.001296 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 13 19:42:21.001296 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application Sep 13 19:42:21.001296 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 19:42:21.001296 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 19:42:21.001296 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 19:42:21.001296 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 19:42:21.001296 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 19:42:21.002723 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 19:42:21.002723 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 19:42:21.002723 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 19:42:21.002723 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 19:42:21.002723 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 19:42:21.002723 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 19:42:21.002723 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 13 19:42:21.002723 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 13 19:42:21.002723 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 13 19:42:21.002723 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 13 19:42:21.002723 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 19:42:21.002723 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 19:42:21.002723 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 19:42:21.002723 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 19:42:21.002723 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 19:42:21.002723 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 19:42:21.003830 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 19:42:21.003830 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application with Lock( Sep 13 19:42:21.003830 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 19:42:21.003830 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application return self._enter() Sep 13 19:42:21.003830 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 19:42:21.003830 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 19:42:21.003830 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 19:42:21.003830 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application return self.creator() Sep 13 19:42:21.003830 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 19:42:21.003830 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application created_value = creator( Sep 13 19:42:21.003830 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 13 19:42:21.003830 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 13 19:42:21.003830 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Sep 13 19:42:21.003830 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application Sep 13 19:42:21.009748 dv-cinder-828806-6-smb devstack@keystone.service[82025]: [pid: 82025|app: 0|req: 378/761] 10.222.0.33 () {56 vars in 1129 bytes} [Tue Sep 13 19:42:20 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 19:42:21.009748 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57c9e4fb-74f1-4d55-9a28-bdc11ff8889c None admin] Authenticating user token {{(pid=82025) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:42:21.127765 dv-cinder-828806-6-smb devstack@keystone.service[82026]: [pid: 82026|app: 0|req: 384/762] 10.222.0.33 () {58 vars in 1282 bytes} [Tue Sep 13 19:42:20 2022] GET /identity/v3/auth/tokens => generated 1002 bytes in 606 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Sep 13 19:42:21.128904 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b66bf32-d789-45a8-be24-a195b0aacc80 None admin] Authenticating user token {{(pid=82026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:42:21.130643 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57c9e4fb-74f1-4d55-9a28-bdc11ff8889c None admin] Validating token access rules against request {{(pid=82025) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:42:21.178470 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58a56d89-967e-4359-97a7-d9f263ba424b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57539b6a6f3b4d589f5f5e1d211cd6a0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82025) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:42:21.179518 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58a56d89-967e-4359-97a7-d9f263ba424b None admin] REQUEST_METHOD: `GET` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:42:21.179978 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58a56d89-967e-4359-97a7-d9f263ba424b None admin] SCRIPT_NAME: `/identity` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:42:21.180476 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58a56d89-967e-4359-97a7-d9f263ba424b None admin] PATH_INFO: `/v3/projects` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:42:21.181392 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58a56d89-967e-4359-97a7-d9f263ba424b None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=82025) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 19:42:21.181887 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58a56d89-967e-4359-97a7-d9f263ba424b None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=82025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:42:21.183753 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58a56d89-967e-4359-97a7-d9f263ba424b None admin] RBAC: Authorization granted {{(pid=82025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:42:21.199725 dv-cinder-828806-6-smb devstack@keystone.service[82025]: [pid: 82025|app: 0|req: 379/763] 10.222.0.33 () {56 vars in 1148 bytes} [Tue Sep 13 19:42:21 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 19:42:21.200862 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58a56d89-967e-4359-97a7-d9f263ba424b None admin] Authenticating user token {{(pid=82025) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:42:21.252050 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG dbcounter [-] [82025] Writing DB stats keystone:SELECT=100 {{(pid=82025) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:42:21.272985 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b66bf32-d789-45a8-be24-a195b0aacc80 None admin] Validating token access rules against request {{(pid=82026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:42:21.305130 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG dbcounter [-] [82026] Writing DB stats keystone:SELECT=100 {{(pid=82026) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:42:21.310065 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff43cad0-c5a3-4781-8ba2-bf77cc2c9370 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57539b6a6f3b4d589f5f5e1d211cd6a0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:42:21.310672 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff43cad0-c5a3-4781-8ba2-bf77cc2c9370 None admin] REQUEST_METHOD: `GET` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:42:21.310958 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff43cad0-c5a3-4781-8ba2-bf77cc2c9370 None admin] SCRIPT_NAME: `/identity` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:42:21.311271 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff43cad0-c5a3-4781-8ba2-bf77cc2c9370 None admin] PATH_INFO: `/v3/services` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:42:21.311901 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff43cad0-c5a3-4781-8ba2-bf77cc2c9370 None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=82026) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 19:42:21.312200 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff43cad0-c5a3-4781-8ba2-bf77cc2c9370 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=82026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:42:21.314032 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff43cad0-c5a3-4781-8ba2-bf77cc2c9370 None admin] RBAC: Authorization granted {{(pid=82026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:42:21.319163 dv-cinder-828806-6-smb devstack@keystone.service[82026]: [pid: 82026|app: 0|req: 385/764] 10.222.0.33 () {56 vars in 1124 bytes} [Tue Sep 13 19:42:21 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 19:42:21.320089 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff43cad0-c5a3-4781-8ba2-bf77cc2c9370 None admin] Authenticating user token {{(pid=82026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:42:21.334200 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58a56d89-967e-4359-97a7-d9f263ba424b None admin] Validating token access rules against request {{(pid=82025) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:42:21.373546 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d27358a8-f39c-427c-b73b-01fc6c75db07 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57539b6a6f3b4d589f5f5e1d211cd6a0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82025) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:42:21.374175 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d27358a8-f39c-427c-b73b-01fc6c75db07 None admin] REQUEST_METHOD: `GET` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:42:21.374460 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d27358a8-f39c-427c-b73b-01fc6c75db07 None admin] SCRIPT_NAME: `/identity` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:42:21.374731 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d27358a8-f39c-427c-b73b-01fc6c75db07 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:42:21.384692 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d27358a8-f39c-427c-b73b-01fc6c75db07 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=82025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:42:21.386145 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d27358a8-f39c-427c-b73b-01fc6c75db07 None admin] RBAC: Authorization granted {{(pid=82025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:42:21.402683 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application [None req-d27358a8-f39c-427c-b73b-01fc6c75db07 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 13 19:42:21.402683 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 19:42:21.402683 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 19:42:21.402683 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 19:42:21.402683 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 19:42:21.402683 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 19:42:21.402683 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 19:42:21.402683 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 19:42:21.402683 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 19:42:21.402683 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 19:42:21.402683 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 19:42:21.402683 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 19:42:21.402683 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 13 19:42:21.402683 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 13 19:42:21.402683 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 13 19:42:21.402683 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 13 19:42:21.403715 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 19:42:21.403715 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 19:42:21.403715 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 19:42:21.403715 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 19:42:21.403715 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 19:42:21.403715 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 19:42:21.403715 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 19:42:21.403715 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application with Lock( Sep 13 19:42:21.403715 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 19:42:21.403715 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application return self._enter() Sep 13 19:42:21.403715 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 19:42:21.403715 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 19:42:21.403715 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 19:42:21.403715 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application return self.creator() Sep 13 19:42:21.403715 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 19:42:21.403715 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application created_value = creator( Sep 13 19:42:21.403715 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 13 19:42:21.410696 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 13 19:42:21.410696 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 13 19:42:21.410696 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application Sep 13 19:42:21.410696 dv-cinder-828806-6-smb devstack@keystone.service[82025]: [pid: 82025|app: 0|req: 380/765] 10.222.0.33 () {56 vars in 1108 bytes} [Tue Sep 13 19:42:21 2022] GET /identity/v3/domains/Default => generated 87 bytes in 204 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 19:42:21.410696 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c38699f-2329-43ac-902e-ff83b20a9406 None None] REQUEST_METHOD: `GET` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:42:21.410696 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c38699f-2329-43ac-902e-ff83b20a9406 None None] SCRIPT_NAME: `/identity` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:42:21.410696 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c38699f-2329-43ac-902e-ff83b20a9406 None None] PATH_INFO: `/` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:42:21.410696 dv-cinder-828806-6-smb devstack@keystone.service[82025]: [pid: 82025|app: 0|req: 381/766] 10.222.0.33 () {54 vars in 927 bytes} [Tue Sep 13 19:42:21 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 19:42:21.412778 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c38699f-2329-43ac-902e-ff83b20a9406 None None] Authenticating user token {{(pid=82025) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:42:21.428998 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff43cad0-c5a3-4781-8ba2-bf77cc2c9370 None admin] Validating token access rules against request {{(pid=82026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:42:21.464935 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6bbfd77-d709-441f-a529-c01cc10a079c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57539b6a6f3b4d589f5f5e1d211cd6a0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:42:21.465910 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6bbfd77-d709-441f-a529-c01cc10a079c None admin] REQUEST_METHOD: `PUT` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:42:21.465910 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6bbfd77-d709-441f-a529-c01cc10a079c None admin] SCRIPT_NAME: `/identity` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:42:21.466164 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6bbfd77-d709-441f-a529-c01cc10a079c None admin] PATH_INFO: `/v3/projects/c8c6fba0f15b4d6a84ff601919b7b8e4/users/e66e7034abed4e0bad1f4137520c1e70/roles/e5af7d5baa93469e9e486ef21c85474e` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:42:21.468095 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6bbfd77-d709-441f-a529-c01cc10a079c None admin] RBAC: Authorizing `identity:create_grant(project_id=c8c6fba0f15b4d6a84ff601919b7b8e4, user_id=e66e7034abed4e0bad1f4137520c1e70, role_id=e5af7d5baa93469e9e486ef21c85474e)` {{(pid=82026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:42:21.470153 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6bbfd77-d709-441f-a529-c01cc10a079c None admin] RBAC: Authorization granted {{(pid=82026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:42:21.512490 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG dbcounter [-] [82025] Writing DB stats keystone:SELECT=100 {{(pid=82025) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:42:21.522988 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c38699f-2329-43ac-902e-ff83b20a9406 None None] Validating token access rules against request {{(pid=82025) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:42:21.559987 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e561d13-cffa-451b-99a3-01dc5fe5a72e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57539b6a6f3b4d589f5f5e1d211cd6a0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82025) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:42:21.560595 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e561d13-cffa-451b-99a3-01dc5fe5a72e None admin] REQUEST_METHOD: `GET` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:42:21.560876 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e561d13-cffa-451b-99a3-01dc5fe5a72e None admin] SCRIPT_NAME: `/identity` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:42:21.561150 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e561d13-cffa-451b-99a3-01dc5fe5a72e None admin] PATH_INFO: `/v3/services` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:42:21.561966 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e561d13-cffa-451b-99a3-01dc5fe5a72e None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=82025) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 19:42:21.562273 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e561d13-cffa-451b-99a3-01dc5fe5a72e None admin] RBAC: Authorizing `identity:list_services()` {{(pid=82025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:42:21.564436 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e561d13-cffa-451b-99a3-01dc5fe5a72e None admin] RBAC: Authorization granted {{(pid=82025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:42:21.574871 dv-cinder-828806-6-smb devstack@keystone.service[82025]: [pid: 82025|app: 0|req: 382/767] 10.222.0.33 () {56 vars in 1124 bytes} [Tue Sep 13 19:42:21 2022] GET /identity/v3/services?type=block-storage => generated 367 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 19:42:21.574871 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e561d13-cffa-451b-99a3-01dc5fe5a72e None admin] Authenticating user token {{(pid=82025) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:42:21.582672 dv-cinder-828806-6-smb devstack@keystone.service[82026]: [pid: 82026|app: 0|req: 386/768] 10.222.0.33 () {58 vars in 1439 bytes} [Tue Sep 13 19:42:21 2022] PUT /identity/v3/projects/c8c6fba0f15b4d6a84ff601919b7b8e4/users/e66e7034abed4e0bad1f4137520c1e70/roles/e5af7d5baa93469e9e486ef21c85474e => generated 0 bytes in 251 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 19:42:21.584422 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc2a7790-0fe7-417b-aeed-c8204bc4f99b None None] REQUEST_METHOD: `POST` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:42:21.584713 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc2a7790-0fe7-417b-aeed-c8204bc4f99b None None] SCRIPT_NAME: `/identity` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:42:21.584993 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc2a7790-0fe7-417b-aeed-c8204bc4f99b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:42:21.619905 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.auth.core [None req-fc2a7790-0fe7-417b-aeed-c8204bc4f99b None None] MFA Rules not processed for user `57539b6a6f3b4d589f5f5e1d211cd6a0`. Rule list: `[]` (Enabled: `True`). {{(pid=82026) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 19:42:21.622623 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.common.fernet_utils [None req-fc2a7790-0fe7-417b-aeed-c8204bc4f99b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82026) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 19:42:21.698948 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG dbcounter [-] [82026] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82026) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:42:21.705978 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e561d13-cffa-451b-99a3-01dc5fe5a72e None admin] Validating token access rules against request {{(pid=82025) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:42:21.731241 dv-cinder-828806-6-smb devstack@keystone.service[82026]: [pid: 82026|app: 0|req: 387/769] 10.222.0.33 () {58 vars in 1024 bytes} [Tue Sep 13 19:42:21 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 144 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 13 19:42:21.731241 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc2a7790-0fe7-417b-aeed-c8204bc4f99b None None] Authenticating user token {{(pid=82026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:42:21.766869 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa2035c8-b76e-4f03-8f8f-4903fcd0448d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57539b6a6f3b4d589f5f5e1d211cd6a0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82025) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:42:21.767524 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa2035c8-b76e-4f03-8f8f-4903fcd0448d None admin] REQUEST_METHOD: `GET` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:42:21.767859 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa2035c8-b76e-4f03-8f8f-4903fcd0448d None admin] SCRIPT_NAME: `/identity` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:42:21.768134 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa2035c8-b76e-4f03-8f8f-4903fcd0448d None admin] PATH_INFO: `/v3/domains` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:42:21.768779 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa2035c8-b76e-4f03-8f8f-4903fcd0448d None admin] RBAC: Adding query filter params (name=Default) {{(pid=82025) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 19:42:21.769260 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa2035c8-b76e-4f03-8f8f-4903fcd0448d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:42:21.772104 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa2035c8-b76e-4f03-8f8f-4903fcd0448d None admin] RBAC: Authorization granted {{(pid=82025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:42:21.789261 dv-cinder-828806-6-smb devstack@keystone.service[82025]: [pid: 82025|app: 0|req: 383/770] 10.222.0.33 () {56 vars in 1109 bytes} [Tue Sep 13 19:42:21 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 217 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 19:42:21.794052 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa2035c8-b76e-4f03-8f8f-4903fcd0448d None admin] Authenticating user token {{(pid=82025) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:42:21.818337 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG dbcounter [-] [82025] Writing DB stats keystone:SELECT=100 {{(pid=82025) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:42:21.865732 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc2a7790-0fe7-417b-aeed-c8204bc4f99b None None] Validating token access rules against request {{(pid=82026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:42:21.940574 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7880269-94c7-425a-ada1-33df5defb33b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57539b6a6f3b4d589f5f5e1d211cd6a0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:42:21.941194 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7880269-94c7-425a-ada1-33df5defb33b None admin] REQUEST_METHOD: `GET` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:42:21.941470 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7880269-94c7-425a-ada1-33df5defb33b None admin] SCRIPT_NAME: `/identity` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:42:21.941749 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7880269-94c7-425a-ada1-33df5defb33b None admin] PATH_INFO: `/v3/endpoints` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:42:21.942595 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7880269-94c7-425a-ada1-33df5defb33b None admin] RBAC: Adding query filter params (interface=public, service_id=70e63d54865b4d8f98b3af22bc7d1862, region_id=RegionOne) {{(pid=82026) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 19:42:21.942904 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7880269-94c7-425a-ada1-33df5defb33b None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=82026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:42:21.944299 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7880269-94c7-425a-ada1-33df5defb33b None admin] RBAC: Authorization granted {{(pid=82026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:42:21.962463 dv-cinder-828806-6-smb devstack@keystone.service[82026]: [pid: 82026|app: 0|req: 388/771] 10.222.0.33 () {56 vars in 1251 bytes} [Tue Sep 13 19:42:21 2022] GET /identity/v3/endpoints?service_id=70e63d54865b4d8f98b3af22bc7d1862&interface=public®ion_id=RegionOne => generated 194 bytes in 234 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 19:42:21.967661 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7880269-94c7-425a-ada1-33df5defb33b None admin] Authenticating user token {{(pid=82026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:42:21.971074 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa2035c8-b76e-4f03-8f8f-4903fcd0448d None admin] Validating token access rules against request {{(pid=82025) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:42:22.036664 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f39bda92-aa20-4262-ba8f-a8e8734702dc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57539b6a6f3b4d589f5f5e1d211cd6a0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82025) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:42:22.037696 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f39bda92-aa20-4262-ba8f-a8e8734702dc None admin] REQUEST_METHOD: `GET` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:42:22.038205 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f39bda92-aa20-4262-ba8f-a8e8734702dc None admin] SCRIPT_NAME: `/identity` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:42:22.038678 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f39bda92-aa20-4262-ba8f-a8e8734702dc None admin] PATH_INFO: `/v3/projects/service` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:42:22.050655 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG dbcounter [-] [82026] Writing DB stats keystone:SELECT=100 {{(pid=82026) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:42:22.052242 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f39bda92-aa20-4262-ba8f-a8e8734702dc None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=82025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:42:22.053699 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f39bda92-aa20-4262-ba8f-a8e8734702dc None admin] RBAC: Authorization granted {{(pid=82025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:42:22.076732 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application [None req-f39bda92-aa20-4262-ba8f-a8e8734702dc None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 13 19:42:22.076732 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 19:42:22.076732 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 19:42:22.076732 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 19:42:22.076732 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 19:42:22.076732 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 19:42:22.076732 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 19:42:22.076732 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 19:42:22.076732 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 19:42:22.076732 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 19:42:22.076732 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 19:42:22.076732 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 19:42:22.076732 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 13 19:42:22.076732 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 13 19:42:22.076732 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 13 19:42:22.077873 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 13 19:42:22.077873 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 19:42:22.077873 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 19:42:22.077873 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 19:42:22.077873 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 19:42:22.077873 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 19:42:22.077873 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 19:42:22.077873 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 19:42:22.077873 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application with Lock( Sep 13 19:42:22.077873 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 19:42:22.077873 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application return self._enter() Sep 13 19:42:22.077873 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 19:42:22.077873 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 19:42:22.077873 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 19:42:22.077873 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application return self.creator() Sep 13 19:42:22.077873 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 19:42:22.077873 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application created_value = creator( Sep 13 19:42:22.078833 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 13 19:42:22.078833 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 13 19:42:22.078833 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 13 19:42:22.078833 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 13 19:42:22.078833 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 13 19:42:22.078833 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 13 19:42:22.078833 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 13 19:42:22.078833 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application Sep 13 19:42:22.078833 dv-cinder-828806-6-smb devstack@keystone.service[82025]: [pid: 82025|app: 0|req: 384/772] 10.222.0.33 () {56 vars in 1111 bytes} [Tue Sep 13 19:42:21 2022] GET /identity/v3/projects/service => generated 88 bytes in 284 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 19:42:22.087020 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f39bda92-aa20-4262-ba8f-a8e8734702dc None admin] Authenticating user token {{(pid=82025) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:42:22.120987 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7880269-94c7-425a-ada1-33df5defb33b None admin] Validating token access rules against request {{(pid=82026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:42:22.166955 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7341053e-9830-4f5c-8a19-23d09b33c154 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57539b6a6f3b4d589f5f5e1d211cd6a0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:42:22.168034 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7341053e-9830-4f5c-8a19-23d09b33c154 None admin] REQUEST_METHOD: `GET` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:42:22.168645 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7341053e-9830-4f5c-8a19-23d09b33c154 None admin] SCRIPT_NAME: `/identity` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:42:22.168937 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7341053e-9830-4f5c-8a19-23d09b33c154 None admin] PATH_INFO: `/v3/services` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:42:22.169835 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7341053e-9830-4f5c-8a19-23d09b33c154 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=82026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:42:22.171976 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7341053e-9830-4f5c-8a19-23d09b33c154 None admin] RBAC: Authorization granted {{(pid=82026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:42:22.193436 dv-cinder-828806-6-smb devstack@keystone.service[82026]: [pid: 82026|app: 0|req: 389/773] 10.222.0.33 () {56 vars in 1087 bytes} [Tue Sep 13 19:42:21 2022] GET /identity/v3/services => generated 772 bytes in 222 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 13 19:42:22.194526 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7341053e-9830-4f5c-8a19-23d09b33c154 None admin] Authenticating user token {{(pid=82026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:42:22.202208 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG dbcounter [-] [82025] Writing DB stats keystone:SELECT=100 {{(pid=82025) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:42:22.235536 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f39bda92-aa20-4262-ba8f-a8e8734702dc None admin] Validating token access rules against request {{(pid=82025) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:42:22.283850 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3e927b3-5921-439c-acde-adcd48c05815 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57539b6a6f3b4d589f5f5e1d211cd6a0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82025) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:42:22.284549 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3e927b3-5921-439c-acde-adcd48c05815 None admin] REQUEST_METHOD: `GET` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:42:22.284828 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3e927b3-5921-439c-acde-adcd48c05815 None admin] SCRIPT_NAME: `/identity` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:42:22.285110 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3e927b3-5921-439c-acde-adcd48c05815 None admin] PATH_INFO: `/v3/projects` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:42:22.285835 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3e927b3-5921-439c-acde-adcd48c05815 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=82025) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 19:42:22.286147 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3e927b3-5921-439c-acde-adcd48c05815 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=82025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:42:22.287682 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3e927b3-5921-439c-acde-adcd48c05815 None admin] RBAC: Authorization granted {{(pid=82025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:42:22.320887 dv-cinder-828806-6-smb devstack@keystone.service[82025]: [pid: 82025|app: 0|req: 385/774] 10.222.0.33 () {56 vars in 1148 bytes} [Tue Sep 13 19:42:22 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 234 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 19:42:22.327436 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3e927b3-5921-439c-acde-adcd48c05815 None admin] Authenticating user token {{(pid=82025) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:42:22.412156 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7341053e-9830-4f5c-8a19-23d09b33c154 None admin] Validating token access rules against request {{(pid=82026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:42:22.435454 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG dbcounter [-] [82026] Writing DB stats keystone:SELECT=100 {{(pid=82026) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:42:22.452889 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a4e967c-2e82-499e-a9f8-e7f8dff40dd2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57539b6a6f3b4d589f5f5e1d211cd6a0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:42:22.454139 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a4e967c-2e82-499e-a9f8-e7f8dff40dd2 None admin] REQUEST_METHOD: `GET` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:42:22.454417 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a4e967c-2e82-499e-a9f8-e7f8dff40dd2 None admin] SCRIPT_NAME: `/identity` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:42:22.454698 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a4e967c-2e82-499e-a9f8-e7f8dff40dd2 None admin] PATH_INFO: `/v3/services/network` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:42:22.455339 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a4e967c-2e82-499e-a9f8-e7f8dff40dd2 None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=82026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:42:22.456808 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a4e967c-2e82-499e-a9f8-e7f8dff40dd2 None admin] RBAC: Authorization granted {{(pid=82026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:42:22.465600 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3e927b3-5921-439c-acde-adcd48c05815 None admin] Validating token access rules against request {{(pid=82025) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:42:22.468808 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application [None req-6a4e967c-2e82-499e-a9f8-e7f8dff40dd2 None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Sep 13 19:42:22.468808 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 19:42:22.468808 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 13 19:42:22.468808 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 13 19:42:22.468808 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 13 19:42:22.468808 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 13 19:42:22.468808 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 13 19:42:22.468808 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 13 19:42:22.468808 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Sep 13 19:42:22.468808 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application Sep 13 19:42:22.468808 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 13 19:42:22.468808 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application Sep 13 19:42:22.468808 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 19:42:22.468808 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 19:42:22.468808 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 19:42:22.468808 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 19:42:22.468808 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 19:42:22.471341 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 19:42:22.471341 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 19:42:22.471341 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 19:42:22.471341 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 19:42:22.471341 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 19:42:22.471341 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 19:42:22.471341 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 13 19:42:22.471341 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 13 19:42:22.471341 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 13 19:42:22.471341 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 13 19:42:22.471341 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 19:42:22.471341 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 19:42:22.471341 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 19:42:22.471341 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 19:42:22.471341 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 19:42:22.471341 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 19:42:22.473193 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 19:42:22.473193 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application with Lock( Sep 13 19:42:22.473193 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 19:42:22.473193 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application return self._enter() Sep 13 19:42:22.473193 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 19:42:22.473193 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 19:42:22.473193 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 19:42:22.473193 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application return self.creator() Sep 13 19:42:22.473193 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 19:42:22.473193 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application created_value = creator( Sep 13 19:42:22.473193 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 13 19:42:22.473193 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 13 19:42:22.473193 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Sep 13 19:42:22.473193 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application Sep 13 19:42:22.473193 dv-cinder-828806-6-smb devstack@keystone.service[82026]: [pid: 82026|app: 0|req: 390/775] 10.222.0.33 () {56 vars in 1111 bytes} [Tue Sep 13 19:42:22 2022] GET /identity/v3/services/network => generated 88 bytes in 276 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 19:42:22.483060 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a4e967c-2e82-499e-a9f8-e7f8dff40dd2 None admin] Authenticating user token {{(pid=82026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:42:22.513193 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8700b92b-4a66-4014-a1a3-2f6ca7c3a507 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57539b6a6f3b4d589f5f5e1d211cd6a0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82025) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:42:22.513732 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8700b92b-4a66-4014-a1a3-2f6ca7c3a507 None admin] REQUEST_METHOD: `GET` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:42:22.514014 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8700b92b-4a66-4014-a1a3-2f6ca7c3a507 None admin] SCRIPT_NAME: `/identity` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:42:22.514291 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8700b92b-4a66-4014-a1a3-2f6ca7c3a507 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:42:22.515023 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8700b92b-4a66-4014-a1a3-2f6ca7c3a507 None admin] RBAC: Adding query filter params (role.id=47ee826cd5f148c19f293f9470f906da, scope.project.id=c8c6fba0f15b4d6a84ff601919b7b8e4, user.id=a28e738b894442e2bc9880eeb64fc0c8) {{(pid=82025) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 19:42:22.515355 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8700b92b-4a66-4014-a1a3-2f6ca7c3a507 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=82025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:42:22.517583 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8700b92b-4a66-4014-a1a3-2f6ca7c3a507 None admin] RBAC: Authorization granted {{(pid=82025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:42:22.520734 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG dbcounter [-] [82025] Writing DB stats keystone:SELECT=100 {{(pid=82025) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:42:22.524782 dv-cinder-828806-6-smb devstack@keystone.service[82025]: [pid: 82025|app: 0|req: 386/776] 10.222.0.33 () {56 vars in 1374 bytes} [Tue Sep 13 19:42:22 2022] GET /identity/v3/role_assignments?user.id=a28e738b894442e2bc9880eeb64fc0c8&scope.project.id=c8c6fba0f15b4d6a84ff601919b7b8e4&role.id=47ee826cd5f148c19f293f9470f906da => generated 259 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 19:42:22.570979 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b28c9258-788c-41ea-ae1c-76497e1873a5 None None] REQUEST_METHOD: `GET` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:42:22.571358 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b28c9258-788c-41ea-ae1c-76497e1873a5 None None] SCRIPT_NAME: `/identity` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:42:22.571596 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b28c9258-788c-41ea-ae1c-76497e1873a5 None None] PATH_INFO: `/` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:42:22.573087 dv-cinder-828806-6-smb devstack@keystone.service[82025]: [pid: 82025|app: 0|req: 387/777] 10.222.0.33 () {54 vars in 927 bytes} [Tue Sep 13 19:42:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 19:42:22.578810 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d517a2e8-d82c-499a-9b84-c6d34dd4a1dc None None] REQUEST_METHOD: `POST` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:42:22.579281 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d517a2e8-d82c-499a-9b84-c6d34dd4a1dc None None] SCRIPT_NAME: `/identity` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:42:22.579455 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d517a2e8-d82c-499a-9b84-c6d34dd4a1dc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:42:22.614620 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a4e967c-2e82-499e-a9f8-e7f8dff40dd2 None admin] Validating token access rules against request {{(pid=82026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:42:22.616158 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.auth.core [None req-d517a2e8-d82c-499a-9b84-c6d34dd4a1dc None None] MFA Rules not processed for user `57539b6a6f3b4d589f5f5e1d211cd6a0`. Rule list: `[]` (Enabled: `True`). {{(pid=82025) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 19:42:22.617443 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.fernet_utils [None req-d517a2e8-d82c-499a-9b84-c6d34dd4a1dc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82025) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 19:42:22.653212 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12ac404b-a5e7-4ac7-bce5-541fab55a2dd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57539b6a6f3b4d589f5f5e1d211cd6a0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:42:22.653833 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12ac404b-a5e7-4ac7-bce5-541fab55a2dd None admin] REQUEST_METHOD: `GET` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:42:22.654112 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12ac404b-a5e7-4ac7-bce5-541fab55a2dd None admin] SCRIPT_NAME: `/identity` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:42:22.654383 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12ac404b-a5e7-4ac7-bce5-541fab55a2dd None admin] PATH_INFO: `/v3/services` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:42:22.655114 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12ac404b-a5e7-4ac7-bce5-541fab55a2dd None admin] RBAC: Adding query filter params (name=network) {{(pid=82026) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 19:42:22.655419 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12ac404b-a5e7-4ac7-bce5-541fab55a2dd None admin] RBAC: Authorizing `identity:list_services()` {{(pid=82026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:42:22.657418 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12ac404b-a5e7-4ac7-bce5-541fab55a2dd None admin] RBAC: Authorization granted {{(pid=82026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:42:22.663656 dv-cinder-828806-6-smb devstack@keystone.service[82026]: [pid: 82026|app: 0|req: 391/778] 10.222.0.33 () {56 vars in 1112 bytes} [Tue Sep 13 19:42:22 2022] GET /identity/v3/services?name=network => generated 124 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 19:42:22.673869 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12ac404b-a5e7-4ac7-bce5-541fab55a2dd None admin] Authenticating user token {{(pid=82026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:42:22.731126 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG dbcounter [-] [82026] Writing DB stats keystone:SELECT=100 {{(pid=82026) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:42:22.755149 dv-cinder-828806-6-smb devstack@keystone.service[82025]: [pid: 82025|app: 0|req: 388/779] 10.222.0.33 () {58 vars in 1024 bytes} [Tue Sep 13 19:42:22 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 177 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 13 19:42:22.829825 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12ac404b-a5e7-4ac7-bce5-541fab55a2dd None admin] Validating token access rules against request {{(pid=82026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:42:22.878339 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc2f1a80-0f47-4d01-afdf-eb1dfbe4ab7f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57539b6a6f3b4d589f5f5e1d211cd6a0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:42:22.879005 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc2f1a80-0f47-4d01-afdf-eb1dfbe4ab7f None admin] REQUEST_METHOD: `GET` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:42:22.879322 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc2f1a80-0f47-4d01-afdf-eb1dfbe4ab7f None admin] SCRIPT_NAME: `/identity` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:42:22.879598 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc2f1a80-0f47-4d01-afdf-eb1dfbe4ab7f None admin] PATH_INFO: `/v3/services` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:42:22.880281 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc2f1a80-0f47-4d01-afdf-eb1dfbe4ab7f None admin] RBAC: Adding query filter params (type=network) {{(pid=82026) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 19:42:22.880594 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc2f1a80-0f47-4d01-afdf-eb1dfbe4ab7f None admin] RBAC: Authorizing `identity:list_services()` {{(pid=82026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:42:22.881963 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc2f1a80-0f47-4d01-afdf-eb1dfbe4ab7f None admin] RBAC: Authorization granted {{(pid=82026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:42:22.889928 dv-cinder-828806-6-smb devstack@keystone.service[82026]: [pid: 82026|app: 0|req: 392/780] 10.222.0.33 () {56 vars in 1112 bytes} [Tue Sep 13 19:42:22 2022] GET /identity/v3/services?type=network => generated 350 bytes in 215 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 13 19:42:22.893465 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d517a2e8-d82c-499a-9b84-c6d34dd4a1dc None None] Authenticating user token {{(pid=82025) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:42:23.009433 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d517a2e8-d82c-499a-9b84-c6d34dd4a1dc None None] Validating token access rules against request {{(pid=82025) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:42:23.041326 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG dbcounter [-] [82025] Writing DB stats keystone:SELECT=100 {{(pid=82025) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:42:23.051293 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49cb52ba-1db7-4495-b1b4-06dd2e9a9c34 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57539b6a6f3b4d589f5f5e1d211cd6a0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82025) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:42:23.051919 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49cb52ba-1db7-4495-b1b4-06dd2e9a9c34 None admin] REQUEST_METHOD: `GET` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:42:23.052201 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49cb52ba-1db7-4495-b1b4-06dd2e9a9c34 None admin] SCRIPT_NAME: `/identity` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:42:23.052479 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49cb52ba-1db7-4495-b1b4-06dd2e9a9c34 None admin] PATH_INFO: `/v3/endpoints` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:42:23.053188 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49cb52ba-1db7-4495-b1b4-06dd2e9a9c34 None admin] RBAC: Adding query filter params (interface=public, service_id=435e89e33ce149d1a9856373d3fad779, region_id=RegionOne) {{(pid=82025) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 19:42:23.053497 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49cb52ba-1db7-4495-b1b4-06dd2e9a9c34 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=82025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:42:23.054852 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49cb52ba-1db7-4495-b1b4-06dd2e9a9c34 None admin] RBAC: Authorization granted {{(pid=82025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:42:23.062785 dv-cinder-828806-6-smb devstack@keystone.service[82025]: [pid: 82025|app: 0|req: 389/781] 10.222.0.33 () {56 vars in 1251 bytes} [Tue Sep 13 19:42:22 2022] GET /identity/v3/endpoints?service_id=435e89e33ce149d1a9856373d3fad779&interface=public®ion_id=RegionOne => generated 194 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 19:42:23.069645 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc2f1a80-0f47-4d01-afdf-eb1dfbe4ab7f None admin] Authenticating user token {{(pid=82026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:42:23.087435 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49cb52ba-1db7-4495-b1b4-06dd2e9a9c34 None admin] Authenticating user token {{(pid=82025) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:42:23.232583 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc2f1a80-0f47-4d01-afdf-eb1dfbe4ab7f None admin] Validating token access rules against request {{(pid=82026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:42:23.244208 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG dbcounter [-] [82026] Writing DB stats keystone:SELECT=100 {{(pid=82026) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:42:23.288439 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49cb52ba-1db7-4495-b1b4-06dd2e9a9c34 None admin] Validating token access rules against request {{(pid=82025) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:42:23.289932 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdcd7be1-dc4a-415a-9564-a5231e589471 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57539b6a6f3b4d589f5f5e1d211cd6a0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:42:23.290886 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdcd7be1-dc4a-415a-9564-a5231e589471 None admin] REQUEST_METHOD: `GET` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:42:23.291214 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdcd7be1-dc4a-415a-9564-a5231e589471 None admin] SCRIPT_NAME: `/identity` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:42:23.291500 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdcd7be1-dc4a-415a-9564-a5231e589471 None admin] PATH_INFO: `/v3/services` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:42:23.292126 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdcd7be1-dc4a-415a-9564-a5231e589471 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=82026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:42:23.293518 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdcd7be1-dc4a-415a-9564-a5231e589471 None admin] RBAC: Authorization granted {{(pid=82026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:42:23.301286 dv-cinder-828806-6-smb devstack@keystone.service[82026]: [pid: 82026|app: 0|req: 393/782] 10.222.0.33 () {56 vars in 1087 bytes} [Tue Sep 13 19:42:23 2022] GET /identity/v3/services => generated 772 bytes in 233 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 19:42:23.363129 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6db9deab-3e5b-430a-8ca8-d3935c8e902a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57539b6a6f3b4d589f5f5e1d211cd6a0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82025) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:42:23.363780 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6db9deab-3e5b-430a-8ca8-d3935c8e902a None admin] REQUEST_METHOD: `GET` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:42:23.364069 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6db9deab-3e5b-430a-8ca8-d3935c8e902a None admin] SCRIPT_NAME: `/identity` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:42:23.364348 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6db9deab-3e5b-430a-8ca8-d3935c8e902a None admin] PATH_INFO: `/v3/roles/admin` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:42:23.377755 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6db9deab-3e5b-430a-8ca8-d3935c8e902a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=82025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 13 19:42:23.383315 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application [None req-6db9deab-3e5b-430a-8ca8-d3935c8e902a None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 13 19:42:23.383315 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 19:42:23.383315 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 19:42:23.383315 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 19:42:23.383315 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 19:42:23.383315 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 19:42:23.383315 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 19:42:23.383315 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 19:42:23.383315 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 19:42:23.383315 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 19:42:23.383315 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 19:42:23.383315 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 19:42:23.383315 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 13 19:42:23.383315 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 13 19:42:23.383315 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 13 19:42:23.383315 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 13 19:42:23.384242 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 13 19:42:23.384242 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 13 19:42:23.384242 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 13 19:42:23.384242 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 13 19:42:23.384242 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 19:42:23.384242 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 19:42:23.384242 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 19:42:23.384242 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 19:42:23.384242 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 19:42:23.384242 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 19:42:23.384242 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 19:42:23.384242 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application with Lock( Sep 13 19:42:23.384242 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 19:42:23.384242 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application return self._enter() Sep 13 19:42:23.384242 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 19:42:23.384242 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 19:42:23.385096 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 19:42:23.385096 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application return self.creator() Sep 13 19:42:23.385096 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 19:42:23.385096 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application created_value = creator( Sep 13 19:42:23.385096 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 13 19:42:23.385096 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 13 19:42:23.385096 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 13 19:42:23.385096 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 13 19:42:23.385096 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 13 19:42:23.385096 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 13 19:42:23.385096 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 13 19:42:23.385096 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application Sep 13 19:42:23.392682 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdcd7be1-dc4a-415a-9564-a5231e589471 None admin] Authenticating user token {{(pid=82026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:42:23.393888 dv-cinder-828806-6-smb devstack@keystone.service[82025]: [pid: 82025|app: 0|req: 390/783] 10.222.0.33 () {56 vars in 1096 bytes} [Tue Sep 13 19:42:23 2022] GET /identity/v3/roles/admin => generated 83 bytes in 307 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 13 19:42:23.556447 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdcd7be1-dc4a-415a-9564-a5231e589471 None admin] Validating token access rules against request {{(pid=82026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:42:23.604982 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18626373-fedf-432a-b383-e0a8619a32f0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57539b6a6f3b4d589f5f5e1d211cd6a0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:42:23.605644 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18626373-fedf-432a-b383-e0a8619a32f0 None admin] REQUEST_METHOD: `GET` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:42:23.605938 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18626373-fedf-432a-b383-e0a8619a32f0 None admin] SCRIPT_NAME: `/identity` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:42:23.606218 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18626373-fedf-432a-b383-e0a8619a32f0 None admin] PATH_INFO: `/v3/roles` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:42:23.606891 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18626373-fedf-432a-b383-e0a8619a32f0 None admin] RBAC: Adding query filter params (name=admin) {{(pid=82026) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 19:42:23.607224 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18626373-fedf-432a-b383-e0a8619a32f0 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:42:23.608595 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18626373-fedf-432a-b383-e0a8619a32f0 None admin] RBAC: Authorization granted {{(pid=82026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:42:23.623568 dv-cinder-828806-6-smb devstack@keystone.service[82026]: [pid: 82026|app: 0|req: 394/784] 10.222.0.33 () {56 vars in 1099 bytes} [Tue Sep 13 19:42:23 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 232 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 19:42:23.629723 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6db9deab-3e5b-430a-8ca8-d3935c8e902a None admin] Authenticating user token {{(pid=82025) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:42:23.705711 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG dbcounter [-] [82025] Writing DB stats keystone:SELECT=100 {{(pid=82025) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:42:23.751410 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6db9deab-3e5b-430a-8ca8-d3935c8e902a None admin] Validating token access rules against request {{(pid=82025) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:42:23.786141 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d2701ea-5cd1-4369-8ef1-817f289882ad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57539b6a6f3b4d589f5f5e1d211cd6a0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82025) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:42:23.786784 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d2701ea-5cd1-4369-8ef1-817f289882ad None admin] REQUEST_METHOD: `GET` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:42:23.788354 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d2701ea-5cd1-4369-8ef1-817f289882ad None admin] SCRIPT_NAME: `/identity` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:42:23.788637 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d2701ea-5cd1-4369-8ef1-817f289882ad None admin] PATH_INFO: `/v3/domains/Default` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:42:23.801022 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d2701ea-5cd1-4369-8ef1-817f289882ad None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=82025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:42:23.802489 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d2701ea-5cd1-4369-8ef1-817f289882ad None admin] RBAC: Authorization granted {{(pid=82025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:42:23.818092 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application [None req-0d2701ea-5cd1-4369-8ef1-817f289882ad None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 13 19:42:23.818092 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 19:42:23.818092 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 19:42:23.818092 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 19:42:23.818092 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 19:42:23.818092 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 19:42:23.818092 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 19:42:23.818092 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 19:42:23.818092 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 19:42:23.818092 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 19:42:23.818092 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 19:42:23.818092 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 19:42:23.818092 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 13 19:42:23.818092 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 13 19:42:23.818092 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 13 19:42:23.818092 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 13 19:42:23.819099 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 19:42:23.819099 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 19:42:23.819099 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 19:42:23.819099 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 19:42:23.819099 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 19:42:23.819099 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 19:42:23.819099 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 19:42:23.819099 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application with Lock( Sep 13 19:42:23.819099 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 19:42:23.819099 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application return self._enter() Sep 13 19:42:23.819099 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 19:42:23.819099 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 19:42:23.819099 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 19:42:23.819099 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application return self.creator() Sep 13 19:42:23.819099 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 19:42:23.819099 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application created_value = creator( Sep 13 19:42:23.819099 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 13 19:42:23.820020 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 13 19:42:23.820020 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 13 19:42:23.820020 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application Sep 13 19:42:23.820020 dv-cinder-828806-6-smb devstack@keystone.service[82025]: [pid: 82025|app: 0|req: 391/785] 10.222.0.33 () {56 vars in 1108 bytes} [Tue Sep 13 19:42:23 2022] GET /identity/v3/domains/Default => generated 87 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 19:42:23.825195 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18626373-fedf-432a-b383-e0a8619a32f0 None admin] Authenticating user token {{(pid=82026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:42:23.864600 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG dbcounter [-] [82026] Writing DB stats keystone:SELECT=100 {{(pid=82026) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:42:23.942365 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18626373-fedf-432a-b383-e0a8619a32f0 None admin] Validating token access rules against request {{(pid=82026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:42:23.979365 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75c05ee9-51ae-4fd2-b008-a23d4f8d12f5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57539b6a6f3b4d589f5f5e1d211cd6a0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:42:23.979973 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75c05ee9-51ae-4fd2-b008-a23d4f8d12f5 None admin] REQUEST_METHOD: `GET` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:42:23.980257 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75c05ee9-51ae-4fd2-b008-a23d4f8d12f5 None admin] SCRIPT_NAME: `/identity` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:42:23.980534 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75c05ee9-51ae-4fd2-b008-a23d4f8d12f5 None admin] PATH_INFO: `/v3/domains` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:42:23.981181 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75c05ee9-51ae-4fd2-b008-a23d4f8d12f5 None admin] RBAC: Adding query filter params (name=Default) {{(pid=82026) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 19:42:23.981486 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75c05ee9-51ae-4fd2-b008-a23d4f8d12f5 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:42:23.982854 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75c05ee9-51ae-4fd2-b008-a23d4f8d12f5 None admin] RBAC: Authorization granted {{(pid=82026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:42:23.995745 dv-cinder-828806-6-smb devstack@keystone.service[82026]: [pid: 82026|app: 0|req: 395/786] 10.222.0.33 () {56 vars in 1109 bytes} [Tue Sep 13 19:42:23 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 19:42:24.002159 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d2701ea-5cd1-4369-8ef1-817f289882ad None admin] Authenticating user token {{(pid=82025) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:42:24.138683 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d2701ea-5cd1-4369-8ef1-817f289882ad None admin] Validating token access rules against request {{(pid=82025) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:42:24.147718 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG dbcounter [-] [82025] Writing DB stats keystone:SELECT=100 {{(pid=82025) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:42:24.185156 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0d7c1ab-ced6-435a-855a-bbceb856967c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57539b6a6f3b4d589f5f5e1d211cd6a0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82025) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:42:24.185808 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0d7c1ab-ced6-435a-855a-bbceb856967c None admin] REQUEST_METHOD: `GET` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:42:24.186091 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0d7c1ab-ced6-435a-855a-bbceb856967c None admin] SCRIPT_NAME: `/identity` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:42:24.186370 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0d7c1ab-ced6-435a-855a-bbceb856967c None admin] PATH_INFO: `/v3/users/swift` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:42:24.198127 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0d7c1ab-ced6-435a-855a-bbceb856967c None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=82025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:42:24.199640 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0d7c1ab-ced6-435a-855a-bbceb856967c None admin] RBAC: Authorization granted {{(pid=82025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:42:24.216623 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application [None req-c0d7c1ab-ced6-435a-855a-bbceb856967c None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Sep 13 19:42:24.216623 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 19:42:24.216623 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 19:42:24.216623 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 19:42:24.216623 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 19:42:24.216623 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 19:42:24.216623 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 19:42:24.216623 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 19:42:24.216623 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 19:42:24.216623 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 19:42:24.216623 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 19:42:24.216623 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 19:42:24.216623 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 13 19:42:24.216623 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 13 19:42:24.216623 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 13 19:42:24.216623 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 13 19:42:24.217639 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 19:42:24.217639 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 19:42:24.217639 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 13 19:42:24.217639 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 13 19:42:24.217639 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 13 19:42:24.217639 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 13 19:42:24.217639 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 19:42:24.217639 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 19:42:24.217639 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 19:42:24.217639 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 19:42:24.217639 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 19:42:24.217639 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application with Lock( Sep 13 19:42:24.217639 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 19:42:24.217639 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application return self._enter() Sep 13 19:42:24.217639 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 19:42:24.217639 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 19:42:24.217639 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 19:42:24.217639 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application return self.creator() Sep 13 19:42:24.218591 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 19:42:24.218591 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application created_value = creator( Sep 13 19:42:24.218591 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 13 19:42:24.218591 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 13 19:42:24.218591 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 13 19:42:24.218591 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 13 19:42:24.218591 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 13 19:42:24.218591 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 13 19:42:24.218591 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Sep 13 19:42:24.218591 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application Sep 13 19:42:24.218591 dv-cinder-828806-6-smb devstack@keystone.service[82025]: [pid: 82025|app: 0|req: 392/787] 10.222.0.33 () {56 vars in 1096 bytes} [Tue Sep 13 19:42:24 2022] GET /identity/v3/users/swift => generated 83 bytes in 217 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 19:42:24.224328 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75c05ee9-51ae-4fd2-b008-a23d4f8d12f5 None admin] Authenticating user token {{(pid=82026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:42:24.334612 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-804f61ac-a565-4594-b5ce-f5ca617b8537 None None] REQUEST_METHOD: `GET` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:42:24.335298 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-804f61ac-a565-4594-b5ce-f5ca617b8537 None None] SCRIPT_NAME: `/identity` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:42:24.335804 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-804f61ac-a565-4594-b5ce-f5ca617b8537 None None] PATH_INFO: `/` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:42:24.337630 dv-cinder-828806-6-smb devstack@keystone.service[82025]: [pid: 82025|app: 0|req: 393/788] 10.222.0.33 () {54 vars in 927 bytes} [Tue Sep 13 19:42:24 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 13 19:42:24.344583 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2280a4e1-3774-4b7b-8ccb-3f72ceeb2472 None None] REQUEST_METHOD: `POST` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:42:24.345103 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2280a4e1-3774-4b7b-8ccb-3f72ceeb2472 None None] SCRIPT_NAME: `/identity` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:42:24.345715 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2280a4e1-3774-4b7b-8ccb-3f72ceeb2472 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:42:24.361000 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG dbcounter [-] [82026] Writing DB stats keystone:SELECT=100 {{(pid=82026) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:42:24.366135 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.auth.core [None req-2280a4e1-3774-4b7b-8ccb-3f72ceeb2472 None None] MFA Rules not processed for user `57539b6a6f3b4d589f5f5e1d211cd6a0`. Rule list: `[]` (Enabled: `True`). {{(pid=82025) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 19:42:24.367599 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.fernet_utils [None req-2280a4e1-3774-4b7b-8ccb-3f72ceeb2472 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82025) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 19:42:24.373681 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75c05ee9-51ae-4fd2-b008-a23d4f8d12f5 None admin] Validating token access rules against request {{(pid=82026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:42:24.438787 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99e10721-4b26-4305-abd3-16a962f38713 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57539b6a6f3b4d589f5f5e1d211cd6a0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:42:24.439432 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99e10721-4b26-4305-abd3-16a962f38713 None admin] REQUEST_METHOD: `GET` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:42:24.439718 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99e10721-4b26-4305-abd3-16a962f38713 None admin] SCRIPT_NAME: `/identity` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:42:24.439997 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99e10721-4b26-4305-abd3-16a962f38713 None admin] PATH_INFO: `/v3/users` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:42:24.440734 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99e10721-4b26-4305-abd3-16a962f38713 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=82026) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 19:42:24.441254 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99e10721-4b26-4305-abd3-16a962f38713 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=82026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:42:24.442579 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99e10721-4b26-4305-abd3-16a962f38713 None admin] RBAC: Authorization granted {{(pid=82026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:42:24.455130 dv-cinder-828806-6-smb devstack@keystone.service[82025]: [pid: 82025|app: 0|req: 394/789] 10.222.0.33 () {58 vars in 1024 bytes} [Tue Sep 13 19:42:24 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 13 19:42:24.476086 dv-cinder-828806-6-smb devstack@keystone.service[82026]: [pid: 82026|app: 0|req: 396/790] 10.222.0.33 () {56 vars in 1135 bytes} [Tue Sep 13 19:42:24 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 252 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 19:42:24.481694 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2280a4e1-3774-4b7b-8ccb-3f72ceeb2472 None None] Authenticating user token {{(pid=82025) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:42:24.633725 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG dbcounter [-] [82025] Writing DB stats keystone:SELECT=100 {{(pid=82025) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:42:24.639964 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2280a4e1-3774-4b7b-8ccb-3f72ceeb2472 None None] Validating token access rules against request {{(pid=82025) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:42:24.685130 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fedababf-8ce8-4072-9ea0-ac76953287df None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57539b6a6f3b4d589f5f5e1d211cd6a0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82025) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:42:24.685769 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fedababf-8ce8-4072-9ea0-ac76953287df None admin] REQUEST_METHOD: `GET` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:42:24.686055 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fedababf-8ce8-4072-9ea0-ac76953287df None admin] SCRIPT_NAME: `/identity` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:42:24.686333 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fedababf-8ce8-4072-9ea0-ac76953287df None admin] PATH_INFO: `/v3/domains/Default` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:42:24.699767 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fedababf-8ce8-4072-9ea0-ac76953287df None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=82025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:42:24.701291 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fedababf-8ce8-4072-9ea0-ac76953287df None admin] RBAC: Authorization granted {{(pid=82025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:42:24.721182 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application [None req-fedababf-8ce8-4072-9ea0-ac76953287df None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 13 19:42:24.721182 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 19:42:24.721182 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 19:42:24.721182 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 19:42:24.721182 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 19:42:24.721182 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 19:42:24.721182 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 19:42:24.721182 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 19:42:24.721182 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 19:42:24.721182 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 19:42:24.721182 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 19:42:24.721182 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 19:42:24.721182 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 13 19:42:24.721182 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 13 19:42:24.721182 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 13 19:42:24.721182 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 13 19:42:24.722130 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 19:42:24.722130 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 19:42:24.722130 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 19:42:24.722130 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 19:42:24.722130 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 19:42:24.722130 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 19:42:24.722130 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 19:42:24.722130 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application with Lock( Sep 13 19:42:24.722130 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 19:42:24.722130 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application return self._enter() Sep 13 19:42:24.722130 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 19:42:24.722130 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 19:42:24.722130 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 19:42:24.722130 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application return self.creator() Sep 13 19:42:24.722130 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 19:42:24.722130 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application created_value = creator( Sep 13 19:42:24.722130 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 13 19:42:24.723056 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 13 19:42:24.723056 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 13 19:42:24.723056 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application Sep 13 19:42:24.723056 dv-cinder-828806-6-smb devstack@keystone.service[82025]: [pid: 82025|app: 0|req: 395/791] 10.222.0.33 () {56 vars in 1108 bytes} [Tue Sep 13 19:42:24 2022] GET /identity/v3/domains/Default => generated 87 bytes in 241 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 19:42:24.729192 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99e10721-4b26-4305-abd3-16a962f38713 None admin] Authenticating user token {{(pid=82026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:42:24.801875 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fedababf-8ce8-4072-9ea0-ac76953287df None admin] Authenticating user token {{(pid=82025) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:42:24.915669 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fedababf-8ce8-4072-9ea0-ac76953287df None admin] Validating token access rules against request {{(pid=82025) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:42:24.917745 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99e10721-4b26-4305-abd3-16a962f38713 None admin] Validating token access rules against request {{(pid=82026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:42:24.952332 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-075334d1-8ffc-4f38-b1ce-c239cfb1d30d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57539b6a6f3b4d589f5f5e1d211cd6a0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82025) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:42:24.952972 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-075334d1-8ffc-4f38-b1ce-c239cfb1d30d None admin] REQUEST_METHOD: `GET` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:42:24.953258 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-075334d1-8ffc-4f38-b1ce-c239cfb1d30d None admin] SCRIPT_NAME: `/identity` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:42:24.954264 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-075334d1-8ffc-4f38-b1ce-c239cfb1d30d None admin] PATH_INFO: `/v3/roles/admin` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:42:24.964892 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-075334d1-8ffc-4f38-b1ce-c239cfb1d30d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=82025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 13 19:42:24.971172 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application [None req-075334d1-8ffc-4f38-b1ce-c239cfb1d30d None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 13 19:42:24.971172 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 19:42:24.971172 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 19:42:24.971172 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 19:42:24.971172 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 19:42:24.971172 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 19:42:24.971172 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 19:42:24.971172 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 19:42:24.971172 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 19:42:24.971172 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 19:42:24.971172 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 19:42:24.971172 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 19:42:24.971172 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 13 19:42:24.971172 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 13 19:42:24.971172 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 13 19:42:24.971172 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 13 19:42:24.972135 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 13 19:42:24.972135 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 13 19:42:24.972135 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 13 19:42:24.972135 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 13 19:42:24.972135 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 19:42:24.972135 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 19:42:24.972135 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 19:42:24.972135 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 19:42:24.972135 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 19:42:24.972135 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 19:42:24.972135 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 19:42:24.972135 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application with Lock( Sep 13 19:42:24.972135 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 19:42:24.972135 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application return self._enter() Sep 13 19:42:24.972135 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 19:42:24.972135 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 19:42:24.972994 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 19:42:24.972994 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application return self.creator() Sep 13 19:42:24.972994 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 19:42:24.972994 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application created_value = creator( Sep 13 19:42:24.972994 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 13 19:42:24.972994 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 13 19:42:24.972994 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 13 19:42:24.972994 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 13 19:42:24.972994 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 13 19:42:24.972994 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 13 19:42:24.972994 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 13 19:42:24.972994 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application Sep 13 19:42:24.972994 dv-cinder-828806-6-smb devstack@keystone.service[82025]: [pid: 82025|app: 0|req: 396/792] 10.222.0.33 () {56 vars in 1096 bytes} [Tue Sep 13 19:42:24 2022] GET /identity/v3/roles/admin => generated 83 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 13 19:42:24.978154 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-075334d1-8ffc-4f38-b1ce-c239cfb1d30d None admin] Authenticating user token {{(pid=82025) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:42:24.990217 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG dbcounter [-] [82025] Writing DB stats keystone:SELECT=100 {{(pid=82025) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:42:25.000230 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f67d002c-6411-4646-a9c6-906fa1759253 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57539b6a6f3b4d589f5f5e1d211cd6a0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:42:25.003207 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f67d002c-6411-4646-a9c6-906fa1759253 None admin] REQUEST_METHOD: `GET` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:42:25.003207 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f67d002c-6411-4646-a9c6-906fa1759253 None admin] SCRIPT_NAME: `/identity` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:42:25.003207 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f67d002c-6411-4646-a9c6-906fa1759253 None admin] PATH_INFO: `/v3/domains` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:42:25.003207 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f67d002c-6411-4646-a9c6-906fa1759253 None admin] RBAC: Adding query filter params (name=Default) {{(pid=82026) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 19:42:25.003207 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f67d002c-6411-4646-a9c6-906fa1759253 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:42:25.004060 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f67d002c-6411-4646-a9c6-906fa1759253 None admin] RBAC: Authorization granted {{(pid=82026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:42:25.028534 dv-cinder-828806-6-smb devstack@keystone.service[82026]: [pid: 82026|app: 0|req: 397/793] 10.222.0.33 () {56 vars in 1109 bytes} [Tue Sep 13 19:42:24 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 300 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 19:42:25.034798 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f67d002c-6411-4646-a9c6-906fa1759253 None admin] Authenticating user token {{(pid=82026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:42:25.058685 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG dbcounter [-] [82026] Writing DB stats keystone:SELECT=100 {{(pid=82026) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:42:25.088235 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-075334d1-8ffc-4f38-b1ce-c239cfb1d30d None admin] Validating token access rules against request {{(pid=82025) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:42:25.130624 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfc2484c-d8fa-4303-9ff5-fbb9bc7840b2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57539b6a6f3b4d589f5f5e1d211cd6a0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82025) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:42:25.132121 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfc2484c-d8fa-4303-9ff5-fbb9bc7840b2 None admin] REQUEST_METHOD: `GET` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:42:25.133336 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfc2484c-d8fa-4303-9ff5-fbb9bc7840b2 None admin] SCRIPT_NAME: `/identity` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:42:25.133882 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfc2484c-d8fa-4303-9ff5-fbb9bc7840b2 None admin] PATH_INFO: `/v3/roles` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:42:25.134895 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfc2484c-d8fa-4303-9ff5-fbb9bc7840b2 None admin] RBAC: Adding query filter params (name=admin) {{(pid=82025) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 19:42:25.136207 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfc2484c-d8fa-4303-9ff5-fbb9bc7840b2 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:42:25.138428 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfc2484c-d8fa-4303-9ff5-fbb9bc7840b2 None admin] RBAC: Authorization granted {{(pid=82025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:42:25.156172 dv-cinder-828806-6-smb devstack@keystone.service[82025]: [pid: 82025|app: 0|req: 397/794] 10.222.0.33 () {56 vars in 1099 bytes} [Tue Sep 13 19:42:24 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 13 19:42:25.171700 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfc2484c-d8fa-4303-9ff5-fbb9bc7840b2 None admin] Authenticating user token {{(pid=82025) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:42:25.210522 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f67d002c-6411-4646-a9c6-906fa1759253 None admin] Validating token access rules against request {{(pid=82026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:42:25.255335 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03eebf16-9aed-460b-8d14-688279a47801 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57539b6a6f3b4d589f5f5e1d211cd6a0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:42:25.255912 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03eebf16-9aed-460b-8d14-688279a47801 None admin] REQUEST_METHOD: `GET` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:42:25.256198 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03eebf16-9aed-460b-8d14-688279a47801 None admin] SCRIPT_NAME: `/identity` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:42:25.256477 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03eebf16-9aed-460b-8d14-688279a47801 None admin] PATH_INFO: `/v3/projects/service` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:42:25.262826 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG dbcounter [-] [82025] Writing DB stats keystone:SELECT=100 {{(pid=82025) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:42:25.272692 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03eebf16-9aed-460b-8d14-688279a47801 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=82026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:42:25.277753 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03eebf16-9aed-460b-8d14-688279a47801 None admin] RBAC: Authorization granted {{(pid=82026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:42:25.295320 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application [None req-03eebf16-9aed-460b-8d14-688279a47801 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 13 19:42:25.295320 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 19:42:25.295320 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 19:42:25.295320 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 19:42:25.295320 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 19:42:25.295320 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 19:42:25.295320 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 19:42:25.295320 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 19:42:25.295320 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 19:42:25.295320 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 19:42:25.295320 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 19:42:25.295320 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 19:42:25.295320 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 13 19:42:25.295320 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 13 19:42:25.295320 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 13 19:42:25.296230 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 13 19:42:25.296230 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 19:42:25.296230 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 19:42:25.296230 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 19:42:25.296230 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 19:42:25.296230 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 19:42:25.296230 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 19:42:25.296230 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 19:42:25.296230 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application with Lock( Sep 13 19:42:25.296230 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 19:42:25.296230 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application return self._enter() Sep 13 19:42:25.296230 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 19:42:25.296230 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 19:42:25.296230 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 19:42:25.296230 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application return self.creator() Sep 13 19:42:25.296230 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 19:42:25.296230 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application created_value = creator( Sep 13 19:42:25.297802 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 13 19:42:25.297802 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 13 19:42:25.297802 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 13 19:42:25.297802 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 13 19:42:25.297802 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 13 19:42:25.297802 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 13 19:42:25.297802 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 13 19:42:25.297802 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application Sep 13 19:42:25.297802 dv-cinder-828806-6-smb devstack@keystone.service[82026]: [pid: 82026|app: 0|req: 398/795] 10.222.0.33 () {56 vars in 1111 bytes} [Tue Sep 13 19:42:25 2022] GET /identity/v3/projects/service => generated 88 bytes in 262 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 13 19:42:25.304267 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03eebf16-9aed-460b-8d14-688279a47801 None admin] Authenticating user token {{(pid=82026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:42:25.306046 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfc2484c-d8fa-4303-9ff5-fbb9bc7840b2 None admin] Validating token access rules against request {{(pid=82025) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:42:25.345090 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afd430b6-3a38-47f6-beff-98ce30275c96 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57539b6a6f3b4d589f5f5e1d211cd6a0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82025) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:42:25.346174 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afd430b6-3a38-47f6-beff-98ce30275c96 None admin] REQUEST_METHOD: `GET` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:42:25.346660 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afd430b6-3a38-47f6-beff-98ce30275c96 None admin] SCRIPT_NAME: `/identity` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:42:25.347205 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afd430b6-3a38-47f6-beff-98ce30275c96 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:42:25.359299 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afd430b6-3a38-47f6-beff-98ce30275c96 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=82025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:42:25.361786 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afd430b6-3a38-47f6-beff-98ce30275c96 None admin] RBAC: Authorization granted {{(pid=82025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:42:25.378437 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application [None req-afd430b6-3a38-47f6-beff-98ce30275c96 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 13 19:42:25.378437 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 19:42:25.378437 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 19:42:25.378437 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 19:42:25.378437 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 19:42:25.378437 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 19:42:25.378437 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 19:42:25.378437 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 19:42:25.378437 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 19:42:25.378437 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 19:42:25.378437 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 19:42:25.378437 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 19:42:25.378437 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 13 19:42:25.378437 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 13 19:42:25.378437 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 13 19:42:25.378437 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 13 19:42:25.379482 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 19:42:25.379482 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 19:42:25.379482 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 19:42:25.379482 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 19:42:25.379482 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 19:42:25.379482 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 19:42:25.379482 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 19:42:25.379482 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application with Lock( Sep 13 19:42:25.379482 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 19:42:25.379482 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application return self._enter() Sep 13 19:42:25.379482 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 19:42:25.379482 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 19:42:25.379482 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 19:42:25.379482 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application return self.creator() Sep 13 19:42:25.379482 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 19:42:25.379482 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application created_value = creator( Sep 13 19:42:25.379482 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 13 19:42:25.380385 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 13 19:42:25.380385 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 13 19:42:25.380385 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application Sep 13 19:42:25.381277 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG dbcounter [-] [82026] Writing DB stats keystone:SELECT=100 {{(pid=82026) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:42:25.383743 dv-cinder-828806-6-smb devstack@keystone.service[82025]: [pid: 82025|app: 0|req: 398/796] 10.222.0.33 () {56 vars in 1108 bytes} [Tue Sep 13 19:42:25 2022] GET /identity/v3/domains/Default => generated 87 bytes in 214 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 13 19:42:25.389533 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fe4e349-9ecc-4388-8129-c205ad551d4a None None] REQUEST_METHOD: `GET` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:42:25.390191 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fe4e349-9ecc-4388-8129-c205ad551d4a None None] SCRIPT_NAME: `/identity` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:42:25.390645 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fe4e349-9ecc-4388-8129-c205ad551d4a None None] PATH_INFO: `/` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:42:25.393223 dv-cinder-828806-6-smb devstack@keystone.service[82025]: [pid: 82025|app: 0|req: 399/797] 10.222.0.33 () {54 vars in 927 bytes} [Tue Sep 13 19:42:25 2022] GET /identity => generated 270 bytes in 9 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 19:42:25.394168 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fe4e349-9ecc-4388-8129-c205ad551d4a None None] Authenticating user token {{(pid=82025) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:42:25.415370 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03eebf16-9aed-460b-8d14-688279a47801 None admin] Validating token access rules against request {{(pid=82026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:42:25.450998 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe83b4a9-d452-4a1a-a406-b8a689cadeff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57539b6a6f3b4d589f5f5e1d211cd6a0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:42:25.451641 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe83b4a9-d452-4a1a-a406-b8a689cadeff None admin] REQUEST_METHOD: `GET` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:42:25.451927 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe83b4a9-d452-4a1a-a406-b8a689cadeff None admin] SCRIPT_NAME: `/identity` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:42:25.452206 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe83b4a9-d452-4a1a-a406-b8a689cadeff None admin] PATH_INFO: `/v3/projects` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:42:25.453349 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe83b4a9-d452-4a1a-a406-b8a689cadeff None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=82026) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 19:42:25.454296 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe83b4a9-d452-4a1a-a406-b8a689cadeff None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=82026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:42:25.456198 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe83b4a9-d452-4a1a-a406-b8a689cadeff None admin] RBAC: Authorization granted {{(pid=82026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:42:25.468482 dv-cinder-828806-6-smb devstack@keystone.service[82026]: [pid: 82026|app: 0|req: 399/798] 10.222.0.33 () {56 vars in 1148 bytes} [Tue Sep 13 19:42:25 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 19:42:25.469753 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4df310cf-a22a-4b41-84b1-e4e0f5d4f015 None None] REQUEST_METHOD: `POST` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:42:25.470220 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4df310cf-a22a-4b41-84b1-e4e0f5d4f015 None None] SCRIPT_NAME: `/identity` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:42:25.470502 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4df310cf-a22a-4b41-84b1-e4e0f5d4f015 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:42:25.488812 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.auth.core [None req-4df310cf-a22a-4b41-84b1-e4e0f5d4f015 None None] MFA Rules not processed for user `57539b6a6f3b4d589f5f5e1d211cd6a0`. Rule list: `[]` (Enabled: `True`). {{(pid=82026) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 19:42:25.490002 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.common.fernet_utils [None req-4df310cf-a22a-4b41-84b1-e4e0f5d4f015 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82026) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 19:42:25.511589 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fe4e349-9ecc-4388-8129-c205ad551d4a None None] Validating token access rules against request {{(pid=82025) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:42:25.535773 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG dbcounter [-] [82025] Writing DB stats keystone:SELECT=100 {{(pid=82025) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:42:25.547579 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2b39756-6404-4048-b375-425ec8b26105 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57539b6a6f3b4d589f5f5e1d211cd6a0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82025) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:42:25.548334 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2b39756-6404-4048-b375-425ec8b26105 None admin] REQUEST_METHOD: `GET` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:42:25.548714 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2b39756-6404-4048-b375-425ec8b26105 None admin] SCRIPT_NAME: `/identity` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:42:25.548813 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2b39756-6404-4048-b375-425ec8b26105 None admin] PATH_INFO: `/v3/domains` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:42:25.549463 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2b39756-6404-4048-b375-425ec8b26105 None admin] RBAC: Adding query filter params (name=Default) {{(pid=82025) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 19:42:25.549771 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2b39756-6404-4048-b375-425ec8b26105 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:42:25.551404 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2b39756-6404-4048-b375-425ec8b26105 None admin] RBAC: Authorization granted {{(pid=82025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:42:25.571188 dv-cinder-828806-6-smb devstack@keystone.service[82026]: [pid: 82026|app: 0|req: 400/799] 10.222.0.33 () {58 vars in 1024 bytes} [Tue Sep 13 19:42:25 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 13 19:42:25.571188 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8d9b880-9d5a-4e30-b618-1b6f01c172f9 None None] REQUEST_METHOD: `GET` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:42:25.571188 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8d9b880-9d5a-4e30-b618-1b6f01c172f9 None None] SCRIPT_NAME: `/identity` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:42:25.571188 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8d9b880-9d5a-4e30-b618-1b6f01c172f9 None None] PATH_INFO: `/` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:42:25.571188 dv-cinder-828806-6-smb devstack@keystone.service[82026]: [pid: 82026|app: 0|req: 401/800] 10.222.0.33 () {54 vars in 927 bytes} [Tue Sep 13 19:42:25 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 19:42:25.571188 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8d9b880-9d5a-4e30-b618-1b6f01c172f9 None None] Authenticating user token {{(pid=82026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:42:25.579798 dv-cinder-828806-6-smb devstack@keystone.service[82025]: [pid: 82025|app: 0|req: 400/801] 10.222.0.33 () {56 vars in 1109 bytes} [Tue Sep 13 19:42:25 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 19:42:25.581148 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ecdd35a-beb7-43f3-8b57-f37e18ec0b4c None None] REQUEST_METHOD: `POST` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:42:25.581440 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ecdd35a-beb7-43f3-8b57-f37e18ec0b4c None None] SCRIPT_NAME: `/identity` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:42:25.581717 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ecdd35a-beb7-43f3-8b57-f37e18ec0b4c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:42:25.606199 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.auth.core [None req-7ecdd35a-beb7-43f3-8b57-f37e18ec0b4c None None] MFA Rules not processed for user `57539b6a6f3b4d589f5f5e1d211cd6a0`. Rule list: `[]` (Enabled: `True`). {{(pid=82025) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 19:42:25.607507 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.fernet_utils [None req-7ecdd35a-beb7-43f3-8b57-f37e18ec0b4c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82025) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 19:42:25.645941 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG dbcounter [-] [82026] Writing DB stats keystone:SELECT=100 {{(pid=82026) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:42:25.699074 dv-cinder-828806-6-smb devstack@keystone.service[82025]: [pid: 82025|app: 0|req: 401/802] 10.222.0.33 () {58 vars in 1024 bytes} [Tue Sep 13 19:42:25 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 13 19:42:25.699074 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ecdd35a-beb7-43f3-8b57-f37e18ec0b4c None None] Authenticating user token {{(pid=82025) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:42:25.704448 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8d9b880-9d5a-4e30-b618-1b6f01c172f9 None None] Validating token access rules against request {{(pid=82026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:42:25.775828 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dcbb4c3-ab6e-492b-b725-7868f3ff3944 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57539b6a6f3b4d589f5f5e1d211cd6a0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:42:25.777231 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dcbb4c3-ab6e-492b-b725-7868f3ff3944 None admin] REQUEST_METHOD: `PUT` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:42:25.777709 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dcbb4c3-ab6e-492b-b725-7868f3ff3944 None admin] SCRIPT_NAME: `/identity` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:42:25.778210 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dcbb4c3-ab6e-492b-b725-7868f3ff3944 None admin] PATH_INFO: `/v3/projects/c8c6fba0f15b4d6a84ff601919b7b8e4/users/fa5a83574f7f424c805e130c462d5969/roles/e5af7d5baa93469e9e486ef21c85474e` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:42:25.785819 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dcbb4c3-ab6e-492b-b725-7868f3ff3944 None admin] RBAC: Authorizing `identity:create_grant(project_id=c8c6fba0f15b4d6a84ff601919b7b8e4, user_id=fa5a83574f7f424c805e130c462d5969, role_id=e5af7d5baa93469e9e486ef21c85474e)` {{(pid=82026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:42:25.787295 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dcbb4c3-ab6e-492b-b725-7868f3ff3944 None admin] RBAC: Authorization granted {{(pid=82026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:42:25.811576 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ecdd35a-beb7-43f3-8b57-f37e18ec0b4c None None] Validating token access rules against request {{(pid=82025) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:42:25.826598 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG dbcounter [-] [82025] Writing DB stats keystone:SELECT=100 {{(pid=82025) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:42:25.848890 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4d5cf35-63e3-440e-b245-07c76952c544 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57539b6a6f3b4d589f5f5e1d211cd6a0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82025) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:42:25.849534 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4d5cf35-63e3-440e-b245-07c76952c544 None admin] REQUEST_METHOD: `GET` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:42:25.849876 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4d5cf35-63e3-440e-b245-07c76952c544 None admin] SCRIPT_NAME: `/identity` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:42:25.850147 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4d5cf35-63e3-440e-b245-07c76952c544 None admin] PATH_INFO: `/v3/users/nova` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:42:25.857988 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4d5cf35-63e3-440e-b245-07c76952c544 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=82025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:42:25.859527 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4d5cf35-63e3-440e-b245-07c76952c544 None admin] RBAC: Authorization granted {{(pid=82025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:42:25.873789 dv-cinder-828806-6-smb devstack@keystone.service[82026]: [pid: 82026|app: 0|req: 402/803] 10.222.0.33 () {58 vars in 1439 bytes} [Tue Sep 13 19:42:25 2022] PUT /identity/v3/projects/c8c6fba0f15b4d6a84ff601919b7b8e4/users/fa5a83574f7f424c805e130c462d5969/roles/e5af7d5baa93469e9e486ef21c85474e => generated 0 bytes in 304 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 19:42:25.874684 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dcbb4c3-ab6e-492b-b725-7868f3ff3944 None admin] Authenticating user token {{(pid=82026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:42:25.880689 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application [None req-a4d5cf35-63e3-440e-b245-07c76952c544 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Sep 13 19:42:25.880689 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 19:42:25.880689 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 19:42:25.880689 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 19:42:25.880689 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 19:42:25.880689 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 19:42:25.880689 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 19:42:25.880689 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 19:42:25.880689 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 19:42:25.880689 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 19:42:25.880689 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 19:42:25.880689 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 19:42:25.880689 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 13 19:42:25.880689 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 13 19:42:25.880689 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 13 19:42:25.880689 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 13 19:42:25.885430 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 19:42:25.885430 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 19:42:25.885430 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 13 19:42:25.885430 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 13 19:42:25.885430 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 13 19:42:25.885430 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 13 19:42:25.885430 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 19:42:25.885430 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 19:42:25.885430 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 19:42:25.885430 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 19:42:25.885430 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 19:42:25.885430 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application with Lock( Sep 13 19:42:25.885430 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 19:42:25.885430 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application return self._enter() Sep 13 19:42:25.885430 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 19:42:25.885430 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 19:42:25.885430 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 19:42:25.885430 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application return self.creator() Sep 13 19:42:25.886455 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 19:42:25.886455 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application created_value = creator( Sep 13 19:42:25.886455 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 13 19:42:25.886455 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 13 19:42:25.886455 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 13 19:42:25.886455 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 13 19:42:25.886455 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 13 19:42:25.886455 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 13 19:42:25.886455 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Sep 13 19:42:25.886455 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application Sep 13 19:42:25.886455 dv-cinder-828806-6-smb devstack@keystone.service[82025]: [pid: 82025|app: 0|req: 402/804] 10.222.0.33 () {56 vars in 1093 bytes} [Tue Sep 13 19:42:25 2022] GET /identity/v3/users/nova => generated 82 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 19:42:25.894601 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4d5cf35-63e3-440e-b245-07c76952c544 None admin] Authenticating user token {{(pid=82025) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:42:26.064767 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4d5cf35-63e3-440e-b245-07c76952c544 None admin] Validating token access rules against request {{(pid=82025) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:42:26.074300 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dcbb4c3-ab6e-492b-b725-7868f3ff3944 None admin] Validating token access rules against request {{(pid=82026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:42:26.097694 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG dbcounter [-] [82026] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82026) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:42:26.104800 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb385157-3769-4850-81ab-fb161549fe5a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57539b6a6f3b4d589f5f5e1d211cd6a0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82025) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:42:26.107339 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb385157-3769-4850-81ab-fb161549fe5a None admin] REQUEST_METHOD: `GET` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:42:26.107339 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb385157-3769-4850-81ab-fb161549fe5a None admin] SCRIPT_NAME: `/identity` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:42:26.107339 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb385157-3769-4850-81ab-fb161549fe5a None admin] PATH_INFO: `/v3/users` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:42:26.107339 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb385157-3769-4850-81ab-fb161549fe5a None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=82025) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 19:42:26.107339 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb385157-3769-4850-81ab-fb161549fe5a None admin] RBAC: Authorizing `identity:list_users()` {{(pid=82025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:42:26.108346 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb385157-3769-4850-81ab-fb161549fe5a None admin] RBAC: Authorization granted {{(pid=82025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:42:26.117060 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57f8d846-5984-412b-a233-3ce47730e77c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57539b6a6f3b4d589f5f5e1d211cd6a0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:42:26.117367 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57f8d846-5984-412b-a233-3ce47730e77c None admin] REQUEST_METHOD: `GET` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:42:26.117693 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57f8d846-5984-412b-a233-3ce47730e77c None admin] SCRIPT_NAME: `/identity` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:42:26.118092 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57f8d846-5984-412b-a233-3ce47730e77c None admin] PATH_INFO: `/v3/roles/service` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:42:26.130639 dv-cinder-828806-6-smb devstack@keystone.service[82025]: [pid: 82025|app: 0|req: 403/805] 10.222.0.33 () {56 vars in 1133 bytes} [Tue Sep 13 19:42:25 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 237 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 13 19:42:26.130945 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57f8d846-5984-412b-a233-3ce47730e77c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=82026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 13 19:42:26.135911 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb385157-3769-4850-81ab-fb161549fe5a None admin] Authenticating user token {{(pid=82025) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:42:26.136036 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application [None req-57f8d846-5984-412b-a233-3ce47730e77c None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 13 19:42:26.136036 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 19:42:26.136036 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 19:42:26.136036 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 19:42:26.136036 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 19:42:26.136036 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 19:42:26.136036 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 19:42:26.136036 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 19:42:26.136036 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 19:42:26.136036 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 19:42:26.136036 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 19:42:26.136036 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 19:42:26.136036 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 13 19:42:26.136036 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 13 19:42:26.136036 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 13 19:42:26.136036 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 13 19:42:26.136931 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 13 19:42:26.136931 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 13 19:42:26.136931 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 13 19:42:26.136931 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 13 19:42:26.136931 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 19:42:26.136931 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 19:42:26.136931 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 19:42:26.136931 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 19:42:26.136931 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 19:42:26.136931 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 19:42:26.136931 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 19:42:26.136931 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application with Lock( Sep 13 19:42:26.136931 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 19:42:26.136931 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application return self._enter() Sep 13 19:42:26.136931 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 19:42:26.136931 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 19:42:26.137972 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 19:42:26.137972 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application return self.creator() Sep 13 19:42:26.137972 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 19:42:26.137972 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application created_value = creator( Sep 13 19:42:26.137972 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 13 19:42:26.137972 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 13 19:42:26.137972 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 13 19:42:26.137972 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 13 19:42:26.137972 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 13 19:42:26.137972 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 13 19:42:26.137972 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 13 19:42:26.137972 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application Sep 13 19:42:26.137972 dv-cinder-828806-6-smb devstack@keystone.service[82026]: [pid: 82026|app: 0|req: 403/806] 10.222.0.33 () {56 vars in 1102 bytes} [Tue Sep 13 19:42:25 2022] GET /identity/v3/roles/service => generated 85 bytes in 263 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 19:42:26.138903 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a51d6b40-9ee8-4348-ba9c-04bcabad826e None None] REQUEST_METHOD: `GET` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:42:26.139788 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a51d6b40-9ee8-4348-ba9c-04bcabad826e None None] SCRIPT_NAME: `/identity` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:42:26.139788 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a51d6b40-9ee8-4348-ba9c-04bcabad826e None None] PATH_INFO: `/` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:42:26.141220 dv-cinder-828806-6-smb devstack@keystone.service[82026]: [pid: 82026|app: 0|req: 404/807] 10.222.0.33 () {54 vars in 927 bytes} [Tue Sep 13 19:42:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 19:42:26.141947 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a51d6b40-9ee8-4348-ba9c-04bcabad826e None None] Authenticating user token {{(pid=82026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:42:26.168032 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG dbcounter [-] [82025] Writing DB stats keystone:SELECT=100 {{(pid=82025) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:42:26.244643 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb385157-3769-4850-81ab-fb161549fe5a None admin] Validating token access rules against request {{(pid=82025) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:42:26.248555 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a51d6b40-9ee8-4348-ba9c-04bcabad826e None None] Validating token access rules against request {{(pid=82026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:42:26.282254 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1731c0fe-bfc8-4de5-a3e6-66ef2a8c7a90 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57539b6a6f3b4d589f5f5e1d211cd6a0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82025) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:42:26.283501 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1731c0fe-bfc8-4de5-a3e6-66ef2a8c7a90 None admin] REQUEST_METHOD: `GET` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:42:26.283967 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1731c0fe-bfc8-4de5-a3e6-66ef2a8c7a90 None admin] SCRIPT_NAME: `/identity` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:42:26.284350 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1731c0fe-bfc8-4de5-a3e6-66ef2a8c7a90 None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:42:26.285102 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1731c0fe-bfc8-4de5-a3e6-66ef2a8c7a90 None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=82025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:42:26.286558 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1731c0fe-bfc8-4de5-a3e6-66ef2a8c7a90 None admin] RBAC: Authorization granted {{(pid=82025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:42:26.287345 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfe1479c-353c-47a2-b282-08fb6318b33b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57539b6a6f3b4d589f5f5e1d211cd6a0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:42:26.288333 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfe1479c-353c-47a2-b282-08fb6318b33b None admin] REQUEST_METHOD: `GET` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:42:26.289070 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfe1479c-353c-47a2-b282-08fb6318b33b None admin] SCRIPT_NAME: `/identity` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:42:26.289986 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfe1479c-353c-47a2-b282-08fb6318b33b None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:42:26.296010 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application [None req-1731c0fe-bfc8-4de5-a3e6-66ef2a8c7a90 None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Sep 13 19:42:26.296010 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 19:42:26.296010 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 13 19:42:26.296010 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 13 19:42:26.296010 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 13 19:42:26.296010 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 13 19:42:26.296010 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 13 19:42:26.296010 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 13 19:42:26.296010 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Sep 13 19:42:26.296010 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application Sep 13 19:42:26.296010 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 13 19:42:26.296010 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application Sep 13 19:42:26.296010 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 19:42:26.296010 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 19:42:26.296010 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 19:42:26.296010 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 19:42:26.296010 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 19:42:26.297162 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 19:42:26.297162 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 19:42:26.297162 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 19:42:26.297162 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 19:42:26.297162 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 19:42:26.297162 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 19:42:26.297162 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 13 19:42:26.297162 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 13 19:42:26.297162 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 13 19:42:26.297162 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 13 19:42:26.297162 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 19:42:26.297162 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 19:42:26.297162 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 19:42:26.297162 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 19:42:26.297162 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 19:42:26.297162 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 19:42:26.298802 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 19:42:26.298802 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application with Lock( Sep 13 19:42:26.298802 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 19:42:26.298802 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application return self._enter() Sep 13 19:42:26.298802 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 19:42:26.298802 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 19:42:26.298802 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 19:42:26.298802 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application return self.creator() Sep 13 19:42:26.298802 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 19:42:26.298802 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application created_value = creator( Sep 13 19:42:26.298802 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 13 19:42:26.298802 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 13 19:42:26.298802 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Sep 13 19:42:26.298802 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application Sep 13 19:42:26.298802 dv-cinder-828806-6-smb devstack@keystone.service[82025]: [pid: 82025|app: 0|req: 404/808] 10.222.0.33 () {56 vars in 1129 bytes} [Tue Sep 13 19:42:26 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 19:42:26.299639 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1731c0fe-bfc8-4de5-a3e6-66ef2a8c7a90 None admin] Authenticating user token {{(pid=82025) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:42:26.349903 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG dbcounter [-] [82026] Writing DB stats keystone:SELECT=100 {{(pid=82026) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:42:26.376298 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfe1479c-353c-47a2-b282-08fb6318b33b None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=82026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:42:26.379487 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfe1479c-353c-47a2-b282-08fb6318b33b None admin] RBAC: Authorization granted {{(pid=82026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:42:26.402468 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG dbcounter [-] [82025] Writing DB stats keystone:SELECT=100 {{(pid=82025) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:42:26.409714 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1731c0fe-bfc8-4de5-a3e6-66ef2a8c7a90 None admin] Validating token access rules against request {{(pid=82025) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:42:26.447905 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a28e244-96b2-4d66-9e4e-b88c413a4123 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57539b6a6f3b4d589f5f5e1d211cd6a0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82025) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:42:26.448812 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a28e244-96b2-4d66-9e4e-b88c413a4123 None admin] REQUEST_METHOD: `GET` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:42:26.449270 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a28e244-96b2-4d66-9e4e-b88c413a4123 None admin] SCRIPT_NAME: `/identity` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:42:26.449719 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a28e244-96b2-4d66-9e4e-b88c413a4123 None admin] PATH_INFO: `/v3/roles` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:42:26.450549 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a28e244-96b2-4d66-9e4e-b88c413a4123 None admin] RBAC: Adding query filter params (name=service) {{(pid=82025) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 19:42:26.451016 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a28e244-96b2-4d66-9e4e-b88c413a4123 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:42:26.452397 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a28e244-96b2-4d66-9e4e-b88c413a4123 None admin] RBAC: Authorization granted {{(pid=82025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:42:26.465853 dv-cinder-828806-6-smb devstack@keystone.service[82025]: [pid: 82025|app: 0|req: 405/809] 10.222.0.33 () {56 vars in 1103 bytes} [Tue Sep 13 19:42:26 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 19:42:26.465853 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b93b2327-d9fc-4200-89bd-a3243344c40d None None] REQUEST_METHOD: `POST` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:42:26.465853 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b93b2327-d9fc-4200-89bd-a3243344c40d None None] SCRIPT_NAME: `/identity` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:42:26.465853 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b93b2327-d9fc-4200-89bd-a3243344c40d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:42:26.490250 dv-cinder-828806-6-smb devstack@keystone.service[82026]: [pid: 82026|app: 0|req: 405/810] 10.222.0.33 () {58 vars in 1282 bytes} [Tue Sep 13 19:42:26 2022] GET /identity/v3/auth/tokens => generated 1002 bytes in 344 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Sep 13 19:42:26.490250 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfe1479c-353c-47a2-b282-08fb6318b33b None admin] Authenticating user token {{(pid=82026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:42:26.490514 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.auth.core [None req-b93b2327-d9fc-4200-89bd-a3243344c40d None None] MFA Rules not processed for user `57539b6a6f3b4d589f5f5e1d211cd6a0`. Rule list: `[]` (Enabled: `True`). {{(pid=82025) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 19:42:26.490514 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.fernet_utils [None req-b93b2327-d9fc-4200-89bd-a3243344c40d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82025) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 19:42:26.561561 dv-cinder-828806-6-smb devstack@keystone.service[82025]: [pid: 82025|app: 0|req: 406/811] 10.222.0.33 () {58 vars in 1024 bytes} [Tue Sep 13 19:42:26 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 13 19:42:26.562790 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b93b2327-d9fc-4200-89bd-a3243344c40d None None] Authenticating user token {{(pid=82025) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:42:26.577938 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG dbcounter [-] [82026] Writing DB stats keystone:SELECT=100 {{(pid=82026) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:42:26.591149 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfe1479c-353c-47a2-b282-08fb6318b33b None admin] Validating token access rules against request {{(pid=82026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:42:26.632890 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91d6aea3-1988-41e8-b8bf-31e74a787421 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57539b6a6f3b4d589f5f5e1d211cd6a0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:42:26.633638 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91d6aea3-1988-41e8-b8bf-31e74a787421 None admin] REQUEST_METHOD: `GET` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:42:26.634200 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91d6aea3-1988-41e8-b8bf-31e74a787421 None admin] SCRIPT_NAME: `/identity` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:42:26.634571 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91d6aea3-1988-41e8-b8bf-31e74a787421 None admin] PATH_INFO: `/v3/services` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:42:26.635601 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91d6aea3-1988-41e8-b8bf-31e74a787421 None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=82026) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 19:42:26.636233 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91d6aea3-1988-41e8-b8bf-31e74a787421 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=82026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:42:26.638139 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91d6aea3-1988-41e8-b8bf-31e74a787421 None admin] RBAC: Authorization granted {{(pid=82026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:42:26.647195 dv-cinder-828806-6-smb devstack@keystone.service[82026]: [pid: 82026|app: 0|req: 406/812] 10.222.0.33 () {56 vars in 1124 bytes} [Tue Sep 13 19:42:26 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 19:42:26.648034 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91d6aea3-1988-41e8-b8bf-31e74a787421 None admin] Authenticating user token {{(pid=82026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:42:26.675526 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG dbcounter [-] [82025] Writing DB stats keystone:SELECT=100 {{(pid=82025) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:42:26.695375 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b93b2327-d9fc-4200-89bd-a3243344c40d None None] Validating token access rules against request {{(pid=82025) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:42:26.737124 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b536044-10d5-4264-b3c1-3d08ad3a17d4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57539b6a6f3b4d589f5f5e1d211cd6a0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82025) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:42:26.737864 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b536044-10d5-4264-b3c1-3d08ad3a17d4 None admin] REQUEST_METHOD: `GET` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:42:26.738222 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b536044-10d5-4264-b3c1-3d08ad3a17d4 None admin] SCRIPT_NAME: `/identity` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:42:26.738567 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b536044-10d5-4264-b3c1-3d08ad3a17d4 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:42:26.750823 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b536044-10d5-4264-b3c1-3d08ad3a17d4 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=82025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:42:26.752663 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b536044-10d5-4264-b3c1-3d08ad3a17d4 None admin] RBAC: Authorization granted {{(pid=82025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:42:26.767708 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91d6aea3-1988-41e8-b8bf-31e74a787421 None admin] Validating token access rules against request {{(pid=82026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:42:26.770819 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application [None req-4b536044-10d5-4264-b3c1-3d08ad3a17d4 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 13 19:42:26.770819 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 19:42:26.770819 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 19:42:26.770819 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 19:42:26.770819 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 19:42:26.770819 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 19:42:26.770819 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 19:42:26.770819 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 19:42:26.770819 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 19:42:26.770819 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 19:42:26.770819 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 19:42:26.770819 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 19:42:26.770819 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 13 19:42:26.770819 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 13 19:42:26.770819 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 13 19:42:26.770819 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 13 19:42:26.772001 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 19:42:26.772001 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 19:42:26.772001 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 19:42:26.772001 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 19:42:26.772001 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 19:42:26.772001 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 19:42:26.772001 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 19:42:26.772001 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application with Lock( Sep 13 19:42:26.772001 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 19:42:26.772001 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application return self._enter() Sep 13 19:42:26.772001 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 19:42:26.772001 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 19:42:26.772001 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 19:42:26.772001 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application return self.creator() Sep 13 19:42:26.772001 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 19:42:26.772001 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application created_value = creator( Sep 13 19:42:26.772001 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 13 19:42:26.773107 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 13 19:42:26.773107 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 13 19:42:26.773107 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application Sep 13 19:42:26.777911 dv-cinder-828806-6-smb devstack@keystone.service[82025]: [pid: 82025|app: 0|req: 407/813] 10.222.0.33 () {56 vars in 1108 bytes} [Tue Sep 13 19:42:26 2022] GET /identity/v3/domains/Default => generated 87 bytes in 215 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 19:42:26.778856 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b536044-10d5-4264-b3c1-3d08ad3a17d4 None admin] Authenticating user token {{(pid=82025) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:42:26.808744 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e061307-95a5-425a-9d1c-5cd8acbafc70 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57539b6a6f3b4d589f5f5e1d211cd6a0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:42:26.810050 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e061307-95a5-425a-9d1c-5cd8acbafc70 None admin] REQUEST_METHOD: `GET` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:42:26.810526 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e061307-95a5-425a-9d1c-5cd8acbafc70 None admin] SCRIPT_NAME: `/identity` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:42:26.810969 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e061307-95a5-425a-9d1c-5cd8acbafc70 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:42:26.822454 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e061307-95a5-425a-9d1c-5cd8acbafc70 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=82026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:42:26.824298 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e061307-95a5-425a-9d1c-5cd8acbafc70 None admin] RBAC: Authorization granted {{(pid=82026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:42:26.827783 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG dbcounter [-] [82026] Writing DB stats keystone:SELECT=100 {{(pid=82026) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:42:26.842405 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application [None req-2e061307-95a5-425a-9d1c-5cd8acbafc70 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 13 19:42:26.842405 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 19:42:26.842405 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 19:42:26.842405 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 19:42:26.842405 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 19:42:26.842405 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 19:42:26.842405 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 19:42:26.842405 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 19:42:26.842405 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 19:42:26.842405 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 19:42:26.842405 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 19:42:26.842405 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 19:42:26.842405 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 13 19:42:26.842405 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 13 19:42:26.842405 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 13 19:42:26.842405 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 13 19:42:26.846022 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 19:42:26.846022 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 19:42:26.846022 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 19:42:26.846022 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 19:42:26.846022 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 19:42:26.846022 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 19:42:26.846022 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 19:42:26.846022 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application with Lock( Sep 13 19:42:26.846022 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 19:42:26.846022 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application return self._enter() Sep 13 19:42:26.846022 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 19:42:26.846022 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 19:42:26.846022 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 19:42:26.846022 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application return self.creator() Sep 13 19:42:26.846022 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 19:42:26.846022 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application created_value = creator( Sep 13 19:42:26.846022 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 13 19:42:26.847127 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 13 19:42:26.847127 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 13 19:42:26.847127 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application Sep 13 19:42:26.847670 dv-cinder-828806-6-smb devstack@keystone.service[82026]: [pid: 82026|app: 0|req: 407/814] 10.222.0.33 () {56 vars in 1108 bytes} [Tue Sep 13 19:42:26 2022] GET /identity/v3/domains/Default => generated 87 bytes in 200 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 19:42:26.848800 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e061307-95a5-425a-9d1c-5cd8acbafc70 None admin] Authenticating user token {{(pid=82026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:42:26.898315 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b536044-10d5-4264-b3c1-3d08ad3a17d4 None admin] Validating token access rules against request {{(pid=82025) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:42:26.932010 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4df87006-c495-415a-9c47-56579597c3f9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57539b6a6f3b4d589f5f5e1d211cd6a0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82025) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:42:26.932613 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4df87006-c495-415a-9c47-56579597c3f9 None admin] REQUEST_METHOD: `GET` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:42:26.932890 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4df87006-c495-415a-9c47-56579597c3f9 None admin] SCRIPT_NAME: `/identity` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:42:26.933161 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4df87006-c495-415a-9c47-56579597c3f9 None admin] PATH_INFO: `/v3/services` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:42:26.933786 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4df87006-c495-415a-9c47-56579597c3f9 None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=82025) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 19:42:26.934091 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4df87006-c495-415a-9c47-56579597c3f9 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=82025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:42:26.935480 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4df87006-c495-415a-9c47-56579597c3f9 None admin] RBAC: Authorization granted {{(pid=82025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:42:26.941241 dv-cinder-828806-6-smb devstack@keystone.service[82025]: [pid: 82025|app: 0|req: 408/815] 10.222.0.33 () {56 vars in 1124 bytes} [Tue Sep 13 19:42:26 2022] GET /identity/v3/services?type=block-storage => generated 367 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 19:42:26.942007 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4df87006-c495-415a-9c47-56579597c3f9 None admin] Authenticating user token {{(pid=82025) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:42:26.944456 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG dbcounter [-] [82025] Writing DB stats keystone:SELECT=100 {{(pid=82025) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:42:26.958536 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e061307-95a5-425a-9d1c-5cd8acbafc70 None admin] Validating token access rules against request {{(pid=82026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:42:26.994173 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f00e69d-7c1a-401f-b518-0604cdcacaa1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57539b6a6f3b4d589f5f5e1d211cd6a0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:42:26.994879 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f00e69d-7c1a-401f-b518-0604cdcacaa1 None admin] REQUEST_METHOD: `GET` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:42:26.995195 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f00e69d-7c1a-401f-b518-0604cdcacaa1 None admin] SCRIPT_NAME: `/identity` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:42:26.995476 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f00e69d-7c1a-401f-b518-0604cdcacaa1 None admin] PATH_INFO: `/v3/domains` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:42:26.996120 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f00e69d-7c1a-401f-b518-0604cdcacaa1 None admin] RBAC: Adding query filter params (name=Default) {{(pid=82026) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 19:42:26.996427 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f00e69d-7c1a-401f-b518-0604cdcacaa1 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:42:26.997792 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f00e69d-7c1a-401f-b518-0604cdcacaa1 None admin] RBAC: Authorization granted {{(pid=82026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:42:27.014042 dv-cinder-828806-6-smb devstack@keystone.service[82026]: [pid: 82026|app: 0|req: 408/816] 10.222.0.33 () {56 vars in 1109 bytes} [Tue Sep 13 19:42:26 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 19:42:27.014042 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f00e69d-7c1a-401f-b518-0604cdcacaa1 None admin] Authenticating user token {{(pid=82026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:42:27.056996 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4df87006-c495-415a-9c47-56579597c3f9 None admin] Validating token access rules against request {{(pid=82025) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:42:27.069985 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG dbcounter [-] [82026] Writing DB stats keystone:SELECT=100 {{(pid=82026) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:42:27.096235 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec888f4f-8d33-41d6-ab56-9d5ecd045156 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57539b6a6f3b4d589f5f5e1d211cd6a0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82025) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:42:27.096842 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec888f4f-8d33-41d6-ab56-9d5ecd045156 None admin] REQUEST_METHOD: `GET` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:42:27.097125 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec888f4f-8d33-41d6-ab56-9d5ecd045156 None admin] SCRIPT_NAME: `/identity` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:42:27.097403 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec888f4f-8d33-41d6-ab56-9d5ecd045156 None admin] PATH_INFO: `/v3/domains` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:42:27.098053 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec888f4f-8d33-41d6-ab56-9d5ecd045156 None admin] RBAC: Adding query filter params (name=Default) {{(pid=82025) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 19:42:27.098371 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec888f4f-8d33-41d6-ab56-9d5ecd045156 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:42:27.099761 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec888f4f-8d33-41d6-ab56-9d5ecd045156 None admin] RBAC: Authorization granted {{(pid=82025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:42:27.112484 dv-cinder-828806-6-smb devstack@keystone.service[82025]: [pid: 82025|app: 0|req: 409/817] 10.222.0.33 () {56 vars in 1109 bytes} [Tue Sep 13 19:42:26 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 19:42:27.113269 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec888f4f-8d33-41d6-ab56-9d5ecd045156 None admin] Authenticating user token {{(pid=82025) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:42:27.127981 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f00e69d-7c1a-401f-b518-0604cdcacaa1 None admin] Validating token access rules against request {{(pid=82026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:42:27.169526 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9e9725d-fc6d-47fb-aa9a-2220ba883d6b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57539b6a6f3b4d589f5f5e1d211cd6a0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:42:27.170083 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9e9725d-fc6d-47fb-aa9a-2220ba883d6b None admin] REQUEST_METHOD: `GET` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:42:27.170370 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9e9725d-fc6d-47fb-aa9a-2220ba883d6b None admin] SCRIPT_NAME: `/identity` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:42:27.170659 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9e9725d-fc6d-47fb-aa9a-2220ba883d6b None admin] PATH_INFO: `/v3/services/network` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:42:27.171365 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9e9725d-fc6d-47fb-aa9a-2220ba883d6b None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=82026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:42:27.172780 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9e9725d-fc6d-47fb-aa9a-2220ba883d6b None admin] RBAC: Authorization granted {{(pid=82026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:42:27.182535 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application [None req-a9e9725d-fc6d-47fb-aa9a-2220ba883d6b None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Sep 13 19:42:27.182535 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 19:42:27.182535 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 13 19:42:27.182535 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 13 19:42:27.182535 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 13 19:42:27.182535 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 13 19:42:27.182535 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 13 19:42:27.182535 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 13 19:42:27.182535 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Sep 13 19:42:27.182535 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application Sep 13 19:42:27.182535 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 13 19:42:27.182535 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application Sep 13 19:42:27.182535 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 19:42:27.182535 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 19:42:27.182535 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 19:42:27.182535 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 19:42:27.182535 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 19:42:27.183745 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 19:42:27.183745 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 19:42:27.183745 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 19:42:27.183745 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 19:42:27.183745 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 19:42:27.183745 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 19:42:27.183745 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 13 19:42:27.183745 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 13 19:42:27.183745 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 13 19:42:27.183745 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 13 19:42:27.183745 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 19:42:27.183745 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 19:42:27.183745 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 19:42:27.183745 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 19:42:27.183745 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 19:42:27.183745 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 19:42:27.184604 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 19:42:27.184604 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application with Lock( Sep 13 19:42:27.184604 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 19:42:27.184604 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application return self._enter() Sep 13 19:42:27.184604 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 19:42:27.184604 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 19:42:27.184604 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 19:42:27.184604 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application return self.creator() Sep 13 19:42:27.184604 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 19:42:27.184604 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application created_value = creator( Sep 13 19:42:27.184604 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 13 19:42:27.184604 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 13 19:42:27.184604 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Sep 13 19:42:27.184604 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application Sep 13 19:42:27.184604 dv-cinder-828806-6-smb devstack@keystone.service[82026]: [pid: 82026|app: 0|req: 409/818] 10.222.0.33 () {56 vars in 1111 bytes} [Tue Sep 13 19:42:27 2022] GET /identity/v3/services/network => generated 88 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 19:42:27.185405 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9e9725d-fc6d-47fb-aa9a-2220ba883d6b None admin] Authenticating user token {{(pid=82026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:42:27.192382 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG dbcounter [-] [82025] Writing DB stats keystone:SELECT=100 {{(pid=82025) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:42:27.239451 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec888f4f-8d33-41d6-ab56-9d5ecd045156 None admin] Validating token access rules against request {{(pid=82025) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:42:27.277486 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b5792e0-f2b7-44cd-b420-9d784340f033 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57539b6a6f3b4d589f5f5e1d211cd6a0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82025) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:42:27.278400 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b5792e0-f2b7-44cd-b420-9d784340f033 None admin] REQUEST_METHOD: `POST` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:42:27.278894 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b5792e0-f2b7-44cd-b420-9d784340f033 None admin] SCRIPT_NAME: `/identity` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:42:27.279398 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b5792e0-f2b7-44cd-b420-9d784340f033 None admin] PATH_INFO: `/v3/endpoints` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:42:27.280255 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b5792e0-f2b7-44cd-b420-9d784340f033 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=82025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:42:27.282391 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b5792e0-f2b7-44cd-b420-9d784340f033 None admin] RBAC: Authorization granted {{(pid=82025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:42:27.305564 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9e9725d-fc6d-47fb-aa9a-2220ba883d6b None admin] Validating token access rules against request {{(pid=82026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:42:27.324541 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG dbcounter [-] [82026] Writing DB stats keystone:SELECT=100 {{(pid=82026) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:42:27.338542 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dca4105f-ccb2-4de4-aad4-376d9e60a65e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57539b6a6f3b4d589f5f5e1d211cd6a0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:42:27.339209 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dca4105f-ccb2-4de4-aad4-376d9e60a65e None admin] REQUEST_METHOD: `GET` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:42:27.339501 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dca4105f-ccb2-4de4-aad4-376d9e60a65e None admin] SCRIPT_NAME: `/identity` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:42:27.339780 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dca4105f-ccb2-4de4-aad4-376d9e60a65e None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:42:27.347885 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dca4105f-ccb2-4de4-aad4-376d9e60a65e None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=82026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:42:27.349315 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dca4105f-ccb2-4de4-aad4-376d9e60a65e None admin] RBAC: Authorization granted {{(pid=82026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:42:27.360378 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application [None req-dca4105f-ccb2-4de4-aad4-376d9e60a65e None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Sep 13 19:42:27.360378 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 19:42:27.360378 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 19:42:27.360378 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 19:42:27.360378 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 19:42:27.360378 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 19:42:27.360378 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 19:42:27.360378 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 19:42:27.360378 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 19:42:27.360378 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 19:42:27.360378 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 19:42:27.360378 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 19:42:27.360378 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 13 19:42:27.360378 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 13 19:42:27.360378 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 13 19:42:27.360378 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 13 19:42:27.361391 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 19:42:27.361391 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 19:42:27.361391 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 13 19:42:27.361391 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 13 19:42:27.361391 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 13 19:42:27.361391 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 13 19:42:27.361391 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 19:42:27.361391 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 19:42:27.361391 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 19:42:27.361391 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 19:42:27.361391 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 19:42:27.361391 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application with Lock( Sep 13 19:42:27.361391 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 19:42:27.361391 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application return self._enter() Sep 13 19:42:27.361391 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 19:42:27.361391 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 19:42:27.361391 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 19:42:27.361391 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application return self.creator() Sep 13 19:42:27.362340 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 19:42:27.362340 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application created_value = creator( Sep 13 19:42:27.362340 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 13 19:42:27.362340 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 13 19:42:27.362340 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 13 19:42:27.362340 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 13 19:42:27.362340 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 13 19:42:27.362340 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 13 19:42:27.362340 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Sep 13 19:42:27.362340 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application Sep 13 19:42:27.362340 dv-cinder-828806-6-smb devstack@keystone.service[82026]: [pid: 82026|app: 0|req: 410/819] 10.222.0.33 () {56 vars in 1117 bytes} [Tue Sep 13 19:42:27 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 19:42:27.362340 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dca4105f-ccb2-4de4-aad4-376d9e60a65e None admin] Authenticating user token {{(pid=82026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:42:27.404983 dv-cinder-828806-6-smb devstack@keystone.service[82025]: [pid: 82025|app: 0|req: 410/820] 10.222.0.33 () {60 vars in 1144 bytes} [Tue Sep 13 19:42:27 2022] POST /identity/v3/endpoints => generated 346 bytes in 292 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 13 19:42:27.406401 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b5792e0-f2b7-44cd-b420-9d784340f033 None admin] Authenticating user token {{(pid=82025) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:42:27.510358 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dca4105f-ccb2-4de4-aad4-376d9e60a65e None admin] Validating token access rules against request {{(pid=82026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:42:27.555996 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b5792e0-f2b7-44cd-b420-9d784340f033 None admin] Validating token access rules against request {{(pid=82025) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:42:27.560539 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d6a8ce7-329b-4c98-9adb-fba2aa435e95 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57539b6a6f3b4d589f5f5e1d211cd6a0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:42:27.561420 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d6a8ce7-329b-4c98-9adb-fba2aa435e95 None admin] REQUEST_METHOD: `GET` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:42:27.561878 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d6a8ce7-329b-4c98-9adb-fba2aa435e95 None admin] SCRIPT_NAME: `/identity` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:42:27.562301 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d6a8ce7-329b-4c98-9adb-fba2aa435e95 None admin] PATH_INFO: `/v3/projects/service` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:42:27.572683 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d6a8ce7-329b-4c98-9adb-fba2aa435e95 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=82026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:42:27.574981 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG dbcounter [-] [82025] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82025) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:42:27.576195 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d6a8ce7-329b-4c98-9adb-fba2aa435e95 None admin] RBAC: Authorization granted {{(pid=82026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:42:27.591182 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application [None req-8d6a8ce7-329b-4c98-9adb-fba2aa435e95 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 13 19:42:27.591182 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 19:42:27.591182 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 19:42:27.591182 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 19:42:27.591182 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 19:42:27.591182 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 19:42:27.591182 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 19:42:27.591182 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 19:42:27.591182 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 19:42:27.591182 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 19:42:27.591182 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 19:42:27.591182 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 19:42:27.591182 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 13 19:42:27.591182 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 13 19:42:27.591182 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 13 19:42:27.592176 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 13 19:42:27.592176 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 19:42:27.592176 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 19:42:27.592176 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 19:42:27.592176 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 19:42:27.592176 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 19:42:27.592176 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 19:42:27.592176 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 19:42:27.592176 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application with Lock( Sep 13 19:42:27.592176 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 19:42:27.592176 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application return self._enter() Sep 13 19:42:27.592176 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 19:42:27.592176 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 19:42:27.592176 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 19:42:27.592176 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application return self.creator() Sep 13 19:42:27.592176 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 19:42:27.592176 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application created_value = creator( Sep 13 19:42:27.593179 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 13 19:42:27.593179 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 13 19:42:27.593179 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 13 19:42:27.593179 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 13 19:42:27.593179 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 13 19:42:27.593179 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 13 19:42:27.593179 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 13 19:42:27.593179 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application Sep 13 19:42:27.595487 dv-cinder-828806-6-smb devstack@keystone.service[82026]: [pid: 82026|app: 0|req: 411/821] 10.222.0.33 () {56 vars in 1111 bytes} [Tue Sep 13 19:42:27 2022] GET /identity/v3/projects/service => generated 88 bytes in 233 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 19:42:27.596484 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d6a8ce7-329b-4c98-9adb-fba2aa435e95 None admin] Authenticating user token {{(pid=82026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:42:27.605220 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01b66cdb-7090-4f0a-b6cc-f7003705dd3a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57539b6a6f3b4d589f5f5e1d211cd6a0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82025) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:42:27.605936 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01b66cdb-7090-4f0a-b6cc-f7003705dd3a None admin] REQUEST_METHOD: `GET` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:42:27.606295 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01b66cdb-7090-4f0a-b6cc-f7003705dd3a None admin] SCRIPT_NAME: `/identity` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:42:27.606638 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01b66cdb-7090-4f0a-b6cc-f7003705dd3a None admin] PATH_INFO: `/v3/services` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:42:27.607412 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01b66cdb-7090-4f0a-b6cc-f7003705dd3a None admin] RBAC: Adding query filter params (name=network) {{(pid=82025) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 19:42:27.608080 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01b66cdb-7090-4f0a-b6cc-f7003705dd3a None admin] RBAC: Authorizing `identity:list_services()` {{(pid=82025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:42:27.609923 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01b66cdb-7090-4f0a-b6cc-f7003705dd3a None admin] RBAC: Authorization granted {{(pid=82025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:42:27.616632 dv-cinder-828806-6-smb devstack@keystone.service[82025]: [pid: 82025|app: 0|req: 411/822] 10.222.0.33 () {56 vars in 1112 bytes} [Tue Sep 13 19:42:27 2022] GET /identity/v3/services?name=network => generated 124 bytes in 211 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 19:42:27.617545 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01b66cdb-7090-4f0a-b6cc-f7003705dd3a None admin] Authenticating user token {{(pid=82025) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:42:27.657155 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG dbcounter [-] [82026] Writing DB stats keystone:SELECT=100 {{(pid=82026) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:42:27.734479 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d6a8ce7-329b-4c98-9adb-fba2aa435e95 None admin] Validating token access rules against request {{(pid=82026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:42:27.753066 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01b66cdb-7090-4f0a-b6cc-f7003705dd3a None admin] Validating token access rules against request {{(pid=82025) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:42:27.772008 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b519b36b-582c-4fc4-b3dd-505b5ec0b369 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57539b6a6f3b4d589f5f5e1d211cd6a0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:42:27.772710 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b519b36b-582c-4fc4-b3dd-505b5ec0b369 None admin] REQUEST_METHOD: `GET` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:42:27.773177 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b519b36b-582c-4fc4-b3dd-505b5ec0b369 None admin] SCRIPT_NAME: `/identity` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:42:27.773410 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b519b36b-582c-4fc4-b3dd-505b5ec0b369 None admin] PATH_INFO: `/v3/users` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:42:27.774315 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b519b36b-582c-4fc4-b3dd-505b5ec0b369 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=82026) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 19:42:27.774665 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b519b36b-582c-4fc4-b3dd-505b5ec0b369 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=82026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:42:27.776169 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b519b36b-582c-4fc4-b3dd-505b5ec0b369 None admin] RBAC: Authorization granted {{(pid=82026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:42:27.798190 dv-cinder-828806-6-smb devstack@keystone.service[82026]: [pid: 82026|app: 0|req: 412/823] 10.222.0.33 () {56 vars in 1149 bytes} [Tue Sep 13 19:42:27 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 19:42:27.799299 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b519b36b-582c-4fc4-b3dd-505b5ec0b369 None admin] Authenticating user token {{(pid=82026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:42:27.801336 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a260d7f3-a216-4373-a782-fb40b88e58f9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57539b6a6f3b4d589f5f5e1d211cd6a0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82025) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:42:27.803797 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a260d7f3-a216-4373-a782-fb40b88e58f9 None admin] REQUEST_METHOD: `GET` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:42:27.804081 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a260d7f3-a216-4373-a782-fb40b88e58f9 None admin] SCRIPT_NAME: `/identity` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:42:27.804354 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a260d7f3-a216-4373-a782-fb40b88e58f9 None admin] PATH_INFO: `/v3/projects` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:42:27.805056 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a260d7f3-a216-4373-a782-fb40b88e58f9 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=82025) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 19:42:27.805359 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a260d7f3-a216-4373-a782-fb40b88e58f9 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=82025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:42:27.806790 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a260d7f3-a216-4373-a782-fb40b88e58f9 None admin] RBAC: Authorization granted {{(pid=82025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:42:27.823684 dv-cinder-828806-6-smb devstack@keystone.service[82025]: [pid: 82025|app: 0|req: 412/824] 10.222.0.33 () {56 vars in 1148 bytes} [Tue Sep 13 19:42:27 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 19:42:27.824541 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a260d7f3-a216-4373-a782-fb40b88e58f9 None admin] Authenticating user token {{(pid=82025) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:42:27.875346 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG dbcounter [-] [82025] Writing DB stats keystone:SELECT=100 {{(pid=82025) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:42:27.927817 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG dbcounter [-] [82026] Writing DB stats keystone:SELECT=100 {{(pid=82026) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:42:27.931944 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b519b36b-582c-4fc4-b3dd-505b5ec0b369 None admin] Validating token access rules against request {{(pid=82026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:42:27.947385 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a260d7f3-a216-4373-a782-fb40b88e58f9 None admin] Validating token access rules against request {{(pid=82025) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:42:27.972125 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-748c05a9-6b19-4734-a26a-edf0419fa5cf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57539b6a6f3b4d589f5f5e1d211cd6a0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:42:27.973216 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-748c05a9-6b19-4734-a26a-edf0419fa5cf None admin] REQUEST_METHOD: `GET` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:42:27.973704 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-748c05a9-6b19-4734-a26a-edf0419fa5cf None admin] SCRIPT_NAME: `/identity` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:42:27.974182 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-748c05a9-6b19-4734-a26a-edf0419fa5cf None admin] PATH_INFO: `/v3/services` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:42:27.975121 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-748c05a9-6b19-4734-a26a-edf0419fa5cf None admin] RBAC: Adding query filter params (type=network) {{(pid=82026) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 19:42:27.975639 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-748c05a9-6b19-4734-a26a-edf0419fa5cf None admin] RBAC: Authorizing `identity:list_services()` {{(pid=82026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:42:27.977294 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-748c05a9-6b19-4734-a26a-edf0419fa5cf None admin] RBAC: Authorization granted {{(pid=82026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:42:27.983015 dv-cinder-828806-6-smb devstack@keystone.service[82026]: [pid: 82026|app: 0|req: 413/825] 10.222.0.33 () {56 vars in 1112 bytes} [Tue Sep 13 19:42:27 2022] GET /identity/v3/services?type=network => generated 350 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 19:42:27.984175 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-748c05a9-6b19-4734-a26a-edf0419fa5cf None admin] Authenticating user token {{(pid=82026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:42:27.995409 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52856479-a1af-4272-835f-ef8b15a77d75 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57539b6a6f3b4d589f5f5e1d211cd6a0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82025) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:42:27.996045 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52856479-a1af-4272-835f-ef8b15a77d75 None admin] REQUEST_METHOD: `GET` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:42:27.996326 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52856479-a1af-4272-835f-ef8b15a77d75 None admin] SCRIPT_NAME: `/identity` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:42:27.996604 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52856479-a1af-4272-835f-ef8b15a77d75 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:42:28.009400 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52856479-a1af-4272-835f-ef8b15a77d75 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=82025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:42:28.011674 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52856479-a1af-4272-835f-ef8b15a77d75 None admin] RBAC: Authorization granted {{(pid=82025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:42:28.115893 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-748c05a9-6b19-4734-a26a-edf0419fa5cf None admin] Validating token access rules against request {{(pid=82026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:42:28.156999 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8c8b9cb-8951-4e8d-89ad-ec420e2c8416 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57539b6a6f3b4d589f5f5e1d211cd6a0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:42:28.158776 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8c8b9cb-8951-4e8d-89ad-ec420e2c8416 None admin] REQUEST_METHOD: `GET` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:42:28.159309 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8c8b9cb-8951-4e8d-89ad-ec420e2c8416 None admin] SCRIPT_NAME: `/identity` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:42:28.159786 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8c8b9cb-8951-4e8d-89ad-ec420e2c8416 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:42:28.160451 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application [None req-52856479-a1af-4272-835f-ef8b15a77d75 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 13 19:42:28.160451 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 19:42:28.160451 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 19:42:28.160451 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 19:42:28.160451 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 19:42:28.160451 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 19:42:28.160451 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 19:42:28.160451 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 19:42:28.160451 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 19:42:28.160451 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 19:42:28.160451 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 19:42:28.160451 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 19:42:28.160451 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 13 19:42:28.160451 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 13 19:42:28.160451 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 13 19:42:28.160451 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 13 19:42:28.161372 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 19:42:28.161372 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 19:42:28.161372 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 19:42:28.161372 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 19:42:28.161372 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 19:42:28.161372 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 19:42:28.161372 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 19:42:28.161372 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application with Lock( Sep 13 19:42:28.161372 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 19:42:28.161372 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application return self._enter() Sep 13 19:42:28.161372 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 19:42:28.161372 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 19:42:28.161372 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 19:42:28.161372 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application return self.creator() Sep 13 19:42:28.161372 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 19:42:28.161372 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application created_value = creator( Sep 13 19:42:28.161372 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 13 19:42:28.162289 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 13 19:42:28.162289 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 13 19:42:28.162289 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application Sep 13 19:42:28.163286 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8c8b9cb-8951-4e8d-89ad-ec420e2c8416 None admin] RBAC: Adding query filter params (role.id=e5af7d5baa93469e9e486ef21c85474e, scope.project.id=c8c6fba0f15b4d6a84ff601919b7b8e4, user.id=e66e7034abed4e0bad1f4137520c1e70) {{(pid=82026) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 19:42:28.163823 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8c8b9cb-8951-4e8d-89ad-ec420e2c8416 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=82026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:42:28.165462 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8c8b9cb-8951-4e8d-89ad-ec420e2c8416 None admin] RBAC: Authorization granted {{(pid=82026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:42:28.166214 dv-cinder-828806-6-smb devstack@keystone.service[82025]: [pid: 82025|app: 0|req: 413/826] 10.222.0.33 () {56 vars in 1108 bytes} [Tue Sep 13 19:42:27 2022] GET /identity/v3/domains/Default => generated 87 bytes in 342 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 19:42:28.167060 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52856479-a1af-4272-835f-ef8b15a77d75 None admin] Authenticating user token {{(pid=82025) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:42:28.175019 dv-cinder-828806-6-smb devstack@keystone.service[82026]: [pid: 82026|app: 0|req: 414/827] 10.222.0.33 () {56 vars in 1374 bytes} [Tue Sep 13 19:42:27 2022] GET /identity/v3/role_assignments?user.id=e66e7034abed4e0bad1f4137520c1e70&scope.project.id=c8c6fba0f15b4d6a84ff601919b7b8e4&role.id=e5af7d5baa93469e9e486ef21c85474e => generated 608 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 19:42:28.176379 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8c8b9cb-8951-4e8d-89ad-ec420e2c8416 None admin] Authenticating user token {{(pid=82026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:42:28.210317 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG dbcounter [-] [82026] Writing DB stats keystone:SELECT=100 {{(pid=82026) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:42:28.286140 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG dbcounter [-] [82025] Writing DB stats keystone:SELECT=100 {{(pid=82025) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:42:28.299028 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52856479-a1af-4272-835f-ef8b15a77d75 None admin] Validating token access rules against request {{(pid=82025) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:42:28.310182 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8c8b9cb-8951-4e8d-89ad-ec420e2c8416 None admin] Validating token access rules against request {{(pid=82026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:42:28.343224 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91165469-b42c-4e6f-a05f-4d4e3c27ff2f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57539b6a6f3b4d589f5f5e1d211cd6a0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82025) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:42:28.344751 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91165469-b42c-4e6f-a05f-4d4e3c27ff2f None admin] REQUEST_METHOD: `POST` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:42:28.345957 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91165469-b42c-4e6f-a05f-4d4e3c27ff2f None admin] SCRIPT_NAME: `/identity` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:42:28.346463 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91165469-b42c-4e6f-a05f-4d4e3c27ff2f None admin] PATH_INFO: `/v3/endpoints` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:42:28.347393 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91165469-b42c-4e6f-a05f-4d4e3c27ff2f None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=82025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:42:28.349900 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91165469-b42c-4e6f-a05f-4d4e3c27ff2f None admin] RBAC: Authorization granted {{(pid=82025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:42:28.357462 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaea69b0-1f44-416b-93ce-890ba78a5d59 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57539b6a6f3b4d589f5f5e1d211cd6a0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:42:28.358473 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaea69b0-1f44-416b-93ce-890ba78a5d59 None admin] REQUEST_METHOD: `GET` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:42:28.358850 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaea69b0-1f44-416b-93ce-890ba78a5d59 None admin] SCRIPT_NAME: `/identity` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:42:28.359210 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaea69b0-1f44-416b-93ce-890ba78a5d59 None admin] PATH_INFO: `/v3/domains` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:42:28.360173 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaea69b0-1f44-416b-93ce-890ba78a5d59 None admin] RBAC: Adding query filter params (name=Default) {{(pid=82026) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 19:42:28.360760 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaea69b0-1f44-416b-93ce-890ba78a5d59 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:42:28.362147 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaea69b0-1f44-416b-93ce-890ba78a5d59 None admin] RBAC: Authorization granted {{(pid=82026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:42:28.394022 dv-cinder-828806-6-smb devstack@keystone.service[82026]: [pid: 82026|app: 0|req: 415/828] 10.222.0.33 () {56 vars in 1109 bytes} [Tue Sep 13 19:42:28 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 19:42:28.394022 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f9f9401-1d63-4545-87f2-5c59abb5423d None None] REQUEST_METHOD: `GET` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:42:28.394022 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f9f9401-1d63-4545-87f2-5c59abb5423d None None] SCRIPT_NAME: `/identity` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:42:28.394022 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f9f9401-1d63-4545-87f2-5c59abb5423d None None] PATH_INFO: `/` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:42:28.394022 dv-cinder-828806-6-smb devstack@keystone.service[82026]: [pid: 82026|app: 0|req: 416/829] 10.222.0.33 () {54 vars in 927 bytes} [Tue Sep 13 19:42:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 19:42:28.394022 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f9f9401-1d63-4545-87f2-5c59abb5423d None None] Authenticating user token {{(pid=82026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:42:28.460906 dv-cinder-828806-6-smb devstack@keystone.service[82025]: [pid: 82025|app: 0|req: 414/830] 10.222.0.33 () {60 vars in 1144 bytes} [Tue Sep 13 19:42:28 2022] POST /identity/v3/endpoints => generated 337 bytes in 294 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 13 19:42:28.462226 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-308deaaa-0e5d-4f14-b98e-6f276a7d16bb None None] REQUEST_METHOD: `POST` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:42:28.462525 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-308deaaa-0e5d-4f14-b98e-6f276a7d16bb None None] SCRIPT_NAME: `/identity` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:42:28.462802 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-308deaaa-0e5d-4f14-b98e-6f276a7d16bb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:42:28.483418 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG dbcounter [-] [82026] Writing DB stats keystone:SELECT=100 {{(pid=82026) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:42:28.508048 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.auth.core [None req-308deaaa-0e5d-4f14-b98e-6f276a7d16bb None None] MFA Rules not processed for user `57539b6a6f3b4d589f5f5e1d211cd6a0`. Rule list: `[]` (Enabled: `True`). {{(pid=82025) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 19:42:28.509294 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.fernet_utils [None req-308deaaa-0e5d-4f14-b98e-6f276a7d16bb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82025) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 19:42:28.535951 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f9f9401-1d63-4545-87f2-5c59abb5423d None None] Validating token access rules against request {{(pid=82026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:42:28.594020 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8fd0a77-a201-4d87-9bf6-83b7393e3571 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57539b6a6f3b4d589f5f5e1d211cd6a0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:42:28.595240 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8fd0a77-a201-4d87-9bf6-83b7393e3571 None admin] REQUEST_METHOD: `GET` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:42:28.595521 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8fd0a77-a201-4d87-9bf6-83b7393e3571 None admin] SCRIPT_NAME: `/identity` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:42:28.595886 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8fd0a77-a201-4d87-9bf6-83b7393e3571 None admin] PATH_INFO: `/v3/projects/service` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:42:28.604931 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8fd0a77-a201-4d87-9bf6-83b7393e3571 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=82026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:42:28.606715 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8fd0a77-a201-4d87-9bf6-83b7393e3571 None admin] RBAC: Authorization granted {{(pid=82026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:42:28.634387 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application [None req-e8fd0a77-a201-4d87-9bf6-83b7393e3571 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 13 19:42:28.634387 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 19:42:28.634387 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 19:42:28.634387 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 19:42:28.634387 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 19:42:28.634387 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 19:42:28.634387 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 19:42:28.634387 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 19:42:28.634387 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 19:42:28.634387 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 19:42:28.634387 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 19:42:28.634387 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 19:42:28.634387 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 13 19:42:28.634387 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 13 19:42:28.634387 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 13 19:42:28.635361 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 13 19:42:28.635361 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 19:42:28.635361 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 19:42:28.635361 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 19:42:28.635361 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 19:42:28.635361 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 19:42:28.635361 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 19:42:28.635361 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 19:42:28.635361 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application with Lock( Sep 13 19:42:28.635361 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 19:42:28.635361 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application return self._enter() Sep 13 19:42:28.635361 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 19:42:28.635361 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 19:42:28.635361 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 19:42:28.635361 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application return self.creator() Sep 13 19:42:28.635361 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 19:42:28.635361 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application created_value = creator( Sep 13 19:42:28.636261 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 13 19:42:28.636261 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 13 19:42:28.636261 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 13 19:42:28.636261 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 13 19:42:28.636261 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 13 19:42:28.636261 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 13 19:42:28.636261 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 13 19:42:28.636261 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application Sep 13 19:42:28.636261 dv-cinder-828806-6-smb devstack@keystone.service[82026]: [pid: 82026|app: 0|req: 417/831] 10.222.0.33 () {56 vars in 1111 bytes} [Tue Sep 13 19:42:28 2022] GET /identity/v3/projects/service => generated 88 bytes in 254 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 13 19:42:28.644467 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8fd0a77-a201-4d87-9bf6-83b7393e3571 None admin] Authenticating user token {{(pid=82026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:42:28.660683 dv-cinder-828806-6-smb devstack@keystone.service[82025]: [pid: 82025|app: 0|req: 415/832] 10.222.0.33 () {58 vars in 1024 bytes} [Tue Sep 13 19:42:28 2022] POST /identity/v3/auth/tokens => generated 1161 bytes in 199 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 13 19:42:28.764205 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8fd0a77-a201-4d87-9bf6-83b7393e3571 None admin] Validating token access rules against request {{(pid=82026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:42:28.806709 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d8cdc01-9777-44cc-a139-40d5c22e921a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57539b6a6f3b4d589f5f5e1d211cd6a0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:42:28.807368 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d8cdc01-9777-44cc-a139-40d5c22e921a None admin] REQUEST_METHOD: `GET` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:42:28.807655 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d8cdc01-9777-44cc-a139-40d5c22e921a None admin] SCRIPT_NAME: `/identity` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:42:28.807936 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d8cdc01-9777-44cc-a139-40d5c22e921a None admin] PATH_INFO: `/v3/projects` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:42:28.808646 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d8cdc01-9777-44cc-a139-40d5c22e921a None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=82026) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 19:42:28.808960 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d8cdc01-9777-44cc-a139-40d5c22e921a None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=82026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:42:28.810415 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d8cdc01-9777-44cc-a139-40d5c22e921a None admin] RBAC: Authorization granted {{(pid=82026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:42:28.831666 dv-cinder-828806-6-smb devstack@keystone.service[82026]: [pid: 82026|app: 0|req: 418/833] 10.222.0.33 () {56 vars in 1148 bytes} [Tue Sep 13 19:42:28 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 13 19:42:28.837615 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-308deaaa-0e5d-4f14-b98e-6f276a7d16bb None None] Authenticating user token {{(pid=82025) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:42:28.940090 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG dbcounter [-] [82025] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82025) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:42:28.966407 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-308deaaa-0e5d-4f14-b98e-6f276a7d16bb None None] Validating token access rules against request {{(pid=82025) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:42:28.982326 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d8cdc01-9777-44cc-a139-40d5c22e921a None admin] Authenticating user token {{(pid=82026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:42:28.991362 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG dbcounter [-] [82026] Writing DB stats keystone:SELECT=100 {{(pid=82026) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:42:29.018751 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1da1749-aef4-4dd0-a760-b57362231bd0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57539b6a6f3b4d589f5f5e1d211cd6a0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82025) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:42:29.019449 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1da1749-aef4-4dd0-a760-b57362231bd0 None admin] REQUEST_METHOD: `PUT` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:42:29.019729 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1da1749-aef4-4dd0-a760-b57362231bd0 None admin] SCRIPT_NAME: `/identity` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:42:29.020005 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1da1749-aef4-4dd0-a760-b57362231bd0 None admin] PATH_INFO: `/v3/projects/c8c6fba0f15b4d6a84ff601919b7b8e4/users/a28e738b894442e2bc9880eeb64fc0c8/roles/47ee826cd5f148c19f293f9470f906da` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:42:29.036606 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1da1749-aef4-4dd0-a760-b57362231bd0 None admin] RBAC: Authorizing `identity:create_grant(project_id=c8c6fba0f15b4d6a84ff601919b7b8e4, user_id=a28e738b894442e2bc9880eeb64fc0c8, role_id=47ee826cd5f148c19f293f9470f906da)` {{(pid=82025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:42:29.038156 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1da1749-aef4-4dd0-a760-b57362231bd0 None admin] RBAC: Authorization granted {{(pid=82025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:42:29.107750 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d8cdc01-9777-44cc-a139-40d5c22e921a None admin] Validating token access rules against request {{(pid=82026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:42:29.119177 dv-cinder-828806-6-smb devstack@keystone.service[82025]: [pid: 82025|app: 0|req: 416/834] 10.222.0.33 () {58 vars in 1439 bytes} [Tue Sep 13 19:42:28 2022] PUT /identity/v3/projects/c8c6fba0f15b4d6a84ff601919b7b8e4/users/a28e738b894442e2bc9880eeb64fc0c8/roles/47ee826cd5f148c19f293f9470f906da => generated 0 bytes in 274 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 19:42:29.156567 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5c0deec-3ca9-4e99-9f4c-73d7118dfd72 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57539b6a6f3b4d589f5f5e1d211cd6a0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:42:29.159044 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5c0deec-3ca9-4e99-9f4c-73d7118dfd72 None admin] REQUEST_METHOD: `GET` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:42:29.159044 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5c0deec-3ca9-4e99-9f4c-73d7118dfd72 None admin] SCRIPT_NAME: `/identity` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:42:29.159044 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5c0deec-3ca9-4e99-9f4c-73d7118dfd72 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:42:29.181228 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5c0deec-3ca9-4e99-9f4c-73d7118dfd72 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=82026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 13 19:42:29.186622 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application [None req-e5c0deec-3ca9-4e99-9f4c-73d7118dfd72 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 13 19:42:29.186622 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 19:42:29.186622 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 19:42:29.186622 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 19:42:29.186622 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 19:42:29.186622 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 19:42:29.186622 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 19:42:29.186622 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 19:42:29.186622 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 19:42:29.186622 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 19:42:29.186622 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 19:42:29.186622 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 19:42:29.186622 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 13 19:42:29.186622 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 13 19:42:29.186622 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 13 19:42:29.186622 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 13 19:42:29.187638 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 13 19:42:29.187638 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 13 19:42:29.187638 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 13 19:42:29.187638 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 13 19:42:29.187638 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 19:42:29.187638 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 19:42:29.187638 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 19:42:29.187638 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 19:42:29.187638 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 19:42:29.187638 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 19:42:29.187638 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 19:42:29.187638 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application with Lock( Sep 13 19:42:29.187638 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 19:42:29.187638 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application return self._enter() Sep 13 19:42:29.187638 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 19:42:29.187638 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 19:42:29.190293 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 19:42:29.190293 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application return self.creator() Sep 13 19:42:29.190293 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 19:42:29.190293 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application created_value = creator( Sep 13 19:42:29.190293 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 13 19:42:29.190293 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 13 19:42:29.190293 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 13 19:42:29.190293 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 13 19:42:29.190293 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 13 19:42:29.190293 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 13 19:42:29.190293 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 13 19:42:29.190293 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application Sep 13 19:42:29.190293 dv-cinder-828806-6-smb devstack@keystone.service[82026]: [pid: 82026|app: 0|req: 419/835] 10.222.0.33 () {56 vars in 1096 bytes} [Tue Sep 13 19:42:28 2022] GET /identity/v3/roles/admin => generated 83 bytes in 207 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 13 19:42:29.198433 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1da1749-aef4-4dd0-a760-b57362231bd0 None admin] Authenticating user token {{(pid=82025) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:42:29.333280 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1da1749-aef4-4dd0-a760-b57362231bd0 None admin] Validating token access rules against request {{(pid=82025) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:42:29.360952 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG dbcounter [-] [82025] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82025) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:42:29.369845 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af9157e4-795f-496d-a2b2-21f88b8a2d35 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57539b6a6f3b4d589f5f5e1d211cd6a0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82025) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:42:29.370463 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af9157e4-795f-496d-a2b2-21f88b8a2d35 None admin] REQUEST_METHOD: `GET` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:42:29.370738 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af9157e4-795f-496d-a2b2-21f88b8a2d35 None admin] SCRIPT_NAME: `/identity` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:42:29.371103 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af9157e4-795f-496d-a2b2-21f88b8a2d35 None admin] PATH_INFO: `/v3/roles` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:42:29.371760 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af9157e4-795f-496d-a2b2-21f88b8a2d35 None admin] RBAC: Adding query filter params (name=admin) {{(pid=82025) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 19:42:29.372060 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af9157e4-795f-496d-a2b2-21f88b8a2d35 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:42:29.373413 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af9157e4-795f-496d-a2b2-21f88b8a2d35 None admin] RBAC: Authorization granted {{(pid=82025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:42:29.383240 dv-cinder-828806-6-smb devstack@keystone.service[82025]: [pid: 82025|app: 0|req: 417/836] 10.222.0.33 () {56 vars in 1099 bytes} [Tue Sep 13 19:42:29 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 19:42:29.389198 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5c0deec-3ca9-4e99-9f4c-73d7118dfd72 None admin] Authenticating user token {{(pid=82026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:42:29.460372 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG dbcounter [-] [82026] Writing DB stats keystone:SELECT=100 {{(pid=82026) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:42:29.501718 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5c0deec-3ca9-4e99-9f4c-73d7118dfd72 None admin] Validating token access rules against request {{(pid=82026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:42:29.541966 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef36019c-ccf0-4b99-8978-d7c8221826b5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57539b6a6f3b4d589f5f5e1d211cd6a0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:42:29.542676 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef36019c-ccf0-4b99-8978-d7c8221826b5 None admin] REQUEST_METHOD: `GET` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:42:29.542970 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef36019c-ccf0-4b99-8978-d7c8221826b5 None admin] SCRIPT_NAME: `/identity` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:42:29.543281 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef36019c-ccf0-4b99-8978-d7c8221826b5 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:42:29.555232 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef36019c-ccf0-4b99-8978-d7c8221826b5 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=82026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:42:29.556699 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef36019c-ccf0-4b99-8978-d7c8221826b5 None admin] RBAC: Authorization granted {{(pid=82026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:42:29.572642 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application [None req-ef36019c-ccf0-4b99-8978-d7c8221826b5 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 13 19:42:29.572642 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 19:42:29.572642 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 19:42:29.572642 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 19:42:29.572642 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 19:42:29.572642 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 19:42:29.572642 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 19:42:29.572642 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 19:42:29.572642 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 19:42:29.572642 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 19:42:29.572642 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 19:42:29.572642 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 19:42:29.572642 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 13 19:42:29.572642 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 13 19:42:29.572642 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 13 19:42:29.572642 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 13 19:42:29.573652 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 19:42:29.573652 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 19:42:29.573652 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 19:42:29.573652 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 19:42:29.573652 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 19:42:29.573652 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 19:42:29.573652 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 19:42:29.573652 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application with Lock( Sep 13 19:42:29.573652 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 19:42:29.573652 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application return self._enter() Sep 13 19:42:29.573652 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 19:42:29.573652 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 19:42:29.573652 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 19:42:29.573652 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application return self.creator() Sep 13 19:42:29.573652 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 19:42:29.573652 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application created_value = creator( Sep 13 19:42:29.573652 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 13 19:42:29.574556 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 13 19:42:29.574556 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 13 19:42:29.574556 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application Sep 13 19:42:29.578498 dv-cinder-828806-6-smb devstack@keystone.service[82026]: [pid: 82026|app: 0|req: 420/837] 10.222.0.33 () {56 vars in 1108 bytes} [Tue Sep 13 19:42:29 2022] GET /identity/v3/domains/Default => generated 87 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 19:42:29.580545 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af9157e4-795f-496d-a2b2-21f88b8a2d35 None admin] Authenticating user token {{(pid=82025) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:42:29.696492 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af9157e4-795f-496d-a2b2-21f88b8a2d35 None admin] Validating token access rules against request {{(pid=82025) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:42:29.733041 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0de38fe1-f6d9-4ab5-b91b-0821430a44ad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57539b6a6f3b4d589f5f5e1d211cd6a0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82025) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:42:29.733580 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0de38fe1-f6d9-4ab5-b91b-0821430a44ad None admin] REQUEST_METHOD: `GET` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:42:29.733865 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0de38fe1-f6d9-4ab5-b91b-0821430a44ad None admin] SCRIPT_NAME: `/identity` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:42:29.734144 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0de38fe1-f6d9-4ab5-b91b-0821430a44ad None admin] PATH_INFO: `/v3/domains` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:42:29.734789 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0de38fe1-f6d9-4ab5-b91b-0821430a44ad None admin] RBAC: Adding query filter params (name=Default) {{(pid=82025) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 19:42:29.735240 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0de38fe1-f6d9-4ab5-b91b-0821430a44ad None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:42:29.736714 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0de38fe1-f6d9-4ab5-b91b-0821430a44ad None admin] RBAC: Authorization granted {{(pid=82025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:42:29.749096 dv-cinder-828806-6-smb devstack@keystone.service[82025]: [pid: 82025|app: 0|req: 418/838] 10.222.0.33 () {56 vars in 1109 bytes} [Tue Sep 13 19:42:29 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 19:42:29.755163 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef36019c-ccf0-4b99-8978-d7c8221826b5 None admin] Authenticating user token {{(pid=82026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:42:29.794250 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deee8507-40e0-452f-8f2d-52bd77bb4ec5 None None] REQUEST_METHOD: `GET` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:42:29.794571 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deee8507-40e0-452f-8f2d-52bd77bb4ec5 None None] SCRIPT_NAME: `/identity` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:42:29.794815 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deee8507-40e0-452f-8f2d-52bd77bb4ec5 None None] PATH_INFO: `/` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:42:29.796435 dv-cinder-828806-6-smb devstack@keystone.service[82025]: [pid: 82025|app: 0|req: 419/839] 10.222.0.33 () {54 vars in 927 bytes} [Tue Sep 13 19:42:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 19:42:29.801974 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4453fc1-ba64-4a6b-9b81-8ad8427858c1 None None] REQUEST_METHOD: `POST` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:42:29.802256 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4453fc1-ba64-4a6b-9b81-8ad8427858c1 None None] SCRIPT_NAME: `/identity` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:42:29.802529 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4453fc1-ba64-4a6b-9b81-8ad8427858c1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:42:29.820762 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.auth.core [None req-b4453fc1-ba64-4a6b-9b81-8ad8427858c1 None None] MFA Rules not processed for user `57539b6a6f3b4d589f5f5e1d211cd6a0`. Rule list: `[]` (Enabled: `True`). {{(pid=82025) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 19:42:29.822222 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.fernet_utils [None req-b4453fc1-ba64-4a6b-9b81-8ad8427858c1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82025) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 19:42:29.874214 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG dbcounter [-] [82025] Writing DB stats keystone:SELECT=100 {{(pid=82025) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:42:29.876871 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef36019c-ccf0-4b99-8978-d7c8221826b5 None admin] Validating token access rules against request {{(pid=82026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:42:29.896142 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG dbcounter [-] [82026] Writing DB stats keystone:SELECT=100 {{(pid=82026) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:42:29.913327 dv-cinder-828806-6-smb devstack@keystone.service[82025]: [pid: 82025|app: 0|req: 420/840] 10.222.0.33 () {58 vars in 1024 bytes} [Tue Sep 13 19:42:29 2022] POST /identity/v3/auth/tokens => generated 1161 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 13 19:42:29.920881 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c244cd45-faa0-40c2-aa32-9262457f13ac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57539b6a6f3b4d589f5f5e1d211cd6a0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:42:29.921770 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c244cd45-faa0-40c2-aa32-9262457f13ac None admin] REQUEST_METHOD: `GET` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:42:29.922281 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c244cd45-faa0-40c2-aa32-9262457f13ac None admin] SCRIPT_NAME: `/identity` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:42:29.922851 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c244cd45-faa0-40c2-aa32-9262457f13ac None admin] PATH_INFO: `/v3/users/swift` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:42:29.931446 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c244cd45-faa0-40c2-aa32-9262457f13ac None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=82026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:42:29.933207 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c244cd45-faa0-40c2-aa32-9262457f13ac None admin] RBAC: Authorization granted {{(pid=82026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:42:29.945991 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application [None req-c244cd45-faa0-40c2-aa32-9262457f13ac None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Sep 13 19:42:29.945991 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 19:42:29.945991 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 19:42:29.945991 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 19:42:29.945991 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 19:42:29.945991 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 19:42:29.945991 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 19:42:29.945991 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 19:42:29.945991 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 19:42:29.945991 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 19:42:29.945991 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 19:42:29.945991 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 19:42:29.945991 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 13 19:42:29.945991 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 13 19:42:29.945991 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 13 19:42:29.945991 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 13 19:42:29.946987 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 19:42:29.946987 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 19:42:29.946987 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 13 19:42:29.946987 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 13 19:42:29.946987 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 13 19:42:29.946987 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 13 19:42:29.946987 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 19:42:29.946987 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 19:42:29.946987 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 19:42:29.946987 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 19:42:29.946987 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 19:42:29.946987 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application with Lock( Sep 13 19:42:29.946987 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 19:42:29.946987 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application return self._enter() Sep 13 19:42:29.946987 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 19:42:29.946987 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 19:42:29.946987 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 19:42:29.946987 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application return self.creator() Sep 13 19:42:29.948066 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 19:42:29.948066 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application created_value = creator( Sep 13 19:42:29.948066 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 13 19:42:29.948066 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 13 19:42:29.948066 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 13 19:42:29.948066 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 13 19:42:29.948066 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 13 19:42:29.948066 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 13 19:42:29.948066 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Sep 13 19:42:29.948066 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application Sep 13 19:42:29.955400 dv-cinder-828806-6-smb devstack@keystone.service[82026]: [pid: 82026|app: 0|req: 421/841] 10.222.0.33 () {56 vars in 1096 bytes} [Tue Sep 13 19:42:29 2022] GET /identity/v3/users/swift => generated 83 bytes in 201 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 19:42:29.958316 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4453fc1-ba64-4a6b-9b81-8ad8427858c1 None None] Authenticating user token {{(pid=82025) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:42:30.065374 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4453fc1-ba64-4a6b-9b81-8ad8427858c1 None None] Validating token access rules against request {{(pid=82025) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:42:30.102467 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeb81bfd-3516-4b2b-929a-96032f66debd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57539b6a6f3b4d589f5f5e1d211cd6a0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82025) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:42:30.103476 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeb81bfd-3516-4b2b-929a-96032f66debd None admin] REQUEST_METHOD: `GET` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:42:30.103992 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeb81bfd-3516-4b2b-929a-96032f66debd None admin] SCRIPT_NAME: `/identity` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:42:30.104473 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeb81bfd-3516-4b2b-929a-96032f66debd None admin] PATH_INFO: `/v3/users` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:42:30.105428 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eeb81bfd-3516-4b2b-929a-96032f66debd None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=82025) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 19:42:30.105939 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eeb81bfd-3516-4b2b-929a-96032f66debd None admin] RBAC: Authorizing `identity:list_users()` {{(pid=82025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:42:30.107605 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eeb81bfd-3516-4b2b-929a-96032f66debd None admin] RBAC: Authorization granted {{(pid=82025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:42:30.133976 dv-cinder-828806-6-smb devstack@keystone.service[82025]: [pid: 82025|app: 0|req: 421/842] 10.222.0.33 () {56 vars in 1135 bytes} [Tue Sep 13 19:42:29 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 19:42:30.135749 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c244cd45-faa0-40c2-aa32-9262457f13ac None admin] Authenticating user token {{(pid=82026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:42:30.187815 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeb81bfd-3516-4b2b-929a-96032f66debd None admin] Authenticating user token {{(pid=82025) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:42:30.227805 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG dbcounter [-] [82025] Writing DB stats keystone:SELECT=100 {{(pid=82025) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:42:30.251806 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c244cd45-faa0-40c2-aa32-9262457f13ac None admin] Validating token access rules against request {{(pid=82026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:42:30.291117 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7eec9fe4-9ef0-4d88-9eb1-c1ec9fe03ffc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57539b6a6f3b4d589f5f5e1d211cd6a0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:42:30.292665 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eec9fe4-9ef0-4d88-9eb1-c1ec9fe03ffc None admin] REQUEST_METHOD: `GET` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:42:30.293449 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eec9fe4-9ef0-4d88-9eb1-c1ec9fe03ffc None admin] SCRIPT_NAME: `/identity` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:42:30.293988 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eec9fe4-9ef0-4d88-9eb1-c1ec9fe03ffc None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:42:30.298757 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeb81bfd-3516-4b2b-929a-96032f66debd None admin] Validating token access rules against request {{(pid=82025) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:42:30.335633 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85f39379-6060-41f6-b8e3-f42d396e2027 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57539b6a6f3b4d589f5f5e1d211cd6a0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82025) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:42:30.336272 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85f39379-6060-41f6-b8e3-f42d396e2027 None admin] REQUEST_METHOD: `GET` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:42:30.336522 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85f39379-6060-41f6-b8e3-f42d396e2027 None admin] SCRIPT_NAME: `/identity` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:42:30.336803 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85f39379-6060-41f6-b8e3-f42d396e2027 None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:42:30.337387 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85f39379-6060-41f6-b8e3-f42d396e2027 None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=82025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:42:30.338740 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85f39379-6060-41f6-b8e3-f42d396e2027 None admin] RBAC: Authorization granted {{(pid=82025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:42:30.347962 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application [None req-85f39379-6060-41f6-b8e3-f42d396e2027 None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Sep 13 19:42:30.347962 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 19:42:30.347962 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 13 19:42:30.347962 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 13 19:42:30.347962 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 13 19:42:30.347962 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 13 19:42:30.347962 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 13 19:42:30.347962 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 13 19:42:30.347962 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Sep 13 19:42:30.347962 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application Sep 13 19:42:30.347962 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 13 19:42:30.347962 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application Sep 13 19:42:30.347962 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 19:42:30.347962 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 19:42:30.347962 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 19:42:30.347962 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 19:42:30.347962 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 19:42:30.349000 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 19:42:30.349000 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 19:42:30.349000 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 19:42:30.349000 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 19:42:30.349000 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 19:42:30.349000 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 19:42:30.349000 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 13 19:42:30.349000 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 13 19:42:30.349000 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 13 19:42:30.349000 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 13 19:42:30.349000 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 19:42:30.349000 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 19:42:30.349000 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 19:42:30.349000 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 19:42:30.349000 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 19:42:30.349000 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 19:42:30.350552 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 19:42:30.350552 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application with Lock( Sep 13 19:42:30.350552 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 19:42:30.350552 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application return self._enter() Sep 13 19:42:30.350552 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 19:42:30.350552 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 19:42:30.350552 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 19:42:30.350552 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application return self.creator() Sep 13 19:42:30.350552 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 19:42:30.350552 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application created_value = creator( Sep 13 19:42:30.350552 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 13 19:42:30.350552 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 13 19:42:30.350552 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Sep 13 19:42:30.350552 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application Sep 13 19:42:30.350552 dv-cinder-828806-6-smb devstack@keystone.service[82025]: [pid: 82025|app: 0|req: 422/843] 10.222.0.33 () {56 vars in 1114 bytes} [Tue Sep 13 19:42:30 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 13 19:42:30.355757 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85f39379-6060-41f6-b8e3-f42d396e2027 None admin] Authenticating user token {{(pid=82025) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:42:30.357784 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG dbcounter [-] [82026] Writing DB stats keystone:SELECT=100 {{(pid=82026) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:42:30.395048 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7eec9fe4-9ef0-4d88-9eb1-c1ec9fe03ffc None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=82026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:42:30.397732 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7eec9fe4-9ef0-4d88-9eb1-c1ec9fe03ffc None admin] RBAC: Authorization granted {{(pid=82026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:42:30.476147 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG dbcounter [-] [82025] Writing DB stats keystone:SELECT=100 {{(pid=82025) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:42:30.480907 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85f39379-6060-41f6-b8e3-f42d396e2027 None admin] Validating token access rules against request {{(pid=82025) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:42:30.529165 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9df665a-9372-43d0-980a-18c0faebf80f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57539b6a6f3b4d589f5f5e1d211cd6a0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82025) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:42:30.529165 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9df665a-9372-43d0-980a-18c0faebf80f None admin] REQUEST_METHOD: `GET` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:42:30.529472 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9df665a-9372-43d0-980a-18c0faebf80f None admin] SCRIPT_NAME: `/identity` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:42:30.529722 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9df665a-9372-43d0-980a-18c0faebf80f None admin] PATH_INFO: `/v3/services` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:42:30.529968 dv-cinder-828806-6-smb devstack@keystone.service[82026]: [pid: 82026|app: 0|req: 422/844] 10.222.0.33 () {58 vars in 1282 bytes} [Tue Sep 13 19:42:30 2022] GET /identity/v3/auth/tokens => generated 1161 bytes in 390 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Sep 13 19:42:30.530561 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9df665a-9372-43d0-980a-18c0faebf80f None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=82025) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 19:42:30.530561 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9df665a-9372-43d0-980a-18c0faebf80f None admin] RBAC: Authorizing `identity:list_services()` {{(pid=82025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:42:30.532410 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7eec9fe4-9ef0-4d88-9eb1-c1ec9fe03ffc None admin] Authenticating user token {{(pid=82026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:42:30.532520 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9df665a-9372-43d0-980a-18c0faebf80f None admin] RBAC: Authorization granted {{(pid=82025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:42:30.543319 dv-cinder-828806-6-smb devstack@keystone.service[82025]: [pid: 82025|app: 0|req: 423/845] 10.222.0.33 () {56 vars in 1114 bytes} [Tue Sep 13 19:42:30 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 19:42:30.544564 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9df665a-9372-43d0-980a-18c0faebf80f None admin] Authenticating user token {{(pid=82025) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:42:30.616543 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG dbcounter [-] [82026] Writing DB stats keystone:SELECT=100 {{(pid=82026) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:42:30.643344 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7eec9fe4-9ef0-4d88-9eb1-c1ec9fe03ffc None admin] Validating token access rules against request {{(pid=82026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:42:30.661645 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9df665a-9372-43d0-980a-18c0faebf80f None admin] Validating token access rules against request {{(pid=82025) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:42:30.680353 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12f3a65d-4df5-48c0-8e9e-a2ce3b969100 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57539b6a6f3b4d589f5f5e1d211cd6a0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:42:30.680982 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12f3a65d-4df5-48c0-8e9e-a2ce3b969100 None admin] REQUEST_METHOD: `GET` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:42:30.681266 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12f3a65d-4df5-48c0-8e9e-a2ce3b969100 None admin] SCRIPT_NAME: `/identity` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:42:30.681539 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12f3a65d-4df5-48c0-8e9e-a2ce3b969100 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:42:30.692081 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12f3a65d-4df5-48c0-8e9e-a2ce3b969100 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=82026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:42:30.693529 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12f3a65d-4df5-48c0-8e9e-a2ce3b969100 None admin] RBAC: Authorization granted {{(pid=82026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:42:30.697506 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2093368c-fa89-46de-97c5-d82bb15df55c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57539b6a6f3b4d589f5f5e1d211cd6a0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82025) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:42:30.698110 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2093368c-fa89-46de-97c5-d82bb15df55c None admin] REQUEST_METHOD: `GET` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:42:30.698387 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2093368c-fa89-46de-97c5-d82bb15df55c None admin] SCRIPT_NAME: `/identity` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:42:30.698660 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2093368c-fa89-46de-97c5-d82bb15df55c None admin] PATH_INFO: `/v3/services` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:42:30.699307 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2093368c-fa89-46de-97c5-d82bb15df55c None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=82025) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 19:42:30.699610 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2093368c-fa89-46de-97c5-d82bb15df55c None admin] RBAC: Authorizing `identity:list_services()` {{(pid=82025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:42:30.701347 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2093368c-fa89-46de-97c5-d82bb15df55c None admin] RBAC: Authorization granted {{(pid=82025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:42:30.713162 dv-cinder-828806-6-smb devstack@keystone.service[82025]: [pid: 82025|app: 0|req: 424/846] 10.222.0.33 () {56 vars in 1114 bytes} [Tue Sep 13 19:42:30 2022] GET /identity/v3/services?type=volumev3 => generated 125 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 19:42:30.713162 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa6bff26-e42e-43ef-a116-7af5ae030895 None None] REQUEST_METHOD: `GET` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:42:30.713162 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa6bff26-e42e-43ef-a116-7af5ae030895 None None] SCRIPT_NAME: `/identity` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:42:30.713499 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application [None req-12f3a65d-4df5-48c0-8e9e-a2ce3b969100 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 13 19:42:30.713499 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 19:42:30.713499 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 19:42:30.713499 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 19:42:30.713499 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 19:42:30.713499 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 19:42:30.713499 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 19:42:30.713499 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 19:42:30.713499 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 19:42:30.713499 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 19:42:30.713499 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 19:42:30.713499 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 19:42:30.713499 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 13 19:42:30.713499 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 13 19:42:30.713499 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 13 19:42:30.713499 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 13 19:42:30.714392 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 19:42:30.714392 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 19:42:30.714392 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 19:42:30.714392 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 19:42:30.714392 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 19:42:30.714392 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 19:42:30.714392 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 19:42:30.714392 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application with Lock( Sep 13 19:42:30.714392 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 19:42:30.714392 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application return self._enter() Sep 13 19:42:30.714392 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 19:42:30.714392 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 19:42:30.714392 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 19:42:30.714392 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application return self.creator() Sep 13 19:42:30.714392 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 19:42:30.714392 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application created_value = creator( Sep 13 19:42:30.714392 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 13 19:42:30.715360 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 13 19:42:30.715360 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 13 19:42:30.715360 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application Sep 13 19:42:30.715546 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa6bff26-e42e-43ef-a116-7af5ae030895 None None] PATH_INFO: `/` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:42:30.715546 dv-cinder-828806-6-smb devstack@keystone.service[82025]: [pid: 82025|app: 0|req: 425/848] 10.222.0.33 () {54 vars in 927 bytes} [Tue Sep 13 19:42:30 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 19:42:30.715682 dv-cinder-828806-6-smb devstack@keystone.service[82026]: [pid: 82026|app: 0|req: 423/848] 10.222.0.33 () {56 vars in 1108 bytes} [Tue Sep 13 19:42:30 2022] GET /identity/v3/domains/Default => generated 87 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 19:42:30.715759 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7505ce8c-7cb3-4375-8054-87317dad5425 None None] REQUEST_METHOD: `POST` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:42:30.715759 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7505ce8c-7cb3-4375-8054-87317dad5425 None None] SCRIPT_NAME: `/identity` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:42:30.715759 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7505ce8c-7cb3-4375-8054-87317dad5425 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:42:30.730919 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12f3a65d-4df5-48c0-8e9e-a2ce3b969100 None admin] Authenticating user token {{(pid=82026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:42:30.734802 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.auth.core [None req-7505ce8c-7cb3-4375-8054-87317dad5425 None None] MFA Rules not processed for user `57539b6a6f3b4d589f5f5e1d211cd6a0`. Rule list: `[]` (Enabled: `True`). {{(pid=82025) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 19:42:30.736416 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.fernet_utils [None req-7505ce8c-7cb3-4375-8054-87317dad5425 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82025) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 19:42:30.771774 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG dbcounter [-] [82025] Writing DB stats keystone:SELECT=100 {{(pid=82025) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:42:30.840248 dv-cinder-828806-6-smb devstack@keystone.service[82025]: [pid: 82025|app: 0|req: 426/849] 10.222.0.33 () {58 vars in 1024 bytes} [Tue Sep 13 19:42:30 2022] POST /identity/v3/auth/tokens => generated 1161 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 13 19:42:30.866220 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12f3a65d-4df5-48c0-8e9e-a2ce3b969100 None admin] Validating token access rules against request {{(pid=82026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:42:30.898395 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG dbcounter [-] [82026] Writing DB stats keystone:SELECT=100 {{(pid=82026) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:42:30.909940 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e2144f1-690f-45a7-8dfd-27cb3d609d89 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57539b6a6f3b4d589f5f5e1d211cd6a0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:42:30.912070 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e2144f1-690f-45a7-8dfd-27cb3d609d89 None admin] REQUEST_METHOD: `GET` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:42:30.912070 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e2144f1-690f-45a7-8dfd-27cb3d609d89 None admin] SCRIPT_NAME: `/identity` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:42:30.912070 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e2144f1-690f-45a7-8dfd-27cb3d609d89 None admin] PATH_INFO: `/v3/domains` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:42:30.912070 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e2144f1-690f-45a7-8dfd-27cb3d609d89 None admin] RBAC: Adding query filter params (name=Default) {{(pid=82026) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 19:42:30.912331 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e2144f1-690f-45a7-8dfd-27cb3d609d89 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:42:30.913614 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e2144f1-690f-45a7-8dfd-27cb3d609d89 None admin] RBAC: Authorization granted {{(pid=82026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:42:30.927083 dv-cinder-828806-6-smb devstack@keystone.service[82026]: [pid: 82026|app: 0|req: 424/850] 10.222.0.33 () {56 vars in 1109 bytes} [Tue Sep 13 19:42:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 19:42:30.932494 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7505ce8c-7cb3-4375-8054-87317dad5425 None None] Authenticating user token {{(pid=82025) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:42:31.041259 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7505ce8c-7cb3-4375-8054-87317dad5425 None None] Validating token access rules against request {{(pid=82025) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:42:31.077172 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d86d22f7-0e28-426e-b0bd-92a5bde58ab7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57539b6a6f3b4d589f5f5e1d211cd6a0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82025) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:42:31.077802 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d86d22f7-0e28-426e-b0bd-92a5bde58ab7 None admin] REQUEST_METHOD: `GET` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:42:31.078076 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d86d22f7-0e28-426e-b0bd-92a5bde58ab7 None admin] SCRIPT_NAME: `/identity` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:42:31.078351 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d86d22f7-0e28-426e-b0bd-92a5bde58ab7 None admin] PATH_INFO: `/v3/projects/service` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:42:31.085605 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d86d22f7-0e28-426e-b0bd-92a5bde58ab7 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=82025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:42:31.087070 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d86d22f7-0e28-426e-b0bd-92a5bde58ab7 None admin] RBAC: Authorization granted {{(pid=82025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:42:31.098648 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application [None req-d86d22f7-0e28-426e-b0bd-92a5bde58ab7 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 13 19:42:31.098648 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 19:42:31.098648 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 19:42:31.098648 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 19:42:31.098648 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 19:42:31.098648 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 19:42:31.098648 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 19:42:31.098648 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 19:42:31.098648 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 19:42:31.098648 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 19:42:31.098648 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 19:42:31.098648 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 19:42:31.098648 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 13 19:42:31.098648 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 13 19:42:31.098648 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 13 19:42:31.099574 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 13 19:42:31.099574 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 19:42:31.099574 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 19:42:31.099574 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 19:42:31.099574 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 19:42:31.099574 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 19:42:31.099574 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 19:42:31.099574 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 19:42:31.099574 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application with Lock( Sep 13 19:42:31.099574 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 19:42:31.099574 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application return self._enter() Sep 13 19:42:31.099574 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 19:42:31.099574 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 19:42:31.099574 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 19:42:31.099574 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application return self.creator() Sep 13 19:42:31.099574 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 19:42:31.099574 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application created_value = creator( Sep 13 19:42:31.100463 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 13 19:42:31.100463 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 13 19:42:31.100463 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 13 19:42:31.100463 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 13 19:42:31.100463 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 13 19:42:31.100463 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 13 19:42:31.100463 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 13 19:42:31.100463 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application Sep 13 19:42:31.100463 dv-cinder-828806-6-smb devstack@keystone.service[82025]: [pid: 82025|app: 0|req: 427/851] 10.222.0.33 () {56 vars in 1111 bytes} [Tue Sep 13 19:42:30 2022] GET /identity/v3/projects/service => generated 88 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 19:42:31.105788 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e2144f1-690f-45a7-8dfd-27cb3d609d89 None admin] Authenticating user token {{(pid=82026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:42:31.146276 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d86d22f7-0e28-426e-b0bd-92a5bde58ab7 None admin] Authenticating user token {{(pid=82025) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:42:31.167340 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG dbcounter [-] [82025] Writing DB stats keystone:SELECT=100 {{(pid=82025) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:42:31.248444 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e2144f1-690f-45a7-8dfd-27cb3d609d89 None admin] Validating token access rules against request {{(pid=82026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:42:31.284222 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d86d22f7-0e28-426e-b0bd-92a5bde58ab7 None admin] Validating token access rules against request {{(pid=82025) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:42:31.309018 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-414f73bf-4c9c-4c75-9479-8a451a626311 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57539b6a6f3b4d589f5f5e1d211cd6a0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:42:31.309634 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-414f73bf-4c9c-4c75-9479-8a451a626311 None admin] REQUEST_METHOD: `GET` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:42:31.309917 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-414f73bf-4c9c-4c75-9479-8a451a626311 None admin] SCRIPT_NAME: `/identity` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:42:31.310195 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-414f73bf-4c9c-4c75-9479-8a451a626311 None admin] PATH_INFO: `/v3/projects` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:42:31.310894 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-414f73bf-4c9c-4c75-9479-8a451a626311 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=82026) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 19:42:31.311244 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-414f73bf-4c9c-4c75-9479-8a451a626311 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=82026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:42:31.312685 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-414f73bf-4c9c-4c75-9479-8a451a626311 None admin] RBAC: Authorization granted {{(pid=82026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:42:31.329866 dv-cinder-828806-6-smb devstack@keystone.service[82026]: [pid: 82026|app: 0|req: 425/852] 10.222.0.33 () {56 vars in 1148 bytes} [Tue Sep 13 19:42:31 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 224 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 19:42:31.335535 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-414f73bf-4c9c-4c75-9479-8a451a626311 None admin] Authenticating user token {{(pid=82026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:42:31.338432 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53865340-933f-461b-8488-1a1bc1965657 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57539b6a6f3b4d589f5f5e1d211cd6a0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82025) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:42:31.339305 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53865340-933f-461b-8488-1a1bc1965657 None admin] REQUEST_METHOD: `GET` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:42:31.339601 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53865340-933f-461b-8488-1a1bc1965657 None admin] SCRIPT_NAME: `/identity` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:42:31.339877 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53865340-933f-461b-8488-1a1bc1965657 None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:42:31.340469 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53865340-933f-461b-8488-1a1bc1965657 None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=82025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:42:31.342745 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53865340-933f-461b-8488-1a1bc1965657 None admin] RBAC: Authorization granted {{(pid=82025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:42:31.354990 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application [None req-53865340-933f-461b-8488-1a1bc1965657 None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Sep 13 19:42:31.354990 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 19:42:31.354990 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 13 19:42:31.354990 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 13 19:42:31.354990 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 13 19:42:31.354990 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 13 19:42:31.354990 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 13 19:42:31.354990 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 13 19:42:31.354990 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Sep 13 19:42:31.354990 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application Sep 13 19:42:31.354990 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 13 19:42:31.354990 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application Sep 13 19:42:31.354990 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 19:42:31.354990 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 19:42:31.354990 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 19:42:31.354990 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 19:42:31.356080 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 19:42:31.356080 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 19:42:31.356080 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 19:42:31.356080 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 19:42:31.356080 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 19:42:31.356080 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 19:42:31.356080 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 19:42:31.356080 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 13 19:42:31.356080 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 13 19:42:31.356080 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 13 19:42:31.356080 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 13 19:42:31.356080 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 19:42:31.356080 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 19:42:31.356080 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 19:42:31.356080 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 19:42:31.356080 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 19:42:31.356080 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 19:42:31.356983 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 19:42:31.356983 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application with Lock( Sep 13 19:42:31.356983 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 19:42:31.356983 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application return self._enter() Sep 13 19:42:31.356983 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 19:42:31.356983 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 19:42:31.356983 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 19:42:31.356983 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application return self.creator() Sep 13 19:42:31.356983 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 19:42:31.356983 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application created_value = creator( Sep 13 19:42:31.356983 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 13 19:42:31.356983 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 13 19:42:31.356983 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Sep 13 19:42:31.356983 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application Sep 13 19:42:31.362480 dv-cinder-828806-6-smb devstack@keystone.service[82025]: [pid: 82025|app: 0|req: 428/853] 10.222.0.33 () {56 vars in 1132 bytes} [Tue Sep 13 19:42:31 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 216 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 13 19:42:31.364098 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53865340-933f-461b-8488-1a1bc1965657 None admin] Authenticating user token {{(pid=82025) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:42:31.408900 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG dbcounter [-] [82026] Writing DB stats keystone:SELECT=100 {{(pid=82026) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:42:31.475314 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG dbcounter [-] [82025] Writing DB stats keystone:SELECT=100 {{(pid=82025) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:42:31.482123 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-414f73bf-4c9c-4c75-9479-8a451a626311 None admin] Validating token access rules against request {{(pid=82026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:42:31.495188 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53865340-933f-461b-8488-1a1bc1965657 None admin] Validating token access rules against request {{(pid=82025) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:42:31.524613 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00a68bd0-83f6-4547-b16b-ab5e5a6ff573 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57539b6a6f3b4d589f5f5e1d211cd6a0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:42:31.525212 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00a68bd0-83f6-4547-b16b-ab5e5a6ff573 None admin] REQUEST_METHOD: `GET` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:42:31.525489 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00a68bd0-83f6-4547-b16b-ab5e5a6ff573 None admin] SCRIPT_NAME: `/identity` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:42:31.525766 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00a68bd0-83f6-4547-b16b-ab5e5a6ff573 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:42:31.526492 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00a68bd0-83f6-4547-b16b-ab5e5a6ff573 None admin] RBAC: Adding query filter params (role.id=e5af7d5baa93469e9e486ef21c85474e, scope.project.id=c8c6fba0f15b4d6a84ff601919b7b8e4, user.id=fa5a83574f7f424c805e130c462d5969) {{(pid=82026) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 19:42:31.526803 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00a68bd0-83f6-4547-b16b-ab5e5a6ff573 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=82026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:42:31.528273 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00a68bd0-83f6-4547-b16b-ab5e5a6ff573 None admin] RBAC: Authorization granted {{(pid=82026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:42:31.532063 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c050941-d5e8-498f-8171-5d3dbc53a00b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57539b6a6f3b4d589f5f5e1d211cd6a0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82025) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:42:31.532744 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c050941-d5e8-498f-8171-5d3dbc53a00b None admin] REQUEST_METHOD: `GET` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:42:31.532958 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c050941-d5e8-498f-8171-5d3dbc53a00b None admin] SCRIPT_NAME: `/identity` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:42:31.533238 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c050941-d5e8-498f-8171-5d3dbc53a00b None admin] PATH_INFO: `/v3/services` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:42:31.534132 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c050941-d5e8-498f-8171-5d3dbc53a00b None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=82025) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 19:42:31.534440 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c050941-d5e8-498f-8171-5d3dbc53a00b None admin] RBAC: Authorizing `identity:list_services()` {{(pid=82025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:42:31.534957 dv-cinder-828806-6-smb devstack@keystone.service[82026]: [pid: 82026|app: 0|req: 426/854] 10.222.0.33 () {56 vars in 1374 bytes} [Tue Sep 13 19:42:31 2022] GET /identity/v3/role_assignments?user.id=fa5a83574f7f424c805e130c462d5969&scope.project.id=c8c6fba0f15b4d6a84ff601919b7b8e4&role.id=e5af7d5baa93469e9e486ef21c85474e => generated 608 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 13 19:42:31.535974 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c050941-d5e8-498f-8171-5d3dbc53a00b None admin] RBAC: Authorization granted {{(pid=82025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:42:31.540605 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff6ce71b-8fdc-4716-84f0-d34fd1702cf5 None None] REQUEST_METHOD: `GET` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:42:31.541182 dv-cinder-828806-6-smb devstack@keystone.service[82025]: [pid: 82025|app: 0|req: 429/855] 10.222.0.33 () {56 vars in 1126 bytes} [Tue Sep 13 19:42:31 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 19:42:31.541347 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff6ce71b-8fdc-4716-84f0-d34fd1702cf5 None None] SCRIPT_NAME: `/identity` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:42:31.541647 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff6ce71b-8fdc-4716-84f0-d34fd1702cf5 None None] PATH_INFO: `/` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:42:31.543307 dv-cinder-828806-6-smb devstack@keystone.service[82026]: [pid: 82026|app: 0|req: 427/856] 10.222.0.33 () {54 vars in 927 bytes} [Tue Sep 13 19:42:31 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 19:42:31.549453 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfd4cc14-04c5-467c-9daa-4d6e3efdabff None None] REQUEST_METHOD: `POST` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:42:31.549807 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfd4cc14-04c5-467c-9daa-4d6e3efdabff None None] SCRIPT_NAME: `/identity` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:42:31.550170 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfd4cc14-04c5-467c-9daa-4d6e3efdabff None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:42:31.553157 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff6ce71b-8fdc-4716-84f0-d34fd1702cf5 None None] Authenticating user token {{(pid=82026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:42:31.579803 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.auth.core [None req-cfd4cc14-04c5-467c-9daa-4d6e3efdabff None None] MFA Rules not processed for user `57539b6a6f3b4d589f5f5e1d211cd6a0`. Rule list: `[]` (Enabled: `True`). {{(pid=82025) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 19:42:31.581630 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.fernet_utils [None req-cfd4cc14-04c5-467c-9daa-4d6e3efdabff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82025) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 19:42:31.677167 dv-cinder-828806-6-smb devstack@keystone.service[82025]: [pid: 82025|app: 0|req: 430/857] 10.222.0.33 () {58 vars in 1024 bytes} [Tue Sep 13 19:42:31 2022] POST /identity/v3/auth/tokens => generated 1161 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 13 19:42:31.714505 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff6ce71b-8fdc-4716-84f0-d34fd1702cf5 None None] Validating token access rules against request {{(pid=82026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:42:31.727706 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG dbcounter [-] [82026] Writing DB stats keystone:SELECT=100 {{(pid=82026) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:42:31.753339 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c5a701c-0e9a-4ef3-8ecf-b527cca380e9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57539b6a6f3b4d589f5f5e1d211cd6a0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:42:31.754011 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c5a701c-0e9a-4ef3-8ecf-b527cca380e9 None admin] REQUEST_METHOD: `GET` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:42:31.754301 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c5a701c-0e9a-4ef3-8ecf-b527cca380e9 None admin] SCRIPT_NAME: `/identity` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:42:31.754578 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c5a701c-0e9a-4ef3-8ecf-b527cca380e9 None admin] PATH_INFO: `/v3/services` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:42:31.755337 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c5a701c-0e9a-4ef3-8ecf-b527cca380e9 None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=82026) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 19:42:31.755643 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c5a701c-0e9a-4ef3-8ecf-b527cca380e9 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=82026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:42:31.757024 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c5a701c-0e9a-4ef3-8ecf-b527cca380e9 None admin] RBAC: Authorization granted {{(pid=82026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:42:31.767420 dv-cinder-828806-6-smb devstack@keystone.service[82026]: [pid: 82026|app: 0|req: 428/858] 10.222.0.33 () {56 vars in 1126 bytes} [Tue Sep 13 19:42:31 2022] GET /identity/v3/services?type=compute_legacy => generated 131 bytes in 215 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 13 19:42:31.973443 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfd4cc14-04c5-467c-9daa-4d6e3efdabff None None] Authenticating user token {{(pid=82025) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:42:32.058086 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG dbcounter [-] [82025] Writing DB stats keystone:SELECT=100 {{(pid=82025) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:42:32.083524 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfd4cc14-04c5-467c-9daa-4d6e3efdabff None None] Validating token access rules against request {{(pid=82025) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:42:32.120636 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6b2d278-9952-4aa0-98ea-07c5bb3750a4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57539b6a6f3b4d589f5f5e1d211cd6a0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82025) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:42:32.121273 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6b2d278-9952-4aa0-98ea-07c5bb3750a4 None admin] REQUEST_METHOD: `GET` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:42:32.122142 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6b2d278-9952-4aa0-98ea-07c5bb3750a4 None admin] SCRIPT_NAME: `/identity` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:42:32.122477 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6b2d278-9952-4aa0-98ea-07c5bb3750a4 None admin] PATH_INFO: `/v3/roles/service` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:42:32.133475 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6b2d278-9952-4aa0-98ea-07c5bb3750a4 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=82025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 13 19:42:32.138298 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application [None req-a6b2d278-9952-4aa0-98ea-07c5bb3750a4 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 13 19:42:32.138298 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 19:42:32.138298 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 19:42:32.138298 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 19:42:32.138298 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 19:42:32.138298 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 19:42:32.138298 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 19:42:32.138298 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 19:42:32.138298 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 19:42:32.138298 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 19:42:32.138298 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 19:42:32.138298 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 19:42:32.138298 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 13 19:42:32.138298 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 13 19:42:32.138298 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 13 19:42:32.138298 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 13 19:42:32.139260 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 13 19:42:32.139260 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 13 19:42:32.139260 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 13 19:42:32.139260 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 13 19:42:32.139260 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 19:42:32.139260 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 19:42:32.139260 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 19:42:32.139260 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 19:42:32.139260 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 19:42:32.139260 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 19:42:32.139260 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 19:42:32.139260 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application with Lock( Sep 13 19:42:32.139260 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 19:42:32.139260 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application return self._enter() Sep 13 19:42:32.139260 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 19:42:32.139260 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 19:42:32.140489 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 19:42:32.140489 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application return self.creator() Sep 13 19:42:32.140489 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 19:42:32.140489 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application created_value = creator( Sep 13 19:42:32.140489 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 13 19:42:32.140489 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 13 19:42:32.140489 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 13 19:42:32.140489 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 13 19:42:32.140489 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 13 19:42:32.140489 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 13 19:42:32.140489 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 13 19:42:32.140489 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application Sep 13 19:42:32.140489 dv-cinder-828806-6-smb devstack@keystone.service[82025]: [pid: 82025|app: 0|req: 431/859] 10.222.0.33 () {56 vars in 1102 bytes} [Tue Sep 13 19:42:31 2022] GET /identity/v3/roles/service => generated 85 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 19:42:32.148141 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c5a701c-0e9a-4ef3-8ecf-b527cca380e9 None admin] Authenticating user token {{(pid=82026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:42:32.257796 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c5a701c-0e9a-4ef3-8ecf-b527cca380e9 None admin] Validating token access rules against request {{(pid=82026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:42:32.301472 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffef490c-7cce-40d9-afa6-c5a7aff16caf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57539b6a6f3b4d589f5f5e1d211cd6a0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:42:32.302105 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffef490c-7cce-40d9-afa6-c5a7aff16caf None admin] REQUEST_METHOD: `GET` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:42:32.302389 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffef490c-7cce-40d9-afa6-c5a7aff16caf None admin] SCRIPT_NAME: `/identity` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:42:32.302669 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffef490c-7cce-40d9-afa6-c5a7aff16caf None admin] PATH_INFO: `/v3/roles` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:42:32.303387 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffef490c-7cce-40d9-afa6-c5a7aff16caf None admin] RBAC: Adding query filter params (name=service) {{(pid=82026) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 19:42:32.303697 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffef490c-7cce-40d9-afa6-c5a7aff16caf None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:42:32.305087 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffef490c-7cce-40d9-afa6-c5a7aff16caf None admin] RBAC: Authorization granted {{(pid=82026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:42:32.315407 dv-cinder-828806-6-smb devstack@keystone.service[82026]: [pid: 82026|app: 0|req: 429/860] 10.222.0.33 () {56 vars in 1103 bytes} [Tue Sep 13 19:42:32 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 19:42:32.321082 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6b2d278-9952-4aa0-98ea-07c5bb3750a4 None admin] Authenticating user token {{(pid=82025) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:42:32.433361 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6b2d278-9952-4aa0-98ea-07c5bb3750a4 None admin] Validating token access rules against request {{(pid=82025) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:42:32.469252 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89f8a094-8d1b-4978-ba05-b134236ab2b7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57539b6a6f3b4d589f5f5e1d211cd6a0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82025) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:42:32.470236 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89f8a094-8d1b-4978-ba05-b134236ab2b7 None admin] REQUEST_METHOD: `GET` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:42:32.470685 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89f8a094-8d1b-4978-ba05-b134236ab2b7 None admin] SCRIPT_NAME: `/identity` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:42:32.470971 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89f8a094-8d1b-4978-ba05-b134236ab2b7 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:42:32.473970 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG dbcounter [-] [82025] Writing DB stats keystone:SELECT=100 {{(pid=82025) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:42:32.482346 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89f8a094-8d1b-4978-ba05-b134236ab2b7 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=82025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:42:32.483878 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89f8a094-8d1b-4978-ba05-b134236ab2b7 None admin] RBAC: Authorization granted {{(pid=82025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:42:32.499869 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application [None req-89f8a094-8d1b-4978-ba05-b134236ab2b7 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 13 19:42:32.499869 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 19:42:32.499869 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 19:42:32.499869 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 19:42:32.499869 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 19:42:32.499869 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 19:42:32.499869 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 19:42:32.499869 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 19:42:32.499869 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 19:42:32.499869 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 19:42:32.499869 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 19:42:32.499869 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 19:42:32.499869 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 13 19:42:32.499869 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 13 19:42:32.499869 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 13 19:42:32.499869 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 13 19:42:32.501662 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 19:42:32.501662 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 19:42:32.501662 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 19:42:32.501662 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 19:42:32.501662 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 19:42:32.501662 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 19:42:32.501662 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 19:42:32.501662 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application with Lock( Sep 13 19:42:32.501662 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 19:42:32.501662 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application return self._enter() Sep 13 19:42:32.501662 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 19:42:32.501662 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 19:42:32.501662 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 19:42:32.501662 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application return self.creator() Sep 13 19:42:32.501662 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 19:42:32.501662 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application created_value = creator( Sep 13 19:42:32.501662 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 13 19:42:32.503112 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 13 19:42:32.503112 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 13 19:42:32.503112 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application Sep 13 19:42:32.503112 dv-cinder-828806-6-smb devstack@keystone.service[82025]: [pid: 82025|app: 0|req: 432/861] 10.222.0.33 () {56 vars in 1108 bytes} [Tue Sep 13 19:42:32 2022] GET /identity/v3/domains/Default => generated 87 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 19:42:32.508203 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffef490c-7cce-40d9-afa6-c5a7aff16caf None admin] Authenticating user token {{(pid=82026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:42:32.545800 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG dbcounter [-] [82026] Writing DB stats keystone:SELECT=100 {{(pid=82026) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:42:32.617390 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffef490c-7cce-40d9-afa6-c5a7aff16caf None admin] Validating token access rules against request {{(pid=82026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:42:32.659717 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-285b943b-f65a-4af9-a153-b794f343587f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57539b6a6f3b4d589f5f5e1d211cd6a0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:42:32.660320 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-285b943b-f65a-4af9-a153-b794f343587f None admin] REQUEST_METHOD: `GET` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:42:32.660608 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-285b943b-f65a-4af9-a153-b794f343587f None admin] SCRIPT_NAME: `/identity` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:42:32.660872 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-285b943b-f65a-4af9-a153-b794f343587f None admin] PATH_INFO: `/v3/domains` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:42:32.661516 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-285b943b-f65a-4af9-a153-b794f343587f None admin] RBAC: Adding query filter params (name=Default) {{(pid=82026) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 19:42:32.661822 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-285b943b-f65a-4af9-a153-b794f343587f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:42:32.663211 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-285b943b-f65a-4af9-a153-b794f343587f None admin] RBAC: Authorization granted {{(pid=82026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:42:32.675974 dv-cinder-828806-6-smb devstack@keystone.service[82026]: [pid: 82026|app: 0|req: 430/862] 10.222.0.33 () {56 vars in 1109 bytes} [Tue Sep 13 19:42:32 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 19:42:32.681226 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89f8a094-8d1b-4978-ba05-b134236ab2b7 None admin] Authenticating user token {{(pid=82025) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:42:32.790689 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89f8a094-8d1b-4978-ba05-b134236ab2b7 None admin] Validating token access rules against request {{(pid=82025) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:42:32.825894 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5874579-8fe5-4d1c-a060-9a93db7be61b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57539b6a6f3b4d589f5f5e1d211cd6a0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82025) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:42:32.826536 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5874579-8fe5-4d1c-a060-9a93db7be61b None admin] REQUEST_METHOD: `GET` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:42:32.826820 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5874579-8fe5-4d1c-a060-9a93db7be61b None admin] SCRIPT_NAME: `/identity` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:42:32.827125 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5874579-8fe5-4d1c-a060-9a93db7be61b None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:42:32.836354 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5874579-8fe5-4d1c-a060-9a93db7be61b None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=82025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:42:32.837839 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5874579-8fe5-4d1c-a060-9a93db7be61b None admin] RBAC: Authorization granted {{(pid=82025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:42:32.851907 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application [None req-c5874579-8fe5-4d1c-a060-9a93db7be61b None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Sep 13 19:42:32.851907 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 19:42:32.851907 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 19:42:32.851907 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 19:42:32.851907 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 19:42:32.851907 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 19:42:32.851907 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 19:42:32.851907 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 19:42:32.851907 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 19:42:32.851907 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 19:42:32.851907 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 19:42:32.851907 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 19:42:32.851907 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 13 19:42:32.851907 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 13 19:42:32.851907 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 13 19:42:32.851907 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 13 19:42:32.852934 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 19:42:32.852934 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 19:42:32.852934 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 13 19:42:32.852934 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 13 19:42:32.852934 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 13 19:42:32.852934 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 13 19:42:32.852934 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 19:42:32.852934 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 19:42:32.852934 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 19:42:32.852934 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 19:42:32.852934 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 19:42:32.852934 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application with Lock( Sep 13 19:42:32.852934 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 19:42:32.852934 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application return self._enter() Sep 13 19:42:32.852934 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 19:42:32.852934 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 19:42:32.852934 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 19:42:32.852934 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application return self.creator() Sep 13 19:42:32.854299 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 19:42:32.854299 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application created_value = creator( Sep 13 19:42:32.854299 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 13 19:42:32.854299 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 13 19:42:32.854299 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 13 19:42:32.854299 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 13 19:42:32.854299 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 13 19:42:32.854299 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 13 19:42:32.854299 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Sep 13 19:42:32.854299 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application Sep 13 19:42:32.854299 dv-cinder-828806-6-smb devstack@keystone.service[82025]: [pid: 82025|app: 0|req: 433/863] 10.222.0.33 () {56 vars in 1117 bytes} [Tue Sep 13 19:42:32 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 19:42:32.859498 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-285b943b-f65a-4af9-a153-b794f343587f None admin] Authenticating user token {{(pid=82026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:42:32.958970 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd1b74e8-1dac-47df-a76c-adecbf956d07 None None] REQUEST_METHOD: `GET` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:42:32.959289 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd1b74e8-1dac-47df-a76c-adecbf956d07 None None] SCRIPT_NAME: `/identity` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:42:32.959479 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd1b74e8-1dac-47df-a76c-adecbf956d07 None None] PATH_INFO: `/` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:42:32.961037 dv-cinder-828806-6-smb devstack@keystone.service[82025]: [pid: 82025|app: 0|req: 434/864] 10.222.0.33 () {54 vars in 927 bytes} [Tue Sep 13 19:42:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 19:42:32.961171 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG dbcounter [-] [82026] Writing DB stats keystone:SELECT=100 {{(pid=82026) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:42:32.966147 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36c1f52c-078b-4f81-a643-414164b06bd3 None None] REQUEST_METHOD: `POST` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:42:32.966430 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36c1f52c-078b-4f81-a643-414164b06bd3 None None] SCRIPT_NAME: `/identity` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:42:32.966708 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36c1f52c-078b-4f81-a643-414164b06bd3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:42:32.968260 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-285b943b-f65a-4af9-a153-b794f343587f None admin] Validating token access rules against request {{(pid=82026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:42:32.986771 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.auth.core [None req-36c1f52c-078b-4f81-a643-414164b06bd3 None None] MFA Rules not processed for user `57539b6a6f3b4d589f5f5e1d211cd6a0`. Rule list: `[]` (Enabled: `True`). {{(pid=82025) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 19:42:32.987893 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.fernet_utils [None req-36c1f52c-078b-4f81-a643-414164b06bd3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82025) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 19:42:33.015453 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f65ad9f-60e2-441e-83f0-b6575af462e7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57539b6a6f3b4d589f5f5e1d211cd6a0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:42:33.016694 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f65ad9f-60e2-441e-83f0-b6575af462e7 None admin] REQUEST_METHOD: `GET` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:42:33.017501 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f65ad9f-60e2-441e-83f0-b6575af462e7 None admin] SCRIPT_NAME: `/identity` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:42:33.017934 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f65ad9f-60e2-441e-83f0-b6575af462e7 None admin] PATH_INFO: `/v3/users` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:42:33.019457 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f65ad9f-60e2-441e-83f0-b6575af462e7 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=82026) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 19:42:33.019917 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f65ad9f-60e2-441e-83f0-b6575af462e7 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=82026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:42:33.022282 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f65ad9f-60e2-441e-83f0-b6575af462e7 None admin] RBAC: Authorization granted {{(pid=82026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:42:33.037258 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG dbcounter [-] [82025] Writing DB stats keystone:SELECT=100 {{(pid=82025) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:42:33.046199 dv-cinder-828806-6-smb devstack@keystone.service[82026]: [pid: 82026|app: 0|req: 431/865] 10.222.0.33 () {56 vars in 1149 bytes} [Tue Sep 13 19:42:32 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 19:42:33.052398 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f65ad9f-60e2-441e-83f0-b6575af462e7 None admin] Authenticating user token {{(pid=82026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:42:33.071077 dv-cinder-828806-6-smb devstack@keystone.service[82025]: [pid: 82025|app: 0|req: 435/866] 10.222.0.33 () {58 vars in 1024 bytes} [Tue Sep 13 19:42:32 2022] POST /identity/v3/auth/tokens => generated 1161 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 13 19:42:33.162730 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f65ad9f-60e2-441e-83f0-b6575af462e7 None admin] Validating token access rules against request {{(pid=82026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:42:33.197825 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06dc8437-118f-4a72-8ffd-09147ff5b860 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57539b6a6f3b4d589f5f5e1d211cd6a0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:42:33.198666 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06dc8437-118f-4a72-8ffd-09147ff5b860 None admin] REQUEST_METHOD: `GET` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:42:33.199127 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06dc8437-118f-4a72-8ffd-09147ff5b860 None admin] SCRIPT_NAME: `/identity` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:42:33.199549 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06dc8437-118f-4a72-8ffd-09147ff5b860 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:42:33.225514 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG dbcounter [-] [82026] Writing DB stats keystone:SELECT=100 {{(pid=82026) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:42:33.271880 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06dc8437-118f-4a72-8ffd-09147ff5b860 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=82026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:42:33.274187 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06dc8437-118f-4a72-8ffd-09147ff5b860 None admin] RBAC: Authorization granted {{(pid=82026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:42:33.353818 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36c1f52c-078b-4f81-a643-414164b06bd3 None None] Authenticating user token {{(pid=82025) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:42:33.380564 dv-cinder-828806-6-smb devstack@keystone.service[82026]: [pid: 82026|app: 0|req: 432/867] 10.222.0.33 () {58 vars in 1282 bytes} [Tue Sep 13 19:42:33 2022] GET /identity/v3/auth/tokens => generated 1161 bytes in 328 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Sep 13 19:42:33.386095 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06dc8437-118f-4a72-8ffd-09147ff5b860 None admin] Authenticating user token {{(pid=82026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:42:33.442428 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG dbcounter [-] [82026] Writing DB stats keystone:SELECT=100 {{(pid=82026) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:42:33.486045 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36c1f52c-078b-4f81-a643-414164b06bd3 None None] Validating token access rules against request {{(pid=82025) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:42:33.493129 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06dc8437-118f-4a72-8ffd-09147ff5b860 None admin] Validating token access rules against request {{(pid=82026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:42:33.525172 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2498d653-7627-4ace-a46d-e35f1ec50adb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57539b6a6f3b4d589f5f5e1d211cd6a0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82025) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:42:33.525789 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2498d653-7627-4ace-a46d-e35f1ec50adb None admin] REQUEST_METHOD: `POST` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:42:33.526066 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2498d653-7627-4ace-a46d-e35f1ec50adb None admin] SCRIPT_NAME: `/identity` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:42:33.526340 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2498d653-7627-4ace-a46d-e35f1ec50adb None admin] PATH_INFO: `/v3/services` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:42:33.526992 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2498d653-7627-4ace-a46d-e35f1ec50adb None admin] RBAC: Authorizing `identity:create_service()` {{(pid=82025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:42:33.528566 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2498d653-7627-4ace-a46d-e35f1ec50adb None admin] RBAC: Authorization granted {{(pid=82025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:42:33.540977 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1e859f5-64a7-4f13-a2dd-4a0a3a33bc35 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57539b6a6f3b4d589f5f5e1d211cd6a0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:42:33.541698 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1e859f5-64a7-4f13-a2dd-4a0a3a33bc35 None admin] REQUEST_METHOD: `GET` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:42:33.542054 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1e859f5-64a7-4f13-a2dd-4a0a3a33bc35 None admin] SCRIPT_NAME: `/identity` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:42:33.542401 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1e859f5-64a7-4f13-a2dd-4a0a3a33bc35 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:42:33.554440 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1e859f5-64a7-4f13-a2dd-4a0a3a33bc35 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=82026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:42:33.556014 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1e859f5-64a7-4f13-a2dd-4a0a3a33bc35 None admin] RBAC: Authorization granted {{(pid=82026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:42:33.571758 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application [None req-b1e859f5-64a7-4f13-a2dd-4a0a3a33bc35 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 13 19:42:33.571758 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 19:42:33.571758 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 19:42:33.571758 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 19:42:33.571758 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 19:42:33.571758 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 19:42:33.571758 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 19:42:33.571758 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 19:42:33.571758 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 19:42:33.571758 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 19:42:33.571758 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 19:42:33.571758 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 19:42:33.571758 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 13 19:42:33.571758 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 13 19:42:33.571758 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 13 19:42:33.571758 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 13 19:42:33.572749 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 19:42:33.572749 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 19:42:33.572749 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 19:42:33.572749 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 19:42:33.572749 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 19:42:33.572749 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 19:42:33.572749 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 19:42:33.572749 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application with Lock( Sep 13 19:42:33.572749 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 19:42:33.572749 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application return self._enter() Sep 13 19:42:33.572749 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 19:42:33.572749 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 19:42:33.572749 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 19:42:33.572749 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application return self.creator() Sep 13 19:42:33.572749 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 19:42:33.572749 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application created_value = creator( Sep 13 19:42:33.572749 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 13 19:42:33.573649 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 13 19:42:33.573649 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 13 19:42:33.573649 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application Sep 13 19:42:33.573649 dv-cinder-828806-6-smb devstack@keystone.service[82026]: [pid: 82026|app: 0|req: 433/868] 10.222.0.33 () {56 vars in 1108 bytes} [Tue Sep 13 19:42:33 2022] GET /identity/v3/domains/Default => generated 87 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 13 19:42:33.580246 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1e859f5-64a7-4f13-a2dd-4a0a3a33bc35 None admin] Authenticating user token {{(pid=82026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:42:33.627094 dv-cinder-828806-6-smb devstack@keystone.service[82025]: [pid: 82025|app: 0|req: 436/869] 10.222.0.33 () {60 vars in 1141 bytes} [Tue Sep 13 19:42:33 2022] POST /identity/v3/services => generated 251 bytes in 270 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 13 19:42:33.708269 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1e859f5-64a7-4f13-a2dd-4a0a3a33bc35 None admin] Validating token access rules against request {{(pid=82026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:42:33.716235 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG dbcounter [-] [82026] Writing DB stats keystone:SELECT=100 {{(pid=82026) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:42:33.756491 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ba2576d-2dea-4cad-8c81-a322950b4e7c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57539b6a6f3b4d589f5f5e1d211cd6a0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:42:33.757068 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ba2576d-2dea-4cad-8c81-a322950b4e7c None admin] REQUEST_METHOD: `GET` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:42:33.757356 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ba2576d-2dea-4cad-8c81-a322950b4e7c None admin] SCRIPT_NAME: `/identity` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:42:33.757634 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ba2576d-2dea-4cad-8c81-a322950b4e7c None admin] PATH_INFO: `/v3/domains` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:42:33.758364 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ba2576d-2dea-4cad-8c81-a322950b4e7c None admin] RBAC: Adding query filter params (name=Default) {{(pid=82026) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 19:42:33.758677 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ba2576d-2dea-4cad-8c81-a322950b4e7c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:42:33.760128 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ba2576d-2dea-4cad-8c81-a322950b4e7c None admin] RBAC: Authorization granted {{(pid=82026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:42:33.774832 dv-cinder-828806-6-smb devstack@keystone.service[82026]: [pid: 82026|app: 0|req: 434/870] 10.222.0.33 () {56 vars in 1109 bytes} [Tue Sep 13 19:42:33 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 19:42:33.780554 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2498d653-7627-4ace-a46d-e35f1ec50adb None admin] Authenticating user token {{(pid=82025) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:42:33.825969 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG dbcounter [-] [82025] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82025) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:42:33.895779 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2498d653-7627-4ace-a46d-e35f1ec50adb None admin] Validating token access rules against request {{(pid=82025) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:42:33.937712 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7033e02-41d5-4ec3-9142-0d6371a9b5e2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57539b6a6f3b4d589f5f5e1d211cd6a0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82025) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:42:33.940312 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7033e02-41d5-4ec3-9142-0d6371a9b5e2 None admin] REQUEST_METHOD: `GET` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:42:33.940312 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7033e02-41d5-4ec3-9142-0d6371a9b5e2 None admin] SCRIPT_NAME: `/identity` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:42:33.940520 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7033e02-41d5-4ec3-9142-0d6371a9b5e2 None admin] PATH_INFO: `/v3/projects/service` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:42:33.948218 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7033e02-41d5-4ec3-9142-0d6371a9b5e2 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=82025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:42:33.949653 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7033e02-41d5-4ec3-9142-0d6371a9b5e2 None admin] RBAC: Authorization granted {{(pid=82025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:42:33.962322 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application [None req-d7033e02-41d5-4ec3-9142-0d6371a9b5e2 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 13 19:42:33.962322 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 19:42:33.962322 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 19:42:33.962322 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 19:42:33.962322 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 19:42:33.962322 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 19:42:33.962322 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 19:42:33.962322 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 19:42:33.962322 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 19:42:33.962322 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 19:42:33.962322 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 19:42:33.962322 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 19:42:33.962322 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 13 19:42:33.962322 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 13 19:42:33.962322 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 13 19:42:33.963267 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 13 19:42:33.963267 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 19:42:33.963267 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 19:42:33.963267 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 19:42:33.963267 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 19:42:33.963267 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 19:42:33.963267 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 19:42:33.963267 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 19:42:33.963267 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application with Lock( Sep 13 19:42:33.963267 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 19:42:33.963267 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application return self._enter() Sep 13 19:42:33.963267 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 19:42:33.963267 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 19:42:33.963267 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 19:42:33.963267 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application return self.creator() Sep 13 19:42:33.963267 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 19:42:33.963267 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application created_value = creator( Sep 13 19:42:33.964195 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 13 19:42:33.964195 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 13 19:42:33.964195 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 13 19:42:33.964195 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 13 19:42:33.964195 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 13 19:42:33.964195 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 13 19:42:33.964195 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 13 19:42:33.964195 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application Sep 13 19:42:33.964195 dv-cinder-828806-6-smb devstack@keystone.service[82025]: [pid: 82025|app: 0|req: 437/871] 10.222.0.33 () {56 vars in 1111 bytes} [Tue Sep 13 19:42:33 2022] GET /identity/v3/projects/service => generated 88 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 19:42:33.969412 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ba2576d-2dea-4cad-8c81-a322950b4e7c None admin] Authenticating user token {{(pid=82026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:42:33.973683 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30575d3e-7476-49b5-8107-3e6485fc8ba3 None None] REQUEST_METHOD: `GET` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:42:33.973971 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30575d3e-7476-49b5-8107-3e6485fc8ba3 None None] SCRIPT_NAME: `/identity` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:42:33.974234 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30575d3e-7476-49b5-8107-3e6485fc8ba3 None None] PATH_INFO: `/` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:42:33.976919 dv-cinder-828806-6-smb devstack@keystone.service[82025]: [pid: 82025|app: 0|req: 438/872] 10.222.0.33 () {54 vars in 927 bytes} [Tue Sep 13 19:42:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 13 19:42:33.981036 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8549fa1-275b-4999-9b65-337462c29b45 None None] REQUEST_METHOD: `POST` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:42:33.981320 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8549fa1-275b-4999-9b65-337462c29b45 None None] SCRIPT_NAME: `/identity` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:42:33.981596 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8549fa1-275b-4999-9b65-337462c29b45 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:42:34.000307 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.auth.core [None req-c8549fa1-275b-4999-9b65-337462c29b45 None None] MFA Rules not processed for user `57539b6a6f3b4d589f5f5e1d211cd6a0`. Rule list: `[]` (Enabled: `True`). {{(pid=82025) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 19:42:34.002272 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.fernet_utils [None req-c8549fa1-275b-4999-9b65-337462c29b45 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82025) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 19:42:34.072616 dv-cinder-828806-6-smb devstack@keystone.service[82025]: [pid: 82025|app: 0|req: 439/873] 10.222.0.33 () {58 vars in 1024 bytes} [Tue Sep 13 19:42:33 2022] POST /identity/v3/auth/tokens => generated 1262 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 13 19:42:34.073692 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66949a07-a288-4c00-97a2-4fb68eb0e745 None None] REQUEST_METHOD: `GET` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:42:34.073983 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66949a07-a288-4c00-97a2-4fb68eb0e745 None None] SCRIPT_NAME: `/identity` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:42:34.074262 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66949a07-a288-4c00-97a2-4fb68eb0e745 None None] PATH_INFO: `/` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:42:34.075528 dv-cinder-828806-6-smb devstack@keystone.service[82025]: [pid: 82025|app: 0|req: 440/874] 10.222.0.33 () {54 vars in 927 bytes} [Tue Sep 13 19:42:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 19:42:34.089674 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9171b5f3-8322-433a-87a7-df179f07e85e None None] REQUEST_METHOD: `POST` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:42:34.089674 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9171b5f3-8322-433a-87a7-df179f07e85e None None] SCRIPT_NAME: `/identity` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:42:34.089674 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9171b5f3-8322-433a-87a7-df179f07e85e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:42:34.093325 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ba2576d-2dea-4cad-8c81-a322950b4e7c None admin] Validating token access rules against request {{(pid=82026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:42:34.109038 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.auth.core [None req-9171b5f3-8322-433a-87a7-df179f07e85e None None] MFA Rules not processed for user `57539b6a6f3b4d589f5f5e1d211cd6a0`. Rule list: `[]` (Enabled: `True`). {{(pid=82025) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 19:42:34.111279 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.fernet_utils [None req-9171b5f3-8322-433a-87a7-df179f07e85e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82025) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 19:42:34.135290 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89bab003-a21a-459b-8781-7adb57ea4d1e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57539b6a6f3b4d589f5f5e1d211cd6a0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:42:34.135898 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89bab003-a21a-459b-8781-7adb57ea4d1e None admin] REQUEST_METHOD: `GET` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:42:34.136179 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89bab003-a21a-459b-8781-7adb57ea4d1e None admin] SCRIPT_NAME: `/identity` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:42:34.136771 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89bab003-a21a-459b-8781-7adb57ea4d1e None admin] PATH_INFO: `/v3/projects` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:42:34.137891 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89bab003-a21a-459b-8781-7adb57ea4d1e None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=82026) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 19:42:34.138228 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89bab003-a21a-459b-8781-7adb57ea4d1e None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=82026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:42:34.139933 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89bab003-a21a-459b-8781-7adb57ea4d1e None admin] RBAC: Authorization granted {{(pid=82026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:42:34.140276 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG dbcounter [-] [82025] Writing DB stats keystone:SELECT=100 {{(pid=82025) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:42:34.162711 dv-cinder-828806-6-smb devstack@keystone.service[82026]: [pid: 82026|app: 0|req: 435/875] 10.222.0.33 () {56 vars in 1148 bytes} [Tue Sep 13 19:42:33 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 19:42:34.163679 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89bab003-a21a-459b-8781-7adb57ea4d1e None admin] Authenticating user token {{(pid=82026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:42:34.192932 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG dbcounter [-] [82026] Writing DB stats keystone:SELECT=100 {{(pid=82026) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:42:34.201018 dv-cinder-828806-6-smb devstack@keystone.service[82025]: [pid: 82025|app: 0|req: 441/876] 10.222.0.33 () {58 vars in 1024 bytes} [Tue Sep 13 19:42:34 2022] POST /identity/v3/auth/tokens => generated 1262 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 13 19:42:34.282785 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89bab003-a21a-459b-8781-7adb57ea4d1e None admin] Validating token access rules against request {{(pid=82026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:42:34.324058 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73faf59c-6c8a-43f4-943c-49b9ac1e675a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57539b6a6f3b4d589f5f5e1d211cd6a0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:42:34.324922 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73faf59c-6c8a-43f4-943c-49b9ac1e675a None admin] REQUEST_METHOD: `GET` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:42:34.325353 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73faf59c-6c8a-43f4-943c-49b9ac1e675a None admin] SCRIPT_NAME: `/identity` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:42:34.325786 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73faf59c-6c8a-43f4-943c-49b9ac1e675a None admin] PATH_INFO: `/v3/role_assignments` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:42:34.326667 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73faf59c-6c8a-43f4-943c-49b9ac1e675a None admin] RBAC: Adding query filter params (role.id=47ee826cd5f148c19f293f9470f906da, scope.project.id=c8c6fba0f15b4d6a84ff601919b7b8e4, user.id=a28e738b894442e2bc9880eeb64fc0c8) {{(pid=82026) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 19:42:34.327156 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73faf59c-6c8a-43f4-943c-49b9ac1e675a None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=82026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:42:34.328757 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73faf59c-6c8a-43f4-943c-49b9ac1e675a None admin] RBAC: Authorization granted {{(pid=82026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:42:34.335359 dv-cinder-828806-6-smb devstack@keystone.service[82026]: [pid: 82026|app: 0|req: 436/877] 10.222.0.33 () {56 vars in 1374 bytes} [Tue Sep 13 19:42:34 2022] GET /identity/v3/role_assignments?user.id=a28e738b894442e2bc9880eeb64fc0c8&scope.project.id=c8c6fba0f15b4d6a84ff601919b7b8e4&role.id=47ee826cd5f148c19f293f9470f906da => generated 608 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 19:42:34.356540 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9171b5f3-8322-433a-87a7-df179f07e85e None None] Authenticating user token {{(pid=82025) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:42:34.467704 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9171b5f3-8322-433a-87a7-df179f07e85e None None] Validating token access rules against request {{(pid=82025) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:42:34.496932 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73faf59c-6c8a-43f4-943c-49b9ac1e675a None admin] Authenticating user token {{(pid=82026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:42:34.510102 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-754edb62-9cce-4157-8244-3fd1fce4e49f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57539b6a6f3b4d589f5f5e1d211cd6a0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82025) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:42:34.510752 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-754edb62-9cce-4157-8244-3fd1fce4e49f None admin] REQUEST_METHOD: `GET` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:42:34.511077 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-754edb62-9cce-4157-8244-3fd1fce4e49f None admin] SCRIPT_NAME: `/identity` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:42:34.511338 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-754edb62-9cce-4157-8244-3fd1fce4e49f None admin] PATH_INFO: `/v3/services/object-store` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:42:34.512362 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-754edb62-9cce-4157-8244-3fd1fce4e49f None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=82025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:42:34.514198 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-754edb62-9cce-4157-8244-3fd1fce4e49f None admin] RBAC: Authorization granted {{(pid=82025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:42:34.525485 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application [None req-754edb62-9cce-4157-8244-3fd1fce4e49f None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Sep 13 19:42:34.525485 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 19:42:34.525485 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 13 19:42:34.525485 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 13 19:42:34.525485 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 13 19:42:34.525485 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 13 19:42:34.525485 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 13 19:42:34.525485 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 13 19:42:34.525485 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Sep 13 19:42:34.525485 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application Sep 13 19:42:34.525485 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 13 19:42:34.525485 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application Sep 13 19:42:34.525485 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 19:42:34.525485 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 19:42:34.525485 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 19:42:34.525485 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 19:42:34.525485 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 19:42:34.526513 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 19:42:34.526513 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 19:42:34.526513 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 19:42:34.526513 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 19:42:34.526513 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 19:42:34.526513 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 19:42:34.526513 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 13 19:42:34.526513 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 13 19:42:34.526513 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 13 19:42:34.526513 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 13 19:42:34.526513 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 19:42:34.526513 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 19:42:34.526513 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 19:42:34.526513 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 19:42:34.526513 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 19:42:34.526513 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 19:42:34.529650 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 19:42:34.529650 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application with Lock( Sep 13 19:42:34.529650 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 19:42:34.529650 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application return self._enter() Sep 13 19:42:34.529650 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 19:42:34.529650 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 19:42:34.529650 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 19:42:34.529650 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application return self.creator() Sep 13 19:42:34.529650 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 19:42:34.529650 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application created_value = creator( Sep 13 19:42:34.529650 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 13 19:42:34.529650 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 13 19:42:34.529650 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Sep 13 19:42:34.529650 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application Sep 13 19:42:34.529650 dv-cinder-828806-6-smb devstack@keystone.service[82025]: [pid: 82025|app: 0|req: 442/878] 10.222.0.33 () {56 vars in 1126 bytes} [Tue Sep 13 19:42:34 2022] GET /identity/v3/services/object-store => generated 93 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 19:42:34.533451 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-754edb62-9cce-4157-8244-3fd1fce4e49f None admin] Authenticating user token {{(pid=82025) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:42:34.565309 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG dbcounter [-] [82025] Writing DB stats keystone:SELECT=100 {{(pid=82025) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:42:34.605064 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG dbcounter [-] [82026] Writing DB stats keystone:SELECT=100 {{(pid=82026) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:42:34.624171 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73faf59c-6c8a-43f4-943c-49b9ac1e675a None admin] Validating token access rules against request {{(pid=82026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:42:34.664759 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-754edb62-9cce-4157-8244-3fd1fce4e49f None admin] Validating token access rules against request {{(pid=82025) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:42:34.669385 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e075375-9c54-434a-9d06-5a8f82ba20d4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57539b6a6f3b4d589f5f5e1d211cd6a0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:42:34.670215 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e075375-9c54-434a-9d06-5a8f82ba20d4 None admin] REQUEST_METHOD: `POST` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:42:34.670646 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e075375-9c54-434a-9d06-5a8f82ba20d4 None admin] SCRIPT_NAME: `/identity` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:42:34.671134 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e075375-9c54-434a-9d06-5a8f82ba20d4 None admin] PATH_INFO: `/v3/services` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:42:34.672444 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e075375-9c54-434a-9d06-5a8f82ba20d4 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=82026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:42:34.674169 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e075375-9c54-434a-9d06-5a8f82ba20d4 None admin] RBAC: Authorization granted {{(pid=82026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:42:34.708517 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd96ff84-9079-4d78-86c1-546da2268c48 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57539b6a6f3b4d589f5f5e1d211cd6a0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82025) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:42:34.709263 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd96ff84-9079-4d78-86c1-546da2268c48 None admin] REQUEST_METHOD: `GET` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:42:34.709616 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd96ff84-9079-4d78-86c1-546da2268c48 None admin] SCRIPT_NAME: `/identity` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:42:34.710030 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd96ff84-9079-4d78-86c1-546da2268c48 None admin] PATH_INFO: `/v3/services` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:42:34.710660 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd96ff84-9079-4d78-86c1-546da2268c48 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=82025) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 19:42:34.711049 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd96ff84-9079-4d78-86c1-546da2268c48 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=82025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:42:34.712529 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd96ff84-9079-4d78-86c1-546da2268c48 None admin] RBAC: Authorization granted {{(pid=82025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:42:34.719111 dv-cinder-828806-6-smb devstack@keystone.service[82025]: [pid: 82025|app: 0|req: 443/879] 10.222.0.33 () {56 vars in 1122 bytes} [Tue Sep 13 19:42:34 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 13 19:42:34.723204 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd96ff84-9079-4d78-86c1-546da2268c48 None admin] Authenticating user token {{(pid=82025) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:42:34.767353 dv-cinder-828806-6-smb devstack@keystone.service[82026]: [pid: 82026|app: 0|req: 437/880] 10.222.0.33 () {60 vars in 1141 bytes} [Tue Sep 13 19:42:34 2022] POST /identity/v3/services => generated 269 bytes in 263 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 13 19:42:34.832344 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG dbcounter [-] [82025] Writing DB stats keystone:SELECT=100 {{(pid=82025) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:42:34.849513 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd96ff84-9079-4d78-86c1-546da2268c48 None admin] Validating token access rules against request {{(pid=82025) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:42:34.895604 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-665881ff-999e-4b08-b002-d9db6e12ce24 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57539b6a6f3b4d589f5f5e1d211cd6a0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82025) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:42:34.896140 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-665881ff-999e-4b08-b002-d9db6e12ce24 None admin] REQUEST_METHOD: `GET` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:42:34.896419 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-665881ff-999e-4b08-b002-d9db6e12ce24 None admin] SCRIPT_NAME: `/identity` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:42:34.896690 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-665881ff-999e-4b08-b002-d9db6e12ce24 None admin] PATH_INFO: `/v3/services` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:42:34.897377 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-665881ff-999e-4b08-b002-d9db6e12ce24 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=82025) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 19:42:34.897684 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-665881ff-999e-4b08-b002-d9db6e12ce24 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=82025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:42:34.899064 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-665881ff-999e-4b08-b002-d9db6e12ce24 None admin] RBAC: Authorization granted {{(pid=82025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:42:34.911225 dv-cinder-828806-6-smb devstack@keystone.service[82025]: [pid: 82025|app: 0|req: 444/881] 10.222.0.33 () {56 vars in 1122 bytes} [Tue Sep 13 19:42:34 2022] GET /identity/v3/services?type=object-store => generated 129 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 13 19:42:35.997734 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd46214b-f3ce-4010-8bef-e7dcb4aeb155 None None] REQUEST_METHOD: `GET` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:42:35.998701 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd46214b-f3ce-4010-8bef-e7dcb4aeb155 None None] SCRIPT_NAME: `/identity` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:42:35.999212 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd46214b-f3ce-4010-8bef-e7dcb4aeb155 None None] PATH_INFO: `/` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:42:36.001039 dv-cinder-828806-6-smb devstack@keystone.service[82026]: [pid: 82026|app: 0|req: 438/882] 10.222.0.33 () {54 vars in 927 bytes} [Tue Sep 13 19:42:35 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 19:42:36.006533 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e9060d9-9f7e-45c3-bbc1-77d0845cbbc2 None None] REQUEST_METHOD: `POST` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:42:36.007347 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e9060d9-9f7e-45c3-bbc1-77d0845cbbc2 None None] SCRIPT_NAME: `/identity` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:42:36.007828 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e9060d9-9f7e-45c3-bbc1-77d0845cbbc2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:42:36.026236 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.auth.core [None req-5e9060d9-9f7e-45c3-bbc1-77d0845cbbc2 None None] MFA Rules not processed for user `57539b6a6f3b4d589f5f5e1d211cd6a0`. Rule list: `[]` (Enabled: `True`). {{(pid=82025) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 19:42:36.027743 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.fernet_utils [None req-5e9060d9-9f7e-45c3-bbc1-77d0845cbbc2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82025) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 19:42:36.100265 dv-cinder-828806-6-smb devstack@keystone.service[82025]: [pid: 82025|app: 0|req: 445/883] 10.222.0.33 () {58 vars in 1024 bytes} [Tue Sep 13 19:42:36 2022] POST /identity/v3/auth/tokens => generated 1372 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 13 19:42:36.373616 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd46214b-f3ce-4010-8bef-e7dcb4aeb155 None None] Authenticating user token {{(pid=82026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:42:36.484303 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd46214b-f3ce-4010-8bef-e7dcb4aeb155 None None] Validating token access rules against request {{(pid=82026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:42:36.521677 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58fdd2a1-cd1d-499d-8a35-fabce97dc4ef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57539b6a6f3b4d589f5f5e1d211cd6a0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:42:36.522706 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58fdd2a1-cd1d-499d-8a35-fabce97dc4ef None admin] REQUEST_METHOD: `GET` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:42:36.523231 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58fdd2a1-cd1d-499d-8a35-fabce97dc4ef None admin] SCRIPT_NAME: `/identity` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:42:36.523708 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58fdd2a1-cd1d-499d-8a35-fabce97dc4ef None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:42:36.524512 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58fdd2a1-cd1d-499d-8a35-fabce97dc4ef None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=82026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:42:36.526152 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58fdd2a1-cd1d-499d-8a35-fabce97dc4ef None admin] RBAC: Authorization granted {{(pid=82026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:42:36.536091 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application [None req-58fdd2a1-cd1d-499d-8a35-fabce97dc4ef None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Sep 13 19:42:36.536091 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 19:42:36.536091 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 13 19:42:36.536091 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 13 19:42:36.536091 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 13 19:42:36.536091 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 13 19:42:36.536091 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 13 19:42:36.536091 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 13 19:42:36.536091 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Sep 13 19:42:36.536091 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application Sep 13 19:42:36.536091 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 13 19:42:36.536091 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application Sep 13 19:42:36.536091 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 19:42:36.536091 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 19:42:36.536091 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 19:42:36.536091 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 19:42:36.536091 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 19:42:36.537064 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 19:42:36.537064 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 19:42:36.537064 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 19:42:36.537064 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 19:42:36.537064 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 19:42:36.537064 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 19:42:36.537064 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 13 19:42:36.537064 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 13 19:42:36.537064 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 13 19:42:36.537064 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 13 19:42:36.537064 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 19:42:36.537064 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 19:42:36.537064 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 19:42:36.537064 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 19:42:36.537064 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 19:42:36.537064 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 19:42:36.537905 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 19:42:36.537905 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application with Lock( Sep 13 19:42:36.537905 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 19:42:36.537905 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application return self._enter() Sep 13 19:42:36.537905 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 19:42:36.537905 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 19:42:36.537905 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 19:42:36.537905 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application return self.creator() Sep 13 19:42:36.537905 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 19:42:36.537905 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application created_value = creator( Sep 13 19:42:36.537905 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 13 19:42:36.537905 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 13 19:42:36.537905 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Sep 13 19:42:36.537905 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application Sep 13 19:42:36.540686 dv-cinder-828806-6-smb devstack@keystone.service[82026]: [pid: 82026|app: 0|req: 439/884] 10.222.0.33 () {56 vars in 1114 bytes} [Tue Sep 13 19:42:36 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 19:42:36.548578 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e9060d9-9f7e-45c3-bbc1-77d0845cbbc2 None None] Authenticating user token {{(pid=82025) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:42:36.633913 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG dbcounter [-] [82025] Writing DB stats keystone:SELECT=100 {{(pid=82025) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:42:36.658086 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e9060d9-9f7e-45c3-bbc1-77d0845cbbc2 None None] Validating token access rules against request {{(pid=82025) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:42:36.709500 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ea5d6d0-1c37-47ab-baf8-260c4ccd4022 None None] REQUEST_METHOD: `GET` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:42:36.710123 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-366894d2-939a-4f03-8f16-d623ff4b2ddd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57539b6a6f3b4d589f5f5e1d211cd6a0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82025) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:42:36.710388 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ea5d6d0-1c37-47ab-baf8-260c4ccd4022 None None] SCRIPT_NAME: `/identity` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:42:36.710732 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-366894d2-939a-4f03-8f16-d623ff4b2ddd None admin] REQUEST_METHOD: `GET` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:42:36.711016 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-366894d2-939a-4f03-8f16-d623ff4b2ddd None admin] SCRIPT_NAME: `/identity` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:42:36.711318 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-366894d2-939a-4f03-8f16-d623ff4b2ddd None admin] PATH_INFO: `/v3/services` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:42:36.711511 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ea5d6d0-1c37-47ab-baf8-260c4ccd4022 None None] PATH_INFO: `/` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:42:36.711955 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-366894d2-939a-4f03-8f16-d623ff4b2ddd None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=82025) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 19:42:36.712259 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-366894d2-939a-4f03-8f16-d623ff4b2ddd None admin] RBAC: Authorizing `identity:list_services()` {{(pid=82025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:42:36.713651 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-366894d2-939a-4f03-8f16-d623ff4b2ddd None admin] RBAC: Authorization granted {{(pid=82025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:42:36.713859 dv-cinder-828806-6-smb devstack@keystone.service[82026]: [pid: 82026|app: 0|req: 440/885] 10.222.0.33 () {54 vars in 927 bytes} [Tue Sep 13 19:42:36 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 19:42:36.719122 dv-cinder-828806-6-smb devstack@keystone.service[82025]: [pid: 82025|app: 0|req: 446/886] 10.222.0.33 () {56 vars in 1114 bytes} [Tue Sep 13 19:42:36 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 19:42:36.720243 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d667a91-305e-4980-a5d6-294ad880a9f5 None None] REQUEST_METHOD: `POST` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:42:36.720767 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d667a91-305e-4980-a5d6-294ad880a9f5 None None] SCRIPT_NAME: `/identity` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:42:36.720932 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d667a91-305e-4980-a5d6-294ad880a9f5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:42:36.728053 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-366894d2-939a-4f03-8f16-d623ff4b2ddd None admin] Authenticating user token {{(pid=82025) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:42:36.746879 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.auth.core [None req-9d667a91-305e-4980-a5d6-294ad880a9f5 None None] MFA Rules not processed for user `57539b6a6f3b4d589f5f5e1d211cd6a0`. Rule list: `[]` (Enabled: `True`). {{(pid=82026) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 19:42:36.748249 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.common.fernet_utils [None req-9d667a91-305e-4980-a5d6-294ad880a9f5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82026) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 19:42:36.751489 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG dbcounter [-] [82026] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82026) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:42:36.835663 dv-cinder-828806-6-smb devstack@keystone.service[82026]: [pid: 82026|app: 0|req: 441/887] 10.222.0.33 () {58 vars in 1024 bytes} [Tue Sep 13 19:42:36 2022] POST /identity/v3/auth/tokens => generated 1372 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 13 19:42:36.862615 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-366894d2-939a-4f03-8f16-d623ff4b2ddd None admin] Validating token access rules against request {{(pid=82025) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:42:36.904274 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a201084-2d46-4210-a0c1-c8beb23500de None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57539b6a6f3b4d589f5f5e1d211cd6a0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82025) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:42:36.913000 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a201084-2d46-4210-a0c1-c8beb23500de None admin] REQUEST_METHOD: `GET` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:42:36.913000 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a201084-2d46-4210-a0c1-c8beb23500de None admin] SCRIPT_NAME: `/identity` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:42:36.913000 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a201084-2d46-4210-a0c1-c8beb23500de None admin] PATH_INFO: `/v3/services` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:42:36.913000 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a201084-2d46-4210-a0c1-c8beb23500de None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=82025) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 19:42:36.913000 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a201084-2d46-4210-a0c1-c8beb23500de None admin] RBAC: Authorizing `identity:list_services()` {{(pid=82025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:42:36.913000 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a201084-2d46-4210-a0c1-c8beb23500de None admin] RBAC: Authorization granted {{(pid=82025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:42:36.916648 dv-cinder-828806-6-smb devstack@keystone.service[82025]: [pid: 82025|app: 0|req: 447/888] 10.222.0.33 () {56 vars in 1114 bytes} [Tue Sep 13 19:42:36 2022] GET /identity/v3/services?type=volumev3 => generated 362 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 19:42:36.924250 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d667a91-305e-4980-a5d6-294ad880a9f5 None None] Authenticating user token {{(pid=82026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:42:37.005834 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f335e5b-cc58-4a9e-9dc1-afa6f471efe2 None None] REQUEST_METHOD: `GET` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:42:37.006387 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f335e5b-cc58-4a9e-9dc1-afa6f471efe2 None None] SCRIPT_NAME: `/identity` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:42:37.007095 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f335e5b-cc58-4a9e-9dc1-afa6f471efe2 None None] PATH_INFO: `/` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:42:37.010203 dv-cinder-828806-6-smb devstack@keystone.service[82025]: [pid: 82025|app: 0|req: 448/889] 10.222.0.33 () {54 vars in 927 bytes} [Tue Sep 13 19:42:37 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 13 19:42:37.016473 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63d24259-2633-45a9-951a-4f2b5368d925 None None] REQUEST_METHOD: `POST` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:42:37.016937 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63d24259-2633-45a9-951a-4f2b5368d925 None None] SCRIPT_NAME: `/identity` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:42:37.017259 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63d24259-2633-45a9-951a-4f2b5368d925 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:42:37.035834 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG dbcounter [-] [82025] Writing DB stats keystone:SELECT=100 {{(pid=82025) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:42:37.037271 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.auth.core [None req-63d24259-2633-45a9-951a-4f2b5368d925 None None] MFA Rules not processed for user `57539b6a6f3b4d589f5f5e1d211cd6a0`. Rule list: `[]` (Enabled: `True`). {{(pid=82025) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 19:42:37.038574 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.fernet_utils [None req-63d24259-2633-45a9-951a-4f2b5368d925 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82025) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 19:42:37.052123 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d667a91-305e-4980-a5d6-294ad880a9f5 None None] Validating token access rules against request {{(pid=82026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:42:37.099735 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-722cc309-320c-4be3-a479-cd2c73cf6b07 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57539b6a6f3b4d589f5f5e1d211cd6a0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:42:37.101038 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-722cc309-320c-4be3-a479-cd2c73cf6b07 None admin] REQUEST_METHOD: `GET` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:42:37.101519 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-722cc309-320c-4be3-a479-cd2c73cf6b07 None admin] SCRIPT_NAME: `/identity` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:42:37.101987 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-722cc309-320c-4be3-a479-cd2c73cf6b07 None admin] PATH_INFO: `/v3/endpoints` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:42:37.102905 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-722cc309-320c-4be3-a479-cd2c73cf6b07 None admin] RBAC: Adding query filter params (interface=public, service_id=2471c2698873418ab8a6f3311bad976e, region_id=RegionOne) {{(pid=82026) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 19:42:37.103431 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-722cc309-320c-4be3-a479-cd2c73cf6b07 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=82026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:42:37.105848 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-722cc309-320c-4be3-a479-cd2c73cf6b07 None admin] RBAC: Authorization granted {{(pid=82026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:42:37.118390 dv-cinder-828806-6-smb devstack@keystone.service[82026]: [pid: 82026|app: 0|req: 442/890] 10.222.0.33 () {56 vars in 1251 bytes} [Tue Sep 13 19:42:36 2022] GET /identity/v3/endpoints?service_id=2471c2698873418ab8a6f3311bad976e&interface=public®ion_id=RegionOne => generated 194 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 19:42:37.120207 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-722cc309-320c-4be3-a479-cd2c73cf6b07 None admin] Authenticating user token {{(pid=82026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:42:37.124533 dv-cinder-828806-6-smb devstack@keystone.service[82025]: [pid: 82025|app: 0|req: 449/891] 10.222.0.33 () {58 vars in 1024 bytes} [Tue Sep 13 19:42:37 2022] POST /identity/v3/auth/tokens => generated 1372 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 13 19:42:37.124953 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63d24259-2633-45a9-951a-4f2b5368d925 None None] Authenticating user token {{(pid=82025) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:42:37.125077 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG dbcounter [-] [82026] Writing DB stats keystone:SELECT=100 {{(pid=82026) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:42:37.234637 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-722cc309-320c-4be3-a479-cd2c73cf6b07 None admin] Validating token access rules against request {{(pid=82026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:42:37.258113 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63d24259-2633-45a9-951a-4f2b5368d925 None None] Validating token access rules against request {{(pid=82025) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:42:37.280066 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eef9df29-c9de-4ac7-8453-7bd08dbea327 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57539b6a6f3b4d589f5f5e1d211cd6a0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:42:37.280684 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eef9df29-c9de-4ac7-8453-7bd08dbea327 None admin] REQUEST_METHOD: `GET` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:42:37.280964 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eef9df29-c9de-4ac7-8453-7bd08dbea327 None admin] SCRIPT_NAME: `/identity` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:42:37.281238 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eef9df29-c9de-4ac7-8453-7bd08dbea327 None admin] PATH_INFO: `/v3/services` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:42:37.282529 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eef9df29-c9de-4ac7-8453-7bd08dbea327 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=82026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:42:37.284631 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eef9df29-c9de-4ac7-8453-7bd08dbea327 None admin] RBAC: Authorization granted {{(pid=82026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:42:37.295070 dv-cinder-828806-6-smb devstack@keystone.service[82026]: [pid: 82026|app: 0|req: 443/892] 10.222.0.33 () {56 vars in 1087 bytes} [Tue Sep 13 19:42:37 2022] GET /identity/v3/services => generated 1268 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 13 19:42:37.298086 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae382be3-674e-48ed-a315-48949f0c3922 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57539b6a6f3b4d589f5f5e1d211cd6a0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82025) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:42:37.298970 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae382be3-674e-48ed-a315-48949f0c3922 None admin] REQUEST_METHOD: `GET` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:42:37.299357 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae382be3-674e-48ed-a315-48949f0c3922 None admin] SCRIPT_NAME: `/identity` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:42:37.299707 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae382be3-674e-48ed-a315-48949f0c3922 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:42:37.302310 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG dbcounter [-] [82025] Writing DB stats keystone:SELECT=100 {{(pid=82025) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:42:37.331048 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae382be3-674e-48ed-a315-48949f0c3922 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=82025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 13 19:42:37.331366 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application [None req-ae382be3-674e-48ed-a315-48949f0c3922 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Sep 13 19:42:37.331366 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 19:42:37.331366 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 19:42:37.331366 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 19:42:37.331366 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 19:42:37.331366 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 19:42:37.331366 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 19:42:37.331366 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 19:42:37.331366 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 19:42:37.331366 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 19:42:37.331366 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 19:42:37.331366 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 19:42:37.331366 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 13 19:42:37.331366 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 13 19:42:37.331366 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 13 19:42:37.331366 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 13 19:42:37.332851 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 13 19:42:37.332851 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 13 19:42:37.332851 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 13 19:42:37.332851 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 13 19:42:37.332851 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 19:42:37.332851 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 19:42:37.332851 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 19:42:37.332851 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 19:42:37.332851 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 19:42:37.332851 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 19:42:37.332851 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 19:42:37.332851 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application with Lock( Sep 13 19:42:37.332851 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 19:42:37.332851 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application return self._enter() Sep 13 19:42:37.332851 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 19:42:37.332851 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 19:42:37.333759 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 19:42:37.333759 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application return self.creator() Sep 13 19:42:37.333759 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 19:42:37.333759 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application created_value = creator( Sep 13 19:42:37.333759 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 13 19:42:37.333759 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 13 19:42:37.333759 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 13 19:42:37.333759 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 13 19:42:37.333759 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 13 19:42:37.333759 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 13 19:42:37.333759 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Sep 13 19:42:37.333759 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application Sep 13 19:42:37.333759 dv-cinder-828806-6-smb devstack@keystone.service[82025]: [pid: 82025|app: 0|req: 450/893] 10.222.0.33 () {56 vars in 1120 bytes} [Tue Sep 13 19:42:37 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 208 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 19:42:37.342833 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eef9df29-c9de-4ac7-8453-7bd08dbea327 None admin] Authenticating user token {{(pid=82026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:42:37.351278 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36e25de2-10e7-456f-a6fa-4e2fff31faf7 None None] REQUEST_METHOD: `GET` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:42:37.351938 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36e25de2-10e7-456f-a6fa-4e2fff31faf7 None None] SCRIPT_NAME: `/identity` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:42:37.352426 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36e25de2-10e7-456f-a6fa-4e2fff31faf7 None None] PATH_INFO: `/` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:42:37.355199 dv-cinder-828806-6-smb devstack@keystone.service[82025]: [pid: 82025|app: 0|req: 451/894] 10.222.0.33 () {54 vars in 927 bytes} [Tue Sep 13 19:42:37 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 13 19:42:37.363360 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-babb21e7-0416-4c8d-bf6f-af96f3aac749 None None] REQUEST_METHOD: `POST` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:42:37.364000 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-babb21e7-0416-4c8d-bf6f-af96f3aac749 None None] SCRIPT_NAME: `/identity` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:42:37.364358 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-babb21e7-0416-4c8d-bf6f-af96f3aac749 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:42:37.389998 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.auth.core [None req-babb21e7-0416-4c8d-bf6f-af96f3aac749 None None] MFA Rules not processed for user `57539b6a6f3b4d589f5f5e1d211cd6a0`. Rule list: `[]` (Enabled: `True`). {{(pid=82025) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 19:42:37.392132 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.fernet_utils [None req-babb21e7-0416-4c8d-bf6f-af96f3aac749 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82025) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 19:42:37.426088 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG dbcounter [-] [82026] Writing DB stats keystone:SELECT=100 {{(pid=82026) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:42:37.467782 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eef9df29-c9de-4ac7-8453-7bd08dbea327 None admin] Validating token access rules against request {{(pid=82026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:42:37.487802 dv-cinder-828806-6-smb devstack@keystone.service[82025]: [pid: 82025|app: 0|req: 452/895] 10.222.0.33 () {58 vars in 1024 bytes} [Tue Sep 13 19:42:37 2022] POST /identity/v3/auth/tokens => generated 1372 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 13 19:42:37.488500 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-babb21e7-0416-4c8d-bf6f-af96f3aac749 None None] Authenticating user token {{(pid=82025) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:42:37.519773 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ef02cde-e680-4a7d-81f5-93479245cf1d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57539b6a6f3b4d589f5f5e1d211cd6a0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:42:37.520594 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ef02cde-e680-4a7d-81f5-93479245cf1d None admin] REQUEST_METHOD: `GET` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:42:37.520879 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ef02cde-e680-4a7d-81f5-93479245cf1d None admin] SCRIPT_NAME: `/identity` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:42:37.521296 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ef02cde-e680-4a7d-81f5-93479245cf1d None admin] PATH_INFO: `/v3/roles` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:42:37.521971 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ef02cde-e680-4a7d-81f5-93479245cf1d None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=82026) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 19:42:37.522282 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ef02cde-e680-4a7d-81f5-93479245cf1d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:42:37.524082 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ef02cde-e680-4a7d-81f5-93479245cf1d None admin] RBAC: Authorization granted {{(pid=82026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:42:37.532952 dv-cinder-828806-6-smb devstack@keystone.service[82026]: [pid: 82026|app: 0|req: 444/896] 10.222.0.33 () {56 vars in 1115 bytes} [Tue Sep 13 19:42:37 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 19:42:37.538441 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ef02cde-e680-4a7d-81f5-93479245cf1d None admin] Authenticating user token {{(pid=82026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:42:37.608060 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-babb21e7-0416-4c8d-bf6f-af96f3aac749 None None] Validating token access rules against request {{(pid=82025) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:42:37.638234 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG dbcounter [-] [82025] Writing DB stats keystone:SELECT=100 {{(pid=82025) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:42:37.654524 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92a28285-7ec4-4879-b9a4-065535e93287 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57539b6a6f3b4d589f5f5e1d211cd6a0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82025) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:42:37.656215 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92a28285-7ec4-4879-b9a4-065535e93287 None admin] REQUEST_METHOD: `GET` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:42:37.656215 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92a28285-7ec4-4879-b9a4-065535e93287 None admin] SCRIPT_NAME: `/identity` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:42:37.656215 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92a28285-7ec4-4879-b9a4-065535e93287 None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:42:37.657169 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92a28285-7ec4-4879-b9a4-065535e93287 None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=82025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:42:37.659626 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92a28285-7ec4-4879-b9a4-065535e93287 None admin] RBAC: Authorization granted {{(pid=82025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:42:37.663873 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ef02cde-e680-4a7d-81f5-93479245cf1d None admin] Validating token access rules against request {{(pid=82026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:42:37.670182 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application [None req-92a28285-7ec4-4879-b9a4-065535e93287 None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Sep 13 19:42:37.670182 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 19:42:37.670182 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 13 19:42:37.670182 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 13 19:42:37.670182 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 13 19:42:37.670182 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 13 19:42:37.670182 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 13 19:42:37.670182 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 13 19:42:37.670182 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Sep 13 19:42:37.670182 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application Sep 13 19:42:37.670182 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 13 19:42:37.670182 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application Sep 13 19:42:37.670182 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 19:42:37.670182 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 19:42:37.670182 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 19:42:37.670182 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 19:42:37.671591 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 19:42:37.671591 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 19:42:37.671591 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 19:42:37.671591 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 19:42:37.671591 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 19:42:37.671591 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 19:42:37.671591 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 19:42:37.671591 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 13 19:42:37.671591 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 13 19:42:37.671591 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 13 19:42:37.671591 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 13 19:42:37.671591 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 19:42:37.671591 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 19:42:37.671591 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 19:42:37.671591 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 19:42:37.671591 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 19:42:37.671591 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 19:42:37.672737 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 19:42:37.672737 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application with Lock( Sep 13 19:42:37.672737 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 19:42:37.672737 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application return self._enter() Sep 13 19:42:37.672737 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 19:42:37.672737 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 19:42:37.672737 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 19:42:37.672737 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application return self.creator() Sep 13 19:42:37.672737 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 19:42:37.672737 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application created_value = creator( Sep 13 19:42:37.672737 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 13 19:42:37.672737 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 13 19:42:37.672737 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Sep 13 19:42:37.672737 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application Sep 13 19:42:37.675358 dv-cinder-828806-6-smb devstack@keystone.service[82025]: [pid: 82025|app: 0|req: 453/897] 10.222.0.33 () {56 vars in 1132 bytes} [Tue Sep 13 19:42:37 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 19:42:37.685157 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92a28285-7ec4-4879-b9a4-065535e93287 None admin] Authenticating user token {{(pid=82025) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:42:37.700367 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG dbcounter [-] [82026] Writing DB stats keystone:SELECT=100 {{(pid=82026) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:42:37.708529 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6cb27fc-fec1-4bc7-b466-16a567d71aac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57539b6a6f3b4d589f5f5e1d211cd6a0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:42:37.713198 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6cb27fc-fec1-4bc7-b466-16a567d71aac None admin] REQUEST_METHOD: `GET` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:42:37.713198 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6cb27fc-fec1-4bc7-b466-16a567d71aac None admin] SCRIPT_NAME: `/identity` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:42:37.713198 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6cb27fc-fec1-4bc7-b466-16a567d71aac None admin] PATH_INFO: `/v3/domains/Default` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:42:37.722509 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6cb27fc-fec1-4bc7-b466-16a567d71aac None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=82026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:42:37.724103 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6cb27fc-fec1-4bc7-b466-16a567d71aac None admin] RBAC: Authorization granted {{(pid=82026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:42:37.740275 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application [None req-b6cb27fc-fec1-4bc7-b466-16a567d71aac None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 13 19:42:37.740275 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 19:42:37.740275 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 19:42:37.740275 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 19:42:37.740275 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 19:42:37.740275 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 19:42:37.740275 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 19:42:37.740275 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 19:42:37.740275 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 19:42:37.740275 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 19:42:37.740275 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 19:42:37.740275 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 19:42:37.740275 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 13 19:42:37.740275 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 13 19:42:37.740275 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 13 19:42:37.740275 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 13 19:42:37.741494 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 19:42:37.741494 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 19:42:37.741494 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 19:42:37.741494 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 19:42:37.741494 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 19:42:37.741494 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 19:42:37.741494 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 19:42:37.741494 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application with Lock( Sep 13 19:42:37.741494 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 19:42:37.741494 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application return self._enter() Sep 13 19:42:37.741494 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 19:42:37.741494 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 19:42:37.741494 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 19:42:37.741494 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application return self.creator() Sep 13 19:42:37.741494 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 19:42:37.741494 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application created_value = creator( Sep 13 19:42:37.741494 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 13 19:42:37.742545 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 13 19:42:37.742545 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 13 19:42:37.742545 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application Sep 13 19:42:37.743417 dv-cinder-828806-6-smb devstack@keystone.service[82026]: [pid: 82026|app: 0|req: 445/898] 10.222.0.33 () {56 vars in 1108 bytes} [Tue Sep 13 19:42:37 2022] GET /identity/v3/domains/Default => generated 87 bytes in 205 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 19:42:37.748489 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6cb27fc-fec1-4bc7-b466-16a567d71aac None admin] Authenticating user token {{(pid=82026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:42:37.812889 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92a28285-7ec4-4879-b9a4-065535e93287 None admin] Validating token access rules against request {{(pid=82025) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:42:37.852077 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6cb27fc-fec1-4bc7-b466-16a567d71aac None admin] Validating token access rules against request {{(pid=82026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:42:37.860832 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87f71959-8141-4d11-8867-6f50c31885b6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57539b6a6f3b4d589f5f5e1d211cd6a0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82025) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:42:37.861393 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87f71959-8141-4d11-8867-6f50c31885b6 None admin] REQUEST_METHOD: `GET` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:42:37.861683 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87f71959-8141-4d11-8867-6f50c31885b6 None admin] SCRIPT_NAME: `/identity` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:42:37.861969 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87f71959-8141-4d11-8867-6f50c31885b6 None admin] PATH_INFO: `/v3/services` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:42:37.862607 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87f71959-8141-4d11-8867-6f50c31885b6 None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=82025) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 19:42:37.862918 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87f71959-8141-4d11-8867-6f50c31885b6 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=82025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:42:37.864390 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87f71959-8141-4d11-8867-6f50c31885b6 None admin] RBAC: Authorization granted {{(pid=82025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:42:37.888219 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e874131-0578-4d9c-a246-d17030fa0318 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57539b6a6f3b4d589f5f5e1d211cd6a0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:42:37.888827 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e874131-0578-4d9c-a246-d17030fa0318 None admin] REQUEST_METHOD: `GET` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:42:37.889110 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e874131-0578-4d9c-a246-d17030fa0318 None admin] SCRIPT_NAME: `/identity` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:42:37.889386 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e874131-0578-4d9c-a246-d17030fa0318 None admin] PATH_INFO: `/v3/domains` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:42:37.890029 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e874131-0578-4d9c-a246-d17030fa0318 None admin] RBAC: Adding query filter params (name=Default) {{(pid=82026) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 19:42:37.890339 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e874131-0578-4d9c-a246-d17030fa0318 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:42:37.892894 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e874131-0578-4d9c-a246-d17030fa0318 None admin] RBAC: Authorization granted {{(pid=82026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:42:37.904695 dv-cinder-828806-6-smb devstack@keystone.service[82026]: [pid: 82026|app: 0|req: 446/899] 10.222.0.33 () {56 vars in 1109 bytes} [Tue Sep 13 19:42:37 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 19:42:37.905475 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e874131-0578-4d9c-a246-d17030fa0318 None admin] Authenticating user token {{(pid=82026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:42:37.918878 dv-cinder-828806-6-smb devstack@keystone.service[82025]: [pid: 82025|app: 0|req: 454/900] 10.222.0.33 () {56 vars in 1126 bytes} [Tue Sep 13 19:42:37 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 235 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 19:42:37.920026 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87f71959-8141-4d11-8867-6f50c31885b6 None admin] Authenticating user token {{(pid=82025) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:42:37.957880 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG dbcounter [-] [82026] Writing DB stats keystone:SELECT=100 {{(pid=82026) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:42:37.977144 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG dbcounter [-] [82025] Writing DB stats keystone:SELECT=100 {{(pid=82025) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:42:38.019970 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e874131-0578-4d9c-a246-d17030fa0318 None admin] Validating token access rules against request {{(pid=82026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:42:38.028892 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87f71959-8141-4d11-8867-6f50c31885b6 None admin] Validating token access rules against request {{(pid=82025) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:42:38.057473 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aaaf193-f801-4cc2-830b-7a237304e017 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57539b6a6f3b4d589f5f5e1d211cd6a0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:42:38.058184 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aaaf193-f801-4cc2-830b-7a237304e017 None admin] REQUEST_METHOD: `POST` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:42:38.058388 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aaaf193-f801-4cc2-830b-7a237304e017 None admin] SCRIPT_NAME: `/identity` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:42:38.058629 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aaaf193-f801-4cc2-830b-7a237304e017 None admin] PATH_INFO: `/v3/services` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:42:38.059316 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2aaaf193-f801-4cc2-830b-7a237304e017 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=82026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:42:38.060688 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2aaaf193-f801-4cc2-830b-7a237304e017 None admin] RBAC: Authorization granted {{(pid=82026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:42:38.067472 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b81ae2a-3abe-482a-8388-0d29021bbb3a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57539b6a6f3b4d589f5f5e1d211cd6a0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82025) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:42:38.068163 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b81ae2a-3abe-482a-8388-0d29021bbb3a None admin] REQUEST_METHOD: `GET` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:42:38.068448 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b81ae2a-3abe-482a-8388-0d29021bbb3a None admin] SCRIPT_NAME: `/identity` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:42:38.068747 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b81ae2a-3abe-482a-8388-0d29021bbb3a None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:42:38.076790 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b81ae2a-3abe-482a-8388-0d29021bbb3a None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=82025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:42:38.079967 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b81ae2a-3abe-482a-8388-0d29021bbb3a None admin] RBAC: Authorization granted {{(pid=82025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:42:38.089827 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application [None req-9b81ae2a-3abe-482a-8388-0d29021bbb3a None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Sep 13 19:42:38.089827 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 19:42:38.089827 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 19:42:38.089827 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 19:42:38.089827 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 19:42:38.089827 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 19:42:38.089827 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 19:42:38.089827 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 19:42:38.089827 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 19:42:38.089827 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 19:42:38.089827 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 19:42:38.089827 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 19:42:38.089827 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 13 19:42:38.089827 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 13 19:42:38.089827 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 13 19:42:38.089827 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 13 19:42:38.090905 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 19:42:38.090905 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 19:42:38.090905 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 13 19:42:38.090905 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 13 19:42:38.090905 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 13 19:42:38.090905 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 13 19:42:38.090905 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 19:42:38.090905 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 19:42:38.090905 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 19:42:38.090905 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 19:42:38.090905 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 19:42:38.090905 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application with Lock( Sep 13 19:42:38.090905 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 19:42:38.090905 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application return self._enter() Sep 13 19:42:38.090905 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 19:42:38.090905 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 19:42:38.090905 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 19:42:38.090905 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application return self.creator() Sep 13 19:42:38.092131 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 19:42:38.092131 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application created_value = creator( Sep 13 19:42:38.092131 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 13 19:42:38.092131 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 13 19:42:38.092131 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 13 19:42:38.092131 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 13 19:42:38.092131 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 13 19:42:38.092131 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 13 19:42:38.092131 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Sep 13 19:42:38.092131 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application Sep 13 19:42:38.092131 dv-cinder-828806-6-smb devstack@keystone.service[82025]: [pid: 82025|app: 0|req: 455/901] 10.222.0.33 () {56 vars in 1117 bytes} [Tue Sep 13 19:42:37 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 19:42:38.092131 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b81ae2a-3abe-482a-8388-0d29021bbb3a None admin] Authenticating user token {{(pid=82025) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:42:38.130385 dv-cinder-828806-6-smb devstack@keystone.service[82026]: [pid: 82026|app: 0|req: 447/902] 10.222.0.33 () {60 vars in 1141 bytes} [Tue Sep 13 19:42:37 2022] POST /identity/v3/services => generated 241 bytes in 225 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 13 19:42:38.131578 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aaaf193-f801-4cc2-830b-7a237304e017 None admin] Authenticating user token {{(pid=82026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:42:38.225495 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b81ae2a-3abe-482a-8388-0d29021bbb3a None admin] Validating token access rules against request {{(pid=82025) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:42:38.243582 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG dbcounter [-] [82025] Writing DB stats keystone:SELECT=100 {{(pid=82025) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:42:38.279585 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG dbcounter [-] [82026] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82026) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:42:38.288027 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35822f06-ec45-44cd-aac3-e906fa6d3abc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57539b6a6f3b4d589f5f5e1d211cd6a0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82025) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:42:38.289033 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35822f06-ec45-44cd-aac3-e906fa6d3abc None admin] REQUEST_METHOD: `GET` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:42:38.289518 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35822f06-ec45-44cd-aac3-e906fa6d3abc None admin] SCRIPT_NAME: `/identity` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:42:38.290005 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35822f06-ec45-44cd-aac3-e906fa6d3abc None admin] PATH_INFO: `/v3/services` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:42:38.291129 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35822f06-ec45-44cd-aac3-e906fa6d3abc None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=82025) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 19:42:38.291677 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35822f06-ec45-44cd-aac3-e906fa6d3abc None admin] RBAC: Authorizing `identity:list_services()` {{(pid=82025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:42:38.292546 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aaaf193-f801-4cc2-830b-7a237304e017 None admin] Validating token access rules against request {{(pid=82026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:42:38.293826 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35822f06-ec45-44cd-aac3-e906fa6d3abc None admin] RBAC: Authorization granted {{(pid=82025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:42:38.302113 dv-cinder-828806-6-smb devstack@keystone.service[82025]: [pid: 82025|app: 0|req: 456/903] 10.222.0.33 () {56 vars in 1126 bytes} [Tue Sep 13 19:42:38 2022] GET /identity/v3/services?type=compute_legacy => generated 386 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 19:42:38.308146 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35822f06-ec45-44cd-aac3-e906fa6d3abc None admin] Authenticating user token {{(pid=82025) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:42:38.344530 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51246cb9-c486-4ecb-bd0f-b0b92cc096cf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57539b6a6f3b4d589f5f5e1d211cd6a0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:42:38.345792 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51246cb9-c486-4ecb-bd0f-b0b92cc096cf None admin] REQUEST_METHOD: `GET` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:42:38.346093 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51246cb9-c486-4ecb-bd0f-b0b92cc096cf None admin] SCRIPT_NAME: `/identity` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:42:38.346349 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51246cb9-c486-4ecb-bd0f-b0b92cc096cf None admin] PATH_INFO: `/v3/users` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:42:38.347177 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51246cb9-c486-4ecb-bd0f-b0b92cc096cf None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=82026) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 19:42:38.347426 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51246cb9-c486-4ecb-bd0f-b0b92cc096cf None admin] RBAC: Authorizing `identity:list_users()` {{(pid=82026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:42:38.349095 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51246cb9-c486-4ecb-bd0f-b0b92cc096cf None admin] RBAC: Authorization granted {{(pid=82026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:42:38.370390 dv-cinder-828806-6-smb devstack@keystone.service[82026]: [pid: 82026|app: 0|req: 448/904] 10.222.0.33 () {56 vars in 1149 bytes} [Tue Sep 13 19:42:38 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 239 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 19:42:38.377141 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51246cb9-c486-4ecb-bd0f-b0b92cc096cf None admin] Authenticating user token {{(pid=82026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:42:38.441242 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35822f06-ec45-44cd-aac3-e906fa6d3abc None admin] Validating token access rules against request {{(pid=82025) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:42:38.482639 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d3c51aa-6332-4920-b2f9-455c586edc31 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57539b6a6f3b4d589f5f5e1d211cd6a0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82025) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:42:38.483677 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d3c51aa-6332-4920-b2f9-455c586edc31 None admin] REQUEST_METHOD: `GET` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:42:38.484187 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d3c51aa-6332-4920-b2f9-455c586edc31 None admin] SCRIPT_NAME: `/identity` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:42:38.484667 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d3c51aa-6332-4920-b2f9-455c586edc31 None admin] PATH_INFO: `/v3/endpoints` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:42:38.486379 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d3c51aa-6332-4920-b2f9-455c586edc31 None admin] RBAC: Adding query filter params (interface=public, service_id=641dea9e264a4dab85cd3f5c45a350b7, region_id=RegionOne) {{(pid=82025) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 19:42:38.487011 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d3c51aa-6332-4920-b2f9-455c586edc31 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=82025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:42:38.488682 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d3c51aa-6332-4920-b2f9-455c586edc31 None admin] RBAC: Authorization granted {{(pid=82025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:42:38.494611 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51246cb9-c486-4ecb-bd0f-b0b92cc096cf None admin] Validating token access rules against request {{(pid=82026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:42:38.495140 dv-cinder-828806-6-smb devstack@keystone.service[82025]: [pid: 82025|app: 0|req: 457/905] 10.222.0.33 () {56 vars in 1251 bytes} [Tue Sep 13 19:42:38 2022] GET /identity/v3/endpoints?service_id=641dea9e264a4dab85cd3f5c45a350b7&interface=public®ion_id=RegionOne => generated 194 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 19:42:38.500797 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d3c51aa-6332-4920-b2f9-455c586edc31 None admin] Authenticating user token {{(pid=82025) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:42:38.538939 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG dbcounter [-] [82025] Writing DB stats keystone:SELECT=100 {{(pid=82025) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:42:38.540806 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2c7cf18-ea3f-4e3f-b0a0-96037fdf6c18 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57539b6a6f3b4d589f5f5e1d211cd6a0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:42:38.541425 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2c7cf18-ea3f-4e3f-b0a0-96037fdf6c18 None admin] REQUEST_METHOD: `GET` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:42:38.541772 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2c7cf18-ea3f-4e3f-b0a0-96037fdf6c18 None admin] SCRIPT_NAME: `/identity` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:42:38.542054 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2c7cf18-ea3f-4e3f-b0a0-96037fdf6c18 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:42:38.577298 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG dbcounter [-] [82026] Writing DB stats keystone:SELECT=100 {{(pid=82026) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:42:38.624712 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d3c51aa-6332-4920-b2f9-455c586edc31 None admin] Validating token access rules against request {{(pid=82025) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:42:38.630385 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2c7cf18-ea3f-4e3f-b0a0-96037fdf6c18 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=82026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:42:38.631892 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2c7cf18-ea3f-4e3f-b0a0-96037fdf6c18 None admin] RBAC: Authorization granted {{(pid=82026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:42:38.665306 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b12decdf-4036-488f-8ad2-bd1f09509b09 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57539b6a6f3b4d589f5f5e1d211cd6a0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82025) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:42:38.666118 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b12decdf-4036-488f-8ad2-bd1f09509b09 None admin] REQUEST_METHOD: `GET` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:42:38.666347 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b12decdf-4036-488f-8ad2-bd1f09509b09 None admin] SCRIPT_NAME: `/identity` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:42:38.666676 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b12decdf-4036-488f-8ad2-bd1f09509b09 None admin] PATH_INFO: `/v3/services` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:42:38.667335 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b12decdf-4036-488f-8ad2-bd1f09509b09 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=82025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:42:38.668822 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b12decdf-4036-488f-8ad2-bd1f09509b09 None admin] RBAC: Authorization granted {{(pid=82025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:42:38.682316 dv-cinder-828806-6-smb devstack@keystone.service[82025]: [pid: 82025|app: 0|req: 458/906] 10.222.0.33 () {56 vars in 1087 bytes} [Tue Sep 13 19:42:38 2022] GET /identity/v3/services => generated 1497 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 13 19:42:38.751992 dv-cinder-828806-6-smb devstack@keystone.service[82026]: [pid: 82026|app: 0|req: 449/907] 10.222.0.33 () {58 vars in 1282 bytes} [Tue Sep 13 19:42:38 2022] GET /identity/v3/auth/tokens => generated 1474 bytes in 375 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Sep 13 19:42:38.757647 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b12decdf-4036-488f-8ad2-bd1f09509b09 None admin] Authenticating user token {{(pid=82025) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:42:38.865759 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG dbcounter [-] [82025] Writing DB stats keystone:SELECT=100 {{(pid=82025) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:42:38.868894 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b12decdf-4036-488f-8ad2-bd1f09509b09 None admin] Validating token access rules against request {{(pid=82025) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:42:38.904825 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a97fcec4-b4d2-4578-abb4-7683a05400c0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57539b6a6f3b4d589f5f5e1d211cd6a0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82025) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:42:38.905459 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a97fcec4-b4d2-4578-abb4-7683a05400c0 None admin] REQUEST_METHOD: `GET` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:42:38.905745 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a97fcec4-b4d2-4578-abb4-7683a05400c0 None admin] SCRIPT_NAME: `/identity` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:42:38.906024 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a97fcec4-b4d2-4578-abb4-7683a05400c0 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:42:38.919897 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a97fcec4-b4d2-4578-abb4-7683a05400c0 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=82025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:42:38.921425 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a97fcec4-b4d2-4578-abb4-7683a05400c0 None admin] RBAC: Authorization granted {{(pid=82025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:42:38.937521 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application [None req-a97fcec4-b4d2-4578-abb4-7683a05400c0 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 13 19:42:38.937521 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 19:42:38.937521 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 19:42:38.937521 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 19:42:38.937521 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 19:42:38.937521 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 19:42:38.937521 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 19:42:38.937521 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 19:42:38.937521 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 19:42:38.937521 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 19:42:38.937521 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 19:42:38.937521 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 19:42:38.937521 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 13 19:42:38.937521 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 13 19:42:38.937521 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 13 19:42:38.937521 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 13 19:42:38.939350 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 19:42:38.939350 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 19:42:38.939350 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 19:42:38.939350 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 19:42:38.939350 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 19:42:38.939350 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 19:42:38.939350 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 19:42:38.939350 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application with Lock( Sep 13 19:42:38.939350 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 19:42:38.939350 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application return self._enter() Sep 13 19:42:38.939350 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 19:42:38.939350 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 19:42:38.939350 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 19:42:38.939350 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application return self.creator() Sep 13 19:42:38.939350 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 19:42:38.939350 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application created_value = creator( Sep 13 19:42:38.939350 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 13 19:42:38.940312 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 13 19:42:38.940312 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 13 19:42:38.940312 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application Sep 13 19:42:38.940312 dv-cinder-828806-6-smb devstack@keystone.service[82025]: [pid: 82025|app: 0|req: 459/908] 10.222.0.33 () {56 vars in 1108 bytes} [Tue Sep 13 19:42:38 2022] GET /identity/v3/domains/Default => generated 87 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 19:42:38.946393 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2c7cf18-ea3f-4e3f-b0a0-96037fdf6c18 None admin] Authenticating user token {{(pid=82026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:42:39.006129 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG dbcounter [-] [82026] Writing DB stats keystone:SELECT=100 {{(pid=82026) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:42:39.053830 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2c7cf18-ea3f-4e3f-b0a0-96037fdf6c18 None admin] Validating token access rules against request {{(pid=82026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:42:39.091547 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c9cb92b-a40b-46fe-9bcf-3ba38ea62a58 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57539b6a6f3b4d589f5f5e1d211cd6a0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:42:39.092351 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c9cb92b-a40b-46fe-9bcf-3ba38ea62a58 None admin] REQUEST_METHOD: `GET` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:42:39.092515 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c9cb92b-a40b-46fe-9bcf-3ba38ea62a58 None admin] SCRIPT_NAME: `/identity` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:42:39.092711 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c9cb92b-a40b-46fe-9bcf-3ba38ea62a58 None admin] PATH_INFO: `/v3/domains` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:42:39.093385 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c9cb92b-a40b-46fe-9bcf-3ba38ea62a58 None admin] RBAC: Adding query filter params (name=Default) {{(pid=82026) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 19:42:39.093701 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c9cb92b-a40b-46fe-9bcf-3ba38ea62a58 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:42:39.095717 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c9cb92b-a40b-46fe-9bcf-3ba38ea62a58 None admin] RBAC: Authorization granted {{(pid=82026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:42:39.109344 dv-cinder-828806-6-smb devstack@keystone.service[82026]: [pid: 82026|app: 0|req: 450/909] 10.222.0.33 () {56 vars in 1109 bytes} [Tue Sep 13 19:42:38 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 13 19:42:39.116335 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a97fcec4-b4d2-4578-abb4-7683a05400c0 None admin] Authenticating user token {{(pid=82025) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:42:39.228481 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a97fcec4-b4d2-4578-abb4-7683a05400c0 None admin] Validating token access rules against request {{(pid=82025) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:42:39.265984 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e09f37b-e1b1-46e4-9bb7-344e5d8a7633 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57539b6a6f3b4d589f5f5e1d211cd6a0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82025) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:42:39.268064 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e09f37b-e1b1-46e4-9bb7-344e5d8a7633 None admin] REQUEST_METHOD: `GET` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:42:39.268555 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e09f37b-e1b1-46e4-9bb7-344e5d8a7633 None admin] SCRIPT_NAME: `/identity` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:42:39.269030 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e09f37b-e1b1-46e4-9bb7-344e5d8a7633 None admin] PATH_INFO: `/v3/projects/service` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:42:39.277561 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e09f37b-e1b1-46e4-9bb7-344e5d8a7633 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=82025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:42:39.279344 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e09f37b-e1b1-46e4-9bb7-344e5d8a7633 None admin] RBAC: Authorization granted {{(pid=82025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:42:39.295058 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application [None req-7e09f37b-e1b1-46e4-9bb7-344e5d8a7633 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 13 19:42:39.295058 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 19:42:39.295058 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 19:42:39.295058 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 19:42:39.295058 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 19:42:39.295058 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 19:42:39.295058 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 19:42:39.295058 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 19:42:39.295058 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 19:42:39.295058 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 19:42:39.295058 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 19:42:39.295058 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 19:42:39.295058 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 13 19:42:39.295058 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 13 19:42:39.295058 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 13 19:42:39.295963 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 13 19:42:39.295963 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 19:42:39.295963 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 19:42:39.295963 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 19:42:39.295963 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 19:42:39.295963 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 19:42:39.295963 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 19:42:39.295963 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 19:42:39.295963 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application with Lock( Sep 13 19:42:39.295963 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 19:42:39.295963 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application return self._enter() Sep 13 19:42:39.295963 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 19:42:39.295963 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 19:42:39.295963 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 19:42:39.295963 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application return self.creator() Sep 13 19:42:39.295963 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 19:42:39.295963 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application created_value = creator( Sep 13 19:42:39.296982 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 13 19:42:39.296982 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 13 19:42:39.296982 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 13 19:42:39.296982 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 13 19:42:39.296982 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 13 19:42:39.296982 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 13 19:42:39.296982 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 13 19:42:39.296982 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application Sep 13 19:42:39.299144 dv-cinder-828806-6-smb devstack@keystone.service[82025]: [pid: 82025|app: 0|req: 460/910] 10.222.0.33 () {56 vars in 1111 bytes} [Tue Sep 13 19:42:39 2022] GET /identity/v3/projects/service => generated 88 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 19:42:39.301457 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c9cb92b-a40b-46fe-9bcf-3ba38ea62a58 None admin] Authenticating user token {{(pid=82026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:42:39.411131 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c9cb92b-a40b-46fe-9bcf-3ba38ea62a58 None admin] Validating token access rules against request {{(pid=82026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:42:39.428263 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG dbcounter [-] [82026] Writing DB stats keystone:SELECT=100 {{(pid=82026) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:42:39.447150 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f81358a1-dd49-4305-a30b-783c61453c13 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57539b6a6f3b4d589f5f5e1d211cd6a0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:42:39.464422 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f81358a1-dd49-4305-a30b-783c61453c13 None admin] REQUEST_METHOD: `GET` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:42:39.464422 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f81358a1-dd49-4305-a30b-783c61453c13 None admin] SCRIPT_NAME: `/identity` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:42:39.464422 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f81358a1-dd49-4305-a30b-783c61453c13 None admin] PATH_INFO: `/v3/projects` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:42:39.464422 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f81358a1-dd49-4305-a30b-783c61453c13 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=82026) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 19:42:39.464422 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f81358a1-dd49-4305-a30b-783c61453c13 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=82026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:42:39.464422 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f81358a1-dd49-4305-a30b-783c61453c13 None admin] RBAC: Authorization granted {{(pid=82026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:42:39.464891 dv-cinder-828806-6-smb devstack@keystone.service[82026]: [pid: 82026|app: 0|req: 451/911] 10.222.0.33 () {56 vars in 1148 bytes} [Tue Sep 13 19:42:39 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 19:42:39.475106 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e09f37b-e1b1-46e4-9bb7-344e5d8a7633 None admin] Authenticating user token {{(pid=82025) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:42:39.488831 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG dbcounter [-] [82025] Writing DB stats keystone:SELECT=100 {{(pid=82025) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:42:39.592028 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e09f37b-e1b1-46e4-9bb7-344e5d8a7633 None admin] Validating token access rules against request {{(pid=82025) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:42:39.631959 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4871af17-7ef4-4c0d-baa0-f1e3da135d00 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57539b6a6f3b4d589f5f5e1d211cd6a0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82025) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:42:39.632579 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4871af17-7ef4-4c0d-baa0-f1e3da135d00 None admin] REQUEST_METHOD: `GET` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:42:39.632864 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4871af17-7ef4-4c0d-baa0-f1e3da135d00 None admin] SCRIPT_NAME: `/identity` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:42:39.633145 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4871af17-7ef4-4c0d-baa0-f1e3da135d00 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:42:39.633879 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4871af17-7ef4-4c0d-baa0-f1e3da135d00 None admin] RBAC: Adding query filter params (role.id=2d9e933a00cb40c3bb31cbfc8127f9ec, scope.project.id=c8c6fba0f15b4d6a84ff601919b7b8e4, user.id=a28e738b894442e2bc9880eeb64fc0c8) {{(pid=82025) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 19:42:39.634200 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4871af17-7ef4-4c0d-baa0-f1e3da135d00 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=82025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:42:39.635753 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4871af17-7ef4-4c0d-baa0-f1e3da135d00 None admin] RBAC: Authorization granted {{(pid=82025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:42:39.643997 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c4e4cde-d911-482e-82ab-95cdbbafb45a None None] REQUEST_METHOD: `GET` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:42:39.644291 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c4e4cde-d911-482e-82ab-95cdbbafb45a None None] SCRIPT_NAME: `/identity` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:42:39.644577 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c4e4cde-d911-482e-82ab-95cdbbafb45a None None] PATH_INFO: `/` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:42:39.645935 dv-cinder-828806-6-smb devstack@keystone.service[82026]: [pid: 82026|app: 0|req: 452/913] 10.222.0.33 () {54 vars in 927 bytes} [Tue Sep 13 19:42:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 19:42:39.646145 dv-cinder-828806-6-smb devstack@keystone.service[82025]: [pid: 82025|app: 0|req: 461/913] 10.222.0.33 () {56 vars in 1374 bytes} [Tue Sep 13 19:42:39 2022] GET /identity/v3/role_assignments?user.id=a28e738b894442e2bc9880eeb64fc0c8&scope.project.id=c8c6fba0f15b4d6a84ff601919b7b8e4&role.id=2d9e933a00cb40c3bb31cbfc8127f9ec => generated 259 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 19:42:39.652791 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d166d3c-793e-49d9-a1a9-37b4c04cef49 None None] REQUEST_METHOD: `POST` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:42:39.653125 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d166d3c-793e-49d9-a1a9-37b4c04cef49 None None] SCRIPT_NAME: `/identity` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:42:39.653368 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d166d3c-793e-49d9-a1a9-37b4c04cef49 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:42:39.674483 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.auth.core [None req-8d166d3c-793e-49d9-a1a9-37b4c04cef49 None None] MFA Rules not processed for user `57539b6a6f3b4d589f5f5e1d211cd6a0`. Rule list: `[]` (Enabled: `True`). {{(pid=82026) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 19:42:39.675763 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.common.fernet_utils [None req-8d166d3c-793e-49d9-a1a9-37b4c04cef49 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82026) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 19:42:39.754880 dv-cinder-828806-6-smb devstack@keystone.service[82026]: [pid: 82026|app: 0|req: 453/914] 10.222.0.33 () {58 vars in 1024 bytes} [Tue Sep 13 19:42:39 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 13 19:42:40.046574 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4871af17-7ef4-4c0d-baa0-f1e3da135d00 None admin] Authenticating user token {{(pid=82025) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:42:40.146062 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG dbcounter [-] [82025] Writing DB stats keystone:SELECT=100 {{(pid=82025) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:42:40.170005 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4871af17-7ef4-4c0d-baa0-f1e3da135d00 None admin] Validating token access rules against request {{(pid=82025) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:42:40.206056 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-911bf2f6-20b7-4f34-bee4-0747410a8000 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57539b6a6f3b4d589f5f5e1d211cd6a0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82025) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:42:40.206697 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-911bf2f6-20b7-4f34-bee4-0747410a8000 None admin] REQUEST_METHOD: `GET` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:42:40.207054 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-911bf2f6-20b7-4f34-bee4-0747410a8000 None admin] SCRIPT_NAME: `/identity` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:42:40.207341 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-911bf2f6-20b7-4f34-bee4-0747410a8000 None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:42:40.207927 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-911bf2f6-20b7-4f34-bee4-0747410a8000 None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=82025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:42:40.209286 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-911bf2f6-20b7-4f34-bee4-0747410a8000 None admin] RBAC: Authorization granted {{(pid=82025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:42:40.218232 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application [None req-911bf2f6-20b7-4f34-bee4-0747410a8000 None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Sep 13 19:42:40.218232 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 19:42:40.218232 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 13 19:42:40.218232 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 13 19:42:40.218232 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 13 19:42:40.218232 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 13 19:42:40.218232 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 13 19:42:40.218232 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 13 19:42:40.218232 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Sep 13 19:42:40.218232 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application Sep 13 19:42:40.218232 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 13 19:42:40.218232 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application Sep 13 19:42:40.218232 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 19:42:40.218232 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 19:42:40.218232 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 19:42:40.218232 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 19:42:40.218232 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 19:42:40.219247 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 19:42:40.219247 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 19:42:40.219247 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 19:42:40.219247 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 19:42:40.219247 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 19:42:40.219247 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 19:42:40.219247 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 13 19:42:40.219247 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 13 19:42:40.219247 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 13 19:42:40.219247 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 13 19:42:40.219247 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 19:42:40.219247 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 19:42:40.219247 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 19:42:40.219247 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 19:42:40.219247 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 19:42:40.219247 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 19:42:40.221289 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 19:42:40.221289 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application with Lock( Sep 13 19:42:40.221289 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 19:42:40.221289 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application return self._enter() Sep 13 19:42:40.221289 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 19:42:40.221289 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 19:42:40.221289 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 19:42:40.221289 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application return self.creator() Sep 13 19:42:40.221289 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 19:42:40.221289 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application created_value = creator( Sep 13 19:42:40.221289 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 13 19:42:40.221289 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 13 19:42:40.221289 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Sep 13 19:42:40.221289 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application Sep 13 19:42:40.221289 dv-cinder-828806-6-smb devstack@keystone.service[82025]: [pid: 82025|app: 0|req: 462/915] 10.222.0.33 () {56 vars in 1114 bytes} [Tue Sep 13 19:42:40 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 19:42:40.228340 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d166d3c-793e-49d9-a1a9-37b4c04cef49 None None] Authenticating user token {{(pid=82026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:42:40.341249 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d166d3c-793e-49d9-a1a9-37b4c04cef49 None None] Validating token access rules against request {{(pid=82026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:42:40.355549 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG dbcounter [-] [82026] Writing DB stats keystone:SELECT=100 {{(pid=82026) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:42:40.399365 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa5dc5fa-3f74-4200-a8f0-1f6f50d23324 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57539b6a6f3b4d589f5f5e1d211cd6a0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:42:40.399987 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa5dc5fa-3f74-4200-a8f0-1f6f50d23324 None admin] REQUEST_METHOD: `GET` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:42:40.400271 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa5dc5fa-3f74-4200-a8f0-1f6f50d23324 None admin] SCRIPT_NAME: `/identity` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:42:40.400551 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa5dc5fa-3f74-4200-a8f0-1f6f50d23324 None admin] PATH_INFO: `/v3/services` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:42:40.401198 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa5dc5fa-3f74-4200-a8f0-1f6f50d23324 None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=82026) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 19:42:40.401567 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa5dc5fa-3f74-4200-a8f0-1f6f50d23324 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=82026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:42:40.402948 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa5dc5fa-3f74-4200-a8f0-1f6f50d23324 None admin] RBAC: Authorization granted {{(pid=82026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:42:40.409580 dv-cinder-828806-6-smb devstack@keystone.service[82026]: [pid: 82026|app: 0|req: 454/916] 10.222.0.33 () {56 vars in 1114 bytes} [Tue Sep 13 19:42:40 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 13 19:42:40.415467 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-911bf2f6-20b7-4f34-bee4-0747410a8000 None admin] Authenticating user token {{(pid=82025) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:42:40.484823 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8252c669-e2cd-4a6c-b504-847b7b078956 None None] REQUEST_METHOD: `GET` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:42:40.485155 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8252c669-e2cd-4a6c-b504-847b7b078956 None None] SCRIPT_NAME: `/identity` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:42:40.485439 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8252c669-e2cd-4a6c-b504-847b7b078956 None None] PATH_INFO: `/` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:42:40.487229 dv-cinder-828806-6-smb devstack@keystone.service[82026]: [pid: 82026|app: 0|req: 455/917] 10.222.0.33 () {54 vars in 927 bytes} [Tue Sep 13 19:42:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 13 19:42:40.492250 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-760384d7-3f8d-45a5-9566-92f4f5bbae4d None None] REQUEST_METHOD: `POST` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:42:40.492541 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-760384d7-3f8d-45a5-9566-92f4f5bbae4d None None] SCRIPT_NAME: `/identity` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:42:40.492820 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-760384d7-3f8d-45a5-9566-92f4f5bbae4d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:42:40.511625 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.auth.core [None req-760384d7-3f8d-45a5-9566-92f4f5bbae4d None None] MFA Rules not processed for user `57539b6a6f3b4d589f5f5e1d211cd6a0`. Rule list: `[]` (Enabled: `True`). {{(pid=82026) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 19:42:40.512934 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.common.fernet_utils [None req-760384d7-3f8d-45a5-9566-92f4f5bbae4d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82026) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 19:42:40.525986 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-911bf2f6-20b7-4f34-bee4-0747410a8000 None admin] Validating token access rules against request {{(pid=82025) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:42:40.566859 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbb2ccd4-7bbf-490b-a39f-e0aa1f950d51 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57539b6a6f3b4d589f5f5e1d211cd6a0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82025) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:42:40.567604 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbb2ccd4-7bbf-490b-a39f-e0aa1f950d51 None admin] REQUEST_METHOD: `GET` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:42:40.567891 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbb2ccd4-7bbf-490b-a39f-e0aa1f950d51 None admin] SCRIPT_NAME: `/identity` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:42:40.568168 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbb2ccd4-7bbf-490b-a39f-e0aa1f950d51 None admin] PATH_INFO: `/v3/services` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:42:40.568803 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbb2ccd4-7bbf-490b-a39f-e0aa1f950d51 None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=82025) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 19:42:40.569108 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbb2ccd4-7bbf-490b-a39f-e0aa1f950d51 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=82025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:42:40.570720 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbb2ccd4-7bbf-490b-a39f-e0aa1f950d51 None admin] RBAC: Authorization granted {{(pid=82025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:42:40.576367 dv-cinder-828806-6-smb devstack@keystone.service[82025]: [pid: 82025|app: 0|req: 463/918] 10.222.0.33 () {56 vars in 1114 bytes} [Tue Sep 13 19:42:40 2022] GET /identity/v3/services?type=volumev3 => generated 362 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 19:42:40.582516 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbb2ccd4-7bbf-490b-a39f-e0aa1f950d51 None admin] Authenticating user token {{(pid=82025) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:42:40.586410 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG dbcounter [-] [82025] Writing DB stats keystone:SELECT=100 {{(pid=82025) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:42:40.598783 dv-cinder-828806-6-smb devstack@keystone.service[82026]: [pid: 82026|app: 0|req: 456/919] 10.222.0.33 () {58 vars in 1024 bytes} [Tue Sep 13 19:42:40 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 13 19:42:40.691112 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbb2ccd4-7bbf-490b-a39f-e0aa1f950d51 None admin] Validating token access rules against request {{(pid=82025) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:42:40.727165 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11dc245f-c37b-48d5-9efd-0115a156e52a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57539b6a6f3b4d589f5f5e1d211cd6a0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82025) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:42:40.727778 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11dc245f-c37b-48d5-9efd-0115a156e52a None admin] REQUEST_METHOD: `POST` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:42:40.728066 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11dc245f-c37b-48d5-9efd-0115a156e52a None admin] SCRIPT_NAME: `/identity` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:42:40.728342 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11dc245f-c37b-48d5-9efd-0115a156e52a None admin] PATH_INFO: `/v3/endpoints` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:42:40.729008 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11dc245f-c37b-48d5-9efd-0115a156e52a None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=82025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:42:40.730368 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11dc245f-c37b-48d5-9efd-0115a156e52a None admin] RBAC: Authorization granted {{(pid=82025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:42:40.812461 dv-cinder-828806-6-smb devstack@keystone.service[82025]: [pid: 82025|app: 0|req: 464/920] 10.222.0.33 () {60 vars in 1144 bytes} [Tue Sep 13 19:42:40 2022] POST /identity/v3/endpoints => generated 346 bytes in 230 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 13 19:42:40.871129 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-760384d7-3f8d-45a5-9566-92f4f5bbae4d None None] Authenticating user token {{(pid=82026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:42:40.985113 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG dbcounter [-] [82026] Writing DB stats keystone:SELECT=100 {{(pid=82026) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:42:40.988693 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-760384d7-3f8d-45a5-9566-92f4f5bbae4d None None] Validating token access rules against request {{(pid=82026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:42:41.028578 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59d27754-5ed2-4a6a-836f-2a22e8f421d9 None None] REQUEST_METHOD: `GET` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:42:41.028578 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59d27754-5ed2-4a6a-836f-2a22e8f421d9 None None] SCRIPT_NAME: `/identity` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:42:41.028578 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59d27754-5ed2-4a6a-836f-2a22e8f421d9 None None] PATH_INFO: `/` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:42:41.028578 dv-cinder-828806-6-smb devstack@keystone.service[82025]: [pid: 82025|app: 0|req: 465/921] 10.222.0.33 () {54 vars in 927 bytes} [Tue Sep 13 19:42:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 13 19:42:41.030844 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44c5b855-8e95-48ad-9b22-4bb72f5f39e4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57539b6a6f3b4d589f5f5e1d211cd6a0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:42:41.031533 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44c5b855-8e95-48ad-9b22-4bb72f5f39e4 None admin] REQUEST_METHOD: `GET` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:42:41.031821 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44c5b855-8e95-48ad-9b22-4bb72f5f39e4 None admin] SCRIPT_NAME: `/identity` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:42:41.032098 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44c5b855-8e95-48ad-9b22-4bb72f5f39e4 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:42:41.033257 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44c5b855-8e95-48ad-9b22-4bb72f5f39e4 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=82026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:42:41.035408 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44c5b855-8e95-48ad-9b22-4bb72f5f39e4 None admin] RBAC: Authorization granted {{(pid=82026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:42:41.036426 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16e22acf-39bb-47b6-9c31-c0fd531ff6d6 None None] REQUEST_METHOD: `POST` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:42:41.036716 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16e22acf-39bb-47b6-9c31-c0fd531ff6d6 None None] SCRIPT_NAME: `/identity` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:42:41.037000 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16e22acf-39bb-47b6-9c31-c0fd531ff6d6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:42:41.045605 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application [None req-44c5b855-8e95-48ad-9b22-4bb72f5f39e4 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Sep 13 19:42:41.045605 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 19:42:41.045605 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 13 19:42:41.045605 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 13 19:42:41.045605 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 13 19:42:41.045605 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 13 19:42:41.045605 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 13 19:42:41.045605 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 13 19:42:41.045605 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Sep 13 19:42:41.045605 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application Sep 13 19:42:41.045605 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 13 19:42:41.045605 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application Sep 13 19:42:41.045605 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 19:42:41.045605 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 19:42:41.045605 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 19:42:41.045605 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 19:42:41.045605 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 19:42:41.046644 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 19:42:41.046644 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 19:42:41.046644 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 19:42:41.046644 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 19:42:41.046644 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 19:42:41.046644 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 19:42:41.046644 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 13 19:42:41.046644 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 13 19:42:41.046644 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 13 19:42:41.046644 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 13 19:42:41.046644 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 19:42:41.046644 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 19:42:41.046644 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 19:42:41.046644 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 19:42:41.046644 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 19:42:41.046644 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 19:42:41.047750 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 19:42:41.047750 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application with Lock( Sep 13 19:42:41.047750 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 19:42:41.047750 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application return self._enter() Sep 13 19:42:41.047750 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 19:42:41.047750 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 19:42:41.047750 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 19:42:41.047750 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application return self.creator() Sep 13 19:42:41.047750 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 19:42:41.047750 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application created_value = creator( Sep 13 19:42:41.047750 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 13 19:42:41.047750 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 13 19:42:41.047750 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Sep 13 19:42:41.047750 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application Sep 13 19:42:41.047750 dv-cinder-828806-6-smb devstack@keystone.service[82026]: [pid: 82026|app: 0|req: 457/922] 10.222.0.33 () {56 vars in 1126 bytes} [Tue Sep 13 19:42:40 2022] GET /identity/v3/services/object-store => generated 93 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 19:42:41.052731 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44c5b855-8e95-48ad-9b22-4bb72f5f39e4 None admin] Authenticating user token {{(pid=82026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:42:41.057631 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.auth.core [None req-16e22acf-39bb-47b6-9c31-c0fd531ff6d6 None None] MFA Rules not processed for user `57539b6a6f3b4d589f5f5e1d211cd6a0`. Rule list: `[]` (Enabled: `True`). {{(pid=82025) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 19:42:41.058814 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.fernet_utils [None req-16e22acf-39bb-47b6-9c31-c0fd531ff6d6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82025) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 19:42:41.129247 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG dbcounter [-] [82025] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82025) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:42:41.140469 dv-cinder-828806-6-smb devstack@keystone.service[82025]: [pid: 82025|app: 0|req: 466/923] 10.222.0.33 () {58 vars in 1024 bytes} [Tue Sep 13 19:42:41 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 13 19:42:41.181639 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44c5b855-8e95-48ad-9b22-4bb72f5f39e4 None admin] Validating token access rules against request {{(pid=82026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:42:41.217257 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f522794-092b-4ddc-934b-f4f5dea898ec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57539b6a6f3b4d589f5f5e1d211cd6a0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:42:41.217923 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f522794-092b-4ddc-934b-f4f5dea898ec None admin] REQUEST_METHOD: `GET` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:42:41.218208 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f522794-092b-4ddc-934b-f4f5dea898ec None admin] SCRIPT_NAME: `/identity` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:42:41.218489 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f522794-092b-4ddc-934b-f4f5dea898ec None admin] PATH_INFO: `/v3/services` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:42:41.219155 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f522794-092b-4ddc-934b-f4f5dea898ec None admin] RBAC: Adding query filter params (name=object-store) {{(pid=82026) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 19:42:41.219465 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f522794-092b-4ddc-934b-f4f5dea898ec None admin] RBAC: Authorizing `identity:list_services()` {{(pid=82026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:42:41.221540 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f522794-092b-4ddc-934b-f4f5dea898ec None admin] RBAC: Authorization granted {{(pid=82026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:42:41.226710 dv-cinder-828806-6-smb devstack@keystone.service[82026]: [pid: 82026|app: 0|req: 458/924] 10.222.0.33 () {56 vars in 1122 bytes} [Tue Sep 13 19:42:41 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 13 19:42:41.232531 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16e22acf-39bb-47b6-9c31-c0fd531ff6d6 None None] Authenticating user token {{(pid=82025) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:42:41.343366 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16e22acf-39bb-47b6-9c31-c0fd531ff6d6 None None] Validating token access rules against request {{(pid=82025) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:42:41.384567 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-537eccc2-c8a4-4c3a-9412-3068bb90e6f9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57539b6a6f3b4d589f5f5e1d211cd6a0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82025) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:42:41.385083 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-537eccc2-c8a4-4c3a-9412-3068bb90e6f9 None admin] REQUEST_METHOD: `GET` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:42:41.385367 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-537eccc2-c8a4-4c3a-9412-3068bb90e6f9 None admin] SCRIPT_NAME: `/identity` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:42:41.385708 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-537eccc2-c8a4-4c3a-9412-3068bb90e6f9 None admin] PATH_INFO: `/v3/services` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:42:41.386347 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-537eccc2-c8a4-4c3a-9412-3068bb90e6f9 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=82025) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 19:42:41.386705 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-537eccc2-c8a4-4c3a-9412-3068bb90e6f9 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=82025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:42:41.388173 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-537eccc2-c8a4-4c3a-9412-3068bb90e6f9 None admin] RBAC: Authorization granted {{(pid=82025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:42:41.393892 dv-cinder-828806-6-smb devstack@keystone.service[82025]: [pid: 82025|app: 0|req: 467/925] 10.222.0.33 () {56 vars in 1122 bytes} [Tue Sep 13 19:42:41 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 19:42:41.399812 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f522794-092b-4ddc-934b-f4f5dea898ec None admin] Authenticating user token {{(pid=82026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:42:41.430274 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG dbcounter [-] [82026] Writing DB stats keystone:SELECT=100 {{(pid=82026) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:42:41.435136 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-537eccc2-c8a4-4c3a-9412-3068bb90e6f9 None admin] Authenticating user token {{(pid=82025) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:42:41.495930 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG dbcounter [-] [82025] Writing DB stats keystone:SELECT=100 {{(pid=82025) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:42:41.529062 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f522794-092b-4ddc-934b-f4f5dea898ec None admin] Validating token access rules against request {{(pid=82026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:42:41.551369 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-537eccc2-c8a4-4c3a-9412-3068bb90e6f9 None admin] Validating token access rules against request {{(pid=82025) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:42:41.580900 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50e4e1bf-633b-4375-b6ad-14835e7dd346 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57539b6a6f3b4d589f5f5e1d211cd6a0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:42:41.582173 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50e4e1bf-633b-4375-b6ad-14835e7dd346 None admin] REQUEST_METHOD: `GET` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:42:41.583164 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50e4e1bf-633b-4375-b6ad-14835e7dd346 None admin] SCRIPT_NAME: `/identity` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:42:41.583891 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50e4e1bf-633b-4375-b6ad-14835e7dd346 None admin] PATH_INFO: `/v3/endpoints` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:42:41.585027 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50e4e1bf-633b-4375-b6ad-14835e7dd346 None admin] RBAC: Adding query filter params (interface=public, service_id=301051e393994a9cb5a2487f1964e962, region_id=RegionOne) {{(pid=82026) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 19:42:41.585572 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50e4e1bf-633b-4375-b6ad-14835e7dd346 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=82026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:42:41.587824 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50e4e1bf-633b-4375-b6ad-14835e7dd346 None admin] RBAC: Authorization granted {{(pid=82026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:42:41.590936 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd6ee0eb-6243-4364-9096-bc894e18d249 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57539b6a6f3b4d589f5f5e1d211cd6a0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82025) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:42:41.591693 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd6ee0eb-6243-4364-9096-bc894e18d249 None admin] REQUEST_METHOD: `GET` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:42:41.592034 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd6ee0eb-6243-4364-9096-bc894e18d249 None admin] SCRIPT_NAME: `/identity` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:42:41.592427 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd6ee0eb-6243-4364-9096-bc894e18d249 None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:42:41.593027 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd6ee0eb-6243-4364-9096-bc894e18d249 None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=82025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:42:41.594437 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd6ee0eb-6243-4364-9096-bc894e18d249 None admin] RBAC: Authorization granted {{(pid=82025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:42:41.599572 dv-cinder-828806-6-smb devstack@keystone.service[82026]: [pid: 82026|app: 0|req: 459/926] 10.222.0.33 () {56 vars in 1251 bytes} [Tue Sep 13 19:42:41 2022] GET /identity/v3/endpoints?service_id=301051e393994a9cb5a2487f1964e962&interface=public®ion_id=RegionOne => generated 194 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 19:42:41.601449 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50e4e1bf-633b-4375-b6ad-14835e7dd346 None admin] Authenticating user token {{(pid=82026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:42:41.610351 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application [None req-bd6ee0eb-6243-4364-9096-bc894e18d249 None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Sep 13 19:42:41.610351 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 19:42:41.610351 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 13 19:42:41.610351 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 13 19:42:41.610351 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 13 19:42:41.610351 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 13 19:42:41.610351 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 13 19:42:41.610351 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 13 19:42:41.610351 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Sep 13 19:42:41.610351 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application Sep 13 19:42:41.610351 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 13 19:42:41.610351 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application Sep 13 19:42:41.610351 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 19:42:41.610351 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 19:42:41.610351 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 19:42:41.610351 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 19:42:41.611368 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 19:42:41.611368 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 19:42:41.611368 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 19:42:41.611368 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 19:42:41.611368 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 19:42:41.611368 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 19:42:41.611368 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 19:42:41.611368 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 13 19:42:41.611368 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 13 19:42:41.611368 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 13 19:42:41.611368 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 13 19:42:41.611368 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 19:42:41.611368 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 19:42:41.611368 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 19:42:41.611368 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 19:42:41.611368 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 19:42:41.611368 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 19:42:41.612277 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 19:42:41.612277 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application with Lock( Sep 13 19:42:41.612277 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 19:42:41.612277 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application return self._enter() Sep 13 19:42:41.612277 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 19:42:41.612277 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 19:42:41.612277 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 19:42:41.612277 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application return self.creator() Sep 13 19:42:41.612277 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 19:42:41.612277 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application created_value = creator( Sep 13 19:42:41.612277 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 13 19:42:41.612277 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 13 19:42:41.612277 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Sep 13 19:42:41.612277 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application Sep 13 19:42:41.616436 dv-cinder-828806-6-smb devstack@keystone.service[82025]: [pid: 82025|app: 0|req: 468/927] 10.222.0.33 () {56 vars in 1132 bytes} [Tue Sep 13 19:42:41 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 19:42:41.617757 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd6ee0eb-6243-4364-9096-bc894e18d249 None admin] Authenticating user token {{(pid=82025) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:42:41.725728 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG dbcounter [-] [82026] Writing DB stats keystone:SELECT=100 {{(pid=82026) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:42:41.738401 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50e4e1bf-633b-4375-b6ad-14835e7dd346 None admin] Validating token access rules against request {{(pid=82026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:42:41.740571 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd6ee0eb-6243-4364-9096-bc894e18d249 None admin] Validating token access rules against request {{(pid=82025) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:42:41.758215 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG dbcounter [-] [82025] Writing DB stats keystone:SELECT=100 {{(pid=82025) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:42:41.777117 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45578668-a8c3-4899-ae8c-a64483370adf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57539b6a6f3b4d589f5f5e1d211cd6a0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82025) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:42:41.779180 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a83cf0ae-b5be-4ce9-ac6e-81cbb782ba6a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57539b6a6f3b4d589f5f5e1d211cd6a0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:42:41.779180 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a83cf0ae-b5be-4ce9-ac6e-81cbb782ba6a None admin] REQUEST_METHOD: `GET` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:42:41.779402 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45578668-a8c3-4899-ae8c-a64483370adf None admin] REQUEST_METHOD: `GET` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:42:41.779486 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a83cf0ae-b5be-4ce9-ac6e-81cbb782ba6a None admin] SCRIPT_NAME: `/identity` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:42:41.779558 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45578668-a8c3-4899-ae8c-a64483370adf None admin] SCRIPT_NAME: `/identity` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:42:41.779637 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a83cf0ae-b5be-4ce9-ac6e-81cbb782ba6a None admin] PATH_INFO: `/v3/services` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:42:41.779719 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45578668-a8c3-4899-ae8c-a64483370adf None admin] PATH_INFO: `/v3/services` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:42:41.779789 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a83cf0ae-b5be-4ce9-ac6e-81cbb782ba6a None admin] RBAC: Authorizing `identity:list_services()` {{(pid=82026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:42:41.780385 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45578668-a8c3-4899-ae8c-a64483370adf None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=82025) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 19:42:41.780875 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45578668-a8c3-4899-ae8c-a64483370adf None admin] RBAC: Authorizing `identity:list_services()` {{(pid=82025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:42:41.780987 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a83cf0ae-b5be-4ce9-ac6e-81cbb782ba6a None admin] RBAC: Authorization granted {{(pid=82026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:42:41.783141 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45578668-a8c3-4899-ae8c-a64483370adf None admin] RBAC: Authorization granted {{(pid=82025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:42:41.794094 dv-cinder-828806-6-smb devstack@keystone.service[82025]: [pid: 82025|app: 0|req: 469/928] 10.222.0.33 () {56 vars in 1126 bytes} [Tue Sep 13 19:42:41 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 13 19:42:41.795128 dv-cinder-828806-6-smb devstack@keystone.service[82026]: [pid: 82026|app: 0|req: 460/929] 10.222.0.33 () {56 vars in 1087 bytes} [Tue Sep 13 19:42:41 2022] GET /identity/v3/services => generated 1497 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 13 19:42:41.796272 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45578668-a8c3-4899-ae8c-a64483370adf None admin] Authenticating user token {{(pid=82025) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:42:41.907521 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6841a07-1e73-4297-88bb-24a2479ed911 None None] REQUEST_METHOD: `GET` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:42:41.907873 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6841a07-1e73-4297-88bb-24a2479ed911 None None] SCRIPT_NAME: `/identity` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:42:41.908124 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6841a07-1e73-4297-88bb-24a2479ed911 None None] PATH_INFO: `/` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:42:41.909996 dv-cinder-828806-6-smb devstack@keystone.service[82026]: [pid: 82026|app: 0|req: 461/930] 10.222.0.33 () {54 vars in 927 bytes} [Tue Sep 13 19:42:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 19:42:41.915582 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-445ed252-93b9-468c-9e6d-d090ffb51b02 None None] REQUEST_METHOD: `POST` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:42:41.915866 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-445ed252-93b9-468c-9e6d-d090ffb51b02 None None] SCRIPT_NAME: `/identity` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:42:41.916149 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-445ed252-93b9-468c-9e6d-d090ffb51b02 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:42:41.918053 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45578668-a8c3-4899-ae8c-a64483370adf None admin] Validating token access rules against request {{(pid=82025) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:42:41.936067 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.auth.core [None req-445ed252-93b9-468c-9e6d-d090ffb51b02 None None] MFA Rules not processed for user `57539b6a6f3b4d589f5f5e1d211cd6a0`. Rule list: `[]` (Enabled: `True`). {{(pid=82026) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 19:42:41.937390 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.common.fernet_utils [None req-445ed252-93b9-468c-9e6d-d090ffb51b02 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82026) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 19:42:41.957857 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2a2803a-f9b6-4915-b74c-1e483049c21b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57539b6a6f3b4d589f5f5e1d211cd6a0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82025) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:42:41.958932 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2a2803a-f9b6-4915-b74c-1e483049c21b None admin] REQUEST_METHOD: `GET` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:42:41.959538 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2a2803a-f9b6-4915-b74c-1e483049c21b None admin] SCRIPT_NAME: `/identity` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:42:41.960011 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2a2803a-f9b6-4915-b74c-1e483049c21b None admin] PATH_INFO: `/v3/services` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:42:41.960862 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2a2803a-f9b6-4915-b74c-1e483049c21b None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=82025) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 19:42:41.961396 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2a2803a-f9b6-4915-b74c-1e483049c21b None admin] RBAC: Authorizing `identity:list_services()` {{(pid=82025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:42:41.962994 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2a2803a-f9b6-4915-b74c-1e483049c21b None admin] RBAC: Authorization granted {{(pid=82025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:42:41.973766 dv-cinder-828806-6-smb devstack@keystone.service[82025]: [pid: 82025|app: 0|req: 470/931] 10.222.0.33 () {56 vars in 1126 bytes} [Tue Sep 13 19:42:41 2022] GET /identity/v3/services?type=compute_legacy => generated 386 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 13 19:42:41.975366 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2a2803a-f9b6-4915-b74c-1e483049c21b None admin] Authenticating user token {{(pid=82025) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:42:42.017604 dv-cinder-828806-6-smb devstack@keystone.service[82026]: [pid: 82026|app: 0|req: 462/932] 10.222.0.33 () {58 vars in 1024 bytes} [Tue Sep 13 19:42:41 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 13 19:42:42.031910 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG dbcounter [-] [82025] Writing DB stats keystone:SELECT=100 {{(pid=82025) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:42:42.089138 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2a2803a-f9b6-4915-b74c-1e483049c21b None admin] Validating token access rules against request {{(pid=82025) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:42:42.125858 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ee45c72-af7d-43f3-a408-5019ef4fad24 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57539b6a6f3b4d589f5f5e1d211cd6a0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82025) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:42:42.126814 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ee45c72-af7d-43f3-a408-5019ef4fad24 None admin] REQUEST_METHOD: `POST` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:42:42.127221 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ee45c72-af7d-43f3-a408-5019ef4fad24 None admin] SCRIPT_NAME: `/identity` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:42:42.127505 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ee45c72-af7d-43f3-a408-5019ef4fad24 None admin] PATH_INFO: `/v3/endpoints` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:42:42.128194 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ee45c72-af7d-43f3-a408-5019ef4fad24 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=82025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:42:42.129564 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ee45c72-af7d-43f3-a408-5019ef4fad24 None admin] RBAC: Authorization granted {{(pid=82025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:42:42.225786 dv-cinder-828806-6-smb devstack@keystone.service[82025]: [pid: 82025|app: 0|req: 471/933] 10.222.0.33 () {60 vars in 1144 bytes} [Tue Sep 13 19:42:41 2022] POST /identity/v3/endpoints => generated 347 bytes in 251 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 13 19:42:42.297300 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-445ed252-93b9-468c-9e6d-d090ffb51b02 None None] Authenticating user token {{(pid=82026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:42:42.397745 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG dbcounter [-] [82026] Writing DB stats keystone:SELECT=100 {{(pid=82026) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:42:42.417207 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-445ed252-93b9-468c-9e6d-d090ffb51b02 None None] Validating token access rules against request {{(pid=82026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:42:42.459151 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9859382-7a4d-4a8a-8865-2dc002ec9394 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57539b6a6f3b4d589f5f5e1d211cd6a0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:42:42.459794 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9859382-7a4d-4a8a-8865-2dc002ec9394 None admin] REQUEST_METHOD: `GET` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:42:42.460080 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9859382-7a4d-4a8a-8865-2dc002ec9394 None admin] SCRIPT_NAME: `/identity` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:42:42.460359 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9859382-7a4d-4a8a-8865-2dc002ec9394 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:42:42.470649 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9859382-7a4d-4a8a-8865-2dc002ec9394 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=82026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 13 19:42:42.475682 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application [None req-d9859382-7a4d-4a8a-8865-2dc002ec9394 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Sep 13 19:42:42.475682 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 19:42:42.475682 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 19:42:42.475682 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 19:42:42.475682 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 19:42:42.475682 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 19:42:42.475682 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 19:42:42.475682 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 19:42:42.475682 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 19:42:42.475682 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 19:42:42.475682 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 19:42:42.475682 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 19:42:42.475682 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 13 19:42:42.475682 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 13 19:42:42.475682 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 13 19:42:42.475682 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 13 19:42:42.476614 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 13 19:42:42.476614 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 13 19:42:42.476614 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 13 19:42:42.476614 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 13 19:42:42.476614 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 19:42:42.476614 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 19:42:42.476614 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 19:42:42.476614 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 19:42:42.476614 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 19:42:42.476614 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 19:42:42.476614 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 19:42:42.476614 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application with Lock( Sep 13 19:42:42.476614 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 19:42:42.476614 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application return self._enter() Sep 13 19:42:42.476614 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 19:42:42.476614 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 19:42:42.477451 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 19:42:42.477451 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application return self.creator() Sep 13 19:42:42.477451 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 19:42:42.477451 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application created_value = creator( Sep 13 19:42:42.477451 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 13 19:42:42.477451 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 13 19:42:42.477451 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 13 19:42:42.477451 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 13 19:42:42.477451 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 13 19:42:42.477451 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 13 19:42:42.477451 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Sep 13 19:42:42.477451 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application Sep 13 19:42:42.477451 dv-cinder-828806-6-smb devstack@keystone.service[82026]: [pid: 82026|app: 0|req: 463/934] 10.222.0.33 () {56 vars in 1120 bytes} [Tue Sep 13 19:42:42 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 19:42:42.483161 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ee45c72-af7d-43f3-a408-5019ef4fad24 None admin] Authenticating user token {{(pid=82025) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:42:42.591517 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ee45c72-af7d-43f3-a408-5019ef4fad24 None admin] Validating token access rules against request {{(pid=82025) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:42:42.593503 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG dbcounter [-] [82025] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82025) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:42:42.627991 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2de1ebe4-d8e7-4c9f-94f6-e75ddaf03844 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57539b6a6f3b4d589f5f5e1d211cd6a0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82025) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:42:42.629004 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2de1ebe4-d8e7-4c9f-94f6-e75ddaf03844 None admin] REQUEST_METHOD: `GET` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:42:42.629486 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2de1ebe4-d8e7-4c9f-94f6-e75ddaf03844 None admin] SCRIPT_NAME: `/identity` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:42:42.629981 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2de1ebe4-d8e7-4c9f-94f6-e75ddaf03844 None admin] PATH_INFO: `/v3/roles` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:42:42.630864 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2de1ebe4-d8e7-4c9f-94f6-e75ddaf03844 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=82025) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 19:42:42.631587 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2de1ebe4-d8e7-4c9f-94f6-e75ddaf03844 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:42:42.633181 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2de1ebe4-d8e7-4c9f-94f6-e75ddaf03844 None admin] RBAC: Authorization granted {{(pid=82025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:42:42.647402 dv-cinder-828806-6-smb devstack@keystone.service[82025]: [pid: 82025|app: 0|req: 472/935] 10.222.0.33 () {56 vars in 1115 bytes} [Tue Sep 13 19:42:42 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 19:42:42.649299 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9859382-7a4d-4a8a-8865-2dc002ec9394 None admin] Authenticating user token {{(pid=82026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:42:42.761863 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9859382-7a4d-4a8a-8865-2dc002ec9394 None admin] Validating token access rules against request {{(pid=82026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:42:42.804321 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07248c7a-03e5-4ad4-8fa5-8dc2a6c3cdea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57539b6a6f3b4d589f5f5e1d211cd6a0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:42:42.804964 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07248c7a-03e5-4ad4-8fa5-8dc2a6c3cdea None admin] REQUEST_METHOD: `GET` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:42:42.805313 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07248c7a-03e5-4ad4-8fa5-8dc2a6c3cdea None admin] SCRIPT_NAME: `/identity` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:42:42.805600 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07248c7a-03e5-4ad4-8fa5-8dc2a6c3cdea None admin] PATH_INFO: `/v3/domains/Default` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:42:42.812643 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG dbcounter [-] [82026] Writing DB stats keystone:SELECT=100 {{(pid=82026) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:42:42.817013 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07248c7a-03e5-4ad4-8fa5-8dc2a6c3cdea None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=82026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:42:42.818481 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07248c7a-03e5-4ad4-8fa5-8dc2a6c3cdea None admin] RBAC: Authorization granted {{(pid=82026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:42:42.833516 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application [None req-07248c7a-03e5-4ad4-8fa5-8dc2a6c3cdea None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 13 19:42:42.833516 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 19:42:42.833516 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 19:42:42.833516 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 19:42:42.833516 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 19:42:42.833516 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 19:42:42.833516 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 19:42:42.833516 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 19:42:42.833516 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 19:42:42.833516 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 19:42:42.833516 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 19:42:42.833516 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 19:42:42.833516 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 13 19:42:42.833516 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 13 19:42:42.833516 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 13 19:42:42.833516 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 13 19:42:42.834579 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 19:42:42.834579 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 19:42:42.834579 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 19:42:42.834579 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 19:42:42.834579 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 19:42:42.834579 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 19:42:42.834579 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 19:42:42.834579 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application with Lock( Sep 13 19:42:42.834579 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 19:42:42.834579 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application return self._enter() Sep 13 19:42:42.834579 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 19:42:42.834579 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 19:42:42.834579 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 19:42:42.834579 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application return self.creator() Sep 13 19:42:42.834579 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 19:42:42.834579 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application created_value = creator( Sep 13 19:42:42.834579 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 13 19:42:42.835509 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 13 19:42:42.835509 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 13 19:42:42.835509 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application Sep 13 19:42:42.835509 dv-cinder-828806-6-smb devstack@keystone.service[82026]: [pid: 82026|app: 0|req: 464/936] 10.222.0.33 () {56 vars in 1108 bytes} [Tue Sep 13 19:42:42 2022] GET /identity/v3/domains/Default => generated 87 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 19:42:42.841999 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2de1ebe4-d8e7-4c9f-94f6-e75ddaf03844 None admin] Authenticating user token {{(pid=82025) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:42:42.945378 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2de1ebe4-d8e7-4c9f-94f6-e75ddaf03844 None admin] Validating token access rules against request {{(pid=82025) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:42:42.981062 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb57c24e-fc91-4252-be7b-1106fcad6893 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57539b6a6f3b4d589f5f5e1d211cd6a0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82025) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:42:42.982071 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb57c24e-fc91-4252-be7b-1106fcad6893 None admin] REQUEST_METHOD: `GET` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:42:42.982551 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb57c24e-fc91-4252-be7b-1106fcad6893 None admin] SCRIPT_NAME: `/identity` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:42:42.983022 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb57c24e-fc91-4252-be7b-1106fcad6893 None admin] PATH_INFO: `/v3/domains` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:42:42.983882 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb57c24e-fc91-4252-be7b-1106fcad6893 None admin] RBAC: Adding query filter params (name=Default) {{(pid=82025) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 19:42:42.984404 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb57c24e-fc91-4252-be7b-1106fcad6893 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:42:42.986641 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb57c24e-fc91-4252-be7b-1106fcad6893 None admin] RBAC: Authorization granted {{(pid=82025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:42:42.999083 dv-cinder-828806-6-smb devstack@keystone.service[82025]: [pid: 82025|app: 0|req: 473/937] 10.222.0.33 () {56 vars in 1109 bytes} [Tue Sep 13 19:42:42 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 19:42:43.005610 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07248c7a-03e5-4ad4-8fa5-8dc2a6c3cdea None admin] Authenticating user token {{(pid=82026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:42:43.116661 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07248c7a-03e5-4ad4-8fa5-8dc2a6c3cdea None admin] Validating token access rules against request {{(pid=82026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:42:43.152178 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41aaf742-b210-4bd6-950a-21200b5e4668 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57539b6a6f3b4d589f5f5e1d211cd6a0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:42:43.153170 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41aaf742-b210-4bd6-950a-21200b5e4668 None admin] REQUEST_METHOD: `GET` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:42:43.153701 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41aaf742-b210-4bd6-950a-21200b5e4668 None admin] SCRIPT_NAME: `/identity` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:42:43.154170 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41aaf742-b210-4bd6-950a-21200b5e4668 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:42:43.162752 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41aaf742-b210-4bd6-950a-21200b5e4668 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=82026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:42:43.164639 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41aaf742-b210-4bd6-950a-21200b5e4668 None admin] RBAC: Authorization granted {{(pid=82026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:42:43.175108 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7beff3d-a48d-4c62-b9df-8f028d2916b1 None None] REQUEST_METHOD: `GET` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:42:43.175408 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7beff3d-a48d-4c62-b9df-8f028d2916b1 None None] SCRIPT_NAME: `/identity` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:42:43.175693 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7beff3d-a48d-4c62-b9df-8f028d2916b1 None None] PATH_INFO: `/` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:42:43.177299 dv-cinder-828806-6-smb devstack@keystone.service[82025]: [pid: 82025|app: 0|req: 474/938] 10.222.0.33 () {54 vars in 927 bytes} [Tue Sep 13 19:42:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 13 19:42:43.178364 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application [None req-41aaf742-b210-4bd6-950a-21200b5e4668 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Sep 13 19:42:43.178364 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 19:42:43.178364 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 19:42:43.178364 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 19:42:43.178364 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 19:42:43.178364 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 19:42:43.178364 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 19:42:43.178364 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 19:42:43.178364 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 19:42:43.178364 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 19:42:43.178364 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 19:42:43.178364 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 19:42:43.178364 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 13 19:42:43.178364 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 13 19:42:43.178364 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 13 19:42:43.178364 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 13 19:42:43.179286 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 19:42:43.179286 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 19:42:43.179286 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 13 19:42:43.179286 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 13 19:42:43.179286 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 13 19:42:43.179286 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 13 19:42:43.179286 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 19:42:43.179286 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 19:42:43.179286 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 19:42:43.179286 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 19:42:43.179286 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 19:42:43.179286 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application with Lock( Sep 13 19:42:43.179286 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 19:42:43.179286 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application return self._enter() Sep 13 19:42:43.179286 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 19:42:43.179286 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 19:42:43.179286 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 19:42:43.179286 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application return self.creator() Sep 13 19:42:43.180228 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 19:42:43.180228 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application created_value = creator( Sep 13 19:42:43.180228 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 13 19:42:43.180228 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 13 19:42:43.180228 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 13 19:42:43.180228 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 13 19:42:43.180228 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 13 19:42:43.180228 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 13 19:42:43.180228 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Sep 13 19:42:43.180228 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application Sep 13 19:42:43.182192 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f30de3e-29e2-4d6d-a671-3aafa6d634ca None None] REQUEST_METHOD: `POST` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:42:43.182600 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f30de3e-29e2-4d6d-a671-3aafa6d634ca None None] SCRIPT_NAME: `/identity` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:42:43.182778 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f30de3e-29e2-4d6d-a671-3aafa6d634ca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:42:43.183172 dv-cinder-828806-6-smb devstack@keystone.service[82026]: [pid: 82026|app: 0|req: 465/939] 10.222.0.33 () {56 vars in 1117 bytes} [Tue Sep 13 19:42:43 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 19:42:43.188911 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41aaf742-b210-4bd6-950a-21200b5e4668 None admin] Authenticating user token {{(pid=82026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:42:43.203246 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.auth.core [None req-0f30de3e-29e2-4d6d-a671-3aafa6d634ca None None] MFA Rules not processed for user `57539b6a6f3b4d589f5f5e1d211cd6a0`. Rule list: `[]` (Enabled: `True`). {{(pid=82025) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 19:42:43.205036 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.fernet_utils [None req-0f30de3e-29e2-4d6d-a671-3aafa6d634ca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82025) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 19:42:43.224452 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG dbcounter [-] [82025] Writing DB stats keystone:SELECT=100 {{(pid=82025) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:42:43.260997 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG dbcounter [-] [82026] Writing DB stats keystone:SELECT=100 {{(pid=82026) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:42:43.305440 dv-cinder-828806-6-smb devstack@keystone.service[82025]: [pid: 82025|app: 0|req: 475/940] 10.222.0.33 () {58 vars in 1024 bytes} [Tue Sep 13 19:42:43 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 13 19:42:43.332709 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41aaf742-b210-4bd6-950a-21200b5e4668 None admin] Validating token access rules against request {{(pid=82026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:42:43.369193 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ef5fd95-8542-44ed-b980-fab7a2b7b534 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57539b6a6f3b4d589f5f5e1d211cd6a0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:42:43.370052 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ef5fd95-8542-44ed-b980-fab7a2b7b534 None admin] REQUEST_METHOD: `GET` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:42:43.370508 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ef5fd95-8542-44ed-b980-fab7a2b7b534 None admin] SCRIPT_NAME: `/identity` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:42:43.370968 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ef5fd95-8542-44ed-b980-fab7a2b7b534 None admin] PATH_INFO: `/v3/users` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:42:43.371889 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ef5fd95-8542-44ed-b980-fab7a2b7b534 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=82026) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 19:42:43.372385 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ef5fd95-8542-44ed-b980-fab7a2b7b534 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=82026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:42:43.373991 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ef5fd95-8542-44ed-b980-fab7a2b7b534 None admin] RBAC: Authorization granted {{(pid=82026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:42:43.392439 dv-cinder-828806-6-smb devstack@keystone.service[82026]: [pid: 82026|app: 0|req: 466/941] 10.222.0.33 () {56 vars in 1149 bytes} [Tue Sep 13 19:42:43 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 13 19:42:43.398264 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f30de3e-29e2-4d6d-a671-3aafa6d634ca None None] Authenticating user token {{(pid=82025) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:42:43.510310 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f30de3e-29e2-4d6d-a671-3aafa6d634ca None None] Validating token access rules against request {{(pid=82025) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:42:43.546320 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62e15d53-6e85-47a0-809a-0de0fbe58c39 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57539b6a6f3b4d589f5f5e1d211cd6a0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82025) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:42:43.547264 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62e15d53-6e85-47a0-809a-0de0fbe58c39 None admin] REQUEST_METHOD: `GET` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:42:43.547741 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62e15d53-6e85-47a0-809a-0de0fbe58c39 None admin] SCRIPT_NAME: `/identity` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:42:43.548356 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62e15d53-6e85-47a0-809a-0de0fbe58c39 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:42:43.558731 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62e15d53-6e85-47a0-809a-0de0fbe58c39 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=82025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:42:43.560426 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62e15d53-6e85-47a0-809a-0de0fbe58c39 None admin] RBAC: Authorization granted {{(pid=82025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:42:43.576176 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application [None req-62e15d53-6e85-47a0-809a-0de0fbe58c39 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 13 19:42:43.576176 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 19:42:43.576176 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 19:42:43.576176 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 19:42:43.576176 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 19:42:43.576176 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 19:42:43.576176 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 19:42:43.576176 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 19:42:43.576176 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 19:42:43.576176 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 19:42:43.576176 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 19:42:43.576176 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 19:42:43.576176 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 13 19:42:43.576176 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 13 19:42:43.576176 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 13 19:42:43.576176 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 13 19:42:43.577154 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 19:42:43.577154 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 19:42:43.577154 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 19:42:43.577154 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 19:42:43.577154 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 19:42:43.577154 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 19:42:43.577154 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 19:42:43.577154 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application with Lock( Sep 13 19:42:43.577154 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 19:42:43.577154 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application return self._enter() Sep 13 19:42:43.577154 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 19:42:43.577154 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 19:42:43.577154 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 19:42:43.577154 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application return self.creator() Sep 13 19:42:43.577154 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 19:42:43.577154 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application created_value = creator( Sep 13 19:42:43.577154 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 13 19:42:43.578049 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 13 19:42:43.578049 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 13 19:42:43.578049 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application Sep 13 19:42:43.579945 dv-cinder-828806-6-smb devstack@keystone.service[82025]: [pid: 82025|app: 0|req: 476/942] 10.222.0.33 () {56 vars in 1108 bytes} [Tue Sep 13 19:42:43 2022] GET /identity/v3/domains/Default => generated 87 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 19:42:43.585688 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ef5fd95-8542-44ed-b980-fab7a2b7b534 None admin] Authenticating user token {{(pid=82026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:42:43.628182 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62e15d53-6e85-47a0-809a-0de0fbe58c39 None admin] Authenticating user token {{(pid=82025) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:42:43.638246 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG dbcounter [-] [82025] Writing DB stats keystone:SELECT=100 {{(pid=82025) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:42:43.708683 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ef5fd95-8542-44ed-b980-fab7a2b7b534 None admin] Validating token access rules against request {{(pid=82026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:42:43.718585 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG dbcounter [-] [82026] Writing DB stats keystone:SELECT=100 {{(pid=82026) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:42:43.753388 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62e15d53-6e85-47a0-809a-0de0fbe58c39 None admin] Validating token access rules against request {{(pid=82025) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:42:43.763507 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-342345c1-f24c-4900-8783-d611ea1e9cc5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57539b6a6f3b4d589f5f5e1d211cd6a0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:42:43.764117 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-342345c1-f24c-4900-8783-d611ea1e9cc5 None admin] REQUEST_METHOD: `GET` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:42:43.764404 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-342345c1-f24c-4900-8783-d611ea1e9cc5 None admin] SCRIPT_NAME: `/identity` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:42:43.764688 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-342345c1-f24c-4900-8783-d611ea1e9cc5 None admin] PATH_INFO: `/v3/domains` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:42:43.765326 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-342345c1-f24c-4900-8783-d611ea1e9cc5 None admin] RBAC: Adding query filter params (name=Default) {{(pid=82026) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 19:42:43.765630 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-342345c1-f24c-4900-8783-d611ea1e9cc5 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:42:43.767702 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-342345c1-f24c-4900-8783-d611ea1e9cc5 None admin] RBAC: Authorization granted {{(pid=82026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:42:43.784708 dv-cinder-828806-6-smb devstack@keystone.service[82026]: [pid: 82026|app: 0|req: 467/943] 10.222.0.33 () {56 vars in 1109 bytes} [Tue Sep 13 19:42:43 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 19:42:43.785763 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-342345c1-f24c-4900-8783-d611ea1e9cc5 None admin] Authenticating user token {{(pid=82026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:42:43.801689 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65f89d97-2301-4ad7-908d-9c1d74e65858 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57539b6a6f3b4d589f5f5e1d211cd6a0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82025) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:42:43.802552 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65f89d97-2301-4ad7-908d-9c1d74e65858 None admin] REQUEST_METHOD: `POST` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:42:43.803026 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65f89d97-2301-4ad7-908d-9c1d74e65858 None admin] SCRIPT_NAME: `/identity` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:42:43.803501 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65f89d97-2301-4ad7-908d-9c1d74e65858 None admin] PATH_INFO: `/v3/projects` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:42:43.804360 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65f89d97-2301-4ad7-908d-9c1d74e65858 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=82025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:42:43.806789 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65f89d97-2301-4ad7-908d-9c1d74e65858 None admin] RBAC: Authorization granted {{(pid=82025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:42:43.810092 dv-cinder-828806-6-smb devstack@keystone.service[82025]: WARNING keystone.server.flask.common [None req-65f89d97-2301-4ad7-908d-9c1d74e65858 None admin] Deprecated: Not specifying a domain during a create user, group or project call, and relying on falling back to the default domain, is deprecated as of Liberty. There is no plan to remove this compatibility, however, future API versions may remove this, so please specify the domain explicitly or use a domain-scoped token. Sep 13 19:42:43.861160 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.sql.core [None req-65f89d97-2301-4ad7-908d-9c1d74e65858 None admin] Conflict project: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") Sep 13 19:42:43.861160 dv-cinder-828806-6-smb devstack@keystone.service[82025]: [SQL: INSERT INTO project (id, name, domain_id, description, enabled, extra, parent_id, is_domain) VALUES (%(id)s, %(name)s, %(domain_id)s, %(description)s, %(enabled)s, %(extra)s, %(parent_id)s, %(is_domain)s)] Sep 13 19:42:43.861160 dv-cinder-828806-6-smb devstack@keystone.service[82025]: [parameters: {'id': '5b8b8ea87a3744f7a03e5b5234405cc7', 'name': 'service', 'domain_id': 'default', 'description': '', 'enabled': 1, 'extra': '{}', 'parent_id': 'default', 'is_domain': 0}] Sep 13 19:42:43.861160 dv-cinder-828806-6-smb devstack@keystone.service[82025]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=82025) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Sep 13 19:42:43.870715 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application [None req-65f89d97-2301-4ad7-908d-9c1d74e65858 None admin] Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id 5b8b8ea87a3744f7a03e5b5234405cc7.: keystone.exception.Conflict: Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id 5b8b8ea87a3744f7a03e5b5234405cc7. Sep 13 19:42:43.870715 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 19:42:43.870715 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Sep 13 19:42:43.870715 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application self.dialect.do_execute( Sep 13 19:42:43.870715 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Sep 13 19:42:43.870715 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Sep 13 19:42:43.870715 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Sep 13 19:42:43.870715 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application result = self._query(query) Sep 13 19:42:43.870715 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Sep 13 19:42:43.870715 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application conn.query(q) Sep 13 19:42:43.870715 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Sep 13 19:42:43.870715 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Sep 13 19:42:43.870715 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Sep 13 19:42:43.871643 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application result.read() Sep 13 19:42:43.871643 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Sep 13 19:42:43.871643 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Sep 13 19:42:43.871643 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Sep 13 19:42:43.871643 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application packet.raise_for_error() Sep 13 19:42:43.871643 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Sep 13 19:42:43.871643 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Sep 13 19:42:43.871643 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Sep 13 19:42:43.871643 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Sep 13 19:42:43.871643 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") Sep 13 19:42:43.871643 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application Sep 13 19:42:43.871643 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: Sep 13 19:42:43.871643 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application Sep 13 19:42:43.871643 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 19:42:43.871643 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Sep 13 19:42:43.871643 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application return method(*args, **kwargs) Sep 13 19:42:43.871643 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 241, in create_project Sep 13 19:42:43.871643 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application return project_ref.to_dict() Sep 13 19:42:43.872603 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Sep 13 19:42:43.872603 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application next(self.gen) Sep 13 19:42:43.872603 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope Sep 13 19:42:43.872603 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application yield resource Sep 13 19:42:43.872603 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Sep 13 19:42:43.872603 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application next(self.gen) Sep 13 19:42:43.872603 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session Sep 13 19:42:43.872603 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application self.session.rollback() Sep 13 19:42:43.872603 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Sep 13 19:42:43.872603 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application self.force_reraise() Sep 13 19:42:43.872603 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Sep 13 19:42:43.872603 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application raise self.value Sep 13 19:42:43.872603 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session Sep 13 19:42:43.872603 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Sep 13 19:42:43.872603 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction Sep 13 19:42:43.872603 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application session.commit() Sep 13 19:42:43.872603 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1451, in commit Sep 13 19:42:43.873510 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Sep 13 19:42:43.873510 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Sep 13 19:42:43.873510 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application self._prepare_impl() Sep 13 19:42:43.873510 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Sep 13 19:42:43.873510 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application self.session.flush() Sep 13 19:42:43.873510 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Sep 13 19:42:43.873510 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application self._flush(objects) Sep 13 19:42:43.873510 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Sep 13 19:42:43.873510 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Sep 13 19:42:43.873510 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Sep 13 19:42:43.873510 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application compat.raise_( Sep 13 19:42:43.873510 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Sep 13 19:42:43.873510 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application raise exception Sep 13 19:42:43.873510 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Sep 13 19:42:43.873510 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application flush_context.execute() Sep 13 19:42:43.873510 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Sep 13 19:42:43.873510 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application rec.execute(self) Sep 13 19:42:43.874769 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Sep 13 19:42:43.874769 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( Sep 13 19:42:43.874769 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Sep 13 19:42:43.874769 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application _emit_insert_statements( Sep 13 19:42:43.874769 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1097, in _emit_insert_statements Sep 13 19:42:43.874769 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application c = connection._execute_20( Sep 13 19:42:43.874769 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1705, in _execute_20 Sep 13 19:42:43.874769 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) Sep 13 19:42:43.874769 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 333, in _execute_on_connection Sep 13 19:42:43.874769 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application return connection._execute_clauseelement( Sep 13 19:42:43.874769 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1572, in _execute_clauseelement Sep 13 19:42:43.874769 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application ret = self._execute_context( Sep 13 19:42:43.874769 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1943, in _execute_context Sep 13 19:42:43.874769 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application self._handle_dbapi_exception( Sep 13 19:42:43.874769 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2122, in _handle_dbapi_exception Sep 13 19:42:43.877137 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) Sep 13 19:42:43.877137 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Sep 13 19:42:43.877137 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application raise exception Sep 13 19:42:43.877137 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Sep 13 19:42:43.877137 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application self.dialect.do_execute( Sep 13 19:42:43.877137 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Sep 13 19:42:43.877137 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Sep 13 19:42:43.877137 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Sep 13 19:42:43.877137 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application result = self._query(query) Sep 13 19:42:43.877137 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Sep 13 19:42:43.877137 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application conn.query(q) Sep 13 19:42:43.877137 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Sep 13 19:42:43.877137 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Sep 13 19:42:43.877137 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Sep 13 19:42:43.877137 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application result.read() Sep 13 19:42:43.877137 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Sep 13 19:42:43.877137 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Sep 13 19:42:43.882448 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Sep 13 19:42:43.882448 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application packet.raise_for_error() Sep 13 19:42:43.882448 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Sep 13 19:42:43.882448 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Sep 13 19:42:43.882448 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Sep 13 19:42:43.882448 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Sep 13 19:42:43.882448 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") Sep 13 19:42:43.882448 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application [SQL: INSERT INTO project (id, name, domain_id, description, enabled, extra, parent_id, is_domain) VALUES (%(id)s, %(name)s, %(domain_id)s, %(description)s, %(enabled)s, %(extra)s, %(parent_id)s, %(is_domain)s)] Sep 13 19:42:43.882448 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application [parameters: {'id': '5b8b8ea87a3744f7a03e5b5234405cc7', 'name': 'service', 'domain_id': 'default', 'description': '', 'enabled': 1, 'extra': '{}', 'parent_id': 'default', 'is_domain': 0}] Sep 13 19:42:43.882448 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) Sep 13 19:42:43.882448 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application Sep 13 19:42:43.882448 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 13 19:42:43.882448 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application Sep 13 19:42:43.882448 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 19:42:43.882448 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 216, in create_project Sep 13 19:42:43.883363 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application ret = self.driver.create_project(project_id, project) Sep 13 19:42:43.883363 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper Sep 13 19:42:43.883363 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, Sep 13 19:42:43.883363 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store project - Duplicate entry found with name service at domain ID default. Sep 13 19:42:43.883363 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application Sep 13 19:42:43.883363 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 13 19:42:43.883363 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application Sep 13 19:42:43.883363 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 19:42:43.883363 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 19:42:43.883363 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 19:42:43.883363 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 19:42:43.883363 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 19:42:43.883363 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 19:42:43.883363 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 19:42:43.883363 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 19:42:43.883363 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 19:42:43.883363 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 19:42:43.884310 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 19:42:43.884310 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 176, in post Sep 13 19:42:43.884310 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application ref = PROVIDERS.resource_api.create_project( Sep 13 19:42:43.884310 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 19:42:43.884310 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 19:42:43.884310 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 218, in create_project Sep 13 19:42:43.884310 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application raise exception.Conflict( Sep 13 19:42:43.884310 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id 5b8b8ea87a3744f7a03e5b5234405cc7. Sep 13 19:42:43.884310 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application Sep 13 19:42:43.884310 dv-cinder-828806-6-smb devstack@keystone.service[82025]: [pid: 82025|app: 0|req: 477/944] 10.222.0.33 () {60 vars in 1140 bytes} [Tue Sep 13 19:42:43 2022] POST /identity/v3/projects => generated 262 bytes in 253 msecs (HTTP/1.1 409) 5 headers in 183 bytes (2 switches on core 0) Sep 13 19:42:43.887979 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65f89d97-2301-4ad7-908d-9c1d74e65858 None admin] Authenticating user token {{(pid=82025) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:42:43.904198 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-342345c1-f24c-4900-8783-d611ea1e9cc5 None admin] Validating token access rules against request {{(pid=82026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:42:43.948528 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dc5d8da-e449-4252-a5c9-9bb332e8bfeb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57539b6a6f3b4d589f5f5e1d211cd6a0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:42:43.949111 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dc5d8da-e449-4252-a5c9-9bb332e8bfeb None admin] REQUEST_METHOD: `GET` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:42:43.949403 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dc5d8da-e449-4252-a5c9-9bb332e8bfeb None admin] SCRIPT_NAME: `/identity` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:42:43.949681 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dc5d8da-e449-4252-a5c9-9bb332e8bfeb None admin] PATH_INFO: `/v3/projects/service` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:42:43.957496 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dc5d8da-e449-4252-a5c9-9bb332e8bfeb None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=82026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:42:43.958917 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dc5d8da-e449-4252-a5c9-9bb332e8bfeb None admin] RBAC: Authorization granted {{(pid=82026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:42:43.971364 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application [None req-9dc5d8da-e449-4252-a5c9-9bb332e8bfeb None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 13 19:42:43.971364 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 19:42:43.971364 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 19:42:43.971364 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 19:42:43.971364 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 19:42:43.971364 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 19:42:43.971364 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 19:42:43.971364 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 19:42:43.971364 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 19:42:43.971364 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 19:42:43.971364 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 19:42:43.971364 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 19:42:43.971364 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 13 19:42:43.971364 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 13 19:42:43.971364 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 13 19:42:43.972333 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 13 19:42:43.972333 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 19:42:43.972333 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 19:42:43.972333 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 19:42:43.972333 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 19:42:43.972333 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 19:42:43.972333 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 19:42:43.972333 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 19:42:43.972333 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application with Lock( Sep 13 19:42:43.972333 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 19:42:43.972333 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application return self._enter() Sep 13 19:42:43.972333 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 19:42:43.972333 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 19:42:43.972333 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 19:42:43.972333 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application return self.creator() Sep 13 19:42:43.972333 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 19:42:43.972333 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application created_value = creator( Sep 13 19:42:43.973236 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 13 19:42:43.973236 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 13 19:42:43.973236 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 13 19:42:43.973236 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 13 19:42:43.973236 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 13 19:42:43.973236 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 13 19:42:43.973236 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 13 19:42:43.973236 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application Sep 13 19:42:43.976616 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG dbcounter [-] [82025] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82025) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:42:43.977656 dv-cinder-828806-6-smb devstack@keystone.service[82026]: [pid: 82026|app: 0|req: 468/945] 10.222.0.33 () {56 vars in 1111 bytes} [Tue Sep 13 19:42:43 2022] GET /identity/v3/projects/service => generated 88 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 13 19:42:43.978219 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dc5d8da-e449-4252-a5c9-9bb332e8bfeb None admin] Authenticating user token {{(pid=82026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:42:44.009449 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG dbcounter [-] [82026] Writing DB stats keystone:SELECT=100 {{(pid=82026) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:42:44.030484 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65f89d97-2301-4ad7-908d-9c1d74e65858 None admin] Validating token access rules against request {{(pid=82025) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:42:44.077049 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d001640-0144-473f-9515-d419c7918313 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57539b6a6f3b4d589f5f5e1d211cd6a0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82025) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:42:44.078067 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d001640-0144-473f-9515-d419c7918313 None admin] REQUEST_METHOD: `GET` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:42:44.078591 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d001640-0144-473f-9515-d419c7918313 None admin] SCRIPT_NAME: `/identity` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:42:44.079129 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d001640-0144-473f-9515-d419c7918313 None admin] PATH_INFO: `/v3/projects/service` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:42:44.088675 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d001640-0144-473f-9515-d419c7918313 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=82025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:42:44.091788 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d001640-0144-473f-9515-d419c7918313 None admin] RBAC: Authorization granted {{(pid=82025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:42:44.093752 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dc5d8da-e449-4252-a5c9-9bb332e8bfeb None admin] Validating token access rules against request {{(pid=82026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:42:44.106212 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application [None req-0d001640-0144-473f-9515-d419c7918313 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 13 19:42:44.106212 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 19:42:44.106212 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 19:42:44.106212 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 19:42:44.106212 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 19:42:44.106212 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 19:42:44.106212 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 19:42:44.106212 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 19:42:44.106212 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 19:42:44.106212 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 19:42:44.106212 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 19:42:44.106212 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 19:42:44.106212 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 13 19:42:44.106212 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 13 19:42:44.106212 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 13 19:42:44.107199 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 13 19:42:44.107199 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 19:42:44.107199 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 19:42:44.107199 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 19:42:44.107199 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 19:42:44.107199 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 19:42:44.107199 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 19:42:44.107199 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 19:42:44.107199 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application with Lock( Sep 13 19:42:44.107199 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 19:42:44.107199 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application return self._enter() Sep 13 19:42:44.107199 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 19:42:44.107199 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 19:42:44.107199 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 19:42:44.107199 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application return self.creator() Sep 13 19:42:44.107199 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 19:42:44.107199 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application created_value = creator( Sep 13 19:42:44.108425 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 13 19:42:44.108425 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 13 19:42:44.108425 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 13 19:42:44.108425 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 13 19:42:44.108425 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 13 19:42:44.108425 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 13 19:42:44.108425 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 13 19:42:44.108425 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application Sep 13 19:42:44.111561 dv-cinder-828806-6-smb devstack@keystone.service[82025]: [pid: 82025|app: 0|req: 478/946] 10.222.0.33 () {56 vars in 1111 bytes} [Tue Sep 13 19:42:43 2022] GET /identity/v3/projects/service => generated 88 bytes in 224 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 19:42:44.119203 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d001640-0144-473f-9515-d419c7918313 None admin] Authenticating user token {{(pid=82025) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:42:44.137988 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1485c74-b832-4b90-ad30-959c2237c3c2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57539b6a6f3b4d589f5f5e1d211cd6a0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:42:44.138501 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1485c74-b832-4b90-ad30-959c2237c3c2 None admin] REQUEST_METHOD: `GET` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:42:44.138787 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1485c74-b832-4b90-ad30-959c2237c3c2 None admin] SCRIPT_NAME: `/identity` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:42:44.139153 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1485c74-b832-4b90-ad30-959c2237c3c2 None admin] PATH_INFO: `/v3/projects` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:42:44.139854 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1485c74-b832-4b90-ad30-959c2237c3c2 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=82026) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 19:42:44.140173 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1485c74-b832-4b90-ad30-959c2237c3c2 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=82026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:42:44.141881 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1485c74-b832-4b90-ad30-959c2237c3c2 None admin] RBAC: Authorization granted {{(pid=82026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:42:44.155233 dv-cinder-828806-6-smb devstack@keystone.service[82026]: [pid: 82026|app: 0|req: 469/947] 10.222.0.33 () {56 vars in 1148 bytes} [Tue Sep 13 19:42:43 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 19:42:44.162195 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1485c74-b832-4b90-ad30-959c2237c3c2 None admin] Authenticating user token {{(pid=82026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:42:44.233248 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d001640-0144-473f-9515-d419c7918313 None admin] Validating token access rules against request {{(pid=82025) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:42:44.258943 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG dbcounter [-] [82025] Writing DB stats keystone:SELECT=100 {{(pid=82025) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:42:44.261662 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG dbcounter [-] [82026] Writing DB stats keystone:SELECT=100 {{(pid=82026) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:42:44.271263 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fccf8a0-7d8a-407c-9906-e0bb3f1e6c93 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57539b6a6f3b4d589f5f5e1d211cd6a0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82025) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:42:44.271878 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fccf8a0-7d8a-407c-9906-e0bb3f1e6c93 None admin] REQUEST_METHOD: `GET` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:42:44.272162 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fccf8a0-7d8a-407c-9906-e0bb3f1e6c93 None admin] SCRIPT_NAME: `/identity` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:42:44.272448 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fccf8a0-7d8a-407c-9906-e0bb3f1e6c93 None admin] PATH_INFO: `/v3/projects` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:42:44.273108 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fccf8a0-7d8a-407c-9906-e0bb3f1e6c93 None admin] RBAC: Adding query filter params (name=service) {{(pid=82025) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 19:42:44.273418 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fccf8a0-7d8a-407c-9906-e0bb3f1e6c93 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=82025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:42:44.274588 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1485c74-b832-4b90-ad30-959c2237c3c2 None admin] Validating token access rules against request {{(pid=82026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:42:44.274844 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fccf8a0-7d8a-407c-9906-e0bb3f1e6c93 None admin] RBAC: Authorization granted {{(pid=82025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:42:44.302177 dv-cinder-828806-6-smb devstack@keystone.service[82025]: [pid: 82025|app: 0|req: 479/948] 10.222.0.33 () {56 vars in 1112 bytes} [Tue Sep 13 19:42:44 2022] GET /identity/v3/projects?name=service => generated 411 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 19:42:44.303686 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e3bed86-d288-4d95-b813-b042e447516f None None] REQUEST_METHOD: `GET` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:42:44.303979 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e3bed86-d288-4d95-b813-b042e447516f None None] SCRIPT_NAME: `/identity` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:42:44.304281 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e3bed86-d288-4d95-b813-b042e447516f None None] PATH_INFO: `/` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:42:44.307070 dv-cinder-828806-6-smb devstack@keystone.service[82025]: [pid: 82025|app: 0|req: 480/949] 10.222.0.33 () {54 vars in 927 bytes} [Tue Sep 13 19:42:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 19:42:44.311588 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c731af38-9634-484f-8cc3-300e555564b2 None None] REQUEST_METHOD: `POST` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:42:44.311860 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c731af38-9634-484f-8cc3-300e555564b2 None None] SCRIPT_NAME: `/identity` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:42:44.312152 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c731af38-9634-484f-8cc3-300e555564b2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:42:44.327234 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d03dfbef-ba51-440a-9fba-4343a8aea1d7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57539b6a6f3b4d589f5f5e1d211cd6a0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:42:44.328228 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d03dfbef-ba51-440a-9fba-4343a8aea1d7 None admin] REQUEST_METHOD: `PUT` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:42:44.328722 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d03dfbef-ba51-440a-9fba-4343a8aea1d7 None admin] SCRIPT_NAME: `/identity` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:42:44.329221 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d03dfbef-ba51-440a-9fba-4343a8aea1d7 None admin] PATH_INFO: `/v3/projects/c8c6fba0f15b4d6a84ff601919b7b8e4/users/a28e738b894442e2bc9880eeb64fc0c8/roles/2d9e933a00cb40c3bb31cbfc8127f9ec` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:42:44.331849 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d03dfbef-ba51-440a-9fba-4343a8aea1d7 None admin] RBAC: Authorizing `identity:create_grant(project_id=c8c6fba0f15b4d6a84ff601919b7b8e4, user_id=a28e738b894442e2bc9880eeb64fc0c8, role_id=2d9e933a00cb40c3bb31cbfc8127f9ec)` {{(pid=82026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:42:44.333595 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d03dfbef-ba51-440a-9fba-4343a8aea1d7 None admin] RBAC: Authorization granted {{(pid=82026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:42:44.334927 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.auth.core [None req-c731af38-9634-484f-8cc3-300e555564b2 None None] MFA Rules not processed for user `57539b6a6f3b4d589f5f5e1d211cd6a0`. Rule list: `[]` (Enabled: `True`). {{(pid=82025) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 19:42:44.336848 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.fernet_utils [None req-c731af38-9634-484f-8cc3-300e555564b2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82025) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 19:42:44.408230 dv-cinder-828806-6-smb devstack@keystone.service[82026]: [pid: 82026|app: 0|req: 470/950] 10.222.0.33 () {58 vars in 1439 bytes} [Tue Sep 13 19:42:44 2022] PUT /identity/v3/projects/c8c6fba0f15b4d6a84ff601919b7b8e4/users/a28e738b894442e2bc9880eeb64fc0c8/roles/2d9e933a00cb40c3bb31cbfc8127f9ec => generated 0 bytes in 240 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 19:42:44.424017 dv-cinder-828806-6-smb devstack@keystone.service[82025]: [pid: 82025|app: 0|req: 481/951] 10.222.0.33 () {58 vars in 1024 bytes} [Tue Sep 13 19:42:44 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 13 19:42:44.592772 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acc491fb-d80d-49d3-b9c5-b37ace9a0279 None None] REQUEST_METHOD: `GET` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:42:44.593678 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acc491fb-d80d-49d3-b9c5-b37ace9a0279 None None] SCRIPT_NAME: `/identity` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:42:44.594169 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acc491fb-d80d-49d3-b9c5-b37ace9a0279 None None] PATH_INFO: `/` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:42:44.595978 dv-cinder-828806-6-smb devstack@keystone.service[82026]: [pid: 82026|app: 0|req: 471/952] 10.222.0.33 () {54 vars in 927 bytes} [Tue Sep 13 19:42:44 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 19:42:44.601799 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4006eb7b-bc40-4b91-b24d-cce6bf7a565c None None] REQUEST_METHOD: `POST` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:42:44.602243 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4006eb7b-bc40-4b91-b24d-cce6bf7a565c None None] SCRIPT_NAME: `/identity` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:42:44.602451 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4006eb7b-bc40-4b91-b24d-cce6bf7a565c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:42:44.621942 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.auth.core [None req-4006eb7b-bc40-4b91-b24d-cce6bf7a565c None None] MFA Rules not processed for user `57539b6a6f3b4d589f5f5e1d211cd6a0`. Rule list: `[]` (Enabled: `True`). {{(pid=82025) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 19:42:44.623532 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.fernet_utils [None req-4006eb7b-bc40-4b91-b24d-cce6bf7a565c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82025) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 19:42:44.701815 dv-cinder-828806-6-smb devstack@keystone.service[82025]: [pid: 82025|app: 0|req: 482/953] 10.222.0.33 () {58 vars in 1024 bytes} [Tue Sep 13 19:42:44 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 13 19:42:44.718462 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acc491fb-d80d-49d3-b9c5-b37ace9a0279 None None] Authenticating user token {{(pid=82026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:42:44.831679 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acc491fb-d80d-49d3-b9c5-b37ace9a0279 None None] Validating token access rules against request {{(pid=82026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:42:44.869258 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2f6a6b3-4e47-4048-929f-e22f754f6b9a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57539b6a6f3b4d589f5f5e1d211cd6a0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:42:44.869964 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2f6a6b3-4e47-4048-929f-e22f754f6b9a None admin] REQUEST_METHOD: `GET` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:42:44.870245 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2f6a6b3-4e47-4048-929f-e22f754f6b9a None admin] SCRIPT_NAME: `/identity` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:42:44.870519 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2f6a6b3-4e47-4048-929f-e22f754f6b9a None admin] PATH_INFO: `/v3/services/object-store` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:42:44.871136 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2f6a6b3-4e47-4048-929f-e22f754f6b9a None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=82026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:42:44.872559 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2f6a6b3-4e47-4048-929f-e22f754f6b9a None admin] RBAC: Authorization granted {{(pid=82026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:42:44.882416 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application [None req-e2f6a6b3-4e47-4048-929f-e22f754f6b9a None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Sep 13 19:42:44.882416 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 19:42:44.882416 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 13 19:42:44.882416 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 13 19:42:44.882416 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 13 19:42:44.882416 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 13 19:42:44.882416 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 13 19:42:44.882416 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 13 19:42:44.882416 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Sep 13 19:42:44.882416 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application Sep 13 19:42:44.882416 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 13 19:42:44.882416 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application Sep 13 19:42:44.882416 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 19:42:44.882416 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 19:42:44.882416 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 19:42:44.882416 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 19:42:44.882416 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 19:42:44.884063 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 19:42:44.884063 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 19:42:44.884063 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 19:42:44.884063 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 19:42:44.884063 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 19:42:44.884063 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 19:42:44.884063 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 13 19:42:44.884063 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 13 19:42:44.884063 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 13 19:42:44.884063 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 13 19:42:44.884063 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 19:42:44.884063 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 19:42:44.884063 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 19:42:44.884063 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 19:42:44.884063 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 19:42:44.884063 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 19:42:44.884940 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 19:42:44.884940 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application with Lock( Sep 13 19:42:44.884940 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 19:42:44.884940 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application return self._enter() Sep 13 19:42:44.884940 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 19:42:44.884940 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 19:42:44.884940 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 19:42:44.884940 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application return self.creator() Sep 13 19:42:44.884940 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 19:42:44.884940 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application created_value = creator( Sep 13 19:42:44.884940 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 13 19:42:44.884940 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 13 19:42:44.884940 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Sep 13 19:42:44.884940 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application Sep 13 19:42:44.884940 dv-cinder-828806-6-smb devstack@keystone.service[82026]: [pid: 82026|app: 0|req: 472/954] 10.222.0.33 () {56 vars in 1126 bytes} [Tue Sep 13 19:42:44 2022] GET /identity/v3/services/object-store => generated 93 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 19:42:44.889861 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4006eb7b-bc40-4b91-b24d-cce6bf7a565c None None] Authenticating user token {{(pid=82025) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:42:44.943293 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG dbcounter [-] [82025] Writing DB stats keystone:SELECT=100 {{(pid=82025) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:42:44.968434 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2f6a6b3-4e47-4048-929f-e22f754f6b9a None admin] Authenticating user token {{(pid=82026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:42:44.983926 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG dbcounter [-] [82026] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82026) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:42:45.016591 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4006eb7b-bc40-4b91-b24d-cce6bf7a565c None None] Validating token access rules against request {{(pid=82025) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:42:45.060196 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d386a31-e6b5-4abd-a7ff-5540b4a03d27 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57539b6a6f3b4d589f5f5e1d211cd6a0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82025) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:42:45.060970 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d386a31-e6b5-4abd-a7ff-5540b4a03d27 None admin] REQUEST_METHOD: `GET` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:42:45.061348 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d386a31-e6b5-4abd-a7ff-5540b4a03d27 None admin] SCRIPT_NAME: `/identity` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:42:45.061721 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d386a31-e6b5-4abd-a7ff-5540b4a03d27 None admin] PATH_INFO: `/v3/services` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:42:45.062452 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d386a31-e6b5-4abd-a7ff-5540b4a03d27 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=82025) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 19:42:45.062900 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d386a31-e6b5-4abd-a7ff-5540b4a03d27 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=82025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:42:45.065321 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d386a31-e6b5-4abd-a7ff-5540b4a03d27 None admin] RBAC: Authorization granted {{(pid=82025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:42:45.070814 dv-cinder-828806-6-smb devstack@keystone.service[82025]: [pid: 82025|app: 0|req: 483/955] 10.222.0.33 () {56 vars in 1122 bytes} [Tue Sep 13 19:42:44 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 19:42:45.076142 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d386a31-e6b5-4abd-a7ff-5540b4a03d27 None admin] Authenticating user token {{(pid=82025) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:42:45.091993 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2f6a6b3-4e47-4048-929f-e22f754f6b9a None admin] Validating token access rules against request {{(pid=82026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:42:45.136523 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a143055-2a9e-4078-9f1f-28e75dc91de9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57539b6a6f3b4d589f5f5e1d211cd6a0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:42:45.137161 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a143055-2a9e-4078-9f1f-28e75dc91de9 None admin] REQUEST_METHOD: `GET` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:42:45.137447 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a143055-2a9e-4078-9f1f-28e75dc91de9 None admin] SCRIPT_NAME: `/identity` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:42:45.137722 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a143055-2a9e-4078-9f1f-28e75dc91de9 None admin] PATH_INFO: `/v3/services/compute` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:42:45.138306 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a143055-2a9e-4078-9f1f-28e75dc91de9 None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=82026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:42:45.139713 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a143055-2a9e-4078-9f1f-28e75dc91de9 None admin] RBAC: Authorization granted {{(pid=82026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:42:45.150346 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application [None req-0a143055-2a9e-4078-9f1f-28e75dc91de9 None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Sep 13 19:42:45.150346 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 19:42:45.150346 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 13 19:42:45.150346 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 13 19:42:45.150346 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 13 19:42:45.150346 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 13 19:42:45.150346 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 13 19:42:45.150346 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 13 19:42:45.150346 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Sep 13 19:42:45.150346 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application Sep 13 19:42:45.150346 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 13 19:42:45.150346 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application Sep 13 19:42:45.150346 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 19:42:45.150346 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 19:42:45.150346 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 19:42:45.150346 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 19:42:45.150346 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 19:42:45.152341 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 19:42:45.152341 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 19:42:45.152341 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 19:42:45.152341 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 19:42:45.152341 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 19:42:45.152341 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 19:42:45.152341 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 13 19:42:45.152341 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 13 19:42:45.152341 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 13 19:42:45.152341 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 13 19:42:45.152341 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 19:42:45.152341 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 19:42:45.152341 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 19:42:45.152341 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 19:42:45.152341 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 19:42:45.152341 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 19:42:45.154330 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 19:42:45.154330 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application with Lock( Sep 13 19:42:45.154330 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 19:42:45.154330 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application return self._enter() Sep 13 19:42:45.154330 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 19:42:45.154330 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 19:42:45.154330 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 19:42:45.154330 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application return self.creator() Sep 13 19:42:45.154330 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 19:42:45.154330 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application created_value = creator( Sep 13 19:42:45.154330 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 13 19:42:45.154330 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 13 19:42:45.154330 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Sep 13 19:42:45.154330 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application Sep 13 19:42:45.156107 dv-cinder-828806-6-smb devstack@keystone.service[82026]: [pid: 82026|app: 0|req: 473/956] 10.222.0.33 () {56 vars in 1111 bytes} [Tue Sep 13 19:42:44 2022] GET /identity/v3/services/compute => generated 88 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 13 19:42:45.163099 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a143055-2a9e-4078-9f1f-28e75dc91de9 None admin] Authenticating user token {{(pid=82026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:42:45.201632 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d386a31-e6b5-4abd-a7ff-5540b4a03d27 None admin] Validating token access rules against request {{(pid=82025) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:42:45.211622 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG dbcounter [-] [82025] Writing DB stats keystone:SELECT=100 {{(pid=82025) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:42:45.245943 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55662be4-4bc6-4c0c-a35d-a4a7593788e1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57539b6a6f3b4d589f5f5e1d211cd6a0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82025) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:42:45.246531 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55662be4-4bc6-4c0c-a35d-a4a7593788e1 None admin] REQUEST_METHOD: `GET` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:42:45.246967 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55662be4-4bc6-4c0c-a35d-a4a7593788e1 None admin] SCRIPT_NAME: `/identity` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:42:45.247452 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55662be4-4bc6-4c0c-a35d-a4a7593788e1 None admin] PATH_INFO: `/v3/services` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:42:45.248426 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55662be4-4bc6-4c0c-a35d-a4a7593788e1 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=82025) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 19:42:45.248958 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55662be4-4bc6-4c0c-a35d-a4a7593788e1 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=82025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:42:45.250724 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55662be4-4bc6-4c0c-a35d-a4a7593788e1 None admin] RBAC: Authorization granted {{(pid=82025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:42:45.251828 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG dbcounter [-] [82026] Writing DB stats keystone:SELECT=100 {{(pid=82026) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:42:45.262324 dv-cinder-828806-6-smb devstack@keystone.service[82025]: [pid: 82025|app: 0|req: 484/957] 10.222.0.33 () {56 vars in 1122 bytes} [Tue Sep 13 19:42:45 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 13 19:42:45.275415 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55662be4-4bc6-4c0c-a35d-a4a7593788e1 None admin] Authenticating user token {{(pid=82025) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:42:45.275546 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a143055-2a9e-4078-9f1f-28e75dc91de9 None admin] Validating token access rules against request {{(pid=82026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:42:45.318103 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7524b841-23a9-4c80-8ff9-7647e8981e2e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57539b6a6f3b4d589f5f5e1d211cd6a0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:42:45.318715 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7524b841-23a9-4c80-8ff9-7647e8981e2e None admin] REQUEST_METHOD: `GET` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:42:45.318996 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7524b841-23a9-4c80-8ff9-7647e8981e2e None admin] SCRIPT_NAME: `/identity` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:42:45.319308 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7524b841-23a9-4c80-8ff9-7647e8981e2e None admin] PATH_INFO: `/v3/services` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:42:45.319959 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7524b841-23a9-4c80-8ff9-7647e8981e2e None admin] RBAC: Adding query filter params (name=compute) {{(pid=82026) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 19:42:45.320700 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7524b841-23a9-4c80-8ff9-7647e8981e2e None admin] RBAC: Authorizing `identity:list_services()` {{(pid=82026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:42:45.322488 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7524b841-23a9-4c80-8ff9-7647e8981e2e None admin] RBAC: Authorization granted {{(pid=82026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:42:45.331239 dv-cinder-828806-6-smb devstack@keystone.service[82026]: [pid: 82026|app: 0|req: 474/958] 10.222.0.33 () {56 vars in 1112 bytes} [Tue Sep 13 19:42:45 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 19:42:45.335374 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7524b841-23a9-4c80-8ff9-7647e8981e2e None admin] Authenticating user token {{(pid=82026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:42:45.405505 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55662be4-4bc6-4c0c-a35d-a4a7593788e1 None admin] Validating token access rules against request {{(pid=82025) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:42:45.452227 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4320eb84-7845-4b15-8e83-539ec492d4b1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57539b6a6f3b4d589f5f5e1d211cd6a0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82025) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:42:45.453212 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4320eb84-7845-4b15-8e83-539ec492d4b1 None admin] REQUEST_METHOD: `POST` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:42:45.453716 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4320eb84-7845-4b15-8e83-539ec492d4b1 None admin] SCRIPT_NAME: `/identity` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:42:45.454193 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4320eb84-7845-4b15-8e83-539ec492d4b1 None admin] PATH_INFO: `/v3/endpoints` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:42:45.456269 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4320eb84-7845-4b15-8e83-539ec492d4b1 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=82025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:42:45.457910 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4320eb84-7845-4b15-8e83-539ec492d4b1 None admin] RBAC: Authorization granted {{(pid=82025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:42:45.462809 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7524b841-23a9-4c80-8ff9-7647e8981e2e None admin] Validating token access rules against request {{(pid=82026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:42:45.502875 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fc7dc5a-75bb-4116-aa83-0688a06517be None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57539b6a6f3b4d589f5f5e1d211cd6a0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:42:45.503426 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fc7dc5a-75bb-4116-aa83-0688a06517be None admin] REQUEST_METHOD: `GET` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:42:45.503714 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fc7dc5a-75bb-4116-aa83-0688a06517be None admin] SCRIPT_NAME: `/identity` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:42:45.503989 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fc7dc5a-75bb-4116-aa83-0688a06517be None admin] PATH_INFO: `/v3/services` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:42:45.504733 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fc7dc5a-75bb-4116-aa83-0688a06517be None admin] RBAC: Adding query filter params (type=compute) {{(pid=82026) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 19:42:45.505034 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fc7dc5a-75bb-4116-aa83-0688a06517be None admin] RBAC: Authorizing `identity:list_services()` {{(pid=82026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:42:45.506393 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fc7dc5a-75bb-4116-aa83-0688a06517be None admin] RBAC: Authorization granted {{(pid=82026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:42:45.511189 dv-cinder-828806-6-smb devstack@keystone.service[82026]: [pid: 82026|app: 0|req: 475/959] 10.222.0.33 () {56 vars in 1112 bytes} [Tue Sep 13 19:42:45 2022] GET /identity/v3/services?type=compute => generated 124 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 19:42:45.555274 dv-cinder-828806-6-smb devstack@keystone.service[82025]: [pid: 82025|app: 0|req: 485/960] 10.222.0.33 () {60 vars in 1144 bytes} [Tue Sep 13 19:42:45 2022] POST /identity/v3/endpoints => generated 349 bytes in 287 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 13 19:42:46.692576 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6925f83-78e6-4dea-8ed6-b656c4ab52e5 None None] REQUEST_METHOD: `GET` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:42:46.693106 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6925f83-78e6-4dea-8ed6-b656c4ab52e5 None None] SCRIPT_NAME: `/identity` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:42:46.693106 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6925f83-78e6-4dea-8ed6-b656c4ab52e5 None None] PATH_INFO: `/` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:42:46.694680 dv-cinder-828806-6-smb devstack@keystone.service[82026]: [pid: 82026|app: 0|req: 476/961] 10.222.0.33 () {54 vars in 927 bytes} [Tue Sep 13 19:42:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 19:42:46.696812 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a50ad9f-3b6f-4479-902d-422a68cac827 None None] REQUEST_METHOD: `GET` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:42:46.697231 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a50ad9f-3b6f-4479-902d-422a68cac827 None None] SCRIPT_NAME: `/identity` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:42:46.697423 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a50ad9f-3b6f-4479-902d-422a68cac827 None None] PATH_INFO: `/` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:42:46.698863 dv-cinder-828806-6-smb devstack@keystone.service[82025]: [pid: 82025|app: 0|req: 486/962] 10.222.0.33 () {54 vars in 927 bytes} [Tue Sep 13 19:42:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 19:42:46.700375 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37597dd8-8a33-4bea-af70-dc26fdd494ea None None] REQUEST_METHOD: `POST` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:42:46.700887 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37597dd8-8a33-4bea-af70-dc26fdd494ea None None] SCRIPT_NAME: `/identity` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:42:46.701370 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37597dd8-8a33-4bea-af70-dc26fdd494ea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:42:46.703791 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f942d91-3ee8-4ee7-9d57-452d088b9682 None None] REQUEST_METHOD: `POST` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:42:46.704079 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f942d91-3ee8-4ee7-9d57-452d088b9682 None None] SCRIPT_NAME: `/identity` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:42:46.704383 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f942d91-3ee8-4ee7-9d57-452d088b9682 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:42:46.715080 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG dbcounter [-] [82026] Writing DB stats keystone:SELECT=100 {{(pid=82026) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:42:46.722807 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.auth.core [None req-9f942d91-3ee8-4ee7-9d57-452d088b9682 None None] MFA Rules not processed for user `57539b6a6f3b4d589f5f5e1d211cd6a0`. Rule list: `[]` (Enabled: `True`). {{(pid=82025) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 19:42:46.723943 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.auth.core [None req-37597dd8-8a33-4bea-af70-dc26fdd494ea None None] MFA Rules not processed for user `57539b6a6f3b4d589f5f5e1d211cd6a0`. Rule list: `[]` (Enabled: `True`). {{(pid=82026) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 19:42:46.724059 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.fernet_utils [None req-9f942d91-3ee8-4ee7-9d57-452d088b9682 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82025) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 19:42:46.725122 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.common.fernet_utils [None req-37597dd8-8a33-4bea-af70-dc26fdd494ea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82026) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 19:42:46.746397 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG dbcounter [-] [82025] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82025) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:42:46.811479 dv-cinder-828806-6-smb devstack@keystone.service[82025]: [pid: 82025|app: 0|req: 487/963] 10.222.0.33 () {58 vars in 1024 bytes} [Tue Sep 13 19:42:46 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 13 19:42:46.817219 dv-cinder-828806-6-smb devstack@keystone.service[82026]: [pid: 82026|app: 0|req: 477/964] 10.222.0.33 () {58 vars in 1024 bytes} [Tue Sep 13 19:42:46 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 13 19:42:47.083304 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f942d91-3ee8-4ee7-9d57-452d088b9682 None None] Authenticating user token {{(pid=82025) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:42:47.091979 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37597dd8-8a33-4bea-af70-dc26fdd494ea None None] Authenticating user token {{(pid=82026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:42:47.193135 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f942d91-3ee8-4ee7-9d57-452d088b9682 None None] Validating token access rules against request {{(pid=82025) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:42:47.226710 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37597dd8-8a33-4bea-af70-dc26fdd494ea None None] Validating token access rules against request {{(pid=82026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:42:47.231924 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0089cbd8-31c4-4a6c-aacd-1d1462a18895 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57539b6a6f3b4d589f5f5e1d211cd6a0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82025) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:42:47.232631 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0089cbd8-31c4-4a6c-aacd-1d1462a18895 None admin] REQUEST_METHOD: `GET` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:42:47.233028 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0089cbd8-31c4-4a6c-aacd-1d1462a18895 None admin] SCRIPT_NAME: `/identity` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:42:47.233371 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0089cbd8-31c4-4a6c-aacd-1d1462a18895 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:42:47.247866 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0089cbd8-31c4-4a6c-aacd-1d1462a18895 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=82025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 13 19:42:47.253334 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application [None req-0089cbd8-31c4-4a6c-aacd-1d1462a18895 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Sep 13 19:42:47.253334 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 19:42:47.253334 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 19:42:47.253334 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 19:42:47.253334 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 19:42:47.253334 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 19:42:47.253334 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 19:42:47.253334 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 19:42:47.253334 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 19:42:47.253334 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 19:42:47.253334 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 19:42:47.253334 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 19:42:47.253334 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 13 19:42:47.253334 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 13 19:42:47.253334 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 13 19:42:47.253334 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 13 19:42:47.254280 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 13 19:42:47.254280 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 13 19:42:47.254280 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 13 19:42:47.254280 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 13 19:42:47.254280 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 19:42:47.254280 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 19:42:47.254280 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 19:42:47.254280 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 19:42:47.254280 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 19:42:47.254280 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 19:42:47.254280 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 19:42:47.254280 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application with Lock( Sep 13 19:42:47.254280 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 19:42:47.254280 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application return self._enter() Sep 13 19:42:47.254280 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 19:42:47.254280 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 19:42:47.255178 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 19:42:47.255178 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application return self.creator() Sep 13 19:42:47.255178 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 19:42:47.255178 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application created_value = creator( Sep 13 19:42:47.255178 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 13 19:42:47.255178 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 13 19:42:47.255178 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 13 19:42:47.255178 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 13 19:42:47.255178 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 13 19:42:47.255178 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 13 19:42:47.255178 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Sep 13 19:42:47.255178 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application Sep 13 19:42:47.259523 dv-cinder-828806-6-smb devstack@keystone.service[82025]: [pid: 82025|app: 0|req: 488/965] 10.222.0.33 () {56 vars in 1120 bytes} [Tue Sep 13 19:42:47 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 19:42:47.260568 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0089cbd8-31c4-4a6c-aacd-1d1462a18895 None admin] Authenticating user token {{(pid=82025) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:42:47.270613 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edad2c12-25c9-43ec-984e-a7d9c2924d0a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57539b6a6f3b4d589f5f5e1d211cd6a0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:42:47.271258 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edad2c12-25c9-43ec-984e-a7d9c2924d0a None admin] REQUEST_METHOD: `POST` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:42:47.271545 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edad2c12-25c9-43ec-984e-a7d9c2924d0a None admin] SCRIPT_NAME: `/identity` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:42:47.271823 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edad2c12-25c9-43ec-984e-a7d9c2924d0a None admin] PATH_INFO: `/v3/users` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:42:47.272864 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edad2c12-25c9-43ec-984e-a7d9c2924d0a None admin] RBAC: Authorizing `identity:create_user()` {{(pid=82026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:42:47.274925 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edad2c12-25c9-43ec-984e-a7d9c2924d0a None admin] RBAC: Authorization granted {{(pid=82026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:42:47.276265 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG dbcounter [-] [82025] Writing DB stats keystone:SELECT=100 {{(pid=82025) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:42:47.280099 dv-cinder-828806-6-smb devstack@keystone.service[82026]: WARNING keystone.server.flask.common [None req-edad2c12-25c9-43ec-984e-a7d9c2924d0a None admin] Deprecated: Not specifying a domain during a create user, group or project call, and relying on falling back to the default domain, is deprecated as of Liberty. There is no plan to remove this compatibility, however, future API versions may remove this, so please specify the domain explicitly or use a domain-scoped token. Sep 13 19:42:47.292525 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG dbcounter [-] [82026] Writing DB stats keystone:SELECT=100 {{(pid=82026) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:42:47.336910 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.common.sql.core [None req-edad2c12-25c9-43ec-984e-a7d9c2924d0a None admin] Conflict user: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") Sep 13 19:42:47.336910 dv-cinder-828806-6-smb devstack@keystone.service[82026]: [SQL: INSERT INTO local_user (user_id, domain_id, name, failed_auth_count, failed_auth_at) VALUES (%(user_id)s, %(domain_id)s, %(name)s, %(failed_auth_count)s, %(failed_auth_at)s)] Sep 13 19:42:47.336910 dv-cinder-828806-6-smb devstack@keystone.service[82026]: [parameters: {'user_id': 'd82573ad7ac045bc91547c309de6d4bb', 'domain_id': 'default', 'name': 'cinder', 'failed_auth_count': 0, 'failed_auth_at': None}] Sep 13 19:42:47.336910 dv-cinder-828806-6-smb devstack@keystone.service[82026]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=82026) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Sep 13 19:42:47.357323 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application [None req-edad2c12-25c9-43ec-984e-a7d9c2924d0a None admin] Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default.: keystone.exception.Conflict: Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default. Sep 13 19:42:47.357323 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 19:42:47.357323 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Sep 13 19:42:47.357323 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application self.dialect.do_execute( Sep 13 19:42:47.357323 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Sep 13 19:42:47.357323 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Sep 13 19:42:47.357323 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Sep 13 19:42:47.357323 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application result = self._query(query) Sep 13 19:42:47.357323 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Sep 13 19:42:47.357323 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application conn.query(q) Sep 13 19:42:47.357323 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Sep 13 19:42:47.357323 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Sep 13 19:42:47.357323 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Sep 13 19:42:47.357323 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application result.read() Sep 13 19:42:47.357323 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Sep 13 19:42:47.358360 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Sep 13 19:42:47.358360 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Sep 13 19:42:47.358360 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application packet.raise_for_error() Sep 13 19:42:47.358360 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Sep 13 19:42:47.358360 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Sep 13 19:42:47.358360 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Sep 13 19:42:47.358360 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Sep 13 19:42:47.358360 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") Sep 13 19:42:47.358360 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application Sep 13 19:42:47.358360 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: Sep 13 19:42:47.358360 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application Sep 13 19:42:47.358360 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 19:42:47.358360 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Sep 13 19:42:47.358360 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application return method(*args, **kwargs) Sep 13 19:42:47.358360 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 141, in create_user Sep 13 19:42:47.358360 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application return base.filter_user(user_ref.to_dict()) Sep 13 19:42:47.358360 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Sep 13 19:42:47.358360 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application next(self.gen) Sep 13 19:42:47.363569 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope Sep 13 19:42:47.363569 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application yield resource Sep 13 19:42:47.363569 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Sep 13 19:42:47.363569 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application next(self.gen) Sep 13 19:42:47.363569 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session Sep 13 19:42:47.363569 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application self.session.rollback() Sep 13 19:42:47.363569 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Sep 13 19:42:47.363569 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application self.force_reraise() Sep 13 19:42:47.363569 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Sep 13 19:42:47.363569 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application raise self.value Sep 13 19:42:47.363569 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session Sep 13 19:42:47.363569 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Sep 13 19:42:47.363569 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction Sep 13 19:42:47.363569 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application session.commit() Sep 13 19:42:47.363569 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1451, in commit Sep 13 19:42:47.363569 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Sep 13 19:42:47.363569 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Sep 13 19:42:47.364560 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application self._prepare_impl() Sep 13 19:42:47.364560 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Sep 13 19:42:47.364560 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application self.session.flush() Sep 13 19:42:47.364560 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Sep 13 19:42:47.364560 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application self._flush(objects) Sep 13 19:42:47.364560 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Sep 13 19:42:47.364560 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Sep 13 19:42:47.364560 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Sep 13 19:42:47.364560 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application compat.raise_( Sep 13 19:42:47.364560 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Sep 13 19:42:47.364560 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application raise exception Sep 13 19:42:47.364560 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Sep 13 19:42:47.364560 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application flush_context.execute() Sep 13 19:42:47.364560 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Sep 13 19:42:47.364560 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application rec.execute(self) Sep 13 19:42:47.364560 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Sep 13 19:42:47.364560 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( Sep 13 19:42:47.365472 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Sep 13 19:42:47.365472 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application _emit_insert_statements( Sep 13 19:42:47.365472 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1238, in _emit_insert_statements Sep 13 19:42:47.365472 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application result = connection._execute_20( Sep 13 19:42:47.365472 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1705, in _execute_20 Sep 13 19:42:47.365472 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) Sep 13 19:42:47.365472 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 333, in _execute_on_connection Sep 13 19:42:47.365472 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application return connection._execute_clauseelement( Sep 13 19:42:47.365472 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1572, in _execute_clauseelement Sep 13 19:42:47.365472 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application ret = self._execute_context( Sep 13 19:42:47.365472 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1943, in _execute_context Sep 13 19:42:47.365472 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application self._handle_dbapi_exception( Sep 13 19:42:47.365472 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2122, in _handle_dbapi_exception Sep 13 19:42:47.365472 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) Sep 13 19:42:47.365472 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Sep 13 19:42:47.365472 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application raise exception Sep 13 19:42:47.367779 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Sep 13 19:42:47.367779 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application self.dialect.do_execute( Sep 13 19:42:47.367779 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Sep 13 19:42:47.367779 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Sep 13 19:42:47.367779 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Sep 13 19:42:47.367779 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application result = self._query(query) Sep 13 19:42:47.367779 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Sep 13 19:42:47.367779 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application conn.query(q) Sep 13 19:42:47.367779 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Sep 13 19:42:47.367779 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Sep 13 19:42:47.367779 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Sep 13 19:42:47.367779 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application result.read() Sep 13 19:42:47.367779 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Sep 13 19:42:47.367779 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Sep 13 19:42:47.367779 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Sep 13 19:42:47.367779 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application packet.raise_for_error() Sep 13 19:42:47.371925 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Sep 13 19:42:47.371925 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Sep 13 19:42:47.371925 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Sep 13 19:42:47.371925 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Sep 13 19:42:47.371925 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") Sep 13 19:42:47.371925 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application [SQL: INSERT INTO local_user (user_id, domain_id, name, failed_auth_count, failed_auth_at) VALUES (%(user_id)s, %(domain_id)s, %(name)s, %(failed_auth_count)s, %(failed_auth_at)s)] Sep 13 19:42:47.371925 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application [parameters: {'user_id': 'd82573ad7ac045bc91547c309de6d4bb', 'domain_id': 'default', 'name': 'cinder', 'failed_auth_count': 0, 'failed_auth_at': None}] Sep 13 19:42:47.371925 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) Sep 13 19:42:47.371925 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application Sep 13 19:42:47.371925 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 13 19:42:47.371925 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application Sep 13 19:42:47.371925 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 19:42:47.371925 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 19:42:47.371925 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 19:42:47.371925 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 19:42:47.374059 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 19:42:47.374059 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 19:42:47.374059 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 19:42:47.374059 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 19:42:47.374059 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 19:42:47.374059 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 19:42:47.374059 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 19:42:47.374059 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 244, in post Sep 13 19:42:47.374059 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.create_user( Sep 13 19:42:47.374059 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 19:42:47.374059 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 19:42:47.374059 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 13 19:42:47.374059 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 13 19:42:47.374059 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 13 19:42:47.374059 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 13 19:42:47.374059 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1000, in create_user Sep 13 19:42:47.374059 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application ref = self._create_user_with_federated_objects(user, driver) Sep 13 19:42:47.378101 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 966, in _create_user_with_federated_objects Sep 13 19:42:47.378101 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application user = driver.create_user(user['id'], user) Sep 13 19:42:47.378101 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper Sep 13 19:42:47.378101 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, Sep 13 19:42:47.378101 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default. Sep 13 19:42:47.378101 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application Sep 13 19:42:47.378101 dv-cinder-828806-6-smb devstack@keystone.service[82026]: [pid: 82026|app: 0|req: 478/966] 10.222.0.33 () {60 vars in 1131 bytes} [Tue Sep 13 19:42:47 2022] POST /identity/v3/users => generated 160 bytes in 268 msecs (HTTP/1.1 409) 5 headers in 183 bytes (2 switches on core 0) Sep 13 19:42:47.378101 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edad2c12-25c9-43ec-984e-a7d9c2924d0a None admin] Authenticating user token {{(pid=82026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:42:47.403336 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0089cbd8-31c4-4a6c-aacd-1d1462a18895 None admin] Validating token access rules against request {{(pid=82025) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:42:47.464258 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb386a70-ef14-4ad2-866a-85b6548f71ac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57539b6a6f3b4d589f5f5e1d211cd6a0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82025) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:42:47.466424 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb386a70-ef14-4ad2-866a-85b6548f71ac None admin] REQUEST_METHOD: `GET` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:42:47.466917 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb386a70-ef14-4ad2-866a-85b6548f71ac None admin] SCRIPT_NAME: `/identity` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:42:47.467432 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb386a70-ef14-4ad2-866a-85b6548f71ac None admin] PATH_INFO: `/v3/roles` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:42:47.468617 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb386a70-ef14-4ad2-866a-85b6548f71ac None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=82025) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 19:42:47.469134 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb386a70-ef14-4ad2-866a-85b6548f71ac None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:42:47.472148 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb386a70-ef14-4ad2-866a-85b6548f71ac None admin] RBAC: Authorization granted {{(pid=82025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:42:47.495434 dv-cinder-828806-6-smb devstack@keystone.service[82025]: [pid: 82025|app: 0|req: 489/967] 10.222.0.33 () {56 vars in 1115 bytes} [Tue Sep 13 19:42:47 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 235 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 19:42:47.499406 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb386a70-ef14-4ad2-866a-85b6548f71ac None admin] Authenticating user token {{(pid=82025) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:42:47.509813 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edad2c12-25c9-43ec-984e-a7d9c2924d0a None admin] Validating token access rules against request {{(pid=82026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:42:47.589134 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a18c73c1-916d-41e0-992b-d82c24577b0c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57539b6a6f3b4d589f5f5e1d211cd6a0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:42:47.590292 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a18c73c1-916d-41e0-992b-d82c24577b0c None admin] REQUEST_METHOD: `GET` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:42:47.592099 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a18c73c1-916d-41e0-992b-d82c24577b0c None admin] SCRIPT_NAME: `/identity` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:42:47.592598 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a18c73c1-916d-41e0-992b-d82c24577b0c None admin] PATH_INFO: `/v3/users/cinder` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:42:47.598371 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG dbcounter [-] [82025] Writing DB stats keystone:SELECT=100 {{(pid=82025) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:42:47.608920 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a18c73c1-916d-41e0-992b-d82c24577b0c None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=82026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:42:47.612576 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a18c73c1-916d-41e0-992b-d82c24577b0c None admin] RBAC: Authorization granted {{(pid=82026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:42:47.634828 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb386a70-ef14-4ad2-866a-85b6548f71ac None admin] Validating token access rules against request {{(pid=82025) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:42:47.635944 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application [None req-a18c73c1-916d-41e0-992b-d82c24577b0c None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Sep 13 19:42:47.635944 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 19:42:47.635944 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 19:42:47.635944 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 19:42:47.635944 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 19:42:47.635944 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 19:42:47.635944 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 19:42:47.635944 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 19:42:47.635944 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 19:42:47.635944 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 19:42:47.635944 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 19:42:47.635944 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 19:42:47.635944 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 13 19:42:47.635944 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 13 19:42:47.635944 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 13 19:42:47.635944 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 13 19:42:47.636911 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 19:42:47.636911 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 19:42:47.636911 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 13 19:42:47.636911 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 13 19:42:47.636911 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 13 19:42:47.636911 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 13 19:42:47.636911 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 19:42:47.636911 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 19:42:47.636911 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 19:42:47.636911 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 19:42:47.636911 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 19:42:47.636911 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application with Lock( Sep 13 19:42:47.636911 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 19:42:47.636911 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application return self._enter() Sep 13 19:42:47.636911 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 19:42:47.636911 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 19:42:47.636911 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 19:42:47.636911 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application return self.creator() Sep 13 19:42:47.637856 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 19:42:47.637856 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application created_value = creator( Sep 13 19:42:47.637856 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 13 19:42:47.637856 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 13 19:42:47.637856 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 13 19:42:47.637856 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 13 19:42:47.637856 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 13 19:42:47.637856 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 13 19:42:47.637856 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Sep 13 19:42:47.637856 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application Sep 13 19:42:47.643529 dv-cinder-828806-6-smb devstack@keystone.service[82026]: [pid: 82026|app: 0|req: 479/968] 10.222.0.33 () {56 vars in 1099 bytes} [Tue Sep 13 19:42:47 2022] GET /identity/v3/users/cinder => generated 84 bytes in 271 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 13 19:42:47.647947 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a18c73c1-916d-41e0-992b-d82c24577b0c None admin] Authenticating user token {{(pid=82026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:42:47.689710 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60cac350-ad9f-4456-86b9-453fa80fba92 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57539b6a6f3b4d589f5f5e1d211cd6a0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82025) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:42:47.690231 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60cac350-ad9f-4456-86b9-453fa80fba92 None admin] REQUEST_METHOD: `GET` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:42:47.690515 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60cac350-ad9f-4456-86b9-453fa80fba92 None admin] SCRIPT_NAME: `/identity` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:42:47.690858 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60cac350-ad9f-4456-86b9-453fa80fba92 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:42:47.703177 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60cac350-ad9f-4456-86b9-453fa80fba92 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=82025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:42:47.705832 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60cac350-ad9f-4456-86b9-453fa80fba92 None admin] RBAC: Authorization granted {{(pid=82025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:42:47.722547 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG dbcounter [-] [82026] Writing DB stats keystone:INSERT=2,keystone:SELECT=98 {{(pid=82026) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:42:47.726155 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application [None req-60cac350-ad9f-4456-86b9-453fa80fba92 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 13 19:42:47.726155 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 19:42:47.726155 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 19:42:47.726155 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 19:42:47.726155 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 19:42:47.726155 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 19:42:47.726155 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 19:42:47.726155 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 19:42:47.726155 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 19:42:47.726155 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 19:42:47.726155 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 19:42:47.726155 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 19:42:47.726155 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 13 19:42:47.726155 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 13 19:42:47.726155 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 13 19:42:47.726155 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 13 19:42:47.727299 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 19:42:47.727299 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 19:42:47.727299 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 19:42:47.727299 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 19:42:47.727299 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 19:42:47.727299 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 19:42:47.727299 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 19:42:47.727299 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application with Lock( Sep 13 19:42:47.727299 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 19:42:47.727299 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application return self._enter() Sep 13 19:42:47.727299 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 19:42:47.727299 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 19:42:47.727299 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 19:42:47.727299 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application return self.creator() Sep 13 19:42:47.727299 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 19:42:47.727299 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application created_value = creator( Sep 13 19:42:47.727299 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 13 19:42:47.728357 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 13 19:42:47.728357 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 13 19:42:47.728357 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application Sep 13 19:42:47.731169 dv-cinder-828806-6-smb devstack@keystone.service[82025]: [pid: 82025|app: 0|req: 490/969] 10.222.0.33 () {56 vars in 1108 bytes} [Tue Sep 13 19:42:47 2022] GET /identity/v3/domains/Default => generated 87 bytes in 232 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 19:42:47.733030 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02def736-b91d-460c-9cee-03e2a7542480 None None] REQUEST_METHOD: `GET` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:42:47.733321 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02def736-b91d-460c-9cee-03e2a7542480 None None] SCRIPT_NAME: `/identity` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:42:47.734062 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02def736-b91d-460c-9cee-03e2a7542480 None None] PATH_INFO: `/` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:42:47.734989 dv-cinder-828806-6-smb devstack@keystone.service[82025]: [pid: 82025|app: 0|req: 491/970] 10.222.0.33 () {54 vars in 927 bytes} [Tue Sep 13 19:42:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 13 19:42:47.739309 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02def736-b91d-460c-9cee-03e2a7542480 None None] Authenticating user token {{(pid=82025) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:42:47.777391 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a18c73c1-916d-41e0-992b-d82c24577b0c None admin] Validating token access rules against request {{(pid=82026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:42:47.817601 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5f9dd36-7769-4d84-8724-4ff3631a24b3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57539b6a6f3b4d589f5f5e1d211cd6a0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:42:47.818217 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5f9dd36-7769-4d84-8724-4ff3631a24b3 None admin] REQUEST_METHOD: `GET` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:42:47.818502 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5f9dd36-7769-4d84-8724-4ff3631a24b3 None admin] SCRIPT_NAME: `/identity` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:42:47.818778 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5f9dd36-7769-4d84-8724-4ff3631a24b3 None admin] PATH_INFO: `/v3/users` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:42:47.819527 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5f9dd36-7769-4d84-8724-4ff3631a24b3 None admin] RBAC: Adding query filter params (name=cinder) {{(pid=82026) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 19:42:47.819842 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5f9dd36-7769-4d84-8724-4ff3631a24b3 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=82026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:42:47.822560 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5f9dd36-7769-4d84-8724-4ff3631a24b3 None admin] RBAC: Authorization granted {{(pid=82026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:42:47.847083 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02def736-b91d-460c-9cee-03e2a7542480 None None] Validating token access rules against request {{(pid=82025) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:42:47.875067 dv-cinder-828806-6-smb devstack@keystone.service[82026]: [pid: 82026|app: 0|req: 480/971] 10.222.0.33 () {56 vars in 1101 bytes} [Tue Sep 13 19:42:47 2022] GET /identity/v3/users?name=cinder => generated 354 bytes in 220 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 19:42:47.875067 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecc3a9bb-77b6-4a04-b861-6432ee7cc0a4 None None] REQUEST_METHOD: `POST` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:42:47.875067 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecc3a9bb-77b6-4a04-b861-6432ee7cc0a4 None None] SCRIPT_NAME: `/identity` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:42:47.875067 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecc3a9bb-77b6-4a04-b861-6432ee7cc0a4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:42:47.885336 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG dbcounter [-] [82025] Writing DB stats keystone:SELECT=100 {{(pid=82025) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:42:47.894483 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1a89a4c-9b18-4fb5-a982-4ea2ede06a35 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57539b6a6f3b4d589f5f5e1d211cd6a0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82025) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:42:47.895301 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1a89a4c-9b18-4fb5-a982-4ea2ede06a35 None admin] REQUEST_METHOD: `GET` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:42:47.895653 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1a89a4c-9b18-4fb5-a982-4ea2ede06a35 None admin] SCRIPT_NAME: `/identity` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:42:47.895959 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.auth.core [None req-ecc3a9bb-77b6-4a04-b861-6432ee7cc0a4 None None] MFA Rules not processed for user `57539b6a6f3b4d589f5f5e1d211cd6a0`. Rule list: `[]` (Enabled: `True`). {{(pid=82026) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 19:42:47.896072 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1a89a4c-9b18-4fb5-a982-4ea2ede06a35 None admin] PATH_INFO: `/v3/domains` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:42:47.896965 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1a89a4c-9b18-4fb5-a982-4ea2ede06a35 None admin] RBAC: Adding query filter params (name=Default) {{(pid=82025) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 19:42:47.897431 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1a89a4c-9b18-4fb5-a982-4ea2ede06a35 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:42:47.897913 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.common.fernet_utils [None req-ecc3a9bb-77b6-4a04-b861-6432ee7cc0a4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82026) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 19:42:47.899076 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1a89a4c-9b18-4fb5-a982-4ea2ede06a35 None admin] RBAC: Authorization granted {{(pid=82025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:42:47.950363 dv-cinder-828806-6-smb devstack@keystone.service[82025]: [pid: 82025|app: 0|req: 492/972] 10.222.0.33 () {56 vars in 1109 bytes} [Tue Sep 13 19:42:47 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 215 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 19:42:47.956077 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1a89a4c-9b18-4fb5-a982-4ea2ede06a35 None admin] Authenticating user token {{(pid=82025) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:42:47.991196 dv-cinder-828806-6-smb devstack@keystone.service[82026]: [pid: 82026|app: 0|req: 481/973] 10.222.0.33 () {58 vars in 1024 bytes} [Tue Sep 13 19:42:47 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 13 19:42:47.995329 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7f98fb4-e8ac-4fe3-a55e-e63034581c4e None None] REQUEST_METHOD: `GET` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:42:47.995701 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7f98fb4-e8ac-4fe3-a55e-e63034581c4e None None] SCRIPT_NAME: `/identity` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:42:47.996042 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7f98fb4-e8ac-4fe3-a55e-e63034581c4e None None] PATH_INFO: `/` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:42:48.003005 dv-cinder-828806-6-smb devstack@keystone.service[82026]: [pid: 82026|app: 0|req: 482/974] 10.222.0.33 () {54 vars in 927 bytes} [Tue Sep 13 19:42:47 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 13 19:42:48.004503 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0981bc2-0ef6-4ff7-ae35-1cc69b7abf1c None None] REQUEST_METHOD: `POST` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:42:48.004797 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0981bc2-0ef6-4ff7-ae35-1cc69b7abf1c None None] SCRIPT_NAME: `/identity` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:42:48.005078 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0981bc2-0ef6-4ff7-ae35-1cc69b7abf1c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:42:48.025438 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.auth.core [None req-a0981bc2-0ef6-4ff7-ae35-1cc69b7abf1c None None] MFA Rules not processed for user `57539b6a6f3b4d589f5f5e1d211cd6a0`. Rule list: `[]` (Enabled: `True`). {{(pid=82026) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 19:42:48.026670 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.common.fernet_utils [None req-a0981bc2-0ef6-4ff7-ae35-1cc69b7abf1c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82026) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 19:42:48.087858 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG dbcounter [-] [82026] Writing DB stats keystone:SELECT=100 {{(pid=82026) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:42:48.101408 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1a89a4c-9b18-4fb5-a982-4ea2ede06a35 None admin] Validating token access rules against request {{(pid=82025) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:42:48.133437 dv-cinder-828806-6-smb devstack@keystone.service[82026]: [pid: 82026|app: 0|req: 483/975] 10.222.0.33 () {58 vars in 1024 bytes} [Tue Sep 13 19:42:48 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 13 19:42:48.151093 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a5c44a5-dc74-45f6-a098-e3bc4f766c2b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57539b6a6f3b4d589f5f5e1d211cd6a0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82025) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:42:48.151849 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a5c44a5-dc74-45f6-a098-e3bc4f766c2b None admin] REQUEST_METHOD: `GET` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:42:48.152138 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a5c44a5-dc74-45f6-a098-e3bc4f766c2b None admin] SCRIPT_NAME: `/identity` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:42:48.152416 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a5c44a5-dc74-45f6-a098-e3bc4f766c2b None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:42:48.161160 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a5c44a5-dc74-45f6-a098-e3bc4f766c2b None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=82025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:42:48.162668 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a5c44a5-dc74-45f6-a098-e3bc4f766c2b None admin] RBAC: Authorization granted {{(pid=82025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:42:48.175275 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application [None req-5a5c44a5-dc74-45f6-a098-e3bc4f766c2b None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Sep 13 19:42:48.175275 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 19:42:48.175275 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 19:42:48.175275 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 19:42:48.175275 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 19:42:48.175275 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 19:42:48.175275 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 19:42:48.175275 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 19:42:48.175275 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 19:42:48.175275 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 19:42:48.175275 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 19:42:48.175275 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 19:42:48.175275 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 13 19:42:48.175275 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 13 19:42:48.175275 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 13 19:42:48.175275 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 13 19:42:48.176268 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 19:42:48.176268 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 19:42:48.176268 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 13 19:42:48.176268 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 13 19:42:48.176268 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 13 19:42:48.176268 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 13 19:42:48.176268 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 19:42:48.176268 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 19:42:48.176268 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 19:42:48.176268 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 19:42:48.176268 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 19:42:48.176268 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application with Lock( Sep 13 19:42:48.176268 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 19:42:48.176268 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application return self._enter() Sep 13 19:42:48.176268 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 19:42:48.176268 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 19:42:48.176268 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 19:42:48.176268 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application return self.creator() Sep 13 19:42:48.177233 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 19:42:48.177233 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application created_value = creator( Sep 13 19:42:48.177233 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 13 19:42:48.177233 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 13 19:42:48.177233 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 13 19:42:48.177233 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 13 19:42:48.177233 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 13 19:42:48.177233 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 13 19:42:48.177233 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Sep 13 19:42:48.177233 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application Sep 13 19:42:48.177233 dv-cinder-828806-6-smb devstack@keystone.service[82025]: [pid: 82025|app: 0|req: 493/976] 10.222.0.33 () {56 vars in 1117 bytes} [Tue Sep 13 19:42:47 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 221 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 13 19:42:48.183987 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0981bc2-0ef6-4ff7-ae35-1cc69b7abf1c None None] Authenticating user token {{(pid=82026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:42:48.284421 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a5c44a5-dc74-45f6-a098-e3bc4f766c2b None admin] Authenticating user token {{(pid=82025) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:42:48.298356 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0981bc2-0ef6-4ff7-ae35-1cc69b7abf1c None None] Validating token access rules against request {{(pid=82026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:42:48.334279 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28442d0c-d708-4601-bd2c-677a7e104050 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57539b6a6f3b4d589f5f5e1d211cd6a0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:42:48.334893 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28442d0c-d708-4601-bd2c-677a7e104050 None admin] REQUEST_METHOD: `GET` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:42:48.335219 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28442d0c-d708-4601-bd2c-677a7e104050 None admin] SCRIPT_NAME: `/identity` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:42:48.335506 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28442d0c-d708-4601-bd2c-677a7e104050 None admin] PATH_INFO: `/v3/users` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:42:48.336240 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28442d0c-d708-4601-bd2c-677a7e104050 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=82026) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 19:42:48.336556 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28442d0c-d708-4601-bd2c-677a7e104050 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=82026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:42:48.337949 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG dbcounter [-] [82025] Writing DB stats keystone:SELECT=100 {{(pid=82025) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:42:48.338087 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28442d0c-d708-4601-bd2c-677a7e104050 None admin] RBAC: Authorization granted {{(pid=82026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:42:48.357764 dv-cinder-828806-6-smb devstack@keystone.service[82026]: [pid: 82026|app: 0|req: 484/977] 10.222.0.33 () {56 vars in 1149 bytes} [Tue Sep 13 19:42:48 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 13 19:42:48.363146 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28442d0c-d708-4601-bd2c-677a7e104050 None admin] Authenticating user token {{(pid=82026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:42:48.396285 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG dbcounter [-] [82026] Writing DB stats keystone:SELECT=100 {{(pid=82026) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:42:48.397322 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a5c44a5-dc74-45f6-a098-e3bc4f766c2b None admin] Validating token access rules against request {{(pid=82025) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:42:48.432517 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d163bf2-0f1a-4205-89bc-2b7767115425 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57539b6a6f3b4d589f5f5e1d211cd6a0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82025) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:42:48.433138 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d163bf2-0f1a-4205-89bc-2b7767115425 None admin] REQUEST_METHOD: `POST` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:42:48.433425 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d163bf2-0f1a-4205-89bc-2b7767115425 None admin] SCRIPT_NAME: `/identity` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:42:48.433713 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d163bf2-0f1a-4205-89bc-2b7767115425 None admin] PATH_INFO: `/v3/services` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:42:48.434379 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d163bf2-0f1a-4205-89bc-2b7767115425 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=82025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:42:48.435770 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d163bf2-0f1a-4205-89bc-2b7767115425 None admin] RBAC: Authorization granted {{(pid=82025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:42:48.467926 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28442d0c-d708-4601-bd2c-677a7e104050 None admin] Validating token access rules against request {{(pid=82026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:42:48.507383 dv-cinder-828806-6-smb devstack@keystone.service[82025]: [pid: 82025|app: 0|req: 494/978] 10.222.0.33 () {60 vars in 1141 bytes} [Tue Sep 13 19:42:48 2022] POST /identity/v3/services => generated 242 bytes in 224 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 13 19:42:48.508358 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d163bf2-0f1a-4205-89bc-2b7767115425 None admin] Authenticating user token {{(pid=82025) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:42:48.522990 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99bd342b-0fba-44bc-bcb7-f3f1ed205a21 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57539b6a6f3b4d589f5f5e1d211cd6a0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:42:48.524120 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99bd342b-0fba-44bc-bcb7-f3f1ed205a21 None admin] REQUEST_METHOD: `GET` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:42:48.524583 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99bd342b-0fba-44bc-bcb7-f3f1ed205a21 None admin] SCRIPT_NAME: `/identity` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:42:48.525025 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99bd342b-0fba-44bc-bcb7-f3f1ed205a21 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:42:48.608092 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99bd342b-0fba-44bc-bcb7-f3f1ed205a21 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=82026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:42:48.609889 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99bd342b-0fba-44bc-bcb7-f3f1ed205a21 None admin] RBAC: Authorization granted {{(pid=82026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:42:48.622025 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d163bf2-0f1a-4205-89bc-2b7767115425 None admin] Validating token access rules against request {{(pid=82025) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:42:48.630171 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG dbcounter [-] [82025] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82025) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:42:48.646790 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG dbcounter [-] [82026] Writing DB stats keystone:SELECT=100 {{(pid=82026) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:42:48.660461 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57580ca5-b43c-4ca1-a0b5-4ffdb9ded1a0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57539b6a6f3b4d589f5f5e1d211cd6a0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82025) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:42:48.661113 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57580ca5-b43c-4ca1-a0b5-4ffdb9ded1a0 None admin] REQUEST_METHOD: `GET` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:42:48.661787 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57580ca5-b43c-4ca1-a0b5-4ffdb9ded1a0 None admin] SCRIPT_NAME: `/identity` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:42:48.661787 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57580ca5-b43c-4ca1-a0b5-4ffdb9ded1a0 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:42:48.662297 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57580ca5-b43c-4ca1-a0b5-4ffdb9ded1a0 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=82025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:42:48.664421 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57580ca5-b43c-4ca1-a0b5-4ffdb9ded1a0 None admin] RBAC: Authorization granted {{(pid=82025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:42:48.674998 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application [None req-57580ca5-b43c-4ca1-a0b5-4ffdb9ded1a0 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Sep 13 19:42:48.674998 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 19:42:48.674998 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 13 19:42:48.674998 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 13 19:42:48.674998 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 13 19:42:48.674998 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 13 19:42:48.674998 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 13 19:42:48.674998 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 13 19:42:48.674998 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Sep 13 19:42:48.674998 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application Sep 13 19:42:48.674998 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 13 19:42:48.674998 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application Sep 13 19:42:48.674998 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 19:42:48.674998 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 19:42:48.674998 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 19:42:48.674998 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 19:42:48.674998 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 19:42:48.676092 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 19:42:48.676092 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 19:42:48.676092 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 19:42:48.676092 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 19:42:48.676092 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 19:42:48.676092 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 19:42:48.676092 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 13 19:42:48.676092 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 13 19:42:48.676092 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 13 19:42:48.676092 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 13 19:42:48.676092 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 19:42:48.676092 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 19:42:48.676092 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 19:42:48.676092 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 19:42:48.676092 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 19:42:48.676092 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 19:42:48.676953 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 19:42:48.676953 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application with Lock( Sep 13 19:42:48.676953 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 19:42:48.676953 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application return self._enter() Sep 13 19:42:48.676953 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 19:42:48.676953 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 19:42:48.676953 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 19:42:48.676953 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application return self.creator() Sep 13 19:42:48.676953 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 19:42:48.676953 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application created_value = creator( Sep 13 19:42:48.676953 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 13 19:42:48.676953 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 13 19:42:48.676953 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Sep 13 19:42:48.676953 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application Sep 13 19:42:48.676953 dv-cinder-828806-6-smb devstack@keystone.service[82025]: [pid: 82025|app: 0|req: 495/979] 10.222.0.33 () {56 vars in 1126 bytes} [Tue Sep 13 19:42:48 2022] GET /identity/v3/services/object-store => generated 93 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 19:42:48.682087 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57580ca5-b43c-4ca1-a0b5-4ffdb9ded1a0 None admin] Authenticating user token {{(pid=82025) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:42:48.739080 dv-cinder-828806-6-smb devstack@keystone.service[82026]: [pid: 82026|app: 0|req: 485/980] 10.222.0.33 () {58 vars in 1282 bytes} [Tue Sep 13 19:42:48 2022] GET /identity/v3/auth/tokens => generated 1570 bytes in 373 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Sep 13 19:42:48.741845 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99bd342b-0fba-44bc-bcb7-f3f1ed205a21 None admin] Authenticating user token {{(pid=82026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:42:48.803298 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57580ca5-b43c-4ca1-a0b5-4ffdb9ded1a0 None admin] Validating token access rules against request {{(pid=82025) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:42:48.841482 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99bd342b-0fba-44bc-bcb7-f3f1ed205a21 None admin] Validating token access rules against request {{(pid=82026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:42:48.845142 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d38c9deb-7d98-4343-83da-1a232cffe95e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57539b6a6f3b4d589f5f5e1d211cd6a0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82025) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:42:48.845919 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d38c9deb-7d98-4343-83da-1a232cffe95e None admin] REQUEST_METHOD: `GET` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:42:48.846202 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d38c9deb-7d98-4343-83da-1a232cffe95e None admin] SCRIPT_NAME: `/identity` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:42:48.846477 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d38c9deb-7d98-4343-83da-1a232cffe95e None admin] PATH_INFO: `/v3/services` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:42:48.847139 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d38c9deb-7d98-4343-83da-1a232cffe95e None admin] RBAC: Adding query filter params (name=object-store) {{(pid=82025) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 19:42:48.847447 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d38c9deb-7d98-4343-83da-1a232cffe95e None admin] RBAC: Authorizing `identity:list_services()` {{(pid=82025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:42:48.848805 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d38c9deb-7d98-4343-83da-1a232cffe95e None admin] RBAC: Authorization granted {{(pid=82025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:42:48.861297 dv-cinder-828806-6-smb devstack@keystone.service[82025]: [pid: 82025|app: 0|req: 496/981] 10.222.0.33 () {56 vars in 1122 bytes} [Tue Sep 13 19:42:48 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 13 19:42:48.862351 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d38c9deb-7d98-4343-83da-1a232cffe95e None admin] Authenticating user token {{(pid=82025) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:42:48.871467 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG dbcounter [-] [82026] Writing DB stats keystone:SELECT=100 {{(pid=82026) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:42:48.882148 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da8346c7-ebb8-4fa4-96c5-719d6359ef22 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57539b6a6f3b4d589f5f5e1d211cd6a0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:42:48.882774 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da8346c7-ebb8-4fa4-96c5-719d6359ef22 None admin] REQUEST_METHOD: `GET` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:42:48.883078 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da8346c7-ebb8-4fa4-96c5-719d6359ef22 None admin] SCRIPT_NAME: `/identity` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:42:48.883360 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da8346c7-ebb8-4fa4-96c5-719d6359ef22 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:42:48.893783 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da8346c7-ebb8-4fa4-96c5-719d6359ef22 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=82026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:42:48.895241 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da8346c7-ebb8-4fa4-96c5-719d6359ef22 None admin] RBAC: Authorization granted {{(pid=82026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:42:48.899589 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG dbcounter [-] [82025] Writing DB stats keystone:SELECT=100 {{(pid=82025) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:42:48.910874 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application [None req-da8346c7-ebb8-4fa4-96c5-719d6359ef22 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 13 19:42:48.910874 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 19:42:48.910874 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 19:42:48.910874 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 19:42:48.910874 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 19:42:48.910874 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 19:42:48.910874 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 19:42:48.910874 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 19:42:48.910874 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 19:42:48.910874 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 19:42:48.910874 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 19:42:48.910874 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 19:42:48.910874 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 13 19:42:48.910874 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 13 19:42:48.910874 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 13 19:42:48.910874 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 13 19:42:48.912017 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 19:42:48.912017 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 19:42:48.912017 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 19:42:48.912017 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 19:42:48.912017 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 19:42:48.912017 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 19:42:48.912017 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 19:42:48.912017 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application with Lock( Sep 13 19:42:48.912017 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 19:42:48.912017 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application return self._enter() Sep 13 19:42:48.912017 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 19:42:48.912017 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 19:42:48.912017 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 19:42:48.912017 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application return self.creator() Sep 13 19:42:48.912017 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 19:42:48.912017 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application created_value = creator( Sep 13 19:42:48.912017 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 13 19:42:48.913017 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 13 19:42:48.913017 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 13 19:42:48.913017 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application Sep 13 19:42:48.913017 dv-cinder-828806-6-smb devstack@keystone.service[82026]: [pid: 82026|app: 0|req: 486/982] 10.222.0.33 () {56 vars in 1108 bytes} [Tue Sep 13 19:42:48 2022] GET /identity/v3/domains/Default => generated 87 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 13 19:42:48.917446 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da8346c7-ebb8-4fa4-96c5-719d6359ef22 None admin] Authenticating user token {{(pid=82026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:42:48.971920 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d38c9deb-7d98-4343-83da-1a232cffe95e None admin] Validating token access rules against request {{(pid=82025) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:42:49.012108 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df17adde-8c95-4524-9593-df4c327556cc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57539b6a6f3b4d589f5f5e1d211cd6a0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82025) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:42:49.012722 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df17adde-8c95-4524-9593-df4c327556cc None admin] REQUEST_METHOD: `GET` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:42:49.013005 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df17adde-8c95-4524-9593-df4c327556cc None admin] SCRIPT_NAME: `/identity` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:42:49.013280 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df17adde-8c95-4524-9593-df4c327556cc None admin] PATH_INFO: `/v3/services` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:42:49.013925 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df17adde-8c95-4524-9593-df4c327556cc None admin] RBAC: Adding query filter params (type=object-store) {{(pid=82025) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 19:42:49.014363 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df17adde-8c95-4524-9593-df4c327556cc None admin] RBAC: Authorizing `identity:list_services()` {{(pid=82025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:42:49.016395 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df17adde-8c95-4524-9593-df4c327556cc None admin] RBAC: Authorization granted {{(pid=82025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:42:49.020529 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da8346c7-ebb8-4fa4-96c5-719d6359ef22 None admin] Validating token access rules against request {{(pid=82026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:42:49.026630 dv-cinder-828806-6-smb devstack@keystone.service[82025]: [pid: 82025|app: 0|req: 497/983] 10.222.0.33 () {56 vars in 1122 bytes} [Tue Sep 13 19:42:48 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 19:42:49.027536 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df17adde-8c95-4524-9593-df4c327556cc None admin] Authenticating user token {{(pid=82025) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:42:49.055360 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c2f6784-93ba-4c87-85bd-605a0cc6dd16 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57539b6a6f3b4d589f5f5e1d211cd6a0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:42:49.055977 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c2f6784-93ba-4c87-85bd-605a0cc6dd16 None admin] REQUEST_METHOD: `GET` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:42:49.056288 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c2f6784-93ba-4c87-85bd-605a0cc6dd16 None admin] SCRIPT_NAME: `/identity` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:42:49.056531 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c2f6784-93ba-4c87-85bd-605a0cc6dd16 None admin] PATH_INFO: `/v3/domains` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:42:49.057179 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c2f6784-93ba-4c87-85bd-605a0cc6dd16 None admin] RBAC: Adding query filter params (name=Default) {{(pid=82026) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 19:42:49.057492 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c2f6784-93ba-4c87-85bd-605a0cc6dd16 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:42:49.058866 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c2f6784-93ba-4c87-85bd-605a0cc6dd16 None admin] RBAC: Authorization granted {{(pid=82026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:42:49.070861 dv-cinder-828806-6-smb devstack@keystone.service[82026]: [pid: 82026|app: 0|req: 487/984] 10.222.0.33 () {56 vars in 1109 bytes} [Tue Sep 13 19:42:48 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 13 19:42:49.076345 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c2f6784-93ba-4c87-85bd-605a0cc6dd16 None admin] Authenticating user token {{(pid=82026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:42:49.121037 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG dbcounter [-] [82026] Writing DB stats keystone:SELECT=100 {{(pid=82026) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:42:49.140413 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG dbcounter [-] [82025] Writing DB stats keystone:SELECT=100 {{(pid=82025) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:42:49.144827 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df17adde-8c95-4524-9593-df4c327556cc None admin] Validating token access rules against request {{(pid=82025) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:42:49.181536 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-821645d2-43e6-41f1-90a4-9b2be468de9f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57539b6a6f3b4d589f5f5e1d211cd6a0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82025) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:42:49.182252 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-821645d2-43e6-41f1-90a4-9b2be468de9f None admin] REQUEST_METHOD: `GET` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:42:49.182400 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-821645d2-43e6-41f1-90a4-9b2be468de9f None admin] SCRIPT_NAME: `/identity` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:42:49.182681 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-821645d2-43e6-41f1-90a4-9b2be468de9f None admin] PATH_INFO: `/v3/endpoints` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:42:49.183423 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-821645d2-43e6-41f1-90a4-9b2be468de9f None admin] RBAC: Adding query filter params (interface=admin, service_id=301051e393994a9cb5a2487f1964e962, region_id=RegionOne) {{(pid=82025) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 19:42:49.183733 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-821645d2-43e6-41f1-90a4-9b2be468de9f None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=82025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:42:49.185081 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-821645d2-43e6-41f1-90a4-9b2be468de9f None admin] RBAC: Authorization granted {{(pid=82025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:42:49.185870 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c2f6784-93ba-4c87-85bd-605a0cc6dd16 None admin] Validating token access rules against request {{(pid=82026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:42:49.191335 dv-cinder-828806-6-smb devstack@keystone.service[82025]: [pid: 82025|app: 0|req: 498/985] 10.222.0.33 () {56 vars in 1249 bytes} [Tue Sep 13 19:42:49 2022] GET /identity/v3/endpoints?service_id=301051e393994a9cb5a2487f1964e962&interface=admin®ion_id=RegionOne => generated 193 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 19:42:49.196880 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-821645d2-43e6-41f1-90a4-9b2be468de9f None admin] Authenticating user token {{(pid=82025) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:42:49.227991 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b4956a0-4072-47f6-8097-1d23b73b8370 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57539b6a6f3b4d589f5f5e1d211cd6a0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:42:49.228749 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b4956a0-4072-47f6-8097-1d23b73b8370 None admin] REQUEST_METHOD: `GET` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:42:49.229006 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b4956a0-4072-47f6-8097-1d23b73b8370 None admin] SCRIPT_NAME: `/identity` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:42:49.229288 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b4956a0-4072-47f6-8097-1d23b73b8370 None admin] PATH_INFO: `/v3/projects/service` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:42:49.236688 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b4956a0-4072-47f6-8097-1d23b73b8370 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=82026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:42:49.238307 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b4956a0-4072-47f6-8097-1d23b73b8370 None admin] RBAC: Authorization granted {{(pid=82026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:42:49.249807 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application [None req-7b4956a0-4072-47f6-8097-1d23b73b8370 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 13 19:42:49.249807 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 19:42:49.249807 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 19:42:49.249807 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 19:42:49.249807 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 19:42:49.249807 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 19:42:49.249807 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 19:42:49.249807 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 19:42:49.249807 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 19:42:49.249807 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 19:42:49.249807 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 19:42:49.249807 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 19:42:49.249807 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 13 19:42:49.249807 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 13 19:42:49.249807 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 13 19:42:49.250722 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 13 19:42:49.250722 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 19:42:49.250722 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 19:42:49.250722 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 19:42:49.250722 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 19:42:49.250722 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 19:42:49.250722 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 19:42:49.250722 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 19:42:49.250722 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application with Lock( Sep 13 19:42:49.250722 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 19:42:49.250722 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application return self._enter() Sep 13 19:42:49.250722 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 19:42:49.250722 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 19:42:49.250722 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 19:42:49.250722 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application return self.creator() Sep 13 19:42:49.250722 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 19:42:49.250722 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application created_value = creator( Sep 13 19:42:49.253393 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 13 19:42:49.253393 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 13 19:42:49.253393 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 13 19:42:49.253393 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 13 19:42:49.253393 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 13 19:42:49.253393 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 13 19:42:49.253393 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 13 19:42:49.253393 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application Sep 13 19:42:49.253393 dv-cinder-828806-6-smb devstack@keystone.service[82026]: [pid: 82026|app: 0|req: 488/986] 10.222.0.33 () {56 vars in 1111 bytes} [Tue Sep 13 19:42:49 2022] GET /identity/v3/projects/service => generated 88 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 13 19:42:49.256657 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b4956a0-4072-47f6-8097-1d23b73b8370 None admin] Authenticating user token {{(pid=82026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:42:49.308377 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-821645d2-43e6-41f1-90a4-9b2be468de9f None admin] Validating token access rules against request {{(pid=82025) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:42:49.346243 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-594055d1-74cc-4480-9278-110fa46a0b61 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57539b6a6f3b4d589f5f5e1d211cd6a0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82025) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:42:49.346859 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-594055d1-74cc-4480-9278-110fa46a0b61 None admin] REQUEST_METHOD: `GET` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:42:49.347247 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-594055d1-74cc-4480-9278-110fa46a0b61 None admin] SCRIPT_NAME: `/identity` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:42:49.347527 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-594055d1-74cc-4480-9278-110fa46a0b61 None admin] PATH_INFO: `/v3/services` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:42:49.348141 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-594055d1-74cc-4480-9278-110fa46a0b61 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=82025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:42:49.349507 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-594055d1-74cc-4480-9278-110fa46a0b61 None admin] RBAC: Authorization granted {{(pid=82025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:42:49.367062 dv-cinder-828806-6-smb devstack@keystone.service[82025]: [pid: 82025|app: 0|req: 499/987] 10.222.0.33 () {56 vars in 1087 bytes} [Tue Sep 13 19:42:49 2022] GET /identity/v3/services => generated 1727 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 13 19:42:49.374480 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG dbcounter [-] [82026] Writing DB stats keystone:SELECT=100 {{(pid=82026) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:42:49.378787 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b4956a0-4072-47f6-8097-1d23b73b8370 None admin] Validating token access rules against request {{(pid=82026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:42:49.419233 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25925dfb-b3cf-4abf-8b61-b58674cdae8e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57539b6a6f3b4d589f5f5e1d211cd6a0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:42:49.419885 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25925dfb-b3cf-4abf-8b61-b58674cdae8e None admin] REQUEST_METHOD: `GET` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:42:49.420170 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25925dfb-b3cf-4abf-8b61-b58674cdae8e None admin] SCRIPT_NAME: `/identity` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:42:49.420450 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25925dfb-b3cf-4abf-8b61-b58674cdae8e None admin] PATH_INFO: `/v3/projects` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:42:49.421198 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25925dfb-b3cf-4abf-8b61-b58674cdae8e None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=82026) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 19:42:49.421517 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25925dfb-b3cf-4abf-8b61-b58674cdae8e None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=82026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:42:49.423172 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25925dfb-b3cf-4abf-8b61-b58674cdae8e None admin] RBAC: Authorization granted {{(pid=82026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:42:49.437289 dv-cinder-828806-6-smb devstack@keystone.service[82026]: [pid: 82026|app: 0|req: 489/988] 10.222.0.33 () {56 vars in 1148 bytes} [Tue Sep 13 19:42:49 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 13 19:42:49.443905 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-594055d1-74cc-4480-9278-110fa46a0b61 None admin] Authenticating user token {{(pid=82025) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:42:49.475771 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG dbcounter [-] [82025] Writing DB stats keystone:SELECT=100 {{(pid=82025) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:42:49.557802 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-594055d1-74cc-4480-9278-110fa46a0b61 None admin] Validating token access rules against request {{(pid=82025) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:42:49.594092 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-638058d9-8916-45bd-8aca-291c7b4aafde None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57539b6a6f3b4d589f5f5e1d211cd6a0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82025) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:42:49.594759 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-638058d9-8916-45bd-8aca-291c7b4aafde None admin] REQUEST_METHOD: `GET` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:42:49.595084 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-638058d9-8916-45bd-8aca-291c7b4aafde None admin] SCRIPT_NAME: `/identity` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:42:49.595368 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-638058d9-8916-45bd-8aca-291c7b4aafde None admin] PATH_INFO: `/v3/role_assignments` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:42:49.596294 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-638058d9-8916-45bd-8aca-291c7b4aafde None admin] RBAC: Adding query filter params (role.id=2d9e933a00cb40c3bb31cbfc8127f9ec, scope.project.id=c8c6fba0f15b4d6a84ff601919b7b8e4, user.id=a28e738b894442e2bc9880eeb64fc0c8) {{(pid=82025) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 19:42:49.596606 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-638058d9-8916-45bd-8aca-291c7b4aafde None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=82025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:42:49.598014 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-638058d9-8916-45bd-8aca-291c7b4aafde None admin] RBAC: Authorization granted {{(pid=82025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:42:49.604267 dv-cinder-828806-6-smb devstack@keystone.service[82025]: [pid: 82025|app: 0|req: 500/989] 10.222.0.33 () {56 vars in 1374 bytes} [Tue Sep 13 19:42:49 2022] GET /identity/v3/role_assignments?user.id=a28e738b894442e2bc9880eeb64fc0c8&scope.project.id=c8c6fba0f15b4d6a84ff601919b7b8e4&role.id=2d9e933a00cb40c3bb31cbfc8127f9ec => generated 608 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 19:42:50.717873 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-579430a4-4d73-4782-a033-5eb9bfce65c4 None None] REQUEST_METHOD: `GET` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:42:50.718395 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-579430a4-4d73-4782-a033-5eb9bfce65c4 None None] SCRIPT_NAME: `/identity` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:42:50.718474 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-579430a4-4d73-4782-a033-5eb9bfce65c4 None None] PATH_INFO: `/` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:42:50.719935 dv-cinder-828806-6-smb devstack@keystone.service[82026]: [pid: 82026|app: 0|req: 490/990] 10.222.0.33 () {54 vars in 927 bytes} [Tue Sep 13 19:42:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 19:42:50.725193 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cb50374-ea2b-4a7a-ae6e-6ddf5f709814 None None] REQUEST_METHOD: `POST` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:42:50.725599 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cb50374-ea2b-4a7a-ae6e-6ddf5f709814 None None] SCRIPT_NAME: `/identity` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:42:50.725760 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cb50374-ea2b-4a7a-ae6e-6ddf5f709814 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:42:50.744107 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.auth.core [None req-7cb50374-ea2b-4a7a-ae6e-6ddf5f709814 None None] MFA Rules not processed for user `57539b6a6f3b4d589f5f5e1d211cd6a0`. Rule list: `[]` (Enabled: `True`). {{(pid=82025) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 19:42:50.745286 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.fernet_utils [None req-7cb50374-ea2b-4a7a-ae6e-6ddf5f709814 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82025) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 19:42:50.812854 dv-cinder-828806-6-smb devstack@keystone.service[82025]: [pid: 82025|app: 0|req: 501/991] 10.222.0.33 () {58 vars in 1024 bytes} [Tue Sep 13 19:42:50 2022] POST /identity/v3/auth/tokens => generated 1570 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 13 19:42:51.081021 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-579430a4-4d73-4782-a033-5eb9bfce65c4 None None] Authenticating user token {{(pid=82026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:42:51.186291 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-579430a4-4d73-4782-a033-5eb9bfce65c4 None None] Validating token access rules against request {{(pid=82026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:42:51.221484 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fe22256-7956-4d8d-b91e-a2735624814a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57539b6a6f3b4d589f5f5e1d211cd6a0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:42:51.222117 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fe22256-7956-4d8d-b91e-a2735624814a None admin] REQUEST_METHOD: `GET` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:42:51.222416 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fe22256-7956-4d8d-b91e-a2735624814a None admin] SCRIPT_NAME: `/identity` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:42:51.222688 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fe22256-7956-4d8d-b91e-a2735624814a None admin] PATH_INFO: `/v3/services/compute` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:42:51.223311 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fe22256-7956-4d8d-b91e-a2735624814a None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=82026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:42:51.224676 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fe22256-7956-4d8d-b91e-a2735624814a None admin] RBAC: Authorization granted {{(pid=82026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:42:51.233505 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application [None req-5fe22256-7956-4d8d-b91e-a2735624814a None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Sep 13 19:42:51.233505 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 19:42:51.233505 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 13 19:42:51.233505 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 13 19:42:51.233505 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 13 19:42:51.233505 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 13 19:42:51.233505 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 13 19:42:51.233505 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 13 19:42:51.233505 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Sep 13 19:42:51.233505 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application Sep 13 19:42:51.233505 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 13 19:42:51.233505 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application Sep 13 19:42:51.233505 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 19:42:51.233505 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 19:42:51.233505 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 19:42:51.233505 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 19:42:51.233505 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 19:42:51.234516 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 19:42:51.234516 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 19:42:51.234516 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 19:42:51.234516 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 19:42:51.234516 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 19:42:51.234516 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 19:42:51.234516 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 13 19:42:51.234516 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 13 19:42:51.234516 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 13 19:42:51.234516 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 13 19:42:51.234516 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 19:42:51.234516 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 19:42:51.234516 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 19:42:51.234516 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 19:42:51.234516 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 19:42:51.234516 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 19:42:51.235426 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 19:42:51.235426 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application with Lock( Sep 13 19:42:51.235426 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 19:42:51.235426 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application return self._enter() Sep 13 19:42:51.235426 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 19:42:51.235426 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 19:42:51.235426 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 19:42:51.235426 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application return self.creator() Sep 13 19:42:51.235426 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 19:42:51.235426 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application created_value = creator( Sep 13 19:42:51.235426 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 13 19:42:51.235426 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 13 19:42:51.235426 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Sep 13 19:42:51.235426 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application Sep 13 19:42:51.235426 dv-cinder-828806-6-smb devstack@keystone.service[82026]: [pid: 82026|app: 0|req: 491/992] 10.222.0.33 () {56 vars in 1111 bytes} [Tue Sep 13 19:42:51 2022] GET /identity/v3/services/compute => generated 88 bytes in 154 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 13 19:42:51.241137 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cb50374-ea2b-4a7a-ae6e-6ddf5f709814 None None] Authenticating user token {{(pid=82025) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:42:51.263470 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG dbcounter [-] [82025] Writing DB stats keystone:SELECT=100 {{(pid=82025) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:42:51.346780 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cb50374-ea2b-4a7a-ae6e-6ddf5f709814 None None] Validating token access rules against request {{(pid=82025) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:42:51.381356 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f3bbbaf-45a3-4774-a4cc-c9d7a792ca07 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57539b6a6f3b4d589f5f5e1d211cd6a0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82025) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:42:51.381964 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f3bbbaf-45a3-4774-a4cc-c9d7a792ca07 None admin] REQUEST_METHOD: `GET` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:42:51.382244 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f3bbbaf-45a3-4774-a4cc-c9d7a792ca07 None admin] SCRIPT_NAME: `/identity` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:42:51.382516 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f3bbbaf-45a3-4774-a4cc-c9d7a792ca07 None admin] PATH_INFO: `/v3/services` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:42:51.383173 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f3bbbaf-45a3-4774-a4cc-c9d7a792ca07 None admin] RBAC: Adding query filter params (name=compute) {{(pid=82025) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 19:42:51.383479 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f3bbbaf-45a3-4774-a4cc-c9d7a792ca07 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=82025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:42:51.384835 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f3bbbaf-45a3-4774-a4cc-c9d7a792ca07 None admin] RBAC: Authorization granted {{(pid=82025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:42:51.394507 dv-cinder-828806-6-smb devstack@keystone.service[82025]: [pid: 82025|app: 0|req: 502/993] 10.222.0.33 () {56 vars in 1112 bytes} [Tue Sep 13 19:42:51 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 19:42:51.395427 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fe22256-7956-4d8d-b91e-a2735624814a None admin] Authenticating user token {{(pid=82026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:42:51.432709 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG dbcounter [-] [82026] Writing DB stats keystone:SELECT=100 {{(pid=82026) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:42:51.519283 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fe22256-7956-4d8d-b91e-a2735624814a None admin] Validating token access rules against request {{(pid=82026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:42:51.557060 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d57504aa-6937-4cd1-afbc-6c7c80f34af6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57539b6a6f3b4d589f5f5e1d211cd6a0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:42:51.557726 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d57504aa-6937-4cd1-afbc-6c7c80f34af6 None admin] REQUEST_METHOD: `GET` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:42:51.558011 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d57504aa-6937-4cd1-afbc-6c7c80f34af6 None admin] SCRIPT_NAME: `/identity` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:42:51.558286 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d57504aa-6937-4cd1-afbc-6c7c80f34af6 None admin] PATH_INFO: `/v3/services` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:42:51.558968 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d57504aa-6937-4cd1-afbc-6c7c80f34af6 None admin] RBAC: Adding query filter params (type=compute) {{(pid=82026) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 19:42:51.559307 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d57504aa-6937-4cd1-afbc-6c7c80f34af6 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=82026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:42:51.560672 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d57504aa-6937-4cd1-afbc-6c7c80f34af6 None admin] RBAC: Authorization granted {{(pid=82026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:42:51.571334 dv-cinder-828806-6-smb devstack@keystone.service[82026]: [pid: 82026|app: 0|req: 492/994] 10.222.0.33 () {56 vars in 1112 bytes} [Tue Sep 13 19:42:51 2022] GET /identity/v3/services?type=compute => generated 352 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 13 19:42:51.572553 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f3bbbaf-45a3-4774-a4cc-c9d7a792ca07 None admin] Authenticating user token {{(pid=82025) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:42:51.609583 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fa7f0ad-08fb-48d4-86ef-95cff5457dbe None None] REQUEST_METHOD: `GET` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:42:51.611099 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fa7f0ad-08fb-48d4-86ef-95cff5457dbe None None] SCRIPT_NAME: `/identity` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:42:51.611099 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fa7f0ad-08fb-48d4-86ef-95cff5457dbe None None] PATH_INFO: `/` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:42:51.612933 dv-cinder-828806-6-smb devstack@keystone.service[82026]: [pid: 82026|app: 0|req: 493/995] 10.222.0.33 () {54 vars in 927 bytes} [Tue Sep 13 19:42:51 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 13 19:42:51.618066 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-432e6440-81aa-429e-9e09-29e240ff5f27 None None] REQUEST_METHOD: `POST` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:42:51.618479 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-432e6440-81aa-429e-9e09-29e240ff5f27 None None] SCRIPT_NAME: `/identity` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:42:51.618759 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-432e6440-81aa-429e-9e09-29e240ff5f27 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:42:51.638869 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.auth.core [None req-432e6440-81aa-429e-9e09-29e240ff5f27 None None] MFA Rules not processed for user `57539b6a6f3b4d589f5f5e1d211cd6a0`. Rule list: `[]` (Enabled: `True`). {{(pid=82026) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 19:42:51.640095 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.common.fernet_utils [None req-432e6440-81aa-429e-9e09-29e240ff5f27 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82026) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 19:42:51.659800 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG dbcounter [-] [82025] Writing DB stats keystone:SELECT=100 {{(pid=82025) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:42:51.679670 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f3bbbaf-45a3-4774-a4cc-c9d7a792ca07 None admin] Validating token access rules against request {{(pid=82025) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:42:51.717722 dv-cinder-828806-6-smb devstack@keystone.service[82026]: [pid: 82026|app: 0|req: 494/996] 10.222.0.33 () {58 vars in 1024 bytes} [Tue Sep 13 19:42:51 2022] POST /identity/v3/auth/tokens => generated 1570 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 13 19:42:51.725919 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4720f4a-72ec-4cb7-a354-343f621448f2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57539b6a6f3b4d589f5f5e1d211cd6a0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82025) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:42:51.726572 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4720f4a-72ec-4cb7-a354-343f621448f2 None admin] REQUEST_METHOD: `GET` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:42:51.726827 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4720f4a-72ec-4cb7-a354-343f621448f2 None admin] SCRIPT_NAME: `/identity` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:42:51.727140 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4720f4a-72ec-4cb7-a354-343f621448f2 None admin] PATH_INFO: `/v3/endpoints` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:42:51.727946 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4720f4a-72ec-4cb7-a354-343f621448f2 None admin] RBAC: Adding query filter params (interface=public, service_id=c37c7f1b6f2e4bc59ce86d6ecd7d0d59, region_id=RegionOne) {{(pid=82025) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 19:42:51.728264 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4720f4a-72ec-4cb7-a354-343f621448f2 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=82025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:42:51.729638 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4720f4a-72ec-4cb7-a354-343f621448f2 None admin] RBAC: Authorization granted {{(pid=82025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:42:51.741404 dv-cinder-828806-6-smb devstack@keystone.service[82025]: [pid: 82025|app: 0|req: 503/997] 10.222.0.33 () {56 vars in 1251 bytes} [Tue Sep 13 19:42:51 2022] GET /identity/v3/endpoints?service_id=c37c7f1b6f2e4bc59ce86d6ecd7d0d59&interface=public®ion_id=RegionOne => generated 194 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 19:42:51.742689 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-432e6440-81aa-429e-9e09-29e240ff5f27 None None] Authenticating user token {{(pid=82026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:42:51.763256 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG dbcounter [-] [82026] Writing DB stats keystone:SELECT=100 {{(pid=82026) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:42:51.818698 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4fc50f7-4352-4251-bf3a-d746a9c0e63c None None] REQUEST_METHOD: `GET` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:42:51.818989 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4fc50f7-4352-4251-bf3a-d746a9c0e63c None None] SCRIPT_NAME: `/identity` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:42:51.819305 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4fc50f7-4352-4251-bf3a-d746a9c0e63c None None] PATH_INFO: `/` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:42:51.820799 dv-cinder-828806-6-smb devstack@keystone.service[82025]: [pid: 82025|app: 0|req: 504/998] 10.222.0.33 () {54 vars in 927 bytes} [Tue Sep 13 19:42:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 13 19:42:51.826193 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e86ab81-dda6-4424-bd3c-023f23085fb4 None None] REQUEST_METHOD: `POST` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:42:51.826625 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e86ab81-dda6-4424-bd3c-023f23085fb4 None None] SCRIPT_NAME: `/identity` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:42:51.827157 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e86ab81-dda6-4424-bd3c-023f23085fb4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:42:51.847909 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.auth.core [None req-3e86ab81-dda6-4424-bd3c-023f23085fb4 None None] MFA Rules not processed for user `57539b6a6f3b4d589f5f5e1d211cd6a0`. Rule list: `[]` (Enabled: `True`). {{(pid=82025) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 19:42:51.849115 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.fernet_utils [None req-3e86ab81-dda6-4424-bd3c-023f23085fb4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82025) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 19:42:51.851386 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-432e6440-81aa-429e-9e09-29e240ff5f27 None None] Validating token access rules against request {{(pid=82026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:42:51.888191 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c07579eb-e12d-474b-a863-302f05b70565 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57539b6a6f3b4d589f5f5e1d211cd6a0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:42:51.888748 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c07579eb-e12d-474b-a863-302f05b70565 None admin] REQUEST_METHOD: `GET` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:42:51.889124 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c07579eb-e12d-474b-a863-302f05b70565 None admin] SCRIPT_NAME: `/identity` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:42:51.889395 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c07579eb-e12d-474b-a863-302f05b70565 None admin] PATH_INFO: `/v3/services` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:42:51.890006 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c07579eb-e12d-474b-a863-302f05b70565 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=82026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:42:51.891406 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c07579eb-e12d-474b-a863-302f05b70565 None admin] RBAC: Authorization granted {{(pid=82026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:42:51.898799 dv-cinder-828806-6-smb devstack@keystone.service[82026]: [pid: 82026|app: 0|req: 495/999] 10.222.0.33 () {56 vars in 1087 bytes} [Tue Sep 13 19:42:51 2022] GET /identity/v3/services => generated 1727 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 13 19:42:51.941327 dv-cinder-828806-6-smb devstack@keystone.service[82025]: [pid: 82025|app: 0|req: 505/1000] 10.222.0.33 () {58 vars in 1024 bytes} [Tue Sep 13 19:42:51 2022] POST /identity/v3/auth/tokens => generated 1570 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 13 19:42:51.990713 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c07579eb-e12d-474b-a863-302f05b70565 None admin] Authenticating user token {{(pid=82026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:42:52.081153 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG dbcounter [-] [82026] Writing DB stats keystone:SELECT=100 {{(pid=82026) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:42:52.100172 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c07579eb-e12d-474b-a863-302f05b70565 None admin] Validating token access rules against request {{(pid=82026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:42:52.135505 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49a667f1-8ec5-45f0-be8c-ded5272cc88c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57539b6a6f3b4d589f5f5e1d211cd6a0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:42:52.136140 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49a667f1-8ec5-45f0-be8c-ded5272cc88c None admin] REQUEST_METHOD: `GET` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:42:52.136426 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49a667f1-8ec5-45f0-be8c-ded5272cc88c None admin] SCRIPT_NAME: `/identity` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:42:52.136706 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49a667f1-8ec5-45f0-be8c-ded5272cc88c None admin] PATH_INFO: `/v3/services/object-store` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:42:52.137298 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49a667f1-8ec5-45f0-be8c-ded5272cc88c None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=82026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:42:52.138723 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49a667f1-8ec5-45f0-be8c-ded5272cc88c None admin] RBAC: Authorization granted {{(pid=82026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:42:52.148168 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application [None req-49a667f1-8ec5-45f0-be8c-ded5272cc88c None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Sep 13 19:42:52.148168 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 19:42:52.148168 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 13 19:42:52.148168 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 13 19:42:52.148168 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 13 19:42:52.148168 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 13 19:42:52.148168 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 13 19:42:52.148168 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 13 19:42:52.148168 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Sep 13 19:42:52.148168 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application Sep 13 19:42:52.148168 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 13 19:42:52.148168 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application Sep 13 19:42:52.148168 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 19:42:52.148168 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 19:42:52.148168 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 19:42:52.148168 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 19:42:52.148168 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 19:42:52.149159 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 19:42:52.149159 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 19:42:52.149159 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 19:42:52.149159 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 19:42:52.149159 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 19:42:52.149159 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 19:42:52.149159 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 13 19:42:52.149159 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 13 19:42:52.149159 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 13 19:42:52.149159 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 13 19:42:52.149159 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 19:42:52.149159 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 19:42:52.149159 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 19:42:52.149159 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 19:42:52.149159 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 19:42:52.149159 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 19:42:52.150005 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 19:42:52.150005 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application with Lock( Sep 13 19:42:52.150005 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 19:42:52.150005 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application return self._enter() Sep 13 19:42:52.150005 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 19:42:52.150005 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 19:42:52.150005 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 19:42:52.150005 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application return self.creator() Sep 13 19:42:52.150005 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 19:42:52.150005 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application created_value = creator( Sep 13 19:42:52.150005 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 13 19:42:52.150005 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 13 19:42:52.150005 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Sep 13 19:42:52.150005 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application Sep 13 19:42:52.150005 dv-cinder-828806-6-smb devstack@keystone.service[82026]: [pid: 82026|app: 0|req: 496/1001] 10.222.0.33 () {56 vars in 1126 bytes} [Tue Sep 13 19:42:51 2022] GET /identity/v3/services/object-store => generated 93 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 19:42:52.155135 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e86ab81-dda6-4424-bd3c-023f23085fb4 None None] Authenticating user token {{(pid=82025) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:42:52.215668 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49a667f1-8ec5-45f0-be8c-ded5272cc88c None admin] Authenticating user token {{(pid=82026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:42:52.237818 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG dbcounter [-] [82025] Writing DB stats keystone:SELECT=100 {{(pid=82025) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:42:52.262742 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e86ab81-dda6-4424-bd3c-023f23085fb4 None None] Validating token access rules against request {{(pid=82025) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:42:52.301940 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62c63021-8291-4fa5-9722-d85b50e3639a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57539b6a6f3b4d589f5f5e1d211cd6a0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82025) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:42:52.302548 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62c63021-8291-4fa5-9722-d85b50e3639a None admin] REQUEST_METHOD: `GET` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:42:52.302843 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62c63021-8291-4fa5-9722-d85b50e3639a None admin] SCRIPT_NAME: `/identity` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:42:52.303143 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62c63021-8291-4fa5-9722-d85b50e3639a None admin] PATH_INFO: `/v3/services` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:42:52.303778 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62c63021-8291-4fa5-9722-d85b50e3639a None admin] RBAC: Adding query filter params (name=object-store) {{(pid=82025) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 19:42:52.304082 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62c63021-8291-4fa5-9722-d85b50e3639a None admin] RBAC: Authorizing `identity:list_services()` {{(pid=82025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:42:52.305440 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62c63021-8291-4fa5-9722-d85b50e3639a None admin] RBAC: Authorization granted {{(pid=82025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:42:52.310714 dv-cinder-828806-6-smb devstack@keystone.service[82025]: [pid: 82025|app: 0|req: 506/1002] 10.222.0.33 () {56 vars in 1122 bytes} [Tue Sep 13 19:42:52 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 13 19:42:52.316940 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62c63021-8291-4fa5-9722-d85b50e3639a None admin] Authenticating user token {{(pid=82025) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:42:52.334483 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49a667f1-8ec5-45f0-be8c-ded5272cc88c None admin] Validating token access rules against request {{(pid=82026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:42:52.370413 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7a59290-fcf4-4c2d-a444-7f637bc66f48 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57539b6a6f3b4d589f5f5e1d211cd6a0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:42:52.371066 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7a59290-fcf4-4c2d-a444-7f637bc66f48 None admin] REQUEST_METHOD: `GET` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:42:52.371347 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7a59290-fcf4-4c2d-a444-7f637bc66f48 None admin] SCRIPT_NAME: `/identity` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:42:52.371618 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7a59290-fcf4-4c2d-a444-7f637bc66f48 None admin] PATH_INFO: `/v3/services/image` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:42:52.372207 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7a59290-fcf4-4c2d-a444-7f637bc66f48 None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=82026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:42:52.373566 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7a59290-fcf4-4c2d-a444-7f637bc66f48 None admin] RBAC: Authorization granted {{(pid=82026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:42:52.383215 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application [None req-e7a59290-fcf4-4c2d-a444-7f637bc66f48 None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Sep 13 19:42:52.383215 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 19:42:52.383215 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 13 19:42:52.383215 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 13 19:42:52.383215 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 13 19:42:52.383215 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 13 19:42:52.383215 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 13 19:42:52.383215 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 13 19:42:52.383215 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Sep 13 19:42:52.383215 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application Sep 13 19:42:52.383215 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 13 19:42:52.383215 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application Sep 13 19:42:52.383215 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 19:42:52.383215 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 19:42:52.383215 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 19:42:52.383215 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 19:42:52.383215 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 19:42:52.384226 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 19:42:52.384226 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 19:42:52.384226 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 19:42:52.384226 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 19:42:52.384226 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 19:42:52.384226 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 19:42:52.384226 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 13 19:42:52.384226 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 13 19:42:52.384226 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 13 19:42:52.384226 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 13 19:42:52.384226 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 19:42:52.384226 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 19:42:52.384226 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 19:42:52.384226 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 19:42:52.384226 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 19:42:52.384226 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 19:42:52.385075 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 19:42:52.385075 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application with Lock( Sep 13 19:42:52.385075 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 19:42:52.385075 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application return self._enter() Sep 13 19:42:52.385075 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 19:42:52.385075 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 19:42:52.385075 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 19:42:52.385075 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application return self.creator() Sep 13 19:42:52.385075 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 19:42:52.385075 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application created_value = creator( Sep 13 19:42:52.385075 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 13 19:42:52.385075 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 13 19:42:52.385075 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Sep 13 19:42:52.385075 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application Sep 13 19:42:52.385075 dv-cinder-828806-6-smb devstack@keystone.service[82026]: [pid: 82026|app: 0|req: 497/1003] 10.222.0.33 () {56 vars in 1105 bytes} [Tue Sep 13 19:42:52 2022] GET /identity/v3/services/image => generated 86 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 19:42:52.390186 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7a59290-fcf4-4c2d-a444-7f637bc66f48 None admin] Authenticating user token {{(pid=82026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:42:52.404231 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG dbcounter [-] [82026] Writing DB stats keystone:SELECT=100 {{(pid=82026) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:42:52.431852 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62c63021-8291-4fa5-9722-d85b50e3639a None admin] Validating token access rules against request {{(pid=82025) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:42:52.467724 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3429776b-4086-46c8-9227-16d6ddbc384e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57539b6a6f3b4d589f5f5e1d211cd6a0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82025) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:42:52.468483 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3429776b-4086-46c8-9227-16d6ddbc384e None admin] REQUEST_METHOD: `GET` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:42:52.468883 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3429776b-4086-46c8-9227-16d6ddbc384e None admin] SCRIPT_NAME: `/identity` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:42:52.469258 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3429776b-4086-46c8-9227-16d6ddbc384e None admin] PATH_INFO: `/v3/services` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:42:52.469989 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3429776b-4086-46c8-9227-16d6ddbc384e None admin] RBAC: Adding query filter params (type=object-store) {{(pid=82025) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 19:42:52.470897 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3429776b-4086-46c8-9227-16d6ddbc384e None admin] RBAC: Authorizing `identity:list_services()` {{(pid=82025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:42:52.472474 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3429776b-4086-46c8-9227-16d6ddbc384e None admin] RBAC: Authorization granted {{(pid=82025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:42:52.477697 dv-cinder-828806-6-smb devstack@keystone.service[82025]: [pid: 82025|app: 0|req: 507/1004] 10.222.0.33 () {56 vars in 1122 bytes} [Tue Sep 13 19:42:52 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 13 19:42:52.483128 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3429776b-4086-46c8-9227-16d6ddbc384e None admin] Authenticating user token {{(pid=82025) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:42:52.492550 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG dbcounter [-] [82025] Writing DB stats keystone:SELECT=100 {{(pid=82025) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:42:52.505137 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7a59290-fcf4-4c2d-a444-7f637bc66f48 None admin] Validating token access rules against request {{(pid=82026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:42:52.543652 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-092707c5-3c5b-43e3-89b8-1e5d8f01ca6e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57539b6a6f3b4d589f5f5e1d211cd6a0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:42:52.544258 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-092707c5-3c5b-43e3-89b8-1e5d8f01ca6e None admin] REQUEST_METHOD: `GET` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:42:52.544540 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-092707c5-3c5b-43e3-89b8-1e5d8f01ca6e None admin] SCRIPT_NAME: `/identity` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:42:52.544874 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-092707c5-3c5b-43e3-89b8-1e5d8f01ca6e None admin] PATH_INFO: `/v3/services` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:42:52.545626 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-092707c5-3c5b-43e3-89b8-1e5d8f01ca6e None admin] RBAC: Adding query filter params (name=image) {{(pid=82026) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 19:42:52.546047 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-092707c5-3c5b-43e3-89b8-1e5d8f01ca6e None admin] RBAC: Authorizing `identity:list_services()` {{(pid=82026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:42:52.547428 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-092707c5-3c5b-43e3-89b8-1e5d8f01ca6e None admin] RBAC: Authorization granted {{(pid=82026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:42:52.555123 dv-cinder-828806-6-smb devstack@keystone.service[82026]: [pid: 82026|app: 0|req: 498/1005] 10.222.0.33 () {56 vars in 1108 bytes} [Tue Sep 13 19:42:52 2022] GET /identity/v3/services?name=image => generated 122 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 13 19:42:52.558702 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-092707c5-3c5b-43e3-89b8-1e5d8f01ca6e None admin] Authenticating user token {{(pid=82026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:42:52.593942 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3429776b-4086-46c8-9227-16d6ddbc384e None admin] Validating token access rules against request {{(pid=82025) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:42:52.632847 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc4545fc-06b6-447d-838e-ca85a26f5905 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57539b6a6f3b4d589f5f5e1d211cd6a0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82025) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:42:52.633462 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc4545fc-06b6-447d-838e-ca85a26f5905 None admin] REQUEST_METHOD: `POST` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:42:52.633746 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc4545fc-06b6-447d-838e-ca85a26f5905 None admin] SCRIPT_NAME: `/identity` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:42:52.634029 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc4545fc-06b6-447d-838e-ca85a26f5905 None admin] PATH_INFO: `/v3/endpoints` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:42:52.634706 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc4545fc-06b6-447d-838e-ca85a26f5905 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=82025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:42:52.636211 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc4545fc-06b6-447d-838e-ca85a26f5905 None admin] RBAC: Authorization granted {{(pid=82025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:42:52.643971 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG dbcounter [-] [82026] Writing DB stats keystone:SELECT=100 {{(pid=82026) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:42:52.668461 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-092707c5-3c5b-43e3-89b8-1e5d8f01ca6e None admin] Validating token access rules against request {{(pid=82026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:42:52.700964 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-737ab76d-07fe-446b-8ed6-99e41a5584df None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57539b6a6f3b4d589f5f5e1d211cd6a0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:42:52.701563 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-737ab76d-07fe-446b-8ed6-99e41a5584df None admin] REQUEST_METHOD: `GET` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:42:52.701878 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-737ab76d-07fe-446b-8ed6-99e41a5584df None admin] SCRIPT_NAME: `/identity` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:42:52.702137 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-737ab76d-07fe-446b-8ed6-99e41a5584df None admin] PATH_INFO: `/v3/services` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:42:52.702773 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-737ab76d-07fe-446b-8ed6-99e41a5584df None admin] RBAC: Adding query filter params (type=image) {{(pid=82026) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 19:42:52.703118 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-737ab76d-07fe-446b-8ed6-99e41a5584df None admin] RBAC: Authorizing `identity:list_services()` {{(pid=82026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:42:52.704490 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-737ab76d-07fe-446b-8ed6-99e41a5584df None admin] RBAC: Authorization granted {{(pid=82026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:42:52.709651 dv-cinder-828806-6-smb devstack@keystone.service[82026]: [pid: 82026|app: 0|req: 499/1006] 10.222.0.33 () {56 vars in 1108 bytes} [Tue Sep 13 19:42:52 2022] GET /identity/v3/services?type=image => generated 122 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 13 19:42:52.710275 dv-cinder-828806-6-smb devstack@keystone.service[82025]: [pid: 82025|app: 0|req: 508/1007] 10.222.0.33 () {60 vars in 1144 bytes} [Tue Sep 13 19:42:52 2022] POST /identity/v3/endpoints => generated 325 bytes in 227 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 13 19:42:54.117777 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16254f64-1c5c-46e8-9183-a6b09baa61dc None None] REQUEST_METHOD: `GET` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:42:54.118421 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16254f64-1c5c-46e8-9183-a6b09baa61dc None None] SCRIPT_NAME: `/identity` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:42:54.118421 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16254f64-1c5c-46e8-9183-a6b09baa61dc None None] PATH_INFO: `/` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:42:54.119736 dv-cinder-828806-6-smb devstack@keystone.service[82026]: [pid: 82026|app: 0|req: 500/1008] 10.222.0.33 () {54 vars in 927 bytes} [Tue Sep 13 19:42:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 19:42:54.124816 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc7e0764-c70e-437d-ba47-972663d29695 None None] REQUEST_METHOD: `POST` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:42:54.125230 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc7e0764-c70e-437d-ba47-972663d29695 None None] SCRIPT_NAME: `/identity` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:42:54.125393 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc7e0764-c70e-437d-ba47-972663d29695 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:42:54.144454 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.auth.core [None req-fc7e0764-c70e-437d-ba47-972663d29695 None None] MFA Rules not processed for user `57539b6a6f3b4d589f5f5e1d211cd6a0`. Rule list: `[]` (Enabled: `True`). {{(pid=82025) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 19:42:54.145640 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.fernet_utils [None req-fc7e0764-c70e-437d-ba47-972663d29695 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82025) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 19:42:54.206660 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG dbcounter [-] [82025] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82025) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:42:54.223077 dv-cinder-828806-6-smb devstack@keystone.service[82025]: [pid: 82025|app: 0|req: 509/1009] 10.222.0.33 () {58 vars in 1024 bytes} [Tue Sep 13 19:42:54 2022] POST /identity/v3/auth/tokens => generated 1717 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 13 19:42:54.492150 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16254f64-1c5c-46e8-9183-a6b09baa61dc None None] Authenticating user token {{(pid=82026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:42:54.595904 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16254f64-1c5c-46e8-9183-a6b09baa61dc None None] Validating token access rules against request {{(pid=82026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:42:54.630077 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25e286a8-c715-4f6b-918c-1f78d62d7349 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57539b6a6f3b4d589f5f5e1d211cd6a0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:42:54.630700 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25e286a8-c715-4f6b-918c-1f78d62d7349 None admin] REQUEST_METHOD: `GET` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:42:54.630981 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25e286a8-c715-4f6b-918c-1f78d62d7349 None admin] SCRIPT_NAME: `/identity` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:42:54.631280 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25e286a8-c715-4f6b-918c-1f78d62d7349 None admin] PATH_INFO: `/v3/services/compute` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:42:54.631863 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25e286a8-c715-4f6b-918c-1f78d62d7349 None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=82026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:42:54.633222 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25e286a8-c715-4f6b-918c-1f78d62d7349 None admin] RBAC: Authorization granted {{(pid=82026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:42:54.642022 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application [None req-25e286a8-c715-4f6b-918c-1f78d62d7349 None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Sep 13 19:42:54.642022 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 19:42:54.642022 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 13 19:42:54.642022 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 13 19:42:54.642022 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 13 19:42:54.642022 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 13 19:42:54.642022 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 13 19:42:54.642022 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 13 19:42:54.642022 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Sep 13 19:42:54.642022 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application Sep 13 19:42:54.642022 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 13 19:42:54.642022 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application Sep 13 19:42:54.642022 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 19:42:54.642022 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 19:42:54.642022 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 19:42:54.642022 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 19:42:54.642022 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 19:42:54.643473 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 19:42:54.643473 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 19:42:54.643473 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 19:42:54.643473 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 19:42:54.643473 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 19:42:54.643473 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 19:42:54.643473 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 13 19:42:54.643473 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 13 19:42:54.643473 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 13 19:42:54.643473 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 13 19:42:54.643473 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 19:42:54.643473 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 19:42:54.643473 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 19:42:54.643473 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 19:42:54.643473 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 19:42:54.643473 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 19:42:54.644333 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 19:42:54.644333 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application with Lock( Sep 13 19:42:54.644333 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 19:42:54.644333 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application return self._enter() Sep 13 19:42:54.644333 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 19:42:54.644333 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 19:42:54.644333 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 19:42:54.644333 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application return self.creator() Sep 13 19:42:54.644333 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 19:42:54.644333 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application created_value = creator( Sep 13 19:42:54.644333 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 13 19:42:54.644333 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 13 19:42:54.644333 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Sep 13 19:42:54.644333 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application Sep 13 19:42:54.647113 dv-cinder-828806-6-smb devstack@keystone.service[82026]: [pid: 82026|app: 0|req: 501/1010] 10.222.0.33 () {56 vars in 1111 bytes} [Tue Sep 13 19:42:54 2022] GET /identity/v3/services/compute => generated 88 bytes in 152 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 19:42:54.649089 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc7e0764-c70e-437d-ba47-972663d29695 None None] Authenticating user token {{(pid=82025) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:42:54.747187 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc7e0764-c70e-437d-ba47-972663d29695 None None] Validating token access rules against request {{(pid=82025) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:42:54.781603 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59f6df70-eb6b-469b-b915-080d5f3706aa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57539b6a6f3b4d589f5f5e1d211cd6a0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82025) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:42:54.782214 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59f6df70-eb6b-469b-b915-080d5f3706aa None admin] REQUEST_METHOD: `GET` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:42:54.782494 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59f6df70-eb6b-469b-b915-080d5f3706aa None admin] SCRIPT_NAME: `/identity` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:42:54.782799 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59f6df70-eb6b-469b-b915-080d5f3706aa None admin] PATH_INFO: `/v3/services` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:42:54.783651 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59f6df70-eb6b-469b-b915-080d5f3706aa None admin] RBAC: Adding query filter params (name=compute) {{(pid=82025) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 19:42:54.783957 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59f6df70-eb6b-469b-b915-080d5f3706aa None admin] RBAC: Authorizing `identity:list_services()` {{(pid=82025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:42:54.785564 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59f6df70-eb6b-469b-b915-080d5f3706aa None admin] RBAC: Authorization granted {{(pid=82025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:42:54.794947 dv-cinder-828806-6-smb devstack@keystone.service[82025]: [pid: 82025|app: 0|req: 510/1011] 10.222.0.33 () {56 vars in 1112 bytes} [Tue Sep 13 19:42:54 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 19:42:54.796626 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25e286a8-c715-4f6b-918c-1f78d62d7349 None admin] Authenticating user token {{(pid=82026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:42:54.799492 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG dbcounter [-] [82026] Writing DB stats keystone:SELECT=100 {{(pid=82026) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:42:54.911734 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25e286a8-c715-4f6b-918c-1f78d62d7349 None admin] Validating token access rules against request {{(pid=82026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:42:54.937261 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fe20874-eaf0-4387-b747-7db8226e2f5c None None] REQUEST_METHOD: `GET` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:42:54.937550 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fe20874-eaf0-4387-b747-7db8226e2f5c None None] SCRIPT_NAME: `/identity` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:42:54.937832 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fe20874-eaf0-4387-b747-7db8226e2f5c None None] PATH_INFO: `/` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:42:54.939286 dv-cinder-828806-6-smb devstack@keystone.service[82025]: [pid: 82025|app: 0|req: 511/1012] 10.222.0.33 () {54 vars in 927 bytes} [Tue Sep 13 19:42:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 13 19:42:54.944291 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-277925fa-f008-4860-87f4-2bc6d9386059 None None] REQUEST_METHOD: `POST` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:42:54.944581 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-277925fa-f008-4860-87f4-2bc6d9386059 None None] SCRIPT_NAME: `/identity` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:42:54.944862 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-277925fa-f008-4860-87f4-2bc6d9386059 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:42:54.948473 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9071e2d2-04fc-4536-a256-1bbfd1b22d15 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57539b6a6f3b4d589f5f5e1d211cd6a0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:42:54.949079 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9071e2d2-04fc-4536-a256-1bbfd1b22d15 None admin] REQUEST_METHOD: `GET` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:42:54.949358 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9071e2d2-04fc-4536-a256-1bbfd1b22d15 None admin] SCRIPT_NAME: `/identity` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:42:54.949630 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9071e2d2-04fc-4536-a256-1bbfd1b22d15 None admin] PATH_INFO: `/v3/services` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:42:54.950260 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9071e2d2-04fc-4536-a256-1bbfd1b22d15 None admin] RBAC: Adding query filter params (type=compute) {{(pid=82026) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 19:42:54.950564 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9071e2d2-04fc-4536-a256-1bbfd1b22d15 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=82026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:42:54.952948 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9071e2d2-04fc-4536-a256-1bbfd1b22d15 None admin] RBAC: Authorization granted {{(pid=82026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:42:54.958960 dv-cinder-828806-6-smb devstack@keystone.service[82026]: [pid: 82026|app: 0|req: 502/1013] 10.222.0.33 () {56 vars in 1112 bytes} [Tue Sep 13 19:42:54 2022] GET /identity/v3/services?type=compute => generated 352 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 19:42:54.960150 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abcb0289-0f59-4340-be17-9d328bcbd13f None None] REQUEST_METHOD: `GET` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:42:54.960573 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abcb0289-0f59-4340-be17-9d328bcbd13f None None] SCRIPT_NAME: `/identity` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:42:54.960863 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abcb0289-0f59-4340-be17-9d328bcbd13f None None] PATH_INFO: `/` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:42:54.962205 dv-cinder-828806-6-smb devstack@keystone.service[82026]: [pid: 82026|app: 0|req: 503/1014] 10.222.0.33 () {54 vars in 927 bytes} [Tue Sep 13 19:42:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 19:42:54.964790 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abcb0289-0f59-4340-be17-9d328bcbd13f None None] Authenticating user token {{(pid=82026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:42:54.964959 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.auth.core [None req-277925fa-f008-4860-87f4-2bc6d9386059 None None] MFA Rules not processed for user `57539b6a6f3b4d589f5f5e1d211cd6a0`. Rule list: `[]` (Enabled: `True`). {{(pid=82025) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 19:42:54.966256 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.fernet_utils [None req-277925fa-f008-4860-87f4-2bc6d9386059 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82025) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 19:42:55.017078 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG dbcounter [-] [82025] Writing DB stats keystone:SELECT=100 {{(pid=82025) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:42:55.031766 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG dbcounter [-] [82026] Writing DB stats keystone:SELECT=100 {{(pid=82026) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:42:55.034793 dv-cinder-828806-6-smb devstack@keystone.service[82025]: [pid: 82025|app: 0|req: 512/1015] 10.222.0.33 () {58 vars in 1024 bytes} [Tue Sep 13 19:42:54 2022] POST /identity/v3/auth/tokens => generated 1717 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 13 19:42:55.036365 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9680ea78-5722-48be-bae1-3d1d5a6df354 None None] REQUEST_METHOD: `POST` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:42:55.036657 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9680ea78-5722-48be-bae1-3d1d5a6df354 None None] SCRIPT_NAME: `/identity` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:42:55.036937 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9680ea78-5722-48be-bae1-3d1d5a6df354 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:42:55.054403 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.auth.core [None req-9680ea78-5722-48be-bae1-3d1d5a6df354 None None] MFA Rules not processed for user `57539b6a6f3b4d589f5f5e1d211cd6a0`. Rule list: `[]` (Enabled: `True`). {{(pid=82025) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 19:42:55.056592 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.fernet_utils [None req-9680ea78-5722-48be-bae1-3d1d5a6df354 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82025) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 19:42:55.074049 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abcb0289-0f59-4340-be17-9d328bcbd13f None None] Validating token access rules against request {{(pid=82026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:42:55.111025 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-695ef4e2-c188-4cb9-b255-f49c5caa4152 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57539b6a6f3b4d589f5f5e1d211cd6a0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:42:55.111717 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-695ef4e2-c188-4cb9-b255-f49c5caa4152 None admin] REQUEST_METHOD: `POST` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:42:55.112006 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-695ef4e2-c188-4cb9-b255-f49c5caa4152 None admin] SCRIPT_NAME: `/identity` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:42:55.112313 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-695ef4e2-c188-4cb9-b255-f49c5caa4152 None admin] PATH_INFO: `/v3/endpoints` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:42:55.112993 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-695ef4e2-c188-4cb9-b255-f49c5caa4152 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=82026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:42:55.114365 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-695ef4e2-c188-4cb9-b255-f49c5caa4152 None admin] RBAC: Authorization granted {{(pid=82026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:42:55.130187 dv-cinder-828806-6-smb devstack@keystone.service[82025]: [pid: 82025|app: 0|req: 513/1016] 10.222.0.33 () {58 vars in 1024 bytes} [Tue Sep 13 19:42:55 2022] POST /identity/v3/auth/tokens => generated 1717 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 13 19:42:55.191066 dv-cinder-828806-6-smb devstack@keystone.service[82026]: [pid: 82026|app: 0|req: 504/1017] 10.222.0.33 () {60 vars in 1144 bytes} [Tue Sep 13 19:42:54 2022] POST /identity/v3/endpoints => generated 334 bytes in 220 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 13 19:42:55.305227 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9680ea78-5722-48be-bae1-3d1d5a6df354 None None] Authenticating user token {{(pid=82025) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:42:55.404767 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-695ef4e2-c188-4cb9-b255-f49c5caa4152 None admin] Authenticating user token {{(pid=82026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:42:55.416163 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9680ea78-5722-48be-bae1-3d1d5a6df354 None None] Validating token access rules against request {{(pid=82025) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:42:55.434084 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG dbcounter [-] [82025] Writing DB stats keystone:SELECT=100 {{(pid=82025) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:42:55.468591 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd10ee7d-4abf-4700-8873-8a2ca9e53b87 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57539b6a6f3b4d589f5f5e1d211cd6a0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82025) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:42:55.469241 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd10ee7d-4abf-4700-8873-8a2ca9e53b87 None admin] REQUEST_METHOD: `GET` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:42:55.469527 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd10ee7d-4abf-4700-8873-8a2ca9e53b87 None admin] SCRIPT_NAME: `/identity` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:42:55.469810 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd10ee7d-4abf-4700-8873-8a2ca9e53b87 None admin] PATH_INFO: `/v3/domains/default` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:42:55.471772 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd10ee7d-4abf-4700-8873-8a2ca9e53b87 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=82025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:42:55.473975 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd10ee7d-4abf-4700-8873-8a2ca9e53b87 None admin] RBAC: Authorization granted {{(pid=82025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:42:55.477665 dv-cinder-828806-6-smb devstack@keystone.service[82025]: [pid: 82025|app: 0|req: 514/1018] 10.222.0.33 () {56 vars in 1108 bytes} [Tue Sep 13 19:42:55 2022] GET /identity/v3/domains/default => generated 199 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 19:42:55.483997 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd10ee7d-4abf-4700-8873-8a2ca9e53b87 None admin] Authenticating user token {{(pid=82025) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:42:55.529698 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-695ef4e2-c188-4cb9-b255-f49c5caa4152 None admin] Validating token access rules against request {{(pid=82026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:42:55.559339 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG dbcounter [-] [82026] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82026) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:42:55.576167 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4ef3a40-3ee3-452c-b1d5-63ef2acf100d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57539b6a6f3b4d589f5f5e1d211cd6a0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:42:55.576800 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4ef3a40-3ee3-452c-b1d5-63ef2acf100d None admin] REQUEST_METHOD: `POST` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:42:55.577080 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4ef3a40-3ee3-452c-b1d5-63ef2acf100d None admin] SCRIPT_NAME: `/identity` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:42:55.577365 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4ef3a40-3ee3-452c-b1d5-63ef2acf100d None admin] PATH_INFO: `/v3/services` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:42:55.578051 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4ef3a40-3ee3-452c-b1d5-63ef2acf100d None admin] RBAC: Authorizing `identity:create_service()` {{(pid=82026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:42:55.582581 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4ef3a40-3ee3-452c-b1d5-63ef2acf100d None admin] RBAC: Authorization granted {{(pid=82026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:42:55.604643 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd10ee7d-4abf-4700-8873-8a2ca9e53b87 None admin] Validating token access rules against request {{(pid=82025) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:42:55.639934 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0112761a-c2c0-4cee-9c96-ea46f3b1c0dd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57539b6a6f3b4d589f5f5e1d211cd6a0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82025) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:42:55.640553 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0112761a-c2c0-4cee-9c96-ea46f3b1c0dd None admin] REQUEST_METHOD: `POST` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:42:55.640828 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0112761a-c2c0-4cee-9c96-ea46f3b1c0dd None admin] SCRIPT_NAME: `/identity` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:42:55.641099 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0112761a-c2c0-4cee-9c96-ea46f3b1c0dd None admin] PATH_INFO: `/v3/projects` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:42:55.641749 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0112761a-c2c0-4cee-9c96-ea46f3b1c0dd None admin] RBAC: Authorizing `identity:create_project()` {{(pid=82025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:42:55.643429 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0112761a-c2c0-4cee-9c96-ea46f3b1c0dd None admin] RBAC: Authorization granted {{(pid=82025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:42:55.675819 dv-cinder-828806-6-smb devstack@keystone.service[82026]: [pid: 82026|app: 0|req: 505/1019] 10.222.0.33 () {60 vars in 1141 bytes} [Tue Sep 13 19:42:55 2022] POST /identity/v3/services => generated 242 bytes in 272 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 13 19:42:55.755065 dv-cinder-828806-6-smb devstack@keystone.service[82025]: [pid: 82025|app: 0|req: 515/1020] 10.222.0.33 () {60 vars in 1141 bytes} [Tue Sep 13 19:42:55 2022] POST /identity/v3/projects => generated 311 bytes in 268 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 13 19:42:57.485056 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cec002f-456a-4ac1-9ca4-11c6dce6e9cb None None] REQUEST_METHOD: `GET` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:42:57.485609 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cec002f-456a-4ac1-9ca4-11c6dce6e9cb None None] SCRIPT_NAME: `/identity` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:42:57.485609 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cec002f-456a-4ac1-9ca4-11c6dce6e9cb None None] PATH_INFO: `/` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:42:57.487774 dv-cinder-828806-6-smb devstack@keystone.service[82026]: [pid: 82026|app: 0|req: 506/1021] 10.222.0.33 () {54 vars in 927 bytes} [Tue Sep 13 19:42:57 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 19:42:57.493289 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6b466e4-143d-4243-9b0b-eefa39abce33 None None] REQUEST_METHOD: `POST` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:42:57.493719 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6b466e4-143d-4243-9b0b-eefa39abce33 None None] SCRIPT_NAME: `/identity` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:42:57.493901 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6b466e4-143d-4243-9b0b-eefa39abce33 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:42:57.516704 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.auth.core [None req-a6b466e4-143d-4243-9b0b-eefa39abce33 None None] MFA Rules not processed for user `57539b6a6f3b4d589f5f5e1d211cd6a0`. Rule list: `[]` (Enabled: `True`). {{(pid=82025) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 19:42:57.518094 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.fernet_utils [None req-a6b466e4-143d-4243-9b0b-eefa39abce33 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82025) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 19:42:57.546793 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG dbcounter [-] [82025] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82025) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:42:57.595246 dv-cinder-828806-6-smb devstack@keystone.service[82025]: [pid: 82025|app: 0|req: 516/1022] 10.222.0.33 () {58 vars in 1024 bytes} [Tue Sep 13 19:42:57 2022] POST /identity/v3/auth/tokens => generated 1969 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 13 19:42:57.868424 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cec002f-456a-4ac1-9ca4-11c6dce6e9cb None None] Authenticating user token {{(pid=82026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:42:57.889451 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92b2912d-f972-42e5-bf7d-9f344d360677 None None] REQUEST_METHOD: `GET` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:42:57.889769 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92b2912d-f972-42e5-bf7d-9f344d360677 None None] SCRIPT_NAME: `/identity` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:42:57.890025 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92b2912d-f972-42e5-bf7d-9f344d360677 None None] PATH_INFO: `/` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:42:57.891460 dv-cinder-828806-6-smb devstack@keystone.service[82025]: [pid: 82025|app: 0|req: 517/1023] 10.222.0.33 () {54 vars in 927 bytes} [Tue Sep 13 19:42:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 13 19:42:57.896916 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e66caa0a-9c85-4978-a698-d31eb508b4c8 None None] REQUEST_METHOD: `POST` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:42:57.897202 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e66caa0a-9c85-4978-a698-d31eb508b4c8 None None] SCRIPT_NAME: `/identity` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:42:57.897486 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e66caa0a-9c85-4978-a698-d31eb508b4c8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:42:57.916354 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.auth.core [None req-e66caa0a-9c85-4978-a698-d31eb508b4c8 None None] MFA Rules not processed for user `57539b6a6f3b4d589f5f5e1d211cd6a0`. Rule list: `[]` (Enabled: `True`). {{(pid=82025) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 19:42:57.917557 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.fernet_utils [None req-e66caa0a-9c85-4978-a698-d31eb508b4c8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82025) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 19:42:57.978807 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cec002f-456a-4ac1-9ca4-11c6dce6e9cb None None] Validating token access rules against request {{(pid=82026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:42:57.992611 dv-cinder-828806-6-smb devstack@keystone.service[82025]: [pid: 82025|app: 0|req: 518/1024] 10.222.0.33 () {58 vars in 1024 bytes} [Tue Sep 13 19:42:57 2022] POST /identity/v3/auth/tokens => generated 1969 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 13 19:42:57.993902 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ae4aba0-686f-4b10-8b69-ed5598dd2ed4 None None] REQUEST_METHOD: `GET` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:42:57.994196 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ae4aba0-686f-4b10-8b69-ed5598dd2ed4 None None] SCRIPT_NAME: `/identity` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:42:57.994477 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ae4aba0-686f-4b10-8b69-ed5598dd2ed4 None None] PATH_INFO: `/` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:42:57.995756 dv-cinder-828806-6-smb devstack@keystone.service[82025]: [pid: 82025|app: 0|req: 519/1025] 10.222.0.33 () {54 vars in 927 bytes} [Tue Sep 13 19:42:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 19:42:58.001386 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6af52bb-73a3-4641-8f2f-9d08f7e05b7b None None] REQUEST_METHOD: `POST` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:42:58.001695 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6af52bb-73a3-4641-8f2f-9d08f7e05b7b None None] SCRIPT_NAME: `/identity` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:42:58.001959 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6af52bb-73a3-4641-8f2f-9d08f7e05b7b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:42:58.017245 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eee17ad2-f4da-439e-98b9-b2aff4494a2a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57539b6a6f3b4d589f5f5e1d211cd6a0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:42:58.018402 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eee17ad2-f4da-439e-98b9-b2aff4494a2a None admin] REQUEST_METHOD: `GET` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:42:58.018671 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eee17ad2-f4da-439e-98b9-b2aff4494a2a None admin] SCRIPT_NAME: `/identity` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:42:58.018938 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eee17ad2-f4da-439e-98b9-b2aff4494a2a None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:42:58.023881 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.auth.core [None req-b6af52bb-73a3-4641-8f2f-9d08f7e05b7b None None] MFA Rules not processed for user `57539b6a6f3b4d589f5f5e1d211cd6a0`. Rule list: `[]` (Enabled: `True`). {{(pid=82025) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 19:42:58.026912 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.fernet_utils [None req-b6af52bb-73a3-4641-8f2f-9d08f7e05b7b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82025) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 19:42:58.029945 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eee17ad2-f4da-439e-98b9-b2aff4494a2a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=82026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 13 19:42:58.035470 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application [None req-eee17ad2-f4da-439e-98b9-b2aff4494a2a None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Sep 13 19:42:58.035470 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 19:42:58.035470 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 19:42:58.035470 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 19:42:58.035470 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 19:42:58.035470 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 19:42:58.035470 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 19:42:58.035470 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 19:42:58.035470 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 19:42:58.035470 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 19:42:58.035470 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 19:42:58.035470 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 19:42:58.035470 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 13 19:42:58.035470 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 13 19:42:58.035470 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 13 19:42:58.035470 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 13 19:42:58.036747 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 13 19:42:58.036747 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 13 19:42:58.036747 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 13 19:42:58.036747 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 13 19:42:58.036747 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 19:42:58.036747 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 19:42:58.036747 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 19:42:58.036747 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 19:42:58.036747 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 19:42:58.036747 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 19:42:58.036747 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 19:42:58.036747 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application with Lock( Sep 13 19:42:58.036747 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 19:42:58.036747 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application return self._enter() Sep 13 19:42:58.036747 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 19:42:58.036747 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 19:42:58.037615 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 19:42:58.037615 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application return self.creator() Sep 13 19:42:58.037615 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 19:42:58.037615 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application created_value = creator( Sep 13 19:42:58.037615 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 13 19:42:58.037615 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 13 19:42:58.037615 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 13 19:42:58.037615 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 13 19:42:58.037615 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 13 19:42:58.037615 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 13 19:42:58.037615 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Sep 13 19:42:58.037615 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application Sep 13 19:42:58.037615 dv-cinder-828806-6-smb devstack@keystone.service[82026]: [pid: 82026|app: 0|req: 507/1026] 10.222.0.33 () {56 vars in 1120 bytes} [Tue Sep 13 19:42:57 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 19:42:58.042720 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eee17ad2-f4da-439e-98b9-b2aff4494a2a None admin] Authenticating user token {{(pid=82026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:42:58.088570 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG dbcounter [-] [82026] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82026) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:42:58.100768 dv-cinder-828806-6-smb devstack@keystone.service[82025]: [pid: 82025|app: 0|req: 520/1027] 10.222.0.33 () {58 vars in 1024 bytes} [Tue Sep 13 19:42:57 2022] POST /identity/v3/auth/tokens => generated 1969 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 13 19:42:58.146189 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eee17ad2-f4da-439e-98b9-b2aff4494a2a None admin] Validating token access rules against request {{(pid=82026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:42:58.182805 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95646208-12b5-487a-87bc-c72408101bd9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57539b6a6f3b4d589f5f5e1d211cd6a0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:42:58.183720 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95646208-12b5-487a-87bc-c72408101bd9 None admin] REQUEST_METHOD: `GET` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:42:58.184207 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95646208-12b5-487a-87bc-c72408101bd9 None admin] SCRIPT_NAME: `/identity` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:42:58.184687 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95646208-12b5-487a-87bc-c72408101bd9 None admin] PATH_INFO: `/v3/roles` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:42:58.185588 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95646208-12b5-487a-87bc-c72408101bd9 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=82026) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 19:42:58.186097 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95646208-12b5-487a-87bc-c72408101bd9 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:42:58.187698 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95646208-12b5-487a-87bc-c72408101bd9 None admin] RBAC: Authorization granted {{(pid=82026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:42:58.197285 dv-cinder-828806-6-smb devstack@keystone.service[82026]: [pid: 82026|app: 0|req: 508/1028] 10.222.0.33 () {56 vars in 1115 bytes} [Tue Sep 13 19:42:58 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 13 19:42:58.202919 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6af52bb-73a3-4641-8f2f-9d08f7e05b7b None None] Authenticating user token {{(pid=82025) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:42:58.222743 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG dbcounter [-] [82025] Writing DB stats keystone:SELECT=100 {{(pid=82025) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:42:58.262539 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95646208-12b5-487a-87bc-c72408101bd9 None admin] Authenticating user token {{(pid=82026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:42:58.312452 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6af52bb-73a3-4641-8f2f-9d08f7e05b7b None None] Validating token access rules against request {{(pid=82025) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:42:58.350031 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0039164-0b31-4d48-9918-9d071187a76a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57539b6a6f3b4d589f5f5e1d211cd6a0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82025) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:42:58.350702 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0039164-0b31-4d48-9918-9d071187a76a None admin] REQUEST_METHOD: `GET` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:42:58.350924 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0039164-0b31-4d48-9918-9d071187a76a None admin] SCRIPT_NAME: `/identity` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:42:58.351229 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0039164-0b31-4d48-9918-9d071187a76a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:42:58.361913 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0039164-0b31-4d48-9918-9d071187a76a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=82025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:42:58.363835 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0039164-0b31-4d48-9918-9d071187a76a None admin] RBAC: Authorization granted {{(pid=82025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:42:58.369561 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95646208-12b5-487a-87bc-c72408101bd9 None admin] Validating token access rules against request {{(pid=82026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:42:58.372386 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG dbcounter [-] [82026] Writing DB stats keystone:SELECT=100 {{(pid=82026) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:42:58.379738 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application [None req-f0039164-0b31-4d48-9918-9d071187a76a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 13 19:42:58.379738 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 19:42:58.379738 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 19:42:58.379738 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 19:42:58.379738 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 19:42:58.379738 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 19:42:58.379738 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 19:42:58.379738 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 19:42:58.379738 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 19:42:58.379738 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 19:42:58.379738 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 19:42:58.379738 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 19:42:58.379738 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 13 19:42:58.379738 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 13 19:42:58.379738 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 13 19:42:58.379738 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 13 19:42:58.381336 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 19:42:58.381336 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 19:42:58.381336 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 19:42:58.381336 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 19:42:58.381336 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 19:42:58.381336 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 19:42:58.381336 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 19:42:58.381336 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application with Lock( Sep 13 19:42:58.381336 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 19:42:58.381336 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application return self._enter() Sep 13 19:42:58.381336 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 19:42:58.381336 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 19:42:58.381336 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 19:42:58.381336 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application return self.creator() Sep 13 19:42:58.381336 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 19:42:58.381336 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application created_value = creator( Sep 13 19:42:58.381336 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 13 19:42:58.382313 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 13 19:42:58.382313 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 13 19:42:58.382313 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application Sep 13 19:42:58.382313 dv-cinder-828806-6-smb devstack@keystone.service[82025]: [pid: 82025|app: 0|req: 521/1029] 10.222.0.33 () {56 vars in 1108 bytes} [Tue Sep 13 19:42:58 2022] GET /identity/v3/domains/Default => generated 87 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 19:42:58.383891 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0039164-0b31-4d48-9918-9d071187a76a None admin] Authenticating user token {{(pid=82025) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:42:58.406368 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8f53ff8-3d34-4e31-b1cd-6540ca5e3f02 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57539b6a6f3b4d589f5f5e1d211cd6a0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:42:58.406917 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8f53ff8-3d34-4e31-b1cd-6540ca5e3f02 None admin] REQUEST_METHOD: `GET` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:42:58.407231 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8f53ff8-3d34-4e31-b1cd-6540ca5e3f02 None admin] SCRIPT_NAME: `/identity` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:42:58.407509 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8f53ff8-3d34-4e31-b1cd-6540ca5e3f02 None admin] PATH_INFO: `/v3/services/image` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:42:58.408757 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8f53ff8-3d34-4e31-b1cd-6540ca5e3f02 None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=82026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:42:58.410160 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8f53ff8-3d34-4e31-b1cd-6540ca5e3f02 None admin] RBAC: Authorization granted {{(pid=82026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:42:58.418919 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application [None req-f8f53ff8-3d34-4e31-b1cd-6540ca5e3f02 None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Sep 13 19:42:58.418919 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 19:42:58.418919 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 13 19:42:58.418919 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 13 19:42:58.418919 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 13 19:42:58.418919 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 13 19:42:58.418919 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 13 19:42:58.418919 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 13 19:42:58.418919 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Sep 13 19:42:58.418919 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application Sep 13 19:42:58.418919 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 13 19:42:58.418919 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application Sep 13 19:42:58.418919 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 19:42:58.418919 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 19:42:58.418919 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 19:42:58.418919 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 19:42:58.418919 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 19:42:58.420146 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 19:42:58.420146 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 19:42:58.420146 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 19:42:58.420146 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 19:42:58.420146 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 19:42:58.420146 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 19:42:58.420146 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 13 19:42:58.420146 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 13 19:42:58.420146 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 13 19:42:58.420146 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 13 19:42:58.420146 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 19:42:58.420146 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 19:42:58.420146 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 19:42:58.420146 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 19:42:58.420146 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 19:42:58.420146 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 19:42:58.421185 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 19:42:58.421185 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application with Lock( Sep 13 19:42:58.421185 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 19:42:58.421185 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application return self._enter() Sep 13 19:42:58.421185 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 19:42:58.421185 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 19:42:58.421185 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 19:42:58.421185 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application return self.creator() Sep 13 19:42:58.421185 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 19:42:58.421185 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application created_value = creator( Sep 13 19:42:58.421185 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 13 19:42:58.421185 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 13 19:42:58.421185 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Sep 13 19:42:58.421185 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application Sep 13 19:42:58.421185 dv-cinder-828806-6-smb devstack@keystone.service[82026]: [pid: 82026|app: 0|req: 509/1030] 10.222.0.33 () {56 vars in 1105 bytes} [Tue Sep 13 19:42:58 2022] GET /identity/v3/services/image => generated 86 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 13 19:42:58.422164 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8f53ff8-3d34-4e31-b1cd-6540ca5e3f02 None admin] Authenticating user token {{(pid=82026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:42:58.456123 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG dbcounter [-] [82025] Writing DB stats keystone:SELECT=100 {{(pid=82025) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:42:58.487825 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0039164-0b31-4d48-9918-9d071187a76a None admin] Validating token access rules against request {{(pid=82025) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:42:58.521364 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8f53ff8-3d34-4e31-b1cd-6540ca5e3f02 None admin] Validating token access rules against request {{(pid=82026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:42:58.522756 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1009e86e-216d-4574-bf2c-8d29890f4f74 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57539b6a6f3b4d589f5f5e1d211cd6a0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82025) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:42:58.523415 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1009e86e-216d-4574-bf2c-8d29890f4f74 None admin] REQUEST_METHOD: `GET` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:42:58.523701 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1009e86e-216d-4574-bf2c-8d29890f4f74 None admin] SCRIPT_NAME: `/identity` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:42:58.523970 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1009e86e-216d-4574-bf2c-8d29890f4f74 None admin] PATH_INFO: `/v3/domains/default` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:42:58.525181 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1009e86e-216d-4574-bf2c-8d29890f4f74 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=82025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:42:58.526664 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1009e86e-216d-4574-bf2c-8d29890f4f74 None admin] RBAC: Authorization granted {{(pid=82025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:42:58.528576 dv-cinder-828806-6-smb devstack@keystone.service[82025]: [pid: 82025|app: 0|req: 522/1031] 10.222.0.33 () {56 vars in 1108 bytes} [Tue Sep 13 19:42:58 2022] GET /identity/v3/domains/default => generated 199 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 19:42:58.529298 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1009e86e-216d-4574-bf2c-8d29890f4f74 None admin] Authenticating user token {{(pid=82025) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:42:58.560427 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12e8539c-8a56-4a86-bb07-295ef35ada83 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57539b6a6f3b4d589f5f5e1d211cd6a0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:42:58.561041 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12e8539c-8a56-4a86-bb07-295ef35ada83 None admin] REQUEST_METHOD: `GET` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:42:58.561330 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12e8539c-8a56-4a86-bb07-295ef35ada83 None admin] SCRIPT_NAME: `/identity` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:42:58.561606 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12e8539c-8a56-4a86-bb07-295ef35ada83 None admin] PATH_INFO: `/v3/domains` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:42:58.562249 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12e8539c-8a56-4a86-bb07-295ef35ada83 None admin] RBAC: Adding query filter params (name=Default) {{(pid=82026) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 19:42:58.562554 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12e8539c-8a56-4a86-bb07-295ef35ada83 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:42:58.563948 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12e8539c-8a56-4a86-bb07-295ef35ada83 None admin] RBAC: Authorization granted {{(pid=82026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:42:58.575438 dv-cinder-828806-6-smb devstack@keystone.service[82026]: [pid: 82026|app: 0|req: 510/1032] 10.222.0.33 () {56 vars in 1109 bytes} [Tue Sep 13 19:42:58 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 19:42:58.576203 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12e8539c-8a56-4a86-bb07-295ef35ada83 None admin] Authenticating user token {{(pid=82026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:42:58.606448 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG dbcounter [-] [82026] Writing DB stats keystone:SELECT=100 {{(pid=82026) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:42:58.630088 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1009e86e-216d-4574-bf2c-8d29890f4f74 None admin] Validating token access rules against request {{(pid=82025) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:42:58.664532 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b28ccc5b-2b01-4e88-8b79-f632d1be5ad5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57539b6a6f3b4d589f5f5e1d211cd6a0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82025) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:42:58.665504 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b28ccc5b-2b01-4e88-8b79-f632d1be5ad5 None admin] REQUEST_METHOD: `GET` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:42:58.665798 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b28ccc5b-2b01-4e88-8b79-f632d1be5ad5 None admin] SCRIPT_NAME: `/identity` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:42:58.666079 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b28ccc5b-2b01-4e88-8b79-f632d1be5ad5 None admin] PATH_INFO: `/v3/services` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:42:58.666712 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b28ccc5b-2b01-4e88-8b79-f632d1be5ad5 None admin] RBAC: Adding query filter params (name=image) {{(pid=82025) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 19:42:58.667045 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b28ccc5b-2b01-4e88-8b79-f632d1be5ad5 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=82025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:42:58.668415 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b28ccc5b-2b01-4e88-8b79-f632d1be5ad5 None admin] RBAC: Authorization granted {{(pid=82025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:42:58.678379 dv-cinder-828806-6-smb devstack@keystone.service[82025]: [pid: 82025|app: 0|req: 523/1033] 10.222.0.33 () {56 vars in 1108 bytes} [Tue Sep 13 19:42:58 2022] GET /identity/v3/services?name=image => generated 122 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 19:42:58.678379 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b28ccc5b-2b01-4e88-8b79-f632d1be5ad5 None admin] Authenticating user token {{(pid=82025) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:42:58.678606 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12e8539c-8a56-4a86-bb07-295ef35ada83 None admin] Validating token access rules against request {{(pid=82026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:42:58.678700 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG dbcounter [-] [82025] Writing DB stats keystone:SELECT=100 {{(pid=82025) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:42:58.712447 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a20509a-24dc-485a-bc45-5333bbb65faa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57539b6a6f3b4d589f5f5e1d211cd6a0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:42:58.713056 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a20509a-24dc-485a-bc45-5333bbb65faa None admin] REQUEST_METHOD: `POST` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:42:58.713343 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a20509a-24dc-485a-bc45-5333bbb65faa None admin] SCRIPT_NAME: `/identity` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:42:58.713622 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a20509a-24dc-485a-bc45-5333bbb65faa None admin] PATH_INFO: `/v3/users` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:42:58.714282 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a20509a-24dc-485a-bc45-5333bbb65faa None admin] RBAC: Authorizing `identity:create_user()` {{(pid=82026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:42:58.715758 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a20509a-24dc-485a-bc45-5333bbb65faa None admin] RBAC: Authorization granted {{(pid=82026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:42:58.775555 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b28ccc5b-2b01-4e88-8b79-f632d1be5ad5 None admin] Validating token access rules against request {{(pid=82025) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:42:58.808560 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4bcf6e3-a39f-4954-bcb8-bf538f770291 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57539b6a6f3b4d589f5f5e1d211cd6a0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82025) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:42:58.808925 dv-cinder-828806-6-smb devstack@keystone.service[82026]: [pid: 82026|app: 0|req: 511/1034] 10.222.0.33 () {60 vars in 1132 bytes} [Tue Sep 13 19:42:58 2022] POST /identity/v3/users => generated 285 bytes in 233 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 13 19:42:58.809183 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4bcf6e3-a39f-4954-bcb8-bf538f770291 None admin] REQUEST_METHOD: `GET` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:42:58.809512 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4bcf6e3-a39f-4954-bcb8-bf538f770291 None admin] SCRIPT_NAME: `/identity` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:42:58.809747 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a20509a-24dc-485a-bc45-5333bbb65faa None admin] Authenticating user token {{(pid=82026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:42:58.809852 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4bcf6e3-a39f-4954-bcb8-bf538f770291 None admin] PATH_INFO: `/v3/users/nova` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:42:58.818746 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4bcf6e3-a39f-4954-bcb8-bf538f770291 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=82025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:42:58.820261 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4bcf6e3-a39f-4954-bcb8-bf538f770291 None admin] RBAC: Authorization granted {{(pid=82025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:42:58.833328 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application [None req-d4bcf6e3-a39f-4954-bcb8-bf538f770291 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Sep 13 19:42:58.833328 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 19:42:58.833328 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 19:42:58.833328 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 19:42:58.833328 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 19:42:58.833328 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 19:42:58.833328 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 19:42:58.833328 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 19:42:58.833328 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 19:42:58.833328 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 19:42:58.833328 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 19:42:58.833328 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 19:42:58.833328 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 13 19:42:58.833328 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 13 19:42:58.833328 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 13 19:42:58.833328 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 13 19:42:58.834440 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 19:42:58.834440 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 19:42:58.834440 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 13 19:42:58.834440 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 13 19:42:58.834440 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 13 19:42:58.834440 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 13 19:42:58.834440 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 19:42:58.834440 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 19:42:58.834440 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 19:42:58.834440 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 19:42:58.834440 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 19:42:58.834440 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application with Lock( Sep 13 19:42:58.834440 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 19:42:58.834440 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application return self._enter() Sep 13 19:42:58.834440 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 19:42:58.834440 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 19:42:58.834440 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 19:42:58.834440 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application return self.creator() Sep 13 19:42:58.835479 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 19:42:58.835479 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application created_value = creator( Sep 13 19:42:58.835479 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 13 19:42:58.835479 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 13 19:42:58.835479 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 13 19:42:58.835479 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 13 19:42:58.835479 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 13 19:42:58.835479 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 13 19:42:58.835479 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Sep 13 19:42:58.835479 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application Sep 13 19:42:58.835479 dv-cinder-828806-6-smb devstack@keystone.service[82025]: [pid: 82025|app: 0|req: 524/1035] 10.222.0.33 () {56 vars in 1093 bytes} [Tue Sep 13 19:42:58 2022] GET /identity/v3/users/nova => generated 82 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 19:42:58.840905 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4bcf6e3-a39f-4954-bcb8-bf538f770291 None admin] Authenticating user token {{(pid=82025) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:42:58.913479 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG dbcounter [-] [82025] Writing DB stats keystone:SELECT=100 {{(pid=82025) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:42:58.933033 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG dbcounter [-] [82026] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=82026) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:42:58.950542 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a20509a-24dc-485a-bc45-5333bbb65faa None admin] Validating token access rules against request {{(pid=82026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:42:58.988299 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4bcf6e3-a39f-4954-bcb8-bf538f770291 None admin] Validating token access rules against request {{(pid=82025) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:42:58.988517 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7405f2e-b5ed-4607-83f7-0272001528de None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57539b6a6f3b4d589f5f5e1d211cd6a0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:42:58.989138 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7405f2e-b5ed-4607-83f7-0272001528de None admin] REQUEST_METHOD: `GET` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:42:58.989426 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7405f2e-b5ed-4607-83f7-0272001528de None admin] SCRIPT_NAME: `/identity` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:42:58.989701 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7405f2e-b5ed-4607-83f7-0272001528de None admin] PATH_INFO: `/v3/services` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:42:58.990349 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7405f2e-b5ed-4607-83f7-0272001528de None admin] RBAC: Adding query filter params (type=image) {{(pid=82026) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 19:42:58.990731 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7405f2e-b5ed-4607-83f7-0272001528de None admin] RBAC: Authorizing `identity:list_services()` {{(pid=82026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:42:58.992160 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7405f2e-b5ed-4607-83f7-0272001528de None admin] RBAC: Authorization granted {{(pid=82026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:42:58.998008 dv-cinder-828806-6-smb devstack@keystone.service[82026]: [pid: 82026|app: 0|req: 512/1036] 10.222.0.33 () {56 vars in 1108 bytes} [Tue Sep 13 19:42:58 2022] GET /identity/v3/services?type=image => generated 350 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 19:42:59.004738 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7405f2e-b5ed-4607-83f7-0272001528de None admin] Authenticating user token {{(pid=82026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:42:59.032117 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1304eee-8bb3-4829-b306-57025da72def None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57539b6a6f3b4d589f5f5e1d211cd6a0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82025) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:42:59.032875 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1304eee-8bb3-4829-b306-57025da72def None admin] REQUEST_METHOD: `GET` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:42:59.033558 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1304eee-8bb3-4829-b306-57025da72def None admin] SCRIPT_NAME: `/identity` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:42:59.033839 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1304eee-8bb3-4829-b306-57025da72def None admin] PATH_INFO: `/v3/users` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:42:59.034670 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1304eee-8bb3-4829-b306-57025da72def None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=82025) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 19:42:59.034986 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1304eee-8bb3-4829-b306-57025da72def None admin] RBAC: Authorizing `identity:list_users()` {{(pid=82025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:42:59.036712 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1304eee-8bb3-4829-b306-57025da72def None admin] RBAC: Authorization granted {{(pid=82025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:42:59.060873 dv-cinder-828806-6-smb devstack@keystone.service[82025]: [pid: 82025|app: 0|req: 525/1037] 10.222.0.33 () {56 vars in 1133 bytes} [Tue Sep 13 19:42:58 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 220 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 13 19:42:59.062057 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1304eee-8bb3-4829-b306-57025da72def None admin] Authenticating user token {{(pid=82025) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:42:59.118646 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7405f2e-b5ed-4607-83f7-0272001528de None admin] Validating token access rules against request {{(pid=82026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:42:59.156870 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ee83f37-e4bf-4183-94d3-c707f8f14ac9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57539b6a6f3b4d589f5f5e1d211cd6a0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:42:59.157486 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ee83f37-e4bf-4183-94d3-c707f8f14ac9 None admin] REQUEST_METHOD: `GET` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:42:59.157774 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ee83f37-e4bf-4183-94d3-c707f8f14ac9 None admin] SCRIPT_NAME: `/identity` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:42:59.158588 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ee83f37-e4bf-4183-94d3-c707f8f14ac9 None admin] PATH_INFO: `/v3/endpoints` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:42:59.159450 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ee83f37-e4bf-4183-94d3-c707f8f14ac9 None admin] RBAC: Adding query filter params (interface=public, service_id=2a1c0dbf4e344baeb342f356bb2fc937, region_id=RegionOne) {{(pid=82026) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 19:42:59.159799 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ee83f37-e4bf-4183-94d3-c707f8f14ac9 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=82026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:42:59.161506 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ee83f37-e4bf-4183-94d3-c707f8f14ac9 None admin] RBAC: Authorization granted {{(pid=82026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:42:59.166368 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1304eee-8bb3-4829-b306-57025da72def None admin] Validating token access rules against request {{(pid=82025) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:42:59.171354 dv-cinder-828806-6-smb devstack@keystone.service[82026]: [pid: 82026|app: 0|req: 513/1038] 10.222.0.33 () {56 vars in 1251 bytes} [Tue Sep 13 19:42:59 2022] GET /identity/v3/endpoints?service_id=2a1c0dbf4e344baeb342f356bb2fc937&interface=public®ion_id=RegionOne => generated 194 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 13 19:42:59.172784 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ee83f37-e4bf-4183-94d3-c707f8f14ac9 None admin] Authenticating user token {{(pid=82026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:42:59.187543 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG dbcounter [-] [82026] Writing DB stats keystone:SELECT=100 {{(pid=82026) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:42:59.190662 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG dbcounter [-] [82025] Writing DB stats keystone:SELECT=100 {{(pid=82025) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:42:59.208560 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-334126c0-aeae-4620-b7f8-bb708222358c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57539b6a6f3b4d589f5f5e1d211cd6a0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82025) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:42:59.209183 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-334126c0-aeae-4620-b7f8-bb708222358c None admin] REQUEST_METHOD: `GET` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:42:59.209464 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-334126c0-aeae-4620-b7f8-bb708222358c None admin] SCRIPT_NAME: `/identity` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:42:59.209740 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-334126c0-aeae-4620-b7f8-bb708222358c None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:42:59.284155 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-334126c0-aeae-4620-b7f8-bb708222358c None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=82025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:42:59.286015 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-334126c0-aeae-4620-b7f8-bb708222358c None admin] RBAC: Authorization granted {{(pid=82025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:42:59.307495 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ee83f37-e4bf-4183-94d3-c707f8f14ac9 None admin] Validating token access rules against request {{(pid=82026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:42:59.344890 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80249da1-6e2f-4b15-80da-4589c9a4549a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57539b6a6f3b4d589f5f5e1d211cd6a0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:42:59.345668 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80249da1-6e2f-4b15-80da-4589c9a4549a None admin] REQUEST_METHOD: `GET` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:42:59.345960 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80249da1-6e2f-4b15-80da-4589c9a4549a None admin] SCRIPT_NAME: `/identity` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:42:59.346239 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80249da1-6e2f-4b15-80da-4589c9a4549a None admin] PATH_INFO: `/v3/services` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:42:59.346855 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80249da1-6e2f-4b15-80da-4589c9a4549a None admin] RBAC: Authorizing `identity:list_services()` {{(pid=82026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:42:59.348261 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80249da1-6e2f-4b15-80da-4589c9a4549a None admin] RBAC: Authorization granted {{(pid=82026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:42:59.355061 dv-cinder-828806-6-smb devstack@keystone.service[82026]: [pid: 82026|app: 0|req: 514/1039] 10.222.0.33 () {56 vars in 1087 bytes} [Tue Sep 13 19:42:59 2022] GET /identity/v3/services => generated 1957 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 13 19:42:59.409743 dv-cinder-828806-6-smb devstack@keystone.service[82025]: [pid: 82025|app: 0|req: 526/1040] 10.222.0.33 () {58 vars in 1282 bytes} [Tue Sep 13 19:42:59 2022] GET /identity/v3/auth/tokens => generated 1969 bytes in 343 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Sep 13 19:42:59.411424 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80249da1-6e2f-4b15-80da-4589c9a4549a None admin] Authenticating user token {{(pid=82026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:42:59.504331 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG dbcounter [-] [82026] Writing DB stats keystone:SELECT=100 {{(pid=82026) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:42:59.539510 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80249da1-6e2f-4b15-80da-4589c9a4549a None admin] Validating token access rules against request {{(pid=82026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:42:59.582545 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42f565da-68b4-450d-88a2-2d45fdcc910c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57539b6a6f3b4d589f5f5e1d211cd6a0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:42:59.583275 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42f565da-68b4-450d-88a2-2d45fdcc910c None admin] REQUEST_METHOD: `GET` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:42:59.583566 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42f565da-68b4-450d-88a2-2d45fdcc910c None admin] SCRIPT_NAME: `/identity` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:42:59.583844 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42f565da-68b4-450d-88a2-2d45fdcc910c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:42:59.594256 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42f565da-68b4-450d-88a2-2d45fdcc910c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=82026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:42:59.595820 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42f565da-68b4-450d-88a2-2d45fdcc910c None admin] RBAC: Authorization granted {{(pid=82026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:42:59.610636 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application [None req-42f565da-68b4-450d-88a2-2d45fdcc910c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 13 19:42:59.610636 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 19:42:59.610636 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 19:42:59.610636 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 19:42:59.610636 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 19:42:59.610636 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 19:42:59.610636 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 19:42:59.610636 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 19:42:59.610636 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 19:42:59.610636 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 19:42:59.610636 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 19:42:59.610636 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 19:42:59.610636 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 13 19:42:59.610636 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 13 19:42:59.610636 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 13 19:42:59.610636 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 13 19:42:59.612339 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 19:42:59.612339 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 19:42:59.612339 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 19:42:59.612339 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 19:42:59.612339 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 19:42:59.612339 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 19:42:59.612339 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 19:42:59.612339 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application with Lock( Sep 13 19:42:59.612339 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 19:42:59.612339 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application return self._enter() Sep 13 19:42:59.612339 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 19:42:59.612339 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 19:42:59.612339 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 19:42:59.612339 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application return self.creator() Sep 13 19:42:59.612339 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 19:42:59.612339 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application created_value = creator( Sep 13 19:42:59.612339 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 13 19:42:59.613277 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 13 19:42:59.613277 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 13 19:42:59.613277 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application Sep 13 19:42:59.613277 dv-cinder-828806-6-smb devstack@keystone.service[82026]: [pid: 82026|app: 0|req: 515/1041] 10.222.0.33 () {56 vars in 1108 bytes} [Tue Sep 13 19:42:59 2022] GET /identity/v3/domains/Default => generated 87 bytes in 202 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 19:42:59.619216 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-334126c0-aeae-4620-b7f8-bb708222358c None admin] Authenticating user token {{(pid=82025) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:42:59.641257 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG dbcounter [-] [82025] Writing DB stats keystone:SELECT=100 {{(pid=82025) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:42:59.723014 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-334126c0-aeae-4620-b7f8-bb708222358c None admin] Validating token access rules against request {{(pid=82025) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:42:59.758423 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6077194a-0e1e-4ac6-b2ab-ea7005601b59 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57539b6a6f3b4d589f5f5e1d211cd6a0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82025) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:42:59.758967 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6077194a-0e1e-4ac6-b2ab-ea7005601b59 None admin] REQUEST_METHOD: `GET` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:42:59.759287 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6077194a-0e1e-4ac6-b2ab-ea7005601b59 None admin] SCRIPT_NAME: `/identity` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:42:59.759569 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6077194a-0e1e-4ac6-b2ab-ea7005601b59 None admin] PATH_INFO: `/v3/domains` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:42:59.760240 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6077194a-0e1e-4ac6-b2ab-ea7005601b59 None admin] RBAC: Adding query filter params (name=Default) {{(pid=82025) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 19:42:59.760555 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6077194a-0e1e-4ac6-b2ab-ea7005601b59 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:42:59.761963 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6077194a-0e1e-4ac6-b2ab-ea7005601b59 None admin] RBAC: Authorization granted {{(pid=82025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:42:59.779272 dv-cinder-828806-6-smb devstack@keystone.service[82025]: [pid: 82025|app: 0|req: 527/1042] 10.222.0.33 () {56 vars in 1109 bytes} [Tue Sep 13 19:42:59 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 19:42:59.780523 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42f565da-68b4-450d-88a2-2d45fdcc910c None admin] Authenticating user token {{(pid=82026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:42:59.884457 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42f565da-68b4-450d-88a2-2d45fdcc910c None admin] Validating token access rules against request {{(pid=82026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:42:59.912402 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG dbcounter [-] [82026] Writing DB stats keystone:SELECT=100 {{(pid=82026) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:42:59.920366 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-241049a2-d310-4ad1-94ac-54ac65ad4df0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57539b6a6f3b4d589f5f5e1d211cd6a0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:42:59.920995 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-241049a2-d310-4ad1-94ac-54ac65ad4df0 None admin] REQUEST_METHOD: `GET` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:42:59.921698 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-241049a2-d310-4ad1-94ac-54ac65ad4df0 None admin] SCRIPT_NAME: `/identity` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:42:59.921698 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-241049a2-d310-4ad1-94ac-54ac65ad4df0 None admin] PATH_INFO: `/v3/projects/service` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:42:59.928813 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-241049a2-d310-4ad1-94ac-54ac65ad4df0 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=82026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:42:59.930261 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-241049a2-d310-4ad1-94ac-54ac65ad4df0 None admin] RBAC: Authorization granted {{(pid=82026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:42:59.941793 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application [None req-241049a2-d310-4ad1-94ac-54ac65ad4df0 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 13 19:42:59.941793 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 19:42:59.941793 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 19:42:59.941793 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 19:42:59.941793 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 19:42:59.941793 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 19:42:59.941793 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 19:42:59.941793 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 19:42:59.941793 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 19:42:59.941793 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 19:42:59.941793 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 19:42:59.941793 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 19:42:59.941793 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 13 19:42:59.941793 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 13 19:42:59.941793 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 13 19:42:59.942698 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 13 19:42:59.942698 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 19:42:59.942698 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 19:42:59.942698 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 19:42:59.942698 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 19:42:59.942698 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 19:42:59.942698 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 19:42:59.942698 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 19:42:59.942698 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application with Lock( Sep 13 19:42:59.942698 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 19:42:59.942698 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application return self._enter() Sep 13 19:42:59.942698 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 19:42:59.942698 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 19:42:59.942698 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 19:42:59.942698 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application return self.creator() Sep 13 19:42:59.942698 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 19:42:59.942698 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application created_value = creator( Sep 13 19:42:59.943679 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 13 19:42:59.943679 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 13 19:42:59.943679 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 13 19:42:59.943679 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 13 19:42:59.943679 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 13 19:42:59.943679 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 13 19:42:59.943679 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 13 19:42:59.943679 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application Sep 13 19:42:59.943679 dv-cinder-828806-6-smb devstack@keystone.service[82026]: [pid: 82026|app: 0|req: 516/1043] 10.222.0.33 () {56 vars in 1111 bytes} [Tue Sep 13 19:42:59 2022] GET /identity/v3/projects/service => generated 88 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 19:42:59.952278 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6077194a-0e1e-4ac6-b2ab-ea7005601b59 None admin] Authenticating user token {{(pid=82025) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:43:00.038062 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG dbcounter [-] [82025] Writing DB stats keystone:SELECT=100 {{(pid=82025) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:43:00.057351 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6077194a-0e1e-4ac6-b2ab-ea7005601b59 None admin] Validating token access rules against request {{(pid=82025) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:43:00.094898 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9afd723e-38cd-40fc-a555-cc7157053422 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57539b6a6f3b4d589f5f5e1d211cd6a0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82025) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:43:00.096214 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9afd723e-38cd-40fc-a555-cc7157053422 None admin] REQUEST_METHOD: `GET` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:43:00.096642 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9afd723e-38cd-40fc-a555-cc7157053422 None admin] SCRIPT_NAME: `/identity` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:43:00.097152 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9afd723e-38cd-40fc-a555-cc7157053422 None admin] PATH_INFO: `/v3/projects` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:43:00.097961 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9afd723e-38cd-40fc-a555-cc7157053422 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=82025) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 19:43:00.098277 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9afd723e-38cd-40fc-a555-cc7157053422 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=82025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:43:00.099754 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9afd723e-38cd-40fc-a555-cc7157053422 None admin] RBAC: Authorization granted {{(pid=82025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:43:00.118675 dv-cinder-828806-6-smb devstack@keystone.service[82025]: [pid: 82025|app: 0|req: 528/1044] 10.222.0.33 () {56 vars in 1148 bytes} [Tue Sep 13 19:42:59 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 13 19:43:00.119911 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-241049a2-d310-4ad1-94ac-54ac65ad4df0 None admin] Authenticating user token {{(pid=82026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:43:00.223291 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-241049a2-d310-4ad1-94ac-54ac65ad4df0 None admin] Validating token access rules against request {{(pid=82026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:43:00.256645 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30197b20-b8f0-446a-b7db-03d4665be47a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57539b6a6f3b4d589f5f5e1d211cd6a0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:43:00.257272 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30197b20-b8f0-446a-b7db-03d4665be47a None admin] REQUEST_METHOD: `GET` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:43:00.257561 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30197b20-b8f0-446a-b7db-03d4665be47a None admin] SCRIPT_NAME: `/identity` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:43:00.257840 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30197b20-b8f0-446a-b7db-03d4665be47a None admin] PATH_INFO: `/v3/role_assignments` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:43:00.258596 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30197b20-b8f0-446a-b7db-03d4665be47a None admin] RBAC: Adding query filter params (role.id=2d9e933a00cb40c3bb31cbfc8127f9ec, scope.project.id=c8c6fba0f15b4d6a84ff601919b7b8e4, user.id=e66e7034abed4e0bad1f4137520c1e70) {{(pid=82026) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 19:43:00.258917 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30197b20-b8f0-446a-b7db-03d4665be47a None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=82026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:43:00.260451 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30197b20-b8f0-446a-b7db-03d4665be47a None admin] RBAC: Authorization granted {{(pid=82026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:43:00.275075 dv-cinder-828806-6-smb devstack@keystone.service[82026]: [pid: 82026|app: 0|req: 517/1045] 10.222.0.33 () {56 vars in 1374 bytes} [Tue Sep 13 19:43:00 2022] GET /identity/v3/role_assignments?user.id=e66e7034abed4e0bad1f4137520c1e70&scope.project.id=c8c6fba0f15b4d6a84ff601919b7b8e4&role.id=2d9e933a00cb40c3bb31cbfc8127f9ec => generated 259 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 13 19:43:01.061926 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-972d6f4d-7e4d-4063-8bed-64687f0235ac None None] REQUEST_METHOD: `GET` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:43:01.062452 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-972d6f4d-7e4d-4063-8bed-64687f0235ac None None] SCRIPT_NAME: `/identity` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:43:01.062532 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-972d6f4d-7e4d-4063-8bed-64687f0235ac None None] PATH_INFO: `/` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:43:01.063878 dv-cinder-828806-6-smb devstack@keystone.service[82025]: [pid: 82025|app: 0|req: 529/1046] 10.222.0.33 () {54 vars in 927 bytes} [Tue Sep 13 19:43:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 19:43:01.069432 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1834b9f8-90f4-444a-a1c4-d4d165ce78d9 None None] REQUEST_METHOD: `POST` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:43:01.069851 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1834b9f8-90f4-444a-a1c4-d4d165ce78d9 None None] SCRIPT_NAME: `/identity` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:43:01.070022 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1834b9f8-90f4-444a-a1c4-d4d165ce78d9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:43:01.088545 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.auth.core [None req-1834b9f8-90f4-444a-a1c4-d4d165ce78d9 None None] MFA Rules not processed for user `57539b6a6f3b4d589f5f5e1d211cd6a0`. Rule list: `[]` (Enabled: `True`). {{(pid=82026) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 19:43:01.089731 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.common.fernet_utils [None req-1834b9f8-90f4-444a-a1c4-d4d165ce78d9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82026) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 19:43:01.142220 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG dbcounter [-] [82026] Writing DB stats keystone:SELECT=100 {{(pid=82026) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:43:01.163769 dv-cinder-828806-6-smb devstack@keystone.service[82026]: [pid: 82026|app: 0|req: 518/1047] 10.222.0.33 () {58 vars in 1024 bytes} [Tue Sep 13 19:43:01 2022] POST /identity/v3/auth/tokens => generated 1969 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 13 19:43:01.431283 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-972d6f4d-7e4d-4063-8bed-64687f0235ac None None] Authenticating user token {{(pid=82025) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:43:01.546757 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-972d6f4d-7e4d-4063-8bed-64687f0235ac None None] Validating token access rules against request {{(pid=82025) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:43:01.579428 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2676e3d-ca45-41c7-89e6-baebd499707f None None] REQUEST_METHOD: `GET` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:43:01.579830 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2676e3d-ca45-41c7-89e6-baebd499707f None None] SCRIPT_NAME: `/identity` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:43:01.580843 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2676e3d-ca45-41c7-89e6-baebd499707f None None] PATH_INFO: `/` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:43:01.582724 dv-cinder-828806-6-smb devstack@keystone.service[82026]: [pid: 82026|app: 0|req: 519/1048] 10.222.0.33 () {54 vars in 927 bytes} [Tue Sep 13 19:43:01 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 13 19:43:01.587712 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1292004-9a85-4cf2-9ae7-2a7d6a21fc43 None None] REQUEST_METHOD: `POST` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:43:01.588005 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1292004-9a85-4cf2-9ae7-2a7d6a21fc43 None None] SCRIPT_NAME: `/identity` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:43:01.588289 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1292004-9a85-4cf2-9ae7-2a7d6a21fc43 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:43:01.589166 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e0e0fef-a3ef-4aad-b2f6-676dd6e79c19 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57539b6a6f3b4d589f5f5e1d211cd6a0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82025) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:43:01.589797 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e0e0fef-a3ef-4aad-b2f6-676dd6e79c19 None admin] REQUEST_METHOD: `GET` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:43:01.590081 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e0e0fef-a3ef-4aad-b2f6-676dd6e79c19 None admin] SCRIPT_NAME: `/identity` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:43:01.590355 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e0e0fef-a3ef-4aad-b2f6-676dd6e79c19 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:43:01.598698 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG dbcounter [-] [82025] Writing DB stats keystone:SELECT=100 {{(pid=82025) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:43:01.601716 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e0e0fef-a3ef-4aad-b2f6-676dd6e79c19 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=82025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 13 19:43:01.606726 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application [None req-5e0e0fef-a3ef-4aad-b2f6-676dd6e79c19 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 13 19:43:01.606726 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 19:43:01.606726 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 19:43:01.606726 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 19:43:01.606726 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 19:43:01.606726 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 19:43:01.606726 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 19:43:01.606726 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 19:43:01.606726 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 19:43:01.606726 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 19:43:01.606726 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 19:43:01.606726 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 19:43:01.606726 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 13 19:43:01.606726 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 13 19:43:01.606726 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 13 19:43:01.606726 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 13 19:43:01.613234 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 13 19:43:01.613234 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 13 19:43:01.613234 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 13 19:43:01.613234 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 13 19:43:01.613234 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 19:43:01.613234 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 19:43:01.613234 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 19:43:01.613234 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 19:43:01.613234 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 19:43:01.613234 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 19:43:01.613234 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 19:43:01.613234 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application with Lock( Sep 13 19:43:01.613234 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 19:43:01.613234 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application return self._enter() Sep 13 19:43:01.613234 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 19:43:01.613234 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 19:43:01.614075 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 19:43:01.614075 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application return self.creator() Sep 13 19:43:01.614075 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 19:43:01.614075 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application created_value = creator( Sep 13 19:43:01.614075 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 13 19:43:01.614075 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 13 19:43:01.614075 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 13 19:43:01.614075 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 13 19:43:01.614075 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 13 19:43:01.614075 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 13 19:43:01.614075 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 13 19:43:01.614075 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application Sep 13 19:43:01.614737 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.auth.core [None req-e1292004-9a85-4cf2-9ae7-2a7d6a21fc43 None None] MFA Rules not processed for user `57539b6a6f3b4d589f5f5e1d211cd6a0`. Rule list: `[]` (Enabled: `True`). {{(pid=82026) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 19:43:01.614737 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.common.fernet_utils [None req-e1292004-9a85-4cf2-9ae7-2a7d6a21fc43 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82026) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 19:43:01.614880 dv-cinder-828806-6-smb devstack@keystone.service[82025]: [pid: 82025|app: 0|req: 530/1049] 10.222.0.33 () {56 vars in 1096 bytes} [Tue Sep 13 19:43:01 2022] GET /identity/v3/roles/admin => generated 83 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 19:43:01.614880 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e0e0fef-a3ef-4aad-b2f6-676dd6e79c19 None admin] Authenticating user token {{(pid=82025) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:43:01.685063 dv-cinder-828806-6-smb devstack@keystone.service[82026]: [pid: 82026|app: 0|req: 520/1050] 10.222.0.33 () {58 vars in 1024 bytes} [Tue Sep 13 19:43:01 2022] POST /identity/v3/auth/tokens => generated 1969 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 13 19:43:01.721572 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e0e0fef-a3ef-4aad-b2f6-676dd6e79c19 None admin] Validating token access rules against request {{(pid=82025) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:43:01.756333 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-292d0cf4-f210-4aa2-beee-1a8640f1e416 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57539b6a6f3b4d589f5f5e1d211cd6a0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82025) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:43:01.756941 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-292d0cf4-f210-4aa2-beee-1a8640f1e416 None admin] REQUEST_METHOD: `GET` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:43:01.757225 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-292d0cf4-f210-4aa2-beee-1a8640f1e416 None admin] SCRIPT_NAME: `/identity` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:43:01.757506 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-292d0cf4-f210-4aa2-beee-1a8640f1e416 None admin] PATH_INFO: `/v3/roles` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:43:01.758167 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-292d0cf4-f210-4aa2-beee-1a8640f1e416 None admin] RBAC: Adding query filter params (name=admin) {{(pid=82025) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 19:43:01.758480 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-292d0cf4-f210-4aa2-beee-1a8640f1e416 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:43:01.759885 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-292d0cf4-f210-4aa2-beee-1a8640f1e416 None admin] RBAC: Authorization granted {{(pid=82025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:43:01.773766 dv-cinder-828806-6-smb devstack@keystone.service[82025]: [pid: 82025|app: 0|req: 531/1051] 10.222.0.33 () {56 vars in 1099 bytes} [Tue Sep 13 19:43:01 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 13 19:43:01.774785 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1292004-9a85-4cf2-9ae7-2a7d6a21fc43 None None] Authenticating user token {{(pid=82026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:43:01.876930 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1292004-9a85-4cf2-9ae7-2a7d6a21fc43 None None] Validating token access rules against request {{(pid=82026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:43:01.891467 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG dbcounter [-] [82026] Writing DB stats keystone:SELECT=100 {{(pid=82026) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:43:01.915251 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82c19a7d-3dee-402e-bcd2-56e6b9b5e568 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57539b6a6f3b4d589f5f5e1d211cd6a0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:43:01.915934 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82c19a7d-3dee-402e-bcd2-56e6b9b5e568 None admin] REQUEST_METHOD: `GET` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:43:01.916220 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82c19a7d-3dee-402e-bcd2-56e6b9b5e568 None admin] SCRIPT_NAME: `/identity` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:43:01.916495 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82c19a7d-3dee-402e-bcd2-56e6b9b5e568 None admin] PATH_INFO: `/v3/users/fc4033db6dcf429aa7b1c2a543358fe5` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:43:01.931189 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82c19a7d-3dee-402e-bcd2-56e6b9b5e568 None admin] RBAC: Authorizing `identity:get_user(user_id=fc4033db6dcf429aa7b1c2a543358fe5)` {{(pid=82026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:43:01.932644 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82c19a7d-3dee-402e-bcd2-56e6b9b5e568 None admin] RBAC: Authorization granted {{(pid=82026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:43:01.939221 dv-cinder-828806-6-smb devstack@keystone.service[82026]: [pid: 82026|app: 0|req: 521/1052] 10.222.0.33 () {56 vars in 1177 bytes} [Tue Sep 13 19:43:01 2022] GET /identity/v3/users/fc4033db6dcf429aa7b1c2a543358fe5 => generated 285 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 13 19:43:01.940117 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-292d0cf4-f210-4aa2-beee-1a8640f1e416 None admin] Authenticating user token {{(pid=82025) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:43:01.970021 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82c19a7d-3dee-402e-bcd2-56e6b9b5e568 None admin] Authenticating user token {{(pid=82026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:43:02.007691 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG dbcounter [-] [82025] Writing DB stats keystone:SELECT=100 {{(pid=82025) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:43:02.049952 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-292d0cf4-f210-4aa2-beee-1a8640f1e416 None admin] Validating token access rules against request {{(pid=82025) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:43:02.082346 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82c19a7d-3dee-402e-bcd2-56e6b9b5e568 None admin] Validating token access rules against request {{(pid=82026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:43:02.085569 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5460ed9d-a9b5-4b31-ac2d-98e5cc7aea2d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57539b6a6f3b4d589f5f5e1d211cd6a0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82025) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:43:02.086175 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5460ed9d-a9b5-4b31-ac2d-98e5cc7aea2d None admin] REQUEST_METHOD: `GET` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:43:02.086453 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5460ed9d-a9b5-4b31-ac2d-98e5cc7aea2d None admin] SCRIPT_NAME: `/identity` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:43:02.086726 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5460ed9d-a9b5-4b31-ac2d-98e5cc7aea2d None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:43:02.120566 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7029f420-d1e4-45ca-bfc6-6160bfb56c9b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57539b6a6f3b4d589f5f5e1d211cd6a0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:43:02.121200 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7029f420-d1e4-45ca-bfc6-6160bfb56c9b None admin] REQUEST_METHOD: `GET` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:43:02.121491 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7029f420-d1e4-45ca-bfc6-6160bfb56c9b None admin] SCRIPT_NAME: `/identity` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:43:02.121936 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7029f420-d1e4-45ca-bfc6-6160bfb56c9b None admin] PATH_INFO: `/v3/services/image` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:43:02.123203 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7029f420-d1e4-45ca-bfc6-6160bfb56c9b None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=82026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:43:02.124768 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7029f420-d1e4-45ca-bfc6-6160bfb56c9b None admin] RBAC: Authorization granted {{(pid=82026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:43:02.133982 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application [None req-7029f420-d1e4-45ca-bfc6-6160bfb56c9b None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Sep 13 19:43:02.133982 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 19:43:02.133982 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 13 19:43:02.133982 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 13 19:43:02.133982 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 13 19:43:02.133982 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 13 19:43:02.133982 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 13 19:43:02.133982 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 13 19:43:02.133982 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Sep 13 19:43:02.133982 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application Sep 13 19:43:02.133982 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 13 19:43:02.133982 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application Sep 13 19:43:02.133982 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 19:43:02.133982 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 19:43:02.133982 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 19:43:02.133982 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 19:43:02.133982 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 19:43:02.135080 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 19:43:02.135080 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 19:43:02.135080 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 19:43:02.135080 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 19:43:02.135080 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 19:43:02.135080 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 19:43:02.135080 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 13 19:43:02.135080 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 13 19:43:02.135080 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 13 19:43:02.135080 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 13 19:43:02.135080 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 19:43:02.135080 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 19:43:02.135080 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 19:43:02.135080 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 19:43:02.135080 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 19:43:02.135080 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 19:43:02.135972 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 19:43:02.135972 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application with Lock( Sep 13 19:43:02.135972 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 19:43:02.135972 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application return self._enter() Sep 13 19:43:02.135972 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 19:43:02.135972 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 19:43:02.135972 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 19:43:02.135972 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application return self.creator() Sep 13 19:43:02.135972 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 19:43:02.135972 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application created_value = creator( Sep 13 19:43:02.135972 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 13 19:43:02.135972 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 13 19:43:02.135972 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Sep 13 19:43:02.135972 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application Sep 13 19:43:02.140096 dv-cinder-828806-6-smb devstack@keystone.service[82026]: [pid: 82026|app: 0|req: 522/1053] 10.222.0.33 () {56 vars in 1105 bytes} [Tue Sep 13 19:43:01 2022] GET /identity/v3/services/image => generated 86 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 13 19:43:02.140820 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7029f420-d1e4-45ca-bfc6-6160bfb56c9b None admin] Authenticating user token {{(pid=82026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:43:02.161173 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5460ed9d-a9b5-4b31-ac2d-98e5cc7aea2d None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=82025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:43:02.163763 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5460ed9d-a9b5-4b31-ac2d-98e5cc7aea2d None admin] RBAC: Authorization granted {{(pid=82025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:43:02.180183 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG dbcounter [-] [82026] Writing DB stats keystone:SELECT=100 {{(pid=82026) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:43:02.243576 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG dbcounter [-] [82025] Writing DB stats keystone:SELECT=100 {{(pid=82025) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:43:02.253775 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7029f420-d1e4-45ca-bfc6-6160bfb56c9b None admin] Validating token access rules against request {{(pid=82026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:43:02.287371 dv-cinder-828806-6-smb devstack@keystone.service[82025]: [pid: 82025|app: 0|req: 532/1054] 10.222.0.33 () {58 vars in 1282 bytes} [Tue Sep 13 19:43:01 2022] GET /identity/v3/auth/tokens => generated 1969 bytes in 347 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Sep 13 19:43:02.293022 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5460ed9d-a9b5-4b31-ac2d-98e5cc7aea2d None admin] Authenticating user token {{(pid=82025) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:43:02.300789 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a945ec7-dcdc-4512-a6d6-bd0fca606035 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57539b6a6f3b4d589f5f5e1d211cd6a0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:43:02.301423 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a945ec7-dcdc-4512-a6d6-bd0fca606035 None admin] REQUEST_METHOD: `GET` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:43:02.301711 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a945ec7-dcdc-4512-a6d6-bd0fca606035 None admin] SCRIPT_NAME: `/identity` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:43:02.301991 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a945ec7-dcdc-4512-a6d6-bd0fca606035 None admin] PATH_INFO: `/v3/services` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:43:02.302654 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a945ec7-dcdc-4512-a6d6-bd0fca606035 None admin] RBAC: Adding query filter params (name=image) {{(pid=82026) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 19:43:02.302962 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a945ec7-dcdc-4512-a6d6-bd0fca606035 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=82026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:43:02.304450 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a945ec7-dcdc-4512-a6d6-bd0fca606035 None admin] RBAC: Authorization granted {{(pid=82026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:43:02.310477 dv-cinder-828806-6-smb devstack@keystone.service[82026]: [pid: 82026|app: 0|req: 523/1055] 10.222.0.33 () {56 vars in 1108 bytes} [Tue Sep 13 19:43:02 2022] GET /identity/v3/services?name=image => generated 122 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 13 19:43:02.316070 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a945ec7-dcdc-4512-a6d6-bd0fca606035 None admin] Authenticating user token {{(pid=82026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:43:02.412137 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5460ed9d-a9b5-4b31-ac2d-98e5cc7aea2d None admin] Validating token access rules against request {{(pid=82025) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:43:02.419266 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG dbcounter [-] [82026] Writing DB stats keystone:SELECT=100 {{(pid=82026) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:43:02.423008 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a945ec7-dcdc-4512-a6d6-bd0fca606035 None admin] Validating token access rules against request {{(pid=82026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:43:02.446769 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-141bb49b-6476-478b-b6dd-a965dc6cb0b7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57539b6a6f3b4d589f5f5e1d211cd6a0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82025) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:43:02.447452 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-141bb49b-6476-478b-b6dd-a965dc6cb0b7 None admin] REQUEST_METHOD: `GET` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:43:02.447735 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-141bb49b-6476-478b-b6dd-a965dc6cb0b7 None admin] SCRIPT_NAME: `/identity` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:43:02.448077 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-141bb49b-6476-478b-b6dd-a965dc6cb0b7 None admin] PATH_INFO: `/v3/projects/024b16f822e545dca8d1e8e3cc6f0f2c` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:43:02.449123 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-141bb49b-6476-478b-b6dd-a965dc6cb0b7 None admin] RBAC: Authorizing `identity:get_project(project_id=024b16f822e545dca8d1e8e3cc6f0f2c)` {{(pid=82025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:43:02.450552 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-141bb49b-6476-478b-b6dd-a965dc6cb0b7 None admin] RBAC: Authorization granted {{(pid=82025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:43:02.452207 dv-cinder-828806-6-smb devstack@keystone.service[82025]: [pid: 82025|app: 0|req: 533/1056] 10.222.0.33 () {56 vars in 1186 bytes} [Tue Sep 13 19:43:02 2022] GET /identity/v3/projects/024b16f822e545dca8d1e8e3cc6f0f2c => generated 311 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 13 19:43:02.453392 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d68c67f1-db8e-4301-b0f4-7a4bc4fb957a None None] REQUEST_METHOD: `GET` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:43:02.453680 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d68c67f1-db8e-4301-b0f4-7a4bc4fb957a None None] SCRIPT_NAME: `/identity` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:43:02.453984 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d68c67f1-db8e-4301-b0f4-7a4bc4fb957a None None] PATH_INFO: `/` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:43:02.455789 dv-cinder-828806-6-smb devstack@keystone.service[82025]: [pid: 82025|app: 0|req: 534/1057] 10.222.0.33 () {54 vars in 927 bytes} [Tue Sep 13 19:43:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 19:43:02.460077 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d68c67f1-db8e-4301-b0f4-7a4bc4fb957a None None] Authenticating user token {{(pid=82025) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:43:02.461531 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-585fbfdf-1f3c-4e45-8e78-87819e08c762 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57539b6a6f3b4d589f5f5e1d211cd6a0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:43:02.462153 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-585fbfdf-1f3c-4e45-8e78-87819e08c762 None admin] REQUEST_METHOD: `GET` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:43:02.462442 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-585fbfdf-1f3c-4e45-8e78-87819e08c762 None admin] SCRIPT_NAME: `/identity` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:43:02.462724 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-585fbfdf-1f3c-4e45-8e78-87819e08c762 None admin] PATH_INFO: `/v3/services` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:43:02.463394 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-585fbfdf-1f3c-4e45-8e78-87819e08c762 None admin] RBAC: Adding query filter params (type=image) {{(pid=82026) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 19:43:02.463709 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-585fbfdf-1f3c-4e45-8e78-87819e08c762 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=82026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:43:02.465075 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-585fbfdf-1f3c-4e45-8e78-87819e08c762 None admin] RBAC: Authorization granted {{(pid=82026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:43:02.470025 dv-cinder-828806-6-smb devstack@keystone.service[82026]: [pid: 82026|app: 0|req: 524/1058] 10.222.0.33 () {56 vars in 1108 bytes} [Tue Sep 13 19:43:02 2022] GET /identity/v3/services?type=image => generated 350 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 13 19:43:02.471848 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7106b101-b508-4427-92a8-c824f138e68d None None] REQUEST_METHOD: `POST` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:43:02.472137 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7106b101-b508-4427-92a8-c824f138e68d None None] SCRIPT_NAME: `/identity` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:43:02.472418 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7106b101-b508-4427-92a8-c824f138e68d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:43:02.489827 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.auth.core [None req-7106b101-b508-4427-92a8-c824f138e68d None None] MFA Rules not processed for user `57539b6a6f3b4d589f5f5e1d211cd6a0`. Rule list: `[]` (Enabled: `True`). {{(pid=82026) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 19:43:02.491028 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.common.fernet_utils [None req-7106b101-b508-4427-92a8-c824f138e68d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82026) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 19:43:02.491172 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG dbcounter [-] [82025] Writing DB stats keystone:SELECT=100 {{(pid=82025) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:43:02.558537 dv-cinder-828806-6-smb devstack@keystone.service[82026]: [pid: 82026|app: 0|req: 525/1059] 10.222.0.33 () {58 vars in 1024 bytes} [Tue Sep 13 19:43:02 2022] POST /identity/v3/auth/tokens => generated 1969 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 13 19:43:02.559417 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7106b101-b508-4427-92a8-c824f138e68d None None] Authenticating user token {{(pid=82026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:43:02.571305 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d68c67f1-db8e-4301-b0f4-7a4bc4fb957a None None] Validating token access rules against request {{(pid=82025) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:43:02.606282 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6157535-208a-466a-a89f-c22fd2ec9596 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57539b6a6f3b4d589f5f5e1d211cd6a0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82025) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:43:02.607184 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6157535-208a-466a-a89f-c22fd2ec9596 None admin] REQUEST_METHOD: `GET` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:43:02.607462 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6157535-208a-466a-a89f-c22fd2ec9596 None admin] SCRIPT_NAME: `/identity` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:43:02.607732 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6157535-208a-466a-a89f-c22fd2ec9596 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:43:02.608442 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6157535-208a-466a-a89f-c22fd2ec9596 None admin] RBAC: Adding query filter params (role.id=e5af7d5baa93469e9e486ef21c85474e, scope.project.id=024b16f822e545dca8d1e8e3cc6f0f2c, user.id=fc4033db6dcf429aa7b1c2a543358fe5) {{(pid=82025) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 19:43:02.608750 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6157535-208a-466a-a89f-c22fd2ec9596 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=82025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:43:02.610158 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6157535-208a-466a-a89f-c22fd2ec9596 None admin] RBAC: Authorization granted {{(pid=82025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:43:02.616197 dv-cinder-828806-6-smb devstack@keystone.service[82025]: [pid: 82025|app: 0|req: 535/1060] 10.222.0.33 () {56 vars in 1374 bytes} [Tue Sep 13 19:43:02 2022] GET /identity/v3/role_assignments?user.id=fc4033db6dcf429aa7b1c2a543358fe5&scope.project.id=024b16f822e545dca8d1e8e3cc6f0f2c&role.id=e5af7d5baa93469e9e486ef21c85474e => generated 259 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 13 19:43:02.678440 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG dbcounter [-] [82026] Writing DB stats keystone:SELECT=100 {{(pid=82026) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:43:02.688431 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7106b101-b508-4427-92a8-c824f138e68d None None] Validating token access rules against request {{(pid=82026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:43:02.727171 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f226b644-a6b8-47a6-b3e7-aad92efea241 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57539b6a6f3b4d589f5f5e1d211cd6a0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:43:02.727800 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f226b644-a6b8-47a6-b3e7-aad92efea241 None admin] REQUEST_METHOD: `POST` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:43:02.728081 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f226b644-a6b8-47a6-b3e7-aad92efea241 None admin] SCRIPT_NAME: `/identity` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:43:02.728357 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f226b644-a6b8-47a6-b3e7-aad92efea241 None admin] PATH_INFO: `/v3/endpoints` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:43:02.729052 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f226b644-a6b8-47a6-b3e7-aad92efea241 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=82026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:43:02.730445 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f226b644-a6b8-47a6-b3e7-aad92efea241 None admin] RBAC: Authorization granted {{(pid=82026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:43:02.801953 dv-cinder-828806-6-smb devstack@keystone.service[82026]: [pid: 82026|app: 0|req: 526/1061] 10.222.0.33 () {60 vars in 1144 bytes} [Tue Sep 13 19:43:02 2022] POST /identity/v3/endpoints => generated 327 bytes in 243 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 13 19:43:02.831003 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6157535-208a-466a-a89f-c22fd2ec9596 None admin] Authenticating user token {{(pid=82025) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:43:02.942864 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG dbcounter [-] [82025] Writing DB stats keystone:SELECT=100 {{(pid=82025) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:43:02.950585 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6157535-208a-466a-a89f-c22fd2ec9596 None admin] Validating token access rules against request {{(pid=82025) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:43:02.994891 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b75f8b9-e7d3-4723-a39d-75d5be47ee1c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57539b6a6f3b4d589f5f5e1d211cd6a0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82025) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:43:02.995570 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b75f8b9-e7d3-4723-a39d-75d5be47ee1c None admin] REQUEST_METHOD: `GET` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:43:02.995856 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b75f8b9-e7d3-4723-a39d-75d5be47ee1c None admin] SCRIPT_NAME: `/identity` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:43:02.996131 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b75f8b9-e7d3-4723-a39d-75d5be47ee1c None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:43:03.006666 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b75f8b9-e7d3-4723-a39d-75d5be47ee1c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=82025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 13 19:43:03.011540 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application [None req-4b75f8b9-e7d3-4723-a39d-75d5be47ee1c None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Sep 13 19:43:03.011540 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 19:43:03.011540 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 19:43:03.011540 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 19:43:03.011540 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 19:43:03.011540 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 19:43:03.011540 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 19:43:03.011540 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 19:43:03.011540 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 19:43:03.011540 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 19:43:03.011540 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 19:43:03.011540 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 19:43:03.011540 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 13 19:43:03.011540 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 13 19:43:03.011540 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 13 19:43:03.011540 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 13 19:43:03.012465 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 13 19:43:03.012465 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 13 19:43:03.012465 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 13 19:43:03.012465 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 13 19:43:03.012465 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 19:43:03.012465 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 19:43:03.012465 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 19:43:03.012465 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 19:43:03.012465 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 19:43:03.012465 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 19:43:03.012465 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 19:43:03.012465 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application with Lock( Sep 13 19:43:03.012465 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 19:43:03.012465 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application return self._enter() Sep 13 19:43:03.012465 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 19:43:03.012465 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 19:43:03.013345 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 19:43:03.013345 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application return self.creator() Sep 13 19:43:03.013345 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 19:43:03.013345 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application created_value = creator( Sep 13 19:43:03.013345 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 13 19:43:03.013345 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 13 19:43:03.013345 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 13 19:43:03.013345 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 13 19:43:03.013345 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 13 19:43:03.013345 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 13 19:43:03.013345 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Sep 13 19:43:03.013345 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application Sep 13 19:43:03.013345 dv-cinder-828806-6-smb devstack@keystone.service[82025]: [pid: 82025|app: 0|req: 536/1062] 10.222.0.33 () {56 vars in 1120 bytes} [Tue Sep 13 19:43:02 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 19:43:03.019298 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f226b644-a6b8-47a6-b3e7-aad92efea241 None admin] Authenticating user token {{(pid=82026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:43:03.125352 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f226b644-a6b8-47a6-b3e7-aad92efea241 None admin] Validating token access rules against request {{(pid=82026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:43:03.159725 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67f4f9cb-2f46-4c1f-8c37-a91edddb85b3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57539b6a6f3b4d589f5f5e1d211cd6a0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:43:03.160334 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67f4f9cb-2f46-4c1f-8c37-a91edddb85b3 None admin] REQUEST_METHOD: `GET` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:43:03.160620 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67f4f9cb-2f46-4c1f-8c37-a91edddb85b3 None admin] SCRIPT_NAME: `/identity` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:43:03.160893 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67f4f9cb-2f46-4c1f-8c37-a91edddb85b3 None admin] PATH_INFO: `/v3/roles` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:43:03.161816 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67f4f9cb-2f46-4c1f-8c37-a91edddb85b3 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=82026) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 19:43:03.162122 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67f4f9cb-2f46-4c1f-8c37-a91edddb85b3 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:43:03.163519 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67f4f9cb-2f46-4c1f-8c37-a91edddb85b3 None admin] RBAC: Authorization granted {{(pid=82026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:43:03.176393 dv-cinder-828806-6-smb devstack@keystone.service[82026]: [pid: 82026|app: 0|req: 527/1063] 10.222.0.33 () {56 vars in 1115 bytes} [Tue Sep 13 19:43:03 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 19:43:03.177899 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b75f8b9-e7d3-4723-a39d-75d5be47ee1c None admin] Authenticating user token {{(pid=82025) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:43:03.285086 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b75f8b9-e7d3-4723-a39d-75d5be47ee1c None admin] Validating token access rules against request {{(pid=82025) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:43:03.321419 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8d8619a-146a-4cf5-af63-9305e313ed9d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57539b6a6f3b4d589f5f5e1d211cd6a0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82025) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:43:03.322065 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8d8619a-146a-4cf5-af63-9305e313ed9d None admin] REQUEST_METHOD: `GET` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:43:03.322413 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8d8619a-146a-4cf5-af63-9305e313ed9d None admin] SCRIPT_NAME: `/identity` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:43:03.322695 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8d8619a-146a-4cf5-af63-9305e313ed9d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:43:03.334408 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8d8619a-146a-4cf5-af63-9305e313ed9d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=82025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:43:03.335901 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8d8619a-146a-4cf5-af63-9305e313ed9d None admin] RBAC: Authorization granted {{(pid=82025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:43:03.351169 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application [None req-b8d8619a-146a-4cf5-af63-9305e313ed9d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 13 19:43:03.351169 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 19:43:03.351169 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 19:43:03.351169 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 19:43:03.351169 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 19:43:03.351169 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 19:43:03.351169 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 19:43:03.351169 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 19:43:03.351169 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 19:43:03.351169 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 19:43:03.351169 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 19:43:03.351169 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 19:43:03.351169 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 13 19:43:03.351169 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 13 19:43:03.351169 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 13 19:43:03.351169 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 13 19:43:03.352145 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 19:43:03.352145 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 19:43:03.352145 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 19:43:03.352145 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 19:43:03.352145 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 19:43:03.352145 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 19:43:03.352145 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 19:43:03.352145 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application with Lock( Sep 13 19:43:03.352145 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 19:43:03.352145 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application return self._enter() Sep 13 19:43:03.352145 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 19:43:03.352145 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 19:43:03.352145 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 19:43:03.352145 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application return self.creator() Sep 13 19:43:03.352145 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 19:43:03.352145 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application created_value = creator( Sep 13 19:43:03.352145 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 13 19:43:03.353077 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 13 19:43:03.353077 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 13 19:43:03.353077 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application Sep 13 19:43:03.353077 dv-cinder-828806-6-smb devstack@keystone.service[82025]: [pid: 82025|app: 0|req: 537/1064] 10.222.0.33 () {56 vars in 1108 bytes} [Tue Sep 13 19:43:03 2022] GET /identity/v3/domains/Default => generated 87 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 13 19:43:03.358969 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67f4f9cb-2f46-4c1f-8c37-a91edddb85b3 None admin] Authenticating user token {{(pid=82026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:43:03.373689 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG dbcounter [-] [82026] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82026) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:43:03.466552 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67f4f9cb-2f46-4c1f-8c37-a91edddb85b3 None admin] Validating token access rules against request {{(pid=82026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:43:03.502005 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75a8ca41-3939-455d-8226-f56fdeaab1fd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57539b6a6f3b4d589f5f5e1d211cd6a0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:43:03.503272 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75a8ca41-3939-455d-8226-f56fdeaab1fd None admin] REQUEST_METHOD: `GET` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:43:03.503717 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75a8ca41-3939-455d-8226-f56fdeaab1fd None admin] SCRIPT_NAME: `/identity` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:43:03.504000 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75a8ca41-3939-455d-8226-f56fdeaab1fd None admin] PATH_INFO: `/v3/domains` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:43:03.504745 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75a8ca41-3939-455d-8226-f56fdeaab1fd None admin] RBAC: Adding query filter params (name=Default) {{(pid=82026) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 19:43:03.505054 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75a8ca41-3939-455d-8226-f56fdeaab1fd None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:43:03.506468 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75a8ca41-3939-455d-8226-f56fdeaab1fd None admin] RBAC: Authorization granted {{(pid=82026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:43:03.519603 dv-cinder-828806-6-smb devstack@keystone.service[82026]: [pid: 82026|app: 0|req: 528/1065] 10.222.0.33 () {56 vars in 1109 bytes} [Tue Sep 13 19:43:03 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 13 19:43:03.524984 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8d8619a-146a-4cf5-af63-9305e313ed9d None admin] Authenticating user token {{(pid=82025) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:43:03.527911 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG dbcounter [-] [82025] Writing DB stats keystone:SELECT=100 {{(pid=82025) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:43:03.629685 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8d8619a-146a-4cf5-af63-9305e313ed9d None admin] Validating token access rules against request {{(pid=82025) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:43:03.663295 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-194bb2a9-4ca6-4cf3-a46a-079977745982 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57539b6a6f3b4d589f5f5e1d211cd6a0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82025) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:43:03.663926 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-194bb2a9-4ca6-4cf3-a46a-079977745982 None admin] REQUEST_METHOD: `GET` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:43:03.664207 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-194bb2a9-4ca6-4cf3-a46a-079977745982 None admin] SCRIPT_NAME: `/identity` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:43:03.664482 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-194bb2a9-4ca6-4cf3-a46a-079977745982 None admin] PATH_INFO: `/v3/users/nova` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:43:03.671883 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-194bb2a9-4ca6-4cf3-a46a-079977745982 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=82025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:43:03.673303 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-194bb2a9-4ca6-4cf3-a46a-079977745982 None admin] RBAC: Authorization granted {{(pid=82025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:43:03.684532 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application [None req-194bb2a9-4ca6-4cf3-a46a-079977745982 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Sep 13 19:43:03.684532 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 19:43:03.684532 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 19:43:03.684532 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 19:43:03.684532 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 19:43:03.684532 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 19:43:03.684532 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 19:43:03.684532 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 19:43:03.684532 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 19:43:03.684532 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 19:43:03.684532 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 19:43:03.684532 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 19:43:03.684532 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 13 19:43:03.684532 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 13 19:43:03.684532 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 13 19:43:03.684532 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 13 19:43:03.685479 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 19:43:03.685479 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 19:43:03.685479 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 13 19:43:03.685479 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 13 19:43:03.685479 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 13 19:43:03.685479 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 13 19:43:03.685479 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 19:43:03.685479 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 19:43:03.685479 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 19:43:03.685479 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 19:43:03.685479 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 19:43:03.685479 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application with Lock( Sep 13 19:43:03.685479 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 19:43:03.685479 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application return self._enter() Sep 13 19:43:03.685479 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 19:43:03.685479 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 19:43:03.685479 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 19:43:03.685479 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application return self.creator() Sep 13 19:43:03.686549 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 19:43:03.686549 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application created_value = creator( Sep 13 19:43:03.686549 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 13 19:43:03.686549 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 13 19:43:03.686549 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 13 19:43:03.686549 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 13 19:43:03.686549 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 13 19:43:03.686549 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 13 19:43:03.686549 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Sep 13 19:43:03.686549 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application Sep 13 19:43:03.687766 dv-cinder-828806-6-smb devstack@keystone.service[82025]: [pid: 82025|app: 0|req: 538/1066] 10.222.0.33 () {56 vars in 1093 bytes} [Tue Sep 13 19:43:03 2022] GET /identity/v3/users/nova => generated 82 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 19:43:03.692278 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75a8ca41-3939-455d-8226-f56fdeaab1fd None admin] Authenticating user token {{(pid=82026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:43:03.763506 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG dbcounter [-] [82026] Writing DB stats keystone:SELECT=100 {{(pid=82026) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:43:03.796480 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75a8ca41-3939-455d-8226-f56fdeaab1fd None admin] Validating token access rules against request {{(pid=82026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:43:03.829838 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84abf19e-052f-4584-a7dd-35d7eb0349b6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57539b6a6f3b4d589f5f5e1d211cd6a0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:43:03.830577 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84abf19e-052f-4584-a7dd-35d7eb0349b6 None admin] REQUEST_METHOD: `GET` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:43:03.830860 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84abf19e-052f-4584-a7dd-35d7eb0349b6 None admin] SCRIPT_NAME: `/identity` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:43:03.831163 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84abf19e-052f-4584-a7dd-35d7eb0349b6 None admin] PATH_INFO: `/v3/users` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:43:03.831886 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84abf19e-052f-4584-a7dd-35d7eb0349b6 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=82026) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 19:43:03.832193 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84abf19e-052f-4584-a7dd-35d7eb0349b6 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=82026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:43:03.833613 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84abf19e-052f-4584-a7dd-35d7eb0349b6 None admin] RBAC: Authorization granted {{(pid=82026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:43:03.855093 dv-cinder-828806-6-smb devstack@keystone.service[82026]: [pid: 82026|app: 0|req: 529/1067] 10.222.0.33 () {56 vars in 1133 bytes} [Tue Sep 13 19:43:03 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 19:43:03.858333 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-194bb2a9-4ca6-4cf3-a46a-079977745982 None admin] Authenticating user token {{(pid=82025) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:43:03.969563 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG dbcounter [-] [82025] Writing DB stats keystone:SELECT=100 {{(pid=82025) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:43:04.011250 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-194bb2a9-4ca6-4cf3-a46a-079977745982 None admin] Validating token access rules against request {{(pid=82025) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:43:04.046553 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c038af5-9971-44dc-af79-fc113c800a23 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57539b6a6f3b4d589f5f5e1d211cd6a0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82025) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:43:04.047523 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c038af5-9971-44dc-af79-fc113c800a23 None admin] REQUEST_METHOD: `GET` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:43:04.048021 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c038af5-9971-44dc-af79-fc113c800a23 None admin] SCRIPT_NAME: `/identity` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:43:04.048510 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c038af5-9971-44dc-af79-fc113c800a23 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:43:04.060325 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c038af5-9971-44dc-af79-fc113c800a23 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=82025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:43:04.062037 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c038af5-9971-44dc-af79-fc113c800a23 None admin] RBAC: Authorization granted {{(pid=82025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:43:04.076856 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application [None req-7c038af5-9971-44dc-af79-fc113c800a23 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 13 19:43:04.076856 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 19:43:04.076856 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 19:43:04.076856 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 19:43:04.076856 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 19:43:04.076856 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 19:43:04.076856 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 19:43:04.076856 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 19:43:04.076856 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 19:43:04.076856 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 19:43:04.076856 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 19:43:04.076856 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 19:43:04.076856 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 13 19:43:04.076856 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 13 19:43:04.076856 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 13 19:43:04.076856 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 13 19:43:04.077802 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 19:43:04.077802 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 19:43:04.077802 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 19:43:04.077802 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 19:43:04.077802 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 19:43:04.077802 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 19:43:04.077802 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 19:43:04.077802 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application with Lock( Sep 13 19:43:04.077802 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 19:43:04.077802 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application return self._enter() Sep 13 19:43:04.077802 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 19:43:04.077802 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 19:43:04.077802 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 19:43:04.077802 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application return self.creator() Sep 13 19:43:04.077802 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 19:43:04.077802 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application created_value = creator( Sep 13 19:43:04.077802 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 13 19:43:04.078695 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 13 19:43:04.078695 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 13 19:43:04.078695 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application Sep 13 19:43:04.084952 dv-cinder-828806-6-smb devstack@keystone.service[82025]: [pid: 82025|app: 0|req: 539/1068] 10.222.0.33 () {56 vars in 1108 bytes} [Tue Sep 13 19:43:03 2022] GET /identity/v3/domains/Default => generated 87 bytes in 223 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 19:43:04.086099 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84abf19e-052f-4584-a7dd-35d7eb0349b6 None admin] Authenticating user token {{(pid=82026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:43:04.189373 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84abf19e-052f-4584-a7dd-35d7eb0349b6 None admin] Validating token access rules against request {{(pid=82026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:43:04.218272 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG dbcounter [-] [82026] Writing DB stats keystone:SELECT=100 {{(pid=82026) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:43:04.227608 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8326373f-ee14-4f78-b1cc-9ffd5a1e8a7a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57539b6a6f3b4d589f5f5e1d211cd6a0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:43:04.228276 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8326373f-ee14-4f78-b1cc-9ffd5a1e8a7a None admin] REQUEST_METHOD: `GET` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:43:04.228552 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8326373f-ee14-4f78-b1cc-9ffd5a1e8a7a None admin] SCRIPT_NAME: `/identity` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:43:04.228758 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8326373f-ee14-4f78-b1cc-9ffd5a1e8a7a None admin] PATH_INFO: `/v3/domains` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:43:04.229394 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8326373f-ee14-4f78-b1cc-9ffd5a1e8a7a None admin] RBAC: Adding query filter params (name=Default) {{(pid=82026) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 19:43:04.229692 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8326373f-ee14-4f78-b1cc-9ffd5a1e8a7a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:43:04.231070 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8326373f-ee14-4f78-b1cc-9ffd5a1e8a7a None admin] RBAC: Authorization granted {{(pid=82026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:43:04.246272 dv-cinder-828806-6-smb devstack@keystone.service[82026]: [pid: 82026|app: 0|req: 530/1069] 10.222.0.33 () {56 vars in 1109 bytes} [Tue Sep 13 19:43:04 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 13 19:43:04.252584 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c038af5-9971-44dc-af79-fc113c800a23 None admin] Authenticating user token {{(pid=82025) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:43:04.365948 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c038af5-9971-44dc-af79-fc113c800a23 None admin] Validating token access rules against request {{(pid=82025) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:43:04.380362 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG dbcounter [-] [82025] Writing DB stats keystone:SELECT=100 {{(pid=82025) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:43:04.401578 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61952b7f-2a59-4e7d-b3a3-77de470cbf3c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57539b6a6f3b4d589f5f5e1d211cd6a0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82025) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:43:04.402212 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61952b7f-2a59-4e7d-b3a3-77de470cbf3c None admin] REQUEST_METHOD: `GET` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:43:04.402498 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61952b7f-2a59-4e7d-b3a3-77de470cbf3c None admin] SCRIPT_NAME: `/identity` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:43:04.402772 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61952b7f-2a59-4e7d-b3a3-77de470cbf3c None admin] PATH_INFO: `/v3/projects/service` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:43:04.410110 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61952b7f-2a59-4e7d-b3a3-77de470cbf3c None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=82025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:43:04.412074 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61952b7f-2a59-4e7d-b3a3-77de470cbf3c None admin] RBAC: Authorization granted {{(pid=82025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:43:04.425384 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application [None req-61952b7f-2a59-4e7d-b3a3-77de470cbf3c None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 13 19:43:04.425384 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 19:43:04.425384 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 19:43:04.425384 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 19:43:04.425384 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 19:43:04.425384 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 19:43:04.425384 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 19:43:04.425384 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 19:43:04.425384 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 19:43:04.425384 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 19:43:04.425384 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 19:43:04.425384 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 19:43:04.425384 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 13 19:43:04.425384 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 13 19:43:04.425384 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 13 19:43:04.426302 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 13 19:43:04.426302 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 19:43:04.426302 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 19:43:04.426302 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 19:43:04.426302 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 19:43:04.426302 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 19:43:04.426302 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 19:43:04.426302 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 19:43:04.426302 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application with Lock( Sep 13 19:43:04.426302 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 19:43:04.426302 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application return self._enter() Sep 13 19:43:04.426302 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 19:43:04.426302 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 19:43:04.426302 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 19:43:04.426302 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application return self.creator() Sep 13 19:43:04.426302 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 19:43:04.426302 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application created_value = creator( Sep 13 19:43:04.432013 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 13 19:43:04.432013 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 13 19:43:04.432013 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 13 19:43:04.432013 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 13 19:43:04.432013 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 13 19:43:04.432013 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 13 19:43:04.432013 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 13 19:43:04.432013 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application Sep 13 19:43:04.432013 dv-cinder-828806-6-smb devstack@keystone.service[82025]: [pid: 82025|app: 0|req: 540/1070] 10.222.0.33 () {56 vars in 1111 bytes} [Tue Sep 13 19:43:04 2022] GET /identity/v3/projects/service => generated 88 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 13 19:43:04.434013 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8326373f-ee14-4f78-b1cc-9ffd5a1e8a7a None admin] Authenticating user token {{(pid=82026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:43:04.538476 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8326373f-ee14-4f78-b1cc-9ffd5a1e8a7a None admin] Validating token access rules against request {{(pid=82026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:43:04.573344 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c97c3c9-9b4c-447c-8696-d627c54af953 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57539b6a6f3b4d589f5f5e1d211cd6a0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:43:04.573960 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c97c3c9-9b4c-447c-8696-d627c54af953 None admin] REQUEST_METHOD: `GET` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:43:04.574249 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c97c3c9-9b4c-447c-8696-d627c54af953 None admin] SCRIPT_NAME: `/identity` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:43:04.574531 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c97c3c9-9b4c-447c-8696-d627c54af953 None admin] PATH_INFO: `/v3/projects` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:43:04.575255 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c97c3c9-9b4c-447c-8696-d627c54af953 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=82026) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 19:43:04.575571 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c97c3c9-9b4c-447c-8696-d627c54af953 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=82026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:43:04.577010 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c97c3c9-9b4c-447c-8696-d627c54af953 None admin] RBAC: Authorization granted {{(pid=82026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:43:04.594033 dv-cinder-828806-6-smb devstack@keystone.service[82026]: [pid: 82026|app: 0|req: 531/1071] 10.222.0.33 () {56 vars in 1148 bytes} [Tue Sep 13 19:43:04 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 19:43:04.596362 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61952b7f-2a59-4e7d-b3a3-77de470cbf3c None admin] Authenticating user token {{(pid=82025) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:43:04.700385 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61952b7f-2a59-4e7d-b3a3-77de470cbf3c None admin] Validating token access rules against request {{(pid=82025) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:43:04.739001 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb1006ec-ba86-4fec-8f95-be7491a903f3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57539b6a6f3b4d589f5f5e1d211cd6a0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82025) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:43:04.739697 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb1006ec-ba86-4fec-8f95-be7491a903f3 None admin] REQUEST_METHOD: `PUT` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:43:04.739981 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb1006ec-ba86-4fec-8f95-be7491a903f3 None admin] SCRIPT_NAME: `/identity` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:43:04.740259 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb1006ec-ba86-4fec-8f95-be7491a903f3 None admin] PATH_INFO: `/v3/projects/c8c6fba0f15b4d6a84ff601919b7b8e4/users/e66e7034abed4e0bad1f4137520c1e70/roles/2d9e933a00cb40c3bb31cbfc8127f9ec` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:43:04.742429 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb1006ec-ba86-4fec-8f95-be7491a903f3 None admin] RBAC: Authorizing `identity:create_grant(project_id=c8c6fba0f15b4d6a84ff601919b7b8e4, user_id=e66e7034abed4e0bad1f4137520c1e70, role_id=2d9e933a00cb40c3bb31cbfc8127f9ec)` {{(pid=82025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:43:04.743903 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb1006ec-ba86-4fec-8f95-be7491a903f3 None admin] RBAC: Authorization granted {{(pid=82025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:43:04.822785 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb6e2a93-1bfa-43c4-a66b-bb6b9250f8b1 None None] REQUEST_METHOD: `GET` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:43:04.823110 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb6e2a93-1bfa-43c4-a66b-bb6b9250f8b1 None None] SCRIPT_NAME: `/identity` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:43:04.823394 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb6e2a93-1bfa-43c4-a66b-bb6b9250f8b1 None None] PATH_INFO: `/` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:43:04.824802 dv-cinder-828806-6-smb devstack@keystone.service[82026]: [pid: 82026|app: 0|req: 532/1072] 10.222.0.33 () {54 vars in 927 bytes} [Tue Sep 13 19:43:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 13 19:43:04.829819 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf7fa92c-6f1c-40e0-b34a-2795407083ca None None] REQUEST_METHOD: `POST` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:43:04.830153 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf7fa92c-6f1c-40e0-b34a-2795407083ca None None] SCRIPT_NAME: `/identity` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:43:04.830446 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf7fa92c-6f1c-40e0-b34a-2795407083ca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:43:04.842237 dv-cinder-828806-6-smb devstack@keystone.service[82025]: [pid: 82025|app: 0|req: 541/1073] 10.222.0.33 () {58 vars in 1439 bytes} [Tue Sep 13 19:43:04 2022] PUT /identity/v3/projects/c8c6fba0f15b4d6a84ff601919b7b8e4/users/e66e7034abed4e0bad1f4137520c1e70/roles/2d9e933a00cb40c3bb31cbfc8127f9ec => generated 0 bytes in 247 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 19:43:04.849762 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.auth.core [None req-bf7fa92c-6f1c-40e0-b34a-2795407083ca None None] MFA Rules not processed for user `57539b6a6f3b4d589f5f5e1d211cd6a0`. Rule list: `[]` (Enabled: `True`). {{(pid=82026) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 19:43:04.851188 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.common.fernet_utils [None req-bf7fa92c-6f1c-40e0-b34a-2795407083ca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82026) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 19:43:04.944102 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG dbcounter [-] [82026] Writing DB stats keystone:SELECT=100 {{(pid=82026) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:43:04.970296 dv-cinder-828806-6-smb devstack@keystone.service[82026]: [pid: 82026|app: 0|req: 533/1074] 10.222.0.33 () {58 vars in 1024 bytes} [Tue Sep 13 19:43:04 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 141 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 13 19:43:05.032010 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63cc457f-560b-4451-9c54-d3bed35c4a97 None None] REQUEST_METHOD: `GET` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:43:05.032305 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63cc457f-560b-4451-9c54-d3bed35c4a97 None None] SCRIPT_NAME: `/identity` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:43:05.032590 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63cc457f-560b-4451-9c54-d3bed35c4a97 None None] PATH_INFO: `/` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:43:05.035085 dv-cinder-828806-6-smb devstack@keystone.service[82025]: [pid: 82025|app: 0|req: 542/1075] 10.222.0.33 () {54 vars in 927 bytes} [Tue Sep 13 19:43:05 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 19:43:05.040449 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33215b94-c16d-4787-81d1-e17014c712ab None None] REQUEST_METHOD: `POST` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:43:05.040742 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33215b94-c16d-4787-81d1-e17014c712ab None None] SCRIPT_NAME: `/identity` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:43:05.041017 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33215b94-c16d-4787-81d1-e17014c712ab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:43:05.059674 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.auth.core [None req-33215b94-c16d-4787-81d1-e17014c712ab None None] MFA Rules not processed for user `57539b6a6f3b4d589f5f5e1d211cd6a0`. Rule list: `[]` (Enabled: `True`). {{(pid=82026) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 19:43:05.060858 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.common.fernet_utils [None req-33215b94-c16d-4787-81d1-e17014c712ab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82026) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 19:43:05.126571 dv-cinder-828806-6-smb devstack@keystone.service[82026]: [pid: 82026|app: 0|req: 534/1076] 10.222.0.33 () {58 vars in 1024 bytes} [Tue Sep 13 19:43:05 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 13 19:43:05.257373 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63cc457f-560b-4451-9c54-d3bed35c4a97 None None] Authenticating user token {{(pid=82025) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:43:05.300450 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG dbcounter [-] [82025] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82025) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:43:05.369804 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63cc457f-560b-4451-9c54-d3bed35c4a97 None None] Validating token access rules against request {{(pid=82025) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:43:05.399806 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33215b94-c16d-4787-81d1-e17014c712ab None None] Authenticating user token {{(pid=82026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:43:05.408269 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1120653-8d72-47ec-901d-e39b912c6f37 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57539b6a6f3b4d589f5f5e1d211cd6a0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82025) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:43:05.409926 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1120653-8d72-47ec-901d-e39b912c6f37 None admin] REQUEST_METHOD: `GET` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:43:05.410425 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1120653-8d72-47ec-901d-e39b912c6f37 None admin] SCRIPT_NAME: `/identity` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:43:05.410856 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1120653-8d72-47ec-901d-e39b912c6f37 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:43:05.422827 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1120653-8d72-47ec-901d-e39b912c6f37 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=82025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 13 19:43:05.428813 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application [None req-b1120653-8d72-47ec-901d-e39b912c6f37 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 13 19:43:05.428813 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 19:43:05.428813 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 19:43:05.428813 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 19:43:05.428813 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 19:43:05.428813 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 19:43:05.428813 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 19:43:05.428813 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 19:43:05.428813 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 19:43:05.428813 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 19:43:05.428813 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 19:43:05.428813 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 19:43:05.428813 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 13 19:43:05.428813 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 13 19:43:05.428813 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 13 19:43:05.428813 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 13 19:43:05.429946 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 13 19:43:05.429946 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 13 19:43:05.429946 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 13 19:43:05.429946 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 13 19:43:05.429946 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 19:43:05.429946 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 19:43:05.429946 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 19:43:05.429946 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 19:43:05.429946 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 19:43:05.429946 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 19:43:05.429946 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 19:43:05.429946 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application with Lock( Sep 13 19:43:05.429946 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 19:43:05.429946 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application return self._enter() Sep 13 19:43:05.429946 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 19:43:05.429946 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 19:43:05.431016 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 19:43:05.431016 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application return self.creator() Sep 13 19:43:05.431016 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 19:43:05.431016 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application created_value = creator( Sep 13 19:43:05.431016 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 13 19:43:05.431016 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 13 19:43:05.431016 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 13 19:43:05.431016 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 13 19:43:05.431016 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 13 19:43:05.431016 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 13 19:43:05.431016 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 13 19:43:05.431016 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application Sep 13 19:43:05.433147 dv-cinder-828806-6-smb devstack@keystone.service[82025]: [pid: 82025|app: 0|req: 543/1077] 10.222.0.33 () {56 vars in 1096 bytes} [Tue Sep 13 19:43:05 2022] GET /identity/v3/roles/admin => generated 83 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 19:43:05.439149 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1120653-8d72-47ec-901d-e39b912c6f37 None admin] Authenticating user token {{(pid=82025) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:43:05.505668 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33215b94-c16d-4787-81d1-e17014c712ab None None] Validating token access rules against request {{(pid=82026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:43:05.515616 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG dbcounter [-] [82026] Writing DB stats keystone:SELECT=100 {{(pid=82026) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:43:05.542144 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-910af820-4466-4085-b552-902790589cfc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57539b6a6f3b4d589f5f5e1d211cd6a0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:43:05.542761 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-910af820-4466-4085-b552-902790589cfc None admin] REQUEST_METHOD: `GET` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:43:05.543056 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-910af820-4466-4085-b552-902790589cfc None admin] SCRIPT_NAME: `/identity` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:43:05.543350 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-910af820-4466-4085-b552-902790589cfc None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:43:05.544394 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG dbcounter [-] [82025] Writing DB stats keystone:SELECT=100 {{(pid=82025) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:43:05.552898 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1120653-8d72-47ec-901d-e39b912c6f37 None admin] Validating token access rules against request {{(pid=82025) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:43:05.608101 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d43b15e-2ff6-4ff7-a0f5-25ebc4e3ec43 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57539b6a6f3b4d589f5f5e1d211cd6a0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82025) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:43:05.608732 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d43b15e-2ff6-4ff7-a0f5-25ebc4e3ec43 None admin] REQUEST_METHOD: `GET` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:43:05.609021 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d43b15e-2ff6-4ff7-a0f5-25ebc4e3ec43 None admin] SCRIPT_NAME: `/identity` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:43:05.609298 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d43b15e-2ff6-4ff7-a0f5-25ebc4e3ec43 None admin] PATH_INFO: `/v3/roles` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:43:05.609978 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d43b15e-2ff6-4ff7-a0f5-25ebc4e3ec43 None admin] RBAC: Adding query filter params (name=admin) {{(pid=82025) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 19:43:05.610289 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d43b15e-2ff6-4ff7-a0f5-25ebc4e3ec43 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:43:05.613542 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d43b15e-2ff6-4ff7-a0f5-25ebc4e3ec43 None admin] RBAC: Authorization granted {{(pid=82025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:43:05.626610 dv-cinder-828806-6-smb devstack@keystone.service[82025]: [pid: 82025|app: 0|req: 544/1078] 10.222.0.33 () {56 vars in 1099 bytes} [Tue Sep 13 19:43:05 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 13 19:43:05.626780 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-910af820-4466-4085-b552-902790589cfc None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=82026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:43:05.627829 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-910af820-4466-4085-b552-902790589cfc None admin] RBAC: Authorization granted {{(pid=82026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:43:05.628612 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d43b15e-2ff6-4ff7-a0f5-25ebc4e3ec43 None admin] Authenticating user token {{(pid=82025) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:43:05.741994 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d43b15e-2ff6-4ff7-a0f5-25ebc4e3ec43 None admin] Validating token access rules against request {{(pid=82025) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:43:05.745320 dv-cinder-828806-6-smb devstack@keystone.service[82026]: [pid: 82026|app: 0|req: 535/1079] 10.222.0.33 () {58 vars in 1282 bytes} [Tue Sep 13 19:43:05 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 346 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Sep 13 19:43:05.751243 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-910af820-4466-4085-b552-902790589cfc None admin] Authenticating user token {{(pid=82026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:43:05.765448 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG dbcounter [-] [82026] Writing DB stats keystone:SELECT=100 {{(pid=82026) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:43:05.784831 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d71b1ce8-6904-4a96-902a-69b070c1554c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57539b6a6f3b4d589f5f5e1d211cd6a0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82025) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:43:05.785374 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d71b1ce8-6904-4a96-902a-69b070c1554c None admin] REQUEST_METHOD: `GET` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:43:05.785730 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d71b1ce8-6904-4a96-902a-69b070c1554c None admin] SCRIPT_NAME: `/identity` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:43:05.785964 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d71b1ce8-6904-4a96-902a-69b070c1554c None admin] PATH_INFO: `/v3/users/fc4033db6dcf429aa7b1c2a543358fe5` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:43:05.787399 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d71b1ce8-6904-4a96-902a-69b070c1554c None admin] RBAC: Authorizing `identity:get_user(user_id=fc4033db6dcf429aa7b1c2a543358fe5)` {{(pid=82025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:43:05.788825 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d71b1ce8-6904-4a96-902a-69b070c1554c None admin] RBAC: Authorization granted {{(pid=82025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:43:05.790417 dv-cinder-828806-6-smb devstack@keystone.service[82025]: [pid: 82025|app: 0|req: 545/1080] 10.222.0.33 () {56 vars in 1177 bytes} [Tue Sep 13 19:43:05 2022] GET /identity/v3/users/fc4033db6dcf429aa7b1c2a543358fe5 => generated 285 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 19:43:05.796102 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d71b1ce8-6904-4a96-902a-69b070c1554c None admin] Authenticating user token {{(pid=82025) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:43:05.825214 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG dbcounter [-] [82025] Writing DB stats keystone:SELECT=100 {{(pid=82025) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:43:05.866249 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-910af820-4466-4085-b552-902790589cfc None admin] Validating token access rules against request {{(pid=82026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:43:05.902909 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0a2851a-d8d1-4b11-bfa2-a25824f3c98f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57539b6a6f3b4d589f5f5e1d211cd6a0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:43:05.903573 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0a2851a-d8d1-4b11-bfa2-a25824f3c98f None admin] REQUEST_METHOD: `GET` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:43:05.903894 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0a2851a-d8d1-4b11-bfa2-a25824f3c98f None admin] SCRIPT_NAME: `/identity` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:43:05.904187 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0a2851a-d8d1-4b11-bfa2-a25824f3c98f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:43:05.904707 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d71b1ce8-6904-4a96-902a-69b070c1554c None admin] Validating token access rules against request {{(pid=82025) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:43:05.915453 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0a2851a-d8d1-4b11-bfa2-a25824f3c98f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=82026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:43:05.917043 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0a2851a-d8d1-4b11-bfa2-a25824f3c98f None admin] RBAC: Authorization granted {{(pid=82026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:43:05.933592 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application [None req-d0a2851a-d8d1-4b11-bfa2-a25824f3c98f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 13 19:43:05.933592 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 19:43:05.933592 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 19:43:05.933592 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 19:43:05.933592 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 19:43:05.933592 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 19:43:05.933592 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 19:43:05.933592 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 19:43:05.933592 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 19:43:05.933592 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 19:43:05.933592 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 19:43:05.933592 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 19:43:05.933592 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 13 19:43:05.933592 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 13 19:43:05.933592 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 13 19:43:05.933592 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 13 19:43:05.934615 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 19:43:05.934615 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 19:43:05.934615 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 19:43:05.934615 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 19:43:05.934615 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 19:43:05.934615 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 19:43:05.934615 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 19:43:05.934615 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application with Lock( Sep 13 19:43:05.934615 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 19:43:05.934615 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application return self._enter() Sep 13 19:43:05.934615 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 19:43:05.934615 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 19:43:05.934615 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 19:43:05.934615 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application return self.creator() Sep 13 19:43:05.934615 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 19:43:05.934615 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application created_value = creator( Sep 13 19:43:05.934615 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 13 19:43:05.935563 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 13 19:43:05.935563 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 13 19:43:05.935563 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application Sep 13 19:43:05.935563 dv-cinder-828806-6-smb devstack@keystone.service[82026]: [pid: 82026|app: 0|req: 536/1081] 10.222.0.33 () {56 vars in 1108 bytes} [Tue Sep 13 19:43:05 2022] GET /identity/v3/domains/Default => generated 87 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 19:43:05.941750 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0a2851a-d8d1-4b11-bfa2-a25824f3c98f None admin] Authenticating user token {{(pid=82026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:43:05.944055 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e53b86b-cf7e-48cb-869b-4111aeb05cd8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57539b6a6f3b4d589f5f5e1d211cd6a0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82025) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:43:05.944757 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e53b86b-cf7e-48cb-869b-4111aeb05cd8 None admin] REQUEST_METHOD: `GET` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:43:05.945047 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e53b86b-cf7e-48cb-869b-4111aeb05cd8 None admin] SCRIPT_NAME: `/identity` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:43:05.945376 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e53b86b-cf7e-48cb-869b-4111aeb05cd8 None admin] PATH_INFO: `/v3/projects/024b16f822e545dca8d1e8e3cc6f0f2c` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:43:05.946474 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e53b86b-cf7e-48cb-869b-4111aeb05cd8 None admin] RBAC: Authorizing `identity:get_project(project_id=024b16f822e545dca8d1e8e3cc6f0f2c)` {{(pid=82025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:43:05.948014 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e53b86b-cf7e-48cb-869b-4111aeb05cd8 None admin] RBAC: Authorization granted {{(pid=82025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:43:05.954815 dv-cinder-828806-6-smb devstack@keystone.service[82025]: [pid: 82025|app: 0|req: 546/1082] 10.222.0.33 () {56 vars in 1186 bytes} [Tue Sep 13 19:43:05 2022] GET /identity/v3/projects/024b16f822e545dca8d1e8e3cc6f0f2c => generated 311 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 13 19:43:05.956374 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e53b86b-cf7e-48cb-869b-4111aeb05cd8 None admin] Authenticating user token {{(pid=82025) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:43:06.006738 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG dbcounter [-] [82026] Writing DB stats keystone:SELECT=100 {{(pid=82026) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:43:06.048141 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0a2851a-d8d1-4b11-bfa2-a25824f3c98f None admin] Validating token access rules against request {{(pid=82026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:43:06.053566 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG dbcounter [-] [82025] Writing DB stats keystone:SELECT=100 {{(pid=82025) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:43:06.063268 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e53b86b-cf7e-48cb-869b-4111aeb05cd8 None admin] Validating token access rules against request {{(pid=82025) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:43:06.085703 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2583272-86f0-462c-ae64-589be025a41a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57539b6a6f3b4d589f5f5e1d211cd6a0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:43:06.086666 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2583272-86f0-462c-ae64-589be025a41a None admin] REQUEST_METHOD: `GET` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:43:06.087141 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2583272-86f0-462c-ae64-589be025a41a None admin] SCRIPT_NAME: `/identity` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:43:06.087569 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2583272-86f0-462c-ae64-589be025a41a None admin] PATH_INFO: `/v3/domains` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:43:06.088360 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2583272-86f0-462c-ae64-589be025a41a None admin] RBAC: Adding query filter params (name=Default) {{(pid=82026) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 19:43:06.088816 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2583272-86f0-462c-ae64-589be025a41a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:43:06.090360 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2583272-86f0-462c-ae64-589be025a41a None admin] RBAC: Authorization granted {{(pid=82026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:43:06.102077 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1be5ebc9-d0d3-4a49-be9b-e622bf7c2f69 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57539b6a6f3b4d589f5f5e1d211cd6a0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82025) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:43:06.102741 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1be5ebc9-d0d3-4a49-be9b-e622bf7c2f69 None admin] REQUEST_METHOD: `PUT` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:43:06.103025 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1be5ebc9-d0d3-4a49-be9b-e622bf7c2f69 None admin] SCRIPT_NAME: `/identity` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:43:06.103325 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1be5ebc9-d0d3-4a49-be9b-e622bf7c2f69 None admin] PATH_INFO: `/v3/projects/024b16f822e545dca8d1e8e3cc6f0f2c/users/fc4033db6dcf429aa7b1c2a543358fe5/roles/e5af7d5baa93469e9e486ef21c85474e` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:43:06.107882 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1be5ebc9-d0d3-4a49-be9b-e622bf7c2f69 None admin] RBAC: Authorizing `identity:create_grant(project_id=024b16f822e545dca8d1e8e3cc6f0f2c, user_id=fc4033db6dcf429aa7b1c2a543358fe5, role_id=e5af7d5baa93469e9e486ef21c85474e)` {{(pid=82025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:43:06.107882 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1be5ebc9-d0d3-4a49-be9b-e622bf7c2f69 None admin] RBAC: Authorization granted {{(pid=82025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:43:06.111254 dv-cinder-828806-6-smb devstack@keystone.service[82026]: [pid: 82026|app: 0|req: 537/1083] 10.222.0.33 () {56 vars in 1109 bytes} [Tue Sep 13 19:43:05 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 13 19:43:06.171418 dv-cinder-828806-6-smb devstack@keystone.service[82025]: [pid: 82025|app: 0|req: 547/1084] 10.222.0.33 () {58 vars in 1439 bytes} [Tue Sep 13 19:43:05 2022] PUT /identity/v3/projects/024b16f822e545dca8d1e8e3cc6f0f2c/users/fc4033db6dcf429aa7b1c2a543358fe5/roles/e5af7d5baa93469e9e486ef21c85474e => generated 0 bytes in 216 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 13 19:43:07.038434 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e012cfe9-ccb1-4124-9b34-d772431e64c1 None None] REQUEST_METHOD: `GET` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:43:07.038999 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e012cfe9-ccb1-4124-9b34-d772431e64c1 None None] SCRIPT_NAME: `/identity` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:43:07.038999 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e012cfe9-ccb1-4124-9b34-d772431e64c1 None None] PATH_INFO: `/` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:43:07.040494 dv-cinder-828806-6-smb devstack@keystone.service[82026]: [pid: 82026|app: 0|req: 538/1085] 10.222.0.33 () {54 vars in 927 bytes} [Tue Sep 13 19:43:07 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 19:43:07.045749 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a20a2344-d183-4382-adb7-b061bb63bab0 None None] REQUEST_METHOD: `POST` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:43:07.046156 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a20a2344-d183-4382-adb7-b061bb63bab0 None None] SCRIPT_NAME: `/identity` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:43:07.046311 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a20a2344-d183-4382-adb7-b061bb63bab0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:43:07.066632 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.auth.core [None req-a20a2344-d183-4382-adb7-b061bb63bab0 None None] MFA Rules not processed for user `57539b6a6f3b4d589f5f5e1d211cd6a0`. Rule list: `[]` (Enabled: `True`). {{(pid=82025) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 19:43:07.067940 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.fernet_utils [None req-a20a2344-d183-4382-adb7-b061bb63bab0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82025) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 19:43:07.133946 dv-cinder-828806-6-smb devstack@keystone.service[82025]: [pid: 82025|app: 0|req: 548/1086] 10.222.0.33 () {58 vars in 1024 bytes} [Tue Sep 13 19:43:07 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 13 19:43:07.404563 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e012cfe9-ccb1-4124-9b34-d772431e64c1 None None] Authenticating user token {{(pid=82026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:43:07.507712 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e012cfe9-ccb1-4124-9b34-d772431e64c1 None None] Validating token access rules against request {{(pid=82026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:43:07.530171 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG dbcounter [-] [82026] Writing DB stats keystone:SELECT=100 {{(pid=82026) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:43:07.545260 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3021e10-8394-4a4c-b8bc-0ce962628e9f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57539b6a6f3b4d589f5f5e1d211cd6a0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:43:07.545893 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3021e10-8394-4a4c-b8bc-0ce962628e9f None admin] REQUEST_METHOD: `GET` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:43:07.546178 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3021e10-8394-4a4c-b8bc-0ce962628e9f None admin] SCRIPT_NAME: `/identity` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:43:07.546483 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3021e10-8394-4a4c-b8bc-0ce962628e9f None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:43:07.557270 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3021e10-8394-4a4c-b8bc-0ce962628e9f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=82026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 13 19:43:07.562133 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application [None req-b3021e10-8394-4a4c-b8bc-0ce962628e9f None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Sep 13 19:43:07.562133 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 19:43:07.562133 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 19:43:07.562133 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 19:43:07.562133 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 19:43:07.562133 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 19:43:07.562133 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 19:43:07.562133 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 19:43:07.562133 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 19:43:07.562133 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 19:43:07.562133 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 19:43:07.562133 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 19:43:07.562133 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 13 19:43:07.562133 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 13 19:43:07.562133 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 13 19:43:07.562133 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 13 19:43:07.567219 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 13 19:43:07.567219 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 13 19:43:07.567219 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 13 19:43:07.567219 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 13 19:43:07.567219 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 19:43:07.567219 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 19:43:07.567219 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 19:43:07.567219 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 19:43:07.567219 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 19:43:07.567219 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 19:43:07.567219 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 19:43:07.567219 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application with Lock( Sep 13 19:43:07.567219 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 19:43:07.567219 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application return self._enter() Sep 13 19:43:07.567219 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 19:43:07.567219 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 19:43:07.568282 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 19:43:07.568282 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application return self.creator() Sep 13 19:43:07.568282 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 19:43:07.568282 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application created_value = creator( Sep 13 19:43:07.568282 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 13 19:43:07.568282 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 13 19:43:07.568282 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 13 19:43:07.568282 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 13 19:43:07.568282 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 13 19:43:07.568282 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 13 19:43:07.568282 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Sep 13 19:43:07.568282 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application Sep 13 19:43:07.568282 dv-cinder-828806-6-smb devstack@keystone.service[82026]: [pid: 82026|app: 0|req: 539/1087] 10.222.0.33 () {56 vars in 1120 bytes} [Tue Sep 13 19:43:07 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 19:43:07.569298 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a20a2344-d183-4382-adb7-b061bb63bab0 None None] Authenticating user token {{(pid=82025) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:43:07.666299 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG dbcounter [-] [82025] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82025) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:43:07.683755 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a20a2344-d183-4382-adb7-b061bb63bab0 None None] Validating token access rules against request {{(pid=82025) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:43:07.717712 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8fee7ae-8e05-4e3a-aa6c-9a061b8d8206 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57539b6a6f3b4d589f5f5e1d211cd6a0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82025) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:43:07.718312 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8fee7ae-8e05-4e3a-aa6c-9a061b8d8206 None admin] REQUEST_METHOD: `GET` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:43:07.718596 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8fee7ae-8e05-4e3a-aa6c-9a061b8d8206 None admin] SCRIPT_NAME: `/identity` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:43:07.718872 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8fee7ae-8e05-4e3a-aa6c-9a061b8d8206 None admin] PATH_INFO: `/v3/roles` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:43:07.719568 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8fee7ae-8e05-4e3a-aa6c-9a061b8d8206 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=82025) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 19:43:07.719877 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8fee7ae-8e05-4e3a-aa6c-9a061b8d8206 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:43:07.722043 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8fee7ae-8e05-4e3a-aa6c-9a061b8d8206 None admin] RBAC: Authorization granted {{(pid=82025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:43:07.734525 dv-cinder-828806-6-smb devstack@keystone.service[82025]: [pid: 82025|app: 0|req: 549/1088] 10.222.0.33 () {56 vars in 1115 bytes} [Tue Sep 13 19:43:07 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 19:43:07.735747 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3021e10-8394-4a4c-b8bc-0ce962628e9f None admin] Authenticating user token {{(pid=82026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:43:07.835525 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3021e10-8394-4a4c-b8bc-0ce962628e9f None admin] Validating token access rules against request {{(pid=82026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:43:07.869672 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5501e869-f7e8-40a5-8390-03f7b437b507 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57539b6a6f3b4d589f5f5e1d211cd6a0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:43:07.870305 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5501e869-f7e8-40a5-8390-03f7b437b507 None admin] REQUEST_METHOD: `GET` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:43:07.870589 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5501e869-f7e8-40a5-8390-03f7b437b507 None admin] SCRIPT_NAME: `/identity` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:43:07.870863 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5501e869-f7e8-40a5-8390-03f7b437b507 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:43:07.880852 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5501e869-f7e8-40a5-8390-03f7b437b507 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=82026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:43:07.882296 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5501e869-f7e8-40a5-8390-03f7b437b507 None admin] RBAC: Authorization granted {{(pid=82026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:43:07.897914 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application [None req-5501e869-f7e8-40a5-8390-03f7b437b507 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 13 19:43:07.897914 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 19:43:07.897914 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 19:43:07.897914 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 19:43:07.897914 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 19:43:07.897914 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 19:43:07.897914 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 19:43:07.897914 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 19:43:07.897914 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 19:43:07.897914 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 19:43:07.897914 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 19:43:07.897914 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 19:43:07.897914 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 13 19:43:07.897914 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 13 19:43:07.897914 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 13 19:43:07.897914 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 13 19:43:07.899116 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 19:43:07.899116 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 19:43:07.899116 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 19:43:07.899116 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 19:43:07.899116 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 19:43:07.899116 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 19:43:07.899116 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 19:43:07.899116 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application with Lock( Sep 13 19:43:07.899116 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 19:43:07.899116 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application return self._enter() Sep 13 19:43:07.899116 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 19:43:07.899116 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 19:43:07.899116 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 19:43:07.899116 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application return self.creator() Sep 13 19:43:07.899116 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 19:43:07.899116 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application created_value = creator( Sep 13 19:43:07.899116 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 13 19:43:07.900123 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 13 19:43:07.900123 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 13 19:43:07.900123 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application Sep 13 19:43:07.900123 dv-cinder-828806-6-smb devstack@keystone.service[82026]: [pid: 82026|app: 0|req: 540/1089] 10.222.0.33 () {56 vars in 1108 bytes} [Tue Sep 13 19:43:07 2022] GET /identity/v3/domains/Default => generated 87 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 19:43:07.904904 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8fee7ae-8e05-4e3a-aa6c-9a061b8d8206 None admin] Authenticating user token {{(pid=82025) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:43:08.004244 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8fee7ae-8e05-4e3a-aa6c-9a061b8d8206 None admin] Validating token access rules against request {{(pid=82025) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:43:08.037305 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce08ac02-26f9-4aa9-a383-977112e8d370 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57539b6a6f3b4d589f5f5e1d211cd6a0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82025) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:43:08.037906 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce08ac02-26f9-4aa9-a383-977112e8d370 None admin] REQUEST_METHOD: `GET` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:43:08.038186 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce08ac02-26f9-4aa9-a383-977112e8d370 None admin] SCRIPT_NAME: `/identity` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:43:08.038460 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce08ac02-26f9-4aa9-a383-977112e8d370 None admin] PATH_INFO: `/v3/domains` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:43:08.039131 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce08ac02-26f9-4aa9-a383-977112e8d370 None admin] RBAC: Adding query filter params (name=Default) {{(pid=82025) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 19:43:08.039437 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce08ac02-26f9-4aa9-a383-977112e8d370 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:43:08.040781 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce08ac02-26f9-4aa9-a383-977112e8d370 None admin] RBAC: Authorization granted {{(pid=82025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:43:08.052309 dv-cinder-828806-6-smb devstack@keystone.service[82025]: [pid: 82025|app: 0|req: 550/1090] 10.222.0.33 () {56 vars in 1109 bytes} [Tue Sep 13 19:43:07 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 19:43:08.057798 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5501e869-f7e8-40a5-8390-03f7b437b507 None admin] Authenticating user token {{(pid=82026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:43:08.089845 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG dbcounter [-] [82026] Writing DB stats keystone:SELECT=100 {{(pid=82026) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:43:08.157649 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5501e869-f7e8-40a5-8390-03f7b437b507 None admin] Validating token access rules against request {{(pid=82026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:43:08.190477 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-531bf3d0-daa1-4848-813e-4b5167026f17 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57539b6a6f3b4d589f5f5e1d211cd6a0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:43:08.191132 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-531bf3d0-daa1-4848-813e-4b5167026f17 None admin] REQUEST_METHOD: `GET` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:43:08.191419 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-531bf3d0-daa1-4848-813e-4b5167026f17 None admin] SCRIPT_NAME: `/identity` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:43:08.191697 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-531bf3d0-daa1-4848-813e-4b5167026f17 None admin] PATH_INFO: `/v3/users/nova` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:43:08.199210 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-531bf3d0-daa1-4848-813e-4b5167026f17 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=82026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:43:08.200650 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-531bf3d0-daa1-4848-813e-4b5167026f17 None admin] RBAC: Authorization granted {{(pid=82026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:43:08.212171 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application [None req-531bf3d0-daa1-4848-813e-4b5167026f17 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Sep 13 19:43:08.212171 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 19:43:08.212171 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 19:43:08.212171 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 19:43:08.212171 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 19:43:08.212171 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 19:43:08.212171 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 19:43:08.212171 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 19:43:08.212171 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 19:43:08.212171 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 19:43:08.212171 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 19:43:08.212171 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 19:43:08.212171 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 13 19:43:08.212171 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 13 19:43:08.212171 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 13 19:43:08.212171 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 13 19:43:08.213230 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 19:43:08.213230 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 19:43:08.213230 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 13 19:43:08.213230 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 13 19:43:08.213230 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 13 19:43:08.213230 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 13 19:43:08.213230 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 19:43:08.213230 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 19:43:08.213230 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 19:43:08.213230 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 19:43:08.213230 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 19:43:08.213230 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application with Lock( Sep 13 19:43:08.213230 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 19:43:08.213230 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application return self._enter() Sep 13 19:43:08.213230 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 19:43:08.213230 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 19:43:08.213230 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 19:43:08.213230 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application return self.creator() Sep 13 19:43:08.214184 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 19:43:08.214184 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application created_value = creator( Sep 13 19:43:08.214184 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 13 19:43:08.214184 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 13 19:43:08.214184 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 13 19:43:08.214184 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 13 19:43:08.214184 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 13 19:43:08.214184 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 13 19:43:08.214184 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Sep 13 19:43:08.214184 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application Sep 13 19:43:08.214184 dv-cinder-828806-6-smb devstack@keystone.service[82026]: [pid: 82026|app: 0|req: 541/1091] 10.222.0.33 () {56 vars in 1093 bytes} [Tue Sep 13 19:43:08 2022] GET /identity/v3/users/nova => generated 82 bytes in 156 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 13 19:43:08.219163 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce08ac02-26f9-4aa9-a383-977112e8d370 None admin] Authenticating user token {{(pid=82025) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:43:08.223680 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG dbcounter [-] [82025] Writing DB stats keystone:SELECT=100 {{(pid=82025) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:43:08.321581 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce08ac02-26f9-4aa9-a383-977112e8d370 None admin] Validating token access rules against request {{(pid=82025) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:43:08.354899 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d35e00f0-c93a-4dfb-8cbb-2b09ed483bc7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57539b6a6f3b4d589f5f5e1d211cd6a0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82025) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:43:08.355467 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d35e00f0-c93a-4dfb-8cbb-2b09ed483bc7 None admin] REQUEST_METHOD: `GET` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:43:08.355747 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d35e00f0-c93a-4dfb-8cbb-2b09ed483bc7 None admin] SCRIPT_NAME: `/identity` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:43:08.356020 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d35e00f0-c93a-4dfb-8cbb-2b09ed483bc7 None admin] PATH_INFO: `/v3/users` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:43:08.356733 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d35e00f0-c93a-4dfb-8cbb-2b09ed483bc7 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=82025) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 19:43:08.357037 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d35e00f0-c93a-4dfb-8cbb-2b09ed483bc7 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=82025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:43:08.358482 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d35e00f0-c93a-4dfb-8cbb-2b09ed483bc7 None admin] RBAC: Authorization granted {{(pid=82025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:43:08.376487 dv-cinder-828806-6-smb devstack@keystone.service[82025]: [pid: 82025|app: 0|req: 551/1092] 10.222.0.33 () {56 vars in 1133 bytes} [Tue Sep 13 19:43:08 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 19:43:08.382889 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-531bf3d0-daa1-4848-813e-4b5167026f17 None admin] Authenticating user token {{(pid=82026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:43:08.396004 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b63bd6d-4f68-4531-9351-d7cff798cac4 None None] REQUEST_METHOD: `GET` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:43:08.396337 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b63bd6d-4f68-4531-9351-d7cff798cac4 None None] SCRIPT_NAME: `/identity` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:43:08.396648 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b63bd6d-4f68-4531-9351-d7cff798cac4 None None] PATH_INFO: `/` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:43:08.398026 dv-cinder-828806-6-smb devstack@keystone.service[82025]: [pid: 82025|app: 0|req: 552/1093] 10.222.0.33 () {54 vars in 927 bytes} [Tue Sep 13 19:43:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 13 19:43:08.403214 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-013b460e-d06c-48eb-94b3-1d9d0098759a None None] REQUEST_METHOD: `POST` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:43:08.403501 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-013b460e-d06c-48eb-94b3-1d9d0098759a None None] SCRIPT_NAME: `/identity` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:43:08.403779 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-013b460e-d06c-48eb-94b3-1d9d0098759a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:43:08.422254 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.auth.core [None req-013b460e-d06c-48eb-94b3-1d9d0098759a None None] MFA Rules not processed for user `57539b6a6f3b4d589f5f5e1d211cd6a0`. Rule list: `[]` (Enabled: `True`). {{(pid=82025) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 19:43:08.423493 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.fernet_utils [None req-013b460e-d06c-48eb-94b3-1d9d0098759a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82025) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 19:43:08.475292 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG dbcounter [-] [82026] Writing DB stats keystone:SELECT=100 {{(pid=82026) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:43:08.481063 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG dbcounter [-] [82025] Writing DB stats keystone:SELECT=100 {{(pid=82025) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:43:08.484500 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-531bf3d0-daa1-4848-813e-4b5167026f17 None admin] Validating token access rules against request {{(pid=82026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:43:08.492050 dv-cinder-828806-6-smb devstack@keystone.service[82025]: [pid: 82025|app: 0|req: 553/1094] 10.222.0.33 () {58 vars in 1024 bytes} [Tue Sep 13 19:43:08 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 13 19:43:08.523111 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44236695-2406-4416-be87-fa22f7a51380 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57539b6a6f3b4d589f5f5e1d211cd6a0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:43:08.523767 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44236695-2406-4416-be87-fa22f7a51380 None admin] REQUEST_METHOD: `GET` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:43:08.524054 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44236695-2406-4416-be87-fa22f7a51380 None admin] SCRIPT_NAME: `/identity` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:43:08.524330 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44236695-2406-4416-be87-fa22f7a51380 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:43:08.590723 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44236695-2406-4416-be87-fa22f7a51380 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=82026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:43:08.592209 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44236695-2406-4416-be87-fa22f7a51380 None admin] RBAC: Authorization granted {{(pid=82026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:43:08.686874 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG dbcounter [-] [82026] Writing DB stats keystone:SELECT=100 {{(pid=82026) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:43:08.695959 dv-cinder-828806-6-smb devstack@keystone.service[82026]: [pid: 82026|app: 0|req: 542/1095] 10.222.0.33 () {58 vars in 1282 bytes} [Tue Sep 13 19:43:08 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 314 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Sep 13 19:43:08.701745 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-013b460e-d06c-48eb-94b3-1d9d0098759a None None] Authenticating user token {{(pid=82025) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:43:08.772145 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44236695-2406-4416-be87-fa22f7a51380 None admin] Authenticating user token {{(pid=82026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:43:08.804024 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-013b460e-d06c-48eb-94b3-1d9d0098759a None None] Validating token access rules against request {{(pid=82025) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:43:08.838619 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb6a536f-3bed-44fb-9100-c17c78bbb4e6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57539b6a6f3b4d589f5f5e1d211cd6a0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82025) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:43:08.839282 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb6a536f-3bed-44fb-9100-c17c78bbb4e6 None admin] REQUEST_METHOD: `GET` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:43:08.839568 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb6a536f-3bed-44fb-9100-c17c78bbb4e6 None admin] SCRIPT_NAME: `/identity` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:43:08.839840 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb6a536f-3bed-44fb-9100-c17c78bbb4e6 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:43:08.852106 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb6a536f-3bed-44fb-9100-c17c78bbb4e6 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=82025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:43:08.853608 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb6a536f-3bed-44fb-9100-c17c78bbb4e6 None admin] RBAC: Authorization granted {{(pid=82025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:43:08.868934 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application [None req-bb6a536f-3bed-44fb-9100-c17c78bbb4e6 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 13 19:43:08.868934 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 19:43:08.868934 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 19:43:08.868934 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 19:43:08.868934 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 19:43:08.868934 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 19:43:08.868934 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 19:43:08.868934 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 19:43:08.868934 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 19:43:08.868934 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 19:43:08.868934 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 19:43:08.868934 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 19:43:08.868934 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 13 19:43:08.868934 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 13 19:43:08.868934 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 13 19:43:08.868934 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 13 19:43:08.869972 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 19:43:08.869972 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 19:43:08.869972 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 19:43:08.869972 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 19:43:08.869972 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 19:43:08.869972 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 19:43:08.869972 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 19:43:08.869972 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application with Lock( Sep 13 19:43:08.869972 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 19:43:08.869972 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application return self._enter() Sep 13 19:43:08.869972 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 19:43:08.869972 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 19:43:08.869972 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 19:43:08.869972 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application return self.creator() Sep 13 19:43:08.869972 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 19:43:08.869972 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application created_value = creator( Sep 13 19:43:08.869972 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 13 19:43:08.870976 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 13 19:43:08.870976 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 13 19:43:08.870976 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application Sep 13 19:43:08.870976 dv-cinder-828806-6-smb devstack@keystone.service[82025]: [pid: 82025|app: 0|req: 554/1096] 10.222.0.33 () {56 vars in 1108 bytes} [Tue Sep 13 19:43:08 2022] GET /identity/v3/domains/Default => generated 87 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 19:43:08.874163 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44236695-2406-4416-be87-fa22f7a51380 None admin] Validating token access rules against request {{(pid=82026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:43:08.875646 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb6a536f-3bed-44fb-9100-c17c78bbb4e6 None admin] Authenticating user token {{(pid=82025) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:43:08.909388 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e23534ef-28b1-4504-956d-99ee25daa27d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57539b6a6f3b4d589f5f5e1d211cd6a0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:43:08.910020 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e23534ef-28b1-4504-956d-99ee25daa27d None admin] REQUEST_METHOD: `GET` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:43:08.910310 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e23534ef-28b1-4504-956d-99ee25daa27d None admin] SCRIPT_NAME: `/identity` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:43:08.910588 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e23534ef-28b1-4504-956d-99ee25daa27d None admin] PATH_INFO: `/v3/roles/admin` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:43:08.920315 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG dbcounter [-] [82025] Writing DB stats keystone:SELECT=100 {{(pid=82025) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:43:08.921058 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e23534ef-28b1-4504-956d-99ee25daa27d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=82026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 13 19:43:08.926589 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application [None req-e23534ef-28b1-4504-956d-99ee25daa27d None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 13 19:43:08.926589 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 19:43:08.926589 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 19:43:08.926589 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 19:43:08.926589 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 19:43:08.926589 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 19:43:08.926589 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 19:43:08.926589 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 19:43:08.926589 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 19:43:08.926589 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 19:43:08.926589 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 19:43:08.926589 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 19:43:08.926589 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 13 19:43:08.926589 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 13 19:43:08.926589 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 13 19:43:08.926589 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 13 19:43:08.933164 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 13 19:43:08.933164 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 13 19:43:08.933164 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 13 19:43:08.933164 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 13 19:43:08.933164 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 19:43:08.933164 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 19:43:08.933164 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 19:43:08.933164 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 19:43:08.933164 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 19:43:08.933164 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 19:43:08.933164 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 19:43:08.933164 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application with Lock( Sep 13 19:43:08.933164 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 19:43:08.933164 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application return self._enter() Sep 13 19:43:08.933164 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 19:43:08.933164 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 19:43:08.934036 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 19:43:08.934036 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application return self.creator() Sep 13 19:43:08.934036 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 19:43:08.934036 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application created_value = creator( Sep 13 19:43:08.934036 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 13 19:43:08.934036 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 13 19:43:08.934036 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 13 19:43:08.934036 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 13 19:43:08.934036 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 13 19:43:08.934036 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 13 19:43:08.934036 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 13 19:43:08.934036 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application Sep 13 19:43:08.934036 dv-cinder-828806-6-smb devstack@keystone.service[82026]: [pid: 82026|app: 0|req: 543/1097] 10.222.0.33 () {56 vars in 1096 bytes} [Tue Sep 13 19:43:08 2022] GET /identity/v3/roles/admin => generated 83 bytes in 156 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 13 19:43:08.934036 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e23534ef-28b1-4504-956d-99ee25daa27d None admin] Authenticating user token {{(pid=82026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:43:08.978774 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb6a536f-3bed-44fb-9100-c17c78bbb4e6 None admin] Validating token access rules against request {{(pid=82025) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:43:08.996428 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG dbcounter [-] [82026] Writing DB stats keystone:SELECT=100 {{(pid=82026) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:43:09.014390 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7f3981d-3e8f-46b4-b6d2-f4bea4b5b27f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57539b6a6f3b4d589f5f5e1d211cd6a0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82025) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:43:09.015115 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7f3981d-3e8f-46b4-b6d2-f4bea4b5b27f None admin] REQUEST_METHOD: `GET` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:43:09.015409 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7f3981d-3e8f-46b4-b6d2-f4bea4b5b27f None admin] SCRIPT_NAME: `/identity` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:43:09.015686 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7f3981d-3e8f-46b4-b6d2-f4bea4b5b27f None admin] PATH_INFO: `/v3/domains` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:43:09.016324 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7f3981d-3e8f-46b4-b6d2-f4bea4b5b27f None admin] RBAC: Adding query filter params (name=Default) {{(pid=82025) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 19:43:09.016627 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7f3981d-3e8f-46b4-b6d2-f4bea4b5b27f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:43:09.018614 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7f3981d-3e8f-46b4-b6d2-f4bea4b5b27f None admin] RBAC: Authorization granted {{(pid=82025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:43:09.031085 dv-cinder-828806-6-smb devstack@keystone.service[82025]: [pid: 82025|app: 0|req: 555/1098] 10.222.0.33 () {56 vars in 1109 bytes} [Tue Sep 13 19:43:08 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 13 19:43:09.037010 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7f3981d-3e8f-46b4-b6d2-f4bea4b5b27f None admin] Authenticating user token {{(pid=82025) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:43:09.044769 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e23534ef-28b1-4504-956d-99ee25daa27d None admin] Validating token access rules against request {{(pid=82026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:43:09.078532 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72a3d324-6f3e-4ff9-ae76-f9b51b8adf85 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57539b6a6f3b4d589f5f5e1d211cd6a0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:43:09.079181 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72a3d324-6f3e-4ff9-ae76-f9b51b8adf85 None admin] REQUEST_METHOD: `GET` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:43:09.079437 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72a3d324-6f3e-4ff9-ae76-f9b51b8adf85 None admin] SCRIPT_NAME: `/identity` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:43:09.079710 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72a3d324-6f3e-4ff9-ae76-f9b51b8adf85 None admin] PATH_INFO: `/v3/roles` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:43:09.080982 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72a3d324-6f3e-4ff9-ae76-f9b51b8adf85 None admin] RBAC: Adding query filter params (name=admin) {{(pid=82026) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 19:43:09.081295 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72a3d324-6f3e-4ff9-ae76-f9b51b8adf85 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:43:09.082647 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72a3d324-6f3e-4ff9-ae76-f9b51b8adf85 None admin] RBAC: Authorization granted {{(pid=82026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:43:09.090947 dv-cinder-828806-6-smb devstack@keystone.service[82026]: [pid: 82026|app: 0|req: 544/1099] 10.222.0.33 () {56 vars in 1099 bytes} [Tue Sep 13 19:43:08 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 13 19:43:09.097077 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72a3d324-6f3e-4ff9-ae76-f9b51b8adf85 None admin] Authenticating user token {{(pid=82026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:43:09.139260 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7f3981d-3e8f-46b4-b6d2-f4bea4b5b27f None admin] Validating token access rules against request {{(pid=82025) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:43:09.141537 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG dbcounter [-] [82025] Writing DB stats keystone:SELECT=100 {{(pid=82025) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:43:09.175046 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ab15364-0017-498b-af7b-edd30f3aff35 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57539b6a6f3b4d589f5f5e1d211cd6a0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82025) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:43:09.175687 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ab15364-0017-498b-af7b-edd30f3aff35 None admin] REQUEST_METHOD: `GET` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:43:09.175971 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ab15364-0017-498b-af7b-edd30f3aff35 None admin] SCRIPT_NAME: `/identity` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:43:09.176246 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ab15364-0017-498b-af7b-edd30f3aff35 None admin] PATH_INFO: `/v3/projects/service` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:43:09.182804 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ab15364-0017-498b-af7b-edd30f3aff35 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=82025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:43:09.184669 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ab15364-0017-498b-af7b-edd30f3aff35 None admin] RBAC: Authorization granted {{(pid=82025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:43:09.194515 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72a3d324-6f3e-4ff9-ae76-f9b51b8adf85 None admin] Validating token access rules against request {{(pid=82026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:43:09.196612 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application [None req-2ab15364-0017-498b-af7b-edd30f3aff35 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 13 19:43:09.196612 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 19:43:09.196612 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 19:43:09.196612 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 19:43:09.196612 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 19:43:09.196612 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 19:43:09.196612 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 19:43:09.196612 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 19:43:09.196612 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 19:43:09.196612 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 19:43:09.196612 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 19:43:09.196612 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 19:43:09.196612 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 13 19:43:09.196612 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 13 19:43:09.196612 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 13 19:43:09.197673 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 13 19:43:09.197673 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 19:43:09.197673 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 19:43:09.197673 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 19:43:09.197673 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 19:43:09.197673 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 19:43:09.197673 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 19:43:09.197673 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 19:43:09.197673 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application with Lock( Sep 13 19:43:09.197673 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 19:43:09.197673 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application return self._enter() Sep 13 19:43:09.197673 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 19:43:09.197673 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 19:43:09.197673 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 19:43:09.197673 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application return self.creator() Sep 13 19:43:09.197673 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 19:43:09.197673 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application created_value = creator( Sep 13 19:43:09.198601 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 13 19:43:09.198601 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 13 19:43:09.198601 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 13 19:43:09.198601 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 13 19:43:09.198601 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 13 19:43:09.198601 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 13 19:43:09.198601 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 13 19:43:09.198601 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application Sep 13 19:43:09.198601 dv-cinder-828806-6-smb devstack@keystone.service[82025]: [pid: 82025|app: 0|req: 556/1100] 10.222.0.33 () {56 vars in 1111 bytes} [Tue Sep 13 19:43:09 2022] GET /identity/v3/projects/service => generated 88 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 19:43:09.203505 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ab15364-0017-498b-af7b-edd30f3aff35 None admin] Authenticating user token {{(pid=82025) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:43:09.209047 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG dbcounter [-] [82026] Writing DB stats keystone:SELECT=100 {{(pid=82026) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:43:09.229332 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98c13175-2af9-4afc-92ea-c4c199b33b8d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57539b6a6f3b4d589f5f5e1d211cd6a0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:43:09.229892 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98c13175-2af9-4afc-92ea-c4c199b33b8d None admin] REQUEST_METHOD: `GET` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:43:09.230176 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98c13175-2af9-4afc-92ea-c4c199b33b8d None admin] SCRIPT_NAME: `/identity` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:43:09.230454 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98c13175-2af9-4afc-92ea-c4c199b33b8d None admin] PATH_INFO: `/v3/users/fc4033db6dcf429aa7b1c2a543358fe5` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:43:09.231609 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98c13175-2af9-4afc-92ea-c4c199b33b8d None admin] RBAC: Authorizing `identity:get_user(user_id=fc4033db6dcf429aa7b1c2a543358fe5)` {{(pid=82026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:43:09.233067 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98c13175-2af9-4afc-92ea-c4c199b33b8d None admin] RBAC: Authorization granted {{(pid=82026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:43:09.234693 dv-cinder-828806-6-smb devstack@keystone.service[82026]: [pid: 82026|app: 0|req: 545/1101] 10.222.0.33 () {56 vars in 1177 bytes} [Tue Sep 13 19:43:09 2022] GET /identity/v3/users/fc4033db6dcf429aa7b1c2a543358fe5 => generated 285 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 13 19:43:09.240536 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98c13175-2af9-4afc-92ea-c4c199b33b8d None admin] Authenticating user token {{(pid=82026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:43:09.305608 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ab15364-0017-498b-af7b-edd30f3aff35 None admin] Validating token access rules against request {{(pid=82025) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:43:09.339783 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98c13175-2af9-4afc-92ea-c4c199b33b8d None admin] Validating token access rules against request {{(pid=82026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:43:09.340051 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-254eb797-72f7-41f4-9221-900b06d8ae80 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57539b6a6f3b4d589f5f5e1d211cd6a0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82025) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:43:09.340652 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-254eb797-72f7-41f4-9221-900b06d8ae80 None admin] REQUEST_METHOD: `GET` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:43:09.340935 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-254eb797-72f7-41f4-9221-900b06d8ae80 None admin] SCRIPT_NAME: `/identity` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:43:09.341210 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-254eb797-72f7-41f4-9221-900b06d8ae80 None admin] PATH_INFO: `/v3/projects` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:43:09.341903 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-254eb797-72f7-41f4-9221-900b06d8ae80 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=82025) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 19:43:09.342213 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-254eb797-72f7-41f4-9221-900b06d8ae80 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=82025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:43:09.343670 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-254eb797-72f7-41f4-9221-900b06d8ae80 None admin] RBAC: Authorization granted {{(pid=82025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:43:09.355759 dv-cinder-828806-6-smb devstack@keystone.service[82025]: [pid: 82025|app: 0|req: 557/1102] 10.222.0.33 () {56 vars in 1148 bytes} [Tue Sep 13 19:43:09 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 13 19:43:09.361627 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-254eb797-72f7-41f4-9221-900b06d8ae80 None admin] Authenticating user token {{(pid=82025) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:43:09.373141 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3da84164-dcc6-49d5-bfed-65f228027f22 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57539b6a6f3b4d589f5f5e1d211cd6a0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:43:09.373748 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3da84164-dcc6-49d5-bfed-65f228027f22 None admin] REQUEST_METHOD: `GET` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:43:09.374033 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3da84164-dcc6-49d5-bfed-65f228027f22 None admin] SCRIPT_NAME: `/identity` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:43:09.374307 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3da84164-dcc6-49d5-bfed-65f228027f22 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:43:09.387413 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG dbcounter [-] [82025] Writing DB stats keystone:SELECT=100 {{(pid=82025) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:43:09.424925 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG dbcounter [-] [82026] Writing DB stats keystone:SELECT=100 {{(pid=82026) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:43:09.446581 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3da84164-dcc6-49d5-bfed-65f228027f22 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=82026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:43:09.448111 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3da84164-dcc6-49d5-bfed-65f228027f22 None admin] RBAC: Authorization granted {{(pid=82026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:43:09.474180 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-254eb797-72f7-41f4-9221-900b06d8ae80 None admin] Validating token access rules against request {{(pid=82025) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:43:09.509478 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e87204c-a7f5-4dbe-b0e2-b07331478654 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57539b6a6f3b4d589f5f5e1d211cd6a0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82025) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:43:09.510006 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e87204c-a7f5-4dbe-b0e2-b07331478654 None admin] REQUEST_METHOD: `GET` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:43:09.510295 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e87204c-a7f5-4dbe-b0e2-b07331478654 None admin] SCRIPT_NAME: `/identity` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:43:09.510572 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e87204c-a7f5-4dbe-b0e2-b07331478654 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:43:09.511491 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e87204c-a7f5-4dbe-b0e2-b07331478654 None admin] RBAC: Adding query filter params (role.id=2d9e933a00cb40c3bb31cbfc8127f9ec, scope.project.id=c8c6fba0f15b4d6a84ff601919b7b8e4, user.id=e66e7034abed4e0bad1f4137520c1e70) {{(pid=82025) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 19:43:09.511805 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e87204c-a7f5-4dbe-b0e2-b07331478654 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=82025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:43:09.513234 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e87204c-a7f5-4dbe-b0e2-b07331478654 None admin] RBAC: Authorization granted {{(pid=82025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:43:09.519989 dv-cinder-828806-6-smb devstack@keystone.service[82025]: [pid: 82025|app: 0|req: 558/1103] 10.222.0.33 () {56 vars in 1374 bytes} [Tue Sep 13 19:43:09 2022] GET /identity/v3/role_assignments?user.id=e66e7034abed4e0bad1f4137520c1e70&scope.project.id=c8c6fba0f15b4d6a84ff601919b7b8e4&role.id=2d9e933a00cb40c3bb31cbfc8127f9ec => generated 608 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 13 19:43:09.555534 dv-cinder-828806-6-smb devstack@keystone.service[82026]: [pid: 82026|app: 0|req: 546/1104] 10.222.0.33 () {58 vars in 1282 bytes} [Tue Sep 13 19:43:09 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 315 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Sep 13 19:43:09.563056 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e87204c-a7f5-4dbe-b0e2-b07331478654 None admin] Authenticating user token {{(pid=82025) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:43:09.691650 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG dbcounter [-] [82025] Writing DB stats keystone:SELECT=100 {{(pid=82025) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:43:09.708188 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e87204c-a7f5-4dbe-b0e2-b07331478654 None admin] Validating token access rules against request {{(pid=82025) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:43:09.748433 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50f4f589-0ecd-4889-95ec-6b6b2dc49de5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57539b6a6f3b4d589f5f5e1d211cd6a0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82025) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:43:09.749189 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50f4f589-0ecd-4889-95ec-6b6b2dc49de5 None admin] REQUEST_METHOD: `GET` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:43:09.749543 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50f4f589-0ecd-4889-95ec-6b6b2dc49de5 None admin] SCRIPT_NAME: `/identity` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:43:09.749895 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50f4f589-0ecd-4889-95ec-6b6b2dc49de5 None admin] PATH_INFO: `/v3/projects/024b16f822e545dca8d1e8e3cc6f0f2c` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:43:09.751077 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50f4f589-0ecd-4889-95ec-6b6b2dc49de5 None admin] RBAC: Authorizing `identity:get_project(project_id=024b16f822e545dca8d1e8e3cc6f0f2c)` {{(pid=82025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:43:09.753050 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50f4f589-0ecd-4889-95ec-6b6b2dc49de5 None admin] RBAC: Authorization granted {{(pid=82025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:43:09.754804 dv-cinder-828806-6-smb devstack@keystone.service[82025]: [pid: 82025|app: 0|req: 559/1105] 10.222.0.33 () {56 vars in 1186 bytes} [Tue Sep 13 19:43:09 2022] GET /identity/v3/projects/024b16f822e545dca8d1e8e3cc6f0f2c => generated 311 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 19:43:09.762662 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3da84164-dcc6-49d5-bfed-65f228027f22 None admin] Authenticating user token {{(pid=82026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:43:09.871755 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG dbcounter [-] [82026] Writing DB stats keystone:SELECT=100 {{(pid=82026) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:43:09.895570 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3da84164-dcc6-49d5-bfed-65f228027f22 None admin] Validating token access rules against request {{(pid=82026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:43:09.933453 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a35b00ea-4b0e-41ba-abab-cbd864fc0b4f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57539b6a6f3b4d589f5f5e1d211cd6a0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:43:09.934067 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a35b00ea-4b0e-41ba-abab-cbd864fc0b4f None admin] REQUEST_METHOD: `GET` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:43:09.934354 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a35b00ea-4b0e-41ba-abab-cbd864fc0b4f None admin] SCRIPT_NAME: `/identity` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:43:09.934634 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a35b00ea-4b0e-41ba-abab-cbd864fc0b4f None admin] PATH_INFO: `/v3/role_assignments` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:43:09.935412 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a35b00ea-4b0e-41ba-abab-cbd864fc0b4f None admin] RBAC: Adding query filter params (role.id=e5af7d5baa93469e9e486ef21c85474e, scope.project.id=024b16f822e545dca8d1e8e3cc6f0f2c, user.id=fc4033db6dcf429aa7b1c2a543358fe5) {{(pid=82026) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 19:43:09.935733 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a35b00ea-4b0e-41ba-abab-cbd864fc0b4f None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=82026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:43:09.937188 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a35b00ea-4b0e-41ba-abab-cbd864fc0b4f None admin] RBAC: Authorization granted {{(pid=82026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:43:09.944003 dv-cinder-828806-6-smb devstack@keystone.service[82026]: [pid: 82026|app: 0|req: 547/1106] 10.222.0.33 () {56 vars in 1374 bytes} [Tue Sep 13 19:43:09 2022] GET /identity/v3/role_assignments?user.id=fc4033db6dcf429aa7b1c2a543358fe5&scope.project.id=024b16f822e545dca8d1e8e3cc6f0f2c&role.id=e5af7d5baa93469e9e486ef21c85474e => generated 608 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 19:43:12.200817 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d8e9f81-f246-45a9-a02f-45a1a2f1b1df None None] REQUEST_METHOD: `GET` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:43:12.201351 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d8e9f81-f246-45a9-a02f-45a1a2f1b1df None None] SCRIPT_NAME: `/identity` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:43:12.201351 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d8e9f81-f246-45a9-a02f-45a1a2f1b1df None None] PATH_INFO: `/` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:43:12.202725 dv-cinder-828806-6-smb devstack@keystone.service[82025]: [pid: 82025|app: 0|req: 560/1107] 10.222.0.33 () {54 vars in 927 bytes} [Tue Sep 13 19:43:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 19:43:12.208547 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9a061aa-7efd-4743-8e27-f005f072a29d None None] REQUEST_METHOD: `POST` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:43:12.208980 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9a061aa-7efd-4743-8e27-f005f072a29d None None] SCRIPT_NAME: `/identity` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:43:12.209112 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9a061aa-7efd-4743-8e27-f005f072a29d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:43:12.228417 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.auth.core [None req-b9a061aa-7efd-4743-8e27-f005f072a29d None None] MFA Rules not processed for user `57539b6a6f3b4d589f5f5e1d211cd6a0`. Rule list: `[]` (Enabled: `True`). {{(pid=82026) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 19:43:12.229596 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.common.fernet_utils [None req-b9a061aa-7efd-4743-8e27-f005f072a29d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82026) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 19:43:12.294440 dv-cinder-828806-6-smb devstack@keystone.service[82026]: [pid: 82026|app: 0|req: 548/1108] 10.222.0.33 () {58 vars in 1024 bytes} [Tue Sep 13 19:43:12 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 13 19:43:12.567913 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d8e9f81-f246-45a9-a02f-45a1a2f1b1df None None] Authenticating user token {{(pid=82025) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:43:12.667505 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d8e9f81-f246-45a9-a02f-45a1a2f1b1df None None] Validating token access rules against request {{(pid=82025) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:43:12.700109 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b38005c-e602-4f45-85c9-202a9ccdaa3e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57539b6a6f3b4d589f5f5e1d211cd6a0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82025) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:43:12.700730 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b38005c-e602-4f45-85c9-202a9ccdaa3e None admin] REQUEST_METHOD: `GET` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:43:12.701017 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b38005c-e602-4f45-85c9-202a9ccdaa3e None admin] SCRIPT_NAME: `/identity` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:43:12.701295 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b38005c-e602-4f45-85c9-202a9ccdaa3e None admin] PATH_INFO: `/v3/domains/default` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:43:12.702407 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b38005c-e602-4f45-85c9-202a9ccdaa3e None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=82025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:43:12.703866 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b38005c-e602-4f45-85c9-202a9ccdaa3e None admin] RBAC: Authorization granted {{(pid=82025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:43:12.705431 dv-cinder-828806-6-smb devstack@keystone.service[82025]: [pid: 82025|app: 0|req: 561/1109] 10.222.0.33 () {56 vars in 1108 bytes} [Tue Sep 13 19:43:12 2022] GET /identity/v3/domains/default => generated 199 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 19:43:12.711871 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9a061aa-7efd-4743-8e27-f005f072a29d None None] Authenticating user token {{(pid=82026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:43:12.784406 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG dbcounter [-] [82026] Writing DB stats keystone:SELECT=100 {{(pid=82026) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:43:12.805867 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9a061aa-7efd-4743-8e27-f005f072a29d None None] Validating token access rules against request {{(pid=82026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:43:12.838839 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c42318f-2d15-4ac1-b525-7ebcca540f85 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57539b6a6f3b4d589f5f5e1d211cd6a0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:43:12.839401 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c42318f-2d15-4ac1-b525-7ebcca540f85 None admin] REQUEST_METHOD: `POST` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:43:12.839684 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c42318f-2d15-4ac1-b525-7ebcca540f85 None admin] SCRIPT_NAME: `/identity` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:43:12.839957 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c42318f-2d15-4ac1-b525-7ebcca540f85 None admin] PATH_INFO: `/v3/users` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:43:12.840605 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c42318f-2d15-4ac1-b525-7ebcca540f85 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=82026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:43:12.842026 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c42318f-2d15-4ac1-b525-7ebcca540f85 None admin] RBAC: Authorization granted {{(pid=82026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:43:12.927768 dv-cinder-828806-6-smb devstack@keystone.service[82026]: [pid: 82026|app: 0|req: 549/1110] 10.222.0.33 () {60 vars in 1132 bytes} [Tue Sep 13 19:43:12 2022] POST /identity/v3/users => generated 286 bytes in 216 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 13 19:43:15.117834 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82a48cd7-75b6-43cd-9a3e-b38f4970f25b None None] REQUEST_METHOD: `GET` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:43:15.118365 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82a48cd7-75b6-43cd-9a3e-b38f4970f25b None None] SCRIPT_NAME: `/identity` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:43:15.118365 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82a48cd7-75b6-43cd-9a3e-b38f4970f25b None None] PATH_INFO: `/` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:43:15.119769 dv-cinder-828806-6-smb devstack@keystone.service[82025]: [pid: 82025|app: 0|req: 562/1111] 10.222.0.33 () {54 vars in 927 bytes} [Tue Sep 13 19:43:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 19:43:15.124831 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14ed94c5-3807-4af5-835d-b2d8035fa8c4 None None] REQUEST_METHOD: `POST` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:43:15.125245 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14ed94c5-3807-4af5-835d-b2d8035fa8c4 None None] SCRIPT_NAME: `/identity` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:43:15.125383 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14ed94c5-3807-4af5-835d-b2d8035fa8c4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:43:15.143980 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.auth.core [None req-14ed94c5-3807-4af5-835d-b2d8035fa8c4 None None] MFA Rules not processed for user `57539b6a6f3b4d589f5f5e1d211cd6a0`. Rule list: `[]` (Enabled: `True`). {{(pid=82026) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 19:43:15.145152 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.common.fernet_utils [None req-14ed94c5-3807-4af5-835d-b2d8035fa8c4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82026) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 19:43:15.210053 dv-cinder-828806-6-smb devstack@keystone.service[82026]: [pid: 82026|app: 0|req: 550/1112] 10.222.0.33 () {58 vars in 1024 bytes} [Tue Sep 13 19:43:15 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 13 19:43:15.476906 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82a48cd7-75b6-43cd-9a3e-b38f4970f25b None None] Authenticating user token {{(pid=82025) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:43:15.504108 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG dbcounter [-] [82025] Writing DB stats keystone:SELECT=100 {{(pid=82025) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:43:15.577871 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82a48cd7-75b6-43cd-9a3e-b38f4970f25b None None] Validating token access rules against request {{(pid=82025) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:43:15.610972 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66e98800-9586-4a0d-b519-4d020f238166 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57539b6a6f3b4d589f5f5e1d211cd6a0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82025) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:43:15.611622 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66e98800-9586-4a0d-b519-4d020f238166 None admin] REQUEST_METHOD: `GET` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:43:15.612486 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66e98800-9586-4a0d-b519-4d020f238166 None admin] SCRIPT_NAME: `/identity` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:43:15.612991 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66e98800-9586-4a0d-b519-4d020f238166 None admin] PATH_INFO: `/v3/roles/6bcd095c76b341e186ea8caa11f5fa31` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:43:15.614491 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66e98800-9586-4a0d-b519-4d020f238166 None admin] RBAC: Authorizing `identity:get_role(role_id=6bcd095c76b341e186ea8caa11f5fa31)` {{(pid=82025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:43:15.615883 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66e98800-9586-4a0d-b519-4d020f238166 None admin] RBAC: Authorization granted {{(pid=82025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:43:15.617194 dv-cinder-828806-6-smb devstack@keystone.service[82025]: [pid: 82025|app: 0|req: 563/1113] 10.222.0.33 () {56 vars in 1177 bytes} [Tue Sep 13 19:43:15 2022] GET /identity/v3/roles/6bcd095c76b341e186ea8caa11f5fa31 => generated 223 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 19:43:15.622828 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14ed94c5-3807-4af5-835d-b2d8035fa8c4 None None] Authenticating user token {{(pid=82026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:43:15.692904 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG dbcounter [-] [82026] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=82026) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:43:15.731646 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14ed94c5-3807-4af5-835d-b2d8035fa8c4 None None] Validating token access rules against request {{(pid=82026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:43:15.765739 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f6e2e86-4027-45fc-855c-9351aa04d140 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57539b6a6f3b4d589f5f5e1d211cd6a0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:43:15.766365 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f6e2e86-4027-45fc-855c-9351aa04d140 None admin] REQUEST_METHOD: `GET` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:43:15.766652 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f6e2e86-4027-45fc-855c-9351aa04d140 None admin] SCRIPT_NAME: `/identity` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:43:15.766934 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f6e2e86-4027-45fc-855c-9351aa04d140 None admin] PATH_INFO: `/v3/users/bf67677653e34d7c95b05ad89b29e4c6` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:43:15.780029 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f6e2e86-4027-45fc-855c-9351aa04d140 None admin] RBAC: Authorizing `identity:get_user(user_id=bf67677653e34d7c95b05ad89b29e4c6)` {{(pid=82026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:43:15.781471 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f6e2e86-4027-45fc-855c-9351aa04d140 None admin] RBAC: Authorization granted {{(pid=82026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:43:15.783080 dv-cinder-828806-6-smb devstack@keystone.service[82026]: [pid: 82026|app: 0|req: 551/1114] 10.222.0.33 () {56 vars in 1177 bytes} [Tue Sep 13 19:43:15 2022] GET /identity/v3/users/bf67677653e34d7c95b05ad89b29e4c6 => generated 286 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 19:43:15.789607 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66e98800-9586-4a0d-b519-4d020f238166 None admin] Authenticating user token {{(pid=82025) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:43:15.879373 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG dbcounter [-] [82025] Writing DB stats keystone:SELECT=100 {{(pid=82025) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:43:15.888055 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66e98800-9586-4a0d-b519-4d020f238166 None admin] Validating token access rules against request {{(pid=82025) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:43:15.922821 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd5008ab-ab74-4f66-8d4b-e90eb0e70e7c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57539b6a6f3b4d589f5f5e1d211cd6a0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82025) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:43:15.923447 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd5008ab-ab74-4f66-8d4b-e90eb0e70e7c None admin] REQUEST_METHOD: `GET` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:43:15.923734 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd5008ab-ab74-4f66-8d4b-e90eb0e70e7c None admin] SCRIPT_NAME: `/identity` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:43:15.924012 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd5008ab-ab74-4f66-8d4b-e90eb0e70e7c None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:43:15.990091 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd5008ab-ab74-4f66-8d4b-e90eb0e70e7c None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=82025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:43:15.991493 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd5008ab-ab74-4f66-8d4b-e90eb0e70e7c None admin] RBAC: Authorization granted {{(pid=82025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:43:16.077838 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG dbcounter [-] [82025] Writing DB stats keystone:SELECT=100 {{(pid=82025) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:43:16.087467 dv-cinder-828806-6-smb devstack@keystone.service[82025]: [pid: 82025|app: 0|req: 564/1115] 10.222.0.33 () {58 vars in 1282 bytes} [Tue Sep 13 19:43:15 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 298 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Sep 13 19:43:16.093340 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f6e2e86-4027-45fc-855c-9351aa04d140 None admin] Authenticating user token {{(pid=82026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:43:16.190196 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f6e2e86-4027-45fc-855c-9351aa04d140 None admin] Validating token access rules against request {{(pid=82026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:43:16.209896 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG dbcounter [-] [82026] Writing DB stats keystone:SELECT=100 {{(pid=82026) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:43:16.223612 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc12356c-7f42-4640-be8c-8ebe81acbfa5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57539b6a6f3b4d589f5f5e1d211cd6a0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:43:16.224228 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc12356c-7f42-4640-be8c-8ebe81acbfa5 None admin] REQUEST_METHOD: `GET` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:43:16.224509 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc12356c-7f42-4640-be8c-8ebe81acbfa5 None admin] SCRIPT_NAME: `/identity` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:43:16.224783 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc12356c-7f42-4640-be8c-8ebe81acbfa5 None admin] PATH_INFO: `/v3/projects/024b16f822e545dca8d1e8e3cc6f0f2c` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:43:16.225883 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc12356c-7f42-4640-be8c-8ebe81acbfa5 None admin] RBAC: Authorizing `identity:get_project(project_id=024b16f822e545dca8d1e8e3cc6f0f2c)` {{(pid=82026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:43:16.227335 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc12356c-7f42-4640-be8c-8ebe81acbfa5 None admin] RBAC: Authorization granted {{(pid=82026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:43:16.228930 dv-cinder-828806-6-smb devstack@keystone.service[82026]: [pid: 82026|app: 0|req: 552/1116] 10.222.0.33 () {56 vars in 1186 bytes} [Tue Sep 13 19:43:16 2022] GET /identity/v3/projects/024b16f822e545dca8d1e8e3cc6f0f2c => generated 311 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 19:43:16.235086 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd5008ab-ab74-4f66-8d4b-e90eb0e70e7c None admin] Authenticating user token {{(pid=82025) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:43:16.331918 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd5008ab-ab74-4f66-8d4b-e90eb0e70e7c None admin] Validating token access rules against request {{(pid=82025) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:43:16.364200 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-691e3759-8974-45b4-a578-c8e5aaaeed40 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57539b6a6f3b4d589f5f5e1d211cd6a0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82025) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:43:16.364793 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-691e3759-8974-45b4-a578-c8e5aaaeed40 None admin] REQUEST_METHOD: `GET` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:43:16.365077 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-691e3759-8974-45b4-a578-c8e5aaaeed40 None admin] SCRIPT_NAME: `/identity` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:43:16.365353 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-691e3759-8974-45b4-a578-c8e5aaaeed40 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:43:16.366070 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-691e3759-8974-45b4-a578-c8e5aaaeed40 None admin] RBAC: Adding query filter params (role.id=6bcd095c76b341e186ea8caa11f5fa31, scope.project.id=024b16f822e545dca8d1e8e3cc6f0f2c, user.id=bf67677653e34d7c95b05ad89b29e4c6) {{(pid=82025) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 19:43:16.366382 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-691e3759-8974-45b4-a578-c8e5aaaeed40 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=82025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:43:16.367829 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-691e3759-8974-45b4-a578-c8e5aaaeed40 None admin] RBAC: Authorization granted {{(pid=82025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:43:16.372969 dv-cinder-828806-6-smb devstack@keystone.service[82025]: [pid: 82025|app: 0|req: 565/1117] 10.222.0.33 () {56 vars in 1374 bytes} [Tue Sep 13 19:43:16 2022] GET /identity/v3/role_assignments?user.id=bf67677653e34d7c95b05ad89b29e4c6&scope.project.id=024b16f822e545dca8d1e8e3cc6f0f2c&role.id=6bcd095c76b341e186ea8caa11f5fa31 => generated 259 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 19:43:18.481092 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6db1382d-b1a7-439a-8450-dcefa9debf67 None None] REQUEST_METHOD: `GET` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:43:18.481633 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6db1382d-b1a7-439a-8450-dcefa9debf67 None None] SCRIPT_NAME: `/identity` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:43:18.481633 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6db1382d-b1a7-439a-8450-dcefa9debf67 None None] PATH_INFO: `/` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:43:18.482989 dv-cinder-828806-6-smb devstack@keystone.service[82026]: [pid: 82026|app: 0|req: 553/1118] 10.222.0.33 () {54 vars in 927 bytes} [Tue Sep 13 19:43:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 19:43:18.488415 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b033ac1a-5dd4-449a-981f-b3264378e9c8 None None] REQUEST_METHOD: `POST` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:43:18.488838 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b033ac1a-5dd4-449a-981f-b3264378e9c8 None None] SCRIPT_NAME: `/identity` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:43:18.488980 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b033ac1a-5dd4-449a-981f-b3264378e9c8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:43:18.507525 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.auth.core [None req-b033ac1a-5dd4-449a-981f-b3264378e9c8 None None] MFA Rules not processed for user `57539b6a6f3b4d589f5f5e1d211cd6a0`. Rule list: `[]` (Enabled: `True`). {{(pid=82025) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 19:43:18.508717 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.fernet_utils [None req-b033ac1a-5dd4-449a-981f-b3264378e9c8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82025) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 19:43:18.559167 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG dbcounter [-] [82025] Writing DB stats keystone:SELECT=100 {{(pid=82025) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:43:18.576382 dv-cinder-828806-6-smb devstack@keystone.service[82025]: [pid: 82025|app: 0|req: 566/1119] 10.222.0.33 () {58 vars in 1024 bytes} [Tue Sep 13 19:43:18 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 13 19:43:18.847417 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6db1382d-b1a7-439a-8450-dcefa9debf67 None None] Authenticating user token {{(pid=82026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:43:18.945875 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6db1382d-b1a7-439a-8450-dcefa9debf67 None None] Validating token access rules against request {{(pid=82026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:43:18.978651 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-975d653d-7a4e-48fa-8d49-0bbb3932bf2f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57539b6a6f3b4d589f5f5e1d211cd6a0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:43:18.979283 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-975d653d-7a4e-48fa-8d49-0bbb3932bf2f None admin] REQUEST_METHOD: `GET` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:43:18.979568 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-975d653d-7a4e-48fa-8d49-0bbb3932bf2f None admin] SCRIPT_NAME: `/identity` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:43:18.979840 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-975d653d-7a4e-48fa-8d49-0bbb3932bf2f None admin] PATH_INFO: `/v3/roles/6bcd095c76b341e186ea8caa11f5fa31` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:43:18.981221 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-975d653d-7a4e-48fa-8d49-0bbb3932bf2f None admin] RBAC: Authorizing `identity:get_role(role_id=6bcd095c76b341e186ea8caa11f5fa31)` {{(pid=82026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:43:18.982588 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-975d653d-7a4e-48fa-8d49-0bbb3932bf2f None admin] RBAC: Authorization granted {{(pid=82026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:43:18.983914 dv-cinder-828806-6-smb devstack@keystone.service[82026]: [pid: 82026|app: 0|req: 554/1120] 10.222.0.33 () {56 vars in 1177 bytes} [Tue Sep 13 19:43:18 2022] GET /identity/v3/roles/6bcd095c76b341e186ea8caa11f5fa31 => generated 223 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 19:43:18.990272 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b033ac1a-5dd4-449a-981f-b3264378e9c8 None None] Authenticating user token {{(pid=82025) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:43:19.087343 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b033ac1a-5dd4-449a-981f-b3264378e9c8 None None] Validating token access rules against request {{(pid=82025) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:43:19.120866 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3654b16-a9dc-4c86-8c4a-ec00296d20c2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57539b6a6f3b4d589f5f5e1d211cd6a0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82025) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:43:19.121419 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3654b16-a9dc-4c86-8c4a-ec00296d20c2 None admin] REQUEST_METHOD: `GET` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:43:19.121700 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3654b16-a9dc-4c86-8c4a-ec00296d20c2 None admin] SCRIPT_NAME: `/identity` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:43:19.121973 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3654b16-a9dc-4c86-8c4a-ec00296d20c2 None admin] PATH_INFO: `/v3/users/bf67677653e34d7c95b05ad89b29e4c6` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:43:19.123099 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3654b16-a9dc-4c86-8c4a-ec00296d20c2 None admin] RBAC: Authorizing `identity:get_user(user_id=bf67677653e34d7c95b05ad89b29e4c6)` {{(pid=82025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:43:19.124515 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3654b16-a9dc-4c86-8c4a-ec00296d20c2 None admin] RBAC: Authorization granted {{(pid=82025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:43:19.126063 dv-cinder-828806-6-smb devstack@keystone.service[82025]: [pid: 82025|app: 0|req: 567/1121] 10.222.0.33 () {56 vars in 1177 bytes} [Tue Sep 13 19:43:18 2022] GET /identity/v3/users/bf67677653e34d7c95b05ad89b29e4c6 => generated 286 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 19:43:19.132510 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-975d653d-7a4e-48fa-8d49-0bbb3932bf2f None admin] Authenticating user token {{(pid=82026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:43:19.186236 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG dbcounter [-] [82026] Writing DB stats keystone:SELECT=100 {{(pid=82026) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:43:19.227893 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-975d653d-7a4e-48fa-8d49-0bbb3932bf2f None admin] Validating token access rules against request {{(pid=82026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:43:19.260696 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73b6c4d4-6264-4a67-a78d-a123edaa11d1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57539b6a6f3b4d589f5f5e1d211cd6a0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:43:19.261305 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73b6c4d4-6264-4a67-a78d-a123edaa11d1 None admin] REQUEST_METHOD: `GET` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:43:19.261585 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73b6c4d4-6264-4a67-a78d-a123edaa11d1 None admin] SCRIPT_NAME: `/identity` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:43:19.261858 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73b6c4d4-6264-4a67-a78d-a123edaa11d1 None admin] PATH_INFO: `/v3/projects/024b16f822e545dca8d1e8e3cc6f0f2c` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:43:19.262948 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73b6c4d4-6264-4a67-a78d-a123edaa11d1 None admin] RBAC: Authorizing `identity:get_project(project_id=024b16f822e545dca8d1e8e3cc6f0f2c)` {{(pid=82026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:43:19.264393 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73b6c4d4-6264-4a67-a78d-a123edaa11d1 None admin] RBAC: Authorization granted {{(pid=82026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:43:19.265985 dv-cinder-828806-6-smb devstack@keystone.service[82026]: [pid: 82026|app: 0|req: 555/1122] 10.222.0.33 () {56 vars in 1186 bytes} [Tue Sep 13 19:43:19 2022] GET /identity/v3/projects/024b16f822e545dca8d1e8e3cc6f0f2c => generated 311 bytes in 134 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 19:43:19.272089 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3654b16-a9dc-4c86-8c4a-ec00296d20c2 None admin] Authenticating user token {{(pid=82025) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:43:19.326920 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG dbcounter [-] [82025] Writing DB stats keystone:SELECT=100 {{(pid=82025) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:43:19.375559 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3654b16-a9dc-4c86-8c4a-ec00296d20c2 None admin] Validating token access rules against request {{(pid=82025) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:43:19.413052 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fdaf5c7-f5cc-40f9-bd93-8d512e9a7e08 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57539b6a6f3b4d589f5f5e1d211cd6a0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82025) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:43:19.413700 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fdaf5c7-f5cc-40f9-bd93-8d512e9a7e08 None admin] REQUEST_METHOD: `PUT` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:43:19.413984 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fdaf5c7-f5cc-40f9-bd93-8d512e9a7e08 None admin] SCRIPT_NAME: `/identity` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:43:19.414257 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fdaf5c7-f5cc-40f9-bd93-8d512e9a7e08 None admin] PATH_INFO: `/v3/projects/024b16f822e545dca8d1e8e3cc6f0f2c/users/bf67677653e34d7c95b05ad89b29e4c6/roles/6bcd095c76b341e186ea8caa11f5fa31` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:43:19.416407 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fdaf5c7-f5cc-40f9-bd93-8d512e9a7e08 None admin] RBAC: Authorizing `identity:create_grant(project_id=024b16f822e545dca8d1e8e3cc6f0f2c, user_id=bf67677653e34d7c95b05ad89b29e4c6, role_id=6bcd095c76b341e186ea8caa11f5fa31)` {{(pid=82025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:43:19.417825 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fdaf5c7-f5cc-40f9-bd93-8d512e9a7e08 None admin] RBAC: Authorization granted {{(pid=82025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:43:19.507669 dv-cinder-828806-6-smb devstack@keystone.service[82025]: [pid: 82025|app: 0|req: 568/1123] 10.222.0.33 () {58 vars in 1439 bytes} [Tue Sep 13 19:43:19 2022] PUT /identity/v3/projects/024b16f822e545dca8d1e8e3cc6f0f2c/users/bf67677653e34d7c95b05ad89b29e4c6/roles/6bcd095c76b341e186ea8caa11f5fa31 => generated 0 bytes in 236 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 19:43:21.611017 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d4046cf-eba6-4f2d-8886-aba1767f3318 None None] REQUEST_METHOD: `GET` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:43:21.611553 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d4046cf-eba6-4f2d-8886-aba1767f3318 None None] SCRIPT_NAME: `/identity` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:43:21.611647 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d4046cf-eba6-4f2d-8886-aba1767f3318 None None] PATH_INFO: `/` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:43:21.612963 dv-cinder-828806-6-smb devstack@keystone.service[82026]: [pid: 82026|app: 0|req: 556/1124] 10.222.0.33 () {54 vars in 927 bytes} [Tue Sep 13 19:43:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 19:43:21.618174 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a63c975-7847-4022-96e6-770ac0c0835f None None] REQUEST_METHOD: `POST` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:43:21.618588 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a63c975-7847-4022-96e6-770ac0c0835f None None] SCRIPT_NAME: `/identity` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:43:21.618732 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a63c975-7847-4022-96e6-770ac0c0835f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:43:21.636949 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.auth.core [None req-1a63c975-7847-4022-96e6-770ac0c0835f None None] MFA Rules not processed for user `57539b6a6f3b4d589f5f5e1d211cd6a0`. Rule list: `[]` (Enabled: `True`). {{(pid=82025) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 19:43:21.638139 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.fernet_utils [None req-1a63c975-7847-4022-96e6-770ac0c0835f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82025) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 19:43:21.707347 dv-cinder-828806-6-smb devstack@keystone.service[82025]: [pid: 82025|app: 0|req: 569/1125] 10.222.0.33 () {58 vars in 1024 bytes} [Tue Sep 13 19:43:21 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 13 19:43:21.980421 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d4046cf-eba6-4f2d-8886-aba1767f3318 None None] Authenticating user token {{(pid=82026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:43:22.079149 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d4046cf-eba6-4f2d-8886-aba1767f3318 None None] Validating token access rules against request {{(pid=82026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:43:22.102494 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG dbcounter [-] [82026] Writing DB stats keystone:SELECT=100 {{(pid=82026) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:43:22.112927 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d942c3cc-06ef-435f-bb6b-c58119eee87b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57539b6a6f3b4d589f5f5e1d211cd6a0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:43:22.113549 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d942c3cc-06ef-435f-bb6b-c58119eee87b None admin] REQUEST_METHOD: `GET` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:43:22.113873 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d942c3cc-06ef-435f-bb6b-c58119eee87b None admin] SCRIPT_NAME: `/identity` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:43:22.114153 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d942c3cc-06ef-435f-bb6b-c58119eee87b None admin] PATH_INFO: `/v3/roles/6bcd095c76b341e186ea8caa11f5fa31` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:43:22.115589 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d942c3cc-06ef-435f-bb6b-c58119eee87b None admin] RBAC: Authorizing `identity:get_role(role_id=6bcd095c76b341e186ea8caa11f5fa31)` {{(pid=82026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:43:22.119563 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d942c3cc-06ef-435f-bb6b-c58119eee87b None admin] RBAC: Authorization granted {{(pid=82026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:43:22.119563 dv-cinder-828806-6-smb devstack@keystone.service[82026]: [pid: 82026|app: 0|req: 557/1126] 10.222.0.33 () {56 vars in 1177 bytes} [Tue Sep 13 19:43:21 2022] GET /identity/v3/roles/6bcd095c76b341e186ea8caa11f5fa31 => generated 223 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 19:43:22.124069 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a63c975-7847-4022-96e6-770ac0c0835f None None] Authenticating user token {{(pid=82025) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:43:22.168560 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG dbcounter [-] [82025] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82025) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:43:22.220551 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a63c975-7847-4022-96e6-770ac0c0835f None None] Validating token access rules against request {{(pid=82025) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:43:22.254433 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-798a3769-6acf-4bc3-bf33-19b4a98bb68b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57539b6a6f3b4d589f5f5e1d211cd6a0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82025) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:43:22.254979 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-798a3769-6acf-4bc3-bf33-19b4a98bb68b None admin] REQUEST_METHOD: `GET` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:43:22.255288 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-798a3769-6acf-4bc3-bf33-19b4a98bb68b None admin] SCRIPT_NAME: `/identity` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:43:22.255562 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-798a3769-6acf-4bc3-bf33-19b4a98bb68b None admin] PATH_INFO: `/v3/users/bf67677653e34d7c95b05ad89b29e4c6` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:43:22.256663 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-798a3769-6acf-4bc3-bf33-19b4a98bb68b None admin] RBAC: Authorizing `identity:get_user(user_id=bf67677653e34d7c95b05ad89b29e4c6)` {{(pid=82025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:43:22.258075 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-798a3769-6acf-4bc3-bf33-19b4a98bb68b None admin] RBAC: Authorization granted {{(pid=82025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:43:22.259665 dv-cinder-828806-6-smb devstack@keystone.service[82025]: [pid: 82025|app: 0|req: 570/1127] 10.222.0.33 () {56 vars in 1177 bytes} [Tue Sep 13 19:43:22 2022] GET /identity/v3/users/bf67677653e34d7c95b05ad89b29e4c6 => generated 286 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 19:43:22.265451 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d942c3cc-06ef-435f-bb6b-c58119eee87b None admin] Authenticating user token {{(pid=82026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:43:22.362380 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d942c3cc-06ef-435f-bb6b-c58119eee87b None admin] Validating token access rules against request {{(pid=82026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:43:22.396752 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc0600ee-4648-4ef7-8d8b-802a14a49f15 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57539b6a6f3b4d589f5f5e1d211cd6a0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:43:22.397344 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc0600ee-4648-4ef7-8d8b-802a14a49f15 None admin] REQUEST_METHOD: `GET` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:43:22.397625 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc0600ee-4648-4ef7-8d8b-802a14a49f15 None admin] SCRIPT_NAME: `/identity` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:43:22.397903 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc0600ee-4648-4ef7-8d8b-802a14a49f15 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:43:22.454094 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG dbcounter [-] [82026] Writing DB stats keystone:SELECT=100 {{(pid=82026) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:43:22.463617 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc0600ee-4648-4ef7-8d8b-802a14a49f15 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=82026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:43:22.465057 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc0600ee-4648-4ef7-8d8b-802a14a49f15 None admin] RBAC: Authorization granted {{(pid=82026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:43:22.558576 dv-cinder-828806-6-smb devstack@keystone.service[82026]: [pid: 82026|app: 0|req: 558/1128] 10.222.0.33 () {58 vars in 1282 bytes} [Tue Sep 13 19:43:22 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 294 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Sep 13 19:43:22.564580 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-798a3769-6acf-4bc3-bf33-19b4a98bb68b None admin] Authenticating user token {{(pid=82025) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:43:22.663470 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-798a3769-6acf-4bc3-bf33-19b4a98bb68b None admin] Validating token access rules against request {{(pid=82025) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:43:22.676798 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG dbcounter [-] [82025] Writing DB stats keystone:SELECT=100 {{(pid=82025) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:43:22.698824 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6184d6aa-f4e5-43af-969f-d09c78c14cf4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57539b6a6f3b4d589f5f5e1d211cd6a0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82025) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:43:22.699474 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6184d6aa-f4e5-43af-969f-d09c78c14cf4 None admin] REQUEST_METHOD: `GET` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:43:22.699760 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6184d6aa-f4e5-43af-969f-d09c78c14cf4 None admin] SCRIPT_NAME: `/identity` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:43:22.700035 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6184d6aa-f4e5-43af-969f-d09c78c14cf4 None admin] PATH_INFO: `/v3/projects/024b16f822e545dca8d1e8e3cc6f0f2c` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:43:22.701142 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6184d6aa-f4e5-43af-969f-d09c78c14cf4 None admin] RBAC: Authorizing `identity:get_project(project_id=024b16f822e545dca8d1e8e3cc6f0f2c)` {{(pid=82025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:43:22.702777 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6184d6aa-f4e5-43af-969f-d09c78c14cf4 None admin] RBAC: Authorization granted {{(pid=82025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:43:22.704881 dv-cinder-828806-6-smb devstack@keystone.service[82025]: [pid: 82025|app: 0|req: 571/1129] 10.222.0.33 () {56 vars in 1186 bytes} [Tue Sep 13 19:43:22 2022] GET /identity/v3/projects/024b16f822e545dca8d1e8e3cc6f0f2c => generated 311 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 19:43:22.712102 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc0600ee-4648-4ef7-8d8b-802a14a49f15 None admin] Authenticating user token {{(pid=82026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:43:22.800387 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG dbcounter [-] [82026] Writing DB stats keystone:SELECT=100 {{(pid=82026) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:43:22.816439 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc0600ee-4648-4ef7-8d8b-802a14a49f15 None admin] Validating token access rules against request {{(pid=82026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:43:22.842110 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f06e53b1-6305-4955-86e7-5f19912c83aa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57539b6a6f3b4d589f5f5e1d211cd6a0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:43:22.842709 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f06e53b1-6305-4955-86e7-5f19912c83aa None admin] REQUEST_METHOD: `GET` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:43:22.842996 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f06e53b1-6305-4955-86e7-5f19912c83aa None admin] SCRIPT_NAME: `/identity` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:43:22.843307 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f06e53b1-6305-4955-86e7-5f19912c83aa None admin] PATH_INFO: `/v3/role_assignments` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:43:22.844034 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f06e53b1-6305-4955-86e7-5f19912c83aa None admin] RBAC: Adding query filter params (role.id=6bcd095c76b341e186ea8caa11f5fa31, scope.project.id=024b16f822e545dca8d1e8e3cc6f0f2c, user.id=bf67677653e34d7c95b05ad89b29e4c6) {{(pid=82026) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 19:43:22.844348 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f06e53b1-6305-4955-86e7-5f19912c83aa None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=82026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:43:22.845782 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f06e53b1-6305-4955-86e7-5f19912c83aa None admin] RBAC: Authorization granted {{(pid=82026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:43:22.851558 dv-cinder-828806-6-smb devstack@keystone.service[82026]: [pid: 82026|app: 0|req: 559/1130] 10.222.0.33 () {56 vars in 1374 bytes} [Tue Sep 13 19:43:22 2022] GET /identity/v3/role_assignments?user.id=bf67677653e34d7c95b05ad89b29e4c6&scope.project.id=024b16f822e545dca8d1e8e3cc6f0f2c&role.id=6bcd095c76b341e186ea8caa11f5fa31 => generated 608 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 13 19:43:25.061158 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-344f2a29-8bc4-430a-97d0-e80c7b2b5908 None None] REQUEST_METHOD: `GET` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:43:25.061690 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-344f2a29-8bc4-430a-97d0-e80c7b2b5908 None None] SCRIPT_NAME: `/identity` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:43:25.061810 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-344f2a29-8bc4-430a-97d0-e80c7b2b5908 None None] PATH_INFO: `/` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:43:25.063078 dv-cinder-828806-6-smb devstack@keystone.service[82025]: [pid: 82025|app: 0|req: 572/1131] 10.222.0.33 () {54 vars in 927 bytes} [Tue Sep 13 19:43:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 19:43:25.068743 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5aed0c2-c948-4cf7-9036-502c9e57ce0a None None] REQUEST_METHOD: `POST` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:43:25.069164 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5aed0c2-c948-4cf7-9036-502c9e57ce0a None None] SCRIPT_NAME: `/identity` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:43:25.069296 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5aed0c2-c948-4cf7-9036-502c9e57ce0a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:43:25.088475 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.auth.core [None req-f5aed0c2-c948-4cf7-9036-502c9e57ce0a None None] MFA Rules not processed for user `57539b6a6f3b4d589f5f5e1d211cd6a0`. Rule list: `[]` (Enabled: `True`). {{(pid=82026) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 19:43:25.089652 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.common.fernet_utils [None req-f5aed0c2-c948-4cf7-9036-502c9e57ce0a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82026) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 19:43:25.153531 dv-cinder-828806-6-smb devstack@keystone.service[82026]: [pid: 82026|app: 0|req: 560/1132] 10.222.0.33 () {58 vars in 1024 bytes} [Tue Sep 13 19:43:25 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 13 19:43:25.430560 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-344f2a29-8bc4-430a-97d0-e80c7b2b5908 None None] Authenticating user token {{(pid=82025) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:43:25.529423 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-344f2a29-8bc4-430a-97d0-e80c7b2b5908 None None] Validating token access rules against request {{(pid=82025) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:43:25.564172 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3732a57d-f6d2-44f9-9e05-91bd386d2aa3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57539b6a6f3b4d589f5f5e1d211cd6a0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82025) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:43:25.564782 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3732a57d-f6d2-44f9-9e05-91bd386d2aa3 None admin] REQUEST_METHOD: `GET` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:43:25.565067 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3732a57d-f6d2-44f9-9e05-91bd386d2aa3 None admin] SCRIPT_NAME: `/identity` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:43:25.565347 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3732a57d-f6d2-44f9-9e05-91bd386d2aa3 None admin] PATH_INFO: `/v3/domains/default` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:43:25.567367 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3732a57d-f6d2-44f9-9e05-91bd386d2aa3 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=82025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:43:25.568783 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3732a57d-f6d2-44f9-9e05-91bd386d2aa3 None admin] RBAC: Authorization granted {{(pid=82025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:43:25.570336 dv-cinder-828806-6-smb devstack@keystone.service[82025]: [pid: 82025|app: 0|req: 573/1133] 10.222.0.33 () {56 vars in 1108 bytes} [Tue Sep 13 19:43:25 2022] GET /identity/v3/domains/default => generated 199 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 19:43:25.576285 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5aed0c2-c948-4cf7-9036-502c9e57ce0a None None] Authenticating user token {{(pid=82026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:43:25.657856 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG dbcounter [-] [82026] Writing DB stats keystone:SELECT=100 {{(pid=82026) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:43:25.672195 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5aed0c2-c948-4cf7-9036-502c9e57ce0a None None] Validating token access rules against request {{(pid=82026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:43:25.705784 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8ca4487-f3a3-424a-83e5-e344804b4a57 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57539b6a6f3b4d589f5f5e1d211cd6a0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:43:25.707002 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8ca4487-f3a3-424a-83e5-e344804b4a57 None admin] REQUEST_METHOD: `POST` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:43:25.707312 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8ca4487-f3a3-424a-83e5-e344804b4a57 None admin] SCRIPT_NAME: `/identity` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:43:25.707590 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8ca4487-f3a3-424a-83e5-e344804b4a57 None admin] PATH_INFO: `/v3/projects` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:43:25.708254 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8ca4487-f3a3-424a-83e5-e344804b4a57 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=82026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:43:25.709679 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8ca4487-f3a3-424a-83e5-e344804b4a57 None admin] RBAC: Authorization granted {{(pid=82026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:43:25.794975 dv-cinder-828806-6-smb devstack@keystone.service[82026]: [pid: 82026|app: 0|req: 561/1134] 10.222.0.33 () {60 vars in 1141 bytes} [Tue Sep 13 19:43:25 2022] POST /identity/v3/projects => generated 311 bytes in 219 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 13 19:43:28.031109 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d1d025d-0dfc-42ca-8995-6f7417bde08f None None] REQUEST_METHOD: `GET` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:43:28.031668 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d1d025d-0dfc-42ca-8995-6f7417bde08f None None] SCRIPT_NAME: `/identity` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:43:28.031668 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d1d025d-0dfc-42ca-8995-6f7417bde08f None None] PATH_INFO: `/` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:43:28.032985 dv-cinder-828806-6-smb devstack@keystone.service[82025]: [pid: 82025|app: 0|req: 574/1135] 10.222.0.33 () {54 vars in 927 bytes} [Tue Sep 13 19:43:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 19:43:28.039109 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d88b259-1ca9-4968-b631-2ad7fcb55393 None None] REQUEST_METHOD: `POST` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:43:28.039528 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d88b259-1ca9-4968-b631-2ad7fcb55393 None None] SCRIPT_NAME: `/identity` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:43:28.039668 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d88b259-1ca9-4968-b631-2ad7fcb55393 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:43:28.058122 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.auth.core [None req-5d88b259-1ca9-4968-b631-2ad7fcb55393 None None] MFA Rules not processed for user `57539b6a6f3b4d589f5f5e1d211cd6a0`. Rule list: `[]` (Enabled: `True`). {{(pid=82026) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 19:43:28.059327 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.common.fernet_utils [None req-5d88b259-1ca9-4968-b631-2ad7fcb55393 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82026) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 19:43:28.122745 dv-cinder-828806-6-smb devstack@keystone.service[82026]: [pid: 82026|app: 0|req: 562/1136] 10.222.0.33 () {58 vars in 1024 bytes} [Tue Sep 13 19:43:28 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 13 19:43:28.392131 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d1d025d-0dfc-42ca-8995-6f7417bde08f None None] Authenticating user token {{(pid=82025) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:43:28.441625 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG dbcounter [-] [82025] Writing DB stats keystone:SELECT=100 {{(pid=82025) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:43:28.489924 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d1d025d-0dfc-42ca-8995-6f7417bde08f None None] Validating token access rules against request {{(pid=82025) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:43:28.524314 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4785904a-d561-42a0-9766-8853bdbf96f1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57539b6a6f3b4d589f5f5e1d211cd6a0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82025) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:43:28.524926 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4785904a-d561-42a0-9766-8853bdbf96f1 None admin] REQUEST_METHOD: `GET` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:43:28.525207 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4785904a-d561-42a0-9766-8853bdbf96f1 None admin] SCRIPT_NAME: `/identity` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:43:28.525482 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4785904a-d561-42a0-9766-8853bdbf96f1 None admin] PATH_INFO: `/v3/domains/default` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:43:28.526578 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4785904a-d561-42a0-9766-8853bdbf96f1 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=82025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:43:28.528017 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4785904a-d561-42a0-9766-8853bdbf96f1 None admin] RBAC: Authorization granted {{(pid=82025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:43:28.529557 dv-cinder-828806-6-smb devstack@keystone.service[82025]: [pid: 82025|app: 0|req: 575/1137] 10.222.0.33 () {56 vars in 1108 bytes} [Tue Sep 13 19:43:28 2022] GET /identity/v3/domains/default => generated 199 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 19:43:28.535356 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d88b259-1ca9-4968-b631-2ad7fcb55393 None None] Authenticating user token {{(pid=82026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:43:28.599140 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG dbcounter [-] [82026] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82026) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:43:28.631356 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d88b259-1ca9-4968-b631-2ad7fcb55393 None None] Validating token access rules against request {{(pid=82026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:43:28.664576 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd02a24e-e9e1-40a3-b2e7-474651040d63 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57539b6a6f3b4d589f5f5e1d211cd6a0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:43:28.665166 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd02a24e-e9e1-40a3-b2e7-474651040d63 None admin] REQUEST_METHOD: `POST` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:43:28.665448 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd02a24e-e9e1-40a3-b2e7-474651040d63 None admin] SCRIPT_NAME: `/identity` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:43:28.665723 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd02a24e-e9e1-40a3-b2e7-474651040d63 None admin] PATH_INFO: `/v3/users` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:43:28.666370 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd02a24e-e9e1-40a3-b2e7-474651040d63 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=82026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:43:28.667815 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd02a24e-e9e1-40a3-b2e7-474651040d63 None admin] RBAC: Authorization granted {{(pid=82026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:43:28.744421 dv-cinder-828806-6-smb devstack@keystone.service[82026]: [pid: 82026|app: 0|req: 563/1138] 10.222.0.33 () {60 vars in 1132 bytes} [Tue Sep 13 19:43:28 2022] POST /identity/v3/users => generated 286 bytes in 210 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 13 19:43:30.945285 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d59acbf0-c492-4541-b3f5-35610c3b4766 None None] REQUEST_METHOD: `GET` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:43:30.945822 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d59acbf0-c492-4541-b3f5-35610c3b4766 None None] SCRIPT_NAME: `/identity` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:43:30.945822 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d59acbf0-c492-4541-b3f5-35610c3b4766 None None] PATH_INFO: `/` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:43:30.947201 dv-cinder-828806-6-smb devstack@keystone.service[82025]: [pid: 82025|app: 0|req: 576/1139] 10.222.0.33 () {54 vars in 927 bytes} [Tue Sep 13 19:43:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 19:43:30.952506 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2de6d8ba-f8ce-478e-ab43-be4e2adfb274 None None] REQUEST_METHOD: `POST` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:43:30.952890 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2de6d8ba-f8ce-478e-ab43-be4e2adfb274 None None] SCRIPT_NAME: `/identity` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:43:30.953075 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2de6d8ba-f8ce-478e-ab43-be4e2adfb274 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:43:30.971288 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.auth.core [None req-2de6d8ba-f8ce-478e-ab43-be4e2adfb274 None None] MFA Rules not processed for user `57539b6a6f3b4d589f5f5e1d211cd6a0`. Rule list: `[]` (Enabled: `True`). {{(pid=82026) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 19:43:30.972529 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.common.fernet_utils [None req-2de6d8ba-f8ce-478e-ab43-be4e2adfb274 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82026) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 19:43:31.037363 dv-cinder-828806-6-smb devstack@keystone.service[82026]: [pid: 82026|app: 0|req: 564/1140] 10.222.0.33 () {58 vars in 1024 bytes} [Tue Sep 13 19:43:30 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 13 19:43:31.319392 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d59acbf0-c492-4541-b3f5-35610c3b4766 None None] Authenticating user token {{(pid=82025) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:43:31.420390 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d59acbf0-c492-4541-b3f5-35610c3b4766 None None] Validating token access rules against request {{(pid=82025) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:43:31.437061 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG dbcounter [-] [82025] Writing DB stats keystone:SELECT=100 {{(pid=82025) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:43:31.454208 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-238c9cb8-2837-47f2-a6f7-d4d1999e659b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57539b6a6f3b4d589f5f5e1d211cd6a0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82025) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:43:31.454866 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-238c9cb8-2837-47f2-a6f7-d4d1999e659b None admin] REQUEST_METHOD: `GET` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:43:31.455179 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-238c9cb8-2837-47f2-a6f7-d4d1999e659b None admin] SCRIPT_NAME: `/identity` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:43:31.455453 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-238c9cb8-2837-47f2-a6f7-d4d1999e659b None admin] PATH_INFO: `/v3/roles/admin` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:43:31.465120 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-238c9cb8-2837-47f2-a6f7-d4d1999e659b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=82025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 13 19:43:31.469907 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application [None req-238c9cb8-2837-47f2-a6f7-d4d1999e659b None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 13 19:43:31.469907 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 19:43:31.469907 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 19:43:31.469907 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 19:43:31.469907 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 19:43:31.469907 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 19:43:31.469907 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 19:43:31.469907 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 19:43:31.469907 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 19:43:31.469907 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 19:43:31.469907 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 19:43:31.469907 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 19:43:31.469907 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 13 19:43:31.469907 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 13 19:43:31.469907 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 13 19:43:31.469907 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 13 19:43:31.471019 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 13 19:43:31.471019 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 13 19:43:31.471019 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 13 19:43:31.471019 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 13 19:43:31.471019 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 19:43:31.471019 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 19:43:31.471019 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 19:43:31.471019 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 19:43:31.471019 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 19:43:31.471019 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 19:43:31.471019 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 19:43:31.471019 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application with Lock( Sep 13 19:43:31.471019 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 19:43:31.471019 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application return self._enter() Sep 13 19:43:31.471019 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 19:43:31.471019 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 19:43:31.472869 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 19:43:31.472869 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application return self.creator() Sep 13 19:43:31.472869 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 19:43:31.472869 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application created_value = creator( Sep 13 19:43:31.472869 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 13 19:43:31.472869 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 13 19:43:31.472869 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 13 19:43:31.472869 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 13 19:43:31.472869 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 13 19:43:31.472869 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 13 19:43:31.472869 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 13 19:43:31.472869 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application Sep 13 19:43:31.472869 dv-cinder-828806-6-smb devstack@keystone.service[82025]: [pid: 82025|app: 0|req: 577/1141] 10.222.0.33 () {56 vars in 1096 bytes} [Tue Sep 13 19:43:31 2022] GET /identity/v3/roles/admin => generated 83 bytes in 152 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 19:43:31.478086 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2de6d8ba-f8ce-478e-ab43-be4e2adfb274 None None] Authenticating user token {{(pid=82026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:43:31.530825 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG dbcounter [-] [82026] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=82026) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:43:31.574320 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2de6d8ba-f8ce-478e-ab43-be4e2adfb274 None None] Validating token access rules against request {{(pid=82026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:43:31.609107 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b56a983-468a-4c79-8923-0bdb0893cb12 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57539b6a6f3b4d589f5f5e1d211cd6a0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:43:31.609706 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b56a983-468a-4c79-8923-0bdb0893cb12 None admin] REQUEST_METHOD: `GET` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:43:31.609988 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b56a983-468a-4c79-8923-0bdb0893cb12 None admin] SCRIPT_NAME: `/identity` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:43:31.610262 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b56a983-468a-4c79-8923-0bdb0893cb12 None admin] PATH_INFO: `/v3/roles` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:43:31.610922 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b56a983-468a-4c79-8923-0bdb0893cb12 None admin] RBAC: Adding query filter params (name=admin) {{(pid=82026) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 19:43:31.611259 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b56a983-468a-4c79-8923-0bdb0893cb12 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:43:31.612683 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b56a983-468a-4c79-8923-0bdb0893cb12 None admin] RBAC: Authorization granted {{(pid=82026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:43:31.620974 dv-cinder-828806-6-smb devstack@keystone.service[82026]: [pid: 82026|app: 0|req: 565/1142] 10.222.0.33 () {56 vars in 1099 bytes} [Tue Sep 13 19:43:31 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 19:43:31.626973 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-238c9cb8-2837-47f2-a6f7-d4d1999e659b None admin] Authenticating user token {{(pid=82025) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:43:31.724545 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-238c9cb8-2837-47f2-a6f7-d4d1999e659b None admin] Validating token access rules against request {{(pid=82025) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:43:31.757120 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40bc4a96-2a56-42da-a188-8c02db95d1b1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57539b6a6f3b4d589f5f5e1d211cd6a0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82025) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:43:31.757734 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40bc4a96-2a56-42da-a188-8c02db95d1b1 None admin] REQUEST_METHOD: `GET` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:43:31.758020 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40bc4a96-2a56-42da-a188-8c02db95d1b1 None admin] SCRIPT_NAME: `/identity` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:43:31.758296 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40bc4a96-2a56-42da-a188-8c02db95d1b1 None admin] PATH_INFO: `/v3/users/08af656c115748f19df102b3401f610b` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:43:31.772310 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40bc4a96-2a56-42da-a188-8c02db95d1b1 None admin] RBAC: Authorizing `identity:get_user(user_id=08af656c115748f19df102b3401f610b)` {{(pid=82025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:43:31.775316 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40bc4a96-2a56-42da-a188-8c02db95d1b1 None admin] RBAC: Authorization granted {{(pid=82025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:43:31.776959 dv-cinder-828806-6-smb devstack@keystone.service[82025]: [pid: 82025|app: 0|req: 578/1143] 10.222.0.33 () {56 vars in 1177 bytes} [Tue Sep 13 19:43:31 2022] GET /identity/v3/users/08af656c115748f19df102b3401f610b => generated 286 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 19:43:31.782714 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b56a983-468a-4c79-8923-0bdb0893cb12 None admin] Authenticating user token {{(pid=82026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:43:31.884674 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b56a983-468a-4c79-8923-0bdb0893cb12 None admin] Validating token access rules against request {{(pid=82026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:43:31.900319 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG dbcounter [-] [82026] Writing DB stats keystone:SELECT=100 {{(pid=82026) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:43:31.917980 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5beab54b-77d0-46b9-bd8b-13a794bab810 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57539b6a6f3b4d589f5f5e1d211cd6a0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:43:31.918579 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5beab54b-77d0-46b9-bd8b-13a794bab810 None admin] REQUEST_METHOD: `GET` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:43:31.918858 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5beab54b-77d0-46b9-bd8b-13a794bab810 None admin] SCRIPT_NAME: `/identity` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:43:31.919163 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5beab54b-77d0-46b9-bd8b-13a794bab810 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:43:31.983963 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5beab54b-77d0-46b9-bd8b-13a794bab810 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=82026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:43:31.985407 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5beab54b-77d0-46b9-bd8b-13a794bab810 None admin] RBAC: Authorization granted {{(pid=82026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:43:32.079881 dv-cinder-828806-6-smb devstack@keystone.service[82026]: [pid: 82026|app: 0|req: 566/1144] 10.222.0.33 () {58 vars in 1282 bytes} [Tue Sep 13 19:43:31 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 298 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Sep 13 19:43:32.086387 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40bc4a96-2a56-42da-a188-8c02db95d1b1 None admin] Authenticating user token {{(pid=82025) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:43:32.121906 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG dbcounter [-] [82025] Writing DB stats keystone:SELECT=100 {{(pid=82025) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:43:32.189296 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40bc4a96-2a56-42da-a188-8c02db95d1b1 None admin] Validating token access rules against request {{(pid=82025) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:43:32.223828 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-672855f0-083f-4bd0-b09e-0bee35b18a36 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57539b6a6f3b4d589f5f5e1d211cd6a0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82025) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:43:32.224452 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-672855f0-083f-4bd0-b09e-0bee35b18a36 None admin] REQUEST_METHOD: `GET` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:43:32.224737 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-672855f0-083f-4bd0-b09e-0bee35b18a36 None admin] SCRIPT_NAME: `/identity` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:43:32.225014 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-672855f0-083f-4bd0-b09e-0bee35b18a36 None admin] PATH_INFO: `/v3/projects/90abb205394c4ca19e3f66453a861d9e` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:43:32.226125 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-672855f0-083f-4bd0-b09e-0bee35b18a36 None admin] RBAC: Authorizing `identity:get_project(project_id=90abb205394c4ca19e3f66453a861d9e)` {{(pid=82025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:43:32.227590 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-672855f0-083f-4bd0-b09e-0bee35b18a36 None admin] RBAC: Authorization granted {{(pid=82025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:43:32.229209 dv-cinder-828806-6-smb devstack@keystone.service[82025]: [pid: 82025|app: 0|req: 579/1145] 10.222.0.33 () {56 vars in 1186 bytes} [Tue Sep 13 19:43:32 2022] GET /identity/v3/projects/90abb205394c4ca19e3f66453a861d9e => generated 311 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 19:43:32.235362 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5beab54b-77d0-46b9-bd8b-13a794bab810 None admin] Authenticating user token {{(pid=82026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:43:32.252765 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG dbcounter [-] [82026] Writing DB stats keystone:SELECT=100 {{(pid=82026) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:43:32.331501 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5beab54b-77d0-46b9-bd8b-13a794bab810 None admin] Validating token access rules against request {{(pid=82026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:43:32.364438 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66c2a72d-9536-49a5-ab4f-81dcb213854d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57539b6a6f3b4d589f5f5e1d211cd6a0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:43:32.365042 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66c2a72d-9536-49a5-ab4f-81dcb213854d None admin] REQUEST_METHOD: `GET` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:43:32.365331 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66c2a72d-9536-49a5-ab4f-81dcb213854d None admin] SCRIPT_NAME: `/identity` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:43:32.365611 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66c2a72d-9536-49a5-ab4f-81dcb213854d None admin] PATH_INFO: `/v3/role_assignments` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:43:32.366361 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66c2a72d-9536-49a5-ab4f-81dcb213854d None admin] RBAC: Adding query filter params (role.id=e5af7d5baa93469e9e486ef21c85474e, scope.project.id=90abb205394c4ca19e3f66453a861d9e, user.id=08af656c115748f19df102b3401f610b) {{(pid=82026) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 19:43:32.366678 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66c2a72d-9536-49a5-ab4f-81dcb213854d None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=82026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:43:32.368136 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66c2a72d-9536-49a5-ab4f-81dcb213854d None admin] RBAC: Authorization granted {{(pid=82026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:43:32.373323 dv-cinder-828806-6-smb devstack@keystone.service[82026]: [pid: 82026|app: 0|req: 567/1146] 10.222.0.33 () {56 vars in 1374 bytes} [Tue Sep 13 19:43:32 2022] GET /identity/v3/role_assignments?user.id=08af656c115748f19df102b3401f610b&scope.project.id=90abb205394c4ca19e3f66453a861d9e&role.id=e5af7d5baa93469e9e486ef21c85474e => generated 259 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 19:43:34.505682 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68485b75-5939-4497-8dc6-8793aa3d2abe None None] REQUEST_METHOD: `GET` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:43:34.506201 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68485b75-5939-4497-8dc6-8793aa3d2abe None None] SCRIPT_NAME: `/identity` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:43:34.506317 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68485b75-5939-4497-8dc6-8793aa3d2abe None None] PATH_INFO: `/` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:43:34.507613 dv-cinder-828806-6-smb devstack@keystone.service[82025]: [pid: 82025|app: 0|req: 580/1147] 10.222.0.33 () {54 vars in 927 bytes} [Tue Sep 13 19:43:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 19:43:34.512678 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6400b00a-4c0c-4202-a4e1-e9a503739075 None None] REQUEST_METHOD: `POST` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:43:34.513092 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6400b00a-4c0c-4202-a4e1-e9a503739075 None None] SCRIPT_NAME: `/identity` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:43:34.513232 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6400b00a-4c0c-4202-a4e1-e9a503739075 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:43:34.530871 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.auth.core [None req-6400b00a-4c0c-4202-a4e1-e9a503739075 None None] MFA Rules not processed for user `57539b6a6f3b4d589f5f5e1d211cd6a0`. Rule list: `[]` (Enabled: `True`). {{(pid=82026) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 19:43:34.532073 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.common.fernet_utils [None req-6400b00a-4c0c-4202-a4e1-e9a503739075 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82026) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 19:43:34.595896 dv-cinder-828806-6-smb devstack@keystone.service[82026]: [pid: 82026|app: 0|req: 568/1148] 10.222.0.33 () {58 vars in 1024 bytes} [Tue Sep 13 19:43:34 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 13 19:43:34.880505 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68485b75-5939-4497-8dc6-8793aa3d2abe None None] Authenticating user token {{(pid=82025) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:43:34.981720 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68485b75-5939-4497-8dc6-8793aa3d2abe None None] Validating token access rules against request {{(pid=82025) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:43:34.983236 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG dbcounter [-] [82025] Writing DB stats keystone:SELECT=100 {{(pid=82025) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:43:35.015324 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06ffc374-e308-42be-a3ac-c1cda66825f4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57539b6a6f3b4d589f5f5e1d211cd6a0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82025) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:43:35.015949 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06ffc374-e308-42be-a3ac-c1cda66825f4 None admin] REQUEST_METHOD: `GET` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:43:35.016233 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06ffc374-e308-42be-a3ac-c1cda66825f4 None admin] SCRIPT_NAME: `/identity` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:43:35.016512 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06ffc374-e308-42be-a3ac-c1cda66825f4 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:43:35.027562 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06ffc374-e308-42be-a3ac-c1cda66825f4 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=82025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 13 19:43:35.032362 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application [None req-06ffc374-e308-42be-a3ac-c1cda66825f4 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 13 19:43:35.032362 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 19:43:35.032362 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 19:43:35.032362 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 19:43:35.032362 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 19:43:35.032362 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 19:43:35.032362 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 19:43:35.032362 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 19:43:35.032362 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 19:43:35.032362 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 19:43:35.032362 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 19:43:35.032362 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 19:43:35.032362 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 13 19:43:35.032362 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 13 19:43:35.032362 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 13 19:43:35.032362 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 13 19:43:35.033482 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 13 19:43:35.033482 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 13 19:43:35.033482 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 13 19:43:35.033482 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 13 19:43:35.033482 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 19:43:35.033482 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 19:43:35.033482 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 19:43:35.033482 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 19:43:35.033482 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 19:43:35.033482 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 19:43:35.033482 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 19:43:35.033482 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application with Lock( Sep 13 19:43:35.033482 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 19:43:35.033482 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application return self._enter() Sep 13 19:43:35.033482 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 19:43:35.033482 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 19:43:35.034513 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 19:43:35.034513 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application return self.creator() Sep 13 19:43:35.034513 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 19:43:35.034513 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application created_value = creator( Sep 13 19:43:35.034513 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 13 19:43:35.034513 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 13 19:43:35.034513 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 13 19:43:35.034513 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 13 19:43:35.034513 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 13 19:43:35.034513 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 13 19:43:35.034513 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 13 19:43:35.034513 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application Sep 13 19:43:35.034513 dv-cinder-828806-6-smb devstack@keystone.service[82025]: [pid: 82025|app: 0|req: 581/1149] 10.222.0.33 () {56 vars in 1096 bytes} [Tue Sep 13 19:43:34 2022] GET /identity/v3/roles/admin => generated 83 bytes in 154 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 13 19:43:35.040034 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6400b00a-4c0c-4202-a4e1-e9a503739075 None None] Authenticating user token {{(pid=82026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:43:35.051275 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG dbcounter [-] [82026] Writing DB stats keystone:SELECT=100 {{(pid=82026) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:43:35.136576 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6400b00a-4c0c-4202-a4e1-e9a503739075 None None] Validating token access rules against request {{(pid=82026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:43:35.169323 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a10efd3-b976-4527-bf37-f895b2fa9030 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57539b6a6f3b4d589f5f5e1d211cd6a0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:43:35.169921 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a10efd3-b976-4527-bf37-f895b2fa9030 None admin] REQUEST_METHOD: `GET` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:43:35.170201 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a10efd3-b976-4527-bf37-f895b2fa9030 None admin] SCRIPT_NAME: `/identity` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:43:35.170473 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a10efd3-b976-4527-bf37-f895b2fa9030 None admin] PATH_INFO: `/v3/roles` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:43:35.171159 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a10efd3-b976-4527-bf37-f895b2fa9030 None admin] RBAC: Adding query filter params (name=admin) {{(pid=82026) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 19:43:35.171464 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a10efd3-b976-4527-bf37-f895b2fa9030 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:43:35.172815 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a10efd3-b976-4527-bf37-f895b2fa9030 None admin] RBAC: Authorization granted {{(pid=82026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:43:35.180886 dv-cinder-828806-6-smb devstack@keystone.service[82026]: [pid: 82026|app: 0|req: 569/1150] 10.222.0.33 () {56 vars in 1099 bytes} [Tue Sep 13 19:43:35 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 19:43:35.186743 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06ffc374-e308-42be-a3ac-c1cda66825f4 None admin] Authenticating user token {{(pid=82025) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:43:35.286561 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06ffc374-e308-42be-a3ac-c1cda66825f4 None admin] Validating token access rules against request {{(pid=82025) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:43:35.320374 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27704d0b-f00b-4c1c-90d9-0abf7b9bf40b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57539b6a6f3b4d589f5f5e1d211cd6a0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82025) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:43:35.320992 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27704d0b-f00b-4c1c-90d9-0abf7b9bf40b None admin] REQUEST_METHOD: `GET` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:43:35.321275 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27704d0b-f00b-4c1c-90d9-0abf7b9bf40b None admin] SCRIPT_NAME: `/identity` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:43:35.321551 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27704d0b-f00b-4c1c-90d9-0abf7b9bf40b None admin] PATH_INFO: `/v3/users/08af656c115748f19df102b3401f610b` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:43:35.322655 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27704d0b-f00b-4c1c-90d9-0abf7b9bf40b None admin] RBAC: Authorizing `identity:get_user(user_id=08af656c115748f19df102b3401f610b)` {{(pid=82025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:43:35.324112 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27704d0b-f00b-4c1c-90d9-0abf7b9bf40b None admin] RBAC: Authorization granted {{(pid=82025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:43:35.325677 dv-cinder-828806-6-smb devstack@keystone.service[82025]: [pid: 82025|app: 0|req: 582/1151] 10.222.0.33 () {56 vars in 1177 bytes} [Tue Sep 13 19:43:35 2022] GET /identity/v3/users/08af656c115748f19df102b3401f610b => generated 286 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 19:43:35.332193 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a10efd3-b976-4527-bf37-f895b2fa9030 None admin] Authenticating user token {{(pid=82026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:43:35.400268 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG dbcounter [-] [82026] Writing DB stats keystone:SELECT=100 {{(pid=82026) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:43:35.429523 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a10efd3-b976-4527-bf37-f895b2fa9030 None admin] Validating token access rules against request {{(pid=82026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:43:35.462611 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cef23cc-a72b-4a99-8626-a6f72fee2847 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57539b6a6f3b4d589f5f5e1d211cd6a0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:43:35.463251 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cef23cc-a72b-4a99-8626-a6f72fee2847 None admin] REQUEST_METHOD: `GET` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:43:35.463533 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cef23cc-a72b-4a99-8626-a6f72fee2847 None admin] SCRIPT_NAME: `/identity` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:43:35.463805 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cef23cc-a72b-4a99-8626-a6f72fee2847 None admin] PATH_INFO: `/v3/projects/90abb205394c4ca19e3f66453a861d9e` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:43:35.464905 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cef23cc-a72b-4a99-8626-a6f72fee2847 None admin] RBAC: Authorizing `identity:get_project(project_id=90abb205394c4ca19e3f66453a861d9e)` {{(pid=82026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:43:35.466317 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cef23cc-a72b-4a99-8626-a6f72fee2847 None admin] RBAC: Authorization granted {{(pid=82026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:43:35.467940 dv-cinder-828806-6-smb devstack@keystone.service[82026]: [pid: 82026|app: 0|req: 570/1152] 10.222.0.33 () {56 vars in 1186 bytes} [Tue Sep 13 19:43:35 2022] GET /identity/v3/projects/90abb205394c4ca19e3f66453a861d9e => generated 311 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 19:43:35.474102 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27704d0b-f00b-4c1c-90d9-0abf7b9bf40b None admin] Authenticating user token {{(pid=82025) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:43:35.505449 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG dbcounter [-] [82025] Writing DB stats keystone:SELECT=100 {{(pid=82025) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:43:35.574682 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27704d0b-f00b-4c1c-90d9-0abf7b9bf40b None admin] Validating token access rules against request {{(pid=82025) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:43:35.607278 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-242e463c-3c3d-4c9e-9a31-58ad1bb9ee40 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57539b6a6f3b4d589f5f5e1d211cd6a0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82025) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:43:35.607922 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-242e463c-3c3d-4c9e-9a31-58ad1bb9ee40 None admin] REQUEST_METHOD: `PUT` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:43:35.608208 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-242e463c-3c3d-4c9e-9a31-58ad1bb9ee40 None admin] SCRIPT_NAME: `/identity` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:43:35.608486 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-242e463c-3c3d-4c9e-9a31-58ad1bb9ee40 None admin] PATH_INFO: `/v3/projects/90abb205394c4ca19e3f66453a861d9e/users/08af656c115748f19df102b3401f610b/roles/e5af7d5baa93469e9e486ef21c85474e` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:43:35.610375 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-242e463c-3c3d-4c9e-9a31-58ad1bb9ee40 None admin] RBAC: Authorizing `identity:create_grant(project_id=90abb205394c4ca19e3f66453a861d9e, user_id=08af656c115748f19df102b3401f610b, role_id=e5af7d5baa93469e9e486ef21c85474e)` {{(pid=82025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:43:35.611830 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-242e463c-3c3d-4c9e-9a31-58ad1bb9ee40 None admin] RBAC: Authorization granted {{(pid=82025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:43:35.696990 dv-cinder-828806-6-smb devstack@keystone.service[82025]: [pid: 82025|app: 0|req: 583/1153] 10.222.0.33 () {58 vars in 1439 bytes} [Tue Sep 13 19:43:35 2022] PUT /identity/v3/projects/90abb205394c4ca19e3f66453a861d9e/users/08af656c115748f19df102b3401f610b/roles/e5af7d5baa93469e9e486ef21c85474e => generated 0 bytes in 223 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 19:43:37.826983 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5ad8788-bb8c-43f5-9071-a826a25549cf None None] REQUEST_METHOD: `GET` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:43:37.827541 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5ad8788-bb8c-43f5-9071-a826a25549cf None None] SCRIPT_NAME: `/identity` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:43:37.827541 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5ad8788-bb8c-43f5-9071-a826a25549cf None None] PATH_INFO: `/` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:43:37.829011 dv-cinder-828806-6-smb devstack@keystone.service[82026]: [pid: 82026|app: 0|req: 571/1154] 10.222.0.33 () {54 vars in 927 bytes} [Tue Sep 13 19:43:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 19:43:37.834437 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89701cf5-b8d2-4e1d-9f5f-09d0b038a709 None None] REQUEST_METHOD: `POST` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:43:37.834862 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89701cf5-b8d2-4e1d-9f5f-09d0b038a709 None None] SCRIPT_NAME: `/identity` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:43:37.834990 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89701cf5-b8d2-4e1d-9f5f-09d0b038a709 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:43:37.852987 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.auth.core [None req-89701cf5-b8d2-4e1d-9f5f-09d0b038a709 None None] MFA Rules not processed for user `57539b6a6f3b4d589f5f5e1d211cd6a0`. Rule list: `[]` (Enabled: `True`). {{(pid=82025) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 19:43:37.854169 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.fernet_utils [None req-89701cf5-b8d2-4e1d-9f5f-09d0b038a709 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82025) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 19:43:37.918922 dv-cinder-828806-6-smb devstack@keystone.service[82025]: [pid: 82025|app: 0|req: 584/1155] 10.222.0.33 () {58 vars in 1024 bytes} [Tue Sep 13 19:43:37 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 13 19:43:38.201239 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5ad8788-bb8c-43f5-9071-a826a25549cf None None] Authenticating user token {{(pid=82026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:43:38.303847 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5ad8788-bb8c-43f5-9071-a826a25549cf None None] Validating token access rules against request {{(pid=82026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:43:38.336412 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-774f9956-3559-46cb-86ac-70c79b0f6c0c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57539b6a6f3b4d589f5f5e1d211cd6a0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:43:38.337035 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-774f9956-3559-46cb-86ac-70c79b0f6c0c None admin] REQUEST_METHOD: `GET` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:43:38.337321 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-774f9956-3559-46cb-86ac-70c79b0f6c0c None admin] SCRIPT_NAME: `/identity` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:43:38.337602 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-774f9956-3559-46cb-86ac-70c79b0f6c0c None admin] PATH_INFO: `/v3/roles/admin` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:43:38.344784 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG dbcounter [-] [82026] Writing DB stats keystone:SELECT=100 {{(pid=82026) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:43:38.348521 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-774f9956-3559-46cb-86ac-70c79b0f6c0c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=82026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 13 19:43:38.353645 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application [None req-774f9956-3559-46cb-86ac-70c79b0f6c0c None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 13 19:43:38.353645 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 19:43:38.353645 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 19:43:38.353645 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 19:43:38.353645 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 19:43:38.353645 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 19:43:38.353645 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 19:43:38.353645 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 19:43:38.353645 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 19:43:38.353645 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 19:43:38.353645 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 19:43:38.353645 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 19:43:38.353645 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 13 19:43:38.353645 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 13 19:43:38.353645 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 13 19:43:38.353645 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 13 19:43:38.358759 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 13 19:43:38.358759 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 13 19:43:38.358759 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 13 19:43:38.358759 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 13 19:43:38.358759 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 19:43:38.358759 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 19:43:38.358759 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 19:43:38.358759 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 19:43:38.358759 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 19:43:38.358759 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 19:43:38.358759 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 19:43:38.358759 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application with Lock( Sep 13 19:43:38.358759 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 19:43:38.358759 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application return self._enter() Sep 13 19:43:38.358759 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 19:43:38.358759 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 19:43:38.359851 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 19:43:38.359851 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application return self.creator() Sep 13 19:43:38.359851 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 19:43:38.359851 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application created_value = creator( Sep 13 19:43:38.359851 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 13 19:43:38.359851 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 13 19:43:38.359851 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 13 19:43:38.359851 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 13 19:43:38.359851 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 13 19:43:38.359851 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 13 19:43:38.359851 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 13 19:43:38.359851 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application Sep 13 19:43:38.359851 dv-cinder-828806-6-smb devstack@keystone.service[82026]: [pid: 82026|app: 0|req: 572/1156] 10.222.0.33 () {56 vars in 1096 bytes} [Tue Sep 13 19:43:38 2022] GET /identity/v3/roles/admin => generated 83 bytes in 154 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 19:43:38.360857 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89701cf5-b8d2-4e1d-9f5f-09d0b038a709 None None] Authenticating user token {{(pid=82025) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:43:38.382045 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG dbcounter [-] [82025] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82025) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:43:38.457240 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89701cf5-b8d2-4e1d-9f5f-09d0b038a709 None None] Validating token access rules against request {{(pid=82025) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:43:38.491566 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f72c2e2-c163-4d39-9a61-52c8231c5ffe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57539b6a6f3b4d589f5f5e1d211cd6a0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82025) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:43:38.492167 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f72c2e2-c163-4d39-9a61-52c8231c5ffe None admin] REQUEST_METHOD: `GET` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:43:38.492450 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f72c2e2-c163-4d39-9a61-52c8231c5ffe None admin] SCRIPT_NAME: `/identity` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:43:38.492726 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f72c2e2-c163-4d39-9a61-52c8231c5ffe None admin] PATH_INFO: `/v3/roles` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:43:38.493387 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f72c2e2-c163-4d39-9a61-52c8231c5ffe None admin] RBAC: Adding query filter params (name=admin) {{(pid=82025) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 19:43:38.493695 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f72c2e2-c163-4d39-9a61-52c8231c5ffe None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:43:38.495070 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f72c2e2-c163-4d39-9a61-52c8231c5ffe None admin] RBAC: Authorization granted {{(pid=82025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:43:38.502822 dv-cinder-828806-6-smb devstack@keystone.service[82025]: [pid: 82025|app: 0|req: 585/1157] 10.222.0.33 () {56 vars in 1099 bytes} [Tue Sep 13 19:43:38 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 19:43:38.509109 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-774f9956-3559-46cb-86ac-70c79b0f6c0c None admin] Authenticating user token {{(pid=82026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:43:38.606114 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-774f9956-3559-46cb-86ac-70c79b0f6c0c None admin] Validating token access rules against request {{(pid=82026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:43:38.638474 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8733289-1b6a-4d14-bd29-17349d9461df None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57539b6a6f3b4d589f5f5e1d211cd6a0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:43:38.639214 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8733289-1b6a-4d14-bd29-17349d9461df None admin] REQUEST_METHOD: `GET` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:43:38.639509 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8733289-1b6a-4d14-bd29-17349d9461df None admin] SCRIPT_NAME: `/identity` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:43:38.639784 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8733289-1b6a-4d14-bd29-17349d9461df None admin] PATH_INFO: `/v3/users/08af656c115748f19df102b3401f610b` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:43:38.640886 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8733289-1b6a-4d14-bd29-17349d9461df None admin] RBAC: Authorizing `identity:get_user(user_id=08af656c115748f19df102b3401f610b)` {{(pid=82026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:43:38.642312 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8733289-1b6a-4d14-bd29-17349d9461df None admin] RBAC: Authorization granted {{(pid=82026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:43:38.643883 dv-cinder-828806-6-smb devstack@keystone.service[82026]: [pid: 82026|app: 0|req: 573/1158] 10.222.0.33 () {56 vars in 1177 bytes} [Tue Sep 13 19:43:38 2022] GET /identity/v3/users/08af656c115748f19df102b3401f610b => generated 286 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 19:43:38.650103 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f72c2e2-c163-4d39-9a61-52c8231c5ffe None admin] Authenticating user token {{(pid=82025) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:43:38.730197 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG dbcounter [-] [82025] Writing DB stats keystone:SELECT=100 {{(pid=82025) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:43:38.747769 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f72c2e2-c163-4d39-9a61-52c8231c5ffe None admin] Validating token access rules against request {{(pid=82025) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:43:38.779916 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-945c24ce-e9f3-4862-b30c-ef6c50909075 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57539b6a6f3b4d589f5f5e1d211cd6a0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82025) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:43:38.780512 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-945c24ce-e9f3-4862-b30c-ef6c50909075 None admin] REQUEST_METHOD: `GET` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:43:38.780797 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-945c24ce-e9f3-4862-b30c-ef6c50909075 None admin] SCRIPT_NAME: `/identity` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:43:38.781074 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-945c24ce-e9f3-4862-b30c-ef6c50909075 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:43:38.845562 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-945c24ce-e9f3-4862-b30c-ef6c50909075 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=82025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:43:38.846989 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-945c24ce-e9f3-4862-b30c-ef6c50909075 None admin] RBAC: Authorization granted {{(pid=82025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:43:38.923848 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG dbcounter [-] [82025] Writing DB stats keystone:SELECT=100 {{(pid=82025) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:43:38.942683 dv-cinder-828806-6-smb devstack@keystone.service[82025]: [pid: 82025|app: 0|req: 586/1159] 10.222.0.33 () {58 vars in 1282 bytes} [Tue Sep 13 19:43:38 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 293 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Sep 13 19:43:38.948691 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8733289-1b6a-4d14-bd29-17349d9461df None admin] Authenticating user token {{(pid=82026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:43:39.012894 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG dbcounter [-] [82026] Writing DB stats keystone:SELECT=100 {{(pid=82026) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:43:39.046455 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8733289-1b6a-4d14-bd29-17349d9461df None admin] Validating token access rules against request {{(pid=82026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:43:39.079469 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6fff997-d64a-4f8f-a89b-3677a7191af8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57539b6a6f3b4d589f5f5e1d211cd6a0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:43:39.080087 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6fff997-d64a-4f8f-a89b-3677a7191af8 None admin] REQUEST_METHOD: `GET` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:43:39.080373 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6fff997-d64a-4f8f-a89b-3677a7191af8 None admin] SCRIPT_NAME: `/identity` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:43:39.080653 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6fff997-d64a-4f8f-a89b-3677a7191af8 None admin] PATH_INFO: `/v3/projects/90abb205394c4ca19e3f66453a861d9e` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:43:39.081761 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6fff997-d64a-4f8f-a89b-3677a7191af8 None admin] RBAC: Authorizing `identity:get_project(project_id=90abb205394c4ca19e3f66453a861d9e)` {{(pid=82026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:43:39.083228 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6fff997-d64a-4f8f-a89b-3677a7191af8 None admin] RBAC: Authorization granted {{(pid=82026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:43:39.084846 dv-cinder-828806-6-smb devstack@keystone.service[82026]: [pid: 82026|app: 0|req: 574/1160] 10.222.0.33 () {56 vars in 1186 bytes} [Tue Sep 13 19:43:38 2022] GET /identity/v3/projects/90abb205394c4ca19e3f66453a861d9e => generated 311 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 19:43:39.091085 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-945c24ce-e9f3-4862-b30c-ef6c50909075 None admin] Authenticating user token {{(pid=82025) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:43:39.212509 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-945c24ce-e9f3-4862-b30c-ef6c50909075 None admin] Validating token access rules against request {{(pid=82025) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:43:39.245063 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7bae1ff-5402-4f36-8e4a-b14f42740e28 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57539b6a6f3b4d589f5f5e1d211cd6a0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82025) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:43:39.245654 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7bae1ff-5402-4f36-8e4a-b14f42740e28 None admin] REQUEST_METHOD: `GET` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:43:39.245935 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7bae1ff-5402-4f36-8e4a-b14f42740e28 None admin] SCRIPT_NAME: `/identity` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:43:39.246206 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7bae1ff-5402-4f36-8e4a-b14f42740e28 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:43:39.246914 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7bae1ff-5402-4f36-8e4a-b14f42740e28 None admin] RBAC: Adding query filter params (role.id=e5af7d5baa93469e9e486ef21c85474e, scope.project.id=90abb205394c4ca19e3f66453a861d9e, user.id=08af656c115748f19df102b3401f610b) {{(pid=82025) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 19:43:39.247248 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7bae1ff-5402-4f36-8e4a-b14f42740e28 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=82025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:43:39.248664 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7bae1ff-5402-4f36-8e4a-b14f42740e28 None admin] RBAC: Authorization granted {{(pid=82025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:43:39.254329 dv-cinder-828806-6-smb devstack@keystone.service[82025]: [pid: 82025|app: 0|req: 587/1161] 10.222.0.33 () {56 vars in 1374 bytes} [Tue Sep 13 19:43:39 2022] GET /identity/v3/role_assignments?user.id=08af656c115748f19df102b3401f610b&scope.project.id=90abb205394c4ca19e3f66453a861d9e&role.id=e5af7d5baa93469e9e486ef21c85474e => generated 608 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 19:43:41.402896 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-767d5025-68c1-4988-9cd0-1b8e78396942 None None] REQUEST_METHOD: `GET` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:43:41.403476 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-767d5025-68c1-4988-9cd0-1b8e78396942 None None] SCRIPT_NAME: `/identity` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:43:41.403476 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-767d5025-68c1-4988-9cd0-1b8e78396942 None None] PATH_INFO: `/` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:43:41.404831 dv-cinder-828806-6-smb devstack@keystone.service[82026]: [pid: 82026|app: 0|req: 575/1162] 10.222.0.33 () {54 vars in 927 bytes} [Tue Sep 13 19:43:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 19:43:41.410643 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9514ba44-1672-472f-8c60-dd4e94e8359a None None] REQUEST_METHOD: `POST` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:43:41.411100 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9514ba44-1672-472f-8c60-dd4e94e8359a None None] SCRIPT_NAME: `/identity` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:43:41.411326 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9514ba44-1672-472f-8c60-dd4e94e8359a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:43:41.429464 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.auth.core [None req-9514ba44-1672-472f-8c60-dd4e94e8359a None None] MFA Rules not processed for user `57539b6a6f3b4d589f5f5e1d211cd6a0`. Rule list: `[]` (Enabled: `True`). {{(pid=82025) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 19:43:41.430652 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.fernet_utils [None req-9514ba44-1672-472f-8c60-dd4e94e8359a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82025) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 19:43:41.471369 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG dbcounter [-] [82025] Writing DB stats keystone:SELECT=100 {{(pid=82025) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:43:41.495390 dv-cinder-828806-6-smb devstack@keystone.service[82025]: [pid: 82025|app: 0|req: 588/1163] 10.222.0.33 () {58 vars in 1024 bytes} [Tue Sep 13 19:43:41 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 13 19:43:41.764791 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-767d5025-68c1-4988-9cd0-1b8e78396942 None None] Authenticating user token {{(pid=82026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:43:41.874236 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-767d5025-68c1-4988-9cd0-1b8e78396942 None None] Validating token access rules against request {{(pid=82026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:43:41.906397 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b18358a4-15ec-4793-9bd5-6af6fdfe124f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57539b6a6f3b4d589f5f5e1d211cd6a0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:43:41.907027 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b18358a4-15ec-4793-9bd5-6af6fdfe124f None admin] REQUEST_METHOD: `GET` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:43:41.907340 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b18358a4-15ec-4793-9bd5-6af6fdfe124f None admin] SCRIPT_NAME: `/identity` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:43:41.907615 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b18358a4-15ec-4793-9bd5-6af6fdfe124f None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:43:41.911663 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG dbcounter [-] [82026] Writing DB stats keystone:SELECT=100 {{(pid=82026) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:43:41.974000 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b18358a4-15ec-4793-9bd5-6af6fdfe124f None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=82026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:43:41.975476 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b18358a4-15ec-4793-9bd5-6af6fdfe124f None admin] RBAC: Authorization granted {{(pid=82026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:43:42.069522 dv-cinder-828806-6-smb devstack@keystone.service[82026]: [pid: 82026|app: 0|req: 576/1164] 10.222.0.33 () {58 vars in 1282 bytes} [Tue Sep 13 19:43:41 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 305 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Sep 13 19:43:42.075535 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9514ba44-1672-472f-8c60-dd4e94e8359a None None] Authenticating user token {{(pid=82025) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:43:42.185368 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9514ba44-1672-472f-8c60-dd4e94e8359a None None] Validating token access rules against request {{(pid=82025) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:43:42.218282 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d2b05b9-2c7c-4976-a2e1-ff857948f5cd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57539b6a6f3b4d589f5f5e1d211cd6a0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82025) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:43:42.218898 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d2b05b9-2c7c-4976-a2e1-ff857948f5cd None admin] REQUEST_METHOD: `GET` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:43:42.219209 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d2b05b9-2c7c-4976-a2e1-ff857948f5cd None admin] SCRIPT_NAME: `/identity` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:43:42.219487 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d2b05b9-2c7c-4976-a2e1-ff857948f5cd None admin] PATH_INFO: `/v3/domains/swift_test` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:43:42.226536 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d2b05b9-2c7c-4976-a2e1-ff857948f5cd None admin] RBAC: Authorizing `identity:get_domain(domain_id=swift_test)` {{(pid=82025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:43:42.227997 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d2b05b9-2c7c-4976-a2e1-ff857948f5cd None admin] RBAC: Authorization granted {{(pid=82025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:43:42.238994 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application [None req-5d2b05b9-2c7c-4976-a2e1-ff857948f5cd None admin] Could not find domain: swift_test.: keystone.exception.DomainNotFound: Could not find domain: swift_test. Sep 13 19:43:42.238994 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 19:43:42.238994 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 712, in get_domain Sep 13 19:43:42.238994 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application project = self.driver.get_project(domain_id) Sep 13 19:43:42.238994 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 13 19:43:42.238994 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 13 19:43:42.238994 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 13 19:43:42.238994 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 13 19:43:42.238994 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: swift_test. Sep 13 19:43:42.238994 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application Sep 13 19:43:42.238994 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 13 19:43:42.238994 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application Sep 13 19:43:42.238994 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 19:43:42.238994 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 19:43:42.238994 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 19:43:42.238994 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 19:43:42.238994 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 19:43:42.240305 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 19:43:42.240305 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 19:43:42.240305 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 19:43:42.240305 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 19:43:42.240305 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 19:43:42.240305 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 19:43:42.240305 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 13 19:43:42.240305 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 13 19:43:42.240305 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 13 19:43:42.240305 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 13 19:43:42.240305 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 19:43:42.240305 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 19:43:42.240305 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 19:43:42.240305 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 19:43:42.240305 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 19:43:42.240305 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 19:43:42.241456 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 19:43:42.241456 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application with Lock( Sep 13 19:43:42.241456 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 19:43:42.241456 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application return self._enter() Sep 13 19:43:42.241456 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 19:43:42.241456 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 19:43:42.241456 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 19:43:42.241456 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application return self.creator() Sep 13 19:43:42.241456 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 19:43:42.241456 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application created_value = creator( Sep 13 19:43:42.241456 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 718, in get_domain Sep 13 19:43:42.241456 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 13 19:43:42.241456 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: swift_test. Sep 13 19:43:42.241456 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application Sep 13 19:43:42.241456 dv-cinder-828806-6-smb devstack@keystone.service[82025]: [pid: 82025|app: 0|req: 589/1165] 10.222.0.33 () {56 vars in 1117 bytes} [Tue Sep 13 19:43:42 2022] GET /identity/v3/domains/swift_test => generated 90 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 19:43:42.246120 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b18358a4-15ec-4793-9bd5-6af6fdfe124f None admin] Authenticating user token {{(pid=82026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:43:42.279224 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG dbcounter [-] [82026] Writing DB stats keystone:SELECT=100 {{(pid=82026) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:43:42.342529 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b18358a4-15ec-4793-9bd5-6af6fdfe124f None admin] Validating token access rules against request {{(pid=82026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:43:42.376179 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da72915d-d450-4a8e-b7ca-cab6b9c3ef6c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57539b6a6f3b4d589f5f5e1d211cd6a0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:43:42.376779 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da72915d-d450-4a8e-b7ca-cab6b9c3ef6c None admin] REQUEST_METHOD: `GET` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:43:42.377063 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da72915d-d450-4a8e-b7ca-cab6b9c3ef6c None admin] SCRIPT_NAME: `/identity` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:43:42.377338 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da72915d-d450-4a8e-b7ca-cab6b9c3ef6c None admin] PATH_INFO: `/v3/domains` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:43:42.377978 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da72915d-d450-4a8e-b7ca-cab6b9c3ef6c None admin] RBAC: Adding query filter params (name=swift_test) {{(pid=82026) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 19:43:42.378284 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da72915d-d450-4a8e-b7ca-cab6b9c3ef6c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:43:42.379708 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da72915d-d450-4a8e-b7ca-cab6b9c3ef6c None admin] RBAC: Authorization granted {{(pid=82026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:43:42.386701 dv-cinder-828806-6-smb devstack@keystone.service[82026]: [pid: 82026|app: 0|req: 577/1166] 10.222.0.33 () {56 vars in 1115 bytes} [Tue Sep 13 19:43:42 2022] GET /identity/v3/domains?name=swift_test => generated 125 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 19:43:44.536638 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f136c9ae-bd5d-4497-bbb4-de4357f557a5 None None] REQUEST_METHOD: `GET` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:43:44.537188 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f136c9ae-bd5d-4497-bbb4-de4357f557a5 None None] SCRIPT_NAME: `/identity` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:43:44.537188 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f136c9ae-bd5d-4497-bbb4-de4357f557a5 None None] PATH_INFO: `/` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:43:44.538517 dv-cinder-828806-6-smb devstack@keystone.service[82025]: [pid: 82025|app: 0|req: 590/1167] 10.222.0.33 () {54 vars in 927 bytes} [Tue Sep 13 19:43:44 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 19:43:44.543947 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e22a9a5-9529-498c-9286-788d04996cf2 None None] REQUEST_METHOD: `POST` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:43:44.544401 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e22a9a5-9529-498c-9286-788d04996cf2 None None] SCRIPT_NAME: `/identity` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:43:44.544502 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e22a9a5-9529-498c-9286-788d04996cf2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:43:44.562473 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.auth.core [None req-6e22a9a5-9529-498c-9286-788d04996cf2 None None] MFA Rules not processed for user `57539b6a6f3b4d589f5f5e1d211cd6a0`. Rule list: `[]` (Enabled: `True`). {{(pid=82026) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 19:43:44.563681 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.common.fernet_utils [None req-6e22a9a5-9529-498c-9286-788d04996cf2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82026) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 19:43:44.627007 dv-cinder-828806-6-smb devstack@keystone.service[82026]: [pid: 82026|app: 0|req: 578/1168] 10.222.0.33 () {58 vars in 1024 bytes} [Tue Sep 13 19:43:44 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 13 19:43:44.898909 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f136c9ae-bd5d-4497-bbb4-de4357f557a5 None None] Authenticating user token {{(pid=82025) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:43:44.936337 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG dbcounter [-] [82025] Writing DB stats keystone:SELECT=100 {{(pid=82025) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:43:44.999400 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f136c9ae-bd5d-4497-bbb4-de4357f557a5 None None] Validating token access rules against request {{(pid=82025) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:43:45.031334 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aca6321a-3ebf-41d6-ac60-71950d2d7fe5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57539b6a6f3b4d589f5f5e1d211cd6a0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82025) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:43:45.031928 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aca6321a-3ebf-41d6-ac60-71950d2d7fe5 None admin] REQUEST_METHOD: `POST` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:43:45.032210 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aca6321a-3ebf-41d6-ac60-71950d2d7fe5 None admin] SCRIPT_NAME: `/identity` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:43:45.032483 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aca6321a-3ebf-41d6-ac60-71950d2d7fe5 None admin] PATH_INFO: `/v3/domains` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:43:45.033152 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aca6321a-3ebf-41d6-ac60-71950d2d7fe5 None admin] RBAC: Authorizing `identity:create_domain()` {{(pid=82025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:43:45.034496 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aca6321a-3ebf-41d6-ac60-71950d2d7fe5 None admin] RBAC: Authorization granted {{(pid=82025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:43:45.115574 dv-cinder-828806-6-smb devstack@keystone.service[82025]: [pid: 82025|app: 0|req: 591/1169] 10.222.0.33 () {60 vars in 1138 bytes} [Tue Sep 13 19:43:44 2022] POST /identity/v3/domains => generated 267 bytes in 217 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 13 19:43:47.307138 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2abe14d0-32d1-4d3c-97a7-856dde84d065 None None] REQUEST_METHOD: `GET` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:43:47.307626 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2abe14d0-32d1-4d3c-97a7-856dde84d065 None None] SCRIPT_NAME: `/identity` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:43:47.307728 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2abe14d0-32d1-4d3c-97a7-856dde84d065 None None] PATH_INFO: `/` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:43:47.309037 dv-cinder-828806-6-smb devstack@keystone.service[82026]: [pid: 82026|app: 0|req: 579/1170] 10.222.0.33 () {54 vars in 927 bytes} [Tue Sep 13 19:43:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 19:43:47.314271 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef3ceef2-668d-4f9f-99ac-f153282a1b64 None None] REQUEST_METHOD: `POST` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:43:47.314673 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef3ceef2-668d-4f9f-99ac-f153282a1b64 None None] SCRIPT_NAME: `/identity` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:43:47.314833 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef3ceef2-668d-4f9f-99ac-f153282a1b64 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:43:47.333017 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.auth.core [None req-ef3ceef2-668d-4f9f-99ac-f153282a1b64 None None] MFA Rules not processed for user `57539b6a6f3b4d589f5f5e1d211cd6a0`. Rule list: `[]` (Enabled: `True`). {{(pid=82025) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 19:43:47.334210 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.fernet_utils [None req-ef3ceef2-668d-4f9f-99ac-f153282a1b64 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82025) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 19:43:47.399315 dv-cinder-828806-6-smb devstack@keystone.service[82025]: [pid: 82025|app: 0|req: 592/1171] 10.222.0.33 () {58 vars in 1024 bytes} [Tue Sep 13 19:43:47 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 13 19:43:47.665211 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2abe14d0-32d1-4d3c-97a7-856dde84d065 None None] Authenticating user token {{(pid=82026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:43:47.695485 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG dbcounter [-] [82026] Writing DB stats keystone:SELECT=100 {{(pid=82026) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:43:47.765385 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2abe14d0-32d1-4d3c-97a7-856dde84d065 None None] Validating token access rules against request {{(pid=82026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:43:47.798240 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47a2a2ad-6e0f-409f-b4dc-144e06d4650c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57539b6a6f3b4d589f5f5e1d211cd6a0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:43:47.798855 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47a2a2ad-6e0f-409f-b4dc-144e06d4650c None admin] REQUEST_METHOD: `GET` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:43:47.799165 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47a2a2ad-6e0f-409f-b4dc-144e06d4650c None admin] SCRIPT_NAME: `/identity` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:43:47.799441 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47a2a2ad-6e0f-409f-b4dc-144e06d4650c None admin] PATH_INFO: `/v3/domains/dd850a774de541269f699674737285a6` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:43:47.810173 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47a2a2ad-6e0f-409f-b4dc-144e06d4650c None admin] RBAC: Authorizing `identity:get_domain(domain_id=dd850a774de541269f699674737285a6)` {{(pid=82026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:43:47.811632 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47a2a2ad-6e0f-409f-b4dc-144e06d4650c None admin] RBAC: Authorization granted {{(pid=82026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:43:47.813199 dv-cinder-828806-6-smb devstack@keystone.service[82026]: [pid: 82026|app: 0|req: 580/1172] 10.222.0.33 () {56 vars in 1183 bytes} [Tue Sep 13 19:43:47 2022] GET /identity/v3/domains/dd850a774de541269f699674737285a6 => generated 267 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 19:43:47.819836 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef3ceef2-668d-4f9f-99ac-f153282a1b64 None None] Authenticating user token {{(pid=82025) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:43:47.845981 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG dbcounter [-] [82025] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82025) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:43:47.920175 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef3ceef2-668d-4f9f-99ac-f153282a1b64 None None] Validating token access rules against request {{(pid=82025) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:43:47.953633 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bea05b3-11b6-41e2-8faa-81d73b787071 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57539b6a6f3b4d589f5f5e1d211cd6a0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82025) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:43:47.954232 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bea05b3-11b6-41e2-8faa-81d73b787071 None admin] REQUEST_METHOD: `POST` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:43:47.954510 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bea05b3-11b6-41e2-8faa-81d73b787071 None admin] SCRIPT_NAME: `/identity` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:43:47.954785 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bea05b3-11b6-41e2-8faa-81d73b787071 None admin] PATH_INFO: `/v3/projects` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:43:47.955451 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bea05b3-11b6-41e2-8faa-81d73b787071 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=82025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:43:47.956902 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bea05b3-11b6-41e2-8faa-81d73b787071 None admin] RBAC: Authorization granted {{(pid=82025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:43:48.055576 dv-cinder-828806-6-smb devstack@keystone.service[82025]: [pid: 82025|app: 0|req: 593/1173] 10.222.0.33 () {60 vars in 1141 bytes} [Tue Sep 13 19:43:47 2022] POST /identity/v3/projects => generated 361 bytes in 236 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 13 19:43:50.254498 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf9ccdbd-d13d-453c-80ae-056f3224b0b1 None None] REQUEST_METHOD: `GET` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:43:50.255055 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf9ccdbd-d13d-453c-80ae-056f3224b0b1 None None] SCRIPT_NAME: `/identity` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:43:50.255055 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf9ccdbd-d13d-453c-80ae-056f3224b0b1 None None] PATH_INFO: `/` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:43:50.256414 dv-cinder-828806-6-smb devstack@keystone.service[82026]: [pid: 82026|app: 0|req: 581/1174] 10.222.0.33 () {54 vars in 927 bytes} [Tue Sep 13 19:43:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 19:43:50.261693 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6780278-10ae-454d-b561-ac63df6d19e1 None None] REQUEST_METHOD: `POST` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:43:50.262110 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6780278-10ae-454d-b561-ac63df6d19e1 None None] SCRIPT_NAME: `/identity` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:43:50.262245 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6780278-10ae-454d-b561-ac63df6d19e1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:43:50.280478 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.auth.core [None req-b6780278-10ae-454d-b561-ac63df6d19e1 None None] MFA Rules not processed for user `57539b6a6f3b4d589f5f5e1d211cd6a0`. Rule list: `[]` (Enabled: `True`). {{(pid=82025) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 19:43:50.281660 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.fernet_utils [None req-b6780278-10ae-454d-b561-ac63df6d19e1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82025) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 19:43:50.346668 dv-cinder-828806-6-smb devstack@keystone.service[82025]: [pid: 82025|app: 0|req: 594/1175] 10.222.0.33 () {58 vars in 1024 bytes} [Tue Sep 13 19:43:50 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 13 19:43:50.615073 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf9ccdbd-d13d-453c-80ae-056f3224b0b1 None None] Authenticating user token {{(pid=82026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:43:50.703751 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG dbcounter [-] [82026] Writing DB stats keystone:SELECT=100 {{(pid=82026) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:43:50.713760 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf9ccdbd-d13d-453c-80ae-056f3224b0b1 None None] Validating token access rules against request {{(pid=82026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:43:50.746511 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e1a0386-24ce-4dc1-8eac-5e4b9c277d84 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57539b6a6f3b4d589f5f5e1d211cd6a0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:43:50.747147 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e1a0386-24ce-4dc1-8eac-5e4b9c277d84 None admin] REQUEST_METHOD: `GET` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:43:50.747431 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e1a0386-24ce-4dc1-8eac-5e4b9c277d84 None admin] SCRIPT_NAME: `/identity` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:43:50.747704 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e1a0386-24ce-4dc1-8eac-5e4b9c277d84 None admin] PATH_INFO: `/v3/domains/dd850a774de541269f699674737285a6` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:43:50.748800 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e1a0386-24ce-4dc1-8eac-5e4b9c277d84 None admin] RBAC: Authorizing `identity:get_domain(domain_id=dd850a774de541269f699674737285a6)` {{(pid=82026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:43:50.750228 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e1a0386-24ce-4dc1-8eac-5e4b9c277d84 None admin] RBAC: Authorization granted {{(pid=82026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:43:50.751799 dv-cinder-828806-6-smb devstack@keystone.service[82026]: [pid: 82026|app: 0|req: 582/1176] 10.222.0.33 () {56 vars in 1183 bytes} [Tue Sep 13 19:43:50 2022] GET /identity/v3/domains/dd850a774de541269f699674737285a6 => generated 267 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 19:43:50.757559 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6780278-10ae-454d-b561-ac63df6d19e1 None None] Authenticating user token {{(pid=82025) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:43:50.767524 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG dbcounter [-] [82025] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82025) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:43:50.856641 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6780278-10ae-454d-b561-ac63df6d19e1 None None] Validating token access rules against request {{(pid=82025) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:43:50.890995 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fcffb1f-1eac-4fe3-a7dc-cf3cb7ddc380 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57539b6a6f3b4d589f5f5e1d211cd6a0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82025) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:43:50.891566 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fcffb1f-1eac-4fe3-a7dc-cf3cb7ddc380 None admin] REQUEST_METHOD: `POST` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:43:50.891849 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fcffb1f-1eac-4fe3-a7dc-cf3cb7ddc380 None admin] SCRIPT_NAME: `/identity` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:43:50.892124 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fcffb1f-1eac-4fe3-a7dc-cf3cb7ddc380 None admin] PATH_INFO: `/v3/users` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:43:50.892773 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fcffb1f-1eac-4fe3-a7dc-cf3cb7ddc380 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=82025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:43:50.894189 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fcffb1f-1eac-4fe3-a7dc-cf3cb7ddc380 None admin] RBAC: Authorization granted {{(pid=82025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:43:50.982644 dv-cinder-828806-6-smb devstack@keystone.service[82025]: [pid: 82025|app: 0|req: 595/1177] 10.222.0.33 () {60 vars in 1132 bytes} [Tue Sep 13 19:43:50 2022] POST /identity/v3/users => generated 311 bytes in 226 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 13 19:43:53.149920 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f5b011a-5493-45c9-b4bc-30ba682a335f None None] REQUEST_METHOD: `GET` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:43:53.150458 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f5b011a-5493-45c9-b4bc-30ba682a335f None None] SCRIPT_NAME: `/identity` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:43:53.150458 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f5b011a-5493-45c9-b4bc-30ba682a335f None None] PATH_INFO: `/` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:43:53.151867 dv-cinder-828806-6-smb devstack@keystone.service[82026]: [pid: 82026|app: 0|req: 583/1178] 10.222.0.33 () {54 vars in 927 bytes} [Tue Sep 13 19:43:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 19:43:53.157082 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec5362b4-7881-4250-99c0-8df0f5eb52f5 None None] REQUEST_METHOD: `POST` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:43:53.157467 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec5362b4-7881-4250-99c0-8df0f5eb52f5 None None] SCRIPT_NAME: `/identity` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:43:53.157633 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec5362b4-7881-4250-99c0-8df0f5eb52f5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:43:53.176226 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.auth.core [None req-ec5362b4-7881-4250-99c0-8df0f5eb52f5 None None] MFA Rules not processed for user `57539b6a6f3b4d589f5f5e1d211cd6a0`. Rule list: `[]` (Enabled: `True`). {{(pid=82025) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 19:43:53.177558 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.fernet_utils [None req-ec5362b4-7881-4250-99c0-8df0f5eb52f5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82025) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 19:43:53.239618 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG dbcounter [-] [82025] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=82025) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:43:53.264718 dv-cinder-828806-6-smb devstack@keystone.service[82025]: [pid: 82025|app: 0|req: 596/1179] 10.222.0.33 () {58 vars in 1024 bytes} [Tue Sep 13 19:43:53 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 13 19:43:53.541299 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f5b011a-5493-45c9-b4bc-30ba682a335f None None] Authenticating user token {{(pid=82026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:43:53.644078 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f5b011a-5493-45c9-b4bc-30ba682a335f None None] Validating token access rules against request {{(pid=82026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:43:53.677394 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a6fd85c-670f-4fa6-8edc-b09890214b9b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57539b6a6f3b4d589f5f5e1d211cd6a0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:43:53.678011 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a6fd85c-670f-4fa6-8edc-b09890214b9b None admin] REQUEST_METHOD: `GET` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:43:53.678290 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a6fd85c-670f-4fa6-8edc-b09890214b9b None admin] SCRIPT_NAME: `/identity` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:43:53.678562 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a6fd85c-670f-4fa6-8edc-b09890214b9b None admin] PATH_INFO: `/v3/roles/admin` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:43:53.688235 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a6fd85c-670f-4fa6-8edc-b09890214b9b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=82026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 13 19:43:53.693658 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application [None req-1a6fd85c-670f-4fa6-8edc-b09890214b9b None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 13 19:43:53.693658 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 19:43:53.693658 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 19:43:53.693658 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 19:43:53.693658 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 19:43:53.693658 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 19:43:53.693658 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 19:43:53.693658 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 19:43:53.693658 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 19:43:53.693658 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 19:43:53.693658 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 19:43:53.693658 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 19:43:53.693658 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 13 19:43:53.693658 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 13 19:43:53.693658 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 13 19:43:53.693658 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 13 19:43:53.694826 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 13 19:43:53.694826 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 13 19:43:53.694826 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 13 19:43:53.694826 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 13 19:43:53.694826 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 19:43:53.694826 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 19:43:53.694826 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 19:43:53.694826 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 19:43:53.694826 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 19:43:53.694826 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 19:43:53.694826 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 19:43:53.694826 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application with Lock( Sep 13 19:43:53.694826 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 19:43:53.694826 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application return self._enter() Sep 13 19:43:53.694826 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 19:43:53.694826 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 19:43:53.695693 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 19:43:53.695693 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application return self.creator() Sep 13 19:43:53.695693 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 19:43:53.695693 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application created_value = creator( Sep 13 19:43:53.695693 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 13 19:43:53.695693 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 13 19:43:53.695693 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 13 19:43:53.695693 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 13 19:43:53.695693 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 13 19:43:53.695693 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 13 19:43:53.695693 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 13 19:43:53.695693 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application Sep 13 19:43:53.695693 dv-cinder-828806-6-smb devstack@keystone.service[82026]: [pid: 82026|app: 0|req: 584/1180] 10.222.0.33 () {56 vars in 1096 bytes} [Tue Sep 13 19:43:53 2022] GET /identity/v3/roles/admin => generated 83 bytes in 154 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 19:43:53.700932 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec5362b4-7881-4250-99c0-8df0f5eb52f5 None None] Authenticating user token {{(pid=82025) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:43:53.798532 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec5362b4-7881-4250-99c0-8df0f5eb52f5 None None] Validating token access rules against request {{(pid=82025) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:43:53.831824 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e557f61c-c8bb-40d3-b908-5f8d03953064 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57539b6a6f3b4d589f5f5e1d211cd6a0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82025) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:43:53.832424 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e557f61c-c8bb-40d3-b908-5f8d03953064 None admin] REQUEST_METHOD: `GET` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:43:53.832877 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e557f61c-c8bb-40d3-b908-5f8d03953064 None admin] SCRIPT_NAME: `/identity` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:43:53.833053 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e557f61c-c8bb-40d3-b908-5f8d03953064 None admin] PATH_INFO: `/v3/roles` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:43:53.833738 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e557f61c-c8bb-40d3-b908-5f8d03953064 None admin] RBAC: Adding query filter params (name=admin) {{(pid=82025) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 19:43:53.834046 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e557f61c-c8bb-40d3-b908-5f8d03953064 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:43:53.835443 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e557f61c-c8bb-40d3-b908-5f8d03953064 None admin] RBAC: Authorization granted {{(pid=82025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:43:53.843334 dv-cinder-828806-6-smb devstack@keystone.service[82025]: [pid: 82025|app: 0|req: 597/1181] 10.222.0.33 () {56 vars in 1099 bytes} [Tue Sep 13 19:43:53 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 19:43:53.850104 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a6fd85c-670f-4fa6-8edc-b09890214b9b None admin] Authenticating user token {{(pid=82026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:43:53.870374 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG dbcounter [-] [82026] Writing DB stats keystone:SELECT=100 {{(pid=82026) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:43:54.007347 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a6fd85c-670f-4fa6-8edc-b09890214b9b None admin] Validating token access rules against request {{(pid=82026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:43:54.040048 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c99c35d6-1fc6-46f7-8b66-f8c79d983a29 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57539b6a6f3b4d589f5f5e1d211cd6a0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:43:54.040916 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c99c35d6-1fc6-46f7-8b66-f8c79d983a29 None admin] REQUEST_METHOD: `GET` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:43:54.041194 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c99c35d6-1fc6-46f7-8b66-f8c79d983a29 None admin] SCRIPT_NAME: `/identity` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:43:54.041467 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c99c35d6-1fc6-46f7-8b66-f8c79d983a29 None admin] PATH_INFO: `/v3/users/63b84e1678a44ad7b82063bcc9393444` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:43:54.054532 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c99c35d6-1fc6-46f7-8b66-f8c79d983a29 None admin] RBAC: Authorizing `identity:get_user(user_id=63b84e1678a44ad7b82063bcc9393444)` {{(pid=82026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:43:54.055941 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c99c35d6-1fc6-46f7-8b66-f8c79d983a29 None admin] RBAC: Authorization granted {{(pid=82026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:43:54.057517 dv-cinder-828806-6-smb devstack@keystone.service[82026]: [pid: 82026|app: 0|req: 585/1182] 10.222.0.33 () {56 vars in 1177 bytes} [Tue Sep 13 19:43:53 2022] GET /identity/v3/users/63b84e1678a44ad7b82063bcc9393444 => generated 311 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 19:43:54.063411 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e557f61c-c8bb-40d3-b908-5f8d03953064 None admin] Authenticating user token {{(pid=82025) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:43:54.118093 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG dbcounter [-] [82025] Writing DB stats keystone:SELECT=100 {{(pid=82025) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:43:54.160165 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e557f61c-c8bb-40d3-b908-5f8d03953064 None admin] Validating token access rules against request {{(pid=82025) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:43:54.192681 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0d24a9c-889a-4db4-8af5-c45dd0e9f587 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57539b6a6f3b4d589f5f5e1d211cd6a0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82025) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:43:54.193271 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0d24a9c-889a-4db4-8af5-c45dd0e9f587 None admin] REQUEST_METHOD: `GET` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:43:54.193553 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0d24a9c-889a-4db4-8af5-c45dd0e9f587 None admin] SCRIPT_NAME: `/identity` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:43:54.193828 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0d24a9c-889a-4db4-8af5-c45dd0e9f587 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:43:54.259867 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0d24a9c-889a-4db4-8af5-c45dd0e9f587 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=82025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:43:54.261307 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0d24a9c-889a-4db4-8af5-c45dd0e9f587 None admin] RBAC: Authorization granted {{(pid=82025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:43:54.315314 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG dbcounter [-] [82025] Writing DB stats keystone:SELECT=100 {{(pid=82025) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:43:54.359210 dv-cinder-828806-6-smb devstack@keystone.service[82025]: [pid: 82025|app: 0|req: 598/1183] 10.222.0.33 () {58 vars in 1282 bytes} [Tue Sep 13 19:43:54 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 296 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Sep 13 19:43:54.365147 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c99c35d6-1fc6-46f7-8b66-f8c79d983a29 None admin] Authenticating user token {{(pid=82026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:43:54.438823 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG dbcounter [-] [82026] Writing DB stats keystone:SELECT=100 {{(pid=82026) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:43:54.460799 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c99c35d6-1fc6-46f7-8b66-f8c79d983a29 None admin] Validating token access rules against request {{(pid=82026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:43:54.493872 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1279f023-8d12-4f28-9a20-78d062f7a692 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57539b6a6f3b4d589f5f5e1d211cd6a0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:43:54.494476 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1279f023-8d12-4f28-9a20-78d062f7a692 None admin] REQUEST_METHOD: `GET` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:43:54.494763 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1279f023-8d12-4f28-9a20-78d062f7a692 None admin] SCRIPT_NAME: `/identity` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:43:54.495062 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1279f023-8d12-4f28-9a20-78d062f7a692 None admin] PATH_INFO: `/v3/projects/5d2260ac58ed49a4a6538d35d503b095` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:43:54.496158 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1279f023-8d12-4f28-9a20-78d062f7a692 None admin] RBAC: Authorizing `identity:get_project(project_id=5d2260ac58ed49a4a6538d35d503b095)` {{(pid=82026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:43:54.497598 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1279f023-8d12-4f28-9a20-78d062f7a692 None admin] RBAC: Authorization granted {{(pid=82026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:43:54.499209 dv-cinder-828806-6-smb devstack@keystone.service[82026]: [pid: 82026|app: 0|req: 586/1184] 10.222.0.33 () {56 vars in 1186 bytes} [Tue Sep 13 19:43:54 2022] GET /identity/v3/projects/5d2260ac58ed49a4a6538d35d503b095 => generated 361 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 19:43:54.505777 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0d24a9c-889a-4db4-8af5-c45dd0e9f587 None admin] Authenticating user token {{(pid=82025) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:43:54.608637 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0d24a9c-889a-4db4-8af5-c45dd0e9f587 None admin] Validating token access rules against request {{(pid=82025) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:43:54.641375 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88725c2d-2e51-483b-87a0-f5d577461794 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57539b6a6f3b4d589f5f5e1d211cd6a0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82025) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:43:54.641965 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88725c2d-2e51-483b-87a0-f5d577461794 None admin] REQUEST_METHOD: `GET` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:43:54.642243 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88725c2d-2e51-483b-87a0-f5d577461794 None admin] SCRIPT_NAME: `/identity` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:43:54.642515 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88725c2d-2e51-483b-87a0-f5d577461794 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:43:54.643255 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88725c2d-2e51-483b-87a0-f5d577461794 None admin] RBAC: Adding query filter params (role.id=e5af7d5baa93469e9e486ef21c85474e, scope.project.id=5d2260ac58ed49a4a6538d35d503b095, user.id=63b84e1678a44ad7b82063bcc9393444) {{(pid=82025) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 19:43:54.643565 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88725c2d-2e51-483b-87a0-f5d577461794 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=82025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:43:54.644968 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88725c2d-2e51-483b-87a0-f5d577461794 None admin] RBAC: Authorization granted {{(pid=82025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:43:54.650749 dv-cinder-828806-6-smb devstack@keystone.service[82025]: [pid: 82025|app: 0|req: 599/1185] 10.222.0.33 () {56 vars in 1374 bytes} [Tue Sep 13 19:43:54 2022] GET /identity/v3/role_assignments?user.id=63b84e1678a44ad7b82063bcc9393444&scope.project.id=5d2260ac58ed49a4a6538d35d503b095&role.id=e5af7d5baa93469e9e486ef21c85474e => generated 259 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 19:43:56.771219 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c32150e2-d962-41cc-9e16-72a5e7db4e80 None None] REQUEST_METHOD: `GET` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:43:56.771773 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c32150e2-d962-41cc-9e16-72a5e7db4e80 None None] SCRIPT_NAME: `/identity` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:43:56.771773 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c32150e2-d962-41cc-9e16-72a5e7db4e80 None None] PATH_INFO: `/` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:43:56.773152 dv-cinder-828806-6-smb devstack@keystone.service[82026]: [pid: 82026|app: 0|req: 587/1186] 10.222.0.33 () {54 vars in 927 bytes} [Tue Sep 13 19:43:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 19:43:56.778446 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-470bd3d9-a748-4566-8f2e-2d02097ceea2 None None] REQUEST_METHOD: `POST` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:43:56.778846 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-470bd3d9-a748-4566-8f2e-2d02097ceea2 None None] SCRIPT_NAME: `/identity` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:43:56.778988 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-470bd3d9-a748-4566-8f2e-2d02097ceea2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:43:56.797444 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.auth.core [None req-470bd3d9-a748-4566-8f2e-2d02097ceea2 None None] MFA Rules not processed for user `57539b6a6f3b4d589f5f5e1d211cd6a0`. Rule list: `[]` (Enabled: `True`). {{(pid=82025) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 19:43:56.798616 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.fernet_utils [None req-470bd3d9-a748-4566-8f2e-2d02097ceea2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82025) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 19:43:56.812668 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG dbcounter [-] [82025] Writing DB stats keystone:SELECT=100 {{(pid=82025) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:43:56.862958 dv-cinder-828806-6-smb devstack@keystone.service[82025]: [pid: 82025|app: 0|req: 600/1187] 10.222.0.33 () {58 vars in 1024 bytes} [Tue Sep 13 19:43:56 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 13 19:43:57.129228 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c32150e2-d962-41cc-9e16-72a5e7db4e80 None None] Authenticating user token {{(pid=82026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:43:57.230363 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c32150e2-d962-41cc-9e16-72a5e7db4e80 None None] Validating token access rules against request {{(pid=82026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:43:57.262767 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f154fbd-972b-4df3-93f3-6eac91f08068 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57539b6a6f3b4d589f5f5e1d211cd6a0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:43:57.263414 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f154fbd-972b-4df3-93f3-6eac91f08068 None admin] REQUEST_METHOD: `GET` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:43:57.263705 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f154fbd-972b-4df3-93f3-6eac91f08068 None admin] SCRIPT_NAME: `/identity` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:43:57.263986 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f154fbd-972b-4df3-93f3-6eac91f08068 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:43:57.274467 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f154fbd-972b-4df3-93f3-6eac91f08068 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=82026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 13 19:43:57.279345 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application [None req-0f154fbd-972b-4df3-93f3-6eac91f08068 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 13 19:43:57.279345 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 19:43:57.279345 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 19:43:57.279345 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 19:43:57.279345 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 19:43:57.279345 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 19:43:57.279345 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 19:43:57.279345 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 19:43:57.279345 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 19:43:57.279345 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 19:43:57.279345 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 19:43:57.279345 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 19:43:57.279345 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 13 19:43:57.279345 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 13 19:43:57.279345 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 13 19:43:57.279345 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 13 19:43:57.280487 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 13 19:43:57.280487 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 13 19:43:57.280487 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 13 19:43:57.280487 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 13 19:43:57.280487 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 19:43:57.280487 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 19:43:57.280487 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 19:43:57.280487 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 19:43:57.280487 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 19:43:57.280487 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 19:43:57.280487 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 19:43:57.280487 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application with Lock( Sep 13 19:43:57.280487 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 19:43:57.280487 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application return self._enter() Sep 13 19:43:57.280487 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 19:43:57.280487 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 19:43:57.281527 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 19:43:57.281527 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application return self.creator() Sep 13 19:43:57.281527 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 19:43:57.281527 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application created_value = creator( Sep 13 19:43:57.281527 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 13 19:43:57.281527 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 13 19:43:57.281527 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 13 19:43:57.281527 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 13 19:43:57.281527 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 13 19:43:57.281527 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 13 19:43:57.281527 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 13 19:43:57.281527 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application Sep 13 19:43:57.281527 dv-cinder-828806-6-smb devstack@keystone.service[82026]: [pid: 82026|app: 0|req: 588/1188] 10.222.0.33 () {56 vars in 1096 bytes} [Tue Sep 13 19:43:57 2022] GET /identity/v3/roles/admin => generated 83 bytes in 152 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 19:43:57.287394 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-470bd3d9-a748-4566-8f2e-2d02097ceea2 None None] Authenticating user token {{(pid=82025) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:43:57.384253 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-470bd3d9-a748-4566-8f2e-2d02097ceea2 None None] Validating token access rules against request {{(pid=82025) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:43:57.418152 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cb08cee-4856-433f-9ce6-2096873831ed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57539b6a6f3b4d589f5f5e1d211cd6a0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82025) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:43:57.418751 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cb08cee-4856-433f-9ce6-2096873831ed None admin] REQUEST_METHOD: `GET` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:43:57.419057 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cb08cee-4856-433f-9ce6-2096873831ed None admin] SCRIPT_NAME: `/identity` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:43:57.419341 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cb08cee-4856-433f-9ce6-2096873831ed None admin] PATH_INFO: `/v3/roles` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:43:57.419999 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cb08cee-4856-433f-9ce6-2096873831ed None admin] RBAC: Adding query filter params (name=admin) {{(pid=82025) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 19:43:57.420306 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cb08cee-4856-433f-9ce6-2096873831ed None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:43:57.421665 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cb08cee-4856-433f-9ce6-2096873831ed None admin] RBAC: Authorization granted {{(pid=82025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:43:57.429827 dv-cinder-828806-6-smb devstack@keystone.service[82025]: [pid: 82025|app: 0|req: 601/1189] 10.222.0.33 () {56 vars in 1099 bytes} [Tue Sep 13 19:43:57 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 13 19:43:57.435694 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f154fbd-972b-4df3-93f3-6eac91f08068 None admin] Authenticating user token {{(pid=82026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:43:57.440007 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG dbcounter [-] [82026] Writing DB stats keystone:SELECT=100 {{(pid=82026) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:43:57.532601 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f154fbd-972b-4df3-93f3-6eac91f08068 None admin] Validating token access rules against request {{(pid=82026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:43:57.565387 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c20a8836-72c9-4cab-a240-2a836115062c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57539b6a6f3b4d589f5f5e1d211cd6a0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:43:57.565996 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c20a8836-72c9-4cab-a240-2a836115062c None admin] REQUEST_METHOD: `GET` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:43:57.566277 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c20a8836-72c9-4cab-a240-2a836115062c None admin] SCRIPT_NAME: `/identity` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:43:57.566548 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c20a8836-72c9-4cab-a240-2a836115062c None admin] PATH_INFO: `/v3/users/63b84e1678a44ad7b82063bcc9393444` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:43:57.568295 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c20a8836-72c9-4cab-a240-2a836115062c None admin] RBAC: Authorizing `identity:get_user(user_id=63b84e1678a44ad7b82063bcc9393444)` {{(pid=82026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:43:57.569722 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c20a8836-72c9-4cab-a240-2a836115062c None admin] RBAC: Authorization granted {{(pid=82026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:43:57.571367 dv-cinder-828806-6-smb devstack@keystone.service[82026]: [pid: 82026|app: 0|req: 589/1190] 10.222.0.33 () {56 vars in 1177 bytes} [Tue Sep 13 19:43:57 2022] GET /identity/v3/users/63b84e1678a44ad7b82063bcc9393444 => generated 311 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 19:43:57.577138 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cb08cee-4856-433f-9ce6-2096873831ed None admin] Authenticating user token {{(pid=82025) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:43:57.593487 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG dbcounter [-] [82025] Writing DB stats keystone:SELECT=100 {{(pid=82025) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:43:57.678064 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cb08cee-4856-433f-9ce6-2096873831ed None admin] Validating token access rules against request {{(pid=82025) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:43:57.710866 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50cf74fe-2242-4700-8e29-eae342784d54 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57539b6a6f3b4d589f5f5e1d211cd6a0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82025) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:43:57.711513 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50cf74fe-2242-4700-8e29-eae342784d54 None admin] REQUEST_METHOD: `GET` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:43:57.711795 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50cf74fe-2242-4700-8e29-eae342784d54 None admin] SCRIPT_NAME: `/identity` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:43:57.712069 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50cf74fe-2242-4700-8e29-eae342784d54 None admin] PATH_INFO: `/v3/projects/5d2260ac58ed49a4a6538d35d503b095` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:43:57.713169 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50cf74fe-2242-4700-8e29-eae342784d54 None admin] RBAC: Authorizing `identity:get_project(project_id=5d2260ac58ed49a4a6538d35d503b095)` {{(pid=82025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:43:57.714589 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50cf74fe-2242-4700-8e29-eae342784d54 None admin] RBAC: Authorization granted {{(pid=82025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:43:57.716222 dv-cinder-828806-6-smb devstack@keystone.service[82025]: [pid: 82025|app: 0|req: 602/1191] 10.222.0.33 () {56 vars in 1186 bytes} [Tue Sep 13 19:43:57 2022] GET /identity/v3/projects/5d2260ac58ed49a4a6538d35d503b095 => generated 361 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 19:43:57.722202 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c20a8836-72c9-4cab-a240-2a836115062c None admin] Authenticating user token {{(pid=82026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:43:57.789687 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG dbcounter [-] [82026] Writing DB stats keystone:SELECT=100 {{(pid=82026) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:43:57.818392 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c20a8836-72c9-4cab-a240-2a836115062c None admin] Validating token access rules against request {{(pid=82026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:43:57.852224 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cea35493-efbf-4bff-8c63-87f19cda609a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57539b6a6f3b4d589f5f5e1d211cd6a0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:43:57.852867 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cea35493-efbf-4bff-8c63-87f19cda609a None admin] REQUEST_METHOD: `PUT` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:43:57.853151 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cea35493-efbf-4bff-8c63-87f19cda609a None admin] SCRIPT_NAME: `/identity` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:43:57.853428 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cea35493-efbf-4bff-8c63-87f19cda609a None admin] PATH_INFO: `/v3/projects/5d2260ac58ed49a4a6538d35d503b095/users/63b84e1678a44ad7b82063bcc9393444/roles/e5af7d5baa93469e9e486ef21c85474e` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:43:57.855338 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cea35493-efbf-4bff-8c63-87f19cda609a None admin] RBAC: Authorizing `identity:create_grant(project_id=5d2260ac58ed49a4a6538d35d503b095, user_id=63b84e1678a44ad7b82063bcc9393444, role_id=e5af7d5baa93469e9e486ef21c85474e)` {{(pid=82026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:43:57.856767 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cea35493-efbf-4bff-8c63-87f19cda609a None admin] RBAC: Authorization granted {{(pid=82026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:43:57.919007 dv-cinder-828806-6-smb devstack@keystone.service[82026]: [pid: 82026|app: 0|req: 590/1192] 10.222.0.33 () {58 vars in 1439 bytes} [Tue Sep 13 19:43:57 2022] PUT /identity/v3/projects/5d2260ac58ed49a4a6538d35d503b095/users/63b84e1678a44ad7b82063bcc9393444/roles/e5af7d5baa93469e9e486ef21c85474e => generated 0 bytes in 197 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 19:44:00.022540 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9a1a045-a72e-400c-b8c8-c3ae454a8c5c None None] REQUEST_METHOD: `GET` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:44:00.023137 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9a1a045-a72e-400c-b8c8-c3ae454a8c5c None None] SCRIPT_NAME: `/identity` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:44:00.023137 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9a1a045-a72e-400c-b8c8-c3ae454a8c5c None None] PATH_INFO: `/` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:44:00.024477 dv-cinder-828806-6-smb devstack@keystone.service[82025]: [pid: 82025|app: 0|req: 603/1193] 10.222.0.33 () {54 vars in 927 bytes} [Tue Sep 13 19:44:00 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 19:44:00.029629 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71c7bc2e-c30d-4292-972c-3901daa744cb None None] REQUEST_METHOD: `POST` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:44:00.029992 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71c7bc2e-c30d-4292-972c-3901daa744cb None None] SCRIPT_NAME: `/identity` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:44:00.030192 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71c7bc2e-c30d-4292-972c-3901daa744cb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:44:00.049037 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.auth.core [None req-71c7bc2e-c30d-4292-972c-3901daa744cb None None] MFA Rules not processed for user `57539b6a6f3b4d589f5f5e1d211cd6a0`. Rule list: `[]` (Enabled: `True`). {{(pid=82026) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 19:44:00.050223 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.common.fernet_utils [None req-71c7bc2e-c30d-4292-972c-3901daa744cb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82026) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 19:44:00.116115 dv-cinder-828806-6-smb devstack@keystone.service[82026]: [pid: 82026|app: 0|req: 591/1194] 10.222.0.33 () {58 vars in 1024 bytes} [Tue Sep 13 19:44:00 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 13 19:44:00.394838 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9a1a045-a72e-400c-b8c8-c3ae454a8c5c None None] Authenticating user token {{(pid=82025) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:44:00.475305 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG dbcounter [-] [82025] Writing DB stats keystone:SELECT=100 {{(pid=82025) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:44:00.494095 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9a1a045-a72e-400c-b8c8-c3ae454a8c5c None None] Validating token access rules against request {{(pid=82025) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:44:00.526494 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03fb78d7-0a63-4fd3-ae61-a5f805aa6721 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57539b6a6f3b4d589f5f5e1d211cd6a0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82025) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:44:00.527131 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03fb78d7-0a63-4fd3-ae61-a5f805aa6721 None admin] REQUEST_METHOD: `GET` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:44:00.527414 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03fb78d7-0a63-4fd3-ae61-a5f805aa6721 None admin] SCRIPT_NAME: `/identity` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:44:00.527685 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03fb78d7-0a63-4fd3-ae61-a5f805aa6721 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:44:00.538409 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03fb78d7-0a63-4fd3-ae61-a5f805aa6721 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=82025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 13 19:44:00.543372 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application [None req-03fb78d7-0a63-4fd3-ae61-a5f805aa6721 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 13 19:44:00.543372 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 19:44:00.543372 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 19:44:00.543372 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 19:44:00.543372 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 19:44:00.543372 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 19:44:00.543372 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 19:44:00.543372 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 19:44:00.543372 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 19:44:00.543372 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 19:44:00.543372 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 19:44:00.543372 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 19:44:00.543372 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 13 19:44:00.543372 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 13 19:44:00.543372 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 13 19:44:00.543372 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 13 19:44:00.544466 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 13 19:44:00.544466 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 13 19:44:00.544466 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 13 19:44:00.544466 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 13 19:44:00.544466 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 19:44:00.544466 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 19:44:00.544466 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 19:44:00.544466 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 19:44:00.544466 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 19:44:00.544466 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 19:44:00.544466 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 19:44:00.544466 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application with Lock( Sep 13 19:44:00.544466 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 19:44:00.544466 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application return self._enter() Sep 13 19:44:00.544466 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 19:44:00.544466 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 19:44:00.545707 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 19:44:00.545707 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application return self.creator() Sep 13 19:44:00.545707 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 19:44:00.545707 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application created_value = creator( Sep 13 19:44:00.545707 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 13 19:44:00.545707 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 13 19:44:00.545707 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 13 19:44:00.545707 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 13 19:44:00.545707 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 13 19:44:00.545707 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 13 19:44:00.545707 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 13 19:44:00.545707 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application Sep 13 19:44:00.545707 dv-cinder-828806-6-smb devstack@keystone.service[82025]: [pid: 82025|app: 0|req: 604/1195] 10.222.0.33 () {56 vars in 1096 bytes} [Tue Sep 13 19:44:00 2022] GET /identity/v3/roles/admin => generated 83 bytes in 150 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 19:44:00.550402 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71c7bc2e-c30d-4292-972c-3901daa744cb None None] Authenticating user token {{(pid=82026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:44:00.610400 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG dbcounter [-] [82026] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82026) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:44:00.649577 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71c7bc2e-c30d-4292-972c-3901daa744cb None None] Validating token access rules against request {{(pid=82026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:44:00.682768 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6460bde5-b9d8-4670-9366-77249fced882 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57539b6a6f3b4d589f5f5e1d211cd6a0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:44:00.683397 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6460bde5-b9d8-4670-9366-77249fced882 None admin] REQUEST_METHOD: `GET` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:44:00.683681 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6460bde5-b9d8-4670-9366-77249fced882 None admin] SCRIPT_NAME: `/identity` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:44:00.683955 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6460bde5-b9d8-4670-9366-77249fced882 None admin] PATH_INFO: `/v3/roles` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:44:00.684621 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6460bde5-b9d8-4670-9366-77249fced882 None admin] RBAC: Adding query filter params (name=admin) {{(pid=82026) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 19:44:00.684929 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6460bde5-b9d8-4670-9366-77249fced882 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:44:00.686303 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6460bde5-b9d8-4670-9366-77249fced882 None admin] RBAC: Authorization granted {{(pid=82026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:44:00.694615 dv-cinder-828806-6-smb devstack@keystone.service[82026]: [pid: 82026|app: 0|req: 592/1196] 10.222.0.33 () {56 vars in 1099 bytes} [Tue Sep 13 19:44:00 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 19:44:00.700587 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03fb78d7-0a63-4fd3-ae61-a5f805aa6721 None admin] Authenticating user token {{(pid=82025) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:44:00.796925 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03fb78d7-0a63-4fd3-ae61-a5f805aa6721 None admin] Validating token access rules against request {{(pid=82025) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:44:00.829050 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82ec32c9-8609-470e-a64e-72b6e2333706 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57539b6a6f3b4d589f5f5e1d211cd6a0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82025) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:44:00.829660 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82ec32c9-8609-470e-a64e-72b6e2333706 None admin] REQUEST_METHOD: `GET` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:44:00.829943 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82ec32c9-8609-470e-a64e-72b6e2333706 None admin] SCRIPT_NAME: `/identity` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:44:00.830218 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82ec32c9-8609-470e-a64e-72b6e2333706 None admin] PATH_INFO: `/v3/users/63b84e1678a44ad7b82063bcc9393444` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:44:00.831380 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82ec32c9-8609-470e-a64e-72b6e2333706 None admin] RBAC: Authorizing `identity:get_user(user_id=63b84e1678a44ad7b82063bcc9393444)` {{(pid=82025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:44:00.832806 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82ec32c9-8609-470e-a64e-72b6e2333706 None admin] RBAC: Authorization granted {{(pid=82025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:44:00.834509 dv-cinder-828806-6-smb devstack@keystone.service[82025]: [pid: 82025|app: 0|req: 605/1197] 10.222.0.33 () {56 vars in 1177 bytes} [Tue Sep 13 19:44:00 2022] GET /identity/v3/users/63b84e1678a44ad7b82063bcc9393444 => generated 311 bytes in 134 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 19:44:00.840229 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6460bde5-b9d8-4670-9366-77249fced882 None admin] Authenticating user token {{(pid=82026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:44:00.944743 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6460bde5-b9d8-4670-9366-77249fced882 None admin] Validating token access rules against request {{(pid=82026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:44:00.968191 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG dbcounter [-] [82026] Writing DB stats keystone:SELECT=100 {{(pid=82026) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:44:00.979428 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-606913e7-fd46-4d4b-bfc3-15f49516defd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57539b6a6f3b4d589f5f5e1d211cd6a0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:44:00.980032 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-606913e7-fd46-4d4b-bfc3-15f49516defd None admin] REQUEST_METHOD: `GET` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:44:00.980317 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-606913e7-fd46-4d4b-bfc3-15f49516defd None admin] SCRIPT_NAME: `/identity` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:44:00.980594 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-606913e7-fd46-4d4b-bfc3-15f49516defd None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:44:01.047850 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-606913e7-fd46-4d4b-bfc3-15f49516defd None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=82026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:44:01.049228 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-606913e7-fd46-4d4b-bfc3-15f49516defd None admin] RBAC: Authorization granted {{(pid=82026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:44:01.144510 dv-cinder-828806-6-smb devstack@keystone.service[82026]: [pid: 82026|app: 0|req: 593/1198] 10.222.0.33 () {58 vars in 1282 bytes} [Tue Sep 13 19:44:00 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 305 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Sep 13 19:44:01.151176 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82ec32c9-8609-470e-a64e-72b6e2333706 None admin] Authenticating user token {{(pid=82025) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:44:01.162908 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG dbcounter [-] [82025] Writing DB stats keystone:SELECT=100 {{(pid=82025) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:44:01.266014 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82ec32c9-8609-470e-a64e-72b6e2333706 None admin] Validating token access rules against request {{(pid=82025) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:44:01.310305 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06f3368f-01af-4352-8ff4-3b6918684cdf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57539b6a6f3b4d589f5f5e1d211cd6a0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82025) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:44:01.310950 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06f3368f-01af-4352-8ff4-3b6918684cdf None admin] REQUEST_METHOD: `GET` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:44:01.311314 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06f3368f-01af-4352-8ff4-3b6918684cdf None admin] SCRIPT_NAME: `/identity` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:44:01.311650 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06f3368f-01af-4352-8ff4-3b6918684cdf None admin] PATH_INFO: `/v3/projects/5d2260ac58ed49a4a6538d35d503b095` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:44:01.315304 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06f3368f-01af-4352-8ff4-3b6918684cdf None admin] RBAC: Authorizing `identity:get_project(project_id=5d2260ac58ed49a4a6538d35d503b095)` {{(pid=82025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:44:01.316742 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06f3368f-01af-4352-8ff4-3b6918684cdf None admin] RBAC: Authorization granted {{(pid=82025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:44:01.319011 dv-cinder-828806-6-smb devstack@keystone.service[82025]: [pid: 82025|app: 0|req: 606/1199] 10.222.0.33 () {56 vars in 1186 bytes} [Tue Sep 13 19:44:01 2022] GET /identity/v3/projects/5d2260ac58ed49a4a6538d35d503b095 => generated 361 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 19:44:01.325163 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-606913e7-fd46-4d4b-bfc3-15f49516defd None admin] Authenticating user token {{(pid=82026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:44:01.349653 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG dbcounter [-] [82026] Writing DB stats keystone:SELECT=100 {{(pid=82026) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:44:01.422519 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-606913e7-fd46-4d4b-bfc3-15f49516defd None admin] Validating token access rules against request {{(pid=82026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:44:01.455495 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a06aeed-738f-4298-99c3-718e78713169 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57539b6a6f3b4d589f5f5e1d211cd6a0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:44:01.456087 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a06aeed-738f-4298-99c3-718e78713169 None admin] REQUEST_METHOD: `GET` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:44:01.456372 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a06aeed-738f-4298-99c3-718e78713169 None admin] SCRIPT_NAME: `/identity` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:44:01.456649 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a06aeed-738f-4298-99c3-718e78713169 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:44:01.457365 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a06aeed-738f-4298-99c3-718e78713169 None admin] RBAC: Adding query filter params (role.id=e5af7d5baa93469e9e486ef21c85474e, scope.project.id=5d2260ac58ed49a4a6538d35d503b095, user.id=63b84e1678a44ad7b82063bcc9393444) {{(pid=82026) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 19:44:01.457676 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a06aeed-738f-4298-99c3-718e78713169 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=82026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:44:01.459346 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a06aeed-738f-4298-99c3-718e78713169 None admin] RBAC: Authorization granted {{(pid=82026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:44:01.464958 dv-cinder-828806-6-smb devstack@keystone.service[82026]: [pid: 82026|app: 0|req: 594/1200] 10.222.0.33 () {56 vars in 1374 bytes} [Tue Sep 13 19:44:01 2022] GET /identity/v3/role_assignments?user.id=63b84e1678a44ad7b82063bcc9393444&scope.project.id=5d2260ac58ed49a4a6538d35d503b095&role.id=e5af7d5baa93469e9e486ef21c85474e => generated 608 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 19:44:11.303624 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG dbcounter [-] [82025] Writing DB stats keystone:SELECT=62 {{(pid=82025) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:44:11.462356 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG dbcounter [-] [82026] Writing DB stats keystone:SELECT=56 {{(pid=82026) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:45:14.931359 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beb78ab9-7c53-4fac-8370-14f102b6c1d2 None None] REQUEST_METHOD: `GET` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:45:14.932071 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beb78ab9-7c53-4fac-8370-14f102b6c1d2 None None] SCRIPT_NAME: `/identity` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:45:14.932071 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beb78ab9-7c53-4fac-8370-14f102b6c1d2 None None] PATH_INFO: `/` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:45:14.933297 dv-cinder-828806-6-smb devstack@keystone.service[82025]: [pid: 82025|app: 0|req: 607/1201] 10.222.0.33 () {54 vars in 927 bytes} [Tue Sep 13 19:45:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 19:45:14.938848 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec567e79-b1c4-4c89-b658-aecaa03eecaf None None] REQUEST_METHOD: `POST` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:45:14.939307 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec567e79-b1c4-4c89-b658-aecaa03eecaf None None] SCRIPT_NAME: `/identity` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:45:14.939445 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec567e79-b1c4-4c89-b658-aecaa03eecaf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:45:14.959264 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.auth.core [None req-ec567e79-b1c4-4c89-b658-aecaa03eecaf None None] MFA Rules not processed for user `57539b6a6f3b4d589f5f5e1d211cd6a0`. Rule list: `[]` (Enabled: `True`). {{(pid=82026) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 19:45:14.967815 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.common.fernet_utils [None req-ec567e79-b1c4-4c89-b658-aecaa03eecaf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82026) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 19:45:15.028972 dv-cinder-828806-6-smb devstack@keystone.service[82026]: [pid: 82026|app: 0|req: 595/1202] 10.222.0.33 () {58 vars in 1024 bytes} [Tue Sep 13 19:45:14 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 13 19:45:15.311685 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-beb78ab9-7c53-4fac-8370-14f102b6c1d2 None None] Authenticating user token {{(pid=82025) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:45:15.413160 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-beb78ab9-7c53-4fac-8370-14f102b6c1d2 None None] Validating token access rules against request {{(pid=82025) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:45:15.448043 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27c7decf-89f0-49f4-91e2-d93d8fcd3f57 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57539b6a6f3b4d589f5f5e1d211cd6a0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82025) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:45:15.448670 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27c7decf-89f0-49f4-91e2-d93d8fcd3f57 None admin] REQUEST_METHOD: `GET` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:45:15.448958 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27c7decf-89f0-49f4-91e2-d93d8fcd3f57 None admin] SCRIPT_NAME: `/identity` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:45:15.449231 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27c7decf-89f0-49f4-91e2-d93d8fcd3f57 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:45:15.459565 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27c7decf-89f0-49f4-91e2-d93d8fcd3f57 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=82025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:45:15.460992 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27c7decf-89f0-49f4-91e2-d93d8fcd3f57 None admin] RBAC: Authorization granted {{(pid=82025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:45:15.475596 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application [None req-27c7decf-89f0-49f4-91e2-d93d8fcd3f57 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 13 19:45:15.475596 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 19:45:15.475596 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 19:45:15.475596 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 19:45:15.475596 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 19:45:15.475596 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 19:45:15.475596 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 19:45:15.475596 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 19:45:15.475596 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 19:45:15.475596 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 19:45:15.475596 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 19:45:15.475596 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 19:45:15.475596 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 13 19:45:15.475596 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 13 19:45:15.475596 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 13 19:45:15.475596 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 13 19:45:15.476853 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 19:45:15.476853 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 19:45:15.476853 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 19:45:15.476853 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 19:45:15.476853 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 19:45:15.476853 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 19:45:15.476853 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 19:45:15.476853 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application with Lock( Sep 13 19:45:15.476853 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 19:45:15.476853 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application return self._enter() Sep 13 19:45:15.476853 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 19:45:15.476853 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 19:45:15.476853 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 19:45:15.476853 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application return self.creator() Sep 13 19:45:15.476853 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 19:45:15.476853 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application created_value = creator( Sep 13 19:45:15.476853 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 13 19:45:15.478016 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 13 19:45:15.478016 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 13 19:45:15.478016 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application Sep 13 19:45:15.478016 dv-cinder-828806-6-smb devstack@keystone.service[82025]: [pid: 82025|app: 0|req: 608/1203] 10.222.0.33 () {56 vars in 1108 bytes} [Tue Sep 13 19:45:15 2022] GET /identity/v3/domains/Default => generated 87 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 19:45:15.483387 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec567e79-b1c4-4c89-b658-aecaa03eecaf None None] Authenticating user token {{(pid=82026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:45:15.582803 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec567e79-b1c4-4c89-b658-aecaa03eecaf None None] Validating token access rules against request {{(pid=82026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:45:15.612156 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG dbcounter [-] [82026] Writing DB stats keystone:SELECT=100 {{(pid=82026) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:45:15.617868 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4818990e-66a0-4e0d-b443-37ee5c5853d1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57539b6a6f3b4d589f5f5e1d211cd6a0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:45:15.619370 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4818990e-66a0-4e0d-b443-37ee5c5853d1 None admin] REQUEST_METHOD: `GET` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:45:15.619814 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4818990e-66a0-4e0d-b443-37ee5c5853d1 None admin] SCRIPT_NAME: `/identity` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:45:15.620103 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4818990e-66a0-4e0d-b443-37ee5c5853d1 None admin] PATH_INFO: `/v3/domains` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:45:15.620757 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4818990e-66a0-4e0d-b443-37ee5c5853d1 None admin] RBAC: Adding query filter params (name=Default) {{(pid=82026) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 19:45:15.621066 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4818990e-66a0-4e0d-b443-37ee5c5853d1 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:45:15.622433 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4818990e-66a0-4e0d-b443-37ee5c5853d1 None admin] RBAC: Authorization granted {{(pid=82026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:45:15.633303 dv-cinder-828806-6-smb devstack@keystone.service[82026]: [pid: 82026|app: 0|req: 596/1204] 10.222.0.33 () {56 vars in 1109 bytes} [Tue Sep 13 19:45:15 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 19:45:15.639165 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27c7decf-89f0-49f4-91e2-d93d8fcd3f57 None admin] Authenticating user token {{(pid=82025) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:45:15.692022 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG dbcounter [-] [82025] Writing DB stats keystone:SELECT=100 {{(pid=82025) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:45:15.737552 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27c7decf-89f0-49f4-91e2-d93d8fcd3f57 None admin] Validating token access rules against request {{(pid=82025) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:45:15.770725 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05ee1cff-a727-4733-9665-7704351edc8e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57539b6a6f3b4d589f5f5e1d211cd6a0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82025) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:45:15.774858 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05ee1cff-a727-4733-9665-7704351edc8e None admin] REQUEST_METHOD: `POST` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:45:15.774858 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05ee1cff-a727-4733-9665-7704351edc8e None admin] SCRIPT_NAME: `/identity` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:45:15.774858 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05ee1cff-a727-4733-9665-7704351edc8e None admin] PATH_INFO: `/v3/users` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:45:15.774858 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05ee1cff-a727-4733-9665-7704351edc8e None admin] RBAC: Authorizing `identity:create_user()` {{(pid=82025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:45:15.774858 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05ee1cff-a727-4733-9665-7704351edc8e None admin] RBAC: Authorization granted {{(pid=82025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:45:15.845017 dv-cinder-828806-6-smb devstack@keystone.service[82025]: [pid: 82025|app: 0|req: 609/1205] 10.222.0.33 () {60 vars in 1132 bytes} [Tue Sep 13 19:45:15 2022] POST /identity/v3/users => generated 251 bytes in 206 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 13 19:45:18.022243 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-616d4cab-f86f-4b41-80b7-1b383e6e9a96 None None] REQUEST_METHOD: `GET` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:45:18.022830 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-616d4cab-f86f-4b41-80b7-1b383e6e9a96 None None] SCRIPT_NAME: `/identity` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:45:18.022830 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-616d4cab-f86f-4b41-80b7-1b383e6e9a96 None None] PATH_INFO: `/` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:45:18.024183 dv-cinder-828806-6-smb devstack@keystone.service[82026]: [pid: 82026|app: 0|req: 597/1206] 10.222.0.33 () {54 vars in 927 bytes} [Tue Sep 13 19:45:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 19:45:18.030166 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15728904-6d1c-44ab-a245-d75d68d7fabd None None] REQUEST_METHOD: `POST` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:45:18.030592 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15728904-6d1c-44ab-a245-d75d68d7fabd None None] SCRIPT_NAME: `/identity` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:45:18.030743 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15728904-6d1c-44ab-a245-d75d68d7fabd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:45:18.049449 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.auth.core [None req-15728904-6d1c-44ab-a245-d75d68d7fabd None None] MFA Rules not processed for user `57539b6a6f3b4d589f5f5e1d211cd6a0`. Rule list: `[]` (Enabled: `True`). {{(pid=82025) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 19:45:18.050639 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.fernet_utils [None req-15728904-6d1c-44ab-a245-d75d68d7fabd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82025) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 19:45:18.118136 dv-cinder-828806-6-smb devstack@keystone.service[82025]: [pid: 82025|app: 0|req: 610/1207] 10.222.0.33 () {58 vars in 1024 bytes} [Tue Sep 13 19:45:18 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 13 19:45:18.398452 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-616d4cab-f86f-4b41-80b7-1b383e6e9a96 None None] Authenticating user token {{(pid=82026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:45:18.501274 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-616d4cab-f86f-4b41-80b7-1b383e6e9a96 None None] Validating token access rules against request {{(pid=82026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:45:18.534726 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63bb667b-47af-4488-8531-4a92728c0be8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57539b6a6f3b4d589f5f5e1d211cd6a0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:45:18.535386 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63bb667b-47af-4488-8531-4a92728c0be8 None admin] REQUEST_METHOD: `GET` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:45:18.535672 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63bb667b-47af-4488-8531-4a92728c0be8 None admin] SCRIPT_NAME: `/identity` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:45:18.535947 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63bb667b-47af-4488-8531-4a92728c0be8 None admin] PATH_INFO: `/v3/roles/service` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:45:18.546858 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63bb667b-47af-4488-8531-4a92728c0be8 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=82026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 13 19:45:18.551999 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application [None req-63bb667b-47af-4488-8531-4a92728c0be8 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 13 19:45:18.551999 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 19:45:18.551999 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 19:45:18.551999 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 19:45:18.551999 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 19:45:18.551999 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 19:45:18.551999 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 19:45:18.551999 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 19:45:18.551999 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 19:45:18.551999 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 19:45:18.551999 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 19:45:18.551999 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 19:45:18.551999 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 13 19:45:18.551999 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 13 19:45:18.551999 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 13 19:45:18.551999 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 13 19:45:18.553156 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 13 19:45:18.553156 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 13 19:45:18.553156 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 13 19:45:18.553156 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 13 19:45:18.553156 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 19:45:18.553156 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 19:45:18.553156 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 19:45:18.553156 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 19:45:18.553156 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 19:45:18.553156 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 19:45:18.553156 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 19:45:18.553156 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application with Lock( Sep 13 19:45:18.553156 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 19:45:18.553156 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application return self._enter() Sep 13 19:45:18.553156 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 19:45:18.553156 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 19:45:18.554243 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 19:45:18.554243 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application return self.creator() Sep 13 19:45:18.554243 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 19:45:18.554243 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application created_value = creator( Sep 13 19:45:18.554243 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 13 19:45:18.554243 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 13 19:45:18.554243 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 13 19:45:18.554243 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 13 19:45:18.554243 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 13 19:45:18.554243 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 13 19:45:18.554243 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 13 19:45:18.554243 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application Sep 13 19:45:18.554243 dv-cinder-828806-6-smb devstack@keystone.service[82026]: [pid: 82026|app: 0|req: 598/1208] 10.222.0.33 () {56 vars in 1102 bytes} [Tue Sep 13 19:45:18 2022] GET /identity/v3/roles/service => generated 85 bytes in 155 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 19:45:18.560028 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15728904-6d1c-44ab-a245-d75d68d7fabd None None] Authenticating user token {{(pid=82025) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:45:18.598345 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG dbcounter [-] [82025] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=82025) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:45:18.660689 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15728904-6d1c-44ab-a245-d75d68d7fabd None None] Validating token access rules against request {{(pid=82025) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:45:18.695419 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d74b9e0c-759d-4031-bc6d-90131d5a09d4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57539b6a6f3b4d589f5f5e1d211cd6a0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82025) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:45:18.696153 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d74b9e0c-759d-4031-bc6d-90131d5a09d4 None admin] REQUEST_METHOD: `GET` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:45:18.696398 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d74b9e0c-759d-4031-bc6d-90131d5a09d4 None admin] SCRIPT_NAME: `/identity` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:45:18.696670 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d74b9e0c-759d-4031-bc6d-90131d5a09d4 None admin] PATH_INFO: `/v3/roles` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:45:18.697497 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d74b9e0c-759d-4031-bc6d-90131d5a09d4 None admin] RBAC: Adding query filter params (name=service) {{(pid=82025) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 19:45:18.697852 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d74b9e0c-759d-4031-bc6d-90131d5a09d4 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:45:18.699228 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d74b9e0c-759d-4031-bc6d-90131d5a09d4 None admin] RBAC: Authorization granted {{(pid=82025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:45:18.706839 dv-cinder-828806-6-smb devstack@keystone.service[82025]: [pid: 82025|app: 0|req: 611/1209] 10.222.0.33 () {56 vars in 1103 bytes} [Tue Sep 13 19:45:18 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 19:45:18.713119 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63bb667b-47af-4488-8531-4a92728c0be8 None admin] Authenticating user token {{(pid=82026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:45:18.765494 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG dbcounter [-] [82026] Writing DB stats keystone:SELECT=100 {{(pid=82026) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:45:18.817009 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63bb667b-47af-4488-8531-4a92728c0be8 None admin] Validating token access rules against request {{(pid=82026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:45:18.851483 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b326992-8fe2-41d5-b3fd-a7ade05e376b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57539b6a6f3b4d589f5f5e1d211cd6a0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:45:18.852102 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b326992-8fe2-41d5-b3fd-a7ade05e376b None admin] REQUEST_METHOD: `GET` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:45:18.852380 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b326992-8fe2-41d5-b3fd-a7ade05e376b None admin] SCRIPT_NAME: `/identity` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:45:18.852652 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b326992-8fe2-41d5-b3fd-a7ade05e376b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:45:18.863537 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b326992-8fe2-41d5-b3fd-a7ade05e376b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=82026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:45:18.868415 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b326992-8fe2-41d5-b3fd-a7ade05e376b None admin] RBAC: Authorization granted {{(pid=82026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:45:18.881428 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application [None req-6b326992-8fe2-41d5-b3fd-a7ade05e376b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 13 19:45:18.881428 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 19:45:18.881428 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 19:45:18.881428 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 19:45:18.881428 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 19:45:18.881428 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 19:45:18.881428 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 19:45:18.881428 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 19:45:18.881428 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 19:45:18.881428 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 19:45:18.881428 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 19:45:18.881428 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 19:45:18.881428 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 13 19:45:18.881428 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 13 19:45:18.881428 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 13 19:45:18.881428 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 13 19:45:18.882445 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 19:45:18.882445 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 19:45:18.882445 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 19:45:18.882445 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 19:45:18.882445 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 19:45:18.882445 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 19:45:18.882445 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 19:45:18.882445 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application with Lock( Sep 13 19:45:18.882445 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 19:45:18.882445 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application return self._enter() Sep 13 19:45:18.882445 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 19:45:18.882445 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 19:45:18.882445 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 19:45:18.882445 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application return self.creator() Sep 13 19:45:18.882445 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 19:45:18.882445 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application created_value = creator( Sep 13 19:45:18.882445 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 13 19:45:18.883404 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 13 19:45:18.883404 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 13 19:45:18.883404 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application Sep 13 19:45:18.883404 dv-cinder-828806-6-smb devstack@keystone.service[82026]: [pid: 82026|app: 0|req: 599/1210] 10.222.0.33 () {56 vars in 1108 bytes} [Tue Sep 13 19:45:18 2022] GET /identity/v3/domains/Default => generated 87 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 19:45:18.888849 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d74b9e0c-759d-4031-bc6d-90131d5a09d4 None admin] Authenticating user token {{(pid=82025) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:45:18.993359 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG dbcounter [-] [82025] Writing DB stats keystone:SELECT=100 {{(pid=82025) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:45:18.996635 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d74b9e0c-759d-4031-bc6d-90131d5a09d4 None admin] Validating token access rules against request {{(pid=82025) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:45:19.030517 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7de93bfd-fe58-4abe-8ed7-4eef6f10cbe0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57539b6a6f3b4d589f5f5e1d211cd6a0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82025) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:45:19.031297 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7de93bfd-fe58-4abe-8ed7-4eef6f10cbe0 None admin] REQUEST_METHOD: `GET` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:45:19.031515 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7de93bfd-fe58-4abe-8ed7-4eef6f10cbe0 None admin] SCRIPT_NAME: `/identity` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:45:19.031793 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7de93bfd-fe58-4abe-8ed7-4eef6f10cbe0 None admin] PATH_INFO: `/v3/domains` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:45:19.032443 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7de93bfd-fe58-4abe-8ed7-4eef6f10cbe0 None admin] RBAC: Adding query filter params (name=Default) {{(pid=82025) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 19:45:19.032751 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7de93bfd-fe58-4abe-8ed7-4eef6f10cbe0 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:45:19.034119 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7de93bfd-fe58-4abe-8ed7-4eef6f10cbe0 None admin] RBAC: Authorization granted {{(pid=82025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:45:19.052391 dv-cinder-828806-6-smb devstack@keystone.service[82025]: [pid: 82025|app: 0|req: 612/1211] 10.222.0.33 () {56 vars in 1109 bytes} [Tue Sep 13 19:45:18 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 13 19:45:19.053628 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b326992-8fe2-41d5-b3fd-a7ade05e376b None admin] Authenticating user token {{(pid=82026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:45:19.157668 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b326992-8fe2-41d5-b3fd-a7ade05e376b None admin] Validating token access rules against request {{(pid=82026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:45:19.159203 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG dbcounter [-] [82026] Writing DB stats keystone:SELECT=100 {{(pid=82026) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:45:19.191765 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c033bbd-cedd-4502-a06c-91e1aafb07d5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57539b6a6f3b4d589f5f5e1d211cd6a0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:45:19.192388 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c033bbd-cedd-4502-a06c-91e1aafb07d5 None admin] REQUEST_METHOD: `GET` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:45:19.192674 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c033bbd-cedd-4502-a06c-91e1aafb07d5 None admin] SCRIPT_NAME: `/identity` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:45:19.192956 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c033bbd-cedd-4502-a06c-91e1aafb07d5 None admin] PATH_INFO: `/v3/users/placement` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:45:19.200115 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c033bbd-cedd-4502-a06c-91e1aafb07d5 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=82026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:45:19.201563 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c033bbd-cedd-4502-a06c-91e1aafb07d5 None admin] RBAC: Authorization granted {{(pid=82026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:45:19.213538 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application [None req-9c033bbd-cedd-4502-a06c-91e1aafb07d5 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Sep 13 19:45:19.213538 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 19:45:19.213538 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 19:45:19.213538 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 19:45:19.213538 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 19:45:19.213538 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 19:45:19.213538 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 19:45:19.213538 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 19:45:19.213538 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 19:45:19.213538 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 19:45:19.213538 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 19:45:19.213538 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 19:45:19.213538 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 13 19:45:19.213538 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 13 19:45:19.213538 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 13 19:45:19.213538 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 13 19:45:19.214682 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 19:45:19.214682 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 19:45:19.214682 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 13 19:45:19.214682 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 13 19:45:19.214682 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 13 19:45:19.214682 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 13 19:45:19.214682 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 19:45:19.214682 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 19:45:19.214682 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 19:45:19.214682 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 19:45:19.214682 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 19:45:19.214682 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application with Lock( Sep 13 19:45:19.214682 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 19:45:19.214682 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application return self._enter() Sep 13 19:45:19.214682 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 19:45:19.214682 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 19:45:19.214682 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 19:45:19.214682 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application return self.creator() Sep 13 19:45:19.216094 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 19:45:19.216094 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application created_value = creator( Sep 13 19:45:19.216094 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 13 19:45:19.216094 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 13 19:45:19.216094 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 13 19:45:19.216094 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 13 19:45:19.216094 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 13 19:45:19.216094 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 13 19:45:19.216094 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Sep 13 19:45:19.216094 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application Sep 13 19:45:19.216094 dv-cinder-828806-6-smb devstack@keystone.service[82026]: [pid: 82026|app: 0|req: 600/1212] 10.222.0.33 () {56 vars in 1108 bytes} [Tue Sep 13 19:45:19 2022] GET /identity/v3/users/placement => generated 87 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 19:45:19.220575 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7de93bfd-fe58-4abe-8ed7-4eef6f10cbe0 None admin] Authenticating user token {{(pid=82025) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:45:19.321145 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7de93bfd-fe58-4abe-8ed7-4eef6f10cbe0 None admin] Validating token access rules against request {{(pid=82025) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:45:19.356203 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7798a8d4-3666-43b6-a063-327a5ea3aa45 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57539b6a6f3b4d589f5f5e1d211cd6a0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82025) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:45:19.356813 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7798a8d4-3666-43b6-a063-327a5ea3aa45 None admin] REQUEST_METHOD: `GET` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:45:19.357099 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7798a8d4-3666-43b6-a063-327a5ea3aa45 None admin] SCRIPT_NAME: `/identity` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:45:19.357379 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7798a8d4-3666-43b6-a063-327a5ea3aa45 None admin] PATH_INFO: `/v3/users` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:45:19.358102 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7798a8d4-3666-43b6-a063-327a5ea3aa45 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=82025) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 19:45:19.358412 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7798a8d4-3666-43b6-a063-327a5ea3aa45 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=82025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:45:19.359901 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7798a8d4-3666-43b6-a063-327a5ea3aa45 None admin] RBAC: Authorization granted {{(pid=82025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:45:19.376994 dv-cinder-828806-6-smb devstack@keystone.service[82025]: [pid: 82025|app: 0|req: 613/1213] 10.222.0.33 () {56 vars in 1143 bytes} [Tue Sep 13 19:45:19 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 19:45:19.382861 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c033bbd-cedd-4502-a06c-91e1aafb07d5 None admin] Authenticating user token {{(pid=82026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:45:19.484425 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c033bbd-cedd-4502-a06c-91e1aafb07d5 None admin] Validating token access rules against request {{(pid=82026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:45:19.517230 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf3eb423-a5f5-472e-b93b-48e8f7245efd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57539b6a6f3b4d589f5f5e1d211cd6a0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:45:19.517831 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf3eb423-a5f5-472e-b93b-48e8f7245efd None admin] REQUEST_METHOD: `GET` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:45:19.518113 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf3eb423-a5f5-472e-b93b-48e8f7245efd None admin] SCRIPT_NAME: `/identity` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:45:19.518387 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf3eb423-a5f5-472e-b93b-48e8f7245efd None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:45:19.547093 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG dbcounter [-] [82026] Writing DB stats keystone:SELECT=100 {{(pid=82026) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:45:19.584065 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf3eb423-a5f5-472e-b93b-48e8f7245efd None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=82026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:45:19.585522 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf3eb423-a5f5-472e-b93b-48e8f7245efd None admin] RBAC: Authorization granted {{(pid=82026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:45:19.682231 dv-cinder-828806-6-smb devstack@keystone.service[82026]: [pid: 82026|app: 0|req: 601/1214] 10.222.0.33 () {58 vars in 1282 bytes} [Tue Sep 13 19:45:19 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 300 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Sep 13 19:45:19.688453 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7798a8d4-3666-43b6-a063-327a5ea3aa45 None admin] Authenticating user token {{(pid=82025) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:45:19.707414 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG dbcounter [-] [82025] Writing DB stats keystone:SELECT=100 {{(pid=82025) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:45:19.785537 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7798a8d4-3666-43b6-a063-327a5ea3aa45 None admin] Validating token access rules against request {{(pid=82025) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:45:19.820266 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34735507-7cc7-4efa-933e-849d85ae0cec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57539b6a6f3b4d589f5f5e1d211cd6a0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82025) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:45:19.820885 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34735507-7cc7-4efa-933e-849d85ae0cec None admin] REQUEST_METHOD: `GET` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:45:19.821168 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34735507-7cc7-4efa-933e-849d85ae0cec None admin] SCRIPT_NAME: `/identity` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:45:19.821445 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34735507-7cc7-4efa-933e-849d85ae0cec None admin] PATH_INFO: `/v3/domains/Default` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:45:19.832441 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34735507-7cc7-4efa-933e-849d85ae0cec None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=82025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:45:19.833903 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34735507-7cc7-4efa-933e-849d85ae0cec None admin] RBAC: Authorization granted {{(pid=82025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:45:19.848497 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application [None req-34735507-7cc7-4efa-933e-849d85ae0cec None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 13 19:45:19.848497 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 19:45:19.848497 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 19:45:19.848497 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 19:45:19.848497 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 19:45:19.848497 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 19:45:19.848497 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 19:45:19.848497 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 19:45:19.848497 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 19:45:19.848497 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 19:45:19.848497 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 19:45:19.848497 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 19:45:19.848497 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 13 19:45:19.848497 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 13 19:45:19.848497 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 13 19:45:19.848497 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 13 19:45:19.849621 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 19:45:19.849621 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 19:45:19.849621 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 19:45:19.849621 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 19:45:19.849621 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 19:45:19.849621 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 19:45:19.849621 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 19:45:19.849621 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application with Lock( Sep 13 19:45:19.849621 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 19:45:19.849621 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application return self._enter() Sep 13 19:45:19.849621 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 19:45:19.849621 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 19:45:19.849621 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 19:45:19.849621 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application return self.creator() Sep 13 19:45:19.849621 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 19:45:19.849621 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application created_value = creator( Sep 13 19:45:19.849621 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 13 19:45:19.850569 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 13 19:45:19.850569 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 13 19:45:19.850569 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application Sep 13 19:45:19.850569 dv-cinder-828806-6-smb devstack@keystone.service[82025]: [pid: 82025|app: 0|req: 614/1215] 10.222.0.33 () {56 vars in 1108 bytes} [Tue Sep 13 19:45:19 2022] GET /identity/v3/domains/Default => generated 87 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 19:45:19.856253 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf3eb423-a5f5-472e-b93b-48e8f7245efd None admin] Authenticating user token {{(pid=82026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:45:19.918174 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG dbcounter [-] [82026] Writing DB stats keystone:SELECT=100 {{(pid=82026) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:45:19.957440 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf3eb423-a5f5-472e-b93b-48e8f7245efd None admin] Validating token access rules against request {{(pid=82026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:45:19.993315 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fe573f8-99f9-4a43-ae5c-ae85131d197b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57539b6a6f3b4d589f5f5e1d211cd6a0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:45:19.994421 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fe573f8-99f9-4a43-ae5c-ae85131d197b None admin] REQUEST_METHOD: `GET` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:45:19.994714 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fe573f8-99f9-4a43-ae5c-ae85131d197b None admin] SCRIPT_NAME: `/identity` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:45:19.994998 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fe573f8-99f9-4a43-ae5c-ae85131d197b None admin] PATH_INFO: `/v3/domains` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:45:19.995674 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fe573f8-99f9-4a43-ae5c-ae85131d197b None admin] RBAC: Adding query filter params (name=Default) {{(pid=82026) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 19:45:19.996004 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fe573f8-99f9-4a43-ae5c-ae85131d197b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:45:19.997440 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fe573f8-99f9-4a43-ae5c-ae85131d197b None admin] RBAC: Authorization granted {{(pid=82026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:45:20.010581 dv-cinder-828806-6-smb devstack@keystone.service[82026]: [pid: 82026|app: 0|req: 602/1216] 10.222.0.33 () {56 vars in 1109 bytes} [Tue Sep 13 19:45:19 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 19:45:20.016365 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34735507-7cc7-4efa-933e-849d85ae0cec None admin] Authenticating user token {{(pid=82025) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:45:20.088658 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG dbcounter [-] [82025] Writing DB stats keystone:SELECT=100 {{(pid=82025) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:45:20.118676 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34735507-7cc7-4efa-933e-849d85ae0cec None admin] Validating token access rules against request {{(pid=82025) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:45:20.150946 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c19a77e-44aa-4222-b82a-383e0b4e31f3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57539b6a6f3b4d589f5f5e1d211cd6a0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82025) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:45:20.151510 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c19a77e-44aa-4222-b82a-383e0b4e31f3 None admin] REQUEST_METHOD: `GET` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:45:20.151793 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c19a77e-44aa-4222-b82a-383e0b4e31f3 None admin] SCRIPT_NAME: `/identity` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:45:20.152069 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c19a77e-44aa-4222-b82a-383e0b4e31f3 None admin] PATH_INFO: `/v3/projects/service` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:45:20.158633 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c19a77e-44aa-4222-b82a-383e0b4e31f3 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=82025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:45:20.160128 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c19a77e-44aa-4222-b82a-383e0b4e31f3 None admin] RBAC: Authorization granted {{(pid=82025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:45:20.172105 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application [None req-8c19a77e-44aa-4222-b82a-383e0b4e31f3 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 13 19:45:20.172105 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 19:45:20.172105 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 19:45:20.172105 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 19:45:20.172105 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 19:45:20.172105 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 19:45:20.172105 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 19:45:20.172105 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 19:45:20.172105 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 19:45:20.172105 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 19:45:20.172105 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 19:45:20.172105 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 19:45:20.172105 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 13 19:45:20.172105 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 13 19:45:20.172105 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 13 19:45:20.173412 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 13 19:45:20.173412 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 19:45:20.173412 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 19:45:20.173412 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 19:45:20.173412 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 19:45:20.173412 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 19:45:20.173412 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 19:45:20.173412 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 19:45:20.173412 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application with Lock( Sep 13 19:45:20.173412 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 19:45:20.173412 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application return self._enter() Sep 13 19:45:20.173412 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 19:45:20.173412 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 19:45:20.173412 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 19:45:20.173412 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application return self.creator() Sep 13 19:45:20.173412 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 19:45:20.173412 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application created_value = creator( Sep 13 19:45:20.174365 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 13 19:45:20.174365 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 13 19:45:20.174365 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 13 19:45:20.174365 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 13 19:45:20.174365 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 13 19:45:20.174365 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 13 19:45:20.174365 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 13 19:45:20.174365 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application Sep 13 19:45:20.174365 dv-cinder-828806-6-smb devstack@keystone.service[82025]: [pid: 82025|app: 0|req: 615/1217] 10.222.0.33 () {56 vars in 1111 bytes} [Tue Sep 13 19:45:20 2022] GET /identity/v3/projects/service => generated 88 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 19:45:20.179522 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fe573f8-99f9-4a43-ae5c-ae85131d197b None admin] Authenticating user token {{(pid=82026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:45:20.277975 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fe573f8-99f9-4a43-ae5c-ae85131d197b None admin] Validating token access rules against request {{(pid=82026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:45:20.301155 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG dbcounter [-] [82026] Writing DB stats keystone:SELECT=100 {{(pid=82026) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:45:20.313300 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f2b77eb-dcf7-4336-979b-514a8294e468 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57539b6a6f3b4d589f5f5e1d211cd6a0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:45:20.313904 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f2b77eb-dcf7-4336-979b-514a8294e468 None admin] REQUEST_METHOD: `GET` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:45:20.314186 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f2b77eb-dcf7-4336-979b-514a8294e468 None admin] SCRIPT_NAME: `/identity` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:45:20.314462 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f2b77eb-dcf7-4336-979b-514a8294e468 None admin] PATH_INFO: `/v3/projects` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:45:20.315189 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f2b77eb-dcf7-4336-979b-514a8294e468 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=82026) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 19:45:20.315500 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f2b77eb-dcf7-4336-979b-514a8294e468 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=82026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:45:20.316993 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f2b77eb-dcf7-4336-979b-514a8294e468 None admin] RBAC: Authorization granted {{(pid=82026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:45:20.328486 dv-cinder-828806-6-smb devstack@keystone.service[82026]: [pid: 82026|app: 0|req: 603/1218] 10.222.0.33 () {56 vars in 1148 bytes} [Tue Sep 13 19:45:20 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 19:45:20.334520 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c19a77e-44aa-4222-b82a-383e0b4e31f3 None admin] Authenticating user token {{(pid=82025) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:45:20.439869 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c19a77e-44aa-4222-b82a-383e0b4e31f3 None admin] Validating token access rules against request {{(pid=82025) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:45:20.468551 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG dbcounter [-] [82025] Writing DB stats keystone:SELECT=100 {{(pid=82025) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:45:20.474150 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fdd9247-1881-48b1-8b48-c67870c10347 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57539b6a6f3b4d589f5f5e1d211cd6a0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82025) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:45:20.474749 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fdd9247-1881-48b1-8b48-c67870c10347 None admin] REQUEST_METHOD: `GET` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:45:20.475048 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fdd9247-1881-48b1-8b48-c67870c10347 None admin] SCRIPT_NAME: `/identity` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:45:20.475333 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fdd9247-1881-48b1-8b48-c67870c10347 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:45:20.476045 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fdd9247-1881-48b1-8b48-c67870c10347 None admin] RBAC: Adding query filter params (role.id=47ee826cd5f148c19f293f9470f906da, scope.project.id=c8c6fba0f15b4d6a84ff601919b7b8e4, user.id=060ea3dea2134429967c164bd158b272) {{(pid=82025) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 19:45:20.476392 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fdd9247-1881-48b1-8b48-c67870c10347 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=82025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:45:20.477797 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fdd9247-1881-48b1-8b48-c67870c10347 None admin] RBAC: Authorization granted {{(pid=82025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:45:20.483658 dv-cinder-828806-6-smb devstack@keystone.service[82025]: [pid: 82025|app: 0|req: 616/1219] 10.222.0.33 () {56 vars in 1374 bytes} [Tue Sep 13 19:45:20 2022] GET /identity/v3/role_assignments?user.id=060ea3dea2134429967c164bd158b272&scope.project.id=c8c6fba0f15b4d6a84ff601919b7b8e4&role.id=47ee826cd5f148c19f293f9470f906da => generated 259 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 19:45:22.612334 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6becc96-a58b-46fb-b95b-de144f1e81d6 None None] REQUEST_METHOD: `GET` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:45:22.612862 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6becc96-a58b-46fb-b95b-de144f1e81d6 None None] SCRIPT_NAME: `/identity` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:45:22.612975 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6becc96-a58b-46fb-b95b-de144f1e81d6 None None] PATH_INFO: `/` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:45:22.614241 dv-cinder-828806-6-smb devstack@keystone.service[82026]: [pid: 82026|app: 0|req: 604/1220] 10.222.0.33 () {54 vars in 927 bytes} [Tue Sep 13 19:45:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 19:45:22.620385 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed3dbd8f-6bc4-43c0-a28a-26dba7aa2f3c None None] REQUEST_METHOD: `POST` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:45:22.620823 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed3dbd8f-6bc4-43c0-a28a-26dba7aa2f3c None None] SCRIPT_NAME: `/identity` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:45:22.621027 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed3dbd8f-6bc4-43c0-a28a-26dba7aa2f3c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:45:22.639963 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.auth.core [None req-ed3dbd8f-6bc4-43c0-a28a-26dba7aa2f3c None None] MFA Rules not processed for user `57539b6a6f3b4d589f5f5e1d211cd6a0`. Rule list: `[]` (Enabled: `True`). {{(pid=82025) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 19:45:22.641148 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.fernet_utils [None req-ed3dbd8f-6bc4-43c0-a28a-26dba7aa2f3c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82025) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 19:45:22.711936 dv-cinder-828806-6-smb devstack@keystone.service[82025]: [pid: 82025|app: 0|req: 617/1221] 10.222.0.33 () {58 vars in 1024 bytes} [Tue Sep 13 19:45:22 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 13 19:45:22.990845 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6becc96-a58b-46fb-b95b-de144f1e81d6 None None] Authenticating user token {{(pid=82026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:45:23.092412 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6becc96-a58b-46fb-b95b-de144f1e81d6 None None] Validating token access rules against request {{(pid=82026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:45:23.126189 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-151d1e69-a2b4-45d9-a9e5-03bcbdcf7526 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57539b6a6f3b4d589f5f5e1d211cd6a0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:45:23.126838 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-151d1e69-a2b4-45d9-a9e5-03bcbdcf7526 None admin] REQUEST_METHOD: `GET` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:45:23.127152 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-151d1e69-a2b4-45d9-a9e5-03bcbdcf7526 None admin] SCRIPT_NAME: `/identity` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:45:23.127431 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-151d1e69-a2b4-45d9-a9e5-03bcbdcf7526 None admin] PATH_INFO: `/v3/roles/service` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:45:23.137424 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-151d1e69-a2b4-45d9-a9e5-03bcbdcf7526 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=82026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 13 19:45:23.142309 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application [None req-151d1e69-a2b4-45d9-a9e5-03bcbdcf7526 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 13 19:45:23.142309 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 19:45:23.142309 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 19:45:23.142309 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 19:45:23.142309 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 19:45:23.142309 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 19:45:23.142309 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 19:45:23.142309 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 19:45:23.142309 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 19:45:23.142309 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 19:45:23.142309 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 19:45:23.142309 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 19:45:23.142309 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 13 19:45:23.142309 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 13 19:45:23.142309 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 13 19:45:23.142309 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 13 19:45:23.146191 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 13 19:45:23.146191 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 13 19:45:23.146191 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 13 19:45:23.146191 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 13 19:45:23.146191 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 19:45:23.146191 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 19:45:23.146191 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 19:45:23.146191 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 19:45:23.146191 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 19:45:23.146191 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 19:45:23.146191 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 19:45:23.146191 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application with Lock( Sep 13 19:45:23.146191 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 19:45:23.146191 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application return self._enter() Sep 13 19:45:23.146191 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 19:45:23.146191 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 19:45:23.147315 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 19:45:23.147315 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application return self.creator() Sep 13 19:45:23.147315 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 19:45:23.147315 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application created_value = creator( Sep 13 19:45:23.147315 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 13 19:45:23.147315 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 13 19:45:23.147315 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 13 19:45:23.147315 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 13 19:45:23.147315 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 13 19:45:23.147315 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 13 19:45:23.147315 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 13 19:45:23.147315 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application Sep 13 19:45:23.147315 dv-cinder-828806-6-smb devstack@keystone.service[82026]: [pid: 82026|app: 0|req: 605/1222] 10.222.0.33 () {56 vars in 1102 bytes} [Tue Sep 13 19:45:22 2022] GET /identity/v3/roles/service => generated 85 bytes in 153 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 19:45:23.149449 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed3dbd8f-6bc4-43c0-a28a-26dba7aa2f3c None None] Authenticating user token {{(pid=82025) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:45:23.252405 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed3dbd8f-6bc4-43c0-a28a-26dba7aa2f3c None None] Validating token access rules against request {{(pid=82025) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:45:23.275463 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG dbcounter [-] [82025] Writing DB stats keystone:SELECT=100 {{(pid=82025) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:45:23.286243 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee1ce589-2064-43a4-9962-0e3152f0730d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57539b6a6f3b4d589f5f5e1d211cd6a0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82025) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:45:23.286871 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee1ce589-2064-43a4-9962-0e3152f0730d None admin] REQUEST_METHOD: `GET` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:45:23.287200 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee1ce589-2064-43a4-9962-0e3152f0730d None admin] SCRIPT_NAME: `/identity` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:45:23.287484 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee1ce589-2064-43a4-9962-0e3152f0730d None admin] PATH_INFO: `/v3/roles` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:45:23.288168 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee1ce589-2064-43a4-9962-0e3152f0730d None admin] RBAC: Adding query filter params (name=service) {{(pid=82025) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 19:45:23.288477 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee1ce589-2064-43a4-9962-0e3152f0730d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:45:23.289893 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee1ce589-2064-43a4-9962-0e3152f0730d None admin] RBAC: Authorization granted {{(pid=82025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:45:23.298968 dv-cinder-828806-6-smb devstack@keystone.service[82025]: [pid: 82025|app: 0|req: 618/1223] 10.222.0.33 () {56 vars in 1103 bytes} [Tue Sep 13 19:45:23 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 19:45:23.304678 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-151d1e69-a2b4-45d9-a9e5-03bcbdcf7526 None admin] Authenticating user token {{(pid=82026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:45:23.348224 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG dbcounter [-] [82026] Writing DB stats keystone:SELECT=100 {{(pid=82026) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:45:23.403953 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-151d1e69-a2b4-45d9-a9e5-03bcbdcf7526 None admin] Validating token access rules against request {{(pid=82026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:45:23.438031 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3452195-ae50-4298-8fa4-ca8d64ff9848 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57539b6a6f3b4d589f5f5e1d211cd6a0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:45:23.441576 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3452195-ae50-4298-8fa4-ca8d64ff9848 None admin] REQUEST_METHOD: `GET` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:45:23.441576 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3452195-ae50-4298-8fa4-ca8d64ff9848 None admin] SCRIPT_NAME: `/identity` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:45:23.441576 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3452195-ae50-4298-8fa4-ca8d64ff9848 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:45:23.449003 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3452195-ae50-4298-8fa4-ca8d64ff9848 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=82026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:45:23.450445 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3452195-ae50-4298-8fa4-ca8d64ff9848 None admin] RBAC: Authorization granted {{(pid=82026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:45:23.465210 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application [None req-c3452195-ae50-4298-8fa4-ca8d64ff9848 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 13 19:45:23.465210 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 19:45:23.465210 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 19:45:23.465210 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 19:45:23.465210 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 19:45:23.465210 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 19:45:23.465210 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 19:45:23.465210 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 19:45:23.465210 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 19:45:23.465210 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 19:45:23.465210 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 19:45:23.465210 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 19:45:23.465210 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 13 19:45:23.465210 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 13 19:45:23.465210 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 13 19:45:23.465210 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 13 19:45:23.472167 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 19:45:23.472167 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 19:45:23.472167 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 19:45:23.472167 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 19:45:23.472167 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 19:45:23.472167 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 19:45:23.472167 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 19:45:23.472167 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application with Lock( Sep 13 19:45:23.472167 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 19:45:23.472167 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application return self._enter() Sep 13 19:45:23.472167 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 19:45:23.472167 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 19:45:23.472167 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 19:45:23.472167 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application return self.creator() Sep 13 19:45:23.472167 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 19:45:23.472167 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application created_value = creator( Sep 13 19:45:23.472167 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 13 19:45:23.473069 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 13 19:45:23.473069 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 13 19:45:23.473069 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application Sep 13 19:45:23.473069 dv-cinder-828806-6-smb devstack@keystone.service[82026]: [pid: 82026|app: 0|req: 606/1224] 10.222.0.33 () {56 vars in 1108 bytes} [Tue Sep 13 19:45:23 2022] GET /identity/v3/domains/Default => generated 87 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 19:45:23.473293 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee1ce589-2064-43a4-9962-0e3152f0730d None admin] Authenticating user token {{(pid=82025) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:45:23.571671 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee1ce589-2064-43a4-9962-0e3152f0730d None admin] Validating token access rules against request {{(pid=82025) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:45:23.606408 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40a6fcc8-63a0-4d71-a275-bcd41469d797 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57539b6a6f3b4d589f5f5e1d211cd6a0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82025) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:45:23.607007 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40a6fcc8-63a0-4d71-a275-bcd41469d797 None admin] REQUEST_METHOD: `GET` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:45:23.607322 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40a6fcc8-63a0-4d71-a275-bcd41469d797 None admin] SCRIPT_NAME: `/identity` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:45:23.607598 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40a6fcc8-63a0-4d71-a275-bcd41469d797 None admin] PATH_INFO: `/v3/domains` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:45:23.608234 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40a6fcc8-63a0-4d71-a275-bcd41469d797 None admin] RBAC: Adding query filter params (name=Default) {{(pid=82025) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 19:45:23.608539 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40a6fcc8-63a0-4d71-a275-bcd41469d797 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:45:23.609991 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40a6fcc8-63a0-4d71-a275-bcd41469d797 None admin] RBAC: Authorization granted {{(pid=82025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:45:23.621777 dv-cinder-828806-6-smb devstack@keystone.service[82025]: [pid: 82025|app: 0|req: 619/1225] 10.222.0.33 () {56 vars in 1109 bytes} [Tue Sep 13 19:45:23 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 19:45:23.627522 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3452195-ae50-4298-8fa4-ca8d64ff9848 None admin] Authenticating user token {{(pid=82026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:45:23.721132 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG dbcounter [-] [82026] Writing DB stats keystone:SELECT=100 {{(pid=82026) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:45:23.727789 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3452195-ae50-4298-8fa4-ca8d64ff9848 None admin] Validating token access rules against request {{(pid=82026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:45:23.764020 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7f053fb-9004-44dc-b2e4-15f62cbfa1ea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57539b6a6f3b4d589f5f5e1d211cd6a0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:45:23.764647 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7f053fb-9004-44dc-b2e4-15f62cbfa1ea None admin] REQUEST_METHOD: `GET` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:45:23.764932 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7f053fb-9004-44dc-b2e4-15f62cbfa1ea None admin] SCRIPT_NAME: `/identity` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:45:23.765214 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7f053fb-9004-44dc-b2e4-15f62cbfa1ea None admin] PATH_INFO: `/v3/users/placement` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:45:23.772053 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7f053fb-9004-44dc-b2e4-15f62cbfa1ea None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=82026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:45:23.773484 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7f053fb-9004-44dc-b2e4-15f62cbfa1ea None admin] RBAC: Authorization granted {{(pid=82026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:45:23.785750 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application [None req-f7f053fb-9004-44dc-b2e4-15f62cbfa1ea None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Sep 13 19:45:23.785750 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 19:45:23.785750 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 19:45:23.785750 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 19:45:23.785750 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 19:45:23.785750 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 19:45:23.785750 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 19:45:23.785750 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 19:45:23.785750 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 19:45:23.785750 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 19:45:23.785750 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 19:45:23.785750 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 19:45:23.785750 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 13 19:45:23.785750 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 13 19:45:23.785750 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 13 19:45:23.785750 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 13 19:45:23.786859 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 19:45:23.786859 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 19:45:23.786859 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 13 19:45:23.786859 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 13 19:45:23.786859 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 13 19:45:23.786859 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 13 19:45:23.786859 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 19:45:23.786859 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 19:45:23.786859 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 19:45:23.786859 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 19:45:23.786859 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 19:45:23.786859 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application with Lock( Sep 13 19:45:23.786859 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 19:45:23.786859 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application return self._enter() Sep 13 19:45:23.786859 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 19:45:23.786859 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 19:45:23.786859 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 19:45:23.786859 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application return self.creator() Sep 13 19:45:23.788101 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 19:45:23.788101 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application created_value = creator( Sep 13 19:45:23.788101 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 13 19:45:23.788101 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 13 19:45:23.788101 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 13 19:45:23.788101 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 13 19:45:23.788101 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 13 19:45:23.788101 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 13 19:45:23.788101 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Sep 13 19:45:23.788101 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application Sep 13 19:45:23.788101 dv-cinder-828806-6-smb devstack@keystone.service[82026]: [pid: 82026|app: 0|req: 607/1226] 10.222.0.33 () {56 vars in 1108 bytes} [Tue Sep 13 19:45:23 2022] GET /identity/v3/users/placement => generated 87 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 19:45:23.792891 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40a6fcc8-63a0-4d71-a275-bcd41469d797 None admin] Authenticating user token {{(pid=82025) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:45:23.840887 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG dbcounter [-] [82025] Writing DB stats keystone:SELECT=100 {{(pid=82025) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:45:23.892601 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40a6fcc8-63a0-4d71-a275-bcd41469d797 None admin] Validating token access rules against request {{(pid=82025) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:45:23.927652 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c02e626-e073-4b2c-b311-894c06f7d88d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57539b6a6f3b4d589f5f5e1d211cd6a0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82025) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:45:23.928259 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c02e626-e073-4b2c-b311-894c06f7d88d None admin] REQUEST_METHOD: `GET` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:45:23.928563 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c02e626-e073-4b2c-b311-894c06f7d88d None admin] SCRIPT_NAME: `/identity` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:45:23.928834 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c02e626-e073-4b2c-b311-894c06f7d88d None admin] PATH_INFO: `/v3/users` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:45:23.929558 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c02e626-e073-4b2c-b311-894c06f7d88d None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=82025) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 19:45:23.929863 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c02e626-e073-4b2c-b311-894c06f7d88d None admin] RBAC: Authorizing `identity:list_users()` {{(pid=82025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:45:23.931302 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c02e626-e073-4b2c-b311-894c06f7d88d None admin] RBAC: Authorization granted {{(pid=82025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:45:23.948510 dv-cinder-828806-6-smb devstack@keystone.service[82025]: [pid: 82025|app: 0|req: 620/1227] 10.222.0.33 () {56 vars in 1143 bytes} [Tue Sep 13 19:45:23 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 19:45:23.954532 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7f053fb-9004-44dc-b2e4-15f62cbfa1ea None admin] Authenticating user token {{(pid=82026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:45:24.061618 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7f053fb-9004-44dc-b2e4-15f62cbfa1ea None admin] Validating token access rules against request {{(pid=82026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:45:24.095840 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23a2100d-f32f-4b95-8bd2-4fa5d30eab01 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57539b6a6f3b4d589f5f5e1d211cd6a0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:45:24.096383 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23a2100d-f32f-4b95-8bd2-4fa5d30eab01 None admin] REQUEST_METHOD: `GET` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:45:24.096675 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23a2100d-f32f-4b95-8bd2-4fa5d30eab01 None admin] SCRIPT_NAME: `/identity` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:45:24.096957 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23a2100d-f32f-4b95-8bd2-4fa5d30eab01 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:45:24.107543 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23a2100d-f32f-4b95-8bd2-4fa5d30eab01 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=82026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:45:24.108990 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23a2100d-f32f-4b95-8bd2-4fa5d30eab01 None admin] RBAC: Authorization granted {{(pid=82026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:45:24.123399 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application [None req-23a2100d-f32f-4b95-8bd2-4fa5d30eab01 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 13 19:45:24.123399 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 19:45:24.123399 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 19:45:24.123399 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 19:45:24.123399 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 19:45:24.123399 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 19:45:24.123399 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 19:45:24.123399 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 19:45:24.123399 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 19:45:24.123399 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 19:45:24.123399 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 19:45:24.123399 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 19:45:24.123399 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 13 19:45:24.123399 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 13 19:45:24.123399 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 13 19:45:24.123399 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 13 19:45:24.128094 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 19:45:24.128094 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 19:45:24.128094 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 19:45:24.128094 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 19:45:24.128094 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 19:45:24.128094 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 19:45:24.128094 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 19:45:24.128094 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application with Lock( Sep 13 19:45:24.128094 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 19:45:24.128094 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application return self._enter() Sep 13 19:45:24.128094 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 19:45:24.128094 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 19:45:24.128094 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 19:45:24.128094 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application return self.creator() Sep 13 19:45:24.128094 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 19:45:24.128094 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application created_value = creator( Sep 13 19:45:24.128094 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 13 19:45:24.129300 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 13 19:45:24.129300 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 13 19:45:24.129300 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application Sep 13 19:45:24.129300 dv-cinder-828806-6-smb devstack@keystone.service[82026]: [pid: 82026|app: 0|req: 608/1228] 10.222.0.33 () {56 vars in 1108 bytes} [Tue Sep 13 19:45:23 2022] GET /identity/v3/domains/Default => generated 87 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 19:45:24.130407 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c02e626-e073-4b2c-b311-894c06f7d88d None admin] Authenticating user token {{(pid=82025) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:45:24.228057 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c02e626-e073-4b2c-b311-894c06f7d88d None admin] Validating token access rules against request {{(pid=82025) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:45:24.230533 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG dbcounter [-] [82025] Writing DB stats keystone:SELECT=100 {{(pid=82025) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:45:24.262665 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c4e7752-7506-498a-bd15-76a7d50c55d9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57539b6a6f3b4d589f5f5e1d211cd6a0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82025) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:45:24.263326 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c4e7752-7506-498a-bd15-76a7d50c55d9 None admin] REQUEST_METHOD: `GET` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:45:24.263616 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c4e7752-7506-498a-bd15-76a7d50c55d9 None admin] SCRIPT_NAME: `/identity` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:45:24.263892 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c4e7752-7506-498a-bd15-76a7d50c55d9 None admin] PATH_INFO: `/v3/domains` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:45:24.264540 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c4e7752-7506-498a-bd15-76a7d50c55d9 None admin] RBAC: Adding query filter params (name=Default) {{(pid=82025) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 19:45:24.264850 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c4e7752-7506-498a-bd15-76a7d50c55d9 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:45:24.266221 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c4e7752-7506-498a-bd15-76a7d50c55d9 None admin] RBAC: Authorization granted {{(pid=82025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:45:24.277447 dv-cinder-828806-6-smb devstack@keystone.service[82025]: [pid: 82025|app: 0|req: 621/1229] 10.222.0.33 () {56 vars in 1109 bytes} [Tue Sep 13 19:45:24 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 19:45:24.283484 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23a2100d-f32f-4b95-8bd2-4fa5d30eab01 None admin] Authenticating user token {{(pid=82026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:45:24.293274 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG dbcounter [-] [82026] Writing DB stats keystone:SELECT=100 {{(pid=82026) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:45:24.392468 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23a2100d-f32f-4b95-8bd2-4fa5d30eab01 None admin] Validating token access rules against request {{(pid=82026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:45:24.427593 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59319d7e-4be9-46d5-ab3e-6354cdbc1416 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57539b6a6f3b4d589f5f5e1d211cd6a0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:45:24.428221 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59319d7e-4be9-46d5-ab3e-6354cdbc1416 None admin] REQUEST_METHOD: `GET` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:45:24.428505 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59319d7e-4be9-46d5-ab3e-6354cdbc1416 None admin] SCRIPT_NAME: `/identity` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:45:24.428780 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59319d7e-4be9-46d5-ab3e-6354cdbc1416 None admin] PATH_INFO: `/v3/projects/service` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:45:24.436190 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59319d7e-4be9-46d5-ab3e-6354cdbc1416 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=82026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:45:24.437634 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59319d7e-4be9-46d5-ab3e-6354cdbc1416 None admin] RBAC: Authorization granted {{(pid=82026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:45:24.449758 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application [None req-59319d7e-4be9-46d5-ab3e-6354cdbc1416 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 13 19:45:24.449758 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 19:45:24.449758 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 19:45:24.449758 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 19:45:24.449758 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 19:45:24.449758 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 19:45:24.449758 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 19:45:24.449758 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 19:45:24.449758 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 19:45:24.449758 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 19:45:24.449758 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 19:45:24.449758 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 19:45:24.449758 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 13 19:45:24.449758 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 13 19:45:24.449758 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 13 19:45:24.450865 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 13 19:45:24.450865 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 19:45:24.450865 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 19:45:24.450865 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 19:45:24.450865 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 19:45:24.450865 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 19:45:24.450865 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 19:45:24.450865 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 19:45:24.450865 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application with Lock( Sep 13 19:45:24.450865 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 19:45:24.450865 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application return self._enter() Sep 13 19:45:24.450865 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 19:45:24.450865 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 19:45:24.450865 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 19:45:24.450865 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application return self.creator() Sep 13 19:45:24.450865 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 19:45:24.450865 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application created_value = creator( Sep 13 19:45:24.451843 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 13 19:45:24.451843 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 13 19:45:24.451843 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 13 19:45:24.451843 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 13 19:45:24.451843 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 13 19:45:24.451843 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 13 19:45:24.451843 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 13 19:45:24.451843 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application Sep 13 19:45:24.451843 dv-cinder-828806-6-smb devstack@keystone.service[82026]: [pid: 82026|app: 0|req: 609/1230] 10.222.0.33 () {56 vars in 1111 bytes} [Tue Sep 13 19:45:24 2022] GET /identity/v3/projects/service => generated 88 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 19:45:24.456941 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c4e7752-7506-498a-bd15-76a7d50c55d9 None admin] Authenticating user token {{(pid=82025) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:45:24.560249 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c4e7752-7506-498a-bd15-76a7d50c55d9 None admin] Validating token access rules against request {{(pid=82025) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:45:24.592778 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e567cec9-a3c9-478e-b45e-f1836d3aa903 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57539b6a6f3b4d589f5f5e1d211cd6a0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82025) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:45:24.593395 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e567cec9-a3c9-478e-b45e-f1836d3aa903 None admin] REQUEST_METHOD: `GET` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:45:24.593682 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e567cec9-a3c9-478e-b45e-f1836d3aa903 None admin] SCRIPT_NAME: `/identity` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:45:24.594015 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e567cec9-a3c9-478e-b45e-f1836d3aa903 None admin] PATH_INFO: `/v3/projects` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:45:24.594728 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e567cec9-a3c9-478e-b45e-f1836d3aa903 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=82025) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 19:45:24.595057 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e567cec9-a3c9-478e-b45e-f1836d3aa903 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=82025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:45:24.599428 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e567cec9-a3c9-478e-b45e-f1836d3aa903 None admin] RBAC: Authorization granted {{(pid=82025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:45:24.609012 dv-cinder-828806-6-smb devstack@keystone.service[82025]: [pid: 82025|app: 0|req: 622/1231] 10.222.0.33 () {56 vars in 1148 bytes} [Tue Sep 13 19:45:24 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 19:45:24.615070 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59319d7e-4be9-46d5-ab3e-6354cdbc1416 None admin] Authenticating user token {{(pid=82026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:45:24.683194 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG dbcounter [-] [82026] Writing DB stats keystone:SELECT=100 {{(pid=82026) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:45:24.724009 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59319d7e-4be9-46d5-ab3e-6354cdbc1416 None admin] Validating token access rules against request {{(pid=82026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:45:24.758324 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50ed671e-213e-41ee-a110-6f7308eca40d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57539b6a6f3b4d589f5f5e1d211cd6a0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:45:24.758974 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50ed671e-213e-41ee-a110-6f7308eca40d None admin] REQUEST_METHOD: `PUT` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:45:24.759286 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50ed671e-213e-41ee-a110-6f7308eca40d None admin] SCRIPT_NAME: `/identity` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:45:24.759567 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50ed671e-213e-41ee-a110-6f7308eca40d None admin] PATH_INFO: `/v3/projects/c8c6fba0f15b4d6a84ff601919b7b8e4/users/060ea3dea2134429967c164bd158b272/roles/47ee826cd5f148c19f293f9470f906da` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:45:24.773473 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50ed671e-213e-41ee-a110-6f7308eca40d None admin] RBAC: Authorizing `identity:create_grant(project_id=c8c6fba0f15b4d6a84ff601919b7b8e4, user_id=060ea3dea2134429967c164bd158b272, role_id=47ee826cd5f148c19f293f9470f906da)` {{(pid=82026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:45:24.774920 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50ed671e-213e-41ee-a110-6f7308eca40d None admin] RBAC: Authorization granted {{(pid=82026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:45:24.850585 dv-cinder-828806-6-smb devstack@keystone.service[82026]: [pid: 82026|app: 0|req: 610/1232] 10.222.0.33 () {58 vars in 1439 bytes} [Tue Sep 13 19:45:24 2022] PUT /identity/v3/projects/c8c6fba0f15b4d6a84ff601919b7b8e4/users/060ea3dea2134429967c164bd158b272/roles/47ee826cd5f148c19f293f9470f906da => generated 0 bytes in 236 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 19:45:26.976928 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c4efb19-d086-492b-b4b4-97835295cd55 None None] REQUEST_METHOD: `GET` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:45:26.977484 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c4efb19-d086-492b-b4b4-97835295cd55 None None] SCRIPT_NAME: `/identity` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:45:26.977484 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c4efb19-d086-492b-b4b4-97835295cd55 None None] PATH_INFO: `/` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:45:26.978872 dv-cinder-828806-6-smb devstack@keystone.service[82025]: [pid: 82025|app: 0|req: 623/1233] 10.222.0.33 () {54 vars in 927 bytes} [Tue Sep 13 19:45:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 19:45:26.983965 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7efc2f05-1cdb-486d-bb2e-0b41af7fcb09 None None] REQUEST_METHOD: `POST` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:45:26.984385 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7efc2f05-1cdb-486d-bb2e-0b41af7fcb09 None None] SCRIPT_NAME: `/identity` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:45:26.984516 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7efc2f05-1cdb-486d-bb2e-0b41af7fcb09 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:45:27.002438 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.auth.core [None req-7efc2f05-1cdb-486d-bb2e-0b41af7fcb09 None None] MFA Rules not processed for user `57539b6a6f3b4d589f5f5e1d211cd6a0`. Rule list: `[]` (Enabled: `True`). {{(pid=82026) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 19:45:27.003640 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.common.fernet_utils [None req-7efc2f05-1cdb-486d-bb2e-0b41af7fcb09 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82026) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 19:45:27.069787 dv-cinder-828806-6-smb devstack@keystone.service[82026]: [pid: 82026|app: 0|req: 611/1234] 10.222.0.33 () {58 vars in 1024 bytes} [Tue Sep 13 19:45:26 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 13 19:45:27.340387 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c4efb19-d086-492b-b4b4-97835295cd55 None None] Authenticating user token {{(pid=82025) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:45:27.365982 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG dbcounter [-] [82025] Writing DB stats keystone:SELECT=100 {{(pid=82025) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:45:27.449437 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c4efb19-d086-492b-b4b4-97835295cd55 None None] Validating token access rules against request {{(pid=82025) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:45:27.483135 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3956f96-aaec-42e5-b421-88428aff18a4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57539b6a6f3b4d589f5f5e1d211cd6a0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82025) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:45:27.483761 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3956f96-aaec-42e5-b421-88428aff18a4 None admin] REQUEST_METHOD: `GET` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:45:27.484042 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3956f96-aaec-42e5-b421-88428aff18a4 None admin] SCRIPT_NAME: `/identity` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:45:27.484378 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3956f96-aaec-42e5-b421-88428aff18a4 None admin] PATH_INFO: `/v3/roles/service` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:45:27.495596 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3956f96-aaec-42e5-b421-88428aff18a4 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=82025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 13 19:45:27.500350 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application [None req-c3956f96-aaec-42e5-b421-88428aff18a4 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 13 19:45:27.500350 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 19:45:27.500350 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 19:45:27.500350 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 19:45:27.500350 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 19:45:27.500350 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 19:45:27.500350 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 19:45:27.500350 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 19:45:27.500350 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 19:45:27.500350 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 19:45:27.500350 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 19:45:27.500350 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 19:45:27.500350 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 13 19:45:27.500350 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 13 19:45:27.500350 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 13 19:45:27.500350 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 13 19:45:27.501502 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 13 19:45:27.501502 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 13 19:45:27.501502 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 13 19:45:27.501502 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 13 19:45:27.501502 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 19:45:27.501502 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 19:45:27.501502 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 19:45:27.501502 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 19:45:27.501502 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 19:45:27.501502 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 19:45:27.501502 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 19:45:27.501502 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application with Lock( Sep 13 19:45:27.501502 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 19:45:27.501502 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application return self._enter() Sep 13 19:45:27.501502 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 19:45:27.501502 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 19:45:27.502485 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 19:45:27.502485 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application return self.creator() Sep 13 19:45:27.502485 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 19:45:27.502485 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application created_value = creator( Sep 13 19:45:27.502485 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 13 19:45:27.502485 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 13 19:45:27.502485 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 13 19:45:27.502485 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 13 19:45:27.502485 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 13 19:45:27.502485 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 13 19:45:27.502485 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 13 19:45:27.502485 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application Sep 13 19:45:27.502485 dv-cinder-828806-6-smb devstack@keystone.service[82025]: [pid: 82025|app: 0|req: 624/1235] 10.222.0.33 () {56 vars in 1102 bytes} [Tue Sep 13 19:45:27 2022] GET /identity/v3/roles/service => generated 85 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 19:45:27.507678 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7efc2f05-1cdb-486d-bb2e-0b41af7fcb09 None None] Authenticating user token {{(pid=82026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:45:27.552542 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG dbcounter [-] [82026] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82026) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:45:27.603850 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7efc2f05-1cdb-486d-bb2e-0b41af7fcb09 None None] Validating token access rules against request {{(pid=82026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:45:27.636822 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-266c766d-ad70-4fd9-85ba-1a25a46f25dc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57539b6a6f3b4d589f5f5e1d211cd6a0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:45:27.637414 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-266c766d-ad70-4fd9-85ba-1a25a46f25dc None admin] REQUEST_METHOD: `GET` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:45:27.637695 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-266c766d-ad70-4fd9-85ba-1a25a46f25dc None admin] SCRIPT_NAME: `/identity` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:45:27.637969 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-266c766d-ad70-4fd9-85ba-1a25a46f25dc None admin] PATH_INFO: `/v3/roles` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:45:27.638630 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-266c766d-ad70-4fd9-85ba-1a25a46f25dc None admin] RBAC: Adding query filter params (name=service) {{(pid=82026) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 19:45:27.638935 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-266c766d-ad70-4fd9-85ba-1a25a46f25dc None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:45:27.640332 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-266c766d-ad70-4fd9-85ba-1a25a46f25dc None admin] RBAC: Authorization granted {{(pid=82026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:45:27.647923 dv-cinder-828806-6-smb devstack@keystone.service[82026]: [pid: 82026|app: 0|req: 612/1236] 10.222.0.33 () {56 vars in 1103 bytes} [Tue Sep 13 19:45:27 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 19:45:27.654626 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3956f96-aaec-42e5-b421-88428aff18a4 None admin] Authenticating user token {{(pid=82025) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:45:27.742299 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG dbcounter [-] [82025] Writing DB stats keystone:SELECT=100 {{(pid=82025) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:45:27.757333 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3956f96-aaec-42e5-b421-88428aff18a4 None admin] Validating token access rules against request {{(pid=82025) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:45:27.789994 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f997a039-f1c2-4d82-8650-04edf6a73af0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57539b6a6f3b4d589f5f5e1d211cd6a0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82025) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:45:27.790628 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f997a039-f1c2-4d82-8650-04edf6a73af0 None admin] REQUEST_METHOD: `GET` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:45:27.790895 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f997a039-f1c2-4d82-8650-04edf6a73af0 None admin] SCRIPT_NAME: `/identity` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:45:27.791242 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f997a039-f1c2-4d82-8650-04edf6a73af0 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:45:27.802337 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f997a039-f1c2-4d82-8650-04edf6a73af0 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=82025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:45:27.803846 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f997a039-f1c2-4d82-8650-04edf6a73af0 None admin] RBAC: Authorization granted {{(pid=82025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:45:27.818633 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application [None req-f997a039-f1c2-4d82-8650-04edf6a73af0 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 13 19:45:27.818633 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 19:45:27.818633 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 19:45:27.818633 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 19:45:27.818633 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 19:45:27.818633 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 19:45:27.818633 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 19:45:27.818633 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 19:45:27.818633 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 19:45:27.818633 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 19:45:27.818633 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 19:45:27.818633 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 19:45:27.818633 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 13 19:45:27.818633 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 13 19:45:27.818633 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 13 19:45:27.818633 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 13 19:45:27.819839 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 19:45:27.819839 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 19:45:27.819839 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 19:45:27.819839 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 19:45:27.819839 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 19:45:27.819839 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 19:45:27.819839 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 19:45:27.819839 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application with Lock( Sep 13 19:45:27.819839 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 19:45:27.819839 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application return self._enter() Sep 13 19:45:27.819839 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 19:45:27.819839 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 19:45:27.819839 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 19:45:27.819839 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application return self.creator() Sep 13 19:45:27.819839 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 19:45:27.819839 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application created_value = creator( Sep 13 19:45:27.819839 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 13 19:45:27.820922 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 13 19:45:27.820922 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 13 19:45:27.820922 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application Sep 13 19:45:27.820922 dv-cinder-828806-6-smb devstack@keystone.service[82025]: [pid: 82025|app: 0|req: 625/1237] 10.222.0.33 () {56 vars in 1108 bytes} [Tue Sep 13 19:45:27 2022] GET /identity/v3/domains/Default => generated 87 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 19:45:27.826346 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-266c766d-ad70-4fd9-85ba-1a25a46f25dc None admin] Authenticating user token {{(pid=82026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:45:27.927444 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-266c766d-ad70-4fd9-85ba-1a25a46f25dc None admin] Validating token access rules against request {{(pid=82026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:45:27.936940 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG dbcounter [-] [82026] Writing DB stats keystone:SELECT=100 {{(pid=82026) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:45:27.961858 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbacfe7b-0727-4dab-98df-90a2efd82f65 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57539b6a6f3b4d589f5f5e1d211cd6a0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:45:27.962456 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbacfe7b-0727-4dab-98df-90a2efd82f65 None admin] REQUEST_METHOD: `GET` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:45:27.962739 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbacfe7b-0727-4dab-98df-90a2efd82f65 None admin] SCRIPT_NAME: `/identity` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:45:27.963179 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbacfe7b-0727-4dab-98df-90a2efd82f65 None admin] PATH_INFO: `/v3/domains` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:45:27.963829 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbacfe7b-0727-4dab-98df-90a2efd82f65 None admin] RBAC: Adding query filter params (name=Default) {{(pid=82026) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 19:45:27.964232 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbacfe7b-0727-4dab-98df-90a2efd82f65 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:45:27.965628 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbacfe7b-0727-4dab-98df-90a2efd82f65 None admin] RBAC: Authorization granted {{(pid=82026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:45:27.977008 dv-cinder-828806-6-smb devstack@keystone.service[82026]: [pid: 82026|app: 0|req: 613/1238] 10.222.0.33 () {56 vars in 1109 bytes} [Tue Sep 13 19:45:27 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 19:45:27.983866 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f997a039-f1c2-4d82-8650-04edf6a73af0 None admin] Authenticating user token {{(pid=82025) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:45:28.088987 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f997a039-f1c2-4d82-8650-04edf6a73af0 None admin] Validating token access rules against request {{(pid=82025) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:45:28.121476 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dab9cb57-9c14-4f62-95c7-0beac99bd26b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57539b6a6f3b4d589f5f5e1d211cd6a0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82025) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:45:28.122092 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dab9cb57-9c14-4f62-95c7-0beac99bd26b None admin] REQUEST_METHOD: `GET` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:45:28.122372 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dab9cb57-9c14-4f62-95c7-0beac99bd26b None admin] SCRIPT_NAME: `/identity` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:45:28.122641 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dab9cb57-9c14-4f62-95c7-0beac99bd26b None admin] PATH_INFO: `/v3/users/placement` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:45:28.125254 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG dbcounter [-] [82025] Writing DB stats keystone:SELECT=100 {{(pid=82025) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:45:28.130108 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dab9cb57-9c14-4f62-95c7-0beac99bd26b None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=82025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:45:28.134293 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dab9cb57-9c14-4f62-95c7-0beac99bd26b None admin] RBAC: Authorization granted {{(pid=82025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:45:28.142855 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application [None req-dab9cb57-9c14-4f62-95c7-0beac99bd26b None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Sep 13 19:45:28.142855 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 19:45:28.142855 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 19:45:28.142855 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 19:45:28.142855 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 19:45:28.142855 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 19:45:28.142855 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 19:45:28.142855 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 19:45:28.142855 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 19:45:28.142855 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 19:45:28.142855 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 19:45:28.142855 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 19:45:28.142855 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 13 19:45:28.142855 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 13 19:45:28.142855 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 13 19:45:28.142855 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 13 19:45:28.143878 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 19:45:28.143878 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 19:45:28.143878 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 13 19:45:28.143878 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 13 19:45:28.143878 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 13 19:45:28.143878 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 13 19:45:28.143878 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 19:45:28.143878 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 19:45:28.143878 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 19:45:28.143878 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 19:45:28.143878 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 19:45:28.143878 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application with Lock( Sep 13 19:45:28.143878 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 19:45:28.143878 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application return self._enter() Sep 13 19:45:28.143878 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 19:45:28.143878 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 19:45:28.143878 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 19:45:28.143878 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application return self.creator() Sep 13 19:45:28.144901 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 19:45:28.144901 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application created_value = creator( Sep 13 19:45:28.144901 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 13 19:45:28.144901 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 13 19:45:28.144901 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 13 19:45:28.144901 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 13 19:45:28.144901 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 13 19:45:28.144901 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 13 19:45:28.144901 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Sep 13 19:45:28.144901 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application Sep 13 19:45:28.144901 dv-cinder-828806-6-smb devstack@keystone.service[82025]: [pid: 82025|app: 0|req: 626/1239] 10.222.0.33 () {56 vars in 1108 bytes} [Tue Sep 13 19:45:27 2022] GET /identity/v3/users/placement => generated 87 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 19:45:28.149841 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbacfe7b-0727-4dab-98df-90a2efd82f65 None admin] Authenticating user token {{(pid=82026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:45:28.246493 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbacfe7b-0727-4dab-98df-90a2efd82f65 None admin] Validating token access rules against request {{(pid=82026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:45:28.280564 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fa755cb-29bc-4384-82a7-faccfe7bec29 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57539b6a6f3b4d589f5f5e1d211cd6a0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:45:28.281171 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fa755cb-29bc-4384-82a7-faccfe7bec29 None admin] REQUEST_METHOD: `GET` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:45:28.281459 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fa755cb-29bc-4384-82a7-faccfe7bec29 None admin] SCRIPT_NAME: `/identity` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:45:28.281739 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fa755cb-29bc-4384-82a7-faccfe7bec29 None admin] PATH_INFO: `/v3/users` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:45:28.282471 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fa755cb-29bc-4384-82a7-faccfe7bec29 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=82026) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 19:45:28.282784 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fa755cb-29bc-4384-82a7-faccfe7bec29 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=82026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:45:28.284307 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fa755cb-29bc-4384-82a7-faccfe7bec29 None admin] RBAC: Authorization granted {{(pid=82026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:45:28.302804 dv-cinder-828806-6-smb devstack@keystone.service[82026]: [pid: 82026|app: 0|req: 614/1240] 10.222.0.33 () {56 vars in 1143 bytes} [Tue Sep 13 19:45:28 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 19:45:28.309149 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dab9cb57-9c14-4f62-95c7-0beac99bd26b None admin] Authenticating user token {{(pid=82025) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:45:28.416783 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dab9cb57-9c14-4f62-95c7-0beac99bd26b None admin] Validating token access rules against request {{(pid=82025) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:45:28.449890 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27c7b32f-57d3-4edc-8588-8c223e0e2ef6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57539b6a6f3b4d589f5f5e1d211cd6a0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82025) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:45:28.450484 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27c7b32f-57d3-4edc-8588-8c223e0e2ef6 None admin] REQUEST_METHOD: `GET` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:45:28.450764 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27c7b32f-57d3-4edc-8588-8c223e0e2ef6 None admin] SCRIPT_NAME: `/identity` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:45:28.451067 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27c7b32f-57d3-4edc-8588-8c223e0e2ef6 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:45:28.511757 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG dbcounter [-] [82025] Writing DB stats keystone:SELECT=100 {{(pid=82025) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:45:28.519558 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27c7b32f-57d3-4edc-8588-8c223e0e2ef6 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=82025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:45:28.520990 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27c7b32f-57d3-4edc-8588-8c223e0e2ef6 None admin] RBAC: Authorization granted {{(pid=82025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:45:28.617530 dv-cinder-828806-6-smb devstack@keystone.service[82025]: [pid: 82025|app: 0|req: 627/1241] 10.222.0.33 () {58 vars in 1282 bytes} [Tue Sep 13 19:45:28 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 309 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Sep 13 19:45:28.624266 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fa755cb-29bc-4384-82a7-faccfe7bec29 None admin] Authenticating user token {{(pid=82026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:45:28.652321 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG dbcounter [-] [82026] Writing DB stats keystone:SELECT=100 {{(pid=82026) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:45:28.722309 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fa755cb-29bc-4384-82a7-faccfe7bec29 None admin] Validating token access rules against request {{(pid=82026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:45:28.762998 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d08e866-7a20-4e49-9736-e5e9ac83175f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57539b6a6f3b4d589f5f5e1d211cd6a0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:45:28.763696 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d08e866-7a20-4e49-9736-e5e9ac83175f None admin] REQUEST_METHOD: `GET` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:45:28.764018 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d08e866-7a20-4e49-9736-e5e9ac83175f None admin] SCRIPT_NAME: `/identity` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:45:28.764333 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d08e866-7a20-4e49-9736-e5e9ac83175f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:45:28.774238 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d08e866-7a20-4e49-9736-e5e9ac83175f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=82026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:45:28.775756 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d08e866-7a20-4e49-9736-e5e9ac83175f None admin] RBAC: Authorization granted {{(pid=82026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:45:28.789906 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application [None req-6d08e866-7a20-4e49-9736-e5e9ac83175f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 13 19:45:28.789906 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 19:45:28.789906 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 19:45:28.789906 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 19:45:28.789906 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 19:45:28.789906 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 19:45:28.789906 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 19:45:28.789906 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 19:45:28.789906 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 19:45:28.789906 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 19:45:28.789906 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 19:45:28.789906 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 19:45:28.789906 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 13 19:45:28.789906 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 13 19:45:28.789906 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 13 19:45:28.789906 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 13 19:45:28.793470 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 19:45:28.793470 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 19:45:28.793470 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 19:45:28.793470 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 19:45:28.793470 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 19:45:28.793470 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 19:45:28.793470 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 19:45:28.793470 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application with Lock( Sep 13 19:45:28.793470 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 19:45:28.793470 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application return self._enter() Sep 13 19:45:28.793470 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 19:45:28.793470 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 19:45:28.793470 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 19:45:28.793470 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application return self.creator() Sep 13 19:45:28.793470 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 19:45:28.793470 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application created_value = creator( Sep 13 19:45:28.793470 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 13 19:45:28.794612 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 13 19:45:28.794612 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 13 19:45:28.794612 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application Sep 13 19:45:28.794612 dv-cinder-828806-6-smb devstack@keystone.service[82026]: [pid: 82026|app: 0|req: 615/1242] 10.222.0.33 () {56 vars in 1108 bytes} [Tue Sep 13 19:45:28 2022] GET /identity/v3/domains/Default => generated 87 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 19:45:28.796794 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27c7b32f-57d3-4edc-8588-8c223e0e2ef6 None admin] Authenticating user token {{(pid=82025) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:45:28.887936 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG dbcounter [-] [82025] Writing DB stats keystone:SELECT=100 {{(pid=82025) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:45:28.893642 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27c7b32f-57d3-4edc-8588-8c223e0e2ef6 None admin] Validating token access rules against request {{(pid=82025) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:45:28.927329 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fff11da-8f65-468b-8484-f0e0aa27005a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57539b6a6f3b4d589f5f5e1d211cd6a0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82025) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:45:28.927930 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fff11da-8f65-468b-8484-f0e0aa27005a None admin] REQUEST_METHOD: `GET` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:45:28.928217 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fff11da-8f65-468b-8484-f0e0aa27005a None admin] SCRIPT_NAME: `/identity` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:45:28.928499 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fff11da-8f65-468b-8484-f0e0aa27005a None admin] PATH_INFO: `/v3/domains` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:45:28.929131 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fff11da-8f65-468b-8484-f0e0aa27005a None admin] RBAC: Adding query filter params (name=Default) {{(pid=82025) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 19:45:28.929440 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fff11da-8f65-468b-8484-f0e0aa27005a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:45:28.930803 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fff11da-8f65-468b-8484-f0e0aa27005a None admin] RBAC: Authorization granted {{(pid=82025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:45:28.941718 dv-cinder-828806-6-smb devstack@keystone.service[82025]: [pid: 82025|app: 0|req: 628/1243] 10.222.0.33 () {56 vars in 1109 bytes} [Tue Sep 13 19:45:28 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 19:45:28.947443 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d08e866-7a20-4e49-9736-e5e9ac83175f None admin] Authenticating user token {{(pid=82026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:45:29.028366 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG dbcounter [-] [82026] Writing DB stats keystone:SELECT=100 {{(pid=82026) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:45:29.049934 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d08e866-7a20-4e49-9736-e5e9ac83175f None admin] Validating token access rules against request {{(pid=82026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:45:29.082804 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b051ba13-a539-4e19-892a-e3aefb95a321 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57539b6a6f3b4d589f5f5e1d211cd6a0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:45:29.083448 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b051ba13-a539-4e19-892a-e3aefb95a321 None admin] REQUEST_METHOD: `GET` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:45:29.083730 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b051ba13-a539-4e19-892a-e3aefb95a321 None admin] SCRIPT_NAME: `/identity` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:45:29.084005 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b051ba13-a539-4e19-892a-e3aefb95a321 None admin] PATH_INFO: `/v3/projects/service` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:45:29.091063 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b051ba13-a539-4e19-892a-e3aefb95a321 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=82026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:45:29.092622 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b051ba13-a539-4e19-892a-e3aefb95a321 None admin] RBAC: Authorization granted {{(pid=82026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:45:29.103425 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application [None req-b051ba13-a539-4e19-892a-e3aefb95a321 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 13 19:45:29.103425 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 19:45:29.103425 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 19:45:29.103425 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 19:45:29.103425 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 19:45:29.103425 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 19:45:29.103425 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 19:45:29.103425 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 19:45:29.103425 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 19:45:29.103425 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 19:45:29.103425 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 19:45:29.103425 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 19:45:29.103425 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 13 19:45:29.103425 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 13 19:45:29.103425 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 13 19:45:29.105763 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 13 19:45:29.105763 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 19:45:29.105763 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 19:45:29.105763 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 19:45:29.105763 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 19:45:29.105763 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 19:45:29.105763 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 19:45:29.105763 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 19:45:29.105763 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application with Lock( Sep 13 19:45:29.105763 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 19:45:29.105763 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application return self._enter() Sep 13 19:45:29.105763 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 19:45:29.105763 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 19:45:29.105763 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 19:45:29.105763 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application return self.creator() Sep 13 19:45:29.105763 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 19:45:29.105763 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application created_value = creator( Sep 13 19:45:29.107055 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 13 19:45:29.107055 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 13 19:45:29.107055 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 13 19:45:29.107055 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 13 19:45:29.107055 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 13 19:45:29.107055 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 13 19:45:29.107055 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 13 19:45:29.107055 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application Sep 13 19:45:29.107055 dv-cinder-828806-6-smb devstack@keystone.service[82026]: [pid: 82026|app: 0|req: 616/1244] 10.222.0.33 () {56 vars in 1111 bytes} [Tue Sep 13 19:45:28 2022] GET /identity/v3/projects/service => generated 88 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 19:45:29.111172 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fff11da-8f65-468b-8484-f0e0aa27005a None admin] Authenticating user token {{(pid=82025) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:45:29.215007 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fff11da-8f65-468b-8484-f0e0aa27005a None admin] Validating token access rules against request {{(pid=82025) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:45:29.249432 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7a81153-b4c4-4c77-bb03-ca5d302cd45d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57539b6a6f3b4d589f5f5e1d211cd6a0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82025) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:45:29.250034 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7a81153-b4c4-4c77-bb03-ca5d302cd45d None admin] REQUEST_METHOD: `GET` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:45:29.250323 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7a81153-b4c4-4c77-bb03-ca5d302cd45d None admin] SCRIPT_NAME: `/identity` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:45:29.250597 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7a81153-b4c4-4c77-bb03-ca5d302cd45d None admin] PATH_INFO: `/v3/projects` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:45:29.251314 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7a81153-b4c4-4c77-bb03-ca5d302cd45d None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=82025) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 19:45:29.251624 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7a81153-b4c4-4c77-bb03-ca5d302cd45d None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=82025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:45:29.253044 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7a81153-b4c4-4c77-bb03-ca5d302cd45d None admin] RBAC: Authorization granted {{(pid=82025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:45:29.265187 dv-cinder-828806-6-smb devstack@keystone.service[82025]: [pid: 82025|app: 0|req: 629/1245] 10.222.0.33 () {56 vars in 1148 bytes} [Tue Sep 13 19:45:29 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 19:45:29.271303 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b051ba13-a539-4e19-892a-e3aefb95a321 None admin] Authenticating user token {{(pid=82026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:45:29.369117 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b051ba13-a539-4e19-892a-e3aefb95a321 None admin] Validating token access rules against request {{(pid=82026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:45:29.403127 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e16c0574-d232-43fd-8421-a9e3280d1aa6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57539b6a6f3b4d589f5f5e1d211cd6a0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:45:29.403722 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e16c0574-d232-43fd-8421-a9e3280d1aa6 None admin] REQUEST_METHOD: `GET` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:45:29.404012 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e16c0574-d232-43fd-8421-a9e3280d1aa6 None admin] SCRIPT_NAME: `/identity` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:45:29.404291 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e16c0574-d232-43fd-8421-a9e3280d1aa6 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:45:29.405014 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e16c0574-d232-43fd-8421-a9e3280d1aa6 None admin] RBAC: Adding query filter params (role.id=47ee826cd5f148c19f293f9470f906da, scope.project.id=c8c6fba0f15b4d6a84ff601919b7b8e4, user.id=060ea3dea2134429967c164bd158b272) {{(pid=82026) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 19:45:29.405326 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e16c0574-d232-43fd-8421-a9e3280d1aa6 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=82026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:45:29.406771 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e16c0574-d232-43fd-8421-a9e3280d1aa6 None admin] RBAC: Authorization granted {{(pid=82026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:45:29.412533 dv-cinder-828806-6-smb devstack@keystone.service[82026]: [pid: 82026|app: 0|req: 617/1246] 10.222.0.33 () {56 vars in 1374 bytes} [Tue Sep 13 19:45:29 2022] GET /identity/v3/role_assignments?user.id=060ea3dea2134429967c164bd158b272&scope.project.id=c8c6fba0f15b4d6a84ff601919b7b8e4&role.id=47ee826cd5f148c19f293f9470f906da => generated 608 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 19:45:31.645748 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9a76e75-e929-470a-9fb3-7f9308998062 None None] REQUEST_METHOD: `GET` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:45:31.646307 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9a76e75-e929-470a-9fb3-7f9308998062 None None] SCRIPT_NAME: `/identity` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:45:31.646307 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9a76e75-e929-470a-9fb3-7f9308998062 None None] PATH_INFO: `/` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:45:31.647759 dv-cinder-828806-6-smb devstack@keystone.service[82025]: [pid: 82025|app: 0|req: 630/1247] 10.222.0.33 () {54 vars in 927 bytes} [Tue Sep 13 19:45:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 19:45:31.653838 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b06b8439-36d2-471a-9722-75070df33108 None None] REQUEST_METHOD: `POST` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:45:31.654246 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b06b8439-36d2-471a-9722-75070df33108 None None] SCRIPT_NAME: `/identity` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:45:31.654435 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b06b8439-36d2-471a-9722-75070df33108 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:45:31.660801 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG dbcounter [-] [82026] Writing DB stats keystone:SELECT=100 {{(pid=82026) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:45:31.673473 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.auth.core [None req-b06b8439-36d2-471a-9722-75070df33108 None None] MFA Rules not processed for user `57539b6a6f3b4d589f5f5e1d211cd6a0`. Rule list: `[]` (Enabled: `True`). {{(pid=82026) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 19:45:31.674927 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.common.fernet_utils [None req-b06b8439-36d2-471a-9722-75070df33108 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82026) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 19:45:31.743045 dv-cinder-828806-6-smb devstack@keystone.service[82026]: [pid: 82026|app: 0|req: 618/1248] 10.222.0.33 () {58 vars in 1024 bytes} [Tue Sep 13 19:45:31 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 13 19:45:32.012087 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9a76e75-e929-470a-9fb3-7f9308998062 None None] Authenticating user token {{(pid=82025) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:45:32.030905 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG dbcounter [-] [82025] Writing DB stats keystone:SELECT=100 {{(pid=82025) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:45:32.114359 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9a76e75-e929-470a-9fb3-7f9308998062 None None] Validating token access rules against request {{(pid=82025) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:45:32.147841 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad4ad077-43cd-4db1-8afc-7bb845af6e73 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57539b6a6f3b4d589f5f5e1d211cd6a0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82025) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:45:32.148455 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad4ad077-43cd-4db1-8afc-7bb845af6e73 None admin] REQUEST_METHOD: `GET` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:45:32.148735 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad4ad077-43cd-4db1-8afc-7bb845af6e73 None admin] SCRIPT_NAME: `/identity` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:45:32.149009 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad4ad077-43cd-4db1-8afc-7bb845af6e73 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:45:32.159088 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad4ad077-43cd-4db1-8afc-7bb845af6e73 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=82025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 13 19:45:32.163832 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application [None req-ad4ad077-43cd-4db1-8afc-7bb845af6e73 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 13 19:45:32.163832 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 19:45:32.163832 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 19:45:32.163832 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 19:45:32.163832 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 19:45:32.163832 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 19:45:32.163832 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 19:45:32.163832 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 19:45:32.163832 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 19:45:32.163832 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 19:45:32.163832 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 19:45:32.163832 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 19:45:32.163832 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 13 19:45:32.163832 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 13 19:45:32.163832 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 13 19:45:32.163832 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 13 19:45:32.164917 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 13 19:45:32.164917 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 13 19:45:32.164917 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 13 19:45:32.164917 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 13 19:45:32.164917 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 19:45:32.164917 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 19:45:32.164917 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 19:45:32.164917 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 19:45:32.164917 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 19:45:32.164917 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 19:45:32.164917 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 19:45:32.164917 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application with Lock( Sep 13 19:45:32.164917 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 19:45:32.164917 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application return self._enter() Sep 13 19:45:32.164917 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 19:45:32.164917 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 19:45:32.165985 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 19:45:32.165985 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application return self.creator() Sep 13 19:45:32.165985 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 19:45:32.165985 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application created_value = creator( Sep 13 19:45:32.165985 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 13 19:45:32.165985 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 13 19:45:32.165985 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 13 19:45:32.165985 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 13 19:45:32.165985 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 13 19:45:32.165985 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 13 19:45:32.165985 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 13 19:45:32.165985 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application Sep 13 19:45:32.165985 dv-cinder-828806-6-smb devstack@keystone.service[82025]: [pid: 82025|app: 0|req: 631/1249] 10.222.0.33 () {56 vars in 1096 bytes} [Tue Sep 13 19:45:32 2022] GET /identity/v3/roles/admin => generated 83 bytes in 154 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 19:45:32.171859 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b06b8439-36d2-471a-9722-75070df33108 None None] Authenticating user token {{(pid=82026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:45:32.270024 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b06b8439-36d2-471a-9722-75070df33108 None None] Validating token access rules against request {{(pid=82026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:45:32.300143 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG dbcounter [-] [82026] Writing DB stats keystone:SELECT=100 {{(pid=82026) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:45:32.305120 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b71a7f5-96e3-4e2b-967e-67d0d747ce7c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57539b6a6f3b4d589f5f5e1d211cd6a0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:45:32.305726 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b71a7f5-96e3-4e2b-967e-67d0d747ce7c None admin] REQUEST_METHOD: `GET` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:45:32.306010 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b71a7f5-96e3-4e2b-967e-67d0d747ce7c None admin] SCRIPT_NAME: `/identity` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:45:32.306287 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b71a7f5-96e3-4e2b-967e-67d0d747ce7c None admin] PATH_INFO: `/v3/roles` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:45:32.308075 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b71a7f5-96e3-4e2b-967e-67d0d747ce7c None admin] RBAC: Adding query filter params (name=admin) {{(pid=82026) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 19:45:32.308396 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b71a7f5-96e3-4e2b-967e-67d0d747ce7c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:45:32.309768 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b71a7f5-96e3-4e2b-967e-67d0d747ce7c None admin] RBAC: Authorization granted {{(pid=82026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:45:32.317535 dv-cinder-828806-6-smb devstack@keystone.service[82026]: [pid: 82026|app: 0|req: 619/1250] 10.222.0.33 () {56 vars in 1099 bytes} [Tue Sep 13 19:45:32 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 19:45:32.323395 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad4ad077-43cd-4db1-8afc-7bb845af6e73 None admin] Authenticating user token {{(pid=82025) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:45:32.399997 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG dbcounter [-] [82025] Writing DB stats keystone:SELECT=100 {{(pid=82025) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:45:32.430400 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad4ad077-43cd-4db1-8afc-7bb845af6e73 None admin] Validating token access rules against request {{(pid=82025) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:45:32.464544 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b3597e3-4bf5-4635-a897-af2700074d3e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57539b6a6f3b4d589f5f5e1d211cd6a0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82025) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:45:32.465199 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b3597e3-4bf5-4635-a897-af2700074d3e None admin] REQUEST_METHOD: `GET` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:45:32.465594 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b3597e3-4bf5-4635-a897-af2700074d3e None admin] SCRIPT_NAME: `/identity` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:45:32.465872 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b3597e3-4bf5-4635-a897-af2700074d3e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:45:32.475952 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b3597e3-4bf5-4635-a897-af2700074d3e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=82025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:45:32.477522 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b3597e3-4bf5-4635-a897-af2700074d3e None admin] RBAC: Authorization granted {{(pid=82025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:45:32.492687 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application [None req-1b3597e3-4bf5-4635-a897-af2700074d3e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 13 19:45:32.492687 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 19:45:32.492687 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 19:45:32.492687 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 19:45:32.492687 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 19:45:32.492687 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 19:45:32.492687 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 19:45:32.492687 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 19:45:32.492687 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 19:45:32.492687 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 19:45:32.492687 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 19:45:32.492687 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 19:45:32.492687 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 13 19:45:32.492687 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 13 19:45:32.492687 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 13 19:45:32.492687 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 13 19:45:32.493831 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 19:45:32.493831 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 19:45:32.493831 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 19:45:32.493831 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 19:45:32.493831 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 19:45:32.493831 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 19:45:32.493831 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 19:45:32.493831 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application with Lock( Sep 13 19:45:32.493831 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 19:45:32.493831 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application return self._enter() Sep 13 19:45:32.493831 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 19:45:32.493831 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 19:45:32.493831 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 19:45:32.493831 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application return self.creator() Sep 13 19:45:32.493831 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 19:45:32.493831 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application created_value = creator( Sep 13 19:45:32.493831 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 13 19:45:32.495177 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 13 19:45:32.495177 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 13 19:45:32.495177 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application Sep 13 19:45:32.495177 dv-cinder-828806-6-smb devstack@keystone.service[82025]: [pid: 82025|app: 0|req: 632/1251] 10.222.0.33 () {56 vars in 1108 bytes} [Tue Sep 13 19:45:32 2022] GET /identity/v3/domains/Default => generated 87 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 19:45:32.499958 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b71a7f5-96e3-4e2b-967e-67d0d747ce7c None admin] Authenticating user token {{(pid=82026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:45:32.598142 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b71a7f5-96e3-4e2b-967e-67d0d747ce7c None admin] Validating token access rules against request {{(pid=82026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:45:32.631176 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0735b829-5a5d-4e04-8eda-e37e8506abd6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57539b6a6f3b4d589f5f5e1d211cd6a0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:45:32.631785 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0735b829-5a5d-4e04-8eda-e37e8506abd6 None admin] REQUEST_METHOD: `GET` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:45:32.632068 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0735b829-5a5d-4e04-8eda-e37e8506abd6 None admin] SCRIPT_NAME: `/identity` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:45:32.632349 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0735b829-5a5d-4e04-8eda-e37e8506abd6 None admin] PATH_INFO: `/v3/domains` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:45:32.632994 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0735b829-5a5d-4e04-8eda-e37e8506abd6 None admin] RBAC: Adding query filter params (name=Default) {{(pid=82026) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 19:45:32.633304 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0735b829-5a5d-4e04-8eda-e37e8506abd6 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:45:32.634667 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0735b829-5a5d-4e04-8eda-e37e8506abd6 None admin] RBAC: Authorization granted {{(pid=82026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:45:32.646243 dv-cinder-828806-6-smb devstack@keystone.service[82026]: [pid: 82026|app: 0|req: 620/1252] 10.222.0.33 () {56 vars in 1109 bytes} [Tue Sep 13 19:45:32 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 19:45:32.652995 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b3597e3-4bf5-4635-a897-af2700074d3e None admin] Authenticating user token {{(pid=82025) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:45:32.755766 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b3597e3-4bf5-4635-a897-af2700074d3e None admin] Validating token access rules against request {{(pid=82025) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:45:32.781947 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG dbcounter [-] [82025] Writing DB stats keystone:SELECT=100 {{(pid=82025) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:45:32.789543 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4c9e33e-1a1e-4422-a2b0-a09f670530d2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57539b6a6f3b4d589f5f5e1d211cd6a0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82025) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:45:32.790202 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4c9e33e-1a1e-4422-a2b0-a09f670530d2 None admin] REQUEST_METHOD: `GET` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:45:32.790487 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4c9e33e-1a1e-4422-a2b0-a09f670530d2 None admin] SCRIPT_NAME: `/identity` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:45:32.790754 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4c9e33e-1a1e-4422-a2b0-a09f670530d2 None admin] PATH_INFO: `/v3/users/placement` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:45:32.797979 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4c9e33e-1a1e-4422-a2b0-a09f670530d2 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=82025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:45:32.799695 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4c9e33e-1a1e-4422-a2b0-a09f670530d2 None admin] RBAC: Authorization granted {{(pid=82025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:45:32.810900 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application [None req-d4c9e33e-1a1e-4422-a2b0-a09f670530d2 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Sep 13 19:45:32.810900 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 19:45:32.810900 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 19:45:32.810900 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 19:45:32.810900 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 19:45:32.810900 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 19:45:32.810900 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 19:45:32.810900 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 19:45:32.810900 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 19:45:32.810900 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 19:45:32.810900 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 19:45:32.810900 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 19:45:32.810900 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 13 19:45:32.810900 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 13 19:45:32.810900 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 13 19:45:32.810900 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 13 19:45:32.812005 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 19:45:32.812005 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 19:45:32.812005 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 13 19:45:32.812005 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 13 19:45:32.812005 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 13 19:45:32.812005 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 13 19:45:32.812005 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 19:45:32.812005 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 19:45:32.812005 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 19:45:32.812005 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 19:45:32.812005 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 19:45:32.812005 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application with Lock( Sep 13 19:45:32.812005 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 19:45:32.812005 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application return self._enter() Sep 13 19:45:32.812005 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 19:45:32.812005 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 19:45:32.812005 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 19:45:32.812005 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application return self.creator() Sep 13 19:45:32.813280 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 19:45:32.813280 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application created_value = creator( Sep 13 19:45:32.813280 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 13 19:45:32.813280 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 13 19:45:32.813280 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 13 19:45:32.813280 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 13 19:45:32.813280 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 13 19:45:32.813280 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 13 19:45:32.813280 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Sep 13 19:45:32.813280 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application Sep 13 19:45:32.813280 dv-cinder-828806-6-smb devstack@keystone.service[82025]: [pid: 82025|app: 0|req: 633/1253] 10.222.0.33 () {56 vars in 1108 bytes} [Tue Sep 13 19:45:32 2022] GET /identity/v3/users/placement => generated 87 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 19:45:32.817852 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0735b829-5a5d-4e04-8eda-e37e8506abd6 None admin] Authenticating user token {{(pid=82026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:45:32.874142 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG dbcounter [-] [82026] Writing DB stats keystone:SELECT=100 {{(pid=82026) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:45:32.917810 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0735b829-5a5d-4e04-8eda-e37e8506abd6 None admin] Validating token access rules against request {{(pid=82026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:45:32.952138 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6aca2e56-9c09-45b6-aad6-d7a8c850ecea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57539b6a6f3b4d589f5f5e1d211cd6a0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:45:32.952738 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aca2e56-9c09-45b6-aad6-d7a8c850ecea None admin] REQUEST_METHOD: `GET` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:45:32.953026 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aca2e56-9c09-45b6-aad6-d7a8c850ecea None admin] SCRIPT_NAME: `/identity` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:45:32.953311 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aca2e56-9c09-45b6-aad6-d7a8c850ecea None admin] PATH_INFO: `/v3/users` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:45:32.954034 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6aca2e56-9c09-45b6-aad6-d7a8c850ecea None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=82026) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 19:45:32.954342 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6aca2e56-9c09-45b6-aad6-d7a8c850ecea None admin] RBAC: Authorizing `identity:list_users()` {{(pid=82026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:45:32.955802 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6aca2e56-9c09-45b6-aad6-d7a8c850ecea None admin] RBAC: Authorization granted {{(pid=82026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:45:32.973397 dv-cinder-828806-6-smb devstack@keystone.service[82026]: [pid: 82026|app: 0|req: 621/1254] 10.222.0.33 () {56 vars in 1143 bytes} [Tue Sep 13 19:45:32 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 19:45:32.979288 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4c9e33e-1a1e-4422-a2b0-a09f670530d2 None admin] Authenticating user token {{(pid=82025) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:45:33.079368 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4c9e33e-1a1e-4422-a2b0-a09f670530d2 None admin] Validating token access rules against request {{(pid=82025) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:45:33.112575 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5b59572-d482-4f65-96b9-ea7f028b5477 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57539b6a6f3b4d589f5f5e1d211cd6a0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82025) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:45:33.113182 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5b59572-d482-4f65-96b9-ea7f028b5477 None admin] REQUEST_METHOD: `GET` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:45:33.113468 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5b59572-d482-4f65-96b9-ea7f028b5477 None admin] SCRIPT_NAME: `/identity` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:45:33.113746 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5b59572-d482-4f65-96b9-ea7f028b5477 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:45:33.167954 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG dbcounter [-] [82025] Writing DB stats keystone:SELECT=100 {{(pid=82025) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:45:33.180082 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5b59572-d482-4f65-96b9-ea7f028b5477 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=82025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:45:33.181584 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5b59572-d482-4f65-96b9-ea7f028b5477 None admin] RBAC: Authorization granted {{(pid=82025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:45:33.278230 dv-cinder-828806-6-smb devstack@keystone.service[82025]: [pid: 82025|app: 0|req: 634/1255] 10.222.0.33 () {58 vars in 1282 bytes} [Tue Sep 13 19:45:32 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 299 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Sep 13 19:45:33.284072 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6aca2e56-9c09-45b6-aad6-d7a8c850ecea None admin] Authenticating user token {{(pid=82026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:45:33.382960 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6aca2e56-9c09-45b6-aad6-d7a8c850ecea None admin] Validating token access rules against request {{(pid=82026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:45:33.396806 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG dbcounter [-] [82026] Writing DB stats keystone:SELECT=100 {{(pid=82026) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:45:33.417204 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55f04cc9-e68f-4692-9cf4-dce085f16e41 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57539b6a6f3b4d589f5f5e1d211cd6a0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:45:33.417923 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55f04cc9-e68f-4692-9cf4-dce085f16e41 None admin] REQUEST_METHOD: `GET` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:45:33.418255 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55f04cc9-e68f-4692-9cf4-dce085f16e41 None admin] SCRIPT_NAME: `/identity` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:45:33.418478 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55f04cc9-e68f-4692-9cf4-dce085f16e41 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:45:33.428521 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55f04cc9-e68f-4692-9cf4-dce085f16e41 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=82026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:45:33.429953 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55f04cc9-e68f-4692-9cf4-dce085f16e41 None admin] RBAC: Authorization granted {{(pid=82026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:45:33.444581 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application [None req-55f04cc9-e68f-4692-9cf4-dce085f16e41 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 13 19:45:33.444581 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 19:45:33.444581 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 19:45:33.444581 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 19:45:33.444581 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 19:45:33.444581 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 19:45:33.444581 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 19:45:33.444581 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 19:45:33.444581 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 19:45:33.444581 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 19:45:33.444581 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 19:45:33.444581 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 19:45:33.444581 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 13 19:45:33.444581 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 13 19:45:33.444581 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 13 19:45:33.444581 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 13 19:45:33.445751 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 19:45:33.445751 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 19:45:33.445751 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 19:45:33.445751 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 19:45:33.445751 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 19:45:33.445751 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 19:45:33.445751 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 19:45:33.445751 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application with Lock( Sep 13 19:45:33.445751 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 19:45:33.445751 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application return self._enter() Sep 13 19:45:33.445751 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 19:45:33.445751 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 19:45:33.445751 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 19:45:33.445751 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application return self.creator() Sep 13 19:45:33.445751 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 19:45:33.445751 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application created_value = creator( Sep 13 19:45:33.445751 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 13 19:45:33.446888 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 13 19:45:33.446888 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 13 19:45:33.446888 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application Sep 13 19:45:33.446888 dv-cinder-828806-6-smb devstack@keystone.service[82026]: [pid: 82026|app: 0|req: 622/1256] 10.222.0.33 () {56 vars in 1108 bytes} [Tue Sep 13 19:45:33 2022] GET /identity/v3/domains/Default => generated 87 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 19:45:33.452205 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5b59572-d482-4f65-96b9-ea7f028b5477 None admin] Authenticating user token {{(pid=82025) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:45:33.540213 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG dbcounter [-] [82025] Writing DB stats keystone:SELECT=100 {{(pid=82025) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:45:33.552574 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5b59572-d482-4f65-96b9-ea7f028b5477 None admin] Validating token access rules against request {{(pid=82025) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:45:33.588203 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb0a38a9-a2cd-4946-90ea-46c40c33122c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57539b6a6f3b4d589f5f5e1d211cd6a0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82025) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:45:33.589279 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb0a38a9-a2cd-4946-90ea-46c40c33122c None admin] REQUEST_METHOD: `GET` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:45:33.589567 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb0a38a9-a2cd-4946-90ea-46c40c33122c None admin] SCRIPT_NAME: `/identity` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:45:33.589847 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb0a38a9-a2cd-4946-90ea-46c40c33122c None admin] PATH_INFO: `/v3/domains` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:45:33.590483 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb0a38a9-a2cd-4946-90ea-46c40c33122c None admin] RBAC: Adding query filter params (name=Default) {{(pid=82025) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 19:45:33.590826 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb0a38a9-a2cd-4946-90ea-46c40c33122c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:45:33.592270 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb0a38a9-a2cd-4946-90ea-46c40c33122c None admin] RBAC: Authorization granted {{(pid=82025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:45:33.603133 dv-cinder-828806-6-smb devstack@keystone.service[82025]: [pid: 82025|app: 0|req: 635/1257] 10.222.0.33 () {56 vars in 1109 bytes} [Tue Sep 13 19:45:33 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 19:45:33.609653 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55f04cc9-e68f-4692-9cf4-dce085f16e41 None admin] Authenticating user token {{(pid=82026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:45:33.736338 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55f04cc9-e68f-4692-9cf4-dce085f16e41 None admin] Validating token access rules against request {{(pid=82026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:45:33.770176 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-349883c2-9222-4248-9b2b-2c8d40eb9f14 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57539b6a6f3b4d589f5f5e1d211cd6a0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:45:33.770792 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-349883c2-9222-4248-9b2b-2c8d40eb9f14 None admin] REQUEST_METHOD: `GET` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:45:33.771099 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-349883c2-9222-4248-9b2b-2c8d40eb9f14 None admin] SCRIPT_NAME: `/identity` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:45:33.771375 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-349883c2-9222-4248-9b2b-2c8d40eb9f14 None admin] PATH_INFO: `/v3/projects/service` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:45:33.778018 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-349883c2-9222-4248-9b2b-2c8d40eb9f14 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=82026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:45:33.779480 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-349883c2-9222-4248-9b2b-2c8d40eb9f14 None admin] RBAC: Authorization granted {{(pid=82026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:45:33.790493 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application [None req-349883c2-9222-4248-9b2b-2c8d40eb9f14 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 13 19:45:33.790493 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 19:45:33.790493 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 19:45:33.790493 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 19:45:33.790493 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 19:45:33.790493 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 19:45:33.790493 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 19:45:33.790493 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 19:45:33.790493 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 19:45:33.790493 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 19:45:33.790493 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 19:45:33.790493 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 19:45:33.790493 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 13 19:45:33.790493 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 13 19:45:33.790493 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 13 19:45:33.792544 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 13 19:45:33.792544 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 19:45:33.792544 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 19:45:33.792544 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 19:45:33.792544 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 19:45:33.792544 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 19:45:33.792544 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 19:45:33.792544 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 19:45:33.792544 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application with Lock( Sep 13 19:45:33.792544 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 19:45:33.792544 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application return self._enter() Sep 13 19:45:33.792544 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 19:45:33.792544 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 19:45:33.792544 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 19:45:33.792544 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application return self.creator() Sep 13 19:45:33.792544 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 19:45:33.792544 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application created_value = creator( Sep 13 19:45:33.793486 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 13 19:45:33.793486 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 13 19:45:33.793486 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 13 19:45:33.793486 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 13 19:45:33.793486 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 13 19:45:33.793486 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 13 19:45:33.793486 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 13 19:45:33.793486 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application Sep 13 19:45:33.793486 dv-cinder-828806-6-smb devstack@keystone.service[82026]: [pid: 82026|app: 0|req: 623/1258] 10.222.0.33 () {56 vars in 1111 bytes} [Tue Sep 13 19:45:33 2022] GET /identity/v3/projects/service => generated 88 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 19:45:33.798266 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb0a38a9-a2cd-4946-90ea-46c40c33122c None admin] Authenticating user token {{(pid=82025) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:45:33.896688 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb0a38a9-a2cd-4946-90ea-46c40c33122c None admin] Validating token access rules against request {{(pid=82025) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:45:33.931052 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c9d910f-f7ea-4f08-bec6-3a27dfdc009d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57539b6a6f3b4d589f5f5e1d211cd6a0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82025) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:45:33.931675 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c9d910f-f7ea-4f08-bec6-3a27dfdc009d None admin] REQUEST_METHOD: `GET` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:45:33.931961 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c9d910f-f7ea-4f08-bec6-3a27dfdc009d None admin] SCRIPT_NAME: `/identity` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:45:33.932457 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c9d910f-f7ea-4f08-bec6-3a27dfdc009d None admin] PATH_INFO: `/v3/projects` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:45:33.933188 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c9d910f-f7ea-4f08-bec6-3a27dfdc009d None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=82025) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 19:45:33.933503 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c9d910f-f7ea-4f08-bec6-3a27dfdc009d None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=82025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:45:33.934963 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c9d910f-f7ea-4f08-bec6-3a27dfdc009d None admin] RBAC: Authorization granted {{(pid=82025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:45:33.946509 dv-cinder-828806-6-smb devstack@keystone.service[82025]: [pid: 82025|app: 0|req: 636/1259] 10.222.0.33 () {56 vars in 1148 bytes} [Tue Sep 13 19:45:33 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 19:45:33.953318 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-349883c2-9222-4248-9b2b-2c8d40eb9f14 None admin] Authenticating user token {{(pid=82026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:45:33.979647 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG dbcounter [-] [82026] Writing DB stats keystone:SELECT=100 {{(pid=82026) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:45:34.060969 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-349883c2-9222-4248-9b2b-2c8d40eb9f14 None admin] Validating token access rules against request {{(pid=82026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:45:34.095394 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e65e26f-156a-497d-ad05-b1d7c8496871 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57539b6a6f3b4d589f5f5e1d211cd6a0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:45:34.096090 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e65e26f-156a-497d-ad05-b1d7c8496871 None admin] REQUEST_METHOD: `GET` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:45:34.096375 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e65e26f-156a-497d-ad05-b1d7c8496871 None admin] SCRIPT_NAME: `/identity` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:45:34.096655 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e65e26f-156a-497d-ad05-b1d7c8496871 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:45:34.097391 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e65e26f-156a-497d-ad05-b1d7c8496871 None admin] RBAC: Adding query filter params (role.id=e5af7d5baa93469e9e486ef21c85474e, scope.project.id=c8c6fba0f15b4d6a84ff601919b7b8e4, user.id=060ea3dea2134429967c164bd158b272) {{(pid=82026) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 19:45:34.097706 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e65e26f-156a-497d-ad05-b1d7c8496871 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=82026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:45:34.099231 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e65e26f-156a-497d-ad05-b1d7c8496871 None admin] RBAC: Authorization granted {{(pid=82026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:45:34.105431 dv-cinder-828806-6-smb devstack@keystone.service[82026]: [pid: 82026|app: 0|req: 624/1260] 10.222.0.33 () {56 vars in 1374 bytes} [Tue Sep 13 19:45:33 2022] GET /identity/v3/role_assignments?user.id=060ea3dea2134429967c164bd158b272&scope.project.id=c8c6fba0f15b4d6a84ff601919b7b8e4&role.id=e5af7d5baa93469e9e486ef21c85474e => generated 259 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 19:45:36.216407 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-082619ae-489e-49a8-b4d8-d1689acefa78 None None] REQUEST_METHOD: `GET` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:45:36.217079 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-082619ae-489e-49a8-b4d8-d1689acefa78 None None] SCRIPT_NAME: `/identity` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:45:36.217079 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-082619ae-489e-49a8-b4d8-d1689acefa78 None None] PATH_INFO: `/` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:45:36.218349 dv-cinder-828806-6-smb devstack@keystone.service[82025]: [pid: 82025|app: 0|req: 637/1261] 10.222.0.33 () {54 vars in 927 bytes} [Tue Sep 13 19:45:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 19:45:36.223454 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fa8449f-1148-4f49-8048-ff708a5d5034 None None] REQUEST_METHOD: `POST` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:45:36.223865 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fa8449f-1148-4f49-8048-ff708a5d5034 None None] SCRIPT_NAME: `/identity` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:45:36.224014 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fa8449f-1148-4f49-8048-ff708a5d5034 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:45:36.242382 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.auth.core [None req-8fa8449f-1148-4f49-8048-ff708a5d5034 None None] MFA Rules not processed for user `57539b6a6f3b4d589f5f5e1d211cd6a0`. Rule list: `[]` (Enabled: `True`). {{(pid=82026) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 19:45:36.243596 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.common.fernet_utils [None req-8fa8449f-1148-4f49-8048-ff708a5d5034 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82026) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 19:45:36.312774 dv-cinder-828806-6-smb devstack@keystone.service[82026]: [pid: 82026|app: 0|req: 625/1262] 10.222.0.33 () {58 vars in 1024 bytes} [Tue Sep 13 19:45:36 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 13 19:45:36.590860 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-082619ae-489e-49a8-b4d8-d1689acefa78 None None] Authenticating user token {{(pid=82025) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:45:36.601716 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG dbcounter [-] [82025] Writing DB stats keystone:SELECT=100 {{(pid=82025) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:45:36.702062 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-082619ae-489e-49a8-b4d8-d1689acefa78 None None] Validating token access rules against request {{(pid=82025) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:45:36.736943 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c89272d5-d9f9-4d81-9e2d-0d8219339675 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57539b6a6f3b4d589f5f5e1d211cd6a0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82025) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:45:36.737801 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c89272d5-d9f9-4d81-9e2d-0d8219339675 None admin] REQUEST_METHOD: `GET` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:45:36.738073 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c89272d5-d9f9-4d81-9e2d-0d8219339675 None admin] SCRIPT_NAME: `/identity` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:45:36.738344 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c89272d5-d9f9-4d81-9e2d-0d8219339675 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:45:36.749297 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c89272d5-d9f9-4d81-9e2d-0d8219339675 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=82025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 13 19:45:36.754088 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application [None req-c89272d5-d9f9-4d81-9e2d-0d8219339675 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 13 19:45:36.754088 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 19:45:36.754088 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 19:45:36.754088 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 19:45:36.754088 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 19:45:36.754088 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 19:45:36.754088 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 19:45:36.754088 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 19:45:36.754088 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 19:45:36.754088 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 19:45:36.754088 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 19:45:36.754088 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 19:45:36.754088 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 13 19:45:36.754088 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 13 19:45:36.754088 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 13 19:45:36.754088 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 13 19:45:36.759131 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 13 19:45:36.759131 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 13 19:45:36.759131 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 13 19:45:36.759131 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 13 19:45:36.759131 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 19:45:36.759131 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 19:45:36.759131 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 19:45:36.759131 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 19:45:36.759131 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 19:45:36.759131 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 19:45:36.759131 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 19:45:36.759131 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application with Lock( Sep 13 19:45:36.759131 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 19:45:36.759131 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application return self._enter() Sep 13 19:45:36.759131 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 19:45:36.759131 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 19:45:36.766254 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 19:45:36.766254 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application return self.creator() Sep 13 19:45:36.766254 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 19:45:36.766254 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application created_value = creator( Sep 13 19:45:36.766254 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 13 19:45:36.766254 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 13 19:45:36.766254 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 13 19:45:36.766254 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 13 19:45:36.766254 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 13 19:45:36.766254 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 13 19:45:36.766254 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 13 19:45:36.766254 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application Sep 13 19:45:36.766254 dv-cinder-828806-6-smb devstack@keystone.service[82025]: [pid: 82025|app: 0|req: 638/1263] 10.222.0.33 () {56 vars in 1096 bytes} [Tue Sep 13 19:45:36 2022] GET /identity/v3/roles/admin => generated 83 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 19:45:36.767203 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fa8449f-1148-4f49-8048-ff708a5d5034 None None] Authenticating user token {{(pid=82026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:45:36.780131 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG dbcounter [-] [82026] Writing DB stats keystone:SELECT=100 {{(pid=82026) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:45:36.859090 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fa8449f-1148-4f49-8048-ff708a5d5034 None None] Validating token access rules against request {{(pid=82026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:45:36.893811 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c468aa66-c4d6-479d-8cac-b8bb14277023 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57539b6a6f3b4d589f5f5e1d211cd6a0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:45:36.894414 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c468aa66-c4d6-479d-8cac-b8bb14277023 None admin] REQUEST_METHOD: `GET` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:45:36.894694 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c468aa66-c4d6-479d-8cac-b8bb14277023 None admin] SCRIPT_NAME: `/identity` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:45:36.895020 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c468aa66-c4d6-479d-8cac-b8bb14277023 None admin] PATH_INFO: `/v3/roles` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:45:36.895858 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c468aa66-c4d6-479d-8cac-b8bb14277023 None admin] RBAC: Adding query filter params (name=admin) {{(pid=82026) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 19:45:36.896165 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c468aa66-c4d6-479d-8cac-b8bb14277023 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:45:36.897531 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c468aa66-c4d6-479d-8cac-b8bb14277023 None admin] RBAC: Authorization granted {{(pid=82026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:45:36.909402 dv-cinder-828806-6-smb devstack@keystone.service[82026]: [pid: 82026|app: 0|req: 626/1264] 10.222.0.33 () {56 vars in 1099 bytes} [Tue Sep 13 19:45:36 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 13 19:45:36.915329 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c89272d5-d9f9-4d81-9e2d-0d8219339675 None admin] Authenticating user token {{(pid=82025) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:45:36.984054 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG dbcounter [-] [82025] Writing DB stats keystone:SELECT=100 {{(pid=82025) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:45:37.018123 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c89272d5-d9f9-4d81-9e2d-0d8219339675 None admin] Validating token access rules against request {{(pid=82025) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:45:37.052662 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d0d6995-2145-4d78-ae1f-4da5516e0e47 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57539b6a6f3b4d589f5f5e1d211cd6a0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82025) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:45:37.053286 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d0d6995-2145-4d78-ae1f-4da5516e0e47 None admin] REQUEST_METHOD: `GET` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:45:37.053573 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d0d6995-2145-4d78-ae1f-4da5516e0e47 None admin] SCRIPT_NAME: `/identity` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:45:37.053851 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d0d6995-2145-4d78-ae1f-4da5516e0e47 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:45:37.064985 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d0d6995-2145-4d78-ae1f-4da5516e0e47 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=82025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:45:37.066429 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d0d6995-2145-4d78-ae1f-4da5516e0e47 None admin] RBAC: Authorization granted {{(pid=82025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:45:37.080650 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application [None req-1d0d6995-2145-4d78-ae1f-4da5516e0e47 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 13 19:45:37.080650 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 19:45:37.080650 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 19:45:37.080650 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 19:45:37.080650 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 19:45:37.080650 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 19:45:37.080650 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 19:45:37.080650 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 19:45:37.080650 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 19:45:37.080650 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 19:45:37.080650 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 19:45:37.080650 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 19:45:37.080650 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 13 19:45:37.080650 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 13 19:45:37.080650 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 13 19:45:37.080650 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 13 19:45:37.081735 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 19:45:37.081735 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 19:45:37.081735 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 19:45:37.081735 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 19:45:37.081735 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 19:45:37.081735 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 19:45:37.081735 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 19:45:37.081735 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application with Lock( Sep 13 19:45:37.081735 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 19:45:37.081735 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application return self._enter() Sep 13 19:45:37.081735 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 19:45:37.081735 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 19:45:37.081735 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 19:45:37.081735 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application return self.creator() Sep 13 19:45:37.081735 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 19:45:37.081735 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application created_value = creator( Sep 13 19:45:37.081735 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 13 19:45:37.082774 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 13 19:45:37.082774 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 13 19:45:37.082774 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application Sep 13 19:45:37.082774 dv-cinder-828806-6-smb devstack@keystone.service[82025]: [pid: 82025|app: 0|req: 639/1265] 10.222.0.33 () {56 vars in 1108 bytes} [Tue Sep 13 19:45:36 2022] GET /identity/v3/domains/Default => generated 87 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 19:45:37.087712 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c468aa66-c4d6-479d-8cac-b8bb14277023 None admin] Authenticating user token {{(pid=82026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:45:37.169895 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG dbcounter [-] [82026] Writing DB stats keystone:SELECT=100 {{(pid=82026) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:45:37.188440 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c468aa66-c4d6-479d-8cac-b8bb14277023 None admin] Validating token access rules against request {{(pid=82026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:45:37.220986 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e51ea928-d98b-4ead-9c19-bcf4bd77bb0d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57539b6a6f3b4d589f5f5e1d211cd6a0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:45:37.221592 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e51ea928-d98b-4ead-9c19-bcf4bd77bb0d None admin] REQUEST_METHOD: `GET` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:45:37.221872 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e51ea928-d98b-4ead-9c19-bcf4bd77bb0d None admin] SCRIPT_NAME: `/identity` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:45:37.222148 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e51ea928-d98b-4ead-9c19-bcf4bd77bb0d None admin] PATH_INFO: `/v3/domains` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:45:37.222785 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e51ea928-d98b-4ead-9c19-bcf4bd77bb0d None admin] RBAC: Adding query filter params (name=Default) {{(pid=82026) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 19:45:37.223125 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e51ea928-d98b-4ead-9c19-bcf4bd77bb0d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:45:37.224494 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e51ea928-d98b-4ead-9c19-bcf4bd77bb0d None admin] RBAC: Authorization granted {{(pid=82026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:45:37.235973 dv-cinder-828806-6-smb devstack@keystone.service[82026]: [pid: 82026|app: 0|req: 627/1266] 10.222.0.33 () {56 vars in 1109 bytes} [Tue Sep 13 19:45:37 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 19:45:37.241819 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d0d6995-2145-4d78-ae1f-4da5516e0e47 None admin] Authenticating user token {{(pid=82025) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:45:37.344134 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d0d6995-2145-4d78-ae1f-4da5516e0e47 None admin] Validating token access rules against request {{(pid=82025) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:45:37.362835 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG dbcounter [-] [82025] Writing DB stats keystone:SELECT=100 {{(pid=82025) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:45:37.376691 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f698c53-978c-45df-affb-ca6ce5a94a4a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57539b6a6f3b4d589f5f5e1d211cd6a0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82025) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:45:37.377319 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f698c53-978c-45df-affb-ca6ce5a94a4a None admin] REQUEST_METHOD: `GET` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:45:37.377604 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f698c53-978c-45df-affb-ca6ce5a94a4a None admin] SCRIPT_NAME: `/identity` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:45:37.377883 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f698c53-978c-45df-affb-ca6ce5a94a4a None admin] PATH_INFO: `/v3/users/placement` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:45:37.385807 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f698c53-978c-45df-affb-ca6ce5a94a4a None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=82025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:45:37.387384 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f698c53-978c-45df-affb-ca6ce5a94a4a None admin] RBAC: Authorization granted {{(pid=82025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:45:37.398276 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application [None req-3f698c53-978c-45df-affb-ca6ce5a94a4a None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Sep 13 19:45:37.398276 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 19:45:37.398276 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 19:45:37.398276 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 19:45:37.398276 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 19:45:37.398276 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 19:45:37.398276 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 19:45:37.398276 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 19:45:37.398276 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 19:45:37.398276 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 19:45:37.398276 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 19:45:37.398276 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 19:45:37.398276 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 13 19:45:37.398276 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 13 19:45:37.398276 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 13 19:45:37.398276 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 13 19:45:37.399409 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 19:45:37.399409 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 19:45:37.399409 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 13 19:45:37.399409 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 13 19:45:37.399409 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 13 19:45:37.399409 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 13 19:45:37.399409 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 19:45:37.399409 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 19:45:37.399409 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 19:45:37.399409 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 19:45:37.399409 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 19:45:37.399409 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application with Lock( Sep 13 19:45:37.399409 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 19:45:37.399409 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application return self._enter() Sep 13 19:45:37.399409 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 19:45:37.399409 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 19:45:37.399409 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 19:45:37.399409 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application return self.creator() Sep 13 19:45:37.400751 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 19:45:37.400751 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application created_value = creator( Sep 13 19:45:37.400751 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 13 19:45:37.400751 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 13 19:45:37.400751 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 13 19:45:37.400751 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 13 19:45:37.400751 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 13 19:45:37.400751 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 13 19:45:37.400751 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Sep 13 19:45:37.400751 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application Sep 13 19:45:37.400751 dv-cinder-828806-6-smb devstack@keystone.service[82025]: [pid: 82025|app: 0|req: 640/1267] 10.222.0.33 () {56 vars in 1108 bytes} [Tue Sep 13 19:45:37 2022] GET /identity/v3/users/placement => generated 87 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 19:45:37.406057 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e51ea928-d98b-4ead-9c19-bcf4bd77bb0d None admin] Authenticating user token {{(pid=82026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:45:37.506214 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e51ea928-d98b-4ead-9c19-bcf4bd77bb0d None admin] Validating token access rules against request {{(pid=82026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:45:37.539244 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49d0c3f0-def3-40ac-b162-61420c8e1fcc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57539b6a6f3b4d589f5f5e1d211cd6a0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:45:37.539845 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49d0c3f0-def3-40ac-b162-61420c8e1fcc None admin] REQUEST_METHOD: `GET` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:45:37.540129 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49d0c3f0-def3-40ac-b162-61420c8e1fcc None admin] SCRIPT_NAME: `/identity` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:45:37.540407 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49d0c3f0-def3-40ac-b162-61420c8e1fcc None admin] PATH_INFO: `/v3/users` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:45:37.541129 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49d0c3f0-def3-40ac-b162-61420c8e1fcc None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=82026) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 19:45:37.541438 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49d0c3f0-def3-40ac-b162-61420c8e1fcc None admin] RBAC: Authorizing `identity:list_users()` {{(pid=82026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:45:37.542919 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49d0c3f0-def3-40ac-b162-61420c8e1fcc None admin] RBAC: Authorization granted {{(pid=82026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:45:37.551990 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG dbcounter [-] [82026] Writing DB stats keystone:SELECT=100 {{(pid=82026) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:45:37.559760 dv-cinder-828806-6-smb devstack@keystone.service[82026]: [pid: 82026|app: 0|req: 628/1268] 10.222.0.33 () {56 vars in 1143 bytes} [Tue Sep 13 19:45:37 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 19:45:37.565847 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f698c53-978c-45df-affb-ca6ce5a94a4a None admin] Authenticating user token {{(pid=82025) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:45:37.665989 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f698c53-978c-45df-affb-ca6ce5a94a4a None admin] Validating token access rules against request {{(pid=82025) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:45:37.700434 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8359b2d2-2b70-4798-a7f1-5a7a02a07914 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57539b6a6f3b4d589f5f5e1d211cd6a0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82025) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:45:37.701061 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8359b2d2-2b70-4798-a7f1-5a7a02a07914 None admin] REQUEST_METHOD: `GET` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:45:37.701343 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8359b2d2-2b70-4798-a7f1-5a7a02a07914 None admin] SCRIPT_NAME: `/identity` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:45:37.701617 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8359b2d2-2b70-4798-a7f1-5a7a02a07914 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:45:37.716580 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8359b2d2-2b70-4798-a7f1-5a7a02a07914 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=82025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:45:37.718033 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8359b2d2-2b70-4798-a7f1-5a7a02a07914 None admin] RBAC: Authorization granted {{(pid=82025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:45:37.733013 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application [None req-8359b2d2-2b70-4798-a7f1-5a7a02a07914 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 13 19:45:37.733013 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 19:45:37.733013 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 19:45:37.733013 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 19:45:37.733013 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 19:45:37.733013 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 19:45:37.733013 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 19:45:37.733013 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 19:45:37.733013 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 19:45:37.733013 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 19:45:37.733013 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 19:45:37.733013 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 19:45:37.733013 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 13 19:45:37.733013 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 13 19:45:37.733013 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 13 19:45:37.733013 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 13 19:45:37.734117 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 19:45:37.734117 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 19:45:37.734117 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 19:45:37.734117 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 19:45:37.734117 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 19:45:37.734117 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 19:45:37.734117 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 19:45:37.734117 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application with Lock( Sep 13 19:45:37.734117 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 19:45:37.734117 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application return self._enter() Sep 13 19:45:37.734117 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 19:45:37.734117 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 19:45:37.734117 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 19:45:37.734117 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application return self.creator() Sep 13 19:45:37.734117 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 19:45:37.734117 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application created_value = creator( Sep 13 19:45:37.734117 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 13 19:45:37.735241 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 13 19:45:37.735241 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 13 19:45:37.735241 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application Sep 13 19:45:37.735241 dv-cinder-828806-6-smb devstack@keystone.service[82025]: [pid: 82025|app: 0|req: 641/1269] 10.222.0.33 () {56 vars in 1108 bytes} [Tue Sep 13 19:45:37 2022] GET /identity/v3/domains/Default => generated 87 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 19:45:37.740119 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49d0c3f0-def3-40ac-b162-61420c8e1fcc None admin] Authenticating user token {{(pid=82026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:45:37.843701 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49d0c3f0-def3-40ac-b162-61420c8e1fcc None admin] Validating token access rules against request {{(pid=82026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:45:37.877882 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2d985eb-035a-4aaf-93ed-54f0e758ff43 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57539b6a6f3b4d589f5f5e1d211cd6a0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:45:37.878480 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2d985eb-035a-4aaf-93ed-54f0e758ff43 None admin] REQUEST_METHOD: `GET` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:45:37.878771 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2d985eb-035a-4aaf-93ed-54f0e758ff43 None admin] SCRIPT_NAME: `/identity` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:45:37.879064 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2d985eb-035a-4aaf-93ed-54f0e758ff43 None admin] PATH_INFO: `/v3/domains` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:45:37.879710 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2d985eb-035a-4aaf-93ed-54f0e758ff43 None admin] RBAC: Adding query filter params (name=Default) {{(pid=82026) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 19:45:37.880017 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2d985eb-035a-4aaf-93ed-54f0e758ff43 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:45:37.881429 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2d985eb-035a-4aaf-93ed-54f0e758ff43 None admin] RBAC: Authorization granted {{(pid=82026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:45:37.893507 dv-cinder-828806-6-smb devstack@keystone.service[82026]: [pid: 82026|app: 0|req: 629/1270] 10.222.0.33 () {56 vars in 1109 bytes} [Tue Sep 13 19:45:37 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 13 19:45:37.899449 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8359b2d2-2b70-4798-a7f1-5a7a02a07914 None admin] Authenticating user token {{(pid=82025) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:45:37.930915 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG dbcounter [-] [82025] Writing DB stats keystone:SELECT=100 {{(pid=82025) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:45:37.999586 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8359b2d2-2b70-4798-a7f1-5a7a02a07914 None admin] Validating token access rules against request {{(pid=82025) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:45:38.046288 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f42d2991-c74d-4949-b1c4-bf96dbea7c4c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57539b6a6f3b4d589f5f5e1d211cd6a0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82025) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:45:38.046922 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f42d2991-c74d-4949-b1c4-bf96dbea7c4c None admin] REQUEST_METHOD: `GET` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:45:38.047246 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f42d2991-c74d-4949-b1c4-bf96dbea7c4c None admin] SCRIPT_NAME: `/identity` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:45:38.047526 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f42d2991-c74d-4949-b1c4-bf96dbea7c4c None admin] PATH_INFO: `/v3/projects/service` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:45:38.067099 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f42d2991-c74d-4949-b1c4-bf96dbea7c4c None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=82025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:45:38.069760 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f42d2991-c74d-4949-b1c4-bf96dbea7c4c None admin] RBAC: Authorization granted {{(pid=82025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:45:38.084369 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application [None req-f42d2991-c74d-4949-b1c4-bf96dbea7c4c None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 13 19:45:38.084369 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 19:45:38.084369 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 19:45:38.084369 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 19:45:38.084369 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 19:45:38.084369 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 19:45:38.084369 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 19:45:38.084369 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 19:45:38.084369 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 19:45:38.084369 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 19:45:38.084369 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 19:45:38.084369 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 19:45:38.084369 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 13 19:45:38.084369 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 13 19:45:38.084369 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 13 19:45:38.085490 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 13 19:45:38.085490 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 19:45:38.085490 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 19:45:38.085490 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 19:45:38.085490 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 19:45:38.085490 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 19:45:38.085490 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 19:45:38.085490 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 19:45:38.085490 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application with Lock( Sep 13 19:45:38.085490 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 19:45:38.085490 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application return self._enter() Sep 13 19:45:38.085490 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 19:45:38.085490 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 19:45:38.085490 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 19:45:38.085490 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application return self.creator() Sep 13 19:45:38.085490 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 19:45:38.085490 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application created_value = creator( Sep 13 19:45:38.086632 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 13 19:45:38.086632 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 13 19:45:38.086632 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 13 19:45:38.086632 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 13 19:45:38.086632 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 13 19:45:38.086632 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 13 19:45:38.086632 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 13 19:45:38.086632 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application Sep 13 19:45:38.087459 dv-cinder-828806-6-smb devstack@keystone.service[82025]: [pid: 82025|app: 0|req: 642/1271] 10.222.0.33 () {56 vars in 1111 bytes} [Tue Sep 13 19:45:37 2022] GET /identity/v3/projects/service => generated 88 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 19:45:38.093347 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2d985eb-035a-4aaf-93ed-54f0e758ff43 None admin] Authenticating user token {{(pid=82026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:45:38.152924 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG dbcounter [-] [82026] Writing DB stats keystone:SELECT=100 {{(pid=82026) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:45:38.195790 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2d985eb-035a-4aaf-93ed-54f0e758ff43 None admin] Validating token access rules against request {{(pid=82026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:45:38.229775 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8914c025-eba6-429f-81e8-b22daf0e213c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57539b6a6f3b4d589f5f5e1d211cd6a0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:45:38.230401 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8914c025-eba6-429f-81e8-b22daf0e213c None admin] REQUEST_METHOD: `GET` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:45:38.230717 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8914c025-eba6-429f-81e8-b22daf0e213c None admin] SCRIPT_NAME: `/identity` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:45:38.230990 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8914c025-eba6-429f-81e8-b22daf0e213c None admin] PATH_INFO: `/v3/projects` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:45:38.231705 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8914c025-eba6-429f-81e8-b22daf0e213c None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=82026) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 19:45:38.232013 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8914c025-eba6-429f-81e8-b22daf0e213c None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=82026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:45:38.233436 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8914c025-eba6-429f-81e8-b22daf0e213c None admin] RBAC: Authorization granted {{(pid=82026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:45:38.245766 dv-cinder-828806-6-smb devstack@keystone.service[82026]: [pid: 82026|app: 0|req: 630/1272] 10.222.0.33 () {56 vars in 1148 bytes} [Tue Sep 13 19:45:38 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 19:45:38.251973 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f42d2991-c74d-4949-b1c4-bf96dbea7c4c None admin] Authenticating user token {{(pid=82025) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:45:38.343405 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG dbcounter [-] [82025] Writing DB stats keystone:SELECT=100 {{(pid=82025) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:45:38.351823 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f42d2991-c74d-4949-b1c4-bf96dbea7c4c None admin] Validating token access rules against request {{(pid=82025) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:45:38.386543 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e9e8356-8bfb-4709-acc1-b7e18647674f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57539b6a6f3b4d589f5f5e1d211cd6a0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82025) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:45:38.387278 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e9e8356-8bfb-4709-acc1-b7e18647674f None admin] REQUEST_METHOD: `PUT` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:45:38.387519 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e9e8356-8bfb-4709-acc1-b7e18647674f None admin] SCRIPT_NAME: `/identity` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:45:38.387796 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e9e8356-8bfb-4709-acc1-b7e18647674f None admin] PATH_INFO: `/v3/projects/c8c6fba0f15b4d6a84ff601919b7b8e4/users/060ea3dea2134429967c164bd158b272/roles/e5af7d5baa93469e9e486ef21c85474e` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:45:38.389678 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e9e8356-8bfb-4709-acc1-b7e18647674f None admin] RBAC: Authorizing `identity:create_grant(project_id=c8c6fba0f15b4d6a84ff601919b7b8e4, user_id=060ea3dea2134429967c164bd158b272, role_id=e5af7d5baa93469e9e486ef21c85474e)` {{(pid=82025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:45:38.391136 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e9e8356-8bfb-4709-acc1-b7e18647674f None admin] RBAC: Authorization granted {{(pid=82025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:45:38.532294 dv-cinder-828806-6-smb devstack@keystone.service[82025]: [pid: 82025|app: 0|req: 643/1273] 10.222.0.33 () {58 vars in 1439 bytes} [Tue Sep 13 19:45:38 2022] PUT /identity/v3/projects/c8c6fba0f15b4d6a84ff601919b7b8e4/users/060ea3dea2134429967c164bd158b272/roles/e5af7d5baa93469e9e486ef21c85474e => generated 0 bytes in 281 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 19:45:40.656309 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e1a062a-93da-40a3-b61c-57111e90becf None None] REQUEST_METHOD: `GET` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:45:40.656842 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e1a062a-93da-40a3-b61c-57111e90becf None None] SCRIPT_NAME: `/identity` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:45:40.656842 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e1a062a-93da-40a3-b61c-57111e90becf None None] PATH_INFO: `/` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:45:40.658198 dv-cinder-828806-6-smb devstack@keystone.service[82026]: [pid: 82026|app: 0|req: 631/1274] 10.222.0.33 () {54 vars in 927 bytes} [Tue Sep 13 19:45:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 19:45:40.663400 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfe419e9-38ff-4239-a016-af95667db093 None None] REQUEST_METHOD: `POST` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:45:40.663783 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfe419e9-38ff-4239-a016-af95667db093 None None] SCRIPT_NAME: `/identity` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:45:40.663948 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfe419e9-38ff-4239-a016-af95667db093 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:45:40.681978 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.auth.core [None req-bfe419e9-38ff-4239-a016-af95667db093 None None] MFA Rules not processed for user `57539b6a6f3b4d589f5f5e1d211cd6a0`. Rule list: `[]` (Enabled: `True`). {{(pid=82025) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 19:45:40.683724 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.fernet_utils [None req-bfe419e9-38ff-4239-a016-af95667db093 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82025) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 19:45:40.750490 dv-cinder-828806-6-smb devstack@keystone.service[82025]: [pid: 82025|app: 0|req: 644/1275] 10.222.0.33 () {58 vars in 1024 bytes} [Tue Sep 13 19:45:40 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 13 19:45:41.021406 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e1a062a-93da-40a3-b61c-57111e90becf None None] Authenticating user token {{(pid=82026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:45:41.127499 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e1a062a-93da-40a3-b61c-57111e90becf None None] Validating token access rules against request {{(pid=82026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:45:41.145255 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG dbcounter [-] [82026] Writing DB stats keystone:SELECT=100 {{(pid=82026) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:45:41.161492 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f394e346-3a5a-441f-8652-58d62ca15978 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57539b6a6f3b4d589f5f5e1d211cd6a0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:45:41.162156 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f394e346-3a5a-441f-8652-58d62ca15978 None admin] REQUEST_METHOD: `GET` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:45:41.162461 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f394e346-3a5a-441f-8652-58d62ca15978 None admin] SCRIPT_NAME: `/identity` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:45:41.162775 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f394e346-3a5a-441f-8652-58d62ca15978 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:45:41.173590 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f394e346-3a5a-441f-8652-58d62ca15978 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=82026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 13 19:45:41.178711 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application [None req-f394e346-3a5a-441f-8652-58d62ca15978 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 13 19:45:41.178711 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 19:45:41.178711 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 19:45:41.178711 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 19:45:41.178711 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 19:45:41.178711 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 19:45:41.178711 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 19:45:41.178711 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 19:45:41.178711 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 19:45:41.178711 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 19:45:41.178711 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 19:45:41.178711 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 19:45:41.178711 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 13 19:45:41.178711 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 13 19:45:41.178711 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 13 19:45:41.178711 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 13 19:45:41.179935 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 13 19:45:41.179935 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 13 19:45:41.179935 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 13 19:45:41.179935 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 13 19:45:41.179935 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 19:45:41.179935 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 19:45:41.179935 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 19:45:41.179935 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 19:45:41.179935 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 19:45:41.179935 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 19:45:41.179935 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 19:45:41.179935 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application with Lock( Sep 13 19:45:41.179935 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 19:45:41.179935 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application return self._enter() Sep 13 19:45:41.179935 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 19:45:41.179935 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 19:45:41.180993 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 19:45:41.180993 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application return self.creator() Sep 13 19:45:41.180993 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 19:45:41.180993 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application created_value = creator( Sep 13 19:45:41.180993 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 13 19:45:41.180993 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 13 19:45:41.180993 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 13 19:45:41.180993 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 13 19:45:41.180993 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 13 19:45:41.180993 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 13 19:45:41.180993 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 13 19:45:41.180993 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application Sep 13 19:45:41.180993 dv-cinder-828806-6-smb devstack@keystone.service[82026]: [pid: 82026|app: 0|req: 632/1276] 10.222.0.33 () {56 vars in 1096 bytes} [Tue Sep 13 19:45:41 2022] GET /identity/v3/roles/admin => generated 83 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 19:45:41.186676 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfe419e9-38ff-4239-a016-af95667db093 None None] Authenticating user token {{(pid=82025) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:45:41.264874 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG dbcounter [-] [82025] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82025) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:45:41.282202 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfe419e9-38ff-4239-a016-af95667db093 None None] Validating token access rules against request {{(pid=82025) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:45:41.315838 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7080f079-353c-4fa6-ba09-524ef6b09e5a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57539b6a6f3b4d589f5f5e1d211cd6a0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82025) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:45:41.316440 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7080f079-353c-4fa6-ba09-524ef6b09e5a None admin] REQUEST_METHOD: `GET` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:45:41.316746 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7080f079-353c-4fa6-ba09-524ef6b09e5a None admin] SCRIPT_NAME: `/identity` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:45:41.317020 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7080f079-353c-4fa6-ba09-524ef6b09e5a None admin] PATH_INFO: `/v3/roles` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:45:41.317676 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7080f079-353c-4fa6-ba09-524ef6b09e5a None admin] RBAC: Adding query filter params (name=admin) {{(pid=82025) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 19:45:41.317979 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7080f079-353c-4fa6-ba09-524ef6b09e5a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:45:41.319363 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7080f079-353c-4fa6-ba09-524ef6b09e5a None admin] RBAC: Authorization granted {{(pid=82025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:45:41.327229 dv-cinder-828806-6-smb devstack@keystone.service[82025]: [pid: 82025|app: 0|req: 645/1277] 10.222.0.33 () {56 vars in 1099 bytes} [Tue Sep 13 19:45:41 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 19:45:41.335857 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f394e346-3a5a-441f-8652-58d62ca15978 None admin] Authenticating user token {{(pid=82026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:45:41.444756 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f394e346-3a5a-441f-8652-58d62ca15978 None admin] Validating token access rules against request {{(pid=82026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:45:41.484374 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d361ec1-b83f-4e3d-bd7f-8357e1d3a378 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57539b6a6f3b4d589f5f5e1d211cd6a0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:45:41.485011 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d361ec1-b83f-4e3d-bd7f-8357e1d3a378 None admin] REQUEST_METHOD: `GET` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:45:41.485301 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d361ec1-b83f-4e3d-bd7f-8357e1d3a378 None admin] SCRIPT_NAME: `/identity` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:45:41.485577 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d361ec1-b83f-4e3d-bd7f-8357e1d3a378 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:45:41.496967 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d361ec1-b83f-4e3d-bd7f-8357e1d3a378 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=82026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:45:41.502559 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d361ec1-b83f-4e3d-bd7f-8357e1d3a378 None admin] RBAC: Authorization granted {{(pid=82026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:45:41.515460 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application [None req-8d361ec1-b83f-4e3d-bd7f-8357e1d3a378 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 13 19:45:41.515460 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 19:45:41.515460 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 19:45:41.515460 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 19:45:41.515460 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 19:45:41.515460 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 19:45:41.515460 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 19:45:41.515460 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 19:45:41.515460 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 19:45:41.515460 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 19:45:41.515460 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 19:45:41.515460 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 19:45:41.515460 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 13 19:45:41.515460 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 13 19:45:41.515460 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 13 19:45:41.515460 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 13 19:45:41.516728 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 19:45:41.516728 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 19:45:41.516728 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 19:45:41.516728 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 19:45:41.516728 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 19:45:41.516728 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 19:45:41.516728 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 19:45:41.516728 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application with Lock( Sep 13 19:45:41.516728 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 19:45:41.516728 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application return self._enter() Sep 13 19:45:41.516728 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 19:45:41.516728 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 19:45:41.516728 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 19:45:41.516728 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application return self.creator() Sep 13 19:45:41.516728 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 19:45:41.516728 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application created_value = creator( Sep 13 19:45:41.516728 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 13 19:45:41.517695 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 13 19:45:41.517695 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 13 19:45:41.517695 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application Sep 13 19:45:41.517695 dv-cinder-828806-6-smb devstack@keystone.service[82026]: [pid: 82026|app: 0|req: 633/1278] 10.222.0.33 () {56 vars in 1108 bytes} [Tue Sep 13 19:45:41 2022] GET /identity/v3/domains/Default => generated 87 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 19:45:41.522808 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7080f079-353c-4fa6-ba09-524ef6b09e5a None admin] Authenticating user token {{(pid=82025) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:45:41.630087 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7080f079-353c-4fa6-ba09-524ef6b09e5a None admin] Validating token access rules against request {{(pid=82025) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:45:41.668736 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efd23542-526c-4e5f-b12c-bbbdaff66d6a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57539b6a6f3b4d589f5f5e1d211cd6a0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82025) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:45:41.669427 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efd23542-526c-4e5f-b12c-bbbdaff66d6a None admin] REQUEST_METHOD: `GET` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:45:41.669631 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efd23542-526c-4e5f-b12c-bbbdaff66d6a None admin] SCRIPT_NAME: `/identity` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:45:41.669906 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efd23542-526c-4e5f-b12c-bbbdaff66d6a None admin] PATH_INFO: `/v3/domains` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:45:41.670565 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efd23542-526c-4e5f-b12c-bbbdaff66d6a None admin] RBAC: Adding query filter params (name=Default) {{(pid=82025) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 19:45:41.670872 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efd23542-526c-4e5f-b12c-bbbdaff66d6a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:45:41.672286 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efd23542-526c-4e5f-b12c-bbbdaff66d6a None admin] RBAC: Authorization granted {{(pid=82025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:45:41.690951 dv-cinder-828806-6-smb devstack@keystone.service[82025]: [pid: 82025|app: 0|req: 646/1279] 10.222.0.33 () {56 vars in 1109 bytes} [Tue Sep 13 19:45:41 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 19:45:41.692201 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d361ec1-b83f-4e3d-bd7f-8357e1d3a378 None admin] Authenticating user token {{(pid=82026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:45:41.724292 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG dbcounter [-] [82026] Writing DB stats keystone:SELECT=100 {{(pid=82026) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:45:41.801571 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d361ec1-b83f-4e3d-bd7f-8357e1d3a378 None admin] Validating token access rules against request {{(pid=82026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:45:41.837413 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efbe68ff-97ec-474d-9bb9-94fef9eb5d8e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57539b6a6f3b4d589f5f5e1d211cd6a0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:45:41.838038 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efbe68ff-97ec-474d-9bb9-94fef9eb5d8e None admin] REQUEST_METHOD: `GET` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:45:41.838321 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efbe68ff-97ec-474d-9bb9-94fef9eb5d8e None admin] SCRIPT_NAME: `/identity` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:45:41.838593 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efbe68ff-97ec-474d-9bb9-94fef9eb5d8e None admin] PATH_INFO: `/v3/users/placement` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:45:41.845828 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efbe68ff-97ec-474d-9bb9-94fef9eb5d8e None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=82026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:45:41.847317 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efbe68ff-97ec-474d-9bb9-94fef9eb5d8e None admin] RBAC: Authorization granted {{(pid=82026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:45:41.860323 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application [None req-efbe68ff-97ec-474d-9bb9-94fef9eb5d8e None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Sep 13 19:45:41.860323 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 19:45:41.860323 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 19:45:41.860323 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 19:45:41.860323 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 19:45:41.860323 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 19:45:41.860323 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 19:45:41.860323 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 19:45:41.860323 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 19:45:41.860323 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 19:45:41.860323 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 19:45:41.860323 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 19:45:41.860323 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 13 19:45:41.860323 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 13 19:45:41.860323 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 13 19:45:41.860323 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 13 19:45:41.861512 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 19:45:41.861512 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 19:45:41.861512 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 13 19:45:41.861512 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 13 19:45:41.861512 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 13 19:45:41.861512 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 13 19:45:41.861512 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 19:45:41.861512 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 19:45:41.861512 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 19:45:41.861512 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 19:45:41.861512 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 19:45:41.861512 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application with Lock( Sep 13 19:45:41.861512 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 19:45:41.861512 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application return self._enter() Sep 13 19:45:41.861512 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 19:45:41.861512 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 19:45:41.861512 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 19:45:41.861512 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application return self.creator() Sep 13 19:45:41.863027 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 19:45:41.863027 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application created_value = creator( Sep 13 19:45:41.863027 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 13 19:45:41.863027 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 13 19:45:41.863027 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 13 19:45:41.863027 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 13 19:45:41.863027 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 13 19:45:41.863027 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 13 19:45:41.863027 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Sep 13 19:45:41.863027 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application Sep 13 19:45:41.863027 dv-cinder-828806-6-smb devstack@keystone.service[82026]: [pid: 82026|app: 0|req: 634/1280] 10.222.0.33 () {56 vars in 1108 bytes} [Tue Sep 13 19:45:41 2022] GET /identity/v3/users/placement => generated 87 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 19:45:41.867388 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efd23542-526c-4e5f-b12c-bbbdaff66d6a None admin] Authenticating user token {{(pid=82025) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:45:41.872452 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG dbcounter [-] [82025] Writing DB stats keystone:SELECT=100 {{(pid=82025) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:45:41.971292 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efd23542-526c-4e5f-b12c-bbbdaff66d6a None admin] Validating token access rules against request {{(pid=82025) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:45:42.006198 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f428e3f-7146-43d5-b00c-d91b8febeed1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57539b6a6f3b4d589f5f5e1d211cd6a0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82025) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:45:42.006803 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f428e3f-7146-43d5-b00c-d91b8febeed1 None admin] REQUEST_METHOD: `GET` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:45:42.007114 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f428e3f-7146-43d5-b00c-d91b8febeed1 None admin] SCRIPT_NAME: `/identity` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:45:42.007396 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f428e3f-7146-43d5-b00c-d91b8febeed1 None admin] PATH_INFO: `/v3/users` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:45:42.008120 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f428e3f-7146-43d5-b00c-d91b8febeed1 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=82025) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 19:45:42.008434 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f428e3f-7146-43d5-b00c-d91b8febeed1 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=82025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:45:42.009852 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f428e3f-7146-43d5-b00c-d91b8febeed1 None admin] RBAC: Authorization granted {{(pid=82025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:45:42.026670 dv-cinder-828806-6-smb devstack@keystone.service[82025]: [pid: 82025|app: 0|req: 647/1281] 10.222.0.33 () {56 vars in 1143 bytes} [Tue Sep 13 19:45:41 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 19:45:42.032737 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efbe68ff-97ec-474d-9bb9-94fef9eb5d8e None admin] Authenticating user token {{(pid=82026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:45:42.123488 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG dbcounter [-] [82026] Writing DB stats keystone:SELECT=100 {{(pid=82026) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:45:42.132961 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efbe68ff-97ec-474d-9bb9-94fef9eb5d8e None admin] Validating token access rules against request {{(pid=82026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:45:42.166091 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5cda07f-1b41-464e-ae72-c9855c501626 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57539b6a6f3b4d589f5f5e1d211cd6a0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:45:42.166688 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5cda07f-1b41-464e-ae72-c9855c501626 None admin] REQUEST_METHOD: `GET` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:45:42.167548 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5cda07f-1b41-464e-ae72-c9855c501626 None admin] SCRIPT_NAME: `/identity` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:45:42.167824 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5cda07f-1b41-464e-ae72-c9855c501626 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:45:42.233956 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5cda07f-1b41-464e-ae72-c9855c501626 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=82026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:45:42.235417 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5cda07f-1b41-464e-ae72-c9855c501626 None admin] RBAC: Authorization granted {{(pid=82026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:45:42.324482 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG dbcounter [-] [82026] Writing DB stats keystone:SELECT=100 {{(pid=82026) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:45:42.334314 dv-cinder-828806-6-smb devstack@keystone.service[82026]: [pid: 82026|app: 0|req: 635/1282] 10.222.0.33 () {58 vars in 1282 bytes} [Tue Sep 13 19:45:42 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 302 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Sep 13 19:45:42.340866 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f428e3f-7146-43d5-b00c-d91b8febeed1 None admin] Authenticating user token {{(pid=82025) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:45:42.401712 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG dbcounter [-] [82025] Writing DB stats keystone:SELECT=100 {{(pid=82025) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:45:42.440477 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f428e3f-7146-43d5-b00c-d91b8febeed1 None admin] Validating token access rules against request {{(pid=82025) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:45:42.486254 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d77ef5da-d60a-4455-b880-400174f776da None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57539b6a6f3b4d589f5f5e1d211cd6a0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82025) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:45:42.486801 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d77ef5da-d60a-4455-b880-400174f776da None admin] REQUEST_METHOD: `GET` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:45:42.487105 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d77ef5da-d60a-4455-b880-400174f776da None admin] SCRIPT_NAME: `/identity` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:45:42.487381 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d77ef5da-d60a-4455-b880-400174f776da None admin] PATH_INFO: `/v3/domains/Default` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:45:42.497136 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d77ef5da-d60a-4455-b880-400174f776da None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=82025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:45:42.498555 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d77ef5da-d60a-4455-b880-400174f776da None admin] RBAC: Authorization granted {{(pid=82025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:45:42.513047 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application [None req-d77ef5da-d60a-4455-b880-400174f776da None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 13 19:45:42.513047 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 19:45:42.513047 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 19:45:42.513047 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 19:45:42.513047 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 19:45:42.513047 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 19:45:42.513047 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 19:45:42.513047 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 19:45:42.513047 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 19:45:42.513047 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 19:45:42.513047 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 19:45:42.513047 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 19:45:42.513047 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 13 19:45:42.513047 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 13 19:45:42.513047 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 13 19:45:42.513047 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 13 19:45:42.514201 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 19:45:42.514201 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 19:45:42.514201 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 19:45:42.514201 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 19:45:42.514201 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 19:45:42.514201 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 19:45:42.514201 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 19:45:42.514201 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application with Lock( Sep 13 19:45:42.514201 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 19:45:42.514201 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application return self._enter() Sep 13 19:45:42.514201 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 19:45:42.514201 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 19:45:42.514201 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 19:45:42.514201 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application return self.creator() Sep 13 19:45:42.514201 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 19:45:42.514201 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application created_value = creator( Sep 13 19:45:42.514201 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 13 19:45:42.515376 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 13 19:45:42.515376 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 13 19:45:42.515376 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application Sep 13 19:45:42.515376 dv-cinder-828806-6-smb devstack@keystone.service[82025]: [pid: 82025|app: 0|req: 648/1283] 10.222.0.33 () {56 vars in 1108 bytes} [Tue Sep 13 19:45:42 2022] GET /identity/v3/domains/Default => generated 87 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 19:45:42.520082 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5cda07f-1b41-464e-ae72-c9855c501626 None admin] Authenticating user token {{(pid=82026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:45:42.618116 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5cda07f-1b41-464e-ae72-c9855c501626 None admin] Validating token access rules against request {{(pid=82026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:45:42.653352 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a126b3d9-c1b7-4440-847a-906c4219a4ea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57539b6a6f3b4d589f5f5e1d211cd6a0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:45:42.653958 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a126b3d9-c1b7-4440-847a-906c4219a4ea None admin] REQUEST_METHOD: `GET` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:45:42.654241 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a126b3d9-c1b7-4440-847a-906c4219a4ea None admin] SCRIPT_NAME: `/identity` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:45:42.654518 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a126b3d9-c1b7-4440-847a-906c4219a4ea None admin] PATH_INFO: `/v3/domains` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:45:42.655195 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a126b3d9-c1b7-4440-847a-906c4219a4ea None admin] RBAC: Adding query filter params (name=Default) {{(pid=82026) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 19:45:42.655503 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a126b3d9-c1b7-4440-847a-906c4219a4ea None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:45:42.656870 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a126b3d9-c1b7-4440-847a-906c4219a4ea None admin] RBAC: Authorization granted {{(pid=82026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:45:42.667964 dv-cinder-828806-6-smb devstack@keystone.service[82026]: [pid: 82026|app: 0|req: 636/1284] 10.222.0.33 () {56 vars in 1109 bytes} [Tue Sep 13 19:45:42 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 19:45:42.673823 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d77ef5da-d60a-4455-b880-400174f776da None admin] Authenticating user token {{(pid=82025) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:45:42.778872 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d77ef5da-d60a-4455-b880-400174f776da None admin] Validating token access rules against request {{(pid=82025) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:45:42.801535 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG dbcounter [-] [82025] Writing DB stats keystone:SELECT=100 {{(pid=82025) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:45:42.824116 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3b759b5-c270-450a-86a9-415addece433 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57539b6a6f3b4d589f5f5e1d211cd6a0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82025) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:45:42.824741 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3b759b5-c270-450a-86a9-415addece433 None admin] REQUEST_METHOD: `GET` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:45:42.825035 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3b759b5-c270-450a-86a9-415addece433 None admin] SCRIPT_NAME: `/identity` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:45:42.825294 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3b759b5-c270-450a-86a9-415addece433 None admin] PATH_INFO: `/v3/projects/service` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:45:42.831864 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3b759b5-c270-450a-86a9-415addece433 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=82025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:45:42.833290 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3b759b5-c270-450a-86a9-415addece433 None admin] RBAC: Authorization granted {{(pid=82025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:45:42.844801 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application [None req-c3b759b5-c270-450a-86a9-415addece433 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 13 19:45:42.844801 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 19:45:42.844801 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 19:45:42.844801 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 19:45:42.844801 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 19:45:42.844801 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 19:45:42.844801 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 19:45:42.844801 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 19:45:42.844801 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 19:45:42.844801 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 19:45:42.844801 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 19:45:42.844801 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 19:45:42.844801 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 13 19:45:42.844801 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 13 19:45:42.844801 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 13 19:45:42.846030 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 13 19:45:42.846030 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 19:45:42.846030 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 19:45:42.846030 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 19:45:42.846030 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 19:45:42.846030 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 19:45:42.846030 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 19:45:42.846030 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 19:45:42.846030 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application with Lock( Sep 13 19:45:42.846030 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 19:45:42.846030 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application return self._enter() Sep 13 19:45:42.846030 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 19:45:42.846030 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 19:45:42.846030 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 19:45:42.846030 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application return self.creator() Sep 13 19:45:42.846030 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 19:45:42.846030 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application created_value = creator( Sep 13 19:45:42.847064 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 13 19:45:42.847064 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 13 19:45:42.847064 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 13 19:45:42.847064 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 13 19:45:42.847064 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 13 19:45:42.847064 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 13 19:45:42.847064 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 13 19:45:42.847064 dv-cinder-828806-6-smb devstack@keystone.service[82025]: ERROR keystone.server.flask.application Sep 13 19:45:42.847064 dv-cinder-828806-6-smb devstack@keystone.service[82025]: [pid: 82025|app: 0|req: 649/1285] 10.222.0.33 () {56 vars in 1111 bytes} [Tue Sep 13 19:45:42 2022] GET /identity/v3/projects/service => generated 88 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 19:45:42.852407 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a126b3d9-c1b7-4440-847a-906c4219a4ea None admin] Authenticating user token {{(pid=82026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:45:42.902822 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG dbcounter [-] [82026] Writing DB stats keystone:SELECT=100 {{(pid=82026) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:45:42.952276 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a126b3d9-c1b7-4440-847a-906c4219a4ea None admin] Validating token access rules against request {{(pid=82026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:45:42.985318 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f3a5c36-8efc-41ca-9699-539c89e7d728 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57539b6a6f3b4d589f5f5e1d211cd6a0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:45:42.985924 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f3a5c36-8efc-41ca-9699-539c89e7d728 None admin] REQUEST_METHOD: `GET` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:45:42.986211 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f3a5c36-8efc-41ca-9699-539c89e7d728 None admin] SCRIPT_NAME: `/identity` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:45:42.986492 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f3a5c36-8efc-41ca-9699-539c89e7d728 None admin] PATH_INFO: `/v3/projects` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:45:42.987243 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f3a5c36-8efc-41ca-9699-539c89e7d728 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=82026) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 19:45:42.987557 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f3a5c36-8efc-41ca-9699-539c89e7d728 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=82026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:45:42.989007 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f3a5c36-8efc-41ca-9699-539c89e7d728 None admin] RBAC: Authorization granted {{(pid=82026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:45:43.001354 dv-cinder-828806-6-smb devstack@keystone.service[82026]: [pid: 82026|app: 0|req: 637/1286] 10.222.0.33 () {56 vars in 1148 bytes} [Tue Sep 13 19:45:42 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 19:45:43.007735 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3b759b5-c270-450a-86a9-415addece433 None admin] Authenticating user token {{(pid=82025) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:45:43.107240 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3b759b5-c270-450a-86a9-415addece433 None admin] Validating token access rules against request {{(pid=82025) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:45:43.141605 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4d4ca46-5503-444b-bbcb-7b5703dfea03 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57539b6a6f3b4d589f5f5e1d211cd6a0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82025) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:45:43.142207 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4d4ca46-5503-444b-bbcb-7b5703dfea03 None admin] REQUEST_METHOD: `GET` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:45:43.142490 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4d4ca46-5503-444b-bbcb-7b5703dfea03 None admin] SCRIPT_NAME: `/identity` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:45:43.142767 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4d4ca46-5503-444b-bbcb-7b5703dfea03 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:45:43.143511 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4d4ca46-5503-444b-bbcb-7b5703dfea03 None admin] RBAC: Adding query filter params (role.id=e5af7d5baa93469e9e486ef21c85474e, scope.project.id=c8c6fba0f15b4d6a84ff601919b7b8e4, user.id=060ea3dea2134429967c164bd158b272) {{(pid=82025) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 19:45:43.143819 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4d4ca46-5503-444b-bbcb-7b5703dfea03 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=82025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:45:43.145228 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4d4ca46-5503-444b-bbcb-7b5703dfea03 None admin] RBAC: Authorization granted {{(pid=82025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:45:43.151074 dv-cinder-828806-6-smb devstack@keystone.service[82025]: [pid: 82025|app: 0|req: 650/1287] 10.222.0.33 () {56 vars in 1374 bytes} [Tue Sep 13 19:45:43 2022] GET /identity/v3/role_assignments?user.id=060ea3dea2134429967c164bd158b272&scope.project.id=c8c6fba0f15b4d6a84ff601919b7b8e4&role.id=e5af7d5baa93469e9e486ef21c85474e => generated 608 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 19:45:45.310221 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b77382c-7d78-4a2a-9977-072c9df006ba None None] REQUEST_METHOD: `GET` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:45:45.310717 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b77382c-7d78-4a2a-9977-072c9df006ba None None] SCRIPT_NAME: `/identity` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:45:45.310820 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b77382c-7d78-4a2a-9977-072c9df006ba None None] PATH_INFO: `/` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:45:45.312313 dv-cinder-828806-6-smb devstack@keystone.service[82026]: [pid: 82026|app: 0|req: 638/1288] 10.222.0.33 () {54 vars in 927 bytes} [Tue Sep 13 19:45:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 19:45:45.317309 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e4d8f5c-34bd-458a-ab3e-74cfe243d2a4 None None] REQUEST_METHOD: `POST` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:45:45.317734 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e4d8f5c-34bd-458a-ab3e-74cfe243d2a4 None None] SCRIPT_NAME: `/identity` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:45:45.317908 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e4d8f5c-34bd-458a-ab3e-74cfe243d2a4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:45:45.336642 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.auth.core [None req-4e4d8f5c-34bd-458a-ab3e-74cfe243d2a4 None None] MFA Rules not processed for user `57539b6a6f3b4d589f5f5e1d211cd6a0`. Rule list: `[]` (Enabled: `True`). {{(pid=82025) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 19:45:45.337835 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.fernet_utils [None req-4e4d8f5c-34bd-458a-ab3e-74cfe243d2a4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82025) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 19:45:45.366882 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG dbcounter [-] [82025] Writing DB stats keystone:SELECT=100 {{(pid=82025) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:45:45.404159 dv-cinder-828806-6-smb devstack@keystone.service[82025]: [pid: 82025|app: 0|req: 651/1289] 10.222.0.33 () {58 vars in 1024 bytes} [Tue Sep 13 19:45:45 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 13 19:45:45.677802 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b77382c-7d78-4a2a-9977-072c9df006ba None None] Authenticating user token {{(pid=82026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:45:45.780925 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b77382c-7d78-4a2a-9977-072c9df006ba None None] Validating token access rules against request {{(pid=82026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:45:45.791285 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG dbcounter [-] [82026] Writing DB stats keystone:SELECT=100 {{(pid=82026) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:45:45.816066 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01064576-45c3-4152-96af-41b16df5ebbd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57539b6a6f3b4d589f5f5e1d211cd6a0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:45:45.816645 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01064576-45c3-4152-96af-41b16df5ebbd None admin] REQUEST_METHOD: `GET` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:45:45.819098 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01064576-45c3-4152-96af-41b16df5ebbd None admin] SCRIPT_NAME: `/identity` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:45:45.819098 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01064576-45c3-4152-96af-41b16df5ebbd None admin] PATH_INFO: `/v3/services/placement` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:45:45.819098 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01064576-45c3-4152-96af-41b16df5ebbd None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=82026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:45:45.819098 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01064576-45c3-4152-96af-41b16df5ebbd None admin] RBAC: Authorization granted {{(pid=82026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:45:45.830094 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application [None req-01064576-45c3-4152-96af-41b16df5ebbd None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Sep 13 19:45:45.830094 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 19:45:45.830094 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 13 19:45:45.830094 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 13 19:45:45.830094 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 13 19:45:45.830094 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 13 19:45:45.830094 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 13 19:45:45.830094 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 13 19:45:45.830094 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Sep 13 19:45:45.830094 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application Sep 13 19:45:45.830094 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 13 19:45:45.830094 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application Sep 13 19:45:45.830094 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 19:45:45.830094 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 19:45:45.830094 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 19:45:45.830094 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 19:45:45.830094 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 19:45:45.833279 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 19:45:45.833279 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 19:45:45.833279 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 19:45:45.833279 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 19:45:45.833279 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 19:45:45.833279 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 19:45:45.833279 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 13 19:45:45.833279 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 13 19:45:45.833279 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 13 19:45:45.833279 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 13 19:45:45.833279 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 19:45:45.833279 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 19:45:45.833279 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 19:45:45.833279 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 19:45:45.833279 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 19:45:45.833279 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 19:45:45.834347 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 19:45:45.834347 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application with Lock( Sep 13 19:45:45.834347 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 19:45:45.834347 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application return self._enter() Sep 13 19:45:45.834347 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 19:45:45.834347 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 19:45:45.834347 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 19:45:45.834347 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application return self.creator() Sep 13 19:45:45.834347 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 19:45:45.834347 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application created_value = creator( Sep 13 19:45:45.834347 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 13 19:45:45.834347 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 13 19:45:45.834347 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Sep 13 19:45:45.834347 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application Sep 13 19:45:45.834347 dv-cinder-828806-6-smb devstack@keystone.service[82026]: [pid: 82026|app: 0|req: 639/1290] 10.222.0.33 () {56 vars in 1117 bytes} [Tue Sep 13 19:45:45 2022] GET /identity/v3/services/placement => generated 90 bytes in 154 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 19:45:45.837172 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e4d8f5c-34bd-458a-ab3e-74cfe243d2a4 None None] Authenticating user token {{(pid=82025) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:45:45.937335 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e4d8f5c-34bd-458a-ab3e-74cfe243d2a4 None None] Validating token access rules against request {{(pid=82025) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:45:45.972435 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5883c57e-85ec-42f0-8c84-ae076ea77a29 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57539b6a6f3b4d589f5f5e1d211cd6a0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82025) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:45:45.973041 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5883c57e-85ec-42f0-8c84-ae076ea77a29 None admin] REQUEST_METHOD: `GET` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:45:45.973339 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5883c57e-85ec-42f0-8c84-ae076ea77a29 None admin] SCRIPT_NAME: `/identity` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:45:45.973617 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5883c57e-85ec-42f0-8c84-ae076ea77a29 None admin] PATH_INFO: `/v3/services` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:45:45.974260 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5883c57e-85ec-42f0-8c84-ae076ea77a29 None admin] RBAC: Adding query filter params (name=placement) {{(pid=82025) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 19:45:45.974552 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5883c57e-85ec-42f0-8c84-ae076ea77a29 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=82025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:45:45.975948 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5883c57e-85ec-42f0-8c84-ae076ea77a29 None admin] RBAC: Authorization granted {{(pid=82025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:45:45.981328 dv-cinder-828806-6-smb devstack@keystone.service[82025]: [pid: 82025|app: 0|req: 652/1291] 10.222.0.33 () {56 vars in 1116 bytes} [Tue Sep 13 19:45:45 2022] GET /identity/v3/services?name=placement => generated 126 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 19:45:45.987486 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01064576-45c3-4152-96af-41b16df5ebbd None admin] Authenticating user token {{(pid=82026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:45:46.087434 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01064576-45c3-4152-96af-41b16df5ebbd None admin] Validating token access rules against request {{(pid=82026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:45:46.121071 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34d54a05-fe46-48ce-a706-8846a421befa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57539b6a6f3b4d589f5f5e1d211cd6a0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:45:46.121662 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34d54a05-fe46-48ce-a706-8846a421befa None admin] REQUEST_METHOD: `GET` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:45:46.121944 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34d54a05-fe46-48ce-a706-8846a421befa None admin] SCRIPT_NAME: `/identity` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:45:46.122219 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34d54a05-fe46-48ce-a706-8846a421befa None admin] PATH_INFO: `/v3/services` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:45:46.122874 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34d54a05-fe46-48ce-a706-8846a421befa None admin] RBAC: Adding query filter params (type=placement) {{(pid=82026) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 19:45:46.123257 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34d54a05-fe46-48ce-a706-8846a421befa None admin] RBAC: Authorizing `identity:list_services()` {{(pid=82026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:45:46.124663 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34d54a05-fe46-48ce-a706-8846a421befa None admin] RBAC: Authorization granted {{(pid=82026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:45:46.129113 dv-cinder-828806-6-smb devstack@keystone.service[82026]: [pid: 82026|app: 0|req: 640/1292] 10.222.0.33 () {56 vars in 1116 bytes} [Tue Sep 13 19:45:45 2022] GET /identity/v3/services?type=placement => generated 126 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 19:45:48.293949 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d4faae8-e11d-4732-918b-f97e2ec2d664 None None] REQUEST_METHOD: `GET` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:45:48.294430 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d4faae8-e11d-4732-918b-f97e2ec2d664 None None] SCRIPT_NAME: `/identity` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:45:48.294524 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d4faae8-e11d-4732-918b-f97e2ec2d664 None None] PATH_INFO: `/` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:45:48.295979 dv-cinder-828806-6-smb devstack@keystone.service[82025]: [pid: 82025|app: 0|req: 653/1293] 10.222.0.33 () {54 vars in 927 bytes} [Tue Sep 13 19:45:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 19:45:48.301802 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-980c7c74-ba3f-49d6-8c5d-6fee1d985c55 None None] REQUEST_METHOD: `POST` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:45:48.302234 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-980c7c74-ba3f-49d6-8c5d-6fee1d985c55 None None] SCRIPT_NAME: `/identity` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:45:48.302355 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-980c7c74-ba3f-49d6-8c5d-6fee1d985c55 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:45:48.321168 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.auth.core [None req-980c7c74-ba3f-49d6-8c5d-6fee1d985c55 None None] MFA Rules not processed for user `57539b6a6f3b4d589f5f5e1d211cd6a0`. Rule list: `[]` (Enabled: `True`). {{(pid=82026) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 19:45:48.322379 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.common.fernet_utils [None req-980c7c74-ba3f-49d6-8c5d-6fee1d985c55 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82026) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 19:45:48.355015 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG dbcounter [-] [82026] Writing DB stats keystone:SELECT=100 {{(pid=82026) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:45:48.392248 dv-cinder-828806-6-smb devstack@keystone.service[82026]: [pid: 82026|app: 0|req: 641/1294] 10.222.0.33 () {58 vars in 1024 bytes} [Tue Sep 13 19:45:48 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 13 19:45:48.670647 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d4faae8-e11d-4732-918b-f97e2ec2d664 None None] Authenticating user token {{(pid=82025) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:45:48.704025 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG dbcounter [-] [82025] Writing DB stats keystone:SELECT=100 {{(pid=82025) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:45:48.775155 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d4faae8-e11d-4732-918b-f97e2ec2d664 None None] Validating token access rules against request {{(pid=82025) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:45:48.811978 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11b58824-5842-4fc2-81f8-ebe223b46fcb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57539b6a6f3b4d589f5f5e1d211cd6a0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82025) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:45:48.812577 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11b58824-5842-4fc2-81f8-ebe223b46fcb None admin] REQUEST_METHOD: `POST` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:45:48.812859 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11b58824-5842-4fc2-81f8-ebe223b46fcb None admin] SCRIPT_NAME: `/identity` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:45:48.813137 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11b58824-5842-4fc2-81f8-ebe223b46fcb None admin] PATH_INFO: `/v3/services` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:45:48.813856 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11b58824-5842-4fc2-81f8-ebe223b46fcb None admin] RBAC: Authorizing `identity:create_service()` {{(pid=82025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:45:48.815254 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11b58824-5842-4fc2-81f8-ebe223b46fcb None admin] RBAC: Authorization granted {{(pid=82025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:45:48.932096 dv-cinder-828806-6-smb devstack@keystone.service[82025]: [pid: 82025|app: 0|req: 654/1295] 10.222.0.33 () {60 vars in 1141 bytes} [Tue Sep 13 19:45:48 2022] POST /identity/v3/services => generated 246 bytes in 262 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 13 19:45:51.125471 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4cafdfe-d63a-44de-99b2-c23f95e484ff None None] REQUEST_METHOD: `GET` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:45:51.126005 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4cafdfe-d63a-44de-99b2-c23f95e484ff None None] SCRIPT_NAME: `/identity` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:45:51.126099 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4cafdfe-d63a-44de-99b2-c23f95e484ff None None] PATH_INFO: `/` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:45:51.127491 dv-cinder-828806-6-smb devstack@keystone.service[82026]: [pid: 82026|app: 0|req: 642/1296] 10.222.0.33 () {54 vars in 927 bytes} [Tue Sep 13 19:45:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 19:45:51.132973 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a6afc5d-148f-4b88-8fec-516a80b52bbb None None] REQUEST_METHOD: `POST` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:45:51.133375 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a6afc5d-148f-4b88-8fec-516a80b52bbb None None] SCRIPT_NAME: `/identity` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:45:51.133537 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a6afc5d-148f-4b88-8fec-516a80b52bbb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:45:51.151683 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.auth.core [None req-0a6afc5d-148f-4b88-8fec-516a80b52bbb None None] MFA Rules not processed for user `57539b6a6f3b4d589f5f5e1d211cd6a0`. Rule list: `[]` (Enabled: `True`). {{(pid=82025) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 19:45:51.153391 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.fernet_utils [None req-0a6afc5d-148f-4b88-8fec-516a80b52bbb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82025) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 19:45:51.226942 dv-cinder-828806-6-smb devstack@keystone.service[82025]: [pid: 82025|app: 0|req: 655/1297] 10.222.0.33 () {58 vars in 1024 bytes} [Tue Sep 13 19:45:51 2022] POST /identity/v3/auth/tokens => generated 2221 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 13 19:45:51.500988 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4cafdfe-d63a-44de-99b2-c23f95e484ff None None] Authenticating user token {{(pid=82026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:45:51.601188 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4cafdfe-d63a-44de-99b2-c23f95e484ff None None] Validating token access rules against request {{(pid=82026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:45:51.633326 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc62abf5-fcd3-4115-b81e-e9647ed88d7f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57539b6a6f3b4d589f5f5e1d211cd6a0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:45:51.633985 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc62abf5-fcd3-4115-b81e-e9647ed88d7f None admin] REQUEST_METHOD: `GET` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:45:51.634365 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc62abf5-fcd3-4115-b81e-e9647ed88d7f None admin] SCRIPT_NAME: `/identity` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:45:51.634643 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc62abf5-fcd3-4115-b81e-e9647ed88d7f None admin] PATH_INFO: `/v3/services/placement` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:45:51.635253 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc62abf5-fcd3-4115-b81e-e9647ed88d7f None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=82026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:45:51.637208 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc62abf5-fcd3-4115-b81e-e9647ed88d7f None admin] RBAC: Authorization granted {{(pid=82026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:45:51.645836 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application [None req-fc62abf5-fcd3-4115-b81e-e9647ed88d7f None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Sep 13 19:45:51.645836 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 19:45:51.645836 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 13 19:45:51.645836 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 13 19:45:51.645836 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 13 19:45:51.645836 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 13 19:45:51.645836 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 13 19:45:51.645836 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 13 19:45:51.645836 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Sep 13 19:45:51.645836 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application Sep 13 19:45:51.645836 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 13 19:45:51.645836 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application Sep 13 19:45:51.645836 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 19:45:51.645836 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 19:45:51.645836 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 19:45:51.645836 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 19:45:51.645836 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 19:45:51.647066 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 19:45:51.647066 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 19:45:51.647066 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 19:45:51.647066 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 19:45:51.647066 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 19:45:51.647066 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 19:45:51.647066 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 13 19:45:51.647066 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 13 19:45:51.647066 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 13 19:45:51.647066 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 13 19:45:51.647066 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 19:45:51.647066 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 19:45:51.647066 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 19:45:51.647066 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 19:45:51.647066 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 19:45:51.647066 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 19:45:51.655149 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 19:45:51.655149 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application with Lock( Sep 13 19:45:51.655149 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 19:45:51.655149 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application return self._enter() Sep 13 19:45:51.655149 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 19:45:51.655149 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 19:45:51.655149 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 19:45:51.655149 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application return self.creator() Sep 13 19:45:51.655149 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 19:45:51.655149 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application created_value = creator( Sep 13 19:45:51.655149 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 13 19:45:51.655149 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 13 19:45:51.655149 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Sep 13 19:45:51.655149 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application Sep 13 19:45:51.655149 dv-cinder-828806-6-smb devstack@keystone.service[82026]: [pid: 82026|app: 0|req: 643/1298] 10.222.0.33 () {56 vars in 1117 bytes} [Tue Sep 13 19:45:51 2022] GET /identity/v3/services/placement => generated 90 bytes in 147 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 19:45:51.656227 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a6afc5d-148f-4b88-8fec-516a80b52bbb None None] Authenticating user token {{(pid=82025) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:45:51.672375 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG dbcounter [-] [82025] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82025) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:45:51.765914 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a6afc5d-148f-4b88-8fec-516a80b52bbb None None] Validating token access rules against request {{(pid=82025) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:45:51.804717 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98685cf4-2055-4e90-90a2-df2ed9f57e34 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57539b6a6f3b4d589f5f5e1d211cd6a0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82025) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:45:51.805312 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98685cf4-2055-4e90-90a2-df2ed9f57e34 None admin] REQUEST_METHOD: `GET` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:45:51.805593 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98685cf4-2055-4e90-90a2-df2ed9f57e34 None admin] SCRIPT_NAME: `/identity` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:45:51.805867 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98685cf4-2055-4e90-90a2-df2ed9f57e34 None admin] PATH_INFO: `/v3/services` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:45:51.806491 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98685cf4-2055-4e90-90a2-df2ed9f57e34 None admin] RBAC: Adding query filter params (name=placement) {{(pid=82025) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 19:45:51.806793 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98685cf4-2055-4e90-90a2-df2ed9f57e34 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=82025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:45:51.808303 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98685cf4-2055-4e90-90a2-df2ed9f57e34 None admin] RBAC: Authorization granted {{(pid=82025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:45:51.813245 dv-cinder-828806-6-smb devstack@keystone.service[82025]: [pid: 82025|app: 0|req: 656/1299] 10.222.0.33 () {56 vars in 1116 bytes} [Tue Sep 13 19:45:51 2022] GET /identity/v3/services?name=placement => generated 358 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 19:45:51.820025 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc62abf5-fcd3-4115-b81e-e9647ed88d7f None admin] Authenticating user token {{(pid=82026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:45:51.852318 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG dbcounter [-] [82026] Writing DB stats keystone:SELECT=100 {{(pid=82026) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:45:51.919985 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc62abf5-fcd3-4115-b81e-e9647ed88d7f None admin] Validating token access rules against request {{(pid=82026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:45:51.954551 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04b0a34b-5819-4b9f-bef8-f86a06ac9a5e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57539b6a6f3b4d589f5f5e1d211cd6a0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:45:51.955174 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04b0a34b-5819-4b9f-bef8-f86a06ac9a5e None admin] REQUEST_METHOD: `GET` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:45:51.955488 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04b0a34b-5819-4b9f-bef8-f86a06ac9a5e None admin] SCRIPT_NAME: `/identity` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:45:51.955802 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04b0a34b-5819-4b9f-bef8-f86a06ac9a5e None admin] PATH_INFO: `/v3/endpoints` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:45:51.956505 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04b0a34b-5819-4b9f-bef8-f86a06ac9a5e None admin] RBAC: Adding query filter params (interface=public, service_id=dc991c8e87d548f6a3e4c15beac2b462, region_id=RegionOne) {{(pid=82026) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 19:45:51.956817 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04b0a34b-5819-4b9f-bef8-f86a06ac9a5e None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=82026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:45:51.958187 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04b0a34b-5819-4b9f-bef8-f86a06ac9a5e None admin] RBAC: Authorization granted {{(pid=82026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:45:51.963215 dv-cinder-828806-6-smb devstack@keystone.service[82026]: [pid: 82026|app: 0|req: 644/1300] 10.222.0.33 () {56 vars in 1251 bytes} [Tue Sep 13 19:45:51 2022] GET /identity/v3/endpoints?service_id=dc991c8e87d548f6a3e4c15beac2b462&interface=public®ion_id=RegionOne => generated 194 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 19:45:51.968914 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98685cf4-2055-4e90-90a2-df2ed9f57e34 None admin] Authenticating user token {{(pid=82025) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:45:52.049937 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG dbcounter [-] [82025] Writing DB stats keystone:SELECT=100 {{(pid=82025) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:45:52.067579 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98685cf4-2055-4e90-90a2-df2ed9f57e34 None admin] Validating token access rules against request {{(pid=82025) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:45:52.100916 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d81729f-7b46-46be-be20-fb98302bd0c1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57539b6a6f3b4d589f5f5e1d211cd6a0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82025) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:45:52.101524 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d81729f-7b46-46be-be20-fb98302bd0c1 None admin] REQUEST_METHOD: `GET` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:45:52.101805 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d81729f-7b46-46be-be20-fb98302bd0c1 None admin] SCRIPT_NAME: `/identity` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:45:52.102131 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d81729f-7b46-46be-be20-fb98302bd0c1 None admin] PATH_INFO: `/v3/services` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:45:52.102740 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d81729f-7b46-46be-be20-fb98302bd0c1 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=82025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:45:52.104144 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d81729f-7b46-46be-be20-fb98302bd0c1 None admin] RBAC: Authorization granted {{(pid=82025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:45:52.112749 dv-cinder-828806-6-smb devstack@keystone.service[82025]: [pid: 82025|app: 0|req: 657/1301] 10.222.0.33 () {56 vars in 1087 bytes} [Tue Sep 13 19:45:51 2022] GET /identity/v3/services => generated 2191 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 13 19:45:54.279510 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4374c0a1-5603-497b-8b2c-91bff96f6e20 None None] REQUEST_METHOD: `GET` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:45:54.280066 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4374c0a1-5603-497b-8b2c-91bff96f6e20 None None] SCRIPT_NAME: `/identity` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:45:54.280066 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4374c0a1-5603-497b-8b2c-91bff96f6e20 None None] PATH_INFO: `/` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:45:54.281411 dv-cinder-828806-6-smb devstack@keystone.service[82026]: [pid: 82026|app: 0|req: 645/1302] 10.222.0.33 () {54 vars in 927 bytes} [Tue Sep 13 19:45:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 19:45:54.286811 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6bdee24-a009-43ee-8e8b-4d7e354b7cc7 None None] REQUEST_METHOD: `POST` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:45:54.287279 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6bdee24-a009-43ee-8e8b-4d7e354b7cc7 None None] SCRIPT_NAME: `/identity` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:45:54.287402 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6bdee24-a009-43ee-8e8b-4d7e354b7cc7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:45:54.306407 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.auth.core [None req-d6bdee24-a009-43ee-8e8b-4d7e354b7cc7 None None] MFA Rules not processed for user `57539b6a6f3b4d589f5f5e1d211cd6a0`. Rule list: `[]` (Enabled: `True`). {{(pid=82025) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 19:45:54.307667 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.fernet_utils [None req-d6bdee24-a009-43ee-8e8b-4d7e354b7cc7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82025) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 19:45:54.373027 dv-cinder-828806-6-smb devstack@keystone.service[82025]: [pid: 82025|app: 0|req: 658/1303] 10.222.0.33 () {58 vars in 1024 bytes} [Tue Sep 13 19:45:54 2022] POST /identity/v3/auth/tokens => generated 2221 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 13 19:45:54.651873 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4374c0a1-5603-497b-8b2c-91bff96f6e20 None None] Authenticating user token {{(pid=82026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:45:54.747366 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG dbcounter [-] [82026] Writing DB stats keystone:SELECT=100 {{(pid=82026) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:45:54.753878 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4374c0a1-5603-497b-8b2c-91bff96f6e20 None None] Validating token access rules against request {{(pid=82026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:45:54.788620 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a9990c7-9aef-48c1-8b11-a3780090934d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57539b6a6f3b4d589f5f5e1d211cd6a0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:45:54.789248 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a9990c7-9aef-48c1-8b11-a3780090934d None admin] REQUEST_METHOD: `GET` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:45:54.789531 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a9990c7-9aef-48c1-8b11-a3780090934d None admin] SCRIPT_NAME: `/identity` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:45:54.789806 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a9990c7-9aef-48c1-8b11-a3780090934d None admin] PATH_INFO: `/v3/services/placement` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:45:54.790388 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a9990c7-9aef-48c1-8b11-a3780090934d None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=82026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:45:54.791817 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a9990c7-9aef-48c1-8b11-a3780090934d None admin] RBAC: Authorization granted {{(pid=82026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:45:54.802544 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application [None req-0a9990c7-9aef-48c1-8b11-a3780090934d None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Sep 13 19:45:54.802544 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 19:45:54.802544 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 13 19:45:54.802544 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 13 19:45:54.802544 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 13 19:45:54.802544 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 13 19:45:54.802544 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 13 19:45:54.802544 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 13 19:45:54.802544 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Sep 13 19:45:54.802544 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application Sep 13 19:45:54.802544 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 13 19:45:54.802544 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application Sep 13 19:45:54.802544 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 19:45:54.802544 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 19:45:54.802544 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 19:45:54.802544 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 19:45:54.802544 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 19:45:54.803831 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 19:45:54.803831 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 19:45:54.803831 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 19:45:54.803831 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 19:45:54.803831 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 19:45:54.803831 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 19:45:54.803831 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 13 19:45:54.803831 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 13 19:45:54.803831 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 13 19:45:54.803831 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 13 19:45:54.803831 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 19:45:54.803831 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 19:45:54.803831 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 19:45:54.803831 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 19:45:54.803831 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 19:45:54.803831 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 19:45:54.804992 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 19:45:54.804992 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application with Lock( Sep 13 19:45:54.804992 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 19:45:54.804992 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application return self._enter() Sep 13 19:45:54.804992 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 19:45:54.804992 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 19:45:54.804992 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 19:45:54.804992 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application return self.creator() Sep 13 19:45:54.804992 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 19:45:54.804992 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application created_value = creator( Sep 13 19:45:54.804992 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 13 19:45:54.804992 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 13 19:45:54.804992 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Sep 13 19:45:54.804992 dv-cinder-828806-6-smb devstack@keystone.service[82026]: ERROR keystone.server.flask.application Sep 13 19:45:54.804992 dv-cinder-828806-6-smb devstack@keystone.service[82026]: [pid: 82026|app: 0|req: 646/1304] 10.222.0.33 () {56 vars in 1117 bytes} [Tue Sep 13 19:45:54 2022] GET /identity/v3/services/placement => generated 90 bytes in 153 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 19:45:54.812612 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6bdee24-a009-43ee-8e8b-4d7e354b7cc7 None None] Authenticating user token {{(pid=82025) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:45:54.896021 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG dbcounter [-] [82025] Writing DB stats keystone:SELECT=100 {{(pid=82025) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:45:54.919845 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6bdee24-a009-43ee-8e8b-4d7e354b7cc7 None None] Validating token access rules against request {{(pid=82025) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:45:54.955995 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e5329a4-0d2f-4462-90c4-2c9e37a7aec2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57539b6a6f3b4d589f5f5e1d211cd6a0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82025) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:45:54.956604 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e5329a4-0d2f-4462-90c4-2c9e37a7aec2 None admin] REQUEST_METHOD: `GET` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:45:54.956887 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e5329a4-0d2f-4462-90c4-2c9e37a7aec2 None admin] SCRIPT_NAME: `/identity` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:45:54.957166 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e5329a4-0d2f-4462-90c4-2c9e37a7aec2 None admin] PATH_INFO: `/v3/services` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:45:54.957790 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e5329a4-0d2f-4462-90c4-2c9e37a7aec2 None admin] RBAC: Adding query filter params (name=placement) {{(pid=82025) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 19:45:54.958100 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e5329a4-0d2f-4462-90c4-2c9e37a7aec2 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=82025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:45:54.959496 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e5329a4-0d2f-4462-90c4-2c9e37a7aec2 None admin] RBAC: Authorization granted {{(pid=82025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:45:54.964522 dv-cinder-828806-6-smb devstack@keystone.service[82025]: [pid: 82025|app: 0|req: 659/1305] 10.222.0.33 () {56 vars in 1116 bytes} [Tue Sep 13 19:45:54 2022] GET /identity/v3/services?name=placement => generated 358 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 19:45:54.970784 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a9990c7-9aef-48c1-8b11-a3780090934d None admin] Authenticating user token {{(pid=82026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:45:55.069152 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a9990c7-9aef-48c1-8b11-a3780090934d None admin] Validating token access rules against request {{(pid=82026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:45:55.101557 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cb8d8ab-fbd5-40ad-9b6b-0d07f2f5bfa8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57539b6a6f3b4d589f5f5e1d211cd6a0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:45:55.102148 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cb8d8ab-fbd5-40ad-9b6b-0d07f2f5bfa8 None admin] REQUEST_METHOD: `POST` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:45:55.102429 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cb8d8ab-fbd5-40ad-9b6b-0d07f2f5bfa8 None admin] SCRIPT_NAME: `/identity` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:45:55.102704 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cb8d8ab-fbd5-40ad-9b6b-0d07f2f5bfa8 None admin] PATH_INFO: `/v3/endpoints` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:45:55.103405 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cb8d8ab-fbd5-40ad-9b6b-0d07f2f5bfa8 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=82026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:45:55.104764 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cb8d8ab-fbd5-40ad-9b6b-0d07f2f5bfa8 None admin] RBAC: Authorization granted {{(pid=82026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:45:55.186088 dv-cinder-828806-6-smb devstack@keystone.service[82026]: [pid: 82026|app: 0|req: 647/1306] 10.222.0.33 () {60 vars in 1144 bytes} [Tue Sep 13 19:45:54 2022] POST /identity/v3/endpoints => generated 331 bytes in 216 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 13 19:46:04.961613 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG dbcounter [-] [82025] Writing DB stats keystone:SELECT=30 {{(pid=82025) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:46:05.180639 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG dbcounter [-] [82026] Writing DB stats keystone:SELECT=91,keystone:INSERT=1 {{(pid=82026) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:51:46.255927 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d20ecc8-6cf3-49dc-8fd6-9aaaf4ab0f7f None None] REQUEST_METHOD: `GET` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:51:46.256400 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d20ecc8-6cf3-49dc-8fd6-9aaaf4ab0f7f None None] SCRIPT_NAME: `/identity` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:51:46.256561 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d20ecc8-6cf3-49dc-8fd6-9aaaf4ab0f7f None None] PATH_INFO: `/` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:51:46.264246 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e04b6ea-2442-4b49-9fde-b72b00f84e6c None None] REQUEST_METHOD: `POST` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:51:46.264813 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e04b6ea-2442-4b49-9fde-b72b00f84e6c None None] SCRIPT_NAME: `/identity` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:51:46.264813 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e04b6ea-2442-4b49-9fde-b72b00f84e6c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:51:46.267708 dv-cinder-828806-6-smb devstack@keystone.service[82025]: [pid: 82025|app: 0|req: 660/1307] 10.222.0.33 () {54 vars in 927 bytes} [Tue Sep 13 19:51:46 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 19:51:46.357378 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.auth.core [None req-6e04b6ea-2442-4b49-9fde-b72b00f84e6c None None] MFA Rules not processed for user `57539b6a6f3b4d589f5f5e1d211cd6a0`. Rule list: `[]` (Enabled: `True`). {{(pid=82026) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 19:51:46.358967 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.common.fernet_utils [None req-6e04b6ea-2442-4b49-9fde-b72b00f84e6c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82026) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 19:51:46.466174 dv-cinder-828806-6-smb devstack@keystone.service[82026]: [pid: 82026|app: 0|req: 648/1308] 10.222.0.33 () {58 vars in 1024 bytes} [Tue Sep 13 19:51:46 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 203 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 13 19:51:46.764910 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f32b2970-3bb7-47ee-8f42-30f76343a90a None None] REQUEST_METHOD: `GET` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:51:46.765279 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f32b2970-3bb7-47ee-8f42-30f76343a90a None None] SCRIPT_NAME: `/identity` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:51:46.765821 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f32b2970-3bb7-47ee-8f42-30f76343a90a None None] PATH_INFO: `/` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:51:46.767301 dv-cinder-828806-6-smb devstack@keystone.service[82025]: [pid: 82025|app: 0|req: 661/1309] 10.222.0.33 () {54 vars in 965 bytes} [Tue Sep 13 19:51:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 19:51:46.773604 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d6a7ccd-4cbc-4a7c-a04d-73253b4a9a3a None None] REQUEST_METHOD: `POST` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:51:46.774003 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d6a7ccd-4cbc-4a7c-a04d-73253b4a9a3a None None] SCRIPT_NAME: `/identity` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:51:46.774358 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d6a7ccd-4cbc-4a7c-a04d-73253b4a9a3a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:51:46.859926 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.auth.core [None req-5d6a7ccd-4cbc-4a7c-a04d-73253b4a9a3a None None] MFA Rules not processed for user `023a2c79c2444611b3d431928e56685d`. Rule list: `[]` (Enabled: `True`). {{(pid=82026) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 19:51:46.861200 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.common.fernet_utils [None req-5d6a7ccd-4cbc-4a7c-a04d-73253b4a9a3a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82026) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 19:51:46.884176 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG dbcounter [-] [82026] Writing DB stats keystone:SELECT=100 {{(pid=82026) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:51:46.943675 dv-cinder-828806-6-smb devstack@keystone.service[82026]: [pid: 82026|app: 0|req: 649/1310] 10.222.0.33 () {58 vars in 1062 bytes} [Tue Sep 13 19:51:46 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 171 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 19:51:46.953242 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f32b2970-3bb7-47ee-8f42-30f76343a90a None None] Authenticating user token {{(pid=82025) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:51:46.955149 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.fernet_utils [None req-f32b2970-3bb7-47ee-8f42-30f76343a90a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82025) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 19:51:47.076754 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f32b2970-3bb7-47ee-8f42-30f76343a90a None None] Validating token access rules against request {{(pid=82025) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:51:47.160116 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29da2245-ae42-4c89-9e8d-27abd6387af4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '023a2c79c2444611b3d431928e56685d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8c6fba0f15b4d6a84ff601919b7b8e4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82025) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:51:47.160723 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29da2245-ae42-4c89-9e8d-27abd6387af4 service neutron] REQUEST_METHOD: `GET` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:51:47.161001 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29da2245-ae42-4c89-9e8d-27abd6387af4 service neutron] SCRIPT_NAME: `/identity` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:51:47.161273 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29da2245-ae42-4c89-9e8d-27abd6387af4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:51:47.162855 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.fernet_utils [None req-29da2245-ae42-4c89-9e8d-27abd6387af4 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82025) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 19:51:47.223754 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG dbcounter [-] [82025] Writing DB stats keystone:SELECT=100 {{(pid=82025) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:51:47.286304 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29da2245-ae42-4c89-9e8d-27abd6387af4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:51:47.287235 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29da2245-ae42-4c89-9e8d-27abd6387af4 service neutron] RBAC: Authorization granted {{(pid=82025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:51:47.310117 dv-cinder-828806-6-smb devstack@keystone.service[82025]: [pid: 82025|app: 0|req: 662/1311] 10.222.0.33 () {60 vars in 1365 bytes} [Tue Sep 13 19:51:46 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 357 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 19:51:49.825598 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fada1b08-84aa-4d85-adb0-dbcf98e6cfae None None] REQUEST_METHOD: `GET` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:51:49.826195 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fada1b08-84aa-4d85-adb0-dbcf98e6cfae None None] SCRIPT_NAME: `/identity` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:51:49.826195 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fada1b08-84aa-4d85-adb0-dbcf98e6cfae None None] PATH_INFO: `/` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:51:49.827897 dv-cinder-828806-6-smb devstack@keystone.service[82026]: [pid: 82026|app: 0|req: 650/1312] 10.222.0.33 () {54 vars in 927 bytes} [Tue Sep 13 19:51:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 19:51:49.832871 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9829efe0-908d-4a67-bc95-ccbecf852e28 None None] REQUEST_METHOD: `POST` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:51:49.833334 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9829efe0-908d-4a67-bc95-ccbecf852e28 None None] SCRIPT_NAME: `/identity` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:51:49.833506 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9829efe0-908d-4a67-bc95-ccbecf852e28 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:51:49.919781 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.auth.core [None req-9829efe0-908d-4a67-bc95-ccbecf852e28 None None] MFA Rules not processed for user `57539b6a6f3b4d589f5f5e1d211cd6a0`. Rule list: `[]` (Enabled: `True`). {{(pid=82025) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 19:51:49.920997 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.fernet_utils [None req-9829efe0-908d-4a67-bc95-ccbecf852e28 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82025) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 19:51:50.019995 dv-cinder-828806-6-smb devstack@keystone.service[82025]: [pid: 82025|app: 0|req: 663/1313] 10.222.0.33 () {58 vars in 1024 bytes} [Tue Sep 13 19:51:49 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 188 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 19:51:50.305096 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fada1b08-84aa-4d85-adb0-dbcf98e6cfae None None] Authenticating user token {{(pid=82026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:51:50.306750 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.common.fernet_utils [None req-fada1b08-84aa-4d85-adb0-dbcf98e6cfae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82026) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 19:51:50.414019 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fada1b08-84aa-4d85-adb0-dbcf98e6cfae None None] Validating token access rules against request {{(pid=82026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:51:50.484714 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG dbcounter [-] [82026] Writing DB stats keystone:SELECT=100 {{(pid=82026) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:51:50.486777 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69b0dc5e-be09-43f5-996d-893b78b43ca0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '023a2c79c2444611b3d431928e56685d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8c6fba0f15b4d6a84ff601919b7b8e4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:51:50.487411 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69b0dc5e-be09-43f5-996d-893b78b43ca0 service neutron] REQUEST_METHOD: `GET` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:51:50.487696 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69b0dc5e-be09-43f5-996d-893b78b43ca0 service neutron] SCRIPT_NAME: `/identity` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:51:50.487973 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69b0dc5e-be09-43f5-996d-893b78b43ca0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:51:50.489588 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.common.fernet_utils [None req-69b0dc5e-be09-43f5-996d-893b78b43ca0 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82026) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 19:51:50.597959 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69b0dc5e-be09-43f5-996d-893b78b43ca0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:51:50.599438 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69b0dc5e-be09-43f5-996d-893b78b43ca0 service neutron] RBAC: Authorization granted {{(pid=82026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:51:50.617118 dv-cinder-828806-6-smb devstack@keystone.service[82026]: [pid: 82026|app: 0|req: 651/1314] 10.222.0.33 () {60 vars in 1365 bytes} [Tue Sep 13 19:51:50 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 313 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 19:51:53.305551 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11f8d395-3518-4e6d-97e5-252631d18634 None None] REQUEST_METHOD: `GET` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:51:53.306031 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11f8d395-3518-4e6d-97e5-252631d18634 None None] SCRIPT_NAME: `/identity` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:51:53.306145 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11f8d395-3518-4e6d-97e5-252631d18634 None None] PATH_INFO: `/` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:51:53.307563 dv-cinder-828806-6-smb devstack@keystone.service[82025]: [pid: 82025|app: 0|req: 664/1315] 10.222.0.33 () {54 vars in 927 bytes} [Tue Sep 13 19:51:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 19:51:53.312854 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6bf9678-10f7-4d4f-ab21-e120bad5acc0 None None] REQUEST_METHOD: `POST` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:51:53.313257 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6bf9678-10f7-4d4f-ab21-e120bad5acc0 None None] SCRIPT_NAME: `/identity` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:51:53.313417 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6bf9678-10f7-4d4f-ab21-e120bad5acc0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:51:53.384962 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.auth.core [None req-a6bf9678-10f7-4d4f-ab21-e120bad5acc0 None None] MFA Rules not processed for user `6485aa9aa85e4a2aa1b120072f8422e4`. Rule list: `[]` (Enabled: `True`). {{(pid=82026) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 19:51:53.386757 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.common.fernet_utils [None req-a6bf9678-10f7-4d4f-ab21-e120bad5acc0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82026) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 19:51:53.437289 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG dbcounter [-] [82026] Writing DB stats keystone:SELECT=100 {{(pid=82026) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:51:53.481819 dv-cinder-828806-6-smb devstack@keystone.service[82026]: [pid: 82026|app: 0|req: 652/1316] 10.222.0.33 () {58 vars in 1024 bytes} [Tue Sep 13 19:51:53 2022] POST /identity/v3/auth/tokens => generated 3243 bytes in 170 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 19:51:53.768563 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11f8d395-3518-4e6d-97e5-252631d18634 None None] Authenticating user token {{(pid=82025) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:51:53.770121 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.fernet_utils [None req-11f8d395-3518-4e6d-97e5-252631d18634 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82025) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 19:51:53.779885 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG dbcounter [-] [82025] Writing DB stats keystone:SELECT=100 {{(pid=82025) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:51:53.875829 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11f8d395-3518-4e6d-97e5-252631d18634 None None] Validating token access rules against request {{(pid=82025) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:51:53.948855 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fbc39fd-038a-4ac0-9438-6d4d7eecdf55 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '023a2c79c2444611b3d431928e56685d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8c6fba0f15b4d6a84ff601919b7b8e4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82025) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:51:53.949531 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fbc39fd-038a-4ac0-9438-6d4d7eecdf55 service neutron] REQUEST_METHOD: `GET` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:51:53.949820 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fbc39fd-038a-4ac0-9438-6d4d7eecdf55 service neutron] SCRIPT_NAME: `/identity` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:51:53.950099 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fbc39fd-038a-4ac0-9438-6d4d7eecdf55 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:51:53.951735 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.fernet_utils [None req-9fbc39fd-038a-4ac0-9438-6d4d7eecdf55 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82025) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 19:51:54.013085 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG dbcounter [-] [82025] Writing DB stats keystone:SELECT=100 {{(pid=82025) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:51:54.059641 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fbc39fd-038a-4ac0-9438-6d4d7eecdf55 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:51:54.061311 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fbc39fd-038a-4ac0-9438-6d4d7eecdf55 service neutron] RBAC: Authorization granted {{(pid=82025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:51:54.079294 dv-cinder-828806-6-smb devstack@keystone.service[82025]: [pid: 82025|app: 0|req: 665/1317] 10.222.0.33 () {60 vars in 1365 bytes} [Tue Sep 13 19:51:53 2022] GET /identity/v3/auth/tokens => generated 3243 bytes in 311 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 19:51:56.954133 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-541223ec-12f5-4c3e-ba8e-caa946979f96 None None] REQUEST_METHOD: `GET` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:51:56.954728 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-541223ec-12f5-4c3e-ba8e-caa946979f96 None None] SCRIPT_NAME: `/identity` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:51:56.954728 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-541223ec-12f5-4c3e-ba8e-caa946979f96 None None] PATH_INFO: `/` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:51:56.956072 dv-cinder-828806-6-smb devstack@keystone.service[82026]: [pid: 82026|app: 0|req: 653/1318] 10.222.0.33 () {54 vars in 927 bytes} [Tue Sep 13 19:51:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 19:51:56.961222 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9e413c1-c433-42b7-99bf-cf3fe2b1edec None None] REQUEST_METHOD: `POST` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:51:56.961646 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9e413c1-c433-42b7-99bf-cf3fe2b1edec None None] SCRIPT_NAME: `/identity` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:51:56.961761 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9e413c1-c433-42b7-99bf-cf3fe2b1edec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:51:57.026527 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.auth.core [None req-c9e413c1-c433-42b7-99bf-cf3fe2b1edec None None] MFA Rules not processed for user `57539b6a6f3b4d589f5f5e1d211cd6a0`. Rule list: `[]` (Enabled: `True`). {{(pid=82025) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 19:51:57.027791 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.fernet_utils [None req-c9e413c1-c433-42b7-99bf-cf3fe2b1edec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82025) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 19:51:57.122326 dv-cinder-828806-6-smb devstack@keystone.service[82025]: [pid: 82025|app: 0|req: 666/1319] 10.222.0.33 () {58 vars in 1024 bytes} [Tue Sep 13 19:51:56 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 162 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 19:51:57.405438 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-541223ec-12f5-4c3e-ba8e-caa946979f96 None None] Authenticating user token {{(pid=82026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:51:57.406999 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.common.fernet_utils [None req-541223ec-12f5-4c3e-ba8e-caa946979f96 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82026) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 19:51:57.515656 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-541223ec-12f5-4c3e-ba8e-caa946979f96 None None] Validating token access rules against request {{(pid=82026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:51:57.588753 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f63d3071-f996-4177-bfb3-54718c6211af service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '023a2c79c2444611b3d431928e56685d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8c6fba0f15b4d6a84ff601919b7b8e4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:51:57.591150 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f63d3071-f996-4177-bfb3-54718c6211af service neutron] REQUEST_METHOD: `GET` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:51:57.591150 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f63d3071-f996-4177-bfb3-54718c6211af service neutron] SCRIPT_NAME: `/identity` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:51:57.591150 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f63d3071-f996-4177-bfb3-54718c6211af service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:51:57.593112 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.common.fernet_utils [None req-f63d3071-f996-4177-bfb3-54718c6211af service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82026) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 19:51:57.600328 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG dbcounter [-] [82026] Writing DB stats keystone:SELECT=100 {{(pid=82026) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:51:57.704821 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f63d3071-f996-4177-bfb3-54718c6211af service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:51:57.706266 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f63d3071-f996-4177-bfb3-54718c6211af service neutron] RBAC: Authorization granted {{(pid=82026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:51:57.725231 dv-cinder-828806-6-smb devstack@keystone.service[82026]: [pid: 82026|app: 0|req: 654/1320] 10.222.0.33 () {60 vars in 1365 bytes} [Tue Sep 13 19:51:57 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 320 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 19:52:00.923883 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-729f9edf-c53c-402b-b18e-26369ac468f8 None None] REQUEST_METHOD: `GET` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:52:00.924470 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-729f9edf-c53c-402b-b18e-26369ac468f8 None None] SCRIPT_NAME: `/identity` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:52:00.924470 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-729f9edf-c53c-402b-b18e-26369ac468f8 None None] PATH_INFO: `/` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:52:00.925943 dv-cinder-828806-6-smb devstack@keystone.service[82025]: [pid: 82025|app: 0|req: 667/1321] 10.222.0.33 () {54 vars in 927 bytes} [Tue Sep 13 19:52:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 19:52:00.931102 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d54dddb3-9d41-42d1-980f-11ecb9b2e0d4 None None] REQUEST_METHOD: `POST` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:52:00.931522 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d54dddb3-9d41-42d1-980f-11ecb9b2e0d4 None None] SCRIPT_NAME: `/identity` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:52:00.931667 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d54dddb3-9d41-42d1-980f-11ecb9b2e0d4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:52:01.001396 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.auth.core [None req-d54dddb3-9d41-42d1-980f-11ecb9b2e0d4 None None] MFA Rules not processed for user `57539b6a6f3b4d589f5f5e1d211cd6a0`. Rule list: `[]` (Enabled: `True`). {{(pid=82026) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 19:52:01.002643 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.common.fernet_utils [None req-d54dddb3-9d41-42d1-980f-11ecb9b2e0d4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82026) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 19:52:01.071264 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG dbcounter [-] [82026] Writing DB stats keystone:SELECT=100 {{(pid=82026) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:52:01.113729 dv-cinder-828806-6-smb devstack@keystone.service[82026]: [pid: 82026|app: 0|req: 655/1322] 10.222.0.33 () {58 vars in 1024 bytes} [Tue Sep 13 19:52:00 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 184 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 19:52:01.394947 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-729f9edf-c53c-402b-b18e-26369ac468f8 None None] Authenticating user token {{(pid=82025) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:52:01.396552 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.fernet_utils [None req-729f9edf-c53c-402b-b18e-26369ac468f8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82025) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 19:52:01.418616 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG dbcounter [-] [82025] Writing DB stats keystone:SELECT=100 {{(pid=82025) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:52:01.506751 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-729f9edf-c53c-402b-b18e-26369ac468f8 None None] Validating token access rules against request {{(pid=82025) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:52:01.582286 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d62441aa-6ad3-4415-a4f9-f88ee4d2ed5f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '023a2c79c2444611b3d431928e56685d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8c6fba0f15b4d6a84ff601919b7b8e4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82025) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:52:01.582894 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d62441aa-6ad3-4415-a4f9-f88ee4d2ed5f service neutron] REQUEST_METHOD: `GET` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:52:01.583208 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d62441aa-6ad3-4415-a4f9-f88ee4d2ed5f service neutron] SCRIPT_NAME: `/identity` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:52:01.583484 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d62441aa-6ad3-4415-a4f9-f88ee4d2ed5f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:52:01.585124 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.fernet_utils [None req-d62441aa-6ad3-4415-a4f9-f88ee4d2ed5f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82025) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 19:52:01.661419 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG dbcounter [-] [82025] Writing DB stats keystone:SELECT=100 {{(pid=82025) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:52:01.701137 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d62441aa-6ad3-4415-a4f9-f88ee4d2ed5f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:52:01.702567 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d62441aa-6ad3-4415-a4f9-f88ee4d2ed5f service neutron] RBAC: Authorization granted {{(pid=82025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:52:01.721070 dv-cinder-828806-6-smb devstack@keystone.service[82025]: [pid: 82025|app: 0|req: 668/1323] 10.222.0.33 () {60 vars in 1365 bytes} [Tue Sep 13 19:52:01 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 327 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 19:52:03.981172 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27b1fd54-3594-49e4-bafe-f826cddbe817 None None] REQUEST_METHOD: `GET` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:52:03.981737 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27b1fd54-3594-49e4-bafe-f826cddbe817 None None] SCRIPT_NAME: `/identity` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:52:03.981737 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27b1fd54-3594-49e4-bafe-f826cddbe817 None None] PATH_INFO: `/` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:52:03.983092 dv-cinder-828806-6-smb devstack@keystone.service[82026]: [pid: 82026|app: 0|req: 656/1324] 10.222.0.33 () {54 vars in 927 bytes} [Tue Sep 13 19:52:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 19:52:03.988409 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aed3accd-6d7e-48fc-81b2-77190fd76069 None None] REQUEST_METHOD: `POST` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:52:03.988827 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aed3accd-6d7e-48fc-81b2-77190fd76069 None None] SCRIPT_NAME: `/identity` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:52:03.988963 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aed3accd-6d7e-48fc-81b2-77190fd76069 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:52:04.056764 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.auth.core [None req-aed3accd-6d7e-48fc-81b2-77190fd76069 None None] MFA Rules not processed for user `57539b6a6f3b4d589f5f5e1d211cd6a0`. Rule list: `[]` (Enabled: `True`). {{(pid=82025) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 19:52:04.058013 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.fernet_utils [None req-aed3accd-6d7e-48fc-81b2-77190fd76069 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82025) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 19:52:04.160461 dv-cinder-828806-6-smb devstack@keystone.service[82025]: [pid: 82025|app: 0|req: 669/1325] 10.222.0.33 () {58 vars in 1024 bytes} [Tue Sep 13 19:52:03 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 173 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 19:52:04.445848 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27b1fd54-3594-49e4-bafe-f826cddbe817 None None] Authenticating user token {{(pid=82026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:52:04.447526 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.common.fernet_utils [None req-27b1fd54-3594-49e4-bafe-f826cddbe817 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82026) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 19:52:04.554941 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27b1fd54-3594-49e4-bafe-f826cddbe817 None None] Validating token access rules against request {{(pid=82026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:52:04.631138 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-442a21a7-1e74-4e90-a4fc-582832e27895 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '023a2c79c2444611b3d431928e56685d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8c6fba0f15b4d6a84ff601919b7b8e4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:52:04.631752 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-442a21a7-1e74-4e90-a4fc-582832e27895 service neutron] REQUEST_METHOD: `GET` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:52:04.632033 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-442a21a7-1e74-4e90-a4fc-582832e27895 service neutron] SCRIPT_NAME: `/identity` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:52:04.632310 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-442a21a7-1e74-4e90-a4fc-582832e27895 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:52:04.633926 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.common.fernet_utils [None req-442a21a7-1e74-4e90-a4fc-582832e27895 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82026) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 19:52:04.652794 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG dbcounter [-] [82026] Writing DB stats keystone:SELECT=100 {{(pid=82026) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:52:04.756118 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-442a21a7-1e74-4e90-a4fc-582832e27895 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:52:04.757482 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-442a21a7-1e74-4e90-a4fc-582832e27895 service neutron] RBAC: Authorization granted {{(pid=82026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:52:04.777032 dv-cinder-828806-6-smb devstack@keystone.service[82026]: [pid: 82026|app: 0|req: 657/1326] 10.222.0.33 () {60 vars in 1365 bytes} [Tue Sep 13 19:52:04 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 332 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 19:52:07.025935 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7af5beb7-1ad1-421f-ac77-265e06250a49 None None] REQUEST_METHOD: `GET` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:52:07.026427 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7af5beb7-1ad1-421f-ac77-265e06250a49 None None] SCRIPT_NAME: `/identity` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:52:07.026427 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7af5beb7-1ad1-421f-ac77-265e06250a49 None None] PATH_INFO: `/` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:52:07.027986 dv-cinder-828806-6-smb devstack@keystone.service[82025]: [pid: 82025|app: 0|req: 670/1327] 10.222.0.33 () {54 vars in 927 bytes} [Tue Sep 13 19:52:07 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 19:52:07.033324 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9174242a-5c69-4901-aaaa-cef8e77cb2dc None None] REQUEST_METHOD: `POST` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:52:07.033737 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9174242a-5c69-4901-aaaa-cef8e77cb2dc None None] SCRIPT_NAME: `/identity` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:52:07.033886 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9174242a-5c69-4901-aaaa-cef8e77cb2dc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:52:07.104741 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.auth.core [None req-9174242a-5c69-4901-aaaa-cef8e77cb2dc None None] MFA Rules not processed for user `6485aa9aa85e4a2aa1b120072f8422e4`. Rule list: `[]` (Enabled: `True`). {{(pid=82026) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 19:52:07.106439 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.common.fernet_utils [None req-9174242a-5c69-4901-aaaa-cef8e77cb2dc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82026) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 19:52:07.172288 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG dbcounter [-] [82026] Writing DB stats keystone:SELECT=100 {{(pid=82026) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:52:07.204544 dv-cinder-828806-6-smb devstack@keystone.service[82026]: [pid: 82026|app: 0|req: 658/1328] 10.222.0.33 () {58 vars in 1024 bytes} [Tue Sep 13 19:52:07 2022] POST /identity/v3/auth/tokens => generated 3243 bytes in 172 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 19:52:07.515559 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89d48ee2-d0de-46f3-a1dd-302f25566eb8 None None] REQUEST_METHOD: `GET` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:52:07.515844 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89d48ee2-d0de-46f3-a1dd-302f25566eb8 None None] SCRIPT_NAME: `/identity` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:52:07.516127 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89d48ee2-d0de-46f3-a1dd-302f25566eb8 None None] PATH_INFO: `/` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:52:07.517490 dv-cinder-828806-6-smb devstack@keystone.service[82025]: [pid: 82025|app: 0|req: 671/1329] 10.222.0.33 () {54 vars in 965 bytes} [Tue Sep 13 19:52:07 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 19:52:07.523971 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6245534a-c410-4a77-a6a0-a6237a64d177 None None] REQUEST_METHOD: `POST` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:52:07.524335 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6245534a-c410-4a77-a6a0-a6237a64d177 None None] SCRIPT_NAME: `/identity` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:52:07.524763 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6245534a-c410-4a77-a6a0-a6237a64d177 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:52:07.615378 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.auth.core [None req-6245534a-c410-4a77-a6a0-a6237a64d177 None None] MFA Rules not processed for user `023a2c79c2444611b3d431928e56685d`. Rule list: `[]` (Enabled: `True`). {{(pid=82026) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 19:52:07.616532 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.common.fernet_utils [None req-6245534a-c410-4a77-a6a0-a6237a64d177 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82026) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 19:52:07.702705 dv-cinder-828806-6-smb devstack@keystone.service[82026]: [pid: 82026|app: 0|req: 659/1330] 10.222.0.33 () {58 vars in 1062 bytes} [Tue Sep 13 19:52:07 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 180 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 19:52:07.711749 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89d48ee2-d0de-46f3-a1dd-302f25566eb8 None None] Authenticating user token {{(pid=82025) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:52:07.713306 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.fernet_utils [None req-89d48ee2-d0de-46f3-a1dd-302f25566eb8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82025) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 19:52:07.753668 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG dbcounter [-] [82025] Writing DB stats keystone:SELECT=100 {{(pid=82025) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:52:07.840919 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89d48ee2-d0de-46f3-a1dd-302f25566eb8 None None] Validating token access rules against request {{(pid=82025) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:52:07.919517 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50d51278-d41a-407e-b846-4035ed2bd5f0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '023a2c79c2444611b3d431928e56685d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8c6fba0f15b4d6a84ff601919b7b8e4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82025) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:52:07.920182 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50d51278-d41a-407e-b846-4035ed2bd5f0 service neutron] REQUEST_METHOD: `GET` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:52:07.920467 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50d51278-d41a-407e-b846-4035ed2bd5f0 service neutron] SCRIPT_NAME: `/identity` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:52:07.920739 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50d51278-d41a-407e-b846-4035ed2bd5f0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:52:07.922604 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.fernet_utils [None req-50d51278-d41a-407e-b846-4035ed2bd5f0 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82025) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 19:52:07.999348 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG dbcounter [-] [82025] Writing DB stats keystone:SELECT=100 {{(pid=82025) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:52:08.032056 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50d51278-d41a-407e-b846-4035ed2bd5f0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:52:08.033489 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50d51278-d41a-407e-b846-4035ed2bd5f0 service neutron] RBAC: Authorization granted {{(pid=82025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:52:08.052499 dv-cinder-828806-6-smb devstack@keystone.service[82025]: [pid: 82025|app: 0|req: 672/1331] 10.222.0.33 () {60 vars in 1365 bytes} [Tue Sep 13 19:52:07 2022] GET /identity/v3/auth/tokens => generated 3243 bytes in 341 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 19:52:11.046379 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbbc1b06-7225-4a9c-93fb-7b1ee7548930 None None] REQUEST_METHOD: `GET` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:52:11.046923 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbbc1b06-7225-4a9c-93fb-7b1ee7548930 None None] SCRIPT_NAME: `/identity` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:52:11.046923 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbbc1b06-7225-4a9c-93fb-7b1ee7548930 None None] PATH_INFO: `/` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:52:11.048565 dv-cinder-828806-6-smb devstack@keystone.service[82026]: [pid: 82026|app: 0|req: 660/1332] 10.222.0.33 () {54 vars in 927 bytes} [Tue Sep 13 19:52:11 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 19:52:11.053663 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92d522ca-dce7-491e-b4fc-8b97c432fdef None None] REQUEST_METHOD: `POST` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:52:11.054175 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92d522ca-dce7-491e-b4fc-8b97c432fdef None None] SCRIPT_NAME: `/identity` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:52:11.054273 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92d522ca-dce7-491e-b4fc-8b97c432fdef None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:52:11.126460 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.auth.core [None req-92d522ca-dce7-491e-b4fc-8b97c432fdef None None] MFA Rules not processed for user `57539b6a6f3b4d589f5f5e1d211cd6a0`. Rule list: `[]` (Enabled: `True`). {{(pid=82025) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 19:52:11.127717 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.fernet_utils [None req-92d522ca-dce7-491e-b4fc-8b97c432fdef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82025) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 19:52:11.223090 dv-cinder-828806-6-smb devstack@keystone.service[82025]: [pid: 82025|app: 0|req: 673/1333] 10.222.0.33 () {58 vars in 1024 bytes} [Tue Sep 13 19:52:11 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 170 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 19:52:11.511171 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbbc1b06-7225-4a9c-93fb-7b1ee7548930 None None] Authenticating user token {{(pid=82026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:52:11.512728 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.common.fernet_utils [None req-dbbc1b06-7225-4a9c-93fb-7b1ee7548930 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82026) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 19:52:11.582436 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG dbcounter [-] [82026] Writing DB stats keystone:SELECT=100 {{(pid=82026) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:52:11.616292 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbbc1b06-7225-4a9c-93fb-7b1ee7548930 None None] Validating token access rules against request {{(pid=82026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:52:11.689079 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c634059-297f-41ed-b6d5-2a15ff029df6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '023a2c79c2444611b3d431928e56685d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8c6fba0f15b4d6a84ff601919b7b8e4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:52:11.697120 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c634059-297f-41ed-b6d5-2a15ff029df6 service neutron] REQUEST_METHOD: `GET` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:52:11.697872 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c634059-297f-41ed-b6d5-2a15ff029df6 service neutron] SCRIPT_NAME: `/identity` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:52:11.698175 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c634059-297f-41ed-b6d5-2a15ff029df6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:52:11.699888 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.common.fernet_utils [None req-1c634059-297f-41ed-b6d5-2a15ff029df6 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82026) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 19:52:11.813446 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c634059-297f-41ed-b6d5-2a15ff029df6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:52:11.814873 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c634059-297f-41ed-b6d5-2a15ff029df6 service neutron] RBAC: Authorization granted {{(pid=82026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:52:11.825174 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG dbcounter [-] [82026] Writing DB stats keystone:SELECT=100 {{(pid=82026) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:52:11.833208 dv-cinder-828806-6-smb devstack@keystone.service[82026]: [pid: 82026|app: 0|req: 661/1334] 10.222.0.33 () {60 vars in 1365 bytes} [Tue Sep 13 19:52:11 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 323 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 19:52:14.060424 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87a18030-4b23-4326-ae54-3f1971806939 None None] REQUEST_METHOD: `GET` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:52:14.060966 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87a18030-4b23-4326-ae54-3f1971806939 None None] SCRIPT_NAME: `/identity` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:52:14.060966 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87a18030-4b23-4326-ae54-3f1971806939 None None] PATH_INFO: `/` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:52:14.062327 dv-cinder-828806-6-smb devstack@keystone.service[82025]: [pid: 82025|app: 0|req: 674/1335] 10.222.0.33 () {54 vars in 927 bytes} [Tue Sep 13 19:52:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 13 19:52:14.067657 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab526e6c-bea1-4374-8d93-61b799ef83f4 None None] REQUEST_METHOD: `POST` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:52:14.068063 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab526e6c-bea1-4374-8d93-61b799ef83f4 None None] SCRIPT_NAME: `/identity` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:52:14.068217 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab526e6c-bea1-4374-8d93-61b799ef83f4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:52:14.135363 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.auth.core [None req-ab526e6c-bea1-4374-8d93-61b799ef83f4 None None] MFA Rules not processed for user `57539b6a6f3b4d589f5f5e1d211cd6a0`. Rule list: `[]` (Enabled: `True`). {{(pid=82026) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 19:52:14.136717 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.common.fernet_utils [None req-ab526e6c-bea1-4374-8d93-61b799ef83f4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82026) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 19:52:14.239596 dv-cinder-828806-6-smb devstack@keystone.service[82026]: [pid: 82026|app: 0|req: 662/1336] 10.222.0.33 () {58 vars in 1024 bytes} [Tue Sep 13 19:52:14 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 173 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 19:52:14.528617 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87a18030-4b23-4326-ae54-3f1971806939 None None] Authenticating user token {{(pid=82025) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:52:14.530218 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.fernet_utils [None req-87a18030-4b23-4326-ae54-3f1971806939 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82025) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 19:52:14.570200 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG dbcounter [-] [82025] Writing DB stats keystone:SELECT=100 {{(pid=82025) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:52:14.632466 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87a18030-4b23-4326-ae54-3f1971806939 None None] Validating token access rules against request {{(pid=82025) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:52:14.705943 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea58fdbc-5bef-435e-b76f-bd709f182fed service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '023a2c79c2444611b3d431928e56685d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8c6fba0f15b4d6a84ff601919b7b8e4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82025) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:52:14.706536 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea58fdbc-5bef-435e-b76f-bd709f182fed service neutron] REQUEST_METHOD: `GET` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:52:14.706813 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea58fdbc-5bef-435e-b76f-bd709f182fed service neutron] SCRIPT_NAME: `/identity` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:52:14.707111 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea58fdbc-5bef-435e-b76f-bd709f182fed service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:52:14.708678 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.fernet_utils [None req-ea58fdbc-5bef-435e-b76f-bd709f182fed service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82025) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 19:52:14.789599 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG dbcounter [-] [82025] Writing DB stats keystone:SELECT=100 {{(pid=82025) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:52:14.815991 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea58fdbc-5bef-435e-b76f-bd709f182fed service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:52:14.817468 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea58fdbc-5bef-435e-b76f-bd709f182fed service neutron] RBAC: Authorization granted {{(pid=82025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:52:14.836306 dv-cinder-828806-6-smb devstack@keystone.service[82025]: [pid: 82025|app: 0|req: 675/1337] 10.222.0.33 () {60 vars in 1365 bytes} [Tue Sep 13 19:52:14 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 308 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 19:52:17.677409 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f074404-b365-49a0-99c8-24c7dfd20cd0 None None] REQUEST_METHOD: `GET` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:52:17.677983 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f074404-b365-49a0-99c8-24c7dfd20cd0 None None] SCRIPT_NAME: `/identity` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:52:17.677983 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f074404-b365-49a0-99c8-24c7dfd20cd0 None None] PATH_INFO: `/` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:52:17.679338 dv-cinder-828806-6-smb devstack@keystone.service[82026]: [pid: 82026|app: 0|req: 663/1338] 10.222.0.33 () {54 vars in 927 bytes} [Tue Sep 13 19:52:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 19:52:17.684858 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf57ee14-49ac-4987-b396-eb9fa504a5cf None None] REQUEST_METHOD: `POST` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:52:17.685267 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf57ee14-49ac-4987-b396-eb9fa504a5cf None None] SCRIPT_NAME: `/identity` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:52:17.685448 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf57ee14-49ac-4987-b396-eb9fa504a5cf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:52:17.754260 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.auth.core [None req-cf57ee14-49ac-4987-b396-eb9fa504a5cf None None] MFA Rules not processed for user `57539b6a6f3b4d589f5f5e1d211cd6a0`. Rule list: `[]` (Enabled: `True`). {{(pid=82025) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 19:52:17.755655 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.fernet_utils [None req-cf57ee14-49ac-4987-b396-eb9fa504a5cf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82025) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 19:52:17.859605 dv-cinder-828806-6-smb devstack@keystone.service[82025]: [pid: 82025|app: 0|req: 676/1339] 10.222.0.33 () {58 vars in 1024 bytes} [Tue Sep 13 19:52:17 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 176 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 19:52:18.139555 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f074404-b365-49a0-99c8-24c7dfd20cd0 None None] Authenticating user token {{(pid=82026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:52:18.141108 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.common.fernet_utils [None req-9f074404-b365-49a0-99c8-24c7dfd20cd0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82026) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 19:52:18.215927 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG dbcounter [-] [82026] Writing DB stats keystone:SELECT=100 {{(pid=82026) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:52:18.243541 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f074404-b365-49a0-99c8-24c7dfd20cd0 None None] Validating token access rules against request {{(pid=82026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:52:18.316727 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fb4cbfa-7b04-4b17-8b42-ea8706f82640 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '023a2c79c2444611b3d431928e56685d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8c6fba0f15b4d6a84ff601919b7b8e4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:52:18.317341 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fb4cbfa-7b04-4b17-8b42-ea8706f82640 service neutron] REQUEST_METHOD: `GET` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:52:18.317628 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fb4cbfa-7b04-4b17-8b42-ea8706f82640 service neutron] SCRIPT_NAME: `/identity` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:52:18.317909 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fb4cbfa-7b04-4b17-8b42-ea8706f82640 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:52:18.319562 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.common.fernet_utils [None req-0fb4cbfa-7b04-4b17-8b42-ea8706f82640 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82026) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 19:52:18.427164 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fb4cbfa-7b04-4b17-8b42-ea8706f82640 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:52:18.428537 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fb4cbfa-7b04-4b17-8b42-ea8706f82640 service neutron] RBAC: Authorization granted {{(pid=82026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:52:18.446237 dv-cinder-828806-6-smb devstack@keystone.service[82026]: [pid: 82026|app: 0|req: 664/1340] 10.222.0.33 () {60 vars in 1365 bytes} [Tue Sep 13 19:52:18 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 307 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 19:52:23.164095 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c002100d-f2c6-483a-859d-3a2ab62de30a None None] REQUEST_METHOD: `GET` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:52:23.164655 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c002100d-f2c6-483a-859d-3a2ab62de30a None None] SCRIPT_NAME: `/identity` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:52:23.164655 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c002100d-f2c6-483a-859d-3a2ab62de30a None None] PATH_INFO: `/` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:52:23.165911 dv-cinder-828806-6-smb devstack@keystone.service[82025]: [pid: 82025|app: 0|req: 677/1341] 10.222.0.33 () {54 vars in 927 bytes} [Tue Sep 13 19:52:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 19:52:23.171728 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adca945f-9e39-4f09-93e2-8a4697f530d6 None None] REQUEST_METHOD: `POST` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:52:23.172196 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adca945f-9e39-4f09-93e2-8a4697f530d6 None None] SCRIPT_NAME: `/identity` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:52:23.172639 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adca945f-9e39-4f09-93e2-8a4697f530d6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:52:23.178393 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG dbcounter [-] [82026] Writing DB stats keystone:SELECT=100 {{(pid=82026) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:52:23.241189 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.auth.core [None req-adca945f-9e39-4f09-93e2-8a4697f530d6 None None] MFA Rules not processed for user `57539b6a6f3b4d589f5f5e1d211cd6a0`. Rule list: `[]` (Enabled: `True`). {{(pid=82026) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 19:52:23.242417 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.common.fernet_utils [None req-adca945f-9e39-4f09-93e2-8a4697f530d6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82026) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 19:52:23.342697 dv-cinder-828806-6-smb devstack@keystone.service[82026]: [pid: 82026|app: 0|req: 665/1342] 10.222.0.33 () {58 vars in 1024 bytes} [Tue Sep 13 19:52:23 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 172 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 19:52:23.631936 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c002100d-f2c6-483a-859d-3a2ab62de30a None None] Authenticating user token {{(pid=82025) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:52:23.633490 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.fernet_utils [None req-c002100d-f2c6-483a-859d-3a2ab62de30a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82025) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 19:52:23.682688 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG dbcounter [-] [82025] Writing DB stats keystone:SELECT=100 {{(pid=82025) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:52:23.739156 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c002100d-f2c6-483a-859d-3a2ab62de30a None None] Validating token access rules against request {{(pid=82025) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:52:23.824733 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-327c87d5-566b-4bac-b3e3-cfaae21ea617 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '023a2c79c2444611b3d431928e56685d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8c6fba0f15b4d6a84ff601919b7b8e4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82025) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:52:23.825402 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-327c87d5-566b-4bac-b3e3-cfaae21ea617 service neutron] REQUEST_METHOD: `GET` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:52:23.826256 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-327c87d5-566b-4bac-b3e3-cfaae21ea617 service neutron] SCRIPT_NAME: `/identity` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:52:23.826542 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-327c87d5-566b-4bac-b3e3-cfaae21ea617 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:52:23.828188 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.fernet_utils [None req-327c87d5-566b-4bac-b3e3-cfaae21ea617 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82025) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 19:52:23.926228 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG dbcounter [-] [82025] Writing DB stats keystone:SELECT=100 {{(pid=82025) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:52:23.943281 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-327c87d5-566b-4bac-b3e3-cfaae21ea617 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:52:23.944714 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-327c87d5-566b-4bac-b3e3-cfaae21ea617 service neutron] RBAC: Authorization granted {{(pid=82025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:52:23.964193 dv-cinder-828806-6-smb devstack@keystone.service[82025]: [pid: 82025|app: 0|req: 678/1343] 10.222.0.33 () {60 vars in 1365 bytes} [Tue Sep 13 19:52:23 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 333 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 19:52:27.102376 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67244051-48d2-46ca-9bb2-b95cbfee7a4f None None] REQUEST_METHOD: `GET` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:52:27.102921 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67244051-48d2-46ca-9bb2-b95cbfee7a4f None None] SCRIPT_NAME: `/identity` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:52:27.102921 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67244051-48d2-46ca-9bb2-b95cbfee7a4f None None] PATH_INFO: `/` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:52:27.104364 dv-cinder-828806-6-smb devstack@keystone.service[82026]: [pid: 82026|app: 0|req: 666/1344] 10.222.0.33 () {54 vars in 927 bytes} [Tue Sep 13 19:52:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 19:52:27.110202 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f88bb5b-9997-4c3c-a6f9-023c5468d2d1 None None] REQUEST_METHOD: `POST` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:52:27.110914 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f88bb5b-9997-4c3c-a6f9-023c5468d2d1 None None] SCRIPT_NAME: `/identity` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:52:27.111186 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f88bb5b-9997-4c3c-a6f9-023c5468d2d1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:52:27.182534 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.auth.core [None req-3f88bb5b-9997-4c3c-a6f9-023c5468d2d1 None None] MFA Rules not processed for user `57539b6a6f3b4d589f5f5e1d211cd6a0`. Rule list: `[]` (Enabled: `True`). {{(pid=82025) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 19:52:27.183790 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.fernet_utils [None req-3f88bb5b-9997-4c3c-a6f9-023c5468d2d1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82025) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 19:52:27.291099 dv-cinder-828806-6-smb devstack@keystone.service[82025]: [pid: 82025|app: 0|req: 679/1345] 10.222.0.33 () {58 vars in 1024 bytes} [Tue Sep 13 19:52:27 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 180 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 13 19:52:27.572693 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67244051-48d2-46ca-9bb2-b95cbfee7a4f None None] Authenticating user token {{(pid=82026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:52:27.574257 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.common.fernet_utils [None req-67244051-48d2-46ca-9bb2-b95cbfee7a4f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82026) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 19:52:27.681692 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG dbcounter [-] [82026] Writing DB stats keystone:SELECT=100 {{(pid=82026) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:52:27.702715 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67244051-48d2-46ca-9bb2-b95cbfee7a4f None None] Validating token access rules against request {{(pid=82026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:52:27.785015 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2007c419-f384-48d4-9ab9-2a6bbba57090 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '023a2c79c2444611b3d431928e56685d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8c6fba0f15b4d6a84ff601919b7b8e4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:52:27.785631 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2007c419-f384-48d4-9ab9-2a6bbba57090 service neutron] REQUEST_METHOD: `GET` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:52:27.785917 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2007c419-f384-48d4-9ab9-2a6bbba57090 service neutron] SCRIPT_NAME: `/identity` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:52:27.786197 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2007c419-f384-48d4-9ab9-2a6bbba57090 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:52:27.787878 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.common.fernet_utils [None req-2007c419-f384-48d4-9ab9-2a6bbba57090 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82026) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 19:52:27.906978 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2007c419-f384-48d4-9ab9-2a6bbba57090 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:52:27.908543 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2007c419-f384-48d4-9ab9-2a6bbba57090 service neutron] RBAC: Authorization granted {{(pid=82026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:52:27.928730 dv-cinder-828806-6-smb devstack@keystone.service[82026]: [pid: 82026|app: 0|req: 667/1346] 10.222.0.33 () {60 vars in 1365 bytes} [Tue Sep 13 19:52:27 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 357 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 19:52:32.390249 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfdebfe7-c774-4e07-a787-3d48db6af784 None None] REQUEST_METHOD: `GET` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:52:32.390782 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfdebfe7-c774-4e07-a787-3d48db6af784 None None] SCRIPT_NAME: `/identity` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:52:32.390782 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfdebfe7-c774-4e07-a787-3d48db6af784 None None] PATH_INFO: `/` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:52:32.392184 dv-cinder-828806-6-smb devstack@keystone.service[82025]: [pid: 82025|app: 0|req: 680/1347] 10.222.0.33 () {54 vars in 927 bytes} [Tue Sep 13 19:52:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 13 19:52:32.397775 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-573dce49-eca0-43d6-96f6-97aa66a64b07 None None] REQUEST_METHOD: `POST` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:52:32.398261 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-573dce49-eca0-43d6-96f6-97aa66a64b07 None None] SCRIPT_NAME: `/identity` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:52:32.398367 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-573dce49-eca0-43d6-96f6-97aa66a64b07 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:52:32.415272 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG dbcounter [-] [82026] Writing DB stats keystone:SELECT=100 {{(pid=82026) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:52:32.469682 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.auth.core [None req-573dce49-eca0-43d6-96f6-97aa66a64b07 None None] MFA Rules not processed for user `57539b6a6f3b4d589f5f5e1d211cd6a0`. Rule list: `[]` (Enabled: `True`). {{(pid=82026) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 19:52:32.471680 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.common.fernet_utils [None req-573dce49-eca0-43d6-96f6-97aa66a64b07 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82026) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 19:52:32.573522 dv-cinder-828806-6-smb devstack@keystone.service[82026]: [pid: 82026|app: 0|req: 668/1348] 10.222.0.33 () {58 vars in 1024 bytes} [Tue Sep 13 19:52:32 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 177 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 19:52:32.853640 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfdebfe7-c774-4e07-a787-3d48db6af784 None None] Authenticating user token {{(pid=82025) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:52:32.855233 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.fernet_utils [None req-dfdebfe7-c774-4e07-a787-3d48db6af784 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82025) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 19:52:32.913857 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG dbcounter [-] [82025] Writing DB stats keystone:SELECT=100 {{(pid=82025) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:52:32.960305 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfdebfe7-c774-4e07-a787-3d48db6af784 None None] Validating token access rules against request {{(pid=82025) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:52:33.034813 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cad455da-d8c4-4399-a785-fbf24478a2c9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '023a2c79c2444611b3d431928e56685d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8c6fba0f15b4d6a84ff601919b7b8e4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82025) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:52:33.035464 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cad455da-d8c4-4399-a785-fbf24478a2c9 service neutron] REQUEST_METHOD: `GET` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:52:33.035744 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cad455da-d8c4-4399-a785-fbf24478a2c9 service neutron] SCRIPT_NAME: `/identity` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:52:33.036017 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cad455da-d8c4-4399-a785-fbf24478a2c9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:52:33.037604 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.fernet_utils [None req-cad455da-d8c4-4399-a785-fbf24478a2c9 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82025) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 19:52:33.144866 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG dbcounter [-] [82025] Writing DB stats keystone:SELECT=100 {{(pid=82025) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:52:33.148432 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cad455da-d8c4-4399-a785-fbf24478a2c9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:52:33.153166 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cad455da-d8c4-4399-a785-fbf24478a2c9 service neutron] RBAC: Authorization granted {{(pid=82025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:52:33.168274 dv-cinder-828806-6-smb devstack@keystone.service[82025]: [pid: 82025|app: 0|req: 681/1349] 10.222.0.33 () {60 vars in 1365 bytes} [Tue Sep 13 19:52:32 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 315 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 19:52:38.098884 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a9cbd70-1792-470d-844d-1c95e5fa4d21 None None] REQUEST_METHOD: `GET` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:52:38.099449 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a9cbd70-1792-470d-844d-1c95e5fa4d21 None None] SCRIPT_NAME: `/identity` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:52:38.099449 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a9cbd70-1792-470d-844d-1c95e5fa4d21 None None] PATH_INFO: `/` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:52:38.100817 dv-cinder-828806-6-smb devstack@keystone.service[82026]: [pid: 82026|app: 0|req: 669/1350] 10.222.0.33 () {54 vars in 921 bytes} [Tue Sep 13 19:52:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 19:52:38.108603 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf12919d-e794-4849-8b51-cbcb4ecfc134 None None] REQUEST_METHOD: `POST` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:52:38.109052 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf12919d-e794-4849-8b51-cbcb4ecfc134 None None] SCRIPT_NAME: `/identity` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:52:38.109158 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf12919d-e794-4849-8b51-cbcb4ecfc134 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:52:38.223998 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.auth.core [None req-bf12919d-e794-4849-8b51-cbcb4ecfc134 None None] MFA Rules not processed for user `060ea3dea2134429967c164bd158b272`. Rule list: `[]` (Enabled: `True`). {{(pid=82025) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 19:52:38.225538 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.fernet_utils [None req-bf12919d-e794-4849-8b51-cbcb4ecfc134 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82025) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 19:52:38.393168 dv-cinder-828806-6-smb devstack@keystone.service[82025]: [pid: 82025|app: 0|req: 682/1351] 10.222.0.33 () {58 vars in 1018 bytes} [Tue Sep 13 19:52:38 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 287 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 19:52:42.550003 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00775586-7278-4270-8973-1b9e7ca39e98 None None] REQUEST_METHOD: `GET` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:52:42.551057 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00775586-7278-4270-8973-1b9e7ca39e98 None None] SCRIPT_NAME: `/identity` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:52:42.551560 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00775586-7278-4270-8973-1b9e7ca39e98 None None] PATH_INFO: `/` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:52:42.553396 dv-cinder-828806-6-smb devstack@keystone.service[82026]: [pid: 82026|app: 0|req: 670/1352] 10.222.0.33 () {54 vars in 921 bytes} [Tue Sep 13 19:52:42 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 19:52:42.558207 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c22e51dd-6227-42a5-b845-6724bde02892 None None] REQUEST_METHOD: `POST` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:52:42.558665 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c22e51dd-6227-42a5-b845-6724bde02892 None None] SCRIPT_NAME: `/identity` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:52:42.558778 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c22e51dd-6227-42a5-b845-6724bde02892 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:52:42.573859 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG dbcounter [-] [82026] Writing DB stats keystone:SELECT=59 {{(pid=82026) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:52:42.614236 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG dbcounter [-] [82025] Writing DB stats keystone:SELECT=100 {{(pid=82025) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:52:42.636662 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.auth.core [None req-c22e51dd-6227-42a5-b845-6724bde02892 None None] MFA Rules not processed for user `060ea3dea2134429967c164bd158b272`. Rule list: `[]` (Enabled: `True`). {{(pid=82025) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 19:52:42.637877 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.fernet_utils [None req-c22e51dd-6227-42a5-b845-6724bde02892 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82025) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 19:52:42.759114 dv-cinder-828806-6-smb devstack@keystone.service[82025]: [pid: 82025|app: 0|req: 683/1353] 10.222.0.33 () {58 vars in 1018 bytes} [Tue Sep 13 19:52:42 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 202 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 19:52:44.140258 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d28309f-4a50-4167-9cff-478ba774bff4 None None] REQUEST_METHOD: `GET` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:52:44.140803 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d28309f-4a50-4167-9cff-478ba774bff4 None None] SCRIPT_NAME: `/identity` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:52:44.140803 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d28309f-4a50-4167-9cff-478ba774bff4 None None] PATH_INFO: `/` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:52:44.142154 dv-cinder-828806-6-smb devstack@keystone.service[82026]: [pid: 82026|app: 0|req: 671/1354] 10.222.0.33 () {54 vars in 921 bytes} [Tue Sep 13 19:52:44 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 19:52:44.147530 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-444cce23-5d63-4b44-bd56-9424a0987dea None None] REQUEST_METHOD: `POST` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:52:44.147978 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-444cce23-5d63-4b44-bd56-9424a0987dea None None] SCRIPT_NAME: `/identity` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:52:44.148093 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-444cce23-5d63-4b44-bd56-9424a0987dea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:52:44.228036 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.auth.core [None req-444cce23-5d63-4b44-bd56-9424a0987dea None None] MFA Rules not processed for user `060ea3dea2134429967c164bd158b272`. Rule list: `[]` (Enabled: `True`). {{(pid=82025) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 19:52:44.229245 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.fernet_utils [None req-444cce23-5d63-4b44-bd56-9424a0987dea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82025) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 19:52:44.272475 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG dbcounter [-] [82025] Writing DB stats keystone:SELECT=100 {{(pid=82025) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:52:44.340127 dv-cinder-828806-6-smb devstack@keystone.service[82025]: [pid: 82025|app: 0|req: 684/1355] 10.222.0.33 () {58 vars in 1018 bytes} [Tue Sep 13 19:52:44 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 194 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 19:52:48.111992 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d29eb14-4000-460d-ad95-9649388ca63f None None] REQUEST_METHOD: `GET` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:52:48.112525 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d29eb14-4000-460d-ad95-9649388ca63f None None] SCRIPT_NAME: `/identity` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:52:48.112525 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d29eb14-4000-460d-ad95-9649388ca63f None None] PATH_INFO: `/` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:52:48.113860 dv-cinder-828806-6-smb devstack@keystone.service[82026]: [pid: 82026|app: 0|req: 672/1356] 10.222.0.33 () {54 vars in 927 bytes} [Tue Sep 13 19:52:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 19:52:48.119460 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9788aaef-6a4e-4c55-b147-2da465bdcbdc None None] REQUEST_METHOD: `POST` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:52:48.119914 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9788aaef-6a4e-4c55-b147-2da465bdcbdc None None] SCRIPT_NAME: `/identity` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:52:48.120200 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9788aaef-6a4e-4c55-b147-2da465bdcbdc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:52:48.191818 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.auth.core [None req-9788aaef-6a4e-4c55-b147-2da465bdcbdc None None] MFA Rules not processed for user `57539b6a6f3b4d589f5f5e1d211cd6a0`. Rule list: `[]` (Enabled: `True`). {{(pid=82025) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 19:52:48.193028 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.fernet_utils [None req-9788aaef-6a4e-4c55-b147-2da465bdcbdc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82025) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 19:52:48.299588 dv-cinder-828806-6-smb devstack@keystone.service[82025]: [pid: 82025|app: 0|req: 685/1357] 10.222.0.33 () {58 vars in 1024 bytes} [Tue Sep 13 19:52:48 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 181 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 19:52:48.613622 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2798b61f-cbe5-4d31-baef-8c83493c2988 None None] REQUEST_METHOD: `GET` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:52:48.623200 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2798b61f-cbe5-4d31-baef-8c83493c2988 None None] SCRIPT_NAME: `/identity` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:52:48.623200 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2798b61f-cbe5-4d31-baef-8c83493c2988 None None] PATH_INFO: `/` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:52:48.623200 dv-cinder-828806-6-smb devstack@keystone.service[82026]: [pid: 82026|app: 0|req: 673/1358] 10.222.0.33 () {54 vars in 962 bytes} [Tue Sep 13 19:52:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 19:52:48.629849 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf361573-1588-47a6-8fa0-b6d755ad720a None None] REQUEST_METHOD: `POST` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:52:48.630151 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf361573-1588-47a6-8fa0-b6d755ad720a None None] SCRIPT_NAME: `/identity` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:52:48.630432 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf361573-1588-47a6-8fa0-b6d755ad720a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:52:48.649461 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG dbcounter [-] [82025] Writing DB stats keystone:SELECT=100 {{(pid=82025) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:52:48.718394 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.auth.core [None req-cf361573-1588-47a6-8fa0-b6d755ad720a None None] MFA Rules not processed for user `e66e7034abed4e0bad1f4137520c1e70`. Rule list: `[]` (Enabled: `True`). {{(pid=82025) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 19:52:48.719661 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.fernet_utils [None req-cf361573-1588-47a6-8fa0-b6d755ad720a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82025) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 19:52:48.850585 dv-cinder-828806-6-smb devstack@keystone.service[82025]: [pid: 82025|app: 0|req: 686/1359] 10.222.0.33 () {58 vars in 1059 bytes} [Tue Sep 13 19:52:48 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 221 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 19:52:48.860812 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2798b61f-cbe5-4d31-baef-8c83493c2988 None None] Authenticating user token {{(pid=82026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:52:48.862346 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.common.fernet_utils [None req-2798b61f-cbe5-4d31-baef-8c83493c2988 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82026) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 19:52:49.027784 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2798b61f-cbe5-4d31-baef-8c83493c2988 None None] Validating token access rules against request {{(pid=82026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:52:49.105530 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG dbcounter [-] [82026] Writing DB stats keystone:SELECT=100 {{(pid=82026) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:52:49.151118 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f403c0d2-f3fb-4984-ae3d-e0f2a0a4804f service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e66e7034abed4e0bad1f4137520c1e70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8c6fba0f15b4d6a84ff601919b7b8e4', 'project_domain_id': 'default', 'roles': ['service', 'member', 'reader', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:52:49.151959 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f403c0d2-f3fb-4984-ae3d-e0f2a0a4804f service nova] REQUEST_METHOD: `GET` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:52:49.152096 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f403c0d2-f3fb-4984-ae3d-e0f2a0a4804f service nova] SCRIPT_NAME: `/identity` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:52:49.152411 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f403c0d2-f3fb-4984-ae3d-e0f2a0a4804f service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:52:49.154762 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.common.fernet_utils [None req-f403c0d2-f3fb-4984-ae3d-e0f2a0a4804f service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82026) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 19:52:49.255843 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f403c0d2-f3fb-4984-ae3d-e0f2a0a4804f service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:52:49.257447 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f403c0d2-f3fb-4984-ae3d-e0f2a0a4804f service nova] RBAC: Authorization granted {{(pid=82026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:52:49.291457 dv-cinder-828806-6-smb devstack@keystone.service[82026]: [pid: 82026|app: 0|req: 674/1360] 10.222.0.33 () {60 vars in 1365 bytes} [Tue Sep 13 19:52:48 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 431 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 19:52:51.707504 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dfdda31-e5de-4a4e-9988-f2afeffbcfb1 None None] REQUEST_METHOD: `GET` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:52:51.707504 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dfdda31-e5de-4a4e-9988-f2afeffbcfb1 None None] SCRIPT_NAME: `/identity` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:52:51.707504 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dfdda31-e5de-4a4e-9988-f2afeffbcfb1 None None] PATH_INFO: `/` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:52:51.709550 dv-cinder-828806-6-smb devstack@keystone.service[82025]: [pid: 82025|app: 0|req: 687/1361] 10.222.0.33 () {54 vars in 927 bytes} [Tue Sep 13 19:52:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 19:52:51.714133 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7fdb4cf-306d-408a-a662-a64c052c1edf None None] REQUEST_METHOD: `POST` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:52:51.714613 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7fdb4cf-306d-408a-a662-a64c052c1edf None None] SCRIPT_NAME: `/identity` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:52:51.714613 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7fdb4cf-306d-408a-a662-a64c052c1edf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:52:51.794868 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.auth.core [None req-e7fdb4cf-306d-408a-a662-a64c052c1edf None None] MFA Rules not processed for user `57539b6a6f3b4d589f5f5e1d211cd6a0`. Rule list: `[]` (Enabled: `True`). {{(pid=82026) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 19:52:51.796615 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.common.fernet_utils [None req-e7fdb4cf-306d-408a-a662-a64c052c1edf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82026) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 19:52:51.840157 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG dbcounter [-] [82026] Writing DB stats keystone:SELECT=100 {{(pid=82026) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:52:51.906697 dv-cinder-828806-6-smb devstack@keystone.service[82026]: [pid: 82026|app: 0|req: 675/1362] 10.222.0.33 () {58 vars in 1024 bytes} [Tue Sep 13 19:52:51 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 193 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 19:52:52.207556 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dfdda31-e5de-4a4e-9988-f2afeffbcfb1 None None] Authenticating user token {{(pid=82025) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:52:52.209279 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.fernet_utils [None req-4dfdda31-e5de-4a4e-9988-f2afeffbcfb1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82025) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 19:52:52.291391 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG dbcounter [-] [82025] Writing DB stats keystone:SELECT=100 {{(pid=82025) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:52:52.395539 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dfdda31-e5de-4a4e-9988-f2afeffbcfb1 None None] Validating token access rules against request {{(pid=82025) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:52:52.525611 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e475f3b6-1301-490a-8d8c-ec7065a6820e service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e66e7034abed4e0bad1f4137520c1e70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8c6fba0f15b4d6a84ff601919b7b8e4', 'project_domain_id': 'default', 'roles': ['service', 'member', 'reader', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82025) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:52:52.526339 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e475f3b6-1301-490a-8d8c-ec7065a6820e service nova] REQUEST_METHOD: `GET` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:52:52.526631 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e475f3b6-1301-490a-8d8c-ec7065a6820e service nova] SCRIPT_NAME: `/identity` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:52:52.526912 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e475f3b6-1301-490a-8d8c-ec7065a6820e service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:52:52.529335 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.fernet_utils [None req-e475f3b6-1301-490a-8d8c-ec7065a6820e service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82025) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 19:52:52.554621 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG dbcounter [-] [82025] Writing DB stats keystone:SELECT=100 {{(pid=82025) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:52:52.626186 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e475f3b6-1301-490a-8d8c-ec7065a6820e service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:52:52.627823 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e475f3b6-1301-490a-8d8c-ec7065a6820e service nova] RBAC: Authorization granted {{(pid=82025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:52:52.646433 dv-cinder-828806-6-smb devstack@keystone.service[82025]: [pid: 82025|app: 0|req: 688/1363] 10.222.0.33 () {60 vars in 1365 bytes} [Tue Sep 13 19:52:52 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 439 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 19:52:55.368535 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7524cfb3-c1af-42b7-b2da-293b524969c6 None None] REQUEST_METHOD: `GET` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:52:55.369065 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7524cfb3-c1af-42b7-b2da-293b524969c6 None None] SCRIPT_NAME: `/identity` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:52:55.369065 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7524cfb3-c1af-42b7-b2da-293b524969c6 None None] PATH_INFO: `/` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:52:55.370711 dv-cinder-828806-6-smb devstack@keystone.service[82026]: [pid: 82026|app: 0|req: 676/1364] 10.222.0.33 () {54 vars in 927 bytes} [Tue Sep 13 19:52:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 19:52:55.376106 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12686ea0-ec6c-4cff-8643-01974d5b3d55 None None] REQUEST_METHOD: `POST` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:52:55.376530 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12686ea0-ec6c-4cff-8643-01974d5b3d55 None None] SCRIPT_NAME: `/identity` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:52:55.376631 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12686ea0-ec6c-4cff-8643-01974d5b3d55 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:52:55.446943 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.auth.core [None req-12686ea0-ec6c-4cff-8643-01974d5b3d55 None None] MFA Rules not processed for user `57539b6a6f3b4d589f5f5e1d211cd6a0`. Rule list: `[]` (Enabled: `True`). {{(pid=82025) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 19:52:55.448172 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.fernet_utils [None req-12686ea0-ec6c-4cff-8643-01974d5b3d55 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82025) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 19:52:55.552077 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG dbcounter [-] [82025] Writing DB stats keystone:SELECT=100 {{(pid=82025) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:52:55.554863 dv-cinder-828806-6-smb devstack@keystone.service[82025]: [pid: 82025|app: 0|req: 689/1365] 10.222.0.33 () {58 vars in 1024 bytes} [Tue Sep 13 19:52:55 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 180 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 19:52:55.848710 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfbc80c8-5f63-4ffd-a05f-15e7c4e23ce1 None None] REQUEST_METHOD: `GET` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:52:55.849122 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfbc80c8-5f63-4ffd-a05f-15e7c4e23ce1 None None] SCRIPT_NAME: `/identity` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:52:55.849631 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfbc80c8-5f63-4ffd-a05f-15e7c4e23ce1 None None] PATH_INFO: `/` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:52:55.851397 dv-cinder-828806-6-smb devstack@keystone.service[82026]: [pid: 82026|app: 0|req: 677/1366] 10.222.0.33 () {54 vars in 962 bytes} [Tue Sep 13 19:52:55 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 19:52:55.857492 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d849adb-bd23-491c-bf30-f64576860b42 None None] REQUEST_METHOD: `POST` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:52:55.857835 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d849adb-bd23-491c-bf30-f64576860b42 None None] SCRIPT_NAME: `/identity` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:52:55.858476 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d849adb-bd23-491c-bf30-f64576860b42 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:52:55.942026 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.auth.core [None req-2d849adb-bd23-491c-bf30-f64576860b42 None None] MFA Rules not processed for user `e66e7034abed4e0bad1f4137520c1e70`. Rule list: `[]` (Enabled: `True`). {{(pid=82025) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 19:52:55.943456 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.fernet_utils [None req-2d849adb-bd23-491c-bf30-f64576860b42 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82025) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 19:52:56.066053 dv-cinder-828806-6-smb devstack@keystone.service[82025]: [pid: 82025|app: 0|req: 690/1367] 10.222.0.33 () {58 vars in 1059 bytes} [Tue Sep 13 19:52:55 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 210 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 13 19:52:56.074214 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfbc80c8-5f63-4ffd-a05f-15e7c4e23ce1 None None] Authenticating user token {{(pid=82026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:52:56.076331 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.common.fernet_utils [None req-bfbc80c8-5f63-4ffd-a05f-15e7c4e23ce1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82026) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 19:52:56.238478 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfbc80c8-5f63-4ffd-a05f-15e7c4e23ce1 None None] Validating token access rules against request {{(pid=82026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:52:56.260212 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG dbcounter [-] [82026] Writing DB stats keystone:SELECT=100 {{(pid=82026) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:52:56.374278 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fff4bcc5-2b6b-4a5c-bda2-9c4fd05a57d1 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e66e7034abed4e0bad1f4137520c1e70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8c6fba0f15b4d6a84ff601919b7b8e4', 'project_domain_id': 'default', 'roles': ['service', 'member', 'reader', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:52:56.374957 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fff4bcc5-2b6b-4a5c-bda2-9c4fd05a57d1 service nova] REQUEST_METHOD: `GET` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:52:56.375223 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fff4bcc5-2b6b-4a5c-bda2-9c4fd05a57d1 service nova] SCRIPT_NAME: `/identity` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:52:56.375476 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fff4bcc5-2b6b-4a5c-bda2-9c4fd05a57d1 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:52:56.377099 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.common.fernet_utils [None req-fff4bcc5-2b6b-4a5c-bda2-9c4fd05a57d1 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82026) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 19:52:56.459682 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89104a92-8c98-4cd0-ba89-44d0380310d9 None None] REQUEST_METHOD: `GET` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:52:56.460204 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89104a92-8c98-4cd0-ba89-44d0380310d9 None None] SCRIPT_NAME: `/identity` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:52:56.460287 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89104a92-8c98-4cd0-ba89-44d0380310d9 None None] PATH_INFO: `/` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:52:56.461848 dv-cinder-828806-6-smb devstack@keystone.service[82025]: [pid: 82025|app: 0|req: 691/1368] 10.222.0.33 () {54 vars in 927 bytes} [Tue Sep 13 19:52:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 13 19:52:56.467320 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80422b34-cf37-436f-b19c-816d97d03eac None None] REQUEST_METHOD: `POST` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:52:56.467530 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80422b34-cf37-436f-b19c-816d97d03eac None None] SCRIPT_NAME: `/identity` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:52:56.467872 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80422b34-cf37-436f-b19c-816d97d03eac None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:52:56.474665 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fff4bcc5-2b6b-4a5c-bda2-9c4fd05a57d1 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:52:56.476370 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fff4bcc5-2b6b-4a5c-bda2-9c4fd05a57d1 service nova] RBAC: Authorization granted {{(pid=82026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:52:56.500415 dv-cinder-828806-6-smb devstack@keystone.service[82026]: [pid: 82026|app: 0|req: 678/1369] 10.222.0.33 () {60 vars in 1365 bytes} [Tue Sep 13 19:52:56 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 426 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 19:52:56.535395 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG dbcounter [-] [82025] Writing DB stats keystone:SELECT=100 {{(pid=82025) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:52:56.543771 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.auth.core [None req-80422b34-cf37-436f-b19c-816d97d03eac None None] MFA Rules not processed for user `57539b6a6f3b4d589f5f5e1d211cd6a0`. Rule list: `[]` (Enabled: `True`). {{(pid=82025) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 19:52:56.545941 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.fernet_utils [None req-80422b34-cf37-436f-b19c-816d97d03eac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82025) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 19:52:56.661972 dv-cinder-828806-6-smb devstack@keystone.service[82025]: [pid: 82025|app: 0|req: 692/1370] 10.222.0.33 () {58 vars in 1024 bytes} [Tue Sep 13 19:52:56 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 196 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 13 19:52:57.006096 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90f21c88-0d8d-4b95-a0a4-fb130041d272 None None] REQUEST_METHOD: `GET` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:52:57.006096 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90f21c88-0d8d-4b95-a0a4-fb130041d272 None None] SCRIPT_NAME: `/identity` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:52:57.006096 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90f21c88-0d8d-4b95-a0a4-fb130041d272 None None] PATH_INFO: `/` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:52:57.007805 dv-cinder-828806-6-smb devstack@keystone.service[82026]: [pid: 82026|app: 0|req: 679/1371] 10.222.0.33 () {54 vars in 964 bytes} [Tue Sep 13 19:52:57 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 19:52:57.012447 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e029770b-f675-4e5b-b63f-7f0d8aa6b82c None None] REQUEST_METHOD: `POST` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:52:57.012827 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e029770b-f675-4e5b-b63f-7f0d8aa6b82c None None] SCRIPT_NAME: `/identity` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:52:57.013208 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e029770b-f675-4e5b-b63f-7f0d8aa6b82c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:52:57.095227 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.auth.core [None req-e029770b-f675-4e5b-b63f-7f0d8aa6b82c None None] MFA Rules not processed for user `46024fc6167f4321818b1bed27a521a0`. Rule list: `[]` (Enabled: `True`). {{(pid=82025) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 19:52:57.096725 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.fernet_utils [None req-e029770b-f675-4e5b-b63f-7f0d8aa6b82c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82025) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 19:52:57.173082 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG dbcounter [-] [82025] Writing DB stats keystone:SELECT=100 {{(pid=82025) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:52:57.182367 dv-cinder-828806-6-smb devstack@keystone.service[82025]: [pid: 82025|app: 0|req: 693/1372] 10.222.0.33 () {58 vars in 1061 bytes} [Tue Sep 13 19:52:57 2022] POST /identity/v3/auth/tokens => generated 3120 bytes in 171 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 13 19:52:57.191129 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90f21c88-0d8d-4b95-a0a4-fb130041d272 None None] Authenticating user token {{(pid=82026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:52:57.192882 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.common.fernet_utils [None req-90f21c88-0d8d-4b95-a0a4-fb130041d272 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82026) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 19:52:57.226523 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG dbcounter [-] [82026] Writing DB stats keystone:SELECT=100 {{(pid=82026) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:52:57.315779 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90f21c88-0d8d-4b95-a0a4-fb130041d272 None None] Validating token access rules against request {{(pid=82026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:52:57.396811 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7695a042-21b9-4d94-9577-fb5406029e03 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46024fc6167f4321818b1bed27a521a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8c6fba0f15b4d6a84ff601919b7b8e4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:52:57.397415 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7695a042-21b9-4d94-9577-fb5406029e03 service cinder] REQUEST_METHOD: `GET` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:52:57.397695 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7695a042-21b9-4d94-9577-fb5406029e03 service cinder] SCRIPT_NAME: `/identity` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:52:57.397968 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7695a042-21b9-4d94-9577-fb5406029e03 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:52:57.399631 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.common.fernet_utils [None req-7695a042-21b9-4d94-9577-fb5406029e03 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82026) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 19:52:57.489490 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG dbcounter [-] [82026] Writing DB stats keystone:SELECT=100 {{(pid=82026) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:52:57.527913 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7695a042-21b9-4d94-9577-fb5406029e03 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=82026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:52:57.529784 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7695a042-21b9-4d94-9577-fb5406029e03 service cinder] RBAC: Authorization granted {{(pid=82026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:52:57.551831 dv-cinder-828806-6-smb devstack@keystone.service[82026]: [pid: 82026|app: 0|req: 680/1373] 10.222.0.33 () {60 vars in 1365 bytes} [Tue Sep 13 19:52:57 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 361 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 13 19:52:58.914645 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed58dfd6-804f-4d3a-8fdb-a9aee1cf9af2 None None] REQUEST_METHOD: `GET` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:52:58.915255 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed58dfd6-804f-4d3a-8fdb-a9aee1cf9af2 None None] SCRIPT_NAME: `/identity` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:52:58.915255 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed58dfd6-804f-4d3a-8fdb-a9aee1cf9af2 None None] PATH_INFO: `/` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:52:58.916764 dv-cinder-828806-6-smb devstack@keystone.service[82025]: [pid: 82025|app: 0|req: 694/1374] 10.222.0.33 () {54 vars in 927 bytes} [Tue Sep 13 19:52:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 19:52:58.921968 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8b21403-4d77-4c06-b9ea-31aebecb21a0 None None] REQUEST_METHOD: `POST` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:52:58.922376 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8b21403-4d77-4c06-b9ea-31aebecb21a0 None None] SCRIPT_NAME: `/identity` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:52:58.922535 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8b21403-4d77-4c06-b9ea-31aebecb21a0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:52:58.991227 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.auth.core [None req-d8b21403-4d77-4c06-b9ea-31aebecb21a0 None None] MFA Rules not processed for user `57539b6a6f3b4d589f5f5e1d211cd6a0`. Rule list: `[]` (Enabled: `True`). {{(pid=82026) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 19:52:58.992469 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.common.fernet_utils [None req-d8b21403-4d77-4c06-b9ea-31aebecb21a0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82026) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 19:52:59.095981 dv-cinder-828806-6-smb devstack@keystone.service[82026]: [pid: 82026|app: 0|req: 681/1375] 10.222.0.33 () {58 vars in 1024 bytes} [Tue Sep 13 19:52:58 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 175 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 19:52:59.385126 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed58dfd6-804f-4d3a-8fdb-a9aee1cf9af2 None None] Authenticating user token {{(pid=82025) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:52:59.386664 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.fernet_utils [None req-ed58dfd6-804f-4d3a-8fdb-a9aee1cf9af2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82025) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 19:52:59.541555 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed58dfd6-804f-4d3a-8fdb-a9aee1cf9af2 None None] Validating token access rules against request {{(pid=82025) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:52:59.613637 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG dbcounter [-] [82025] Writing DB stats keystone:SELECT=100 {{(pid=82025) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:52:59.664480 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6289450-1ec6-4b24-9fdf-2777d59d3a1e service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e66e7034abed4e0bad1f4137520c1e70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8c6fba0f15b4d6a84ff601919b7b8e4', 'project_domain_id': 'default', 'roles': ['service', 'member', 'reader', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82025) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:52:59.665109 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6289450-1ec6-4b24-9fdf-2777d59d3a1e service nova] REQUEST_METHOD: `GET` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:52:59.665397 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6289450-1ec6-4b24-9fdf-2777d59d3a1e service nova] SCRIPT_NAME: `/identity` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:52:59.665691 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6289450-1ec6-4b24-9fdf-2777d59d3a1e service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:52:59.667331 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.fernet_utils [None req-e6289450-1ec6-4b24-9fdf-2777d59d3a1e service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82025) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 19:52:59.767878 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6289450-1ec6-4b24-9fdf-2777d59d3a1e service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:52:59.769477 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6289450-1ec6-4b24-9fdf-2777d59d3a1e service nova] RBAC: Authorization granted {{(pid=82025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:52:59.795707 dv-cinder-828806-6-smb devstack@keystone.service[82025]: [pid: 82025|app: 0|req: 695/1376] 10.222.0.33 () {60 vars in 1365 bytes} [Tue Sep 13 19:52:59 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 406 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 19:53:02.203795 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a520bb5e-08d6-4d37-9622-46bbfadc1dc6 None None] REQUEST_METHOD: `GET` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:53:02.204335 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a520bb5e-08d6-4d37-9622-46bbfadc1dc6 None None] SCRIPT_NAME: `/identity` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:53:02.204335 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a520bb5e-08d6-4d37-9622-46bbfadc1dc6 None None] PATH_INFO: `/` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:53:02.205869 dv-cinder-828806-6-smb devstack@keystone.service[82026]: [pid: 82026|app: 0|req: 682/1377] 10.222.0.33 () {54 vars in 927 bytes} [Tue Sep 13 19:53:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 19:53:02.211000 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1d70ce0-84a1-40a2-be6d-4a7efe3fd8b0 None None] REQUEST_METHOD: `POST` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:53:02.211409 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1d70ce0-84a1-40a2-be6d-4a7efe3fd8b0 None None] SCRIPT_NAME: `/identity` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:53:02.211592 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1d70ce0-84a1-40a2-be6d-4a7efe3fd8b0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:53:02.288034 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.auth.core [None req-e1d70ce0-84a1-40a2-be6d-4a7efe3fd8b0 None None] MFA Rules not processed for user `57539b6a6f3b4d589f5f5e1d211cd6a0`. Rule list: `[]` (Enabled: `True`). {{(pid=82025) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 19:53:02.289261 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.fernet_utils [None req-e1d70ce0-84a1-40a2-be6d-4a7efe3fd8b0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82025) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 19:53:02.322380 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG dbcounter [-] [82025] Writing DB stats keystone:SELECT=100 {{(pid=82025) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:53:02.397622 dv-cinder-828806-6-smb devstack@keystone.service[82025]: [pid: 82025|app: 0|req: 696/1378] 10.222.0.33 () {58 vars in 1024 bytes} [Tue Sep 13 19:53:02 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 187 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 19:53:02.703320 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a520bb5e-08d6-4d37-9622-46bbfadc1dc6 None None] Authenticating user token {{(pid=82026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:53:02.705158 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.common.fernet_utils [None req-a520bb5e-08d6-4d37-9622-46bbfadc1dc6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82026) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 19:53:02.746576 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG dbcounter [-] [82026] Writing DB stats keystone:SELECT=100 {{(pid=82026) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:53:02.877938 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a520bb5e-08d6-4d37-9622-46bbfadc1dc6 None None] Validating token access rules against request {{(pid=82026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:53:03.006152 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG dbcounter [-] [82026] Writing DB stats keystone:SELECT=100 {{(pid=82026) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:53:03.011740 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c9c3f80-6580-4ef9-9637-4589d18498ec service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e66e7034abed4e0bad1f4137520c1e70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8c6fba0f15b4d6a84ff601919b7b8e4', 'project_domain_id': 'default', 'roles': ['service', 'member', 'reader', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:53:03.017195 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c9c3f80-6580-4ef9-9637-4589d18498ec service nova] REQUEST_METHOD: `GET` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:53:03.017195 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c9c3f80-6580-4ef9-9637-4589d18498ec service nova] SCRIPT_NAME: `/identity` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:53:03.017195 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c9c3f80-6580-4ef9-9637-4589d18498ec service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:53:03.017195 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.common.fernet_utils [None req-5c9c3f80-6580-4ef9-9637-4589d18498ec service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82026) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 19:53:03.120968 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c9c3f80-6580-4ef9-9637-4589d18498ec service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:53:03.122876 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c9c3f80-6580-4ef9-9637-4589d18498ec service nova] RBAC: Authorization granted {{(pid=82026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:53:03.145329 dv-cinder-828806-6-smb devstack@keystone.service[82026]: [pid: 82026|app: 0|req: 683/1379] 10.222.0.33 () {60 vars in 1365 bytes} [Tue Sep 13 19:53:02 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 442 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 19:53:05.558145 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8379173b-ec16-4a26-a967-7be16d82201a None None] REQUEST_METHOD: `GET` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:53:05.559078 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8379173b-ec16-4a26-a967-7be16d82201a None None] SCRIPT_NAME: `/identity` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:53:05.559078 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8379173b-ec16-4a26-a967-7be16d82201a None None] PATH_INFO: `/` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:53:05.560012 dv-cinder-828806-6-smb devstack@keystone.service[82025]: [pid: 82025|app: 0|req: 697/1380] 10.222.0.33 () {54 vars in 927 bytes} [Tue Sep 13 19:53:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 19:53:05.566777 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99065992-9c70-4801-ae61-959855a4bbf2 None None] REQUEST_METHOD: `POST` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:53:05.567347 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99065992-9c70-4801-ae61-959855a4bbf2 None None] SCRIPT_NAME: `/identity` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:53:05.567824 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99065992-9c70-4801-ae61-959855a4bbf2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:53:05.670761 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.auth.core [None req-99065992-9c70-4801-ae61-959855a4bbf2 None None] MFA Rules not processed for user `57539b6a6f3b4d589f5f5e1d211cd6a0`. Rule list: `[]` (Enabled: `True`). {{(pid=82026) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 19:53:05.672101 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.common.fernet_utils [None req-99065992-9c70-4801-ae61-959855a4bbf2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82026) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 19:53:05.743604 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG dbcounter [-] [82026] Writing DB stats keystone:SELECT=100 {{(pid=82026) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:53:05.786668 dv-cinder-828806-6-smb devstack@keystone.service[82026]: [pid: 82026|app: 0|req: 684/1381] 10.222.0.33 () {58 vars in 1024 bytes} [Tue Sep 13 19:53:05 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 222 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 19:53:06.094476 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8379173b-ec16-4a26-a967-7be16d82201a None None] Authenticating user token {{(pid=82025) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:53:06.096062 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.fernet_utils [None req-8379173b-ec16-4a26-a967-7be16d82201a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82025) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 19:53:06.270598 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8379173b-ec16-4a26-a967-7be16d82201a None None] Validating token access rules against request {{(pid=82025) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:53:06.285052 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG dbcounter [-] [82025] Writing DB stats keystone:SELECT=100 {{(pid=82025) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:53:06.431753 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-840f6a4e-cbca-4813-bdff-50e670f68d83 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e66e7034abed4e0bad1f4137520c1e70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8c6fba0f15b4d6a84ff601919b7b8e4', 'project_domain_id': 'default', 'roles': ['service', 'member', 'reader', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82025) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:53:06.432308 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-840f6a4e-cbca-4813-bdff-50e670f68d83 service nova] REQUEST_METHOD: `GET` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:53:06.432607 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-840f6a4e-cbca-4813-bdff-50e670f68d83 service nova] SCRIPT_NAME: `/identity` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:53:06.432947 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-840f6a4e-cbca-4813-bdff-50e670f68d83 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:53:06.434585 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.fernet_utils [None req-840f6a4e-cbca-4813-bdff-50e670f68d83 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82025) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 19:53:06.529685 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-840f6a4e-cbca-4813-bdff-50e670f68d83 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:53:06.531353 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-840f6a4e-cbca-4813-bdff-50e670f68d83 service nova] RBAC: Authorization granted {{(pid=82025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:53:06.552359 dv-cinder-828806-6-smb devstack@keystone.service[82025]: [pid: 82025|app: 0|req: 698/1382] 10.222.0.33 () {60 vars in 1365 bytes} [Tue Sep 13 19:53:06 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 458 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 19:53:08.995941 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db30bdd4-8e37-4519-aaf5-e96e14725c54 None None] REQUEST_METHOD: `GET` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:53:08.996527 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db30bdd4-8e37-4519-aaf5-e96e14725c54 None None] SCRIPT_NAME: `/identity` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:53:08.996527 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db30bdd4-8e37-4519-aaf5-e96e14725c54 None None] PATH_INFO: `/` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:53:08.998524 dv-cinder-828806-6-smb devstack@keystone.service[82026]: [pid: 82026|app: 0|req: 685/1383] 10.222.0.33 () {54 vars in 927 bytes} [Tue Sep 13 19:53:08 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 19:53:09.004215 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac40e095-401e-433d-af89-928f92501b42 None None] REQUEST_METHOD: `POST` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:53:09.004672 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac40e095-401e-433d-af89-928f92501b42 None None] SCRIPT_NAME: `/identity` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:53:09.004771 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac40e095-401e-433d-af89-928f92501b42 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:53:09.026385 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG dbcounter [-] [82025] Writing DB stats keystone:SELECT=100 {{(pid=82025) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:53:09.073863 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.auth.core [None req-ac40e095-401e-433d-af89-928f92501b42 None None] MFA Rules not processed for user `57539b6a6f3b4d589f5f5e1d211cd6a0`. Rule list: `[]` (Enabled: `True`). {{(pid=82025) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 19:53:09.075057 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.fernet_utils [None req-ac40e095-401e-433d-af89-928f92501b42 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82025) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 19:53:09.195105 dv-cinder-828806-6-smb devstack@keystone.service[82025]: [pid: 82025|app: 0|req: 699/1384] 10.222.0.33 () {58 vars in 1024 bytes} [Tue Sep 13 19:53:09 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 192 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 19:53:09.488081 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db30bdd4-8e37-4519-aaf5-e96e14725c54 None None] Authenticating user token {{(pid=82026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:53:09.490825 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.common.fernet_utils [None req-db30bdd4-8e37-4519-aaf5-e96e14725c54 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82026) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 19:53:09.691515 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db30bdd4-8e37-4519-aaf5-e96e14725c54 None None] Validating token access rules against request {{(pid=82026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:53:09.747439 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG dbcounter [-] [82026] Writing DB stats keystone:SELECT=100 {{(pid=82026) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:53:09.850531 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5abc343-20b0-46ff-b830-022ef3d27d30 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e66e7034abed4e0bad1f4137520c1e70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8c6fba0f15b4d6a84ff601919b7b8e4', 'project_domain_id': 'default', 'roles': ['service', 'member', 'reader', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:53:09.851181 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5abc343-20b0-46ff-b830-022ef3d27d30 service nova] REQUEST_METHOD: `GET` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:53:09.851474 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5abc343-20b0-46ff-b830-022ef3d27d30 service nova] SCRIPT_NAME: `/identity` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:53:09.852120 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5abc343-20b0-46ff-b830-022ef3d27d30 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:53:09.853421 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.common.fernet_utils [None req-e5abc343-20b0-46ff-b830-022ef3d27d30 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82026) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 19:53:09.978305 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5abc343-20b0-46ff-b830-022ef3d27d30 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:53:09.978305 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5abc343-20b0-46ff-b830-022ef3d27d30 service nova] RBAC: Authorization granted {{(pid=82026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:53:09.999845 dv-cinder-828806-6-smb devstack@keystone.service[82026]: [pid: 82026|app: 0|req: 686/1385] 10.222.0.33 () {60 vars in 1365 bytes} [Tue Sep 13 19:53:09 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 513 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 19:53:12.249605 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70469669-c416-4129-abd5-7387c80f9e8e None None] REQUEST_METHOD: `GET` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:53:12.250352 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70469669-c416-4129-abd5-7387c80f9e8e None None] SCRIPT_NAME: `/identity` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:53:12.250352 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70469669-c416-4129-abd5-7387c80f9e8e None None] PATH_INFO: `/` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:53:12.251602 dv-cinder-828806-6-smb devstack@keystone.service[82025]: [pid: 82025|app: 0|req: 700/1386] 10.222.0.33 () {54 vars in 927 bytes} [Tue Sep 13 19:53:12 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 13 19:53:12.258337 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adcc3876-fecb-46e0-a878-c162f5351f1b None None] REQUEST_METHOD: `POST` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:53:12.258857 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adcc3876-fecb-46e0-a878-c162f5351f1b None None] SCRIPT_NAME: `/identity` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:53:12.258954 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adcc3876-fecb-46e0-a878-c162f5351f1b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:53:12.333292 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.auth.core [None req-adcc3876-fecb-46e0-a878-c162f5351f1b None None] MFA Rules not processed for user `57539b6a6f3b4d589f5f5e1d211cd6a0`. Rule list: `[]` (Enabled: `True`). {{(pid=82026) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 19:53:12.334506 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.common.fernet_utils [None req-adcc3876-fecb-46e0-a878-c162f5351f1b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82026) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 19:53:12.343303 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG dbcounter [-] [82026] Writing DB stats keystone:SELECT=100 {{(pid=82026) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:53:12.432405 dv-cinder-828806-6-smb devstack@keystone.service[82026]: [pid: 82026|app: 0|req: 687/1387] 10.222.0.33 () {58 vars in 1024 bytes} [Tue Sep 13 19:53:12 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 175 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 19:53:12.727862 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70469669-c416-4129-abd5-7387c80f9e8e None None] Authenticating user token {{(pid=82025) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:53:12.729405 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.fernet_utils [None req-70469669-c416-4129-abd5-7387c80f9e8e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82025) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 19:53:12.834346 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG dbcounter [-] [82025] Writing DB stats keystone:SELECT=100 {{(pid=82025) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:53:12.893290 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70469669-c416-4129-abd5-7387c80f9e8e None None] Validating token access rules against request {{(pid=82025) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:53:13.009411 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c483542e-9c28-46c6-86ba-71635a910165 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e66e7034abed4e0bad1f4137520c1e70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8c6fba0f15b4d6a84ff601919b7b8e4', 'project_domain_id': 'default', 'roles': ['service', 'member', 'reader', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82025) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:53:13.009965 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c483542e-9c28-46c6-86ba-71635a910165 service nova] REQUEST_METHOD: `GET` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:53:13.010250 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c483542e-9c28-46c6-86ba-71635a910165 service nova] SCRIPT_NAME: `/identity` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:53:13.010523 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c483542e-9c28-46c6-86ba-71635a910165 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:53:13.012157 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.fernet_utils [None req-c483542e-9c28-46c6-86ba-71635a910165 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82025) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 19:53:13.072837 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG dbcounter [-] [82025] Writing DB stats keystone:SELECT=100 {{(pid=82025) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:53:13.103685 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c483542e-9c28-46c6-86ba-71635a910165 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:53:13.105338 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c483542e-9c28-46c6-86ba-71635a910165 service nova] RBAC: Authorization granted {{(pid=82025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:53:13.127582 dv-cinder-828806-6-smb devstack@keystone.service[82025]: [pid: 82025|app: 0|req: 701/1388] 10.222.0.33 () {60 vars in 1365 bytes} [Tue Sep 13 19:53:12 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 400 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 19:53:13.234920 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81db3d32-9cca-40e9-8462-00be1277046f None None] REQUEST_METHOD: `GET` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:53:13.235244 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81db3d32-9cca-40e9-8462-00be1277046f None None] SCRIPT_NAME: `/identity` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:53:13.235538 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81db3d32-9cca-40e9-8462-00be1277046f None None] PATH_INFO: `/` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:53:13.236889 dv-cinder-828806-6-smb devstack@keystone.service[82026]: [pid: 82026|app: 0|req: 688/1389] 10.222.0.33 () {54 vars in 927 bytes} [Tue Sep 13 19:53:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 19:53:13.242112 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2795f923-cbf2-41cb-8996-48f435bf9aec None None] REQUEST_METHOD: `POST` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:53:13.242404 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2795f923-cbf2-41cb-8996-48f435bf9aec None None] SCRIPT_NAME: `/identity` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:53:13.242745 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2795f923-cbf2-41cb-8996-48f435bf9aec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:53:13.314464 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.auth.core [None req-2795f923-cbf2-41cb-8996-48f435bf9aec None None] MFA Rules not processed for user `57539b6a6f3b4d589f5f5e1d211cd6a0`. Rule list: `[]` (Enabled: `True`). {{(pid=82025) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 19:53:13.315705 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.fernet_utils [None req-2795f923-cbf2-41cb-8996-48f435bf9aec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82025) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 19:53:13.425837 dv-cinder-828806-6-smb devstack@keystone.service[82025]: [pid: 82025|app: 0|req: 702/1390] 10.222.0.33 () {58 vars in 1024 bytes} [Tue Sep 13 19:53:13 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 185 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 19:53:13.725663 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-507407e3-fc72-4039-8515-38ebded1ce82 None None] REQUEST_METHOD: `GET` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:53:13.726118 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-507407e3-fc72-4039-8515-38ebded1ce82 None None] SCRIPT_NAME: `/identity` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:53:13.726221 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-507407e3-fc72-4039-8515-38ebded1ce82 None None] PATH_INFO: `/` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:53:13.727608 dv-cinder-828806-6-smb devstack@keystone.service[82026]: [pid: 82026|app: 0|req: 689/1391] 10.222.0.33 () {54 vars in 966 bytes} [Tue Sep 13 19:53:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 19:53:13.732763 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd40ed08-30f8-41e4-afe3-efa62159555f None None] REQUEST_METHOD: `POST` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:53:13.733059 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd40ed08-30f8-41e4-afe3-efa62159555f None None] SCRIPT_NAME: `/identity` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:53:13.733346 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd40ed08-30f8-41e4-afe3-efa62159555f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:53:13.780145 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG dbcounter [-] [82025] Writing DB stats keystone:SELECT=100 {{(pid=82025) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:53:13.811585 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.auth.core [None req-fd40ed08-30f8-41e4-afe3-efa62159555f None None] MFA Rules not processed for user `f7b2421bf1f84193a29f79709d1d5a19`. Rule list: `[]` (Enabled: `True`). {{(pid=82025) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 19:53:13.812798 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.fernet_utils [None req-fd40ed08-30f8-41e4-afe3-efa62159555f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82025) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 19:53:13.891233 dv-cinder-828806-6-smb devstack@keystone.service[82025]: [pid: 82025|app: 0|req: 703/1392] 10.222.0.33 () {58 vars in 1063 bytes} [Tue Sep 13 19:53:13 2022] POST /identity/v3/auth/tokens => generated 3120 bytes in 159 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 19:53:13.900091 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-507407e3-fc72-4039-8515-38ebded1ce82 None None] Authenticating user token {{(pid=82026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:53:13.901612 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.common.fernet_utils [None req-507407e3-fc72-4039-8515-38ebded1ce82 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82026) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 19:53:14.008340 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-507407e3-fc72-4039-8515-38ebded1ce82 None None] Validating token access rules against request {{(pid=82026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:53:14.047744 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG dbcounter [-] [82026] Writing DB stats keystone:SELECT=100 {{(pid=82026) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:53:14.085039 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8d9ae4e-e6b7-4356-bc25-0de80869a88a service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f7b2421bf1f84193a29f79709d1d5a19', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8c6fba0f15b4d6a84ff601919b7b8e4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:53:14.085647 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8d9ae4e-e6b7-4356-bc25-0de80869a88a service glance] REQUEST_METHOD: `GET` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:53:14.085932 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8d9ae4e-e6b7-4356-bc25-0de80869a88a service glance] SCRIPT_NAME: `/identity` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:53:14.086211 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8d9ae4e-e6b7-4356-bc25-0de80869a88a service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:53:14.087878 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.common.fernet_utils [None req-b8d9ae4e-e6b7-4356-bc25-0de80869a88a service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82026) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 19:53:14.204138 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8d9ae4e-e6b7-4356-bc25-0de80869a88a service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=82026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:53:14.205615 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8d9ae4e-e6b7-4356-bc25-0de80869a88a service glance] RBAC: Authorization granted {{(pid=82026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:53:14.226667 dv-cinder-828806-6-smb devstack@keystone.service[82026]: [pid: 82026|app: 0|req: 690/1393] 10.222.0.33 () {60 vars in 1365 bytes} [Tue Sep 13 19:53:13 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 327 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 19:53:15.127332 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f57dfd94-23c4-4326-8cd4-c0d829581883 None None] REQUEST_METHOD: `POST` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:53:15.130586 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f57dfd94-23c4-4326-8cd4-c0d829581883 None None] SCRIPT_NAME: `/identity` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:53:15.130586 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f57dfd94-23c4-4326-8cd4-c0d829581883 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:53:15.197172 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.auth.core [None req-f57dfd94-23c4-4326-8cd4-c0d829581883 None None] MFA Rules not processed for user `a28e738b894442e2bc9880eeb64fc0c8`. Rule list: `[]` (Enabled: `True`). {{(pid=82025) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 19:53:15.198395 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.fernet_utils [None req-f57dfd94-23c4-4326-8cd4-c0d829581883 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82025) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 19:53:15.280284 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG dbcounter [-] [82025] Writing DB stats keystone:SELECT=100 {{(pid=82025) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:53:15.287959 dv-cinder-828806-6-smb devstack@keystone.service[82025]: [pid: 82025|app: 0|req: 704/1394] 10.222.0.33 () {58 vars in 1009 bytes} [Tue Sep 13 19:53:15 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 162 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 19:53:15.336997 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb31d161-de18-4ae5-b9d1-8765eb46d242 None None] REQUEST_METHOD: `GET` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:53:15.337481 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb31d161-de18-4ae5-b9d1-8765eb46d242 None None] SCRIPT_NAME: `/identity` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:53:15.337579 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb31d161-de18-4ae5-b9d1-8765eb46d242 None None] PATH_INFO: `/` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:53:15.338931 dv-cinder-828806-6-smb devstack@keystone.service[82026]: [pid: 82026|app: 0|req: 691/1395] 10.222.0.33 () {54 vars in 943 bytes} [Tue Sep 13 19:53:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 19:53:15.346564 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f9cac79-ec06-4e69-8da0-757ffe8c9ace None None] REQUEST_METHOD: `POST` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:53:15.346928 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f9cac79-ec06-4e69-8da0-757ffe8c9ace None None] SCRIPT_NAME: `/identity` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:53:15.347296 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f9cac79-ec06-4e69-8da0-757ffe8c9ace None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:53:15.433193 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.auth.core [None req-2f9cac79-ec06-4e69-8da0-757ffe8c9ace None None] MFA Rules not processed for user `fa5a83574f7f424c805e130c462d5969`. Rule list: `[]` (Enabled: `True`). {{(pid=82025) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 19:53:15.434416 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.fernet_utils [None req-2f9cac79-ec06-4e69-8da0-757ffe8c9ace None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82025) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 19:53:15.494325 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0be86533-57c1-4f87-98e4-8bb6ebe2c804 None None] REQUEST_METHOD: `GET` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:53:15.494726 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0be86533-57c1-4f87-98e4-8bb6ebe2c804 None None] SCRIPT_NAME: `/identity` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:53:15.495189 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0be86533-57c1-4f87-98e4-8bb6ebe2c804 None None] PATH_INFO: `/` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:53:15.496590 dv-cinder-828806-6-smb devstack@keystone.service[82026]: [pid: 82026|app: 0|req: 692/1396] 10.222.0.33 () {54 vars in 927 bytes} [Tue Sep 13 19:53:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 19:53:15.502319 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-637fbf9e-9d60-430e-8ed1-a30dfebc1446 None None] REQUEST_METHOD: `POST` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:53:15.502609 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-637fbf9e-9d60-430e-8ed1-a30dfebc1446 None None] SCRIPT_NAME: `/identity` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:53:15.502890 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-637fbf9e-9d60-430e-8ed1-a30dfebc1446 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:53:15.548814 dv-cinder-828806-6-smb devstack@keystone.service[82025]: [pid: 82025|app: 0|req: 705/1397] 10.222.0.33 () {58 vars in 1040 bytes} [Tue Sep 13 19:53:15 2022] POST /identity/v3/auth/tokens => generated 3304 bytes in 203 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 19:53:15.558443 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f9cac79-ec06-4e69-8da0-757ffe8c9ace None None] Authenticating user token {{(pid=82025) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:53:15.568357 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f9cac79-ec06-4e69-8da0-757ffe8c9ace None None] Validating token access rules against request {{(pid=82025) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:53:15.571596 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.auth.core [None req-637fbf9e-9d60-430e-8ed1-a30dfebc1446 None None] MFA Rules not processed for user `57539b6a6f3b4d589f5f5e1d211cd6a0`. Rule list: `[]` (Enabled: `True`). {{(pid=82026) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 19:53:15.572890 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.common.fernet_utils [None req-637fbf9e-9d60-430e-8ed1-a30dfebc1446 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82026) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 19:53:15.592458 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG dbcounter [-] [82026] Writing DB stats keystone:SELECT=100 {{(pid=82026) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:53:15.618703 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG dbcounter [-] [82025] Writing DB stats keystone:SELECT=100 {{(pid=82025) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:53:15.675073 dv-cinder-828806-6-smb devstack@keystone.service[82026]: [pid: 82026|app: 0|req: 693/1398] 10.222.0.33 () {58 vars in 1024 bytes} [Tue Sep 13 19:53:15 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 172 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 13 19:53:15.675306 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a36f6b3-99fc-4c4a-b4df-711a744d203c service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa5a83574f7f424c805e130c462d5969', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8c6fba0f15b4d6a84ff601919b7b8e4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82025) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:53:15.675435 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a36f6b3-99fc-4c4a-b4df-711a744d203c service swift] REQUEST_METHOD: `GET` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:53:15.675666 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a36f6b3-99fc-4c4a-b4df-711a744d203c service swift] SCRIPT_NAME: `/identity` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:53:15.675939 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a36f6b3-99fc-4c4a-b4df-711a744d203c service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:53:15.677574 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.fernet_utils [None req-9a36f6b3-99fc-4c4a-b4df-711a744d203c service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82025) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 19:53:15.765667 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a36f6b3-99fc-4c4a-b4df-711a744d203c service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=82025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:53:15.767294 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a36f6b3-99fc-4c4a-b4df-711a744d203c service swift] RBAC: Authorization granted {{(pid=82025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:53:15.775323 dv-cinder-828806-6-smb devstack@keystone.service[82025]: [pid: 82025|app: 0|req: 706/1399] 10.222.0.33 () {60 vars in 1384 bytes} [Tue Sep 13 19:53:15 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 217 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Sep 13 19:53:15.972038 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-637fbf9e-9d60-430e-8ed1-a30dfebc1446 None None] Authenticating user token {{(pid=82026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:53:15.973268 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.common.fernet_utils [None req-637fbf9e-9d60-430e-8ed1-a30dfebc1446 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82026) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 19:53:16.087997 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-637fbf9e-9d60-430e-8ed1-a30dfebc1446 None None] Validating token access rules against request {{(pid=82026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:53:16.124821 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG dbcounter [-] [82026] Writing DB stats keystone:SELECT=100 {{(pid=82026) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:53:16.210363 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85cd14b8-2a02-40e1-ac69-7a8fd34bda2e service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e66e7034abed4e0bad1f4137520c1e70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8c6fba0f15b4d6a84ff601919b7b8e4', 'project_domain_id': 'default', 'roles': ['service', 'member', 'reader', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:53:16.211081 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85cd14b8-2a02-40e1-ac69-7a8fd34bda2e service nova] REQUEST_METHOD: `GET` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:53:16.211379 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85cd14b8-2a02-40e1-ac69-7a8fd34bda2e service nova] SCRIPT_NAME: `/identity` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:53:16.211801 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85cd14b8-2a02-40e1-ac69-7a8fd34bda2e service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:53:16.213567 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.common.fernet_utils [None req-85cd14b8-2a02-40e1-ac69-7a8fd34bda2e service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82026) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 19:53:16.346545 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85cd14b8-2a02-40e1-ac69-7a8fd34bda2e service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:53:16.348197 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85cd14b8-2a02-40e1-ac69-7a8fd34bda2e service nova] RBAC: Authorization granted {{(pid=82026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:53:16.370593 dv-cinder-828806-6-smb devstack@keystone.service[82026]: [pid: 82026|app: 0|req: 694/1400] 10.222.0.33 () {60 vars in 1365 bytes} [Tue Sep 13 19:53:15 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 399 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 19:53:19.138908 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-329f77c5-c369-4b29-b239-d87a37ae4976 None None] REQUEST_METHOD: `GET` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:53:19.139564 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-329f77c5-c369-4b29-b239-d87a37ae4976 None None] SCRIPT_NAME: `/identity` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:53:19.139564 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-329f77c5-c369-4b29-b239-d87a37ae4976 None None] PATH_INFO: `/` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:53:19.140869 dv-cinder-828806-6-smb devstack@keystone.service[82025]: [pid: 82025|app: 0|req: 707/1401] 10.222.0.33 () {54 vars in 927 bytes} [Tue Sep 13 19:53:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 19:53:19.146117 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e433428f-1cc9-4ed3-8af9-fc199a47959d None None] REQUEST_METHOD: `POST` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:53:19.146537 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e433428f-1cc9-4ed3-8af9-fc199a47959d None None] SCRIPT_NAME: `/identity` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:53:19.146734 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e433428f-1cc9-4ed3-8af9-fc199a47959d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:53:19.199716 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG dbcounter [-] [82026] Writing DB stats keystone:SELECT=100 {{(pid=82026) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:53:19.220263 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.auth.core [None req-e433428f-1cc9-4ed3-8af9-fc199a47959d None None] MFA Rules not processed for user `57539b6a6f3b4d589f5f5e1d211cd6a0`. Rule list: `[]` (Enabled: `True`). {{(pid=82026) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 19:53:19.221599 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.common.fernet_utils [None req-e433428f-1cc9-4ed3-8af9-fc199a47959d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82026) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 19:53:19.338856 dv-cinder-828806-6-smb devstack@keystone.service[82026]: [pid: 82026|app: 0|req: 695/1402] 10.222.0.33 () {58 vars in 1024 bytes} [Tue Sep 13 19:53:19 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 194 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 19:53:19.634475 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-329f77c5-c369-4b29-b239-d87a37ae4976 None None] Authenticating user token {{(pid=82025) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:53:19.636033 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.fernet_utils [None req-329f77c5-c369-4b29-b239-d87a37ae4976 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82025) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 19:53:19.729528 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG dbcounter [-] [82025] Writing DB stats keystone:SELECT=100 {{(pid=82025) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:53:19.810990 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-329f77c5-c369-4b29-b239-d87a37ae4976 None None] Validating token access rules against request {{(pid=82025) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:53:19.941434 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19b4ec97-04a4-49ab-a677-64bfb697da8a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e66e7034abed4e0bad1f4137520c1e70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8c6fba0f15b4d6a84ff601919b7b8e4', 'project_domain_id': 'default', 'roles': ['service', 'member', 'reader', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82025) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:53:19.942354 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19b4ec97-04a4-49ab-a677-64bfb697da8a service nova] REQUEST_METHOD: `GET` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:53:19.942640 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19b4ec97-04a4-49ab-a677-64bfb697da8a service nova] SCRIPT_NAME: `/identity` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:53:19.942924 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19b4ec97-04a4-49ab-a677-64bfb697da8a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:53:19.944616 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.fernet_utils [None req-19b4ec97-04a4-49ab-a677-64bfb697da8a service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82025) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 19:53:19.996497 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG dbcounter [-] [82025] Writing DB stats keystone:SELECT=100 {{(pid=82025) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:53:20.055422 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19b4ec97-04a4-49ab-a677-64bfb697da8a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:53:20.057047 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19b4ec97-04a4-49ab-a677-64bfb697da8a service nova] RBAC: Authorization granted {{(pid=82025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:53:20.080397 dv-cinder-828806-6-smb devstack@keystone.service[82025]: [pid: 82025|app: 0|req: 708/1403] 10.222.0.33 () {60 vars in 1365 bytes} [Tue Sep 13 19:53:19 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 446 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 19:53:22.661649 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8a778d8-4f91-45f8-9b1a-1c5e65b49c55 None None] REQUEST_METHOD: `GET` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:53:22.662237 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8a778d8-4f91-45f8-9b1a-1c5e65b49c55 None None] SCRIPT_NAME: `/identity` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:53:22.662237 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8a778d8-4f91-45f8-9b1a-1c5e65b49c55 None None] PATH_INFO: `/` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:53:22.664011 dv-cinder-828806-6-smb devstack@keystone.service[82026]: [pid: 82026|app: 0|req: 696/1404] 10.222.0.33 () {54 vars in 927 bytes} [Tue Sep 13 19:53:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 19:53:22.668961 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83d0f2c3-7f8f-49e8-b00f-c67b64c9f63e None None] REQUEST_METHOD: `POST` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:53:22.669404 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83d0f2c3-7f8f-49e8-b00f-c67b64c9f63e None None] SCRIPT_NAME: `/identity` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:53:22.669528 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83d0f2c3-7f8f-49e8-b00f-c67b64c9f63e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:53:22.744567 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.auth.core [None req-83d0f2c3-7f8f-49e8-b00f-c67b64c9f63e None None] MFA Rules not processed for user `57539b6a6f3b4d589f5f5e1d211cd6a0`. Rule list: `[]` (Enabled: `True`). {{(pid=82025) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 19:53:22.745988 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.fernet_utils [None req-83d0f2c3-7f8f-49e8-b00f-c67b64c9f63e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82025) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 19:53:22.859077 dv-cinder-828806-6-smb devstack@keystone.service[82025]: [pid: 82025|app: 0|req: 709/1405] 10.222.0.33 () {58 vars in 1024 bytes} [Tue Sep 13 19:53:22 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 188 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 19:53:23.151059 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8a778d8-4f91-45f8-9b1a-1c5e65b49c55 None None] Authenticating user token {{(pid=82026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:53:23.152587 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.common.fernet_utils [None req-e8a778d8-4f91-45f8-9b1a-1c5e65b49c55 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82026) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 19:53:23.286605 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG dbcounter [-] [82026] Writing DB stats keystone:SELECT=100 {{(pid=82026) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:53:23.321987 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8a778d8-4f91-45f8-9b1a-1c5e65b49c55 None None] Validating token access rules against request {{(pid=82026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:53:23.454456 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8ca303e-555a-46e6-958f-36062ccfb273 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e66e7034abed4e0bad1f4137520c1e70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8c6fba0f15b4d6a84ff601919b7b8e4', 'project_domain_id': 'default', 'roles': ['service', 'member', 'reader', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:53:23.454983 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8ca303e-555a-46e6-958f-36062ccfb273 service nova] REQUEST_METHOD: `GET` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:53:23.455292 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8ca303e-555a-46e6-958f-36062ccfb273 service nova] SCRIPT_NAME: `/identity` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:53:23.455564 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8ca303e-555a-46e6-958f-36062ccfb273 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:53:23.457173 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.common.fernet_utils [None req-e8ca303e-555a-46e6-958f-36062ccfb273 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82026) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 19:53:23.546984 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG dbcounter [-] [82026] Writing DB stats keystone:SELECT=100 {{(pid=82026) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:53:23.561795 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8ca303e-555a-46e6-958f-36062ccfb273 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:53:23.563584 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8ca303e-555a-46e6-958f-36062ccfb273 service nova] RBAC: Authorization granted {{(pid=82026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:53:23.591222 dv-cinder-828806-6-smb devstack@keystone.service[82026]: [pid: 82026|app: 0|req: 697/1406] 10.222.0.33 () {60 vars in 1365 bytes} [Tue Sep 13 19:53:23 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 441 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 19:53:25.980086 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14901dac-d6d4-4186-a5d7-ea7cf3fbbbad None None] REQUEST_METHOD: `GET` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:53:25.980707 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14901dac-d6d4-4186-a5d7-ea7cf3fbbbad None None] SCRIPT_NAME: `/identity` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:53:25.980707 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14901dac-d6d4-4186-a5d7-ea7cf3fbbbad None None] PATH_INFO: `/` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:53:25.982443 dv-cinder-828806-6-smb devstack@keystone.service[82025]: [pid: 82025|app: 0|req: 710/1407] 10.222.0.33 () {54 vars in 927 bytes} [Tue Sep 13 19:53:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 19:53:25.988467 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28f3a614-5355-4dad-b57b-b943891aa3c6 None None] REQUEST_METHOD: `POST` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:53:25.988938 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28f3a614-5355-4dad-b57b-b943891aa3c6 None None] SCRIPT_NAME: `/identity` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:53:25.989165 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28f3a614-5355-4dad-b57b-b943891aa3c6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:53:26.067709 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.auth.core [None req-28f3a614-5355-4dad-b57b-b943891aa3c6 None None] MFA Rules not processed for user `57539b6a6f3b4d589f5f5e1d211cd6a0`. Rule list: `[]` (Enabled: `True`). {{(pid=82026) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 19:53:26.070541 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.common.fernet_utils [None req-28f3a614-5355-4dad-b57b-b943891aa3c6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82026) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 19:53:26.178496 dv-cinder-828806-6-smb devstack@keystone.service[82026]: [pid: 82026|app: 0|req: 698/1408] 10.222.0.33 () {58 vars in 1024 bytes} [Tue Sep 13 19:53:25 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 191 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 19:53:26.479673 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14901dac-d6d4-4186-a5d7-ea7cf3fbbbad None None] Authenticating user token {{(pid=82025) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:53:26.485784 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.fernet_utils [None req-14901dac-d6d4-4186-a5d7-ea7cf3fbbbad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82025) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 19:53:26.507589 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG dbcounter [-] [82025] Writing DB stats keystone:SELECT=100 {{(pid=82025) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:53:26.667394 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14901dac-d6d4-4186-a5d7-ea7cf3fbbbad None None] Validating token access rules against request {{(pid=82025) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:53:26.779912 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG dbcounter [-] [82025] Writing DB stats keystone:SELECT=100 {{(pid=82025) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:53:26.804576 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32d2cf2d-f9b6-4f3c-8967-8103100c3229 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e66e7034abed4e0bad1f4137520c1e70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8c6fba0f15b4d6a84ff601919b7b8e4', 'project_domain_id': 'default', 'roles': ['service', 'member', 'reader', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82025) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:53:26.805216 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32d2cf2d-f9b6-4f3c-8967-8103100c3229 service nova] REQUEST_METHOD: `GET` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:53:26.805494 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32d2cf2d-f9b6-4f3c-8967-8103100c3229 service nova] SCRIPT_NAME: `/identity` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:53:26.805769 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32d2cf2d-f9b6-4f3c-8967-8103100c3229 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:53:26.807403 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.fernet_utils [None req-32d2cf2d-f9b6-4f3c-8967-8103100c3229 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82025) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 19:53:26.906735 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32d2cf2d-f9b6-4f3c-8967-8103100c3229 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:53:26.908399 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32d2cf2d-f9b6-4f3c-8967-8103100c3229 service nova] RBAC: Authorization granted {{(pid=82025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:53:26.930275 dv-cinder-828806-6-smb devstack@keystone.service[82025]: [pid: 82025|app: 0|req: 711/1409] 10.222.0.33 () {60 vars in 1365 bytes} [Tue Sep 13 19:53:26 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 451 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 19:53:36.176973 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG dbcounter [-] [82026] Writing DB stats keystone:SELECT=74 {{(pid=82026) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:53:36.927455 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG dbcounter [-] [82025] Writing DB stats keystone:SELECT=54 {{(pid=82025) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:53:40.324857 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b19bd0c-a9a3-4e36-957d-33ae33b9013f None None] REQUEST_METHOD: `GET` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:53:40.325403 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b19bd0c-a9a3-4e36-957d-33ae33b9013f None None] SCRIPT_NAME: `/identity` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:53:40.325403 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b19bd0c-a9a3-4e36-957d-33ae33b9013f None None] PATH_INFO: `/` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:53:40.326784 dv-cinder-828806-6-smb devstack@keystone.service[82026]: [pid: 82026|app: 0|req: 699/1410] 10.222.0.33 () {54 vars in 918 bytes} [Tue Sep 13 19:53:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 19:53:40.332479 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aea9f12c-79d6-44d2-b5c7-8a75c7ba103b None None] REQUEST_METHOD: `POST` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:53:40.332918 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aea9f12c-79d6-44d2-b5c7-8a75c7ba103b None None] SCRIPT_NAME: `/identity` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:53:40.333026 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aea9f12c-79d6-44d2-b5c7-8a75c7ba103b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:53:40.409994 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.auth.core [None req-aea9f12c-79d6-44d2-b5c7-8a75c7ba103b None None] MFA Rules not processed for user `060ea3dea2134429967c164bd158b272`. Rule list: `[]` (Enabled: `True`). {{(pid=82025) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 19:53:40.411263 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.fernet_utils [None req-aea9f12c-79d6-44d2-b5c7-8a75c7ba103b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82025) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 19:53:40.518852 dv-cinder-828806-6-smb devstack@keystone.service[82025]: [pid: 82025|app: 0|req: 712/1411] 10.222.0.33 () {58 vars in 1015 bytes} [Tue Sep 13 19:53:40 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 187 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 19:53:40.533515 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4e102d7-7f10-484d-8dc7-fe07fd2353ec None None] REQUEST_METHOD: `GET` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:53:40.533797 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4e102d7-7f10-484d-8dc7-fe07fd2353ec None None] SCRIPT_NAME: `/identity` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:53:40.534069 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4e102d7-7f10-484d-8dc7-fe07fd2353ec None None] PATH_INFO: `/` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:53:40.535441 dv-cinder-828806-6-smb devstack@keystone.service[82026]: [pid: 82026|app: 0|req: 700/1412] 10.222.0.33 () {54 vars in 918 bytes} [Tue Sep 13 19:53:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 19:53:40.547745 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0213d58-5e95-415c-a817-435d1a820472 None None] REQUEST_METHOD: `POST` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:53:40.547745 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0213d58-5e95-415c-a817-435d1a820472 None None] SCRIPT_NAME: `/identity` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:53:40.547745 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0213d58-5e95-415c-a817-435d1a820472 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:53:40.613892 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG dbcounter [-] [82025] Writing DB stats keystone:SELECT=100 {{(pid=82025) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:53:40.616893 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.auth.core [None req-a0213d58-5e95-415c-a817-435d1a820472 None None] MFA Rules not processed for user `e66e7034abed4e0bad1f4137520c1e70`. Rule list: `[]` (Enabled: `True`). {{(pid=82025) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 19:53:40.618120 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.fernet_utils [None req-a0213d58-5e95-415c-a817-435d1a820472 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82025) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 19:53:40.732526 dv-cinder-828806-6-smb devstack@keystone.service[82025]: [pid: 82025|app: 0|req: 713/1413] 10.222.0.33 () {58 vars in 1015 bytes} [Tue Sep 13 19:53:40 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 193 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 19:53:43.352771 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbb5df31-a246-469d-adfd-0c1fb7804bbb None None] REQUEST_METHOD: `GET` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:53:43.353311 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbb5df31-a246-469d-adfd-0c1fb7804bbb None None] SCRIPT_NAME: `/identity` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:53:43.353311 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbb5df31-a246-469d-adfd-0c1fb7804bbb None None] PATH_INFO: `/` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:53:43.354669 dv-cinder-828806-6-smb devstack@keystone.service[82026]: [pid: 82026|app: 0|req: 701/1414] 127.0.0.1 () {54 vars in 917 bytes} [Tue Sep 13 19:53:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 19:53:43.359892 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3acf4a01-0200-4b15-ba33-53bc71baff77 None None] REQUEST_METHOD: `POST` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:53:43.360353 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3acf4a01-0200-4b15-ba33-53bc71baff77 None None] SCRIPT_NAME: `/identity` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:53:43.360545 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3acf4a01-0200-4b15-ba33-53bc71baff77 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:53:43.427246 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.auth.core [None req-3acf4a01-0200-4b15-ba33-53bc71baff77 None None] MFA Rules not processed for user `57539b6a6f3b4d589f5f5e1d211cd6a0`. Rule list: `[]` (Enabled: `True`). {{(pid=82025) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 19:53:43.428466 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.fernet_utils [None req-3acf4a01-0200-4b15-ba33-53bc71baff77 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82025) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 19:53:43.483470 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG dbcounter [-] [82025] Writing DB stats keystone:SELECT=100 {{(pid=82025) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:53:43.525789 dv-cinder-828806-6-smb devstack@keystone.service[82025]: [pid: 82025|app: 0|req: 714/1415] 127.0.0.1 () {58 vars in 1014 bytes} [Tue Sep 13 19:53:43 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 167 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 19:53:43.820782 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbb5df31-a246-469d-adfd-0c1fb7804bbb None None] Authenticating user token {{(pid=82026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:53:43.822311 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.common.fernet_utils [None req-dbb5df31-a246-469d-adfd-0c1fb7804bbb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82026) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 19:53:43.971054 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbb5df31-a246-469d-adfd-0c1fb7804bbb None None] Validating token access rules against request {{(pid=82026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:53:44.043993 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG dbcounter [-] [82026] Writing DB stats keystone:SELECT=100 {{(pid=82026) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:53:44.085081 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5c67b30-975a-4121-a281-d2ba857cb6f8 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e66e7034abed4e0bad1f4137520c1e70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8c6fba0f15b4d6a84ff601919b7b8e4', 'project_domain_id': 'default', 'roles': ['service', 'member', 'reader', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:53:44.085613 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5c67b30-975a-4121-a281-d2ba857cb6f8 service nova] REQUEST_METHOD: `GET` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:53:44.085897 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5c67b30-975a-4121-a281-d2ba857cb6f8 service nova] SCRIPT_NAME: `/identity` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:53:44.086169 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5c67b30-975a-4121-a281-d2ba857cb6f8 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:53:44.087824 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.common.fernet_utils [None req-f5c67b30-975a-4121-a281-d2ba857cb6f8 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82026) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 19:53:44.177073 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5c67b30-975a-4121-a281-d2ba857cb6f8 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:53:44.178666 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5c67b30-975a-4121-a281-d2ba857cb6f8 service nova] RBAC: Authorization granted {{(pid=82026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:53:44.197205 dv-cinder-828806-6-smb devstack@keystone.service[82026]: [pid: 82026|app: 0|req: 702/1416] 10.222.0.33 () {60 vars in 1365 bytes} [Tue Sep 13 19:53:43 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 377 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 19:53:45.361435 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8b3af20-7320-4341-a5a3-60758614d795 None None] REQUEST_METHOD: `GET` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:53:45.362065 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8b3af20-7320-4341-a5a3-60758614d795 None None] SCRIPT_NAME: `/identity` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:53:45.362065 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8b3af20-7320-4341-a5a3-60758614d795 None None] PATH_INFO: `/` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:53:45.363405 dv-cinder-828806-6-smb devstack@keystone.service[82025]: [pid: 82025|app: 0|req: 715/1417] 127.0.0.1 () {54 vars in 901 bytes} [Tue Sep 13 19:53:45 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 19:53:45.369900 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-449bc9c7-375c-4cab-83a9-6718ea625fb1 None None] REQUEST_METHOD: `POST` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:53:45.370326 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-449bc9c7-375c-4cab-83a9-6718ea625fb1 None None] SCRIPT_NAME: `/identity` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:53:45.370441 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-449bc9c7-375c-4cab-83a9-6718ea625fb1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:53:45.447017 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.auth.core [None req-449bc9c7-375c-4cab-83a9-6718ea625fb1 None None] MFA Rules not processed for user `57539b6a6f3b4d589f5f5e1d211cd6a0`. Rule list: `[]` (Enabled: `True`). {{(pid=82026) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 19:53:45.448284 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.common.fernet_utils [None req-449bc9c7-375c-4cab-83a9-6718ea625fb1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82026) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 19:53:45.475209 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG dbcounter [-] [82026] Writing DB stats keystone:SELECT=100 {{(pid=82026) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:53:45.546074 dv-cinder-828806-6-smb devstack@keystone.service[82026]: [pid: 82026|app: 0|req: 703/1418] 127.0.0.1 () {58 vars in 998 bytes} [Tue Sep 13 19:53:45 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 177 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 19:53:45.699741 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8b3af20-7320-4341-a5a3-60758614d795 None None] Authenticating user token {{(pid=82025) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:53:45.701254 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.fernet_utils [None req-f8b3af20-7320-4341-a5a3-60758614d795 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82025) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 19:53:45.848295 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8b3af20-7320-4341-a5a3-60758614d795 None None] Validating token access rules against request {{(pid=82025) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:53:45.888504 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG dbcounter [-] [82025] Writing DB stats keystone:SELECT=100 {{(pid=82025) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:53:45.963352 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f88e362a-aa7d-41f9-b003-0a1f9f013e0b service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e66e7034abed4e0bad1f4137520c1e70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8c6fba0f15b4d6a84ff601919b7b8e4', 'project_domain_id': 'default', 'roles': ['service', 'member', 'reader', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82025) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:53:45.963875 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f88e362a-aa7d-41f9-b003-0a1f9f013e0b service nova] REQUEST_METHOD: `GET` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:53:45.964153 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f88e362a-aa7d-41f9-b003-0a1f9f013e0b service nova] SCRIPT_NAME: `/identity` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:53:45.964423 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f88e362a-aa7d-41f9-b003-0a1f9f013e0b service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:53:45.966005 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.fernet_utils [None req-f88e362a-aa7d-41f9-b003-0a1f9f013e0b service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82025) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 19:53:46.054880 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f88e362a-aa7d-41f9-b003-0a1f9f013e0b service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:53:46.056510 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f88e362a-aa7d-41f9-b003-0a1f9f013e0b service nova] RBAC: Authorization granted {{(pid=82025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:53:46.075182 dv-cinder-828806-6-smb devstack@keystone.service[82025]: [pid: 82025|app: 0|req: 716/1419] 10.222.0.33 () {60 vars in 1365 bytes} [Tue Sep 13 19:53:45 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 376 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 19:53:47.222569 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c4f63c6-8e64-4af7-9e93-671c3b12ac94 None None] REQUEST_METHOD: `GET` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:53:47.223176 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c4f63c6-8e64-4af7-9e93-671c3b12ac94 None None] SCRIPT_NAME: `/identity` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:53:47.223176 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c4f63c6-8e64-4af7-9e93-671c3b12ac94 None None] PATH_INFO: `/` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:53:47.224527 dv-cinder-828806-6-smb devstack@keystone.service[82026]: [pid: 82026|app: 0|req: 704/1420] 127.0.0.1 () {54 vars in 901 bytes} [Tue Sep 13 19:53:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 19:53:47.230678 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aafbe16d-7c8c-4336-9260-48a2e4ea5c96 None None] REQUEST_METHOD: `POST` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:53:47.231143 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aafbe16d-7c8c-4336-9260-48a2e4ea5c96 None None] SCRIPT_NAME: `/identity` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:53:47.231259 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aafbe16d-7c8c-4336-9260-48a2e4ea5c96 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:53:47.285499 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG dbcounter [-] [82025] Writing DB stats keystone:SELECT=100 {{(pid=82025) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:53:47.308038 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.auth.core [None req-aafbe16d-7c8c-4336-9260-48a2e4ea5c96 None None] MFA Rules not processed for user `57539b6a6f3b4d589f5f5e1d211cd6a0`. Rule list: `[]` (Enabled: `True`). {{(pid=82025) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 19:53:47.309239 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.fernet_utils [None req-aafbe16d-7c8c-4336-9260-48a2e4ea5c96 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82025) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 19:53:47.411491 dv-cinder-828806-6-smb devstack@keystone.service[82025]: [pid: 82025|app: 0|req: 717/1421] 127.0.0.1 () {58 vars in 998 bytes} [Tue Sep 13 19:53:47 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 182 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 19:53:47.566990 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c4f63c6-8e64-4af7-9e93-671c3b12ac94 None None] Authenticating user token {{(pid=82026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:53:47.568599 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.common.fernet_utils [None req-6c4f63c6-8e64-4af7-9e93-671c3b12ac94 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82026) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 19:53:47.720467 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c4f63c6-8e64-4af7-9e93-671c3b12ac94 None None] Validating token access rules against request {{(pid=82026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:53:47.732982 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG dbcounter [-] [82026] Writing DB stats keystone:SELECT=100 {{(pid=82026) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:53:47.835598 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7bb87c1-d08e-4bb8-aa29-7d063e0defa9 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e66e7034abed4e0bad1f4137520c1e70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8c6fba0f15b4d6a84ff601919b7b8e4', 'project_domain_id': 'default', 'roles': ['service', 'member', 'reader', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:53:47.848616 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7bb87c1-d08e-4bb8-aa29-7d063e0defa9 service nova] REQUEST_METHOD: `GET` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:53:47.848616 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7bb87c1-d08e-4bb8-aa29-7d063e0defa9 service nova] SCRIPT_NAME: `/identity` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:53:47.848616 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7bb87c1-d08e-4bb8-aa29-7d063e0defa9 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:53:47.848616 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.common.fernet_utils [None req-d7bb87c1-d08e-4bb8-aa29-7d063e0defa9 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82026) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 19:53:47.928891 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7bb87c1-d08e-4bb8-aa29-7d063e0defa9 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:53:47.930586 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7bb87c1-d08e-4bb8-aa29-7d063e0defa9 service nova] RBAC: Authorization granted {{(pid=82026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:53:47.948753 dv-cinder-828806-6-smb devstack@keystone.service[82026]: [pid: 82026|app: 0|req: 705/1422] 10.222.0.33 () {60 vars in 1365 bytes} [Tue Sep 13 19:53:47 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 382 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 19:53:49.084836 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02367f73-d920-4ff2-95a9-8e0d8dece2af None None] REQUEST_METHOD: `GET` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:53:49.085420 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02367f73-d920-4ff2-95a9-8e0d8dece2af None None] SCRIPT_NAME: `/identity` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:53:49.085420 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02367f73-d920-4ff2-95a9-8e0d8dece2af None None] PATH_INFO: `/` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:53:49.086757 dv-cinder-828806-6-smb devstack@keystone.service[82025]: [pid: 82025|app: 0|req: 718/1423] 127.0.0.1 () {54 vars in 901 bytes} [Tue Sep 13 19:53:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 19:53:49.093227 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59ba9122-a994-493f-9a9f-28956d3fd0b3 None None] REQUEST_METHOD: `POST` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:53:49.093660 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59ba9122-a994-493f-9a9f-28956d3fd0b3 None None] SCRIPT_NAME: `/identity` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:53:49.093788 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59ba9122-a994-493f-9a9f-28956d3fd0b3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:53:49.114390 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG dbcounter [-] [82026] Writing DB stats keystone:SELECT=100 {{(pid=82026) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:53:49.169800 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.auth.core [None req-59ba9122-a994-493f-9a9f-28956d3fd0b3 None None] MFA Rules not processed for user `57539b6a6f3b4d589f5f5e1d211cd6a0`. Rule list: `[]` (Enabled: `True`). {{(pid=82026) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 19:53:49.171018 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.common.fernet_utils [None req-59ba9122-a994-493f-9a9f-28956d3fd0b3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82026) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 19:53:49.267542 dv-cinder-828806-6-smb devstack@keystone.service[82026]: [pid: 82026|app: 0|req: 706/1424] 127.0.0.1 () {58 vars in 998 bytes} [Tue Sep 13 19:53:49 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 175 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 19:53:49.422710 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02367f73-d920-4ff2-95a9-8e0d8dece2af None None] Authenticating user token {{(pid=82025) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:53:49.424169 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.fernet_utils [None req-02367f73-d920-4ff2-95a9-8e0d8dece2af None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82025) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 19:53:49.535188 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG dbcounter [-] [82025] Writing DB stats keystone:SELECT=100 {{(pid=82025) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:53:49.571964 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02367f73-d920-4ff2-95a9-8e0d8dece2af None None] Validating token access rules against request {{(pid=82025) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:53:49.709580 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d2a1090-4ca6-4a2d-b621-7f32fc5d46d1 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e66e7034abed4e0bad1f4137520c1e70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8c6fba0f15b4d6a84ff601919b7b8e4', 'project_domain_id': 'default', 'roles': ['service', 'member', 'reader', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82025) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:53:49.710382 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d2a1090-4ca6-4a2d-b621-7f32fc5d46d1 service nova] REQUEST_METHOD: `GET` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:53:49.710813 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d2a1090-4ca6-4a2d-b621-7f32fc5d46d1 service nova] SCRIPT_NAME: `/identity` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:53:49.711276 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d2a1090-4ca6-4a2d-b621-7f32fc5d46d1 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:53:49.713634 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.fernet_utils [None req-2d2a1090-4ca6-4a2d-b621-7f32fc5d46d1 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82025) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 19:53:49.802033 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG dbcounter [-] [82025] Writing DB stats keystone:SELECT=100 {{(pid=82025) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:53:49.815507 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d2a1090-4ca6-4a2d-b621-7f32fc5d46d1 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:53:49.817116 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d2a1090-4ca6-4a2d-b621-7f32fc5d46d1 service nova] RBAC: Authorization granted {{(pid=82025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:53:49.835230 dv-cinder-828806-6-smb devstack@keystone.service[82025]: [pid: 82025|app: 0|req: 719/1425] 10.222.0.33 () {60 vars in 1365 bytes} [Tue Sep 13 19:53:49 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 413 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 19:53:50.960949 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b882601d-1b09-4a88-b588-cd4a974bcfa8 None None] REQUEST_METHOD: `GET` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:53:50.961497 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b882601d-1b09-4a88-b588-cd4a974bcfa8 None None] SCRIPT_NAME: `/identity` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:53:50.961497 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b882601d-1b09-4a88-b588-cd4a974bcfa8 None None] PATH_INFO: `/` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:53:50.962881 dv-cinder-828806-6-smb devstack@keystone.service[82026]: [pid: 82026|app: 0|req: 707/1426] 127.0.0.1 () {54 vars in 901 bytes} [Tue Sep 13 19:53:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 19:53:50.969278 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8cac7af-d273-4a8e-909d-53846af4f68e None None] REQUEST_METHOD: `POST` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:53:50.970406 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8cac7af-d273-4a8e-909d-53846af4f68e None None] SCRIPT_NAME: `/identity` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:53:50.970797 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8cac7af-d273-4a8e-909d-53846af4f68e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:53:51.046444 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.auth.core [None req-b8cac7af-d273-4a8e-909d-53846af4f68e None None] MFA Rules not processed for user `57539b6a6f3b4d589f5f5e1d211cd6a0`. Rule list: `[]` (Enabled: `True`). {{(pid=82025) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 19:53:51.048205 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.fernet_utils [None req-b8cac7af-d273-4a8e-909d-53846af4f68e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82025) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 19:53:51.150789 dv-cinder-828806-6-smb devstack@keystone.service[82025]: [pid: 82025|app: 0|req: 720/1427] 127.0.0.1 () {58 vars in 998 bytes} [Tue Sep 13 19:53:50 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 182 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 19:53:51.305570 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b882601d-1b09-4a88-b588-cd4a974bcfa8 None None] Authenticating user token {{(pid=82026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:53:51.307121 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.common.fernet_utils [None req-b882601d-1b09-4a88-b588-cd4a974bcfa8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82026) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 19:53:51.393093 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG dbcounter [-] [82026] Writing DB stats keystone:SELECT=100 {{(pid=82026) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:53:51.457289 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b882601d-1b09-4a88-b588-cd4a974bcfa8 None None] Validating token access rules against request {{(pid=82026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:53:51.570480 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f52aa9ea-6aaa-4a22-8396-364ff904c126 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e66e7034abed4e0bad1f4137520c1e70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8c6fba0f15b4d6a84ff601919b7b8e4', 'project_domain_id': 'default', 'roles': ['service', 'member', 'reader', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:53:51.571109 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f52aa9ea-6aaa-4a22-8396-364ff904c126 service nova] REQUEST_METHOD: `GET` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:53:51.571394 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f52aa9ea-6aaa-4a22-8396-364ff904c126 service nova] SCRIPT_NAME: `/identity` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:53:51.571669 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f52aa9ea-6aaa-4a22-8396-364ff904c126 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:53:51.573274 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.common.fernet_utils [None req-f52aa9ea-6aaa-4a22-8396-364ff904c126 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82026) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 19:53:51.622080 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG dbcounter [-] [82026] Writing DB stats keystone:SELECT=100 {{(pid=82026) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:53:51.663399 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f52aa9ea-6aaa-4a22-8396-364ff904c126 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:53:51.665008 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f52aa9ea-6aaa-4a22-8396-364ff904c126 service nova] RBAC: Authorization granted {{(pid=82026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:53:51.683268 dv-cinder-828806-6-smb devstack@keystone.service[82026]: [pid: 82026|app: 0|req: 708/1428] 10.222.0.33 () {60 vars in 1365 bytes} [Tue Sep 13 19:53:51 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 378 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 19:53:52.801985 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc696f85-57d5-4982-9368-2fce2748d9b2 None None] REQUEST_METHOD: `GET` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:53:52.802529 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc696f85-57d5-4982-9368-2fce2748d9b2 None None] SCRIPT_NAME: `/identity` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:53:52.802529 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc696f85-57d5-4982-9368-2fce2748d9b2 None None] PATH_INFO: `/` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:53:52.803973 dv-cinder-828806-6-smb devstack@keystone.service[82025]: [pid: 82025|app: 0|req: 721/1429] 127.0.0.1 () {54 vars in 901 bytes} [Tue Sep 13 19:53:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 19:53:52.810049 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d92cb75-ca15-4681-b320-645780c36928 None None] REQUEST_METHOD: `POST` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:53:52.810520 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d92cb75-ca15-4681-b320-645780c36928 None None] SCRIPT_NAME: `/identity` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:53:52.810632 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d92cb75-ca15-4681-b320-645780c36928 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:53:52.886512 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.auth.core [None req-7d92cb75-ca15-4681-b320-645780c36928 None None] MFA Rules not processed for user `57539b6a6f3b4d589f5f5e1d211cd6a0`. Rule list: `[]` (Enabled: `True`). {{(pid=82026) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 19:53:52.887799 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.common.fernet_utils [None req-7d92cb75-ca15-4681-b320-645780c36928 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82026) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 19:53:52.984952 dv-cinder-828806-6-smb devstack@keystone.service[82026]: [pid: 82026|app: 0|req: 709/1430] 127.0.0.1 () {58 vars in 998 bytes} [Tue Sep 13 19:53:52 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 176 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 19:53:53.138214 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc696f85-57d5-4982-9368-2fce2748d9b2 None None] Authenticating user token {{(pid=82025) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:53:53.139690 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.fernet_utils [None req-fc696f85-57d5-4982-9368-2fce2748d9b2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82025) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 19:53:53.188605 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG dbcounter [-] [82025] Writing DB stats keystone:SELECT=100 {{(pid=82025) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:53:53.287531 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc696f85-57d5-4982-9368-2fce2748d9b2 None None] Validating token access rules against request {{(pid=82025) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:53:53.398662 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da79129e-094b-4c33-9594-d21c732832f1 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e66e7034abed4e0bad1f4137520c1e70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8c6fba0f15b4d6a84ff601919b7b8e4', 'project_domain_id': 'default', 'roles': ['service', 'member', 'reader', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82025) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:53:53.399219 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da79129e-094b-4c33-9594-d21c732832f1 service nova] REQUEST_METHOD: `GET` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:53:53.399505 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da79129e-094b-4c33-9594-d21c732832f1 service nova] SCRIPT_NAME: `/identity` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:53:53.399780 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da79129e-094b-4c33-9594-d21c732832f1 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:53:53.401379 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.fernet_utils [None req-da79129e-094b-4c33-9594-d21c732832f1 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82025) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 19:53:53.408453 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG dbcounter [-] [82025] Writing DB stats keystone:SELECT=100 {{(pid=82025) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:53:53.490796 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da79129e-094b-4c33-9594-d21c732832f1 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:53:53.492449 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da79129e-094b-4c33-9594-d21c732832f1 service nova] RBAC: Authorization granted {{(pid=82025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:53:53.511425 dv-cinder-828806-6-smb devstack@keystone.service[82025]: [pid: 82025|app: 0|req: 722/1431] 10.222.0.33 () {60 vars in 1365 bytes} [Tue Sep 13 19:53:53 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 373 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 19:53:54.645769 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a499cde-d9ff-4b32-89f1-ff6067b0acfc None None] REQUEST_METHOD: `GET` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:53:54.646339 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a499cde-d9ff-4b32-89f1-ff6067b0acfc None None] SCRIPT_NAME: `/identity` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:53:54.646339 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a499cde-d9ff-4b32-89f1-ff6067b0acfc None None] PATH_INFO: `/` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:53:54.647808 dv-cinder-828806-6-smb devstack@keystone.service[82026]: [pid: 82026|app: 0|req: 710/1432] 127.0.0.1 () {54 vars in 901 bytes} [Tue Sep 13 19:53:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 19:53:54.654146 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c47ab9a-be3b-4e58-bc22-d36e27330323 None None] REQUEST_METHOD: `POST` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:53:54.654551 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c47ab9a-be3b-4e58-bc22-d36e27330323 None None] SCRIPT_NAME: `/identity` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:53:54.654696 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c47ab9a-be3b-4e58-bc22-d36e27330323 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:53:54.735604 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.auth.core [None req-9c47ab9a-be3b-4e58-bc22-d36e27330323 None None] MFA Rules not processed for user `57539b6a6f3b4d589f5f5e1d211cd6a0`. Rule list: `[]` (Enabled: `True`). {{(pid=82025) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 19:53:54.737630 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.fernet_utils [None req-9c47ab9a-be3b-4e58-bc22-d36e27330323 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82025) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 19:53:54.807052 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG dbcounter [-] [82025] Writing DB stats keystone:SELECT=100 {{(pid=82025) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:53:54.836355 dv-cinder-828806-6-smb devstack@keystone.service[82025]: [pid: 82025|app: 0|req: 723/1433] 127.0.0.1 () {58 vars in 998 bytes} [Tue Sep 13 19:53:54 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 183 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 19:53:54.987452 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a499cde-d9ff-4b32-89f1-ff6067b0acfc None None] Authenticating user token {{(pid=82026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:53:54.988898 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.common.fernet_utils [None req-8a499cde-d9ff-4b32-89f1-ff6067b0acfc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82026) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 19:53:55.006345 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG dbcounter [-] [82026] Writing DB stats keystone:SELECT=100 {{(pid=82026) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:53:55.148407 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a499cde-d9ff-4b32-89f1-ff6067b0acfc None None] Validating token access rules against request {{(pid=82026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:53:55.235155 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG dbcounter [-] [82026] Writing DB stats keystone:SELECT=100 {{(pid=82026) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:53:55.260004 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d646fc2-7460-4b18-a614-de3086170358 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e66e7034abed4e0bad1f4137520c1e70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8c6fba0f15b4d6a84ff601919b7b8e4', 'project_domain_id': 'default', 'roles': ['service', 'member', 'reader', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:53:55.260545 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d646fc2-7460-4b18-a614-de3086170358 service nova] REQUEST_METHOD: `GET` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:53:55.260837 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d646fc2-7460-4b18-a614-de3086170358 service nova] SCRIPT_NAME: `/identity` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:53:55.261116 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d646fc2-7460-4b18-a614-de3086170358 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:53:55.262730 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.common.fernet_utils [None req-3d646fc2-7460-4b18-a614-de3086170358 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82026) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 19:53:55.353141 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d646fc2-7460-4b18-a614-de3086170358 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:53:55.354805 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d646fc2-7460-4b18-a614-de3086170358 service nova] RBAC: Authorization granted {{(pid=82026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:53:55.385458 dv-cinder-828806-6-smb devstack@keystone.service[82026]: [pid: 82026|app: 0|req: 711/1434] 10.222.0.33 () {60 vars in 1365 bytes} [Tue Sep 13 19:53:54 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 399 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 19:53:56.512795 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5757cdd-d89b-47d1-8b75-4f226517847a None None] REQUEST_METHOD: `GET` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:53:56.513354 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5757cdd-d89b-47d1-8b75-4f226517847a None None] SCRIPT_NAME: `/identity` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:53:56.513354 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5757cdd-d89b-47d1-8b75-4f226517847a None None] PATH_INFO: `/` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:53:56.514683 dv-cinder-828806-6-smb devstack@keystone.service[82025]: [pid: 82025|app: 0|req: 724/1435] 127.0.0.1 () {54 vars in 901 bytes} [Tue Sep 13 19:53:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 19:53:56.521608 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6684a081-851c-4afe-9ef9-dafa923bf048 None None] REQUEST_METHOD: `POST` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:53:56.526626 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6684a081-851c-4afe-9ef9-dafa923bf048 None None] SCRIPT_NAME: `/identity` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:53:56.526626 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6684a081-851c-4afe-9ef9-dafa923bf048 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:53:56.602027 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.auth.core [None req-6684a081-851c-4afe-9ef9-dafa923bf048 None None] MFA Rules not processed for user `57539b6a6f3b4d589f5f5e1d211cd6a0`. Rule list: `[]` (Enabled: `True`). {{(pid=82026) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 19:53:56.603265 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.common.fernet_utils [None req-6684a081-851c-4afe-9ef9-dafa923bf048 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82026) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 19:53:56.645585 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG dbcounter [-] [82026] Writing DB stats keystone:SELECT=100 {{(pid=82026) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:53:56.706010 dv-cinder-828806-6-smb devstack@keystone.service[82026]: [pid: 82026|app: 0|req: 712/1436] 127.0.0.1 () {58 vars in 998 bytes} [Tue Sep 13 19:53:56 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 185 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 19:53:56.860163 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5757cdd-d89b-47d1-8b75-4f226517847a None None] Authenticating user token {{(pid=82025) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:53:56.862155 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.fernet_utils [None req-f5757cdd-d89b-47d1-8b75-4f226517847a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82025) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 19:53:57.006170 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5757cdd-d89b-47d1-8b75-4f226517847a None None] Validating token access rules against request {{(pid=82025) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:53:57.075508 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG dbcounter [-] [82025] Writing DB stats keystone:SELECT=100 {{(pid=82025) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:53:57.135831 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15bf9cc9-a78b-47b5-909c-d3fd64fc9554 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e66e7034abed4e0bad1f4137520c1e70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8c6fba0f15b4d6a84ff601919b7b8e4', 'project_domain_id': 'default', 'roles': ['service', 'member', 'reader', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82025) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:53:57.136337 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15bf9cc9-a78b-47b5-909c-d3fd64fc9554 service nova] REQUEST_METHOD: `GET` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:53:57.136615 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15bf9cc9-a78b-47b5-909c-d3fd64fc9554 service nova] SCRIPT_NAME: `/identity` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:53:57.136886 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15bf9cc9-a78b-47b5-909c-d3fd64fc9554 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:53:57.138473 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.fernet_utils [None req-15bf9cc9-a78b-47b5-909c-d3fd64fc9554 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82025) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 19:53:57.227447 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15bf9cc9-a78b-47b5-909c-d3fd64fc9554 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:53:57.229038 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15bf9cc9-a78b-47b5-909c-d3fd64fc9554 service nova] RBAC: Authorization granted {{(pid=82025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:53:57.247193 dv-cinder-828806-6-smb devstack@keystone.service[82025]: [pid: 82025|app: 0|req: 725/1437] 10.222.0.33 () {60 vars in 1365 bytes} [Tue Sep 13 19:53:56 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 388 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 19:53:58.366765 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40c60f74-5ecd-4338-8f1a-b6e8efc808de None None] REQUEST_METHOD: `GET` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:53:58.367346 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40c60f74-5ecd-4338-8f1a-b6e8efc808de None None] SCRIPT_NAME: `/identity` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:53:58.367346 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40c60f74-5ecd-4338-8f1a-b6e8efc808de None None] PATH_INFO: `/` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:53:58.368696 dv-cinder-828806-6-smb devstack@keystone.service[82026]: [pid: 82026|app: 0|req: 713/1438] 127.0.0.1 () {54 vars in 901 bytes} [Tue Sep 13 19:53:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 19:53:58.375020 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76392a56-8417-437c-8d0f-41921e9b673b None None] REQUEST_METHOD: `POST` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:53:58.375490 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76392a56-8417-437c-8d0f-41921e9b673b None None] SCRIPT_NAME: `/identity` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:53:58.375608 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76392a56-8417-437c-8d0f-41921e9b673b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:53:58.453794 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.auth.core [None req-76392a56-8417-437c-8d0f-41921e9b673b None None] MFA Rules not processed for user `57539b6a6f3b4d589f5f5e1d211cd6a0`. Rule list: `[]` (Enabled: `True`). {{(pid=82025) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 19:53:58.455546 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.fernet_utils [None req-76392a56-8417-437c-8d0f-41921e9b673b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82025) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 19:53:58.457545 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG dbcounter [-] [82025] Writing DB stats keystone:SELECT=100 {{(pid=82025) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:53:58.556565 dv-cinder-828806-6-smb devstack@keystone.service[82025]: [pid: 82025|app: 0|req: 726/1439] 127.0.0.1 () {58 vars in 998 bytes} [Tue Sep 13 19:53:58 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 182 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 13 19:53:58.713386 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40c60f74-5ecd-4338-8f1a-b6e8efc808de None None] Authenticating user token {{(pid=82026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:53:58.714933 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.common.fernet_utils [None req-40c60f74-5ecd-4338-8f1a-b6e8efc808de None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82026) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 19:53:58.860206 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40c60f74-5ecd-4338-8f1a-b6e8efc808de None None] Validating token access rules against request {{(pid=82026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:53:58.887319 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG dbcounter [-] [82026] Writing DB stats keystone:SELECT=100 {{(pid=82026) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:53:58.974186 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b0fddbc-9e41-4840-a2e7-6f8e55c181ed service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e66e7034abed4e0bad1f4137520c1e70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8c6fba0f15b4d6a84ff601919b7b8e4', 'project_domain_id': 'default', 'roles': ['service', 'member', 'reader', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:53:58.974793 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b0fddbc-9e41-4840-a2e7-6f8e55c181ed service nova] REQUEST_METHOD: `GET` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:53:58.975114 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b0fddbc-9e41-4840-a2e7-6f8e55c181ed service nova] SCRIPT_NAME: `/identity` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:53:58.975398 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b0fddbc-9e41-4840-a2e7-6f8e55c181ed service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:53:58.977018 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.common.fernet_utils [None req-6b0fddbc-9e41-4840-a2e7-6f8e55c181ed service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82026) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 19:53:59.184026 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b0fddbc-9e41-4840-a2e7-6f8e55c181ed service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:53:59.185539 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b0fddbc-9e41-4840-a2e7-6f8e55c181ed service nova] RBAC: Authorization granted {{(pid=82026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:53:59.204215 dv-cinder-828806-6-smb devstack@keystone.service[82026]: [pid: 82026|app: 0|req: 714/1440] 10.222.0.33 () {60 vars in 1365 bytes} [Tue Sep 13 19:53:58 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 491 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 19:54:01.269139 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcadf11f-13f0-4a2b-8149-bc59139b5ddc None None] REQUEST_METHOD: `GET` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:54:01.269677 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcadf11f-13f0-4a2b-8149-bc59139b5ddc None None] SCRIPT_NAME: `/identity` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:54:01.269677 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcadf11f-13f0-4a2b-8149-bc59139b5ddc None None] PATH_INFO: `/` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:54:01.271089 dv-cinder-828806-6-smb devstack@keystone.service[82025]: [pid: 82025|app: 0|req: 727/1441] 127.0.0.1 () {54 vars in 917 bytes} [Tue Sep 13 19:54:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 19:54:01.276557 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ce537b1-3606-4c95-8a56-7bea408e868a None None] REQUEST_METHOD: `POST` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:54:01.276990 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ce537b1-3606-4c95-8a56-7bea408e868a None None] SCRIPT_NAME: `/identity` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:54:01.277089 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ce537b1-3606-4c95-8a56-7bea408e868a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:54:01.317375 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG dbcounter [-] [82026] Writing DB stats keystone:SELECT=100 {{(pid=82026) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:54:01.342395 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.auth.core [None req-8ce537b1-3606-4c95-8a56-7bea408e868a None None] MFA Rules not processed for user `57539b6a6f3b4d589f5f5e1d211cd6a0`. Rule list: `[]` (Enabled: `True`). {{(pid=82026) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 19:54:01.343689 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.common.fernet_utils [None req-8ce537b1-3606-4c95-8a56-7bea408e868a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82026) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 19:54:01.438657 dv-cinder-828806-6-smb devstack@keystone.service[82026]: [pid: 82026|app: 0|req: 715/1442] 127.0.0.1 () {58 vars in 1014 bytes} [Tue Sep 13 19:54:01 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 13 19:54:01.726598 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcadf11f-13f0-4a2b-8149-bc59139b5ddc None None] Authenticating user token {{(pid=82025) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:54:01.728226 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.fernet_utils [None req-fcadf11f-13f0-4a2b-8149-bc59139b5ddc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82025) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 19:54:01.832335 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcadf11f-13f0-4a2b-8149-bc59139b5ddc None None] Validating token access rules against request {{(pid=82025) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:54:01.863775 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG dbcounter [-] [82025] Writing DB stats keystone:SELECT=100 {{(pid=82025) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:54:01.906452 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f184a3b-0c2e-4364-95e9-14ae376c8bf3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '023a2c79c2444611b3d431928e56685d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8c6fba0f15b4d6a84ff601919b7b8e4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82025) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:54:01.907086 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f184a3b-0c2e-4364-95e9-14ae376c8bf3 service neutron] REQUEST_METHOD: `GET` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:54:01.907378 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f184a3b-0c2e-4364-95e9-14ae376c8bf3 service neutron] SCRIPT_NAME: `/identity` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:54:01.907660 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f184a3b-0c2e-4364-95e9-14ae376c8bf3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:54:01.909892 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.fernet_utils [None req-6f184a3b-0c2e-4364-95e9-14ae376c8bf3 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82025) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 19:54:02.020900 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f184a3b-0c2e-4364-95e9-14ae376c8bf3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:54:02.022361 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f184a3b-0c2e-4364-95e9-14ae376c8bf3 service neutron] RBAC: Authorization granted {{(pid=82025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:54:02.040303 dv-cinder-828806-6-smb devstack@keystone.service[82025]: [pid: 82025|app: 0|req: 728/1443] 10.222.0.33 () {60 vars in 1365 bytes} [Tue Sep 13 19:54:01 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 314 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 19:54:04.366885 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f8e1f99-4b08-4c40-a793-7559bd86fe97 None None] REQUEST_METHOD: `GET` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:54:04.367468 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f8e1f99-4b08-4c40-a793-7559bd86fe97 None None] SCRIPT_NAME: `/identity` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:54:04.367468 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f8e1f99-4b08-4c40-a793-7559bd86fe97 None None] PATH_INFO: `/` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:54:04.368865 dv-cinder-828806-6-smb devstack@keystone.service[82026]: [pid: 82026|app: 0|req: 716/1444] 127.0.0.1 () {54 vars in 917 bytes} [Tue Sep 13 19:54:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 19:54:04.374163 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-172a490c-f1a5-487b-9d80-9dc0ed410497 None None] REQUEST_METHOD: `POST` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:54:04.374600 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-172a490c-f1a5-487b-9d80-9dc0ed410497 None None] SCRIPT_NAME: `/identity` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:54:04.374708 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-172a490c-f1a5-487b-9d80-9dc0ed410497 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:54:04.442086 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.auth.core [None req-172a490c-f1a5-487b-9d80-9dc0ed410497 None None] MFA Rules not processed for user `57539b6a6f3b4d589f5f5e1d211cd6a0`. Rule list: `[]` (Enabled: `True`). {{(pid=82025) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 19:54:04.443342 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.fernet_utils [None req-172a490c-f1a5-487b-9d80-9dc0ed410497 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82025) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 19:54:04.459008 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG dbcounter [-] [82025] Writing DB stats keystone:SELECT=100 {{(pid=82025) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:54:04.545654 dv-cinder-828806-6-smb devstack@keystone.service[82025]: [pid: 82025|app: 0|req: 729/1445] 127.0.0.1 () {58 vars in 1014 bytes} [Tue Sep 13 19:54:04 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 172 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 19:54:04.845500 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f8e1f99-4b08-4c40-a793-7559bd86fe97 None None] Authenticating user token {{(pid=82026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:54:04.847164 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.common.fernet_utils [None req-6f8e1f99-4b08-4c40-a793-7559bd86fe97 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82026) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 19:54:04.949898 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f8e1f99-4b08-4c40-a793-7559bd86fe97 None None] Validating token access rules against request {{(pid=82026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:54:04.963666 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG dbcounter [-] [82026] Writing DB stats keystone:SELECT=100 {{(pid=82026) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:54:05.023533 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56742774-bf3c-47cf-a799-d89f8729ae46 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '023a2c79c2444611b3d431928e56685d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8c6fba0f15b4d6a84ff601919b7b8e4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:54:05.024133 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56742774-bf3c-47cf-a799-d89f8729ae46 service neutron] REQUEST_METHOD: `GET` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:54:05.024409 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56742774-bf3c-47cf-a799-d89f8729ae46 service neutron] SCRIPT_NAME: `/identity` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:54:05.024678 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56742774-bf3c-47cf-a799-d89f8729ae46 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:54:05.026263 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.common.fernet_utils [None req-56742774-bf3c-47cf-a799-d89f8729ae46 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82026) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 19:54:05.141358 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56742774-bf3c-47cf-a799-d89f8729ae46 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:54:05.142748 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56742774-bf3c-47cf-a799-d89f8729ae46 service neutron] RBAC: Authorization granted {{(pid=82026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:54:05.161239 dv-cinder-828806-6-smb devstack@keystone.service[82026]: [pid: 82026|app: 0|req: 717/1446] 10.222.0.33 () {60 vars in 1365 bytes} [Tue Sep 13 19:54:04 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 316 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 19:54:07.700210 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5037be5-e087-424e-afe9-76b53031ac08 None None] REQUEST_METHOD: `GET` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:54:07.700800 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5037be5-e087-424e-afe9-76b53031ac08 None None] SCRIPT_NAME: `/identity` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:54:07.700800 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5037be5-e087-424e-afe9-76b53031ac08 None None] PATH_INFO: `/` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:54:07.702082 dv-cinder-828806-6-smb devstack@keystone.service[82025]: [pid: 82025|app: 0|req: 730/1447] 127.0.0.1 () {54 vars in 917 bytes} [Tue Sep 13 19:54:07 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 19:54:07.707653 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96530672-1a0b-4871-bc5b-a1b871f85297 None None] REQUEST_METHOD: `POST` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:54:07.708083 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96530672-1a0b-4871-bc5b-a1b871f85297 None None] SCRIPT_NAME: `/identity` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:54:07.708277 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96530672-1a0b-4871-bc5b-a1b871f85297 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:54:07.756704 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG dbcounter [-] [82026] Writing DB stats keystone:SELECT=100 {{(pid=82026) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:54:07.778056 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.auth.core [None req-96530672-1a0b-4871-bc5b-a1b871f85297 None None] MFA Rules not processed for user `57539b6a6f3b4d589f5f5e1d211cd6a0`. Rule list: `[]` (Enabled: `True`). {{(pid=82026) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 19:54:07.779312 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.common.fernet_utils [None req-96530672-1a0b-4871-bc5b-a1b871f85297 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82026) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 19:54:07.881421 dv-cinder-828806-6-smb devstack@keystone.service[82026]: [pid: 82026|app: 0|req: 718/1448] 127.0.0.1 () {58 vars in 1014 bytes} [Tue Sep 13 19:54:07 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 175 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 19:54:08.168354 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5037be5-e087-424e-afe9-76b53031ac08 None None] Authenticating user token {{(pid=82025) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:54:08.169947 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.fernet_utils [None req-a5037be5-e087-424e-afe9-76b53031ac08 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82025) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 19:54:08.274019 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5037be5-e087-424e-afe9-76b53031ac08 None None] Validating token access rules against request {{(pid=82025) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:54:08.316165 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG dbcounter [-] [82025] Writing DB stats keystone:SELECT=100 {{(pid=82025) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:54:08.349693 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68af1f90-41d0-4b3a-b6a5-c848b4c12ab2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '023a2c79c2444611b3d431928e56685d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8c6fba0f15b4d6a84ff601919b7b8e4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82025) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:54:08.350315 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68af1f90-41d0-4b3a-b6a5-c848b4c12ab2 service neutron] REQUEST_METHOD: `GET` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:54:08.350595 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68af1f90-41d0-4b3a-b6a5-c848b4c12ab2 service neutron] SCRIPT_NAME: `/identity` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:54:08.351110 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68af1f90-41d0-4b3a-b6a5-c848b4c12ab2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:54:08.353215 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.fernet_utils [None req-68af1f90-41d0-4b3a-b6a5-c848b4c12ab2 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82025) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 19:54:08.467064 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68af1f90-41d0-4b3a-b6a5-c848b4c12ab2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:54:08.468468 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68af1f90-41d0-4b3a-b6a5-c848b4c12ab2 service neutron] RBAC: Authorization granted {{(pid=82025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:54:08.487068 dv-cinder-828806-6-smb devstack@keystone.service[82025]: [pid: 82025|app: 0|req: 731/1449] 10.222.0.33 () {60 vars in 1365 bytes} [Tue Sep 13 19:54:08 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 319 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 19:54:10.811795 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00f7bda8-f0dc-4f85-bc00-1704f3bba861 None None] REQUEST_METHOD: `GET` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:54:10.812371 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00f7bda8-f0dc-4f85-bc00-1704f3bba861 None None] SCRIPT_NAME: `/identity` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:54:10.812371 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00f7bda8-f0dc-4f85-bc00-1704f3bba861 None None] PATH_INFO: `/` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:54:10.813703 dv-cinder-828806-6-smb devstack@keystone.service[82026]: [pid: 82026|app: 0|req: 719/1450] 127.0.0.1 () {54 vars in 917 bytes} [Tue Sep 13 19:54:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 19:54:10.820748 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1082014-79da-4a0f-9890-5ee6df99dab7 None None] REQUEST_METHOD: `POST` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:54:10.821255 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1082014-79da-4a0f-9890-5ee6df99dab7 None None] SCRIPT_NAME: `/identity` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:54:10.821360 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1082014-79da-4a0f-9890-5ee6df99dab7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:54:10.887401 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.auth.core [None req-f1082014-79da-4a0f-9890-5ee6df99dab7 None None] MFA Rules not processed for user `57539b6a6f3b4d589f5f5e1d211cd6a0`. Rule list: `[]` (Enabled: `True`). {{(pid=82025) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 19:54:10.888638 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.fernet_utils [None req-f1082014-79da-4a0f-9890-5ee6df99dab7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82025) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 19:54:10.909707 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG dbcounter [-] [82025] Writing DB stats keystone:SELECT=100 {{(pid=82025) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:54:10.987107 dv-cinder-828806-6-smb devstack@keystone.service[82025]: [pid: 82025|app: 0|req: 732/1451] 127.0.0.1 () {58 vars in 1014 bytes} [Tue Sep 13 19:54:10 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 167 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 19:54:11.271776 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00f7bda8-f0dc-4f85-bc00-1704f3bba861 None None] Authenticating user token {{(pid=82026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:54:11.273307 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.common.fernet_utils [None req-00f7bda8-f0dc-4f85-bc00-1704f3bba861 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82026) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 19:54:11.375920 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00f7bda8-f0dc-4f85-bc00-1704f3bba861 None None] Validating token access rules against request {{(pid=82026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:54:11.396580 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG dbcounter [-] [82026] Writing DB stats keystone:SELECT=100 {{(pid=82026) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:54:11.449433 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-964a222e-7f04-4536-83b4-bbfd9e3bc16b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '023a2c79c2444611b3d431928e56685d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8c6fba0f15b4d6a84ff601919b7b8e4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:54:11.450030 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-964a222e-7f04-4536-83b4-bbfd9e3bc16b service neutron] REQUEST_METHOD: `GET` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:54:11.450318 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-964a222e-7f04-4536-83b4-bbfd9e3bc16b service neutron] SCRIPT_NAME: `/identity` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:54:11.450597 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-964a222e-7f04-4536-83b4-bbfd9e3bc16b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:54:11.452244 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.common.fernet_utils [None req-964a222e-7f04-4536-83b4-bbfd9e3bc16b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82026) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 19:54:11.560528 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-964a222e-7f04-4536-83b4-bbfd9e3bc16b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:54:11.561978 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-964a222e-7f04-4536-83b4-bbfd9e3bc16b service neutron] RBAC: Authorization granted {{(pid=82026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:54:11.580627 dv-cinder-828806-6-smb devstack@keystone.service[82026]: [pid: 82026|app: 0|req: 720/1452] 10.222.0.33 () {60 vars in 1365 bytes} [Tue Sep 13 19:54:11 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 309 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 19:54:13.856881 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fc6f12c-d0cc-4dd1-a57b-451b367dd5ad None None] REQUEST_METHOD: `GET` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:54:13.857454 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fc6f12c-d0cc-4dd1-a57b-451b367dd5ad None None] SCRIPT_NAME: `/identity` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:54:13.857454 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fc6f12c-d0cc-4dd1-a57b-451b367dd5ad None None] PATH_INFO: `/` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:54:13.858799 dv-cinder-828806-6-smb devstack@keystone.service[82025]: [pid: 82025|app: 0|req: 733/1453] 127.0.0.1 () {54 vars in 917 bytes} [Tue Sep 13 19:54:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 19:54:13.864928 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2710deb-85c3-4675-93b8-b76f70fe45a3 None None] REQUEST_METHOD: `POST` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:54:13.865353 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2710deb-85c3-4675-93b8-b76f70fe45a3 None None] SCRIPT_NAME: `/identity` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:54:13.865485 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2710deb-85c3-4675-93b8-b76f70fe45a3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:54:13.928758 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG dbcounter [-] [82026] Writing DB stats keystone:SELECT=100 {{(pid=82026) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:54:13.931660 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.auth.core [None req-b2710deb-85c3-4675-93b8-b76f70fe45a3 None None] MFA Rules not processed for user `57539b6a6f3b4d589f5f5e1d211cd6a0`. Rule list: `[]` (Enabled: `True`). {{(pid=82026) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 19:54:13.932938 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.common.fernet_utils [None req-b2710deb-85c3-4675-93b8-b76f70fe45a3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82026) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 19:54:14.028338 dv-cinder-828806-6-smb devstack@keystone.service[82026]: [pid: 82026|app: 0|req: 721/1454] 127.0.0.1 () {58 vars in 1014 bytes} [Tue Sep 13 19:54:13 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 19:54:14.318681 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fc6f12c-d0cc-4dd1-a57b-451b367dd5ad None None] Authenticating user token {{(pid=82025) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:54:14.320292 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.fernet_utils [None req-7fc6f12c-d0cc-4dd1-a57b-451b367dd5ad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82025) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 19:54:14.423956 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fc6f12c-d0cc-4dd1-a57b-451b367dd5ad None None] Validating token access rules against request {{(pid=82025) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:54:14.473614 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG dbcounter [-] [82025] Writing DB stats keystone:SELECT=100 {{(pid=82025) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:54:14.497414 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb47f5c6-51ec-44fa-8536-83e6b39ddf3c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '023a2c79c2444611b3d431928e56685d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8c6fba0f15b4d6a84ff601919b7b8e4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82025) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:54:14.498013 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb47f5c6-51ec-44fa-8536-83e6b39ddf3c service neutron] REQUEST_METHOD: `GET` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:54:14.498295 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb47f5c6-51ec-44fa-8536-83e6b39ddf3c service neutron] SCRIPT_NAME: `/identity` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:54:14.498565 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb47f5c6-51ec-44fa-8536-83e6b39ddf3c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:54:14.500192 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.fernet_utils [None req-fb47f5c6-51ec-44fa-8536-83e6b39ddf3c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82025) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 19:54:14.607740 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb47f5c6-51ec-44fa-8536-83e6b39ddf3c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:54:14.609196 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb47f5c6-51ec-44fa-8536-83e6b39ddf3c service neutron] RBAC: Authorization granted {{(pid=82025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:54:14.628718 dv-cinder-828806-6-smb devstack@keystone.service[82025]: [pid: 82025|app: 0|req: 734/1455] 10.222.0.33 () {60 vars in 1365 bytes} [Tue Sep 13 19:54:14 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 311 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 19:54:16.829801 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5a1e8be-7090-44e7-81ee-10a6758aef4a None None] REQUEST_METHOD: `GET` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:54:16.830425 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5a1e8be-7090-44e7-81ee-10a6758aef4a None None] SCRIPT_NAME: `/identity` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:54:16.830425 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5a1e8be-7090-44e7-81ee-10a6758aef4a None None] PATH_INFO: `/` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:54:16.831797 dv-cinder-828806-6-smb devstack@keystone.service[82026]: [pid: 82026|app: 0|req: 722/1456] 127.0.0.1 () {54 vars in 917 bytes} [Tue Sep 13 19:54:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 19:54:16.837231 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df0ce5ab-3a82-4499-87c4-ec52ef65e636 None None] REQUEST_METHOD: `POST` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:54:16.837649 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df0ce5ab-3a82-4499-87c4-ec52ef65e636 None None] SCRIPT_NAME: `/identity` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:54:16.837791 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df0ce5ab-3a82-4499-87c4-ec52ef65e636 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:54:16.903355 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.auth.core [None req-df0ce5ab-3a82-4499-87c4-ec52ef65e636 None None] MFA Rules not processed for user `57539b6a6f3b4d589f5f5e1d211cd6a0`. Rule list: `[]` (Enabled: `True`). {{(pid=82025) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 19:54:16.904578 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.fernet_utils [None req-df0ce5ab-3a82-4499-87c4-ec52ef65e636 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82025) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 19:54:16.934813 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG dbcounter [-] [82025] Writing DB stats keystone:SELECT=100 {{(pid=82025) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:54:17.002642 dv-cinder-828806-6-smb devstack@keystone.service[82025]: [pid: 82025|app: 0|req: 735/1457] 127.0.0.1 () {58 vars in 1014 bytes} [Tue Sep 13 19:54:16 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 19:54:17.290215 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5a1e8be-7090-44e7-81ee-10a6758aef4a None None] Authenticating user token {{(pid=82026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:54:17.291805 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.common.fernet_utils [None req-a5a1e8be-7090-44e7-81ee-10a6758aef4a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82026) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 19:54:17.394151 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5a1e8be-7090-44e7-81ee-10a6758aef4a None None] Validating token access rules against request {{(pid=82026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:54:17.421736 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG dbcounter [-] [82026] Writing DB stats keystone:SELECT=100 {{(pid=82026) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:54:17.466742 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16a0f83c-7b38-479a-8813-9cba2639bf31 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '023a2c79c2444611b3d431928e56685d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8c6fba0f15b4d6a84ff601919b7b8e4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:54:17.467362 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16a0f83c-7b38-479a-8813-9cba2639bf31 service neutron] REQUEST_METHOD: `GET` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:54:17.467645 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16a0f83c-7b38-479a-8813-9cba2639bf31 service neutron] SCRIPT_NAME: `/identity` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:54:17.467921 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16a0f83c-7b38-479a-8813-9cba2639bf31 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:54:17.469509 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.common.fernet_utils [None req-16a0f83c-7b38-479a-8813-9cba2639bf31 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82026) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 19:54:17.577431 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16a0f83c-7b38-479a-8813-9cba2639bf31 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:54:17.578862 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16a0f83c-7b38-479a-8813-9cba2639bf31 service neutron] RBAC: Authorization granted {{(pid=82026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:54:17.596978 dv-cinder-828806-6-smb devstack@keystone.service[82026]: [pid: 82026|app: 0|req: 723/1458] 10.222.0.33 () {60 vars in 1365 bytes} [Tue Sep 13 19:54:17 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 307 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 19:54:19.835181 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b9e12fa-aaa9-4f13-9396-fa8c71e8ac14 None None] REQUEST_METHOD: `GET` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:54:19.835792 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b9e12fa-aaa9-4f13-9396-fa8c71e8ac14 None None] SCRIPT_NAME: `/identity` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:54:19.835792 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b9e12fa-aaa9-4f13-9396-fa8c71e8ac14 None None] PATH_INFO: `/` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:54:19.837126 dv-cinder-828806-6-smb devstack@keystone.service[82025]: [pid: 82025|app: 0|req: 736/1459] 127.0.0.1 () {54 vars in 917 bytes} [Tue Sep 13 19:54:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 19:54:19.842848 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eac71c3-c2c4-4ebc-bc60-35509d8dd038 None None] REQUEST_METHOD: `POST` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:54:19.843332 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eac71c3-c2c4-4ebc-bc60-35509d8dd038 None None] SCRIPT_NAME: `/identity` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:54:19.843507 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eac71c3-c2c4-4ebc-bc60-35509d8dd038 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:54:19.909276 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.auth.core [None req-4eac71c3-c2c4-4ebc-bc60-35509d8dd038 None None] MFA Rules not processed for user `57539b6a6f3b4d589f5f5e1d211cd6a0`. Rule list: `[]` (Enabled: `True`). {{(pid=82026) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 19:54:19.910475 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.common.fernet_utils [None req-4eac71c3-c2c4-4ebc-bc60-35509d8dd038 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82026) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 19:54:19.918607 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG dbcounter [-] [82026] Writing DB stats keystone:SELECT=100 {{(pid=82026) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:54:20.006808 dv-cinder-828806-6-smb devstack@keystone.service[82026]: [pid: 82026|app: 0|req: 724/1460] 127.0.0.1 () {58 vars in 1014 bytes} [Tue Sep 13 19:54:19 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 19:54:20.294912 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b9e12fa-aaa9-4f13-9396-fa8c71e8ac14 None None] Authenticating user token {{(pid=82025) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:54:20.296501 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.fernet_utils [None req-5b9e12fa-aaa9-4f13-9396-fa8c71e8ac14 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82025) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 19:54:20.403585 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b9e12fa-aaa9-4f13-9396-fa8c71e8ac14 None None] Validating token access rules against request {{(pid=82025) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:54:20.460882 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG dbcounter [-] [82025] Writing DB stats keystone:SELECT=100 {{(pid=82025) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:54:20.479735 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad6ca78c-ed81-460b-881e-e6082880c16e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '023a2c79c2444611b3d431928e56685d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8c6fba0f15b4d6a84ff601919b7b8e4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82025) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:54:20.480352 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad6ca78c-ed81-460b-881e-e6082880c16e service neutron] REQUEST_METHOD: `GET` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:54:20.485087 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad6ca78c-ed81-460b-881e-e6082880c16e service neutron] SCRIPT_NAME: `/identity` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:54:20.485087 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad6ca78c-ed81-460b-881e-e6082880c16e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:54:20.485087 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.fernet_utils [None req-ad6ca78c-ed81-460b-881e-e6082880c16e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82025) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 19:54:20.600743 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad6ca78c-ed81-460b-881e-e6082880c16e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:54:20.602186 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad6ca78c-ed81-460b-881e-e6082880c16e service neutron] RBAC: Authorization granted {{(pid=82025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:54:20.624406 dv-cinder-828806-6-smb devstack@keystone.service[82025]: [pid: 82025|app: 0|req: 737/1461] 10.222.0.33 () {60 vars in 1365 bytes} [Tue Sep 13 19:54:20 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 330 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 19:54:22.957388 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d587cb1c-9461-4395-ba85-b1a05f4b77a3 None None] REQUEST_METHOD: `GET` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:54:22.957983 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d587cb1c-9461-4395-ba85-b1a05f4b77a3 None None] SCRIPT_NAME: `/identity` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:54:22.957983 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d587cb1c-9461-4395-ba85-b1a05f4b77a3 None None] PATH_INFO: `/` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:54:22.959307 dv-cinder-828806-6-smb devstack@keystone.service[82026]: [pid: 82026|app: 0|req: 725/1462] 127.0.0.1 () {54 vars in 917 bytes} [Tue Sep 13 19:54:22 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 19:54:22.964522 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6090dbd7-6d6c-4cf2-8fb3-0284b2f16b5f None None] REQUEST_METHOD: `POST` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:54:22.964928 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6090dbd7-6d6c-4cf2-8fb3-0284b2f16b5f None None] SCRIPT_NAME: `/identity` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:54:22.965077 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6090dbd7-6d6c-4cf2-8fb3-0284b2f16b5f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:54:23.029935 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.auth.core [None req-6090dbd7-6d6c-4cf2-8fb3-0284b2f16b5f None None] MFA Rules not processed for user `57539b6a6f3b4d589f5f5e1d211cd6a0`. Rule list: `[]` (Enabled: `True`). {{(pid=82025) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 19:54:23.031165 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.fernet_utils [None req-6090dbd7-6d6c-4cf2-8fb3-0284b2f16b5f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82025) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 19:54:23.069369 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG dbcounter [-] [82025] Writing DB stats keystone:SELECT=100 {{(pid=82025) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:54:23.127775 dv-cinder-828806-6-smb devstack@keystone.service[82025]: [pid: 82025|app: 0|req: 738/1463] 127.0.0.1 () {58 vars in 1014 bytes} [Tue Sep 13 19:54:22 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 19:54:23.416813 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d587cb1c-9461-4395-ba85-b1a05f4b77a3 None None] Authenticating user token {{(pid=82026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:54:23.418342 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.common.fernet_utils [None req-d587cb1c-9461-4395-ba85-b1a05f4b77a3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82026) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 19:54:23.521494 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d587cb1c-9461-4395-ba85-b1a05f4b77a3 None None] Validating token access rules against request {{(pid=82026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:54:23.558967 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG dbcounter [-] [82026] Writing DB stats keystone:SELECT=100 {{(pid=82026) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:54:23.595436 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fafe8b8c-67cf-481c-95b5-b5a0b5d9fdad service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '023a2c79c2444611b3d431928e56685d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8c6fba0f15b4d6a84ff601919b7b8e4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:54:23.596040 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fafe8b8c-67cf-481c-95b5-b5a0b5d9fdad service neutron] REQUEST_METHOD: `GET` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:54:23.596321 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fafe8b8c-67cf-481c-95b5-b5a0b5d9fdad service neutron] SCRIPT_NAME: `/identity` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:54:23.596600 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fafe8b8c-67cf-481c-95b5-b5a0b5d9fdad service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:54:23.598219 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.common.fernet_utils [None req-fafe8b8c-67cf-481c-95b5-b5a0b5d9fdad service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82026) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 19:54:23.704963 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fafe8b8c-67cf-481c-95b5-b5a0b5d9fdad service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:54:23.706984 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fafe8b8c-67cf-481c-95b5-b5a0b5d9fdad service neutron] RBAC: Authorization granted {{(pid=82026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:54:23.724899 dv-cinder-828806-6-smb devstack@keystone.service[82026]: [pid: 82026|app: 0|req: 726/1464] 10.222.0.33 () {60 vars in 1365 bytes} [Tue Sep 13 19:54:23 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 309 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 19:54:25.916710 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-581c6a1c-fb9f-45aa-b3ed-11722f5ae029 None None] REQUEST_METHOD: `GET` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:54:25.917304 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-581c6a1c-fb9f-45aa-b3ed-11722f5ae029 None None] SCRIPT_NAME: `/identity` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:54:25.917304 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-581c6a1c-fb9f-45aa-b3ed-11722f5ae029 None None] PATH_INFO: `/` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:54:25.918621 dv-cinder-828806-6-smb devstack@keystone.service[82025]: [pid: 82025|app: 0|req: 739/1465] 127.0.0.1 () {54 vars in 917 bytes} [Tue Sep 13 19:54:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 19:54:25.923930 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-258833da-ffb2-456a-ae51-68431945e443 None None] REQUEST_METHOD: `POST` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:54:25.924485 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-258833da-ffb2-456a-ae51-68431945e443 None None] SCRIPT_NAME: `/identity` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:54:25.924651 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-258833da-ffb2-456a-ae51-68431945e443 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:54:25.992559 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.auth.core [None req-258833da-ffb2-456a-ae51-68431945e443 None None] MFA Rules not processed for user `57539b6a6f3b4d589f5f5e1d211cd6a0`. Rule list: `[]` (Enabled: `True`). {{(pid=82026) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 19:54:25.993766 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.common.fernet_utils [None req-258833da-ffb2-456a-ae51-68431945e443 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82026) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 19:54:26.012267 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG dbcounter [-] [82026] Writing DB stats keystone:SELECT=100 {{(pid=82026) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:54:26.113169 dv-cinder-828806-6-smb devstack@keystone.service[82026]: [pid: 82026|app: 0|req: 727/1466] 127.0.0.1 () {58 vars in 1014 bytes} [Tue Sep 13 19:54:25 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 190 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 19:54:26.395923 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-581c6a1c-fb9f-45aa-b3ed-11722f5ae029 None None] Authenticating user token {{(pid=82025) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:54:26.398391 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.fernet_utils [None req-581c6a1c-fb9f-45aa-b3ed-11722f5ae029 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82025) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 19:54:26.503577 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-581c6a1c-fb9f-45aa-b3ed-11722f5ae029 None None] Validating token access rules against request {{(pid=82025) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:54:26.570422 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG dbcounter [-] [82025] Writing DB stats keystone:SELECT=100 {{(pid=82025) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:54:26.577045 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-750d8910-0e6c-4df7-a1fe-4d5616722ae1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '023a2c79c2444611b3d431928e56685d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8c6fba0f15b4d6a84ff601919b7b8e4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82025) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:54:26.577650 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-750d8910-0e6c-4df7-a1fe-4d5616722ae1 service neutron] REQUEST_METHOD: `GET` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:54:26.577935 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-750d8910-0e6c-4df7-a1fe-4d5616722ae1 service neutron] SCRIPT_NAME: `/identity` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:54:26.578212 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-750d8910-0e6c-4df7-a1fe-4d5616722ae1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:54:26.579901 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.fernet_utils [None req-750d8910-0e6c-4df7-a1fe-4d5616722ae1 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82025) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 19:54:26.690435 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-750d8910-0e6c-4df7-a1fe-4d5616722ae1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:54:26.691918 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-750d8910-0e6c-4df7-a1fe-4d5616722ae1 service neutron] RBAC: Authorization granted {{(pid=82025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:54:26.710884 dv-cinder-828806-6-smb devstack@keystone.service[82025]: [pid: 82025|app: 0|req: 740/1467] 10.222.0.33 () {60 vars in 1365 bytes} [Tue Sep 13 19:54:26 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 315 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 19:54:28.913483 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a9dda23-26a1-4eed-8c59-7c16204e57b1 None None] REQUEST_METHOD: `GET` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:54:28.914063 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a9dda23-26a1-4eed-8c59-7c16204e57b1 None None] SCRIPT_NAME: `/identity` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:54:28.914063 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a9dda23-26a1-4eed-8c59-7c16204e57b1 None None] PATH_INFO: `/` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:54:28.915476 dv-cinder-828806-6-smb devstack@keystone.service[82026]: [pid: 82026|app: 0|req: 728/1468] 127.0.0.1 () {54 vars in 917 bytes} [Tue Sep 13 19:54:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 19:54:28.920717 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b26741b-64ea-42fb-b484-a6a43da73299 None None] REQUEST_METHOD: `POST` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:54:28.921142 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b26741b-64ea-42fb-b484-a6a43da73299 None None] SCRIPT_NAME: `/identity` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:54:28.921252 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b26741b-64ea-42fb-b484-a6a43da73299 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:54:28.988924 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.auth.core [None req-2b26741b-64ea-42fb-b484-a6a43da73299 None None] MFA Rules not processed for user `57539b6a6f3b4d589f5f5e1d211cd6a0`. Rule list: `[]` (Enabled: `True`). {{(pid=82025) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 19:54:28.990163 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.fernet_utils [None req-2b26741b-64ea-42fb-b484-a6a43da73299 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82025) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 19:54:29.037866 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG dbcounter [-] [82025] Writing DB stats keystone:SELECT=100 {{(pid=82025) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:54:29.086984 dv-cinder-828806-6-smb devstack@keystone.service[82025]: [pid: 82025|app: 0|req: 741/1469] 127.0.0.1 () {58 vars in 1014 bytes} [Tue Sep 13 19:54:28 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 167 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 13 19:54:29.373619 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a9dda23-26a1-4eed-8c59-7c16204e57b1 None None] Authenticating user token {{(pid=82026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:54:29.375185 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.common.fernet_utils [None req-1a9dda23-26a1-4eed-8c59-7c16204e57b1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82026) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 19:54:29.477643 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a9dda23-26a1-4eed-8c59-7c16204e57b1 None None] Validating token access rules against request {{(pid=82026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:54:29.524070 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG dbcounter [-] [82026] Writing DB stats keystone:SELECT=100 {{(pid=82026) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:54:29.549787 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6267245f-0a14-43b2-992d-e38ddc4af926 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '023a2c79c2444611b3d431928e56685d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8c6fba0f15b4d6a84ff601919b7b8e4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:54:29.550386 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6267245f-0a14-43b2-992d-e38ddc4af926 service neutron] REQUEST_METHOD: `GET` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:54:29.550667 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6267245f-0a14-43b2-992d-e38ddc4af926 service neutron] SCRIPT_NAME: `/identity` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:54:29.550940 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6267245f-0a14-43b2-992d-e38ddc4af926 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:54:29.552564 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.common.fernet_utils [None req-6267245f-0a14-43b2-992d-e38ddc4af926 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82026) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 19:54:29.659487 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6267245f-0a14-43b2-992d-e38ddc4af926 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:54:29.660911 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6267245f-0a14-43b2-992d-e38ddc4af926 service neutron] RBAC: Authorization granted {{(pid=82026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:54:29.679150 dv-cinder-828806-6-smb devstack@keystone.service[82026]: [pid: 82026|app: 0|req: 729/1470] 10.222.0.33 () {60 vars in 1365 bytes} [Tue Sep 13 19:54:29 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 306 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 19:54:39.085480 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG dbcounter [-] [82025] Writing DB stats keystone:SELECT=22 {{(pid=82025) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:54:39.676647 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG dbcounter [-] [82026] Writing DB stats keystone:SELECT=66 {{(pid=82026) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:54:50.063097 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bccf02d2-d2d4-4dbb-af31-ba235724d35e None None] REQUEST_METHOD: `GET` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:54:50.063659 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bccf02d2-d2d4-4dbb-af31-ba235724d35e None None] SCRIPT_NAME: `/identity` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:54:50.063659 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bccf02d2-d2d4-4dbb-af31-ba235724d35e None None] PATH_INFO: `/` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:54:50.064943 dv-cinder-828806-6-smb devstack@keystone.service[82025]: [pid: 82025|app: 0|req: 742/1471] 10.222.0.33 () {54 vars in 927 bytes} [Tue Sep 13 19:54:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 19:54:50.071209 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8054611-b355-44d8-b4d0-8ab0f89c9338 None None] REQUEST_METHOD: `POST` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:54:50.071664 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8054611-b355-44d8-b4d0-8ab0f89c9338 None None] SCRIPT_NAME: `/identity` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:54:50.071769 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8054611-b355-44d8-b4d0-8ab0f89c9338 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:54:50.141809 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.auth.core [None req-a8054611-b355-44d8-b4d0-8ab0f89c9338 None None] MFA Rules not processed for user `57539b6a6f3b4d589f5f5e1d211cd6a0`. Rule list: `[]` (Enabled: `True`). {{(pid=82026) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 19:54:50.143004 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.common.fernet_utils [None req-a8054611-b355-44d8-b4d0-8ab0f89c9338 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82026) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 19:54:50.238199 dv-cinder-828806-6-smb devstack@keystone.service[82026]: [pid: 82026|app: 0|req: 730/1472] 10.222.0.33 () {58 vars in 1024 bytes} [Tue Sep 13 19:54:50 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 168 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 19:54:50.539814 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dffedc4-3c7e-4f2d-b28f-f2b9634a68f9 None None] REQUEST_METHOD: `GET` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:54:50.540082 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dffedc4-3c7e-4f2d-b28f-f2b9634a68f9 None None] SCRIPT_NAME: `/identity` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:54:50.540350 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dffedc4-3c7e-4f2d-b28f-f2b9634a68f9 None None] PATH_INFO: `/` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:54:50.541675 dv-cinder-828806-6-smb devstack@keystone.service[82025]: [pid: 82025|app: 0|req: 743/1473] 10.222.0.33 () {54 vars in 966 bytes} [Tue Sep 13 19:54:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 19:54:50.546585 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9714ae6f-e918-418f-80c3-10cb7526e4c1 None None] REQUEST_METHOD: `POST` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:54:50.546874 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9714ae6f-e918-418f-80c3-10cb7526e4c1 None None] SCRIPT_NAME: `/identity` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:54:50.547188 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9714ae6f-e918-418f-80c3-10cb7526e4c1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:54:50.624319 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.auth.core [None req-9714ae6f-e918-418f-80c3-10cb7526e4c1 None None] MFA Rules not processed for user `f7b2421bf1f84193a29f79709d1d5a19`. Rule list: `[]` (Enabled: `True`). {{(pid=82026) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 19:54:50.625527 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.common.fernet_utils [None req-9714ae6f-e918-418f-80c3-10cb7526e4c1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82026) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 19:54:50.646935 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG dbcounter [-] [82026] Writing DB stats keystone:SELECT=100 {{(pid=82026) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:54:50.703497 dv-cinder-828806-6-smb devstack@keystone.service[82026]: [pid: 82026|app: 0|req: 731/1474] 10.222.0.33 () {58 vars in 1063 bytes} [Tue Sep 13 19:54:50 2022] POST /identity/v3/auth/tokens => generated 3120 bytes in 158 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 19:54:50.712385 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dffedc4-3c7e-4f2d-b28f-f2b9634a68f9 None None] Authenticating user token {{(pid=82025) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:54:50.713908 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.fernet_utils [None req-0dffedc4-3c7e-4f2d-b28f-f2b9634a68f9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82025) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 19:54:50.940531 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dffedc4-3c7e-4f2d-b28f-f2b9634a68f9 None None] Validating token access rules against request {{(pid=82025) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:54:51.014245 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed0bdc33-f3a3-4613-a25a-29d380c78f9f service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f7b2421bf1f84193a29f79709d1d5a19', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8c6fba0f15b4d6a84ff601919b7b8e4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82025) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:54:51.014858 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed0bdc33-f3a3-4613-a25a-29d380c78f9f service glance] REQUEST_METHOD: `GET` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:54:51.015143 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed0bdc33-f3a3-4613-a25a-29d380c78f9f service glance] SCRIPT_NAME: `/identity` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:54:51.015417 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed0bdc33-f3a3-4613-a25a-29d380c78f9f service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:54:51.016994 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.fernet_utils [None req-ed0bdc33-f3a3-4613-a25a-29d380c78f9f service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82025) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 19:54:51.073234 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG dbcounter [-] [82025] Writing DB stats keystone:SELECT=100 {{(pid=82025) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:54:51.128786 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed0bdc33-f3a3-4613-a25a-29d380c78f9f service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=82025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:54:51.130210 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed0bdc33-f3a3-4613-a25a-29d380c78f9f service glance] RBAC: Authorization granted {{(pid=82025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:54:51.148322 dv-cinder-828806-6-smb devstack@keystone.service[82025]: [pid: 82025|app: 0|req: 744/1475] 10.222.0.33 () {60 vars in 1365 bytes} [Tue Sep 13 19:54:50 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 436 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 19:54:53.398539 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87c48792-d4c9-4568-878b-0a9d99647516 None None] REQUEST_METHOD: `GET` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:54:53.399139 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87c48792-d4c9-4568-878b-0a9d99647516 None None] SCRIPT_NAME: `/identity` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:54:53.399139 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87c48792-d4c9-4568-878b-0a9d99647516 None None] PATH_INFO: `/` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:54:53.400545 dv-cinder-828806-6-smb devstack@keystone.service[82026]: [pid: 82026|app: 0|req: 732/1476] 10.222.0.33 () {54 vars in 927 bytes} [Tue Sep 13 19:54:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 19:54:53.405737 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7379c8d5-f545-45b9-a916-319788e942e5 None None] REQUEST_METHOD: `POST` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:54:53.406154 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7379c8d5-f545-45b9-a916-319788e942e5 None None] SCRIPT_NAME: `/identity` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:54:53.406301 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7379c8d5-f545-45b9-a916-319788e942e5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:54:53.473308 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.auth.core [None req-7379c8d5-f545-45b9-a916-319788e942e5 None None] MFA Rules not processed for user `57539b6a6f3b4d589f5f5e1d211cd6a0`. Rule list: `[]` (Enabled: `True`). {{(pid=82025) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 19:54:53.474524 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.fernet_utils [None req-7379c8d5-f545-45b9-a916-319788e942e5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82025) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 19:54:53.571940 dv-cinder-828806-6-smb devstack@keystone.service[82025]: [pid: 82025|app: 0|req: 745/1477] 10.222.0.33 () {58 vars in 1024 bytes} [Tue Sep 13 19:54:53 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 167 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 19:54:53.845525 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87c48792-d4c9-4568-878b-0a9d99647516 None None] Authenticating user token {{(pid=82026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:54:53.847248 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.common.fernet_utils [None req-87c48792-d4c9-4568-878b-0a9d99647516 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82026) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 19:54:53.969543 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87c48792-d4c9-4568-878b-0a9d99647516 None None] Validating token access rules against request {{(pid=82026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:54:54.019358 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG dbcounter [-] [82026] Writing DB stats keystone:SELECT=100 {{(pid=82026) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:54:54.063444 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20bd99c2-e7e5-45df-8d93-dfc1070024c9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57539b6a6f3b4d589f5f5e1d211cd6a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b454f707d20347ada3d82aa85495635e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:54:54.064048 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20bd99c2-e7e5-45df-8d93-dfc1070024c9 admin admin] REQUEST_METHOD: `GET` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:54:54.064328 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20bd99c2-e7e5-45df-8d93-dfc1070024c9 admin admin] SCRIPT_NAME: `/identity` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:54:54.064599 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20bd99c2-e7e5-45df-8d93-dfc1070024c9 admin admin] PATH_INFO: `/v3/projects` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:54:54.065245 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20bd99c2-e7e5-45df-8d93-dfc1070024c9 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=82026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:54:54.068036 dv-cinder-828806-6-smb devstack@keystone.service[82026]: WARNING py.warnings [None req-20bd99c2-e7e5-45df-8d93-dfc1070024c9 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_projects": "(role:reader and system_scope:all) or (role:reader and domain_id:%(target.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Sep 13 19:54:54.068036 dv-cinder-828806-6-smb devstack@keystone.service[82026]: warnings.warn(msg) Sep 13 19:54:54.068036 dv-cinder-828806-6-smb devstack@keystone.service[82026]: Sep 13 19:54:54.069547 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20bd99c2-e7e5-45df-8d93-dfc1070024c9 admin admin] RBAC: Authorization granted {{(pid=82026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:54:54.089639 dv-cinder-828806-6-smb devstack@keystone.service[82026]: [pid: 82026|app: 0|req: 733/1478] 10.222.0.33 () {56 vars in 1108 bytes} [Tue Sep 13 19:54:53 2022] GET /identity/v3/projects => generated 2553 bytes in 245 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 13 19:54:56.335455 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33bb6df2-a582-42ea-a7d2-db3fb788af82 None None] REQUEST_METHOD: `GET` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:54:56.335984 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33bb6df2-a582-42ea-a7d2-db3fb788af82 None None] SCRIPT_NAME: `/identity` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:54:56.336091 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33bb6df2-a582-42ea-a7d2-db3fb788af82 None None] PATH_INFO: `/` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:54:56.337371 dv-cinder-828806-6-smb devstack@keystone.service[82025]: [pid: 82025|app: 0|req: 746/1479] 10.222.0.33 () {54 vars in 927 bytes} [Tue Sep 13 19:54:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 19:54:56.342688 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ec6110c-64e5-4900-9805-09dc918b10bf None None] REQUEST_METHOD: `POST` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:54:56.343142 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ec6110c-64e5-4900-9805-09dc918b10bf None None] SCRIPT_NAME: `/identity` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:54:56.343274 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ec6110c-64e5-4900-9805-09dc918b10bf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:54:56.407865 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.auth.core [None req-5ec6110c-64e5-4900-9805-09dc918b10bf None None] MFA Rules not processed for user `57539b6a6f3b4d589f5f5e1d211cd6a0`. Rule list: `[]` (Enabled: `True`). {{(pid=82026) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 19:54:56.409061 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.common.fernet_utils [None req-5ec6110c-64e5-4900-9805-09dc918b10bf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82026) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 19:54:56.504534 dv-cinder-828806-6-smb devstack@keystone.service[82026]: [pid: 82026|app: 0|req: 734/1480] 10.222.0.33 () {58 vars in 1024 bytes} [Tue Sep 13 19:54:56 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 19:54:56.816298 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33bb6df2-a582-42ea-a7d2-db3fb788af82 None None] Authenticating user token {{(pid=82025) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:54:56.817852 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.fernet_utils [None req-33bb6df2-a582-42ea-a7d2-db3fb788af82 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82025) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 19:54:56.829500 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG dbcounter [-] [82025] Writing DB stats keystone:SELECT=100 {{(pid=82025) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:54:56.972658 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33bb6df2-a582-42ea-a7d2-db3fb788af82 None None] Validating token access rules against request {{(pid=82025) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:54:57.053961 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG dbcounter [-] [82025] Writing DB stats keystone:SELECT=100 {{(pid=82025) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:54:57.087962 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86d4da77-c9ef-480c-8f81-9885ccb0707d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e66e7034abed4e0bad1f4137520c1e70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8c6fba0f15b4d6a84ff601919b7b8e4', 'project_domain_id': 'default', 'roles': ['service', 'member', 'reader', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82025) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:54:57.088565 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86d4da77-c9ef-480c-8f81-9885ccb0707d service nova] REQUEST_METHOD: `GET` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:54:57.088842 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86d4da77-c9ef-480c-8f81-9885ccb0707d service nova] SCRIPT_NAME: `/identity` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:54:57.089137 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86d4da77-c9ef-480c-8f81-9885ccb0707d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:54:57.090769 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.fernet_utils [None req-86d4da77-c9ef-480c-8f81-9885ccb0707d service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82025) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 19:54:57.192878 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86d4da77-c9ef-480c-8f81-9885ccb0707d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:54:57.195303 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86d4da77-c9ef-480c-8f81-9885ccb0707d service nova] RBAC: Authorization granted {{(pid=82025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:54:57.213910 dv-cinder-828806-6-smb devstack@keystone.service[82025]: [pid: 82025|app: 0|req: 747/1481] 10.222.0.33 () {60 vars in 1365 bytes} [Tue Sep 13 19:54:56 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 399 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 19:54:59.617838 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adca8879-ee11-4186-bb3b-4c3ba1703fec None None] REQUEST_METHOD: `GET` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:54:59.618375 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adca8879-ee11-4186-bb3b-4c3ba1703fec None None] SCRIPT_NAME: `/identity` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:54:59.618375 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adca8879-ee11-4186-bb3b-4c3ba1703fec None None] PATH_INFO: `/` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:54:59.619761 dv-cinder-828806-6-smb devstack@keystone.service[82026]: [pid: 82026|app: 0|req: 735/1482] 10.222.0.33 () {54 vars in 927 bytes} [Tue Sep 13 19:54:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 19:54:59.624924 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e2d4dc0-48f4-406c-9add-dedc95665d27 None None] REQUEST_METHOD: `POST` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:54:59.625352 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e2d4dc0-48f4-406c-9add-dedc95665d27 None None] SCRIPT_NAME: `/identity` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:54:59.625476 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e2d4dc0-48f4-406c-9add-dedc95665d27 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:54:59.689595 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.auth.core [None req-7e2d4dc0-48f4-406c-9add-dedc95665d27 None None] MFA Rules not processed for user `57539b6a6f3b4d589f5f5e1d211cd6a0`. Rule list: `[]` (Enabled: `True`). {{(pid=82025) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 19:54:59.691359 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.fernet_utils [None req-7e2d4dc0-48f4-406c-9add-dedc95665d27 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82025) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 19:54:59.736872 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG dbcounter [-] [82025] Writing DB stats keystone:SELECT=100 {{(pid=82025) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:54:59.790433 dv-cinder-828806-6-smb devstack@keystone.service[82025]: [pid: 82025|app: 0|req: 748/1483] 10.222.0.33 () {58 vars in 1024 bytes} [Tue Sep 13 19:54:59 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 19:55:00.090413 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adca8879-ee11-4186-bb3b-4c3ba1703fec None None] Authenticating user token {{(pid=82026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:55:00.092027 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.common.fernet_utils [None req-adca8879-ee11-4186-bb3b-4c3ba1703fec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82026) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 19:55:00.116739 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG dbcounter [-] [82026] Writing DB stats keystone:SELECT=100 {{(pid=82026) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:55:00.196724 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adca8879-ee11-4186-bb3b-4c3ba1703fec None None] Validating token access rules against request {{(pid=82026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:55:00.268883 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fef5579-aa8d-4d55-badb-e0ad3a3f44a3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '023a2c79c2444611b3d431928e56685d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8c6fba0f15b4d6a84ff601919b7b8e4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:55:00.269516 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fef5579-aa8d-4d55-badb-e0ad3a3f44a3 service neutron] REQUEST_METHOD: `GET` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:55:00.269803 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fef5579-aa8d-4d55-badb-e0ad3a3f44a3 service neutron] SCRIPT_NAME: `/identity` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:55:00.270079 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fef5579-aa8d-4d55-badb-e0ad3a3f44a3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:55:00.271727 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.common.fernet_utils [None req-6fef5579-aa8d-4d55-badb-e0ad3a3f44a3 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82026) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 19:55:00.346545 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG dbcounter [-] [82026] Writing DB stats keystone:SELECT=100 {{(pid=82026) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:55:00.383744 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fef5579-aa8d-4d55-badb-e0ad3a3f44a3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:55:00.385187 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fef5579-aa8d-4d55-badb-e0ad3a3f44a3 service neutron] RBAC: Authorization granted {{(pid=82026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:55:00.403098 dv-cinder-828806-6-smb devstack@keystone.service[82026]: [pid: 82026|app: 0|req: 736/1484] 10.222.0.33 () {60 vars in 1365 bytes} [Tue Sep 13 19:55:00 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 313 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 19:55:02.648948 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68ca9dc9-af97-465e-a2e4-3e3dcd7c0e08 None None] REQUEST_METHOD: `GET` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:55:02.649516 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68ca9dc9-af97-465e-a2e4-3e3dcd7c0e08 None None] SCRIPT_NAME: `/identity` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:55:02.649516 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68ca9dc9-af97-465e-a2e4-3e3dcd7c0e08 None None] PATH_INFO: `/` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:55:02.650868 dv-cinder-828806-6-smb devstack@keystone.service[82025]: [pid: 82025|app: 0|req: 749/1485] 10.222.0.33 () {54 vars in 927 bytes} [Tue Sep 13 19:55:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 19:55:02.656283 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-015a6bce-1521-4cb3-9869-2b1f8d87aa33 None None] REQUEST_METHOD: `POST` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:55:02.656716 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-015a6bce-1521-4cb3-9869-2b1f8d87aa33 None None] SCRIPT_NAME: `/identity` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:55:02.656850 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-015a6bce-1521-4cb3-9869-2b1f8d87aa33 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:55:02.722102 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.auth.core [None req-015a6bce-1521-4cb3-9869-2b1f8d87aa33 None None] MFA Rules not processed for user `57539b6a6f3b4d589f5f5e1d211cd6a0`. Rule list: `[]` (Enabled: `True`). {{(pid=82026) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 19:55:02.723347 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.common.fernet_utils [None req-015a6bce-1521-4cb3-9869-2b1f8d87aa33 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82026) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 19:55:02.821045 dv-cinder-828806-6-smb devstack@keystone.service[82026]: [pid: 82026|app: 0|req: 737/1486] 10.222.0.33 () {58 vars in 1024 bytes} [Tue Sep 13 19:55:02 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 19:55:03.118936 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68ca9dc9-af97-465e-a2e4-3e3dcd7c0e08 None None] Authenticating user token {{(pid=82025) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:55:03.120518 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.fernet_utils [None req-68ca9dc9-af97-465e-a2e4-3e3dcd7c0e08 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82025) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 19:55:03.229901 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68ca9dc9-af97-465e-a2e4-3e3dcd7c0e08 None None] Validating token access rules against request {{(pid=82025) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:55:03.302155 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG dbcounter [-] [82025] Writing DB stats keystone:SELECT=100 {{(pid=82025) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:55:03.303689 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-458d77f8-2049-4979-8487-4b1cf05f62a0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '023a2c79c2444611b3d431928e56685d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8c6fba0f15b4d6a84ff601919b7b8e4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82025) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:55:03.304303 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-458d77f8-2049-4979-8487-4b1cf05f62a0 service neutron] REQUEST_METHOD: `GET` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:55:03.304589 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-458d77f8-2049-4979-8487-4b1cf05f62a0 service neutron] SCRIPT_NAME: `/identity` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:55:03.305122 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-458d77f8-2049-4979-8487-4b1cf05f62a0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:55:03.306731 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.fernet_utils [None req-458d77f8-2049-4979-8487-4b1cf05f62a0 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82025) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 19:55:03.413642 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-458d77f8-2049-4979-8487-4b1cf05f62a0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:55:03.415076 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-458d77f8-2049-4979-8487-4b1cf05f62a0 service neutron] RBAC: Authorization granted {{(pid=82025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:55:03.433703 dv-cinder-828806-6-smb devstack@keystone.service[82025]: [pid: 82025|app: 0|req: 750/1487] 10.222.0.33 () {60 vars in 1365 bytes} [Tue Sep 13 19:55:03 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 315 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 19:55:05.733339 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c476eab0-f9d5-425d-bac4-04b47a4a400f None None] REQUEST_METHOD: `GET` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:55:05.733890 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c476eab0-f9d5-425d-bac4-04b47a4a400f None None] SCRIPT_NAME: `/identity` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:55:05.733890 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c476eab0-f9d5-425d-bac4-04b47a4a400f None None] PATH_INFO: `/` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:55:05.735287 dv-cinder-828806-6-smb devstack@keystone.service[82026]: [pid: 82026|app: 0|req: 738/1488] 10.222.0.33 () {54 vars in 927 bytes} [Tue Sep 13 19:55:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 19:55:05.741413 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6045124f-b755-4a53-8162-ebceef516049 None None] REQUEST_METHOD: `POST` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:55:05.741831 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6045124f-b755-4a53-8162-ebceef516049 None None] SCRIPT_NAME: `/identity` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:55:05.741970 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6045124f-b755-4a53-8162-ebceef516049 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:55:05.808342 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.auth.core [None req-6045124f-b755-4a53-8162-ebceef516049 None None] MFA Rules not processed for user `57539b6a6f3b4d589f5f5e1d211cd6a0`. Rule list: `[]` (Enabled: `True`). {{(pid=82025) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 19:55:05.809471 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.fernet_utils [None req-6045124f-b755-4a53-8162-ebceef516049 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82025) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 19:55:05.865368 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG dbcounter [-] [82025] Writing DB stats keystone:SELECT=100 {{(pid=82025) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:55:05.909554 dv-cinder-828806-6-smb devstack@keystone.service[82025]: [pid: 82025|app: 0|req: 751/1489] 10.222.0.33 () {58 vars in 1024 bytes} [Tue Sep 13 19:55:05 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 169 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 19:55:06.206609 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c476eab0-f9d5-425d-bac4-04b47a4a400f None None] Authenticating user token {{(pid=82026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:55:06.208233 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.common.fernet_utils [None req-c476eab0-f9d5-425d-bac4-04b47a4a400f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82026) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 19:55:06.244756 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG dbcounter [-] [82026] Writing DB stats keystone:SELECT=100 {{(pid=82026) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:55:06.313403 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c476eab0-f9d5-425d-bac4-04b47a4a400f None None] Validating token access rules against request {{(pid=82026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:55:06.385231 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4484c1f6-dd53-48c2-ad4c-915895f10264 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '023a2c79c2444611b3d431928e56685d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8c6fba0f15b4d6a84ff601919b7b8e4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:55:06.385827 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4484c1f6-dd53-48c2-ad4c-915895f10264 service neutron] REQUEST_METHOD: `GET` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:55:06.386106 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4484c1f6-dd53-48c2-ad4c-915895f10264 service neutron] SCRIPT_NAME: `/identity` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:55:06.386377 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4484c1f6-dd53-48c2-ad4c-915895f10264 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:55:06.388000 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.common.fernet_utils [None req-4484c1f6-dd53-48c2-ad4c-915895f10264 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82026) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 19:55:06.465870 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG dbcounter [-] [82026] Writing DB stats keystone:SELECT=100 {{(pid=82026) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:55:06.493914 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4484c1f6-dd53-48c2-ad4c-915895f10264 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:55:06.495474 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4484c1f6-dd53-48c2-ad4c-915895f10264 service neutron] RBAC: Authorization granted {{(pid=82026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:55:06.513475 dv-cinder-828806-6-smb devstack@keystone.service[82026]: [pid: 82026|app: 0|req: 739/1490] 10.222.0.33 () {60 vars in 1365 bytes} [Tue Sep 13 19:55:06 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 307 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 19:55:09.048907 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10e07608-edba-4c79-a05b-de3cd29c4e95 None None] REQUEST_METHOD: `GET` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:55:09.049470 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10e07608-edba-4c79-a05b-de3cd29c4e95 None None] SCRIPT_NAME: `/identity` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:55:09.049470 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10e07608-edba-4c79-a05b-de3cd29c4e95 None None] PATH_INFO: `/` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:55:09.051364 dv-cinder-828806-6-smb devstack@keystone.service[82025]: [pid: 82025|app: 0|req: 752/1491] 10.222.0.33 () {54 vars in 927 bytes} [Tue Sep 13 19:55:09 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 19:55:09.056993 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76dc9405-e4dd-4a71-b128-b4a9481fba88 None None] REQUEST_METHOD: `POST` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:55:09.057431 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76dc9405-e4dd-4a71-b128-b4a9481fba88 None None] SCRIPT_NAME: `/identity` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:55:09.057541 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76dc9405-e4dd-4a71-b128-b4a9481fba88 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:55:09.126612 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.auth.core [None req-76dc9405-e4dd-4a71-b128-b4a9481fba88 None None] MFA Rules not processed for user `57539b6a6f3b4d589f5f5e1d211cd6a0`. Rule list: `[]` (Enabled: `True`). {{(pid=82026) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 19:55:09.127847 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.common.fernet_utils [None req-76dc9405-e4dd-4a71-b128-b4a9481fba88 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82026) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 19:55:09.221353 dv-cinder-828806-6-smb devstack@keystone.service[82026]: [pid: 82026|app: 0|req: 740/1492] 10.222.0.33 () {58 vars in 1024 bytes} [Tue Sep 13 19:55:09 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 19:55:09.512373 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10e07608-edba-4c79-a05b-de3cd29c4e95 None None] Authenticating user token {{(pid=82025) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:55:09.513914 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.fernet_utils [None req-10e07608-edba-4c79-a05b-de3cd29c4e95 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82025) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 19:55:09.618410 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10e07608-edba-4c79-a05b-de3cd29c4e95 None None] Validating token access rules against request {{(pid=82025) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:55:09.690354 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e031af0-b3f4-4a7e-8c8e-c68bcd0b8a7e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '023a2c79c2444611b3d431928e56685d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8c6fba0f15b4d6a84ff601919b7b8e4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82025) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:55:09.691657 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e031af0-b3f4-4a7e-8c8e-c68bcd0b8a7e service neutron] REQUEST_METHOD: `GET` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:55:09.691945 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e031af0-b3f4-4a7e-8c8e-c68bcd0b8a7e service neutron] SCRIPT_NAME: `/identity` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:55:09.692227 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e031af0-b3f4-4a7e-8c8e-c68bcd0b8a7e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:55:09.693834 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.fernet_utils [None req-4e031af0-b3f4-4a7e-8c8e-c68bcd0b8a7e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82025) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 19:55:09.702201 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG dbcounter [-] [82025] Writing DB stats keystone:SELECT=100 {{(pid=82025) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:55:09.805441 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e031af0-b3f4-4a7e-8c8e-c68bcd0b8a7e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:55:09.807226 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e031af0-b3f4-4a7e-8c8e-c68bcd0b8a7e service neutron] RBAC: Authorization granted {{(pid=82025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:55:09.826938 dv-cinder-828806-6-smb devstack@keystone.service[82025]: [pid: 82025|app: 0|req: 753/1493] 10.222.0.33 () {60 vars in 1365 bytes} [Tue Sep 13 19:55:09 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 315 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 19:55:19.219814 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG dbcounter [-] [82026] Writing DB stats keystone:SELECT=82 {{(pid=82026) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:55:19.824600 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG dbcounter [-] [82025] Writing DB stats keystone:SELECT=50 {{(pid=82025) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:56:32.661531 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a71cebd-4eb4-4e95-9fd0-3d7ed4f219e8 None None] REQUEST_METHOD: `POST` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:56:32.662124 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a71cebd-4eb4-4e95-9fd0-3d7ed4f219e8 None None] SCRIPT_NAME: `/identity` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:56:32.662124 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a71cebd-4eb4-4e95-9fd0-3d7ed4f219e8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:56:32.736650 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.auth.core [None req-6a71cebd-4eb4-4e95-9fd0-3d7ed4f219e8 None None] MFA Rules not processed for user `57539b6a6f3b4d589f5f5e1d211cd6a0`. Rule list: `[]` (Enabled: `True`). {{(pid=82026) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 19:56:32.737852 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.common.fernet_utils [None req-6a71cebd-4eb4-4e95-9fd0-3d7ed4f219e8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82026) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 19:56:32.833435 dv-cinder-828806-6-smb devstack@keystone.service[82026]: [pid: 82026|app: 0|req: 741/1494] 10.222.0.33 () {58 vars in 958 bytes} [Tue Sep 13 19:56:32 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 173 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 19:56:32.842172 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54ff403d-8c4e-4ecd-835f-6d7cb6efe3c1 None None] REQUEST_METHOD: `POST` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:56:32.842677 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54ff403d-8c4e-4ecd-835f-6d7cb6efe3c1 None None] SCRIPT_NAME: `/identity` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:56:32.842783 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54ff403d-8c4e-4ecd-835f-6d7cb6efe3c1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:56:32.917575 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.auth.core [None req-54ff403d-8c4e-4ecd-835f-6d7cb6efe3c1 None None] MFA Rules not processed for user `57539b6a6f3b4d589f5f5e1d211cd6a0`. Rule list: `[]` (Enabled: `True`). {{(pid=82025) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 19:56:32.918717 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.fernet_utils [None req-54ff403d-8c4e-4ecd-835f-6d7cb6efe3c1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82025) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 19:56:33.015803 dv-cinder-828806-6-smb devstack@keystone.service[82025]: [pid: 82025|app: 0|req: 754/1495] 10.222.0.33 () {58 vars in 958 bytes} [Tue Sep 13 19:56:32 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 175 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 19:56:33.020493 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a71cebd-4eb4-4e95-9fd0-3d7ed4f219e8 None None] Authenticating user token {{(pid=82026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:56:33.022351 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.common.fernet_utils [None req-6a71cebd-4eb4-4e95-9fd0-3d7ed4f219e8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82026) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 19:56:33.033789 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a71cebd-4eb4-4e95-9fd0-3d7ed4f219e8 None None] Validating token access rules against request {{(pid=82026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:56:33.095081 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG dbcounter [-] [82026] Writing DB stats keystone:SELECT=100 {{(pid=82026) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:56:33.128891 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b29383d-9e5d-43da-9c24-095af6e76036 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57539b6a6f3b4d589f5f5e1d211cd6a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b454f707d20347ada3d82aa85495635e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:56:33.129493 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b29383d-9e5d-43da-9c24-095af6e76036 admin admin] REQUEST_METHOD: `GET` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:56:33.129773 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b29383d-9e5d-43da-9c24-095af6e76036 admin admin] SCRIPT_NAME: `/identity` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:56:33.130047 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b29383d-9e5d-43da-9c24-095af6e76036 admin admin] PATH_INFO: `/v3/domains` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:56:33.130698 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b29383d-9e5d-43da-9c24-095af6e76036 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82026) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 19:56:33.131014 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b29383d-9e5d-43da-9c24-095af6e76036 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:56:33.132061 dv-cinder-828806-6-smb devstack@keystone.service[82026]: WARNING py.warnings [None req-1b29383d-9e5d-43da-9c24-095af6e76036 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_domains": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Sep 13 19:56:33.132061 dv-cinder-828806-6-smb devstack@keystone.service[82026]: warnings.warn(msg) Sep 13 19:56:33.132061 dv-cinder-828806-6-smb devstack@keystone.service[82026]: Sep 13 19:56:33.132937 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b29383d-9e5d-43da-9c24-095af6e76036 admin admin] RBAC: Authorization granted {{(pid=82026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:56:33.143784 dv-cinder-828806-6-smb devstack@keystone.service[82026]: [pid: 82026|app: 0|req: 742/1496] 10.222.0.33 () {58 vars in 1153 bytes} [Tue Sep 13 19:56:33 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 124 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 19:56:33.152870 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54ff403d-8c4e-4ecd-835f-6d7cb6efe3c1 None None] Authenticating user token {{(pid=82025) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:56:33.162000 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54ff403d-8c4e-4ecd-835f-6d7cb6efe3c1 None None] Validating token access rules against request {{(pid=82025) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:56:33.222902 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG dbcounter [-] [82025] Writing DB stats keystone:SELECT=100 {{(pid=82025) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:56:33.257307 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd534871-530c-4194-be0c-5cc13687ef4d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57539b6a6f3b4d589f5f5e1d211cd6a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b454f707d20347ada3d82aa85495635e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82025) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:56:33.257942 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd534871-530c-4194-be0c-5cc13687ef4d admin admin] REQUEST_METHOD: `POST` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:56:33.258220 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd534871-530c-4194-be0c-5cc13687ef4d admin admin] SCRIPT_NAME: `/identity` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:56:33.258493 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd534871-530c-4194-be0c-5cc13687ef4d admin admin] PATH_INFO: `/v3/projects` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:56:33.259161 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd534871-530c-4194-be0c-5cc13687ef4d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:56:33.260887 dv-cinder-828806-6-smb devstack@keystone.service[82025]: WARNING py.warnings [None req-dd534871-530c-4194-be0c-5cc13687ef4d admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Sep 13 19:56:33.260887 dv-cinder-828806-6-smb devstack@keystone.service[82025]: warnings.warn(msg) Sep 13 19:56:33.260887 dv-cinder-828806-6-smb devstack@keystone.service[82025]: Sep 13 19:56:33.262067 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd534871-530c-4194-be0c-5cc13687ef4d admin admin] RBAC: Authorization granted {{(pid=82025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:56:33.371917 dv-cinder-828806-6-smb devstack@keystone.service[82025]: [pid: 82025|app: 0|req: 755/1497] 10.222.0.33 () {60 vars in 1153 bytes} [Tue Sep 13 19:56:33 2022] POST /identity/v3/projects => generated 379 bytes in 219 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 13 19:56:33.376220 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b29383d-9e5d-43da-9c24-095af6e76036 admin admin] Authenticating user token {{(pid=82026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:56:33.377791 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.common.fernet_utils [None req-1b29383d-9e5d-43da-9c24-095af6e76036 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82026) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 19:56:33.411143 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b29383d-9e5d-43da-9c24-095af6e76036 admin admin] Validating token access rules against request {{(pid=82026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:56:33.510203 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cb6168a-a5cc-4ae5-be09-b12bc9683943 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57539b6a6f3b4d589f5f5e1d211cd6a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b454f707d20347ada3d82aa85495635e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:56:33.510719 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cb6168a-a5cc-4ae5-be09-b12bc9683943 admin admin] REQUEST_METHOD: `POST` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:56:33.511000 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cb6168a-a5cc-4ae5-be09-b12bc9683943 admin admin] SCRIPT_NAME: `/identity` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:56:33.511306 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cb6168a-a5cc-4ae5-be09-b12bc9683943 admin admin] PATH_INFO: `/v3/users` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:56:33.511938 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cb6168a-a5cc-4ae5-be09-b12bc9683943 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:56:33.512951 dv-cinder-828806-6-smb devstack@keystone.service[82026]: WARNING py.warnings [None req-0cb6168a-a5cc-4ae5-be09-b12bc9683943 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Sep 13 19:56:33.512951 dv-cinder-828806-6-smb devstack@keystone.service[82026]: warnings.warn(msg) Sep 13 19:56:33.512951 dv-cinder-828806-6-smb devstack@keystone.service[82026]: Sep 13 19:56:33.514148 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cb6168a-a5cc-4ae5-be09-b12bc9683943 admin admin] RBAC: Authorization granted {{(pid=82026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:56:33.648171 dv-cinder-828806-6-smb devstack@keystone.service[82026]: [pid: 82026|app: 0|req: 743/1498] 10.222.0.33 () {60 vars in 1144 bytes} [Tue Sep 13 19:56:33 2022] POST /identity/v3/users => generated 290 bytes in 272 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 13 19:56:33.652451 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd534871-530c-4194-be0c-5cc13687ef4d admin admin] Authenticating user token {{(pid=82025) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:56:33.653958 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.fernet_utils [None req-dd534871-530c-4194-be0c-5cc13687ef4d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82025) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 19:56:33.715899 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd534871-530c-4194-be0c-5cc13687ef4d admin admin] Validating token access rules against request {{(pid=82025) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:56:33.798871 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG dbcounter [-] [82025] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82025) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:56:33.809674 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6dcd2e1-2300-4646-b659-a94be301c3c3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57539b6a6f3b4d589f5f5e1d211cd6a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b454f707d20347ada3d82aa85495635e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82025) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:56:33.813064 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6dcd2e1-2300-4646-b659-a94be301c3c3 admin admin] REQUEST_METHOD: `GET` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:56:33.813064 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6dcd2e1-2300-4646-b659-a94be301c3c3 admin admin] SCRIPT_NAME: `/identity` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:56:33.813064 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6dcd2e1-2300-4646-b659-a94be301c3c3 admin admin] PATH_INFO: `/v3/roles` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:56:33.813064 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6dcd2e1-2300-4646-b659-a94be301c3c3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:56:33.813064 dv-cinder-828806-6-smb devstack@keystone.service[82025]: WARNING py.warnings [None req-f6dcd2e1-2300-4646-b659-a94be301c3c3 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_roles": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Sep 13 19:56:33.813064 dv-cinder-828806-6-smb devstack@keystone.service[82025]: warnings.warn(msg) Sep 13 19:56:33.813064 dv-cinder-828806-6-smb devstack@keystone.service[82025]: Sep 13 19:56:33.813588 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6dcd2e1-2300-4646-b659-a94be301c3c3 admin admin] RBAC: Authorization granted {{(pid=82025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:56:33.827586 dv-cinder-828806-6-smb devstack@keystone.service[82025]: [pid: 82025|app: 0|req: 756/1499] 10.222.0.33 () {58 vars in 1122 bytes} [Tue Sep 13 19:56:33 2022] GET /identity/v3/roles => generated 1420 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 13 19:56:33.831637 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cb6168a-a5cc-4ae5-be09-b12bc9683943 admin admin] Authenticating user token {{(pid=82026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:56:33.833156 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.common.fernet_utils [None req-0cb6168a-a5cc-4ae5-be09-b12bc9683943 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82026) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 19:56:33.845216 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cb6168a-a5cc-4ae5-be09-b12bc9683943 admin admin] Validating token access rules against request {{(pid=82026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:56:33.870184 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG dbcounter [-] [82026] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=82026) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:56:33.938495 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31ad0cd6-f75f-4a11-88ec-f1d634c52b2c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57539b6a6f3b4d589f5f5e1d211cd6a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b454f707d20347ada3d82aa85495635e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:56:33.939119 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31ad0cd6-f75f-4a11-88ec-f1d634c52b2c admin admin] REQUEST_METHOD: `GET` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:56:33.939402 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31ad0cd6-f75f-4a11-88ec-f1d634c52b2c admin admin] SCRIPT_NAME: `/identity` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:56:33.939678 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31ad0cd6-f75f-4a11-88ec-f1d634c52b2c admin admin] PATH_INFO: `/v3/roles` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:56:33.940313 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31ad0cd6-f75f-4a11-88ec-f1d634c52b2c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:56:33.941319 dv-cinder-828806-6-smb devstack@keystone.service[82026]: WARNING py.warnings [None req-31ad0cd6-f75f-4a11-88ec-f1d634c52b2c admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_roles": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Sep 13 19:56:33.941319 dv-cinder-828806-6-smb devstack@keystone.service[82026]: warnings.warn(msg) Sep 13 19:56:33.941319 dv-cinder-828806-6-smb devstack@keystone.service[82026]: Sep 13 19:56:33.942203 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31ad0cd6-f75f-4a11-88ec-f1d634c52b2c admin admin] RBAC: Authorization granted {{(pid=82026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:56:33.954973 dv-cinder-828806-6-smb devstack@keystone.service[82026]: [pid: 82026|app: 0|req: 744/1500] 10.222.0.33 () {58 vars in 1122 bytes} [Tue Sep 13 19:56:33 2022] GET /identity/v3/roles => generated 1420 bytes in 124 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 13 19:56:33.959171 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6dcd2e1-2300-4646-b659-a94be301c3c3 admin admin] Authenticating user token {{(pid=82025) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:56:33.960966 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.fernet_utils [None req-f6dcd2e1-2300-4646-b659-a94be301c3c3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82025) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 19:56:33.994150 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6dcd2e1-2300-4646-b659-a94be301c3c3 admin admin] Validating token access rules against request {{(pid=82025) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:56:34.088717 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0708c4bc-2593-418b-bb3a-7f94fef424d6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57539b6a6f3b4d589f5f5e1d211cd6a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b454f707d20347ada3d82aa85495635e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82025) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:56:34.089295 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0708c4bc-2593-418b-bb3a-7f94fef424d6 admin admin] REQUEST_METHOD: `PUT` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:56:34.089575 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0708c4bc-2593-418b-bb3a-7f94fef424d6 admin admin] SCRIPT_NAME: `/identity` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:56:34.089849 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0708c4bc-2593-418b-bb3a-7f94fef424d6 admin admin] PATH_INFO: `/v3/projects/42bcbe08bcbb496c9c5c1c27b1877c8f/users/1545ec18dd1342aeb11e170e5877bfe0/roles/3618ab638a65401f82333da7596d1daf` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:56:34.112001 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0708c4bc-2593-418b-bb3a-7f94fef424d6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=42bcbe08bcbb496c9c5c1c27b1877c8f, user_id=1545ec18dd1342aeb11e170e5877bfe0, role_id=3618ab638a65401f82333da7596d1daf)` {{(pid=82025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:56:34.113083 dv-cinder-828806-6-smb devstack@keystone.service[82025]: WARNING py.warnings [None req-0708c4bc-2593-418b-bb3a-7f94fef424d6 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_grant": "(role:admin and system_scope:all) or ((role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.domain.id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.domain.id)s)) and (domain_id:%(target.role.domain_id)s or None:%(target.role.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Sep 13 19:56:34.113083 dv-cinder-828806-6-smb devstack@keystone.service[82025]: warnings.warn(msg) Sep 13 19:56:34.113083 dv-cinder-828806-6-smb devstack@keystone.service[82025]: Sep 13 19:56:34.115101 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0708c4bc-2593-418b-bb3a-7f94fef424d6 admin admin] RBAC: Authorization granted {{(pid=82025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:56:34.201045 dv-cinder-828806-6-smb devstack@keystone.service[82025]: [pid: 82025|app: 0|req: 757/1501] 10.222.0.33 () {60 vars in 1483 bytes} [Tue Sep 13 19:56:33 2022] PUT /identity/v3/projects/42bcbe08bcbb496c9c5c1c27b1877c8f/users/1545ec18dd1342aeb11e170e5877bfe0/roles/3618ab638a65401f82333da7596d1daf => generated 0 bytes in 242 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 19:56:34.213994 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b055458f-520d-40a0-854d-95f98eb874ba None None] REQUEST_METHOD: `POST` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:56:34.214305 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b055458f-520d-40a0-854d-95f98eb874ba None None] SCRIPT_NAME: `/identity` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:56:34.214569 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b055458f-520d-40a0-854d-95f98eb874ba None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:56:34.272367 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.auth.core [None req-b055458f-520d-40a0-854d-95f98eb874ba None None] MFA Rules not processed for user `1545ec18dd1342aeb11e170e5877bfe0`. Rule list: `[]` (Enabled: `True`). {{(pid=82026) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 19:56:34.273646 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.common.fernet_utils [None req-b055458f-520d-40a0-854d-95f98eb874ba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82026) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 19:56:34.354370 dv-cinder-828806-6-smb devstack@keystone.service[82026]: [pid: 82026|app: 0|req: 745/1502] 10.222.0.33 () {58 vars in 958 bytes} [Tue Sep 13 19:56:34 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 141 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 13 19:56:34.368206 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9269b92b-a735-4b8c-99ff-604ccbf709d1 None None] REQUEST_METHOD: `GET` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:56:34.368496 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9269b92b-a735-4b8c-99ff-604ccbf709d1 None None] SCRIPT_NAME: `/identity` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:56:34.368777 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9269b92b-a735-4b8c-99ff-604ccbf709d1 None None] PATH_INFO: `/` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:56:34.370103 dv-cinder-828806-6-smb devstack@keystone.service[82025]: [pid: 82025|app: 0|req: 758/1503] 10.222.0.33 () {54 vars in 964 bytes} [Tue Sep 13 19:56:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 13 19:56:34.375053 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-791da8ba-a68a-4c1c-b3b3-a3902f158695 None None] REQUEST_METHOD: `POST` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:56:34.375349 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-791da8ba-a68a-4c1c-b3b3-a3902f158695 None None] SCRIPT_NAME: `/identity` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:56:34.375631 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-791da8ba-a68a-4c1c-b3b3-a3902f158695 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:56:34.407977 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG dbcounter [-] [82026] Writing DB stats keystone:SELECT=100 {{(pid=82026) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:56:34.452956 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.auth.core [None req-791da8ba-a68a-4c1c-b3b3-a3902f158695 None None] MFA Rules not processed for user `46024fc6167f4321818b1bed27a521a0`. Rule list: `[]` (Enabled: `True`). {{(pid=82026) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 19:56:34.454461 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.common.fernet_utils [None req-791da8ba-a68a-4c1c-b3b3-a3902f158695 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82026) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 19:56:34.529827 dv-cinder-828806-6-smb devstack@keystone.service[82026]: [pid: 82026|app: 0|req: 746/1504] 10.222.0.33 () {58 vars in 1061 bytes} [Tue Sep 13 19:56:34 2022] POST /identity/v3/auth/tokens => generated 3120 bytes in 156 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 19:56:34.538207 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9269b92b-a735-4b8c-99ff-604ccbf709d1 None None] Authenticating user token {{(pid=82025) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:56:34.539775 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.fernet_utils [None req-9269b92b-a735-4b8c-99ff-604ccbf709d1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82025) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 19:56:34.590188 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG dbcounter [-] [82025] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82025) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:56:34.643066 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9269b92b-a735-4b8c-99ff-604ccbf709d1 None None] Validating token access rules against request {{(pid=82025) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:56:34.716663 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29de78eb-e004-4947-a530-b02505d5276a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46024fc6167f4321818b1bed27a521a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8c6fba0f15b4d6a84ff601919b7b8e4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82025) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:56:34.717257 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29de78eb-e004-4947-a530-b02505d5276a service cinder] REQUEST_METHOD: `GET` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:56:34.717537 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29de78eb-e004-4947-a530-b02505d5276a service cinder] SCRIPT_NAME: `/identity` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:56:34.717808 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29de78eb-e004-4947-a530-b02505d5276a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:56:34.719418 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.fernet_utils [None req-29de78eb-e004-4947-a530-b02505d5276a service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82025) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 19:56:34.819117 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29de78eb-e004-4947-a530-b02505d5276a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=82025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:56:34.820573 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29de78eb-e004-4947-a530-b02505d5276a service cinder] RBAC: Authorization granted {{(pid=82025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:56:34.824128 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG dbcounter [-] [82025] Writing DB stats keystone:SELECT=100 {{(pid=82025) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:56:34.838880 dv-cinder-828806-6-smb devstack@keystone.service[82025]: [pid: 82025|app: 0|req: 759/1505] 10.222.0.33 () {60 vars in 1365 bytes} [Tue Sep 13 19:56:34 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 302 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 19:56:34.884458 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1255fbcb-a161-466a-a668-ea3dbf2d1076 None None] REQUEST_METHOD: `GET` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:56:34.884876 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1255fbcb-a161-466a-a668-ea3dbf2d1076 None None] SCRIPT_NAME: `/identity` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:56:34.885024 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1255fbcb-a161-466a-a668-ea3dbf2d1076 None None] PATH_INFO: `/` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:56:34.886352 dv-cinder-828806-6-smb devstack@keystone.service[82026]: [pid: 82026|app: 0|req: 747/1506] 10.222.0.33 () {52 vars in 830 bytes} [Tue Sep 13 19:56:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 19:56:34.889886 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29de78eb-e004-4947-a530-b02505d5276a service cinder] Authenticating user token {{(pid=82025) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:56:34.891152 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.fernet_utils [None req-29de78eb-e004-4947-a530-b02505d5276a service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82025) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 19:56:34.990490 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29de78eb-e004-4947-a530-b02505d5276a service cinder] Validating token access rules against request {{(pid=82025) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:56:35.082625 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf6f1f37-6a7b-4b93-bc9f-3ed3f35984a5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57539b6a6f3b4d589f5f5e1d211cd6a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b454f707d20347ada3d82aa85495635e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82025) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:56:35.083265 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf6f1f37-6a7b-4b93-bc9f-3ed3f35984a5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:56:35.083545 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf6f1f37-6a7b-4b93-bc9f-3ed3f35984a5 admin admin] SCRIPT_NAME: `/identity` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:56:35.083819 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf6f1f37-6a7b-4b93-bc9f-3ed3f35984a5 admin admin] PATH_INFO: `/v3/users/1545ec18dd1342aeb11e170e5877bfe0` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:56:35.097084 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf6f1f37-6a7b-4b93-bc9f-3ed3f35984a5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=1545ec18dd1342aeb11e170e5877bfe0)` {{(pid=82025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:56:35.098123 dv-cinder-828806-6-smb devstack@keystone.service[82025]: WARNING py.warnings [None req-cf6f1f37-6a7b-4b93-bc9f-3ed3f35984a5 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Sep 13 19:56:35.098123 dv-cinder-828806-6-smb devstack@keystone.service[82025]: warnings.warn(msg) Sep 13 19:56:35.098123 dv-cinder-828806-6-smb devstack@keystone.service[82025]: Sep 13 19:56:35.099373 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf6f1f37-6a7b-4b93-bc9f-3ed3f35984a5 admin admin] RBAC: Authorization granted {{(pid=82025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:56:35.108829 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG dbcounter [-] [82025] Writing DB stats keystone:SELECT=100 {{(pid=82025) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:56:35.286194 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.notifications [None req-cf6f1f37-6a7b-4b93-bc9f-3ed3f35984a5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1545ec18dd1342aeb11e170e5877bfe0'} {{(pid=82025) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 19:56:35.355741 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.notifications [None req-cf6f1f37-6a7b-4b93-bc9f-3ed3f35984a5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1545ec18dd1342aeb11e170e5877bfe0'} {{(pid=82025) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 19:56:35.356182 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.notifications [None req-cf6f1f37-6a7b-4b93-bc9f-3ed3f35984a5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1545ec18dd1342aeb11e170e5877bfe0'} {{(pid=82025) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 19:56:35.380920 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.notifications [None req-cf6f1f37-6a7b-4b93-bc9f-3ed3f35984a5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1545ec18dd1342aeb11e170e5877bfe0'} {{(pid=82025) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 19:56:35.395802 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.notifications [None req-cf6f1f37-6a7b-4b93-bc9f-3ed3f35984a5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1545ec18dd1342aeb11e170e5877bfe0'} {{(pid=82025) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 19:56:35.401554 dv-cinder-828806-6-smb devstack@keystone.service[82025]: [pid: 82025|app: 0|req: 760/1507] 10.222.0.33 () {58 vars in 1224 bytes} [Tue Sep 13 19:56:34 2022] DELETE /identity/v3/users/1545ec18dd1342aeb11e170e5877bfe0 => generated 0 bytes in 512 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 19:56:35.405969 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89eeabd2-306a-4425-85a2-ef9f67de4ce1 None None] REQUEST_METHOD: `POST` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:56:35.406260 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89eeabd2-306a-4425-85a2-ef9f67de4ce1 None None] SCRIPT_NAME: `/identity` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:56:35.406536 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89eeabd2-306a-4425-85a2-ef9f67de4ce1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:56:35.472298 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.auth.core [None req-89eeabd2-306a-4425-85a2-ef9f67de4ce1 None None] MFA Rules not processed for user `57539b6a6f3b4d589f5f5e1d211cd6a0`. Rule list: `[]` (Enabled: `True`). {{(pid=82026) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 19:56:35.473535 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.common.fernet_utils [None req-89eeabd2-306a-4425-85a2-ef9f67de4ce1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82026) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 19:56:35.547963 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG dbcounter [-] [82026] Writing DB stats keystone:SELECT=100 {{(pid=82026) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:56:35.560493 dv-cinder-828806-6-smb devstack@keystone.service[82026]: [pid: 82026|app: 0|req: 748/1508] 10.222.0.33 () {58 vars in 958 bytes} [Tue Sep 13 19:56:35 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 155 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 19:56:35.571109 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf6f1f37-6a7b-4b93-bc9f-3ed3f35984a5 admin admin] Authenticating user token {{(pid=82025) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:56:35.572329 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.fernet_utils [None req-cf6f1f37-6a7b-4b93-bc9f-3ed3f35984a5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82025) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 19:56:35.669220 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf6f1f37-6a7b-4b93-bc9f-3ed3f35984a5 admin admin] Validating token access rules against request {{(pid=82025) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:56:35.722543 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG dbcounter [-] [82025] Writing DB stats keystone:DELETE=10,keystone:SELECT=89,keystone:INSERT=1 {{(pid=82025) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:56:35.742404 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07a4350c-fd3a-4c04-a98e-2df450b71a55 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '023a2c79c2444611b3d431928e56685d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8c6fba0f15b4d6a84ff601919b7b8e4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82025) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:56:35.743010 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07a4350c-fd3a-4c04-a98e-2df450b71a55 service neutron] REQUEST_METHOD: `GET` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:56:35.743372 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07a4350c-fd3a-4c04-a98e-2df450b71a55 service neutron] SCRIPT_NAME: `/identity` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:56:35.743671 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07a4350c-fd3a-4c04-a98e-2df450b71a55 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:56:35.746086 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.fernet_utils [None req-07a4350c-fd3a-4c04-a98e-2df450b71a55 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82025) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 19:56:35.856759 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07a4350c-fd3a-4c04-a98e-2df450b71a55 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:56:35.858087 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07a4350c-fd3a-4c04-a98e-2df450b71a55 service neutron] RBAC: Authorization granted {{(pid=82025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:56:35.876702 dv-cinder-828806-6-smb devstack@keystone.service[82025]: [pid: 82025|app: 0|req: 761/1509] 10.222.0.33 () {60 vars in 1365 bytes} [Tue Sep 13 19:56:35 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 306 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 19:56:36.300975 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89eeabd2-306a-4425-85a2-ef9f67de4ce1 None None] Authenticating user token {{(pid=82026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:56:36.306682 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.common.fernet_utils [None req-89eeabd2-306a-4425-85a2-ef9f67de4ce1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82026) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 19:56:36.314190 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89eeabd2-306a-4425-85a2-ef9f67de4ce1 None None] Validating token access rules against request {{(pid=82026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:56:36.412127 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bff2c90c-c95a-4a54-b5ca-569f6e320180 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57539b6a6f3b4d589f5f5e1d211cd6a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b454f707d20347ada3d82aa85495635e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:56:36.413527 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bff2c90c-c95a-4a54-b5ca-569f6e320180 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:56:36.413909 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bff2c90c-c95a-4a54-b5ca-569f6e320180 admin admin] SCRIPT_NAME: `/identity` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:56:36.414194 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bff2c90c-c95a-4a54-b5ca-569f6e320180 admin admin] PATH_INFO: `/v3/projects/42bcbe08bcbb496c9c5c1c27b1877c8f` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:56:36.424009 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bff2c90c-c95a-4a54-b5ca-569f6e320180 admin admin] RBAC: Authorizing `identity:delete_project(project_id=42bcbe08bcbb496c9c5c1c27b1877c8f)` {{(pid=82026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:56:36.425042 dv-cinder-828806-6-smb devstack@keystone.service[82026]: WARNING py.warnings [None req-bff2c90c-c95a-4a54-b5ca-569f6e320180 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Sep 13 19:56:36.425042 dv-cinder-828806-6-smb devstack@keystone.service[82026]: warnings.warn(msg) Sep 13 19:56:36.425042 dv-cinder-828806-6-smb devstack@keystone.service[82026]: Sep 13 19:56:36.426381 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bff2c90c-c95a-4a54-b5ca-569f6e320180 admin admin] RBAC: Authorization granted {{(pid=82026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:56:36.549288 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.notifications [None req-bff2c90c-c95a-4a54-b5ca-569f6e320180 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '42bcbe08bcbb496c9c5c1c27b1877c8f', 'request_id': 'req-bff2c90c-c95a-4a54-b5ca-569f6e320180'} {{(pid=82026) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 19:56:36.607055 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.notifications [None req-bff2c90c-c95a-4a54-b5ca-569f6e320180 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '42bcbe08bcbb496c9c5c1c27b1877c8f', 'request_id': 'req-bff2c90c-c95a-4a54-b5ca-569f6e320180'} {{(pid=82026) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 19:56:36.613595 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.notifications [None req-bff2c90c-c95a-4a54-b5ca-569f6e320180 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '42bcbe08bcbb496c9c5c1c27b1877c8f', 'request_id': 'req-bff2c90c-c95a-4a54-b5ca-569f6e320180'} {{(pid=82026) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 19:56:36.643327 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.notifications [None req-bff2c90c-c95a-4a54-b5ca-569f6e320180 admin admin] The token cache is being invalidate because project 42bcbe08bcbb496c9c5c1c27b1877c8f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82026) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 13 19:56:36.643645 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.notifications [None req-bff2c90c-c95a-4a54-b5ca-569f6e320180 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82026) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 19:56:36.644054 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.notifications [None req-bff2c90c-c95a-4a54-b5ca-569f6e320180 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82026) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 19:56:36.645452 dv-cinder-828806-6-smb devstack@keystone.service[82026]: [pid: 82026|app: 0|req: 749/1510] 10.222.0.33 () {58 vars in 1233 bytes} [Tue Sep 13 19:56:36 2022] DELETE /identity/v3/projects/42bcbe08bcbb496c9c5c1c27b1877c8f => generated 0 bytes in 345 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 19:56:45.874337 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG dbcounter [-] [82025] Writing DB stats keystone:SELECT=62 {{(pid=82025) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:56:46.641249 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG dbcounter [-] [82026] Writing DB stats keystone:SELECT=84,keystone:DELETE=7,keystone:INSERT=1 {{(pid=82026) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:58:14.217142 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b2fbb67-2bb5-464e-a399-5fbd0e1ee8ca None None] REQUEST_METHOD: `GET` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:58:14.217753 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b2fbb67-2bb5-464e-a399-5fbd0e1ee8ca None None] SCRIPT_NAME: `/identity` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:58:14.217753 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b2fbb67-2bb5-464e-a399-5fbd0e1ee8ca None None] PATH_INFO: `/` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:58:14.220182 dv-cinder-828806-6-smb devstack@keystone.service[82025]: [pid: 82025|app: 0|req: 762/1511] 127.0.0.1 () {54 vars in 901 bytes} [Tue Sep 13 19:58:14 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 19:58:14.225336 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d07294ff-7354-4814-a4d9-c2aa17586d59 None None] REQUEST_METHOD: `POST` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:58:14.225778 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d07294ff-7354-4814-a4d9-c2aa17586d59 None None] SCRIPT_NAME: `/identity` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:58:14.225942 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d07294ff-7354-4814-a4d9-c2aa17586d59 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:58:14.308121 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.auth.core [None req-d07294ff-7354-4814-a4d9-c2aa17586d59 None None] MFA Rules not processed for user `57539b6a6f3b4d589f5f5e1d211cd6a0`. Rule list: `[]` (Enabled: `True`). {{(pid=82026) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 19:58:14.309334 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.common.fernet_utils [None req-d07294ff-7354-4814-a4d9-c2aa17586d59 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82026) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 19:58:14.417997 dv-cinder-828806-6-smb devstack@keystone.service[82026]: [pid: 82026|app: 0|req: 750/1512] 127.0.0.1 () {58 vars in 998 bytes} [Tue Sep 13 19:58:14 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 194 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 19:58:14.572906 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b2fbb67-2bb5-464e-a399-5fbd0e1ee8ca None None] Authenticating user token {{(pid=82025) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:58:14.575313 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.fernet_utils [None req-9b2fbb67-2bb5-464e-a399-5fbd0e1ee8ca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82025) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 19:58:14.697023 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b2fbb67-2bb5-464e-a399-5fbd0e1ee8ca None None] Validating token access rules against request {{(pid=82025) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:58:14.702500 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c921f40-0394-492d-967c-920ad5b7b5ab service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e66e7034abed4e0bad1f4137520c1e70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8c6fba0f15b4d6a84ff601919b7b8e4', 'project_domain_id': 'default', 'roles': ['service', 'member', 'reader', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82025) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:58:14.703391 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c921f40-0394-492d-967c-920ad5b7b5ab service nova] REQUEST_METHOD: `GET` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:58:14.704039 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c921f40-0394-492d-967c-920ad5b7b5ab service nova] SCRIPT_NAME: `/identity` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:58:14.704311 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c921f40-0394-492d-967c-920ad5b7b5ab service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:58:14.712770 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c921f40-0394-492d-967c-920ad5b7b5ab service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:58:14.714353 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c921f40-0394-492d-967c-920ad5b7b5ab service nova] RBAC: Authorization granted {{(pid=82025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:58:14.723873 dv-cinder-828806-6-smb devstack@keystone.service[82025]: [pid: 82025|app: 0|req: 763/1513] 10.222.0.33 () {60 vars in 1365 bytes} [Tue Sep 13 19:58:14 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 151 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 19:58:15.575696 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f72d5b08-3a60-4623-b11e-1c512a715d5c None None] REQUEST_METHOD: `GET` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:58:15.576265 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f72d5b08-3a60-4623-b11e-1c512a715d5c None None] SCRIPT_NAME: `/identity` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:58:15.576265 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f72d5b08-3a60-4623-b11e-1c512a715d5c None None] PATH_INFO: `/v3` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:58:15.577693 dv-cinder-828806-6-smb devstack@keystone.service[82026]: [pid: 82026|app: 0|req: 751/1514] 10.222.0.16 () {54 vars in 925 bytes} [Tue Sep 13 19:58:15 2022] GET /identity/v3 => generated 255 bytes in 3 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 19:58:15.584315 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b89cad44-021e-4c2a-9ae7-a0422b4bdab5 None None] REQUEST_METHOD: `POST` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:58:15.584722 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b89cad44-021e-4c2a-9ae7-a0422b4bdab5 None None] SCRIPT_NAME: `/identity` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:58:15.585017 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b89cad44-021e-4c2a-9ae7-a0422b4bdab5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:58:15.644103 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.auth.core [None req-b89cad44-021e-4c2a-9ae7-a0422b4bdab5 None None] MFA Rules not processed for user `060ea3dea2134429967c164bd158b272`. Rule list: `[]` (Enabled: `True`). {{(pid=82025) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 19:58:15.645305 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.fernet_utils [None req-b89cad44-021e-4c2a-9ae7-a0422b4bdab5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82025) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 19:58:15.713201 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG dbcounter [-] [82025] Writing DB stats keystone:SELECT=100 {{(pid=82025) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:58:15.718636 dv-cinder-828806-6-smb devstack@keystone.service[82025]: [pid: 82025|app: 0|req: 764/1515] 10.222.0.16 () {58 vars in 1015 bytes} [Tue Sep 13 19:58:15 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 135 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 13 19:58:15.817479 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba2c3845-8d31-4dad-afd0-a7750c9b20d3 None None] REQUEST_METHOD: `GET` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:58:15.817765 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba2c3845-8d31-4dad-afd0-a7750c9b20d3 None None] SCRIPT_NAME: `/identity` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:58:15.818073 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba2c3845-8d31-4dad-afd0-a7750c9b20d3 None None] PATH_INFO: `/` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:58:15.819455 dv-cinder-828806-6-smb devstack@keystone.service[82026]: [pid: 82026|app: 0|req: 752/1516] 127.0.0.1 () {54 vars in 901 bytes} [Tue Sep 13 19:58:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 19:58:15.825595 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b11edee9-b155-4dae-bd9e-4e7ae68304be None None] REQUEST_METHOD: `POST` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:58:15.825939 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b11edee9-b155-4dae-bd9e-4e7ae68304be None None] SCRIPT_NAME: `/identity` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:58:15.826167 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b11edee9-b155-4dae-bd9e-4e7ae68304be None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:58:15.846402 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.auth.core [None req-b11edee9-b155-4dae-bd9e-4e7ae68304be None None] MFA Rules not processed for user `57539b6a6f3b4d589f5f5e1d211cd6a0`. Rule list: `[]` (Enabled: `True`). {{(pid=82025) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 19:58:15.847638 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.fernet_utils [None req-b11edee9-b155-4dae-bd9e-4e7ae68304be None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82025) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 19:58:15.861610 dv-cinder-828806-6-smb devstack@keystone.service[82025]: [pid: 82025|app: 0|req: 765/1517] 127.0.0.1 () {58 vars in 998 bytes} [Tue Sep 13 19:58:15 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 19:58:16.013809 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba2c3845-8d31-4dad-afd0-a7750c9b20d3 None None] Authenticating user token {{(pid=82026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:58:16.028485 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba2c3845-8d31-4dad-afd0-a7750c9b20d3 None None] Validating token access rules against request {{(pid=82026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:58:16.034969 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-949f4538-184d-4fec-a537-df3a4ed745e7 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e66e7034abed4e0bad1f4137520c1e70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8c6fba0f15b4d6a84ff601919b7b8e4', 'project_domain_id': 'default', 'roles': ['service', 'member', 'reader', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:58:16.035595 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-949f4538-184d-4fec-a537-df3a4ed745e7 service nova] REQUEST_METHOD: `GET` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:58:16.035879 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-949f4538-184d-4fec-a537-df3a4ed745e7 service nova] SCRIPT_NAME: `/identity` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:58:16.036158 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-949f4538-184d-4fec-a537-df3a4ed745e7 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:58:16.044085 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-949f4538-184d-4fec-a537-df3a4ed745e7 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:58:16.045674 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-949f4538-184d-4fec-a537-df3a4ed745e7 service nova] RBAC: Authorization granted {{(pid=82026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:58:16.056676 dv-cinder-828806-6-smb devstack@keystone.service[82026]: [pid: 82026|app: 0|req: 753/1518] 10.222.0.33 () {60 vars in 1365 bytes} [Tue Sep 13 19:58:16 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 19:58:24.387604 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-befb6751-576a-4279-9920-0f2b22693339 None None] REQUEST_METHOD: `GET` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:58:24.388106 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-befb6751-576a-4279-9920-0f2b22693339 None None] SCRIPT_NAME: `/identity` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:58:24.388207 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-befb6751-576a-4279-9920-0f2b22693339 None None] PATH_INFO: `/` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:58:24.389529 dv-cinder-828806-6-smb devstack@keystone.service[82025]: [pid: 82025|app: 0|req: 766/1519] 10.222.0.33 () {54 vars in 961 bytes} [Tue Sep 13 19:58:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 19:58:24.395093 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17f7987a-28a3-4cb3-af1e-6e9a896a0103 None None] REQUEST_METHOD: `POST` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:58:24.395510 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17f7987a-28a3-4cb3-af1e-6e9a896a0103 None None] SCRIPT_NAME: `/identity` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:58:24.395655 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17f7987a-28a3-4cb3-af1e-6e9a896a0103 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:58:24.419626 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.auth.core [None req-17f7987a-28a3-4cb3-af1e-6e9a896a0103 None None] MFA Rules not processed for user `060ea3dea2134429967c164bd158b272`. Rule list: `[]` (Enabled: `True`). {{(pid=82026) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 19:58:24.420840 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.common.fernet_utils [None req-17f7987a-28a3-4cb3-af1e-6e9a896a0103 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82026) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 19:58:24.430047 dv-cinder-828806-6-smb devstack@keystone.service[82026]: [pid: 82026|app: 0|req: 754/1520] 10.222.0.33 () {58 vars in 1058 bytes} [Tue Sep 13 19:58:24 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 19:58:24.437740 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-befb6751-576a-4279-9920-0f2b22693339 None None] Authenticating user token {{(pid=82025) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:58:24.451319 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-befb6751-576a-4279-9920-0f2b22693339 None None] Validating token access rules against request {{(pid=82025) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:58:24.459308 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73e35dbf-97dd-46b4-b316-c0fc152887e2 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '060ea3dea2134429967c164bd158b272', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8c6fba0f15b4d6a84ff601919b7b8e4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82025) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:58:24.459903 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73e35dbf-97dd-46b4-b316-c0fc152887e2 service placement] REQUEST_METHOD: `GET` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:58:24.460183 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73e35dbf-97dd-46b4-b316-c0fc152887e2 service placement] SCRIPT_NAME: `/identity` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:58:24.460454 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73e35dbf-97dd-46b4-b316-c0fc152887e2 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:58:24.468750 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73e35dbf-97dd-46b4-b316-c0fc152887e2 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=82025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:58:24.471377 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73e35dbf-97dd-46b4-b316-c0fc152887e2 service placement] RBAC: Authorization granted {{(pid=82025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:58:24.481082 dv-cinder-828806-6-smb devstack@keystone.service[82025]: [pid: 82025|app: 0|req: 767/1521] 10.222.0.33 () {60 vars in 1365 bytes} [Tue Sep 13 19:58:24 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 19:58:27.559026 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0da3653-85b7-4249-a8cc-4f6a7cb57ea2 None None] REQUEST_METHOD: `GET` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:58:27.559623 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0da3653-85b7-4249-a8cc-4f6a7cb57ea2 None None] SCRIPT_NAME: `/identity` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:58:27.559726 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0da3653-85b7-4249-a8cc-4f6a7cb57ea2 None None] PATH_INFO: `/` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:58:27.561033 dv-cinder-828806-6-smb devstack@keystone.service[82026]: [pid: 82026|app: 0|req: 755/1522] 127.0.0.1 () {54 vars in 901 bytes} [Tue Sep 13 19:58:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 19:58:27.567965 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40937371-1eb0-440d-a1cf-20c1294602ed None None] REQUEST_METHOD: `POST` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:58:27.568401 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40937371-1eb0-440d-a1cf-20c1294602ed None None] SCRIPT_NAME: `/identity` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:58:27.568514 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40937371-1eb0-440d-a1cf-20c1294602ed None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:58:27.587735 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.auth.core [None req-40937371-1eb0-440d-a1cf-20c1294602ed None None] MFA Rules not processed for user `57539b6a6f3b4d589f5f5e1d211cd6a0`. Rule list: `[]` (Enabled: `True`). {{(pid=82025) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 19:58:27.588961 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.fernet_utils [None req-40937371-1eb0-440d-a1cf-20c1294602ed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82025) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 19:58:27.597104 dv-cinder-828806-6-smb devstack@keystone.service[82025]: [pid: 82025|app: 0|req: 768/1523] 127.0.0.1 () {58 vars in 998 bytes} [Tue Sep 13 19:58:27 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 19:58:27.751857 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0da3653-85b7-4249-a8cc-4f6a7cb57ea2 None None] Authenticating user token {{(pid=82026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:58:27.767417 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0da3653-85b7-4249-a8cc-4f6a7cb57ea2 None None] Validating token access rules against request {{(pid=82026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:58:27.772933 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdb257dd-a7b2-43dd-81e7-3f5b903b9e81 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e66e7034abed4e0bad1f4137520c1e70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8c6fba0f15b4d6a84ff601919b7b8e4', 'project_domain_id': 'default', 'roles': ['service', 'member', 'reader', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:58:27.773530 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdb257dd-a7b2-43dd-81e7-3f5b903b9e81 service nova] REQUEST_METHOD: `GET` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:58:27.773815 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdb257dd-a7b2-43dd-81e7-3f5b903b9e81 service nova] SCRIPT_NAME: `/identity` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:58:27.774094 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdb257dd-a7b2-43dd-81e7-3f5b903b9e81 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:58:27.782976 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdb257dd-a7b2-43dd-81e7-3f5b903b9e81 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:58:27.784589 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdb257dd-a7b2-43dd-81e7-3f5b903b9e81 service nova] RBAC: Authorization granted {{(pid=82026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:58:27.794019 dv-cinder-828806-6-smb devstack@keystone.service[82026]: [pid: 82026|app: 0|req: 756/1524] 10.222.0.33 () {60 vars in 1365 bytes} [Tue Sep 13 19:58:27 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 19:58:28.961643 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69b20dcb-5c51-461f-bc64-36456e2a009b None None] REQUEST_METHOD: `GET` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:58:28.962214 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69b20dcb-5c51-461f-bc64-36456e2a009b None None] SCRIPT_NAME: `/identity` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:58:28.962214 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69b20dcb-5c51-461f-bc64-36456e2a009b None None] PATH_INFO: `/` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:58:28.963595 dv-cinder-828806-6-smb devstack@keystone.service[82025]: [pid: 82025|app: 0|req: 769/1525] 127.0.0.1 () {54 vars in 901 bytes} [Tue Sep 13 19:58:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 19:58:28.970291 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e07c1e07-8eb7-40ab-87b9-2dac85aae1b9 None None] REQUEST_METHOD: `POST` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:58:28.970739 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e07c1e07-8eb7-40ab-87b9-2dac85aae1b9 None None] SCRIPT_NAME: `/identity` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:58:28.970843 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e07c1e07-8eb7-40ab-87b9-2dac85aae1b9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:58:28.990098 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.auth.core [None req-e07c1e07-8eb7-40ab-87b9-2dac85aae1b9 None None] MFA Rules not processed for user `57539b6a6f3b4d589f5f5e1d211cd6a0`. Rule list: `[]` (Enabled: `True`). {{(pid=82026) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 19:58:28.991346 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.common.fernet_utils [None req-e07c1e07-8eb7-40ab-87b9-2dac85aae1b9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82026) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 19:58:28.999167 dv-cinder-828806-6-smb devstack@keystone.service[82026]: [pid: 82026|app: 0|req: 757/1526] 127.0.0.1 () {58 vars in 998 bytes} [Tue Sep 13 19:58:28 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 19:58:29.152825 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69b20dcb-5c51-461f-bc64-36456e2a009b None None] Authenticating user token {{(pid=82025) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:58:29.167779 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69b20dcb-5c51-461f-bc64-36456e2a009b None None] Validating token access rules against request {{(pid=82025) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:58:29.173500 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f54bb8d-149e-4ff8-b70b-80ba53a162d0 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e66e7034abed4e0bad1f4137520c1e70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8c6fba0f15b4d6a84ff601919b7b8e4', 'project_domain_id': 'default', 'roles': ['service', 'member', 'reader', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82025) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:58:29.174098 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f54bb8d-149e-4ff8-b70b-80ba53a162d0 service nova] REQUEST_METHOD: `GET` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:58:29.174384 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f54bb8d-149e-4ff8-b70b-80ba53a162d0 service nova] SCRIPT_NAME: `/identity` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:58:29.174662 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f54bb8d-149e-4ff8-b70b-80ba53a162d0 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:58:29.182757 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f54bb8d-149e-4ff8-b70b-80ba53a162d0 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:58:29.184365 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f54bb8d-149e-4ff8-b70b-80ba53a162d0 service nova] RBAC: Authorization granted {{(pid=82025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:58:29.194038 dv-cinder-828806-6-smb devstack@keystone.service[82025]: [pid: 82025|app: 0|req: 770/1527] 10.222.0.33 () {60 vars in 1365 bytes} [Tue Sep 13 19:58:29 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 19:58:33.521303 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aab6b535-f69b-4b08-8a1c-e88b3c29d574 None None] REQUEST_METHOD: `GET` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:58:33.521854 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aab6b535-f69b-4b08-8a1c-e88b3c29d574 None None] SCRIPT_NAME: `/identity` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:58:33.521854 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aab6b535-f69b-4b08-8a1c-e88b3c29d574 None None] PATH_INFO: `/` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:58:33.523283 dv-cinder-828806-6-smb devstack@keystone.service[82026]: [pid: 82026|app: 0|req: 758/1528] 127.0.0.1 () {54 vars in 917 bytes} [Tue Sep 13 19:58:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 19:58:33.537000 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25c32797-2771-4406-b19d-90ea620ab34e None None] REQUEST_METHOD: `POST` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:58:33.537000 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25c32797-2771-4406-b19d-90ea620ab34e None None] SCRIPT_NAME: `/identity` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:58:33.537000 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25c32797-2771-4406-b19d-90ea620ab34e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:58:33.549038 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.auth.core [None req-25c32797-2771-4406-b19d-90ea620ab34e None None] MFA Rules not processed for user `57539b6a6f3b4d589f5f5e1d211cd6a0`. Rule list: `[]` (Enabled: `True`). {{(pid=82025) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 19:58:33.550241 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.fernet_utils [None req-25c32797-2771-4406-b19d-90ea620ab34e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82025) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 19:58:33.558204 dv-cinder-828806-6-smb devstack@keystone.service[82025]: [pid: 82025|app: 0|req: 771/1529] 127.0.0.1 () {58 vars in 1014 bytes} [Tue Sep 13 19:58:33 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 19:58:33.850767 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aab6b535-f69b-4b08-8a1c-e88b3c29d574 None None] Authenticating user token {{(pid=82026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:58:33.852479 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.common.fernet_utils [None req-aab6b535-f69b-4b08-8a1c-e88b3c29d574 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82026) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 19:58:33.885660 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG dbcounter [-] [82026] Writing DB stats keystone:SELECT=100 {{(pid=82026) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:58:33.930957 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aab6b535-f69b-4b08-8a1c-e88b3c29d574 None None] Validating token access rules against request {{(pid=82026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:58:33.934538 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ad5f07e-a0ab-460e-8e12-a45046cab10b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '023a2c79c2444611b3d431928e56685d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8c6fba0f15b4d6a84ff601919b7b8e4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:58:33.935198 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ad5f07e-a0ab-460e-8e12-a45046cab10b service neutron] REQUEST_METHOD: `GET` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:58:33.935484 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ad5f07e-a0ab-460e-8e12-a45046cab10b service neutron] SCRIPT_NAME: `/identity` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:58:33.935762 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ad5f07e-a0ab-460e-8e12-a45046cab10b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:58:33.945948 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ad5f07e-a0ab-460e-8e12-a45046cab10b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:58:33.947429 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ad5f07e-a0ab-460e-8e12-a45046cab10b service neutron] RBAC: Authorization granted {{(pid=82026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:58:33.957513 dv-cinder-828806-6-smb devstack@keystone.service[82026]: [pid: 82026|app: 0|req: 759/1530] 10.222.0.33 () {60 vars in 1365 bytes} [Tue Sep 13 19:58:33 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 107 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 19:58:36.163171 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a109f042-50a4-44de-8546-877cffb46013 None None] REQUEST_METHOD: `GET` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:58:36.163716 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a109f042-50a4-44de-8546-877cffb46013 None None] SCRIPT_NAME: `/identity` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:58:36.163716 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a109f042-50a4-44de-8546-877cffb46013 None None] PATH_INFO: `/` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:58:36.165127 dv-cinder-828806-6-smb devstack@keystone.service[82025]: [pid: 82025|app: 0|req: 772/1531] 127.0.0.1 () {54 vars in 917 bytes} [Tue Sep 13 19:58:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 19:58:36.170658 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd62ab8e-3aec-4b7f-ae2d-d39d341513ab None None] REQUEST_METHOD: `POST` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:58:36.171185 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd62ab8e-3aec-4b7f-ae2d-d39d341513ab None None] SCRIPT_NAME: `/identity` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:58:36.171290 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd62ab8e-3aec-4b7f-ae2d-d39d341513ab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:58:36.192669 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.auth.core [None req-dd62ab8e-3aec-4b7f-ae2d-d39d341513ab None None] MFA Rules not processed for user `57539b6a6f3b4d589f5f5e1d211cd6a0`. Rule list: `[]` (Enabled: `True`). {{(pid=82026) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 19:58:36.194154 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.common.fernet_utils [None req-dd62ab8e-3aec-4b7f-ae2d-d39d341513ab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82026) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 19:58:36.202416 dv-cinder-828806-6-smb devstack@keystone.service[82026]: [pid: 82026|app: 0|req: 760/1532] 127.0.0.1 () {58 vars in 1014 bytes} [Tue Sep 13 19:58:36 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 19:58:36.493291 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a109f042-50a4-44de-8546-877cffb46013 None None] Authenticating user token {{(pid=82025) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:58:36.495087 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.fernet_utils [None req-a109f042-50a4-44de-8546-877cffb46013 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82025) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 19:58:36.508880 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a109f042-50a4-44de-8546-877cffb46013 None None] Validating token access rules against request {{(pid=82025) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:58:36.512438 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a668de4-4694-4d8f-9610-3da09b0d6faa service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '023a2c79c2444611b3d431928e56685d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8c6fba0f15b4d6a84ff601919b7b8e4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82025) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:58:36.513040 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a668de4-4694-4d8f-9610-3da09b0d6faa service neutron] REQUEST_METHOD: `GET` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:58:36.513328 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a668de4-4694-4d8f-9610-3da09b0d6faa service neutron] SCRIPT_NAME: `/identity` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:58:36.513609 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a668de4-4694-4d8f-9610-3da09b0d6faa service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:58:36.522614 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a668de4-4694-4d8f-9610-3da09b0d6faa service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:58:36.524083 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a668de4-4694-4d8f-9610-3da09b0d6faa service neutron] RBAC: Authorization granted {{(pid=82025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:58:36.533415 dv-cinder-828806-6-smb devstack@keystone.service[82025]: [pid: 82025|app: 0|req: 773/1533] 10.222.0.33 () {60 vars in 1365 bytes} [Tue Sep 13 19:58:36 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 19:58:40.205827 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ead6d8f-386d-444c-95fc-3de18c848cb4 None None] REQUEST_METHOD: `GET` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:58:40.206390 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ead6d8f-386d-444c-95fc-3de18c848cb4 None None] SCRIPT_NAME: `/identity` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:58:40.206390 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ead6d8f-386d-444c-95fc-3de18c848cb4 None None] PATH_INFO: `/` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:58:40.207785 dv-cinder-828806-6-smb devstack@keystone.service[82026]: [pid: 82026|app: 0|req: 761/1534] 127.0.0.1 () {54 vars in 917 bytes} [Tue Sep 13 19:58:40 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 19:58:40.213007 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cd638bc-814e-436c-aafb-8e438b3d2527 None None] REQUEST_METHOD: `POST` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:58:40.213434 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cd638bc-814e-436c-aafb-8e438b3d2527 None None] SCRIPT_NAME: `/identity` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:58:40.213594 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cd638bc-814e-436c-aafb-8e438b3d2527 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:58:40.233378 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.auth.core [None req-1cd638bc-814e-436c-aafb-8e438b3d2527 None None] MFA Rules not processed for user `57539b6a6f3b4d589f5f5e1d211cd6a0`. Rule list: `[]` (Enabled: `True`). {{(pid=82025) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 19:58:40.234588 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.fernet_utils [None req-1cd638bc-814e-436c-aafb-8e438b3d2527 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82025) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 19:58:40.242462 dv-cinder-828806-6-smb devstack@keystone.service[82025]: [pid: 82025|app: 0|req: 774/1535] 127.0.0.1 () {58 vars in 1014 bytes} [Tue Sep 13 19:58:40 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 19:58:40.551953 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ead6d8f-386d-444c-95fc-3de18c848cb4 None None] Authenticating user token {{(pid=82026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:58:40.553720 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.common.fernet_utils [None req-2ead6d8f-386d-444c-95fc-3de18c848cb4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82026) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 19:58:40.633377 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ead6d8f-386d-444c-95fc-3de18c848cb4 None None] Validating token access rules against request {{(pid=82026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:58:40.637018 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c07fa18-1dbe-4454-91ee-6233127ef5f0 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46024fc6167f4321818b1bed27a521a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8c6fba0f15b4d6a84ff601919b7b8e4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:58:40.637630 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c07fa18-1dbe-4454-91ee-6233127ef5f0 service cinder] REQUEST_METHOD: `GET` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:58:40.637916 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c07fa18-1dbe-4454-91ee-6233127ef5f0 service cinder] SCRIPT_NAME: `/identity` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:58:40.638195 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c07fa18-1dbe-4454-91ee-6233127ef5f0 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:58:40.648228 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c07fa18-1dbe-4454-91ee-6233127ef5f0 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=82026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:58:40.649670 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c07fa18-1dbe-4454-91ee-6233127ef5f0 service cinder] RBAC: Authorization granted {{(pid=82026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:58:40.659507 dv-cinder-828806-6-smb devstack@keystone.service[82026]: [pid: 82026|app: 0|req: 762/1536] 10.222.0.33 () {60 vars in 1365 bytes} [Tue Sep 13 19:58:40 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 108 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 19:58:42.839914 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f3948c9-3be8-4d1f-bd37-903c5abb8a21 None None] REQUEST_METHOD: `GET` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:58:42.840446 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f3948c9-3be8-4d1f-bd37-903c5abb8a21 None None] SCRIPT_NAME: `/identity` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:58:42.840578 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f3948c9-3be8-4d1f-bd37-903c5abb8a21 None None] PATH_INFO: `/` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:58:42.841916 dv-cinder-828806-6-smb devstack@keystone.service[82025]: [pid: 82025|app: 0|req: 775/1537] 127.0.0.1 () {54 vars in 917 bytes} [Tue Sep 13 19:58:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 19:58:42.847869 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d775cf7e-7760-4b5e-8c14-bf0d87e0f70b None None] REQUEST_METHOD: `POST` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:58:42.848294 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d775cf7e-7760-4b5e-8c14-bf0d87e0f70b None None] SCRIPT_NAME: `/identity` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:58:42.848438 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d775cf7e-7760-4b5e-8c14-bf0d87e0f70b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:58:42.868760 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.auth.core [None req-d775cf7e-7760-4b5e-8c14-bf0d87e0f70b None None] MFA Rules not processed for user `57539b6a6f3b4d589f5f5e1d211cd6a0`. Rule list: `[]` (Enabled: `True`). {{(pid=82026) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 19:58:42.869974 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.common.fernet_utils [None req-d775cf7e-7760-4b5e-8c14-bf0d87e0f70b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82026) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 19:58:42.878102 dv-cinder-828806-6-smb devstack@keystone.service[82026]: [pid: 82026|app: 0|req: 763/1538] 127.0.0.1 () {58 vars in 1014 bytes} [Tue Sep 13 19:58:42 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 19:58:43.180939 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f3948c9-3be8-4d1f-bd37-903c5abb8a21 None None] Authenticating user token {{(pid=82025) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:58:43.182648 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.fernet_utils [None req-7f3948c9-3be8-4d1f-bd37-903c5abb8a21 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82025) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 19:58:43.195976 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f3948c9-3be8-4d1f-bd37-903c5abb8a21 None None] Validating token access rules against request {{(pid=82025) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:58:43.199636 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9211a25-ec69-4de2-9b80-9d89fae3b1a2 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46024fc6167f4321818b1bed27a521a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8c6fba0f15b4d6a84ff601919b7b8e4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82025) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:58:43.200224 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9211a25-ec69-4de2-9b80-9d89fae3b1a2 service cinder] REQUEST_METHOD: `GET` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:58:43.200503 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9211a25-ec69-4de2-9b80-9d89fae3b1a2 service cinder] SCRIPT_NAME: `/identity` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:58:43.200770 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9211a25-ec69-4de2-9b80-9d89fae3b1a2 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:58:43.210161 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9211a25-ec69-4de2-9b80-9d89fae3b1a2 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=82025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:58:43.211602 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9211a25-ec69-4de2-9b80-9d89fae3b1a2 service cinder] RBAC: Authorization granted {{(pid=82025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:58:43.221401 dv-cinder-828806-6-smb devstack@keystone.service[82025]: [pid: 82025|app: 0|req: 776/1539] 10.222.0.33 () {60 vars in 1365 bytes} [Tue Sep 13 19:58:43 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 19:58:52.863755 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG dbcounter [-] [82026] Writing DB stats keystone:SELECT=63 {{(pid=82026) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:58:53.216726 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG dbcounter [-] [82025] Writing DB stats keystone:SELECT=37 {{(pid=82025) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 20:00:11.579616 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c125e39-f2ed-4fc9-a645-864b86a27380 None None] REQUEST_METHOD: `POST` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:00:11.580267 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c125e39-f2ed-4fc9-a645-864b86a27380 None None] SCRIPT_NAME: `/identity` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:00:11.580267 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c125e39-f2ed-4fc9-a645-864b86a27380 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:00:11.608161 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.auth.core [None req-1c125e39-f2ed-4fc9-a645-864b86a27380 None None] MFA Rules not processed for user `57539b6a6f3b4d589f5f5e1d211cd6a0`. Rule list: `[]` (Enabled: `True`). {{(pid=82026) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 20:00:11.609392 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.common.fernet_utils [None req-1c125e39-f2ed-4fc9-a645-864b86a27380 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82026) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 20:00:11.620481 dv-cinder-828806-6-smb devstack@keystone.service[82026]: [pid: 82026|app: 0|req: 764/1540] 10.222.0.33 () {58 vars in 958 bytes} [Tue Sep 13 20:00:11 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 20:00:11.629153 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd0faeb6-58d6-47d4-afac-d38c6d3f56d9 None None] REQUEST_METHOD: `POST` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:00:11.629708 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd0faeb6-58d6-47d4-afac-d38c6d3f56d9 None None] SCRIPT_NAME: `/identity` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:00:11.629708 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd0faeb6-58d6-47d4-afac-d38c6d3f56d9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:00:11.657718 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.auth.core [None req-bd0faeb6-58d6-47d4-afac-d38c6d3f56d9 None None] MFA Rules not processed for user `57539b6a6f3b4d589f5f5e1d211cd6a0`. Rule list: `[]` (Enabled: `True`). {{(pid=82025) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 20:00:11.659273 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.fernet_utils [None req-bd0faeb6-58d6-47d4-afac-d38c6d3f56d9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82025) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 20:00:11.674584 dv-cinder-828806-6-smb devstack@keystone.service[82025]: [pid: 82025|app: 0|req: 777/1541] 10.222.0.33 () {58 vars in 958 bytes} [Tue Sep 13 20:00:11 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 46 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 20:00:11.679734 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c125e39-f2ed-4fc9-a645-864b86a27380 None None] Authenticating user token {{(pid=82026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 20:00:11.691918 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c125e39-f2ed-4fc9-a645-864b86a27380 None None] Validating token access rules against request {{(pid=82026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 20:00:11.699798 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bc192e9-5f89-4467-87e3-e1657a9e2056 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57539b6a6f3b4d589f5f5e1d211cd6a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b454f707d20347ada3d82aa85495635e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 20:00:11.700418 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bc192e9-5f89-4467-87e3-e1657a9e2056 admin admin] REQUEST_METHOD: `GET` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:00:11.700701 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bc192e9-5f89-4467-87e3-e1657a9e2056 admin admin] SCRIPT_NAME: `/identity` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:00:11.700976 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bc192e9-5f89-4467-87e3-e1657a9e2056 admin admin] PATH_INFO: `/v3/domains` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:00:11.701630 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bc192e9-5f89-4467-87e3-e1657a9e2056 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82026) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 20:00:11.701935 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bc192e9-5f89-4467-87e3-e1657a9e2056 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 20:00:11.703579 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bc192e9-5f89-4467-87e3-e1657a9e2056 admin admin] RBAC: Authorization granted {{(pid=82026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 20:00:11.722015 dv-cinder-828806-6-smb devstack@keystone.service[82026]: [pid: 82026|app: 0|req: 765/1542] 10.222.0.33 () {58 vars in 1153 bytes} [Tue Sep 13 20:00:11 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 20:00:11.731268 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd0faeb6-58d6-47d4-afac-d38c6d3f56d9 None None] Authenticating user token {{(pid=82025) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 20:00:11.746770 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd0faeb6-58d6-47d4-afac-d38c6d3f56d9 None None] Validating token access rules against request {{(pid=82025) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 20:00:11.753092 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b593736d-9370-4925-ad0b-2bada4ea2e02 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57539b6a6f3b4d589f5f5e1d211cd6a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b454f707d20347ada3d82aa85495635e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82025) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 20:00:11.754044 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b593736d-9370-4925-ad0b-2bada4ea2e02 admin admin] REQUEST_METHOD: `POST` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:00:11.754640 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b593736d-9370-4925-ad0b-2bada4ea2e02 admin admin] SCRIPT_NAME: `/identity` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:00:11.755185 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b593736d-9370-4925-ad0b-2bada4ea2e02 admin admin] PATH_INFO: `/v3/projects` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:00:11.756125 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b593736d-9370-4925-ad0b-2bada4ea2e02 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 20:00:11.758408 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b593736d-9370-4925-ad0b-2bada4ea2e02 admin admin] RBAC: Authorization granted {{(pid=82025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 20:00:11.774045 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ae07afb-3568-4e7a-a597-bc7b0c05259e None None] REQUEST_METHOD: `POST` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:00:11.774425 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ae07afb-3568-4e7a-a597-bc7b0c05259e None None] SCRIPT_NAME: `/identity` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:00:11.774611 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ae07afb-3568-4e7a-a597-bc7b0c05259e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:00:11.816443 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.auth.core [None req-4ae07afb-3568-4e7a-a597-bc7b0c05259e None None] MFA Rules not processed for user `57539b6a6f3b4d589f5f5e1d211cd6a0`. Rule list: `[]` (Enabled: `True`). {{(pid=82026) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 20:00:11.823529 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.common.fernet_utils [None req-4ae07afb-3568-4e7a-a597-bc7b0c05259e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82026) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 20:00:11.829078 dv-cinder-828806-6-smb devstack@keystone.service[82026]: [pid: 82026|app: 0|req: 766/1543] 10.222.0.33 () {58 vars in 958 bytes} [Tue Sep 13 20:00:11 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 56 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 20:00:11.830485 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cb6ffbc-2dae-4a4f-bc01-6feebba828e7 None None] REQUEST_METHOD: `POST` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:00:11.830753 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cb6ffbc-2dae-4a4f-bc01-6feebba828e7 None None] SCRIPT_NAME: `/identity` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:00:11.831081 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cb6ffbc-2dae-4a4f-bc01-6feebba828e7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:00:11.853979 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.auth.core [None req-6cb6ffbc-2dae-4a4f-bc01-6feebba828e7 None None] MFA Rules not processed for user `57539b6a6f3b4d589f5f5e1d211cd6a0`. Rule list: `[]` (Enabled: `True`). {{(pid=82026) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 20:00:11.857869 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.common.fernet_utils [None req-6cb6ffbc-2dae-4a4f-bc01-6feebba828e7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82026) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 20:00:11.863949 dv-cinder-828806-6-smb devstack@keystone.service[82026]: [pid: 82026|app: 0|req: 767/1544] 10.222.0.33 () {58 vars in 958 bytes} [Tue Sep 13 20:00:11 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 20:00:11.865510 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8d5f391-8915-4a84-8c0a-0b11524aeef4 None None] REQUEST_METHOD: `POST` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:00:11.865801 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8d5f391-8915-4a84-8c0a-0b11524aeef4 None None] SCRIPT_NAME: `/identity` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:00:11.866081 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8d5f391-8915-4a84-8c0a-0b11524aeef4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:00:11.889641 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.auth.core [None req-c8d5f391-8915-4a84-8c0a-0b11524aeef4 None None] MFA Rules not processed for user `57539b6a6f3b4d589f5f5e1d211cd6a0`. Rule list: `[]` (Enabled: `True`). {{(pid=82026) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 20:00:11.892367 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.common.fernet_utils [None req-c8d5f391-8915-4a84-8c0a-0b11524aeef4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82026) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 20:00:11.899297 dv-cinder-828806-6-smb devstack@keystone.service[82026]: [pid: 82026|app: 0|req: 768/1545] 10.222.0.33 () {58 vars in 958 bytes} [Tue Sep 13 20:00:11 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 20:00:11.900477 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dad282b0-d650-4b01-af00-d9bfce7e2576 None None] REQUEST_METHOD: `POST` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:00:11.900766 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dad282b0-d650-4b01-af00-d9bfce7e2576 None None] SCRIPT_NAME: `/identity` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:00:11.901045 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dad282b0-d650-4b01-af00-d9bfce7e2576 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:00:11.913026 dv-cinder-828806-6-smb devstack@keystone.service[82025]: [pid: 82025|app: 0|req: 778/1546] 10.222.0.33 () {60 vars in 1153 bytes} [Tue Sep 13 20:00:11 2022] POST /identity/v3/projects => generated 377 bytes in 183 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 13 20:00:11.914189 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e172265-dd07-4a44-b5e6-6b55c1e1e9d2 None None] REQUEST_METHOD: `POST` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:00:11.914479 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e172265-dd07-4a44-b5e6-6b55c1e1e9d2 None None] SCRIPT_NAME: `/identity` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:00:11.914760 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e172265-dd07-4a44-b5e6-6b55c1e1e9d2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:00:11.925527 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.auth.core [None req-dad282b0-d650-4b01-af00-d9bfce7e2576 None None] MFA Rules not processed for user `57539b6a6f3b4d589f5f5e1d211cd6a0`. Rule list: `[]` (Enabled: `True`). {{(pid=82026) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 20:00:11.926756 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.common.fernet_utils [None req-dad282b0-d650-4b01-af00-d9bfce7e2576 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82026) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 20:00:11.935551 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.auth.core [None req-8e172265-dd07-4a44-b5e6-6b55c1e1e9d2 None None] MFA Rules not processed for user `57539b6a6f3b4d589f5f5e1d211cd6a0`. Rule list: `[]` (Enabled: `True`). {{(pid=82025) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 20:00:11.936930 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.fernet_utils [None req-8e172265-dd07-4a44-b5e6-6b55c1e1e9d2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82025) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 20:00:11.999622 dv-cinder-828806-6-smb devstack@keystone.service[82026]: [pid: 82026|app: 0|req: 769/1547] 10.222.0.33 () {58 vars in 958 bytes} [Tue Sep 13 20:00:11 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 20:00:12.000876 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc2763b1-1c2c-4d4a-8fbd-240edf40d6b2 None None] REQUEST_METHOD: `POST` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:00:12.001167 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc2763b1-1c2c-4d4a-8fbd-240edf40d6b2 None None] SCRIPT_NAME: `/identity` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:00:12.001444 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc2763b1-1c2c-4d4a-8fbd-240edf40d6b2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:00:12.011791 dv-cinder-828806-6-smb devstack@keystone.service[82025]: [pid: 82025|app: 0|req: 779/1548] 10.222.0.33 () {58 vars in 958 bytes} [Tue Sep 13 20:00:11 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 20:00:12.013030 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1577e7b-f500-4982-acbf-db0023f6be8c None None] REQUEST_METHOD: `POST` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:00:12.013314 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1577e7b-f500-4982-acbf-db0023f6be8c None None] SCRIPT_NAME: `/identity` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:00:12.013590 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1577e7b-f500-4982-acbf-db0023f6be8c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:00:12.027313 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.auth.core [None req-bc2763b1-1c2c-4d4a-8fbd-240edf40d6b2 None None] MFA Rules not processed for user `57539b6a6f3b4d589f5f5e1d211cd6a0`. Rule list: `[]` (Enabled: `True`). {{(pid=82026) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 20:00:12.028532 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.common.fernet_utils [None req-bc2763b1-1c2c-4d4a-8fbd-240edf40d6b2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82026) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 20:00:12.033125 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.auth.core [None req-a1577e7b-f500-4982-acbf-db0023f6be8c None None] MFA Rules not processed for user `57539b6a6f3b4d589f5f5e1d211cd6a0`. Rule list: `[]` (Enabled: `True`). {{(pid=82025) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 20:00:12.034280 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.fernet_utils [None req-a1577e7b-f500-4982-acbf-db0023f6be8c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82025) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 20:00:12.036412 dv-cinder-828806-6-smb devstack@keystone.service[82026]: [pid: 82026|app: 0|req: 770/1549] 10.222.0.33 () {58 vars in 958 bytes} [Tue Sep 13 20:00:11 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 20:00:12.038284 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-164ad78b-bfcc-43a0-b686-b3ad132e7ac0 None None] REQUEST_METHOD: `POST` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:00:12.038580 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-164ad78b-bfcc-43a0-b686-b3ad132e7ac0 None None] SCRIPT_NAME: `/identity` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:00:12.038863 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-164ad78b-bfcc-43a0-b686-b3ad132e7ac0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:00:12.048039 dv-cinder-828806-6-smb devstack@keystone.service[82025]: [pid: 82025|app: 0|req: 780/1550] 10.222.0.33 () {58 vars in 958 bytes} [Tue Sep 13 20:00:12 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 20:00:12.049240 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71a2765b-2c76-4583-8c96-a9951516d5a9 None None] REQUEST_METHOD: `POST` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:00:12.049528 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71a2765b-2c76-4583-8c96-a9951516d5a9 None None] SCRIPT_NAME: `/identity` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:00:12.049801 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71a2765b-2c76-4583-8c96-a9951516d5a9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:00:12.059195 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.auth.core [None req-164ad78b-bfcc-43a0-b686-b3ad132e7ac0 None None] MFA Rules not processed for user `57539b6a6f3b4d589f5f5e1d211cd6a0`. Rule list: `[]` (Enabled: `True`). {{(pid=82026) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 20:00:12.060406 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.common.fernet_utils [None req-164ad78b-bfcc-43a0-b686-b3ad132e7ac0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82026) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 20:00:12.068913 dv-cinder-828806-6-smb devstack@keystone.service[82026]: [pid: 82026|app: 0|req: 771/1551] 10.222.0.33 () {58 vars in 958 bytes} [Tue Sep 13 20:00:12 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 20:00:12.069723 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-164ad78b-bfcc-43a0-b686-b3ad132e7ac0 None None] Authenticating user token {{(pid=82026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 20:00:12.070893 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.auth.core [None req-71a2765b-2c76-4583-8c96-a9951516d5a9 None None] MFA Rules not processed for user `57539b6a6f3b4d589f5f5e1d211cd6a0`. Rule list: `[]` (Enabled: `True`). {{(pid=82025) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 20:00:12.072107 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.fernet_utils [None req-71a2765b-2c76-4583-8c96-a9951516d5a9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82025) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 20:00:12.080618 dv-cinder-828806-6-smb devstack@keystone.service[82025]: [pid: 82025|app: 0|req: 781/1552] 10.222.0.33 () {58 vars in 958 bytes} [Tue Sep 13 20:00:12 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 20:00:12.081248 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-164ad78b-bfcc-43a0-b686-b3ad132e7ac0 None None] Validating token access rules against request {{(pid=82026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 20:00:12.085349 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a2ac3d5-8526-49d2-9602-fd0c027af326 None None] REQUEST_METHOD: `POST` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:00:12.085642 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a2ac3d5-8526-49d2-9602-fd0c027af326 None None] SCRIPT_NAME: `/identity` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:00:12.085925 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a2ac3d5-8526-49d2-9602-fd0c027af326 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:00:12.086278 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cd02b02-f22d-47bd-9f9f-5916f985ec65 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57539b6a6f3b4d589f5f5e1d211cd6a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b454f707d20347ada3d82aa85495635e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 20:00:12.086882 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cd02b02-f22d-47bd-9f9f-5916f985ec65 admin admin] REQUEST_METHOD: `POST` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:00:12.087199 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cd02b02-f22d-47bd-9f9f-5916f985ec65 admin admin] SCRIPT_NAME: `/identity` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:00:12.087478 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cd02b02-f22d-47bd-9f9f-5916f985ec65 admin admin] PATH_INFO: `/v3/users` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:00:12.088121 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cd02b02-f22d-47bd-9f9f-5916f985ec65 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 20:00:12.090051 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cd02b02-f22d-47bd-9f9f-5916f985ec65 admin admin] RBAC: Authorization granted {{(pid=82026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 20:00:12.104827 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.auth.core [None req-4a2ac3d5-8526-49d2-9602-fd0c027af326 None None] MFA Rules not processed for user `57539b6a6f3b4d589f5f5e1d211cd6a0`. Rule list: `[]` (Enabled: `True`). {{(pid=82025) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 20:00:12.106024 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.fernet_utils [None req-4a2ac3d5-8526-49d2-9602-fd0c027af326 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82025) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 20:00:12.113935 dv-cinder-828806-6-smb devstack@keystone.service[82025]: [pid: 82025|app: 0|req: 782/1553] 10.222.0.33 () {58 vars in 958 bytes} [Tue Sep 13 20:00:12 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 20:00:12.115709 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36e9ef57-af1d-4c0d-adfe-d9e353f8a2a2 None None] REQUEST_METHOD: `POST` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:00:12.115991 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36e9ef57-af1d-4c0d-adfe-d9e353f8a2a2 None None] SCRIPT_NAME: `/identity` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:00:12.116270 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36e9ef57-af1d-4c0d-adfe-d9e353f8a2a2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:00:12.135827 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.auth.core [None req-36e9ef57-af1d-4c0d-adfe-d9e353f8a2a2 None None] MFA Rules not processed for user `57539b6a6f3b4d589f5f5e1d211cd6a0`. Rule list: `[]` (Enabled: `True`). {{(pid=82025) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 20:00:12.137047 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.fernet_utils [None req-36e9ef57-af1d-4c0d-adfe-d9e353f8a2a2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82025) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 20:00:12.144819 dv-cinder-828806-6-smb devstack@keystone.service[82025]: [pid: 82025|app: 0|req: 783/1554] 10.222.0.33 () {58 vars in 958 bytes} [Tue Sep 13 20:00:12 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 20:00:12.145574 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36e9ef57-af1d-4c0d-adfe-d9e353f8a2a2 None None] Authenticating user token {{(pid=82025) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 20:00:12.155061 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36e9ef57-af1d-4c0d-adfe-d9e353f8a2a2 None None] Validating token access rules against request {{(pid=82025) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 20:00:12.159710 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81217c62-e666-4ee9-9631-9a762fb8ac13 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57539b6a6f3b4d589f5f5e1d211cd6a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b454f707d20347ada3d82aa85495635e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82025) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 20:00:12.160319 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81217c62-e666-4ee9-9631-9a762fb8ac13 admin admin] REQUEST_METHOD: `GET` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:00:12.160726 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81217c62-e666-4ee9-9631-9a762fb8ac13 admin admin] SCRIPT_NAME: `/identity` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:00:12.161016 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81217c62-e666-4ee9-9631-9a762fb8ac13 admin admin] PATH_INFO: `/v3/domains` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:00:12.161702 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81217c62-e666-4ee9-9631-9a762fb8ac13 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82025) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 20:00:12.162008 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81217c62-e666-4ee9-9631-9a762fb8ac13 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 20:00:12.163265 dv-cinder-828806-6-smb devstack@keystone.service[82025]: WARNING py.warnings [None req-81217c62-e666-4ee9-9631-9a762fb8ac13 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_domains": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Sep 13 20:00:12.163265 dv-cinder-828806-6-smb devstack@keystone.service[82025]: warnings.warn(msg) Sep 13 20:00:12.163265 dv-cinder-828806-6-smb devstack@keystone.service[82025]: Sep 13 20:00:12.164143 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81217c62-e666-4ee9-9631-9a762fb8ac13 admin admin] RBAC: Authorization granted {{(pid=82025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 20:00:12.175824 dv-cinder-828806-6-smb devstack@keystone.service[82025]: [pid: 82025|app: 0|req: 784/1555] 10.222.0.33 () {58 vars in 1153 bytes} [Tue Sep 13 20:00:12 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 20:00:12.176957 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d743b9ea-a317-4f42-81b3-30a16a4233b2 None None] REQUEST_METHOD: `POST` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:00:12.177920 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d743b9ea-a317-4f42-81b3-30a16a4233b2 None None] SCRIPT_NAME: `/identity` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:00:12.178290 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d743b9ea-a317-4f42-81b3-30a16a4233b2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:00:12.192354 dv-cinder-828806-6-smb devstack@keystone.service[82026]: [pid: 82026|app: 0|req: 772/1556] 10.222.0.33 () {60 vars in 1144 bytes} [Tue Sep 13 20:00:12 2022] POST /identity/v3/users => generated 289 bytes in 120 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 13 20:00:12.192354 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cd02b02-f22d-47bd-9f9f-5916f985ec65 admin admin] Authenticating user token {{(pid=82026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 20:00:12.200046 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.auth.core [None req-d743b9ea-a317-4f42-81b3-30a16a4233b2 None None] MFA Rules not processed for user `57539b6a6f3b4d589f5f5e1d211cd6a0`. Rule list: `[]` (Enabled: `True`). {{(pid=82025) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 20:00:12.203094 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.fernet_utils [None req-d743b9ea-a317-4f42-81b3-30a16a4233b2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82025) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 20:00:12.203496 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cd02b02-f22d-47bd-9f9f-5916f985ec65 admin admin] Validating token access rules against request {{(pid=82026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 20:00:12.208160 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20f5e27b-6074-464c-820c-ba553519e7f8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57539b6a6f3b4d589f5f5e1d211cd6a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b454f707d20347ada3d82aa85495635e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 20:00:12.208981 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20f5e27b-6074-464c-820c-ba553519e7f8 admin admin] REQUEST_METHOD: `GET` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:00:12.209271 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20f5e27b-6074-464c-820c-ba553519e7f8 admin admin] SCRIPT_NAME: `/identity` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:00:12.209596 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20f5e27b-6074-464c-820c-ba553519e7f8 admin admin] PATH_INFO: `/v3/domains` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:00:12.209698 dv-cinder-828806-6-smb devstack@keystone.service[82025]: [pid: 82025|app: 0|req: 785/1557] 10.222.0.33 () {58 vars in 958 bytes} [Tue Sep 13 20:00:12 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 20:00:12.210253 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20f5e27b-6074-464c-820c-ba553519e7f8 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82026) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 20:00:12.210564 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20f5e27b-6074-464c-820c-ba553519e7f8 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 20:00:12.210797 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7030b79d-ae0e-4a1d-81b9-9c535bf08484 None None] REQUEST_METHOD: `POST` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:00:12.211125 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7030b79d-ae0e-4a1d-81b9-9c535bf08484 None None] SCRIPT_NAME: `/identity` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:00:12.211408 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7030b79d-ae0e-4a1d-81b9-9c535bf08484 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:00:12.212211 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20f5e27b-6074-464c-820c-ba553519e7f8 admin admin] RBAC: Authorization granted {{(pid=82026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 20:00:12.225239 dv-cinder-828806-6-smb devstack@keystone.service[82026]: [pid: 82026|app: 0|req: 773/1558] 10.222.0.33 () {58 vars in 1153 bytes} [Tue Sep 13 20:00:12 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 20:00:12.226077 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20f5e27b-6074-464c-820c-ba553519e7f8 admin admin] Authenticating user token {{(pid=82026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 20:00:12.231845 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.auth.core [None req-7030b79d-ae0e-4a1d-81b9-9c535bf08484 None None] MFA Rules not processed for user `57539b6a6f3b4d589f5f5e1d211cd6a0`. Rule list: `[]` (Enabled: `True`). {{(pid=82025) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 20:00:12.233729 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.fernet_utils [None req-7030b79d-ae0e-4a1d-81b9-9c535bf08484 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82025) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 20:00:12.235983 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20f5e27b-6074-464c-820c-ba553519e7f8 admin admin] Validating token access rules against request {{(pid=82026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 20:00:12.241368 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b29a2c9f-001f-4309-8c3b-8aef2a92bf5d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57539b6a6f3b4d589f5f5e1d211cd6a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b454f707d20347ada3d82aa85495635e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 20:00:12.241966 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b29a2c9f-001f-4309-8c3b-8aef2a92bf5d admin admin] REQUEST_METHOD: `GET` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:00:12.245902 dv-cinder-828806-6-smb devstack@keystone.service[82025]: [pid: 82025|app: 0|req: 786/1559] 10.222.0.33 () {58 vars in 958 bytes} [Tue Sep 13 20:00:12 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 20:00:12.246062 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b29a2c9f-001f-4309-8c3b-8aef2a92bf5d admin admin] SCRIPT_NAME: `/identity` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:00:12.246062 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b29a2c9f-001f-4309-8c3b-8aef2a92bf5d admin admin] PATH_INFO: `/v3/domains` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:00:12.246062 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b29a2c9f-001f-4309-8c3b-8aef2a92bf5d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82026) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 20:00:12.246062 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b29a2c9f-001f-4309-8c3b-8aef2a92bf5d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 20:00:12.246427 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb8d80eb-eb99-47b8-a368-db0bf389f117 None None] REQUEST_METHOD: `POST` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:00:12.246427 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb8d80eb-eb99-47b8-a368-db0bf389f117 None None] SCRIPT_NAME: `/identity` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:00:12.246427 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb8d80eb-eb99-47b8-a368-db0bf389f117 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:00:12.246655 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b29a2c9f-001f-4309-8c3b-8aef2a92bf5d admin admin] RBAC: Authorization granted {{(pid=82026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 20:00:12.259936 dv-cinder-828806-6-smb devstack@keystone.service[82026]: [pid: 82026|app: 0|req: 774/1560] 10.222.0.33 () {58 vars in 1153 bytes} [Tue Sep 13 20:00:12 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 20:00:12.259936 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b29a2c9f-001f-4309-8c3b-8aef2a92bf5d admin admin] Authenticating user token {{(pid=82026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 20:00:12.266241 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.auth.core [None req-bb8d80eb-eb99-47b8-a368-db0bf389f117 None None] MFA Rules not processed for user `57539b6a6f3b4d589f5f5e1d211cd6a0`. Rule list: `[]` (Enabled: `True`). {{(pid=82025) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 20:00:12.266241 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.fernet_utils [None req-bb8d80eb-eb99-47b8-a368-db0bf389f117 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82025) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 20:00:12.269463 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b29a2c9f-001f-4309-8c3b-8aef2a92bf5d admin admin] Validating token access rules against request {{(pid=82026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 20:00:12.274191 dv-cinder-828806-6-smb devstack@keystone.service[82025]: [pid: 82025|app: 0|req: 787/1561] 10.222.0.33 () {58 vars in 958 bytes} [Tue Sep 13 20:00:12 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 20:00:12.274545 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5850395d-e4ea-407a-8353-e48dc56b2b98 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57539b6a6f3b4d589f5f5e1d211cd6a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b454f707d20347ada3d82aa85495635e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 20:00:12.274994 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb8d80eb-eb99-47b8-a368-db0bf389f117 None None] Authenticating user token {{(pid=82025) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 20:00:12.275211 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5850395d-e4ea-407a-8353-e48dc56b2b98 admin admin] REQUEST_METHOD: `GET` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:00:12.275473 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5850395d-e4ea-407a-8353-e48dc56b2b98 admin admin] SCRIPT_NAME: `/identity` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:00:12.275749 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5850395d-e4ea-407a-8353-e48dc56b2b98 admin admin] PATH_INFO: `/v3/domains` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:00:12.276398 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5850395d-e4ea-407a-8353-e48dc56b2b98 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82026) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 20:00:12.276707 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5850395d-e4ea-407a-8353-e48dc56b2b98 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 20:00:12.278483 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5850395d-e4ea-407a-8353-e48dc56b2b98 admin admin] RBAC: Authorization granted {{(pid=82026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 20:00:12.286281 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb8d80eb-eb99-47b8-a368-db0bf389f117 None None] Validating token access rules against request {{(pid=82025) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 20:00:12.291966 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df890b0e-90a0-4b59-b26d-3b5d1e1c321e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57539b6a6f3b4d589f5f5e1d211cd6a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b454f707d20347ada3d82aa85495635e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82025) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 20:00:12.292603 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df890b0e-90a0-4b59-b26d-3b5d1e1c321e admin admin] REQUEST_METHOD: `POST` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:00:12.292867 dv-cinder-828806-6-smb devstack@keystone.service[82026]: [pid: 82026|app: 0|req: 775/1562] 10.222.0.33 () {58 vars in 1153 bytes} [Tue Sep 13 20:00:12 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 20:00:12.292983 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df890b0e-90a0-4b59-b26d-3b5d1e1c321e admin admin] SCRIPT_NAME: `/identity` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:00:12.293780 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5850395d-e4ea-407a-8353-e48dc56b2b98 admin admin] Authenticating user token {{(pid=82026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 20:00:12.299459 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df890b0e-90a0-4b59-b26d-3b5d1e1c321e admin admin] PATH_INFO: `/v3/projects` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:00:12.300134 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df890b0e-90a0-4b59-b26d-3b5d1e1c321e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 20:00:12.302667 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df890b0e-90a0-4b59-b26d-3b5d1e1c321e admin admin] RBAC: Authorization granted {{(pid=82025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 20:00:12.305172 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5850395d-e4ea-407a-8353-e48dc56b2b98 admin admin] Validating token access rules against request {{(pid=82026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 20:00:12.308945 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c5de9c8-cc87-4f56-ac23-582222fd652d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57539b6a6f3b4d589f5f5e1d211cd6a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b454f707d20347ada3d82aa85495635e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 20:00:12.309541 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c5de9c8-cc87-4f56-ac23-582222fd652d admin admin] REQUEST_METHOD: `GET` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:00:12.309830 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c5de9c8-cc87-4f56-ac23-582222fd652d admin admin] SCRIPT_NAME: `/identity` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:00:12.310113 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c5de9c8-cc87-4f56-ac23-582222fd652d admin admin] PATH_INFO: `/v3/roles` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:00:12.310761 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c5de9c8-cc87-4f56-ac23-582222fd652d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 20:00:12.312408 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c5de9c8-cc87-4f56-ac23-582222fd652d admin admin] RBAC: Authorization granted {{(pid=82026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 20:00:12.323461 dv-cinder-828806-6-smb devstack@keystone.service[82026]: [pid: 82026|app: 0|req: 776/1563] 10.222.0.33 () {58 vars in 1122 bytes} [Tue Sep 13 20:00:12 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 13 20:00:12.324534 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c5de9c8-cc87-4f56-ac23-582222fd652d admin admin] Authenticating user token {{(pid=82026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 20:00:12.333990 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c5de9c8-cc87-4f56-ac23-582222fd652d admin admin] Validating token access rules against request {{(pid=82026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 20:00:12.338490 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfc6841e-8a6e-4513-a868-c08c0f5aa710 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57539b6a6f3b4d589f5f5e1d211cd6a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b454f707d20347ada3d82aa85495635e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 20:00:12.339090 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfc6841e-8a6e-4513-a868-c08c0f5aa710 admin admin] REQUEST_METHOD: `GET` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:00:12.339412 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfc6841e-8a6e-4513-a868-c08c0f5aa710 admin admin] SCRIPT_NAME: `/identity` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:00:12.339692 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfc6841e-8a6e-4513-a868-c08c0f5aa710 admin admin] PATH_INFO: `/v3/domains` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:00:12.340329 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfc6841e-8a6e-4513-a868-c08c0f5aa710 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82026) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 20:00:12.340643 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfc6841e-8a6e-4513-a868-c08c0f5aa710 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 20:00:12.342215 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfc6841e-8a6e-4513-a868-c08c0f5aa710 admin admin] RBAC: Authorization granted {{(pid=82026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 20:00:12.353966 dv-cinder-828806-6-smb devstack@keystone.service[82026]: [pid: 82026|app: 0|req: 777/1564] 10.222.0.33 () {58 vars in 1153 bytes} [Tue Sep 13 20:00:12 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 20:00:12.354722 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfc6841e-8a6e-4513-a868-c08c0f5aa710 admin admin] Authenticating user token {{(pid=82026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 20:00:12.364062 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfc6841e-8a6e-4513-a868-c08c0f5aa710 admin admin] Validating token access rules against request {{(pid=82026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 20:00:12.369440 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b691aa0-9ca3-4298-b8a0-58c6048eb8a4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57539b6a6f3b4d589f5f5e1d211cd6a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b454f707d20347ada3d82aa85495635e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 20:00:12.370007 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b691aa0-9ca3-4298-b8a0-58c6048eb8a4 admin admin] REQUEST_METHOD: `POST` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:00:12.370297 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b691aa0-9ca3-4298-b8a0-58c6048eb8a4 admin admin] SCRIPT_NAME: `/identity` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:00:12.370579 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b691aa0-9ca3-4298-b8a0-58c6048eb8a4 admin admin] PATH_INFO: `/v3/projects` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:00:12.371241 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b691aa0-9ca3-4298-b8a0-58c6048eb8a4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 20:00:12.374950 dv-cinder-828806-6-smb devstack@keystone.service[82026]: WARNING py.warnings [None req-5b691aa0-9ca3-4298-b8a0-58c6048eb8a4 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Sep 13 20:00:12.374950 dv-cinder-828806-6-smb devstack@keystone.service[82026]: warnings.warn(msg) Sep 13 20:00:12.374950 dv-cinder-828806-6-smb devstack@keystone.service[82026]: Sep 13 20:00:12.374950 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b691aa0-9ca3-4298-b8a0-58c6048eb8a4 admin admin] RBAC: Authorization granted {{(pid=82026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 20:00:12.403215 dv-cinder-828806-6-smb devstack@keystone.service[82025]: [pid: 82025|app: 0|req: 788/1565] 10.222.0.33 () {60 vars in 1153 bytes} [Tue Sep 13 20:00:12 2022] POST /identity/v3/projects => generated 375 bytes in 128 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 13 20:00:12.404090 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df890b0e-90a0-4b59-b26d-3b5d1e1c321e admin admin] Authenticating user token {{(pid=82025) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 20:00:12.452296 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG dbcounter [-] [82025] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=82025) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 20:00:12.454737 dv-cinder-828806-6-smb devstack@keystone.service[82026]: [pid: 82026|app: 0|req: 778/1566] 10.222.0.33 () {60 vars in 1153 bytes} [Tue Sep 13 20:00:12 2022] POST /identity/v3/projects => generated 365 bytes in 100 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 13 20:00:12.458854 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b691aa0-9ca3-4298-b8a0-58c6048eb8a4 admin admin] Authenticating user token {{(pid=82026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 20:00:12.464737 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG dbcounter [-] [82026] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=82026) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 20:00:12.470394 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df890b0e-90a0-4b59-b26d-3b5d1e1c321e admin admin] Validating token access rules against request {{(pid=82025) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 20:00:12.521418 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b691aa0-9ca3-4298-b8a0-58c6048eb8a4 admin admin] Validating token access rules against request {{(pid=82026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 20:00:12.526327 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f645e9d-f869-4a9a-91c9-e8b4487c3acf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57539b6a6f3b4d589f5f5e1d211cd6a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b454f707d20347ada3d82aa85495635e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 20:00:12.526940 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f645e9d-f869-4a9a-91c9-e8b4487c3acf admin admin] REQUEST_METHOD: `POST` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:00:12.527261 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f645e9d-f869-4a9a-91c9-e8b4487c3acf admin admin] SCRIPT_NAME: `/identity` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:00:12.527544 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f645e9d-f869-4a9a-91c9-e8b4487c3acf admin admin] PATH_INFO: `/v3/projects` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:00:12.528188 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdc4a547-0bb1-4913-a86c-ee03554e11f0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57539b6a6f3b4d589f5f5e1d211cd6a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b454f707d20347ada3d82aa85495635e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82025) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 20:00:12.528317 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f645e9d-f869-4a9a-91c9-e8b4487c3acf admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 20:00:12.528805 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdc4a547-0bb1-4913-a86c-ee03554e11f0 admin admin] REQUEST_METHOD: `GET` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:00:12.529092 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdc4a547-0bb1-4913-a86c-ee03554e11f0 admin admin] SCRIPT_NAME: `/identity` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:00:12.529372 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdc4a547-0bb1-4913-a86c-ee03554e11f0 admin admin] PATH_INFO: `/v3/domains` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:00:12.530019 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdc4a547-0bb1-4913-a86c-ee03554e11f0 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82025) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 20:00:12.530164 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f645e9d-f869-4a9a-91c9-e8b4487c3acf admin admin] RBAC: Authorization granted {{(pid=82026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 20:00:12.530328 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdc4a547-0bb1-4913-a86c-ee03554e11f0 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 20:00:12.532203 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdc4a547-0bb1-4913-a86c-ee03554e11f0 admin admin] RBAC: Authorization granted {{(pid=82025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 20:00:12.545030 dv-cinder-828806-6-smb devstack@keystone.service[82025]: [pid: 82025|app: 0|req: 789/1567] 10.222.0.33 () {58 vars in 1153 bytes} [Tue Sep 13 20:00:12 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 20:00:12.550039 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdc4a547-0bb1-4913-a86c-ee03554e11f0 admin admin] Authenticating user token {{(pid=82025) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 20:00:12.556051 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdc4a547-0bb1-4913-a86c-ee03554e11f0 admin admin] Validating token access rules against request {{(pid=82025) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 20:00:12.560754 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09cdfa1a-868f-4068-bfce-22af8381da0e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57539b6a6f3b4d589f5f5e1d211cd6a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b454f707d20347ada3d82aa85495635e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82025) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 20:00:12.561349 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09cdfa1a-868f-4068-bfce-22af8381da0e admin admin] REQUEST_METHOD: `GET` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:00:12.561635 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09cdfa1a-868f-4068-bfce-22af8381da0e admin admin] SCRIPT_NAME: `/identity` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:00:12.561916 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09cdfa1a-868f-4068-bfce-22af8381da0e admin admin] PATH_INFO: `/v3/domains` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:00:12.562586 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09cdfa1a-868f-4068-bfce-22af8381da0e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82025) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 20:00:12.562896 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09cdfa1a-868f-4068-bfce-22af8381da0e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 20:00:12.564538 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09cdfa1a-868f-4068-bfce-22af8381da0e admin admin] RBAC: Authorization granted {{(pid=82025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 20:00:12.577774 dv-cinder-828806-6-smb devstack@keystone.service[82025]: [pid: 82025|app: 0|req: 790/1568] 10.222.0.33 () {58 vars in 1153 bytes} [Tue Sep 13 20:00:12 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 20:00:12.578726 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09cdfa1a-868f-4068-bfce-22af8381da0e admin admin] Authenticating user token {{(pid=82025) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 20:00:12.588553 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09cdfa1a-868f-4068-bfce-22af8381da0e admin admin] Validating token access rules against request {{(pid=82025) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 20:00:12.593254 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bee969c5-a43c-4c1a-a6f5-063b9fc4de12 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57539b6a6f3b4d589f5f5e1d211cd6a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b454f707d20347ada3d82aa85495635e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82025) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 20:00:12.597765 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bee969c5-a43c-4c1a-a6f5-063b9fc4de12 admin admin] REQUEST_METHOD: `POST` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:00:12.597765 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bee969c5-a43c-4c1a-a6f5-063b9fc4de12 admin admin] SCRIPT_NAME: `/identity` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:00:12.597765 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bee969c5-a43c-4c1a-a6f5-063b9fc4de12 admin admin] PATH_INFO: `/v3/projects` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:00:12.597765 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bee969c5-a43c-4c1a-a6f5-063b9fc4de12 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 20:00:12.597765 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bee969c5-a43c-4c1a-a6f5-063b9fc4de12 admin admin] RBAC: Authorization granted {{(pid=82025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 20:00:12.624534 dv-cinder-828806-6-smb devstack@keystone.service[82026]: [pid: 82026|app: 0|req: 779/1569] 10.222.0.33 () {60 vars in 1153 bytes} [Tue Sep 13 20:00:12 2022] POST /identity/v3/projects => generated 377 bytes in 166 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 13 20:00:12.625568 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f645e9d-f869-4a9a-91c9-e8b4487c3acf admin admin] Authenticating user token {{(pid=82026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 20:00:12.684664 dv-cinder-828806-6-smb devstack@keystone.service[82025]: [pid: 82025|app: 0|req: 791/1570] 10.222.0.33 () {60 vars in 1153 bytes} [Tue Sep 13 20:00:12 2022] POST /identity/v3/projects => generated 381 bytes in 106 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 13 20:00:12.685502 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bee969c5-a43c-4c1a-a6f5-063b9fc4de12 admin admin] Authenticating user token {{(pid=82025) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 20:00:12.693561 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f645e9d-f869-4a9a-91c9-e8b4487c3acf admin admin] Validating token access rules against request {{(pid=82026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 20:00:12.751680 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eceaf88a-65fa-403e-af04-ec68a973704b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57539b6a6f3b4d589f5f5e1d211cd6a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b454f707d20347ada3d82aa85495635e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 20:00:12.752300 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eceaf88a-65fa-403e-af04-ec68a973704b admin admin] REQUEST_METHOD: `GET` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:00:12.752584 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eceaf88a-65fa-403e-af04-ec68a973704b admin admin] SCRIPT_NAME: `/identity` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:00:12.752863 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eceaf88a-65fa-403e-af04-ec68a973704b admin admin] PATH_INFO: `/v3/roles` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:00:12.753030 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bee969c5-a43c-4c1a-a6f5-063b9fc4de12 admin admin] Validating token access rules against request {{(pid=82025) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 20:00:12.753524 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eceaf88a-65fa-403e-af04-ec68a973704b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 20:00:12.755380 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eceaf88a-65fa-403e-af04-ec68a973704b admin admin] RBAC: Authorization granted {{(pid=82026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 20:00:12.758442 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0865b319-ac85-498a-b2a9-f051483f3e14 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57539b6a6f3b4d589f5f5e1d211cd6a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b454f707d20347ada3d82aa85495635e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82025) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 20:00:12.759101 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0865b319-ac85-498a-b2a9-f051483f3e14 admin admin] REQUEST_METHOD: `POST` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:00:12.759393 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0865b319-ac85-498a-b2a9-f051483f3e14 admin admin] SCRIPT_NAME: `/identity` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:00:12.759671 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0865b319-ac85-498a-b2a9-f051483f3e14 admin admin] PATH_INFO: `/v3/projects` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:00:12.760318 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0865b319-ac85-498a-b2a9-f051483f3e14 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 20:00:12.762238 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0865b319-ac85-498a-b2a9-f051483f3e14 admin admin] RBAC: Authorization granted {{(pid=82025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 20:00:12.769837 dv-cinder-828806-6-smb devstack@keystone.service[82026]: [pid: 82026|app: 0|req: 780/1571] 10.222.0.33 () {58 vars in 1122 bytes} [Tue Sep 13 20:00:12 2022] GET /identity/v3/roles => generated 1420 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 13 20:00:12.770756 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eceaf88a-65fa-403e-af04-ec68a973704b admin admin] Authenticating user token {{(pid=82026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 20:00:12.781239 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eceaf88a-65fa-403e-af04-ec68a973704b admin admin] Validating token access rules against request {{(pid=82026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 20:00:12.785947 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42335c31-608f-495f-8b46-1ecd7cc629b6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57539b6a6f3b4d589f5f5e1d211cd6a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b454f707d20347ada3d82aa85495635e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 20:00:12.786556 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42335c31-608f-495f-8b46-1ecd7cc629b6 admin admin] REQUEST_METHOD: `POST` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:00:12.787668 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42335c31-608f-495f-8b46-1ecd7cc629b6 admin admin] SCRIPT_NAME: `/identity` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:00:12.788100 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42335c31-608f-495f-8b46-1ecd7cc629b6 admin admin] PATH_INFO: `/v3/users` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:00:12.788750 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42335c31-608f-495f-8b46-1ecd7cc629b6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 20:00:12.792530 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42335c31-608f-495f-8b46-1ecd7cc629b6 admin admin] RBAC: Authorization granted {{(pid=82026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 20:00:12.877032 dv-cinder-828806-6-smb devstack@keystone.service[82025]: [pid: 82025|app: 0|req: 792/1572] 10.222.0.33 () {60 vars in 1153 bytes} [Tue Sep 13 20:00:12 2022] POST /identity/v3/projects => generated 371 bytes in 192 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 13 20:00:12.877763 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0865b319-ac85-498a-b2a9-f051483f3e14 admin admin] Authenticating user token {{(pid=82025) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 20:00:12.911669 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG dbcounter [-] [82025] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=82025) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 20:00:12.941945 dv-cinder-828806-6-smb devstack@keystone.service[82026]: [pid: 82026|app: 0|req: 781/1573] 10.222.0.33 () {60 vars in 1144 bytes} [Tue Sep 13 20:00:12 2022] POST /identity/v3/users => generated 288 bytes in 169 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 13 20:00:12.941945 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42335c31-608f-495f-8b46-1ecd7cc629b6 admin admin] Authenticating user token {{(pid=82026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 20:00:12.942332 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0865b319-ac85-498a-b2a9-f051483f3e14 admin admin] Validating token access rules against request {{(pid=82025) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 20:00:12.945117 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5ccc4ba-c284-4ad1-abb1-815e0e67b41b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57539b6a6f3b4d589f5f5e1d211cd6a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b454f707d20347ada3d82aa85495635e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82025) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 20:00:12.945727 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5ccc4ba-c284-4ad1-abb1-815e0e67b41b admin admin] REQUEST_METHOD: `POST` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:00:12.946011 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5ccc4ba-c284-4ad1-abb1-815e0e67b41b admin admin] SCRIPT_NAME: `/identity` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:00:12.946283 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5ccc4ba-c284-4ad1-abb1-815e0e67b41b admin admin] PATH_INFO: `/v3/users` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:00:12.946920 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5ccc4ba-c284-4ad1-abb1-815e0e67b41b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 20:00:12.948052 dv-cinder-828806-6-smb devstack@keystone.service[82025]: WARNING py.warnings [None req-b5ccc4ba-c284-4ad1-abb1-815e0e67b41b admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Sep 13 20:00:12.948052 dv-cinder-828806-6-smb devstack@keystone.service[82025]: warnings.warn(msg) Sep 13 20:00:12.948052 dv-cinder-828806-6-smb devstack@keystone.service[82025]: Sep 13 20:00:12.949560 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5ccc4ba-c284-4ad1-abb1-815e0e67b41b admin admin] RBAC: Authorization granted {{(pid=82025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 20:00:12.950653 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42335c31-608f-495f-8b46-1ecd7cc629b6 admin admin] Validating token access rules against request {{(pid=82026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 20:00:12.955484 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4784c9cf-7a06-480c-b76e-b1995c0623ec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57539b6a6f3b4d589f5f5e1d211cd6a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b454f707d20347ada3d82aa85495635e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 20:00:12.956082 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4784c9cf-7a06-480c-b76e-b1995c0623ec admin admin] REQUEST_METHOD: `POST` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:00:12.956369 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4784c9cf-7a06-480c-b76e-b1995c0623ec admin admin] SCRIPT_NAME: `/identity` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:00:12.956645 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4784c9cf-7a06-480c-b76e-b1995c0623ec admin admin] PATH_INFO: `/v3/projects` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:00:12.957287 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4784c9cf-7a06-480c-b76e-b1995c0623ec admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 20:00:12.959859 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4784c9cf-7a06-480c-b76e-b1995c0623ec admin admin] RBAC: Authorization granted {{(pid=82026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 20:00:12.975494 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG dbcounter [-] [82026] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=82026) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 20:00:13.047364 dv-cinder-828806-6-smb devstack@keystone.service[82025]: [pid: 82025|app: 0|req: 793/1574] 10.222.0.33 () {60 vars in 1144 bytes} [Tue Sep 13 20:00:12 2022] POST /identity/v3/users => generated 283 bytes in 170 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 13 20:00:13.048166 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5ccc4ba-c284-4ad1-abb1-815e0e67b41b admin admin] Authenticating user token {{(pid=82025) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 20:00:13.058430 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5ccc4ba-c284-4ad1-abb1-815e0e67b41b admin admin] Validating token access rules against request {{(pid=82025) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 20:00:13.063470 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf2fb58b-1991-49dd-bc9b-bfcd4b194436 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57539b6a6f3b4d589f5f5e1d211cd6a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b454f707d20347ada3d82aa85495635e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82025) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 20:00:13.064062 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf2fb58b-1991-49dd-bc9b-bfcd4b194436 admin admin] REQUEST_METHOD: `POST` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:00:13.064340 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf2fb58b-1991-49dd-bc9b-bfcd4b194436 admin admin] SCRIPT_NAME: `/identity` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:00:13.064663 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf2fb58b-1991-49dd-bc9b-bfcd4b194436 admin admin] PATH_INFO: `/v3/projects` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:00:13.065246 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf2fb58b-1991-49dd-bc9b-bfcd4b194436 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 20:00:13.070586 dv-cinder-828806-6-smb devstack@keystone.service[82026]: [pid: 82026|app: 0|req: 782/1575] 10.222.0.33 () {60 vars in 1153 bytes} [Tue Sep 13 20:00:12 2022] POST /identity/v3/projects => generated 383 bytes in 127 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 13 20:00:13.070586 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4784c9cf-7a06-480c-b76e-b1995c0623ec admin admin] Authenticating user token {{(pid=82026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 20:00:13.070840 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf2fb58b-1991-49dd-bc9b-bfcd4b194436 admin admin] RBAC: Authorization granted {{(pid=82025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 20:00:13.130298 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4784c9cf-7a06-480c-b76e-b1995c0623ec admin admin] Validating token access rules against request {{(pid=82026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 20:00:13.135340 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-705fe8db-b97a-4db6-a45a-fe8c51ff3527 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57539b6a6f3b4d589f5f5e1d211cd6a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b454f707d20347ada3d82aa85495635e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 20:00:13.135949 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-705fe8db-b97a-4db6-a45a-fe8c51ff3527 admin admin] REQUEST_METHOD: `POST` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:00:13.136237 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-705fe8db-b97a-4db6-a45a-fe8c51ff3527 admin admin] SCRIPT_NAME: `/identity` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:00:13.136518 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-705fe8db-b97a-4db6-a45a-fe8c51ff3527 admin admin] PATH_INFO: `/v3/users` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:00:13.137155 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-705fe8db-b97a-4db6-a45a-fe8c51ff3527 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 20:00:13.139113 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-705fe8db-b97a-4db6-a45a-fe8c51ff3527 admin admin] RBAC: Authorization granted {{(pid=82026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 20:00:13.167689 dv-cinder-828806-6-smb devstack@keystone.service[82025]: [pid: 82025|app: 0|req: 794/1576] 10.222.0.33 () {60 vars in 1153 bytes} [Tue Sep 13 20:00:13 2022] POST /identity/v3/projects => generated 391 bytes in 120 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 13 20:00:13.168771 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf2fb58b-1991-49dd-bc9b-bfcd4b194436 admin admin] Authenticating user token {{(pid=82025) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 20:00:13.232618 dv-cinder-828806-6-smb devstack@keystone.service[82026]: [pid: 82026|app: 0|req: 783/1577] 10.222.0.33 () {60 vars in 1144 bytes} [Tue Sep 13 20:00:13 2022] POST /identity/v3/users => generated 289 bytes in 163 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 13 20:00:13.232618 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-705fe8db-b97a-4db6-a45a-fe8c51ff3527 admin admin] Authenticating user token {{(pid=82026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 20:00:13.232949 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf2fb58b-1991-49dd-bc9b-bfcd4b194436 admin admin] Validating token access rules against request {{(pid=82025) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 20:00:13.236738 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90727d29-b63f-4c48-8857-2794daf3e7e9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57539b6a6f3b4d589f5f5e1d211cd6a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b454f707d20347ada3d82aa85495635e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82025) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 20:00:13.237351 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90727d29-b63f-4c48-8857-2794daf3e7e9 admin admin] REQUEST_METHOD: `POST` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:00:13.237643 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90727d29-b63f-4c48-8857-2794daf3e7e9 admin admin] SCRIPT_NAME: `/identity` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:00:13.237919 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90727d29-b63f-4c48-8857-2794daf3e7e9 admin admin] PATH_INFO: `/v3/users` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:00:13.238549 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90727d29-b63f-4c48-8857-2794daf3e7e9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 20:00:13.241229 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90727d29-b63f-4c48-8857-2794daf3e7e9 admin admin] RBAC: Authorization granted {{(pid=82025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 20:00:13.241540 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-705fe8db-b97a-4db6-a45a-fe8c51ff3527 admin admin] Validating token access rules against request {{(pid=82026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 20:00:13.246116 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c80613d-a255-4533-ac31-0d8a3164258f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57539b6a6f3b4d589f5f5e1d211cd6a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b454f707d20347ada3d82aa85495635e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 20:00:13.246777 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c80613d-a255-4533-ac31-0d8a3164258f admin admin] REQUEST_METHOD: `PUT` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:00:13.247088 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c80613d-a255-4533-ac31-0d8a3164258f admin admin] SCRIPT_NAME: `/identity` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:00:13.247367 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c80613d-a255-4533-ac31-0d8a3164258f admin admin] PATH_INFO: `/v3/projects/db8c0b9ac40341f6b40fee93483420f7/users/abe7dd30d59f41b19efde48cc035aa4f/roles/3618ab638a65401f82333da7596d1daf` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:00:13.262332 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c80613d-a255-4533-ac31-0d8a3164258f admin admin] RBAC: Authorizing `identity:create_grant(project_id=db8c0b9ac40341f6b40fee93483420f7, user_id=abe7dd30d59f41b19efde48cc035aa4f, role_id=3618ab638a65401f82333da7596d1daf)` {{(pid=82026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 20:00:13.266255 dv-cinder-828806-6-smb devstack@keystone.service[82026]: WARNING py.warnings [None req-3c80613d-a255-4533-ac31-0d8a3164258f admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_grant": "(role:admin and system_scope:all) or ((role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.domain.id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.domain.id)s)) and (domain_id:%(target.role.domain_id)s or None:%(target.role.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Sep 13 20:00:13.266255 dv-cinder-828806-6-smb devstack@keystone.service[82026]: warnings.warn(msg) Sep 13 20:00:13.266255 dv-cinder-828806-6-smb devstack@keystone.service[82026]: Sep 13 20:00:13.266255 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c80613d-a255-4533-ac31-0d8a3164258f admin admin] RBAC: Authorization granted {{(pid=82026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 20:00:13.323091 dv-cinder-828806-6-smb devstack@keystone.service[82025]: [pid: 82025|app: 0|req: 795/1578] 10.222.0.33 () {60 vars in 1144 bytes} [Tue Sep 13 20:00:13 2022] POST /identity/v3/users => generated 291 bytes in 152 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 13 20:00:13.323091 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90727d29-b63f-4c48-8857-2794daf3e7e9 admin admin] Authenticating user token {{(pid=82025) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 20:00:13.331311 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90727d29-b63f-4c48-8857-2794daf3e7e9 admin admin] Validating token access rules against request {{(pid=82025) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 20:00:13.335992 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6d8f7a3-3bff-4a2a-b61e-c4e26afdbe61 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57539b6a6f3b4d589f5f5e1d211cd6a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b454f707d20347ada3d82aa85495635e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82025) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 20:00:13.336571 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6d8f7a3-3bff-4a2a-b61e-c4e26afdbe61 admin admin] REQUEST_METHOD: `POST` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:00:13.336858 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6d8f7a3-3bff-4a2a-b61e-c4e26afdbe61 admin admin] SCRIPT_NAME: `/identity` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:00:13.337142 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6d8f7a3-3bff-4a2a-b61e-c4e26afdbe61 admin admin] PATH_INFO: `/v3/users` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:00:13.337823 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6d8f7a3-3bff-4a2a-b61e-c4e26afdbe61 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 20:00:13.339762 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6d8f7a3-3bff-4a2a-b61e-c4e26afdbe61 admin admin] RBAC: Authorization granted {{(pid=82025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 20:00:13.348259 dv-cinder-828806-6-smb devstack@keystone.service[82026]: [pid: 82026|app: 0|req: 784/1579] 10.222.0.33 () {60 vars in 1483 bytes} [Tue Sep 13 20:00:13 2022] PUT /identity/v3/projects/db8c0b9ac40341f6b40fee93483420f7/users/abe7dd30d59f41b19efde48cc035aa4f/roles/3618ab638a65401f82333da7596d1daf => generated 0 bytes in 118 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 20:00:13.349788 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c80613d-a255-4533-ac31-0d8a3164258f admin admin] Authenticating user token {{(pid=82026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 20:00:13.410573 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c80613d-a255-4533-ac31-0d8a3164258f admin admin] Validating token access rules against request {{(pid=82026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 20:00:13.416037 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7d10098-4ac7-4454-8721-a21bca9b9930 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57539b6a6f3b4d589f5f5e1d211cd6a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b454f707d20347ada3d82aa85495635e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 20:00:13.416680 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7d10098-4ac7-4454-8721-a21bca9b9930 admin admin] REQUEST_METHOD: `GET` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:00:13.416970 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7d10098-4ac7-4454-8721-a21bca9b9930 admin admin] SCRIPT_NAME: `/identity` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:00:13.426668 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7d10098-4ac7-4454-8721-a21bca9b9930 admin admin] PATH_INFO: `/v3/roles` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:00:13.426668 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7d10098-4ac7-4454-8721-a21bca9b9930 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 20:00:13.426668 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7d10098-4ac7-4454-8721-a21bca9b9930 admin admin] RBAC: Authorization granted {{(pid=82026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 20:00:13.430216 dv-cinder-828806-6-smb devstack@keystone.service[82026]: [pid: 82026|app: 0|req: 785/1580] 10.222.0.33 () {58 vars in 1122 bytes} [Tue Sep 13 20:00:13 2022] GET /identity/v3/roles => generated 1420 bytes in 81 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 13 20:00:13.431001 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7d10098-4ac7-4454-8721-a21bca9b9930 admin admin] Authenticating user token {{(pid=82026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 20:00:13.440465 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7d10098-4ac7-4454-8721-a21bca9b9930 admin admin] Validating token access rules against request {{(pid=82026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 20:00:13.445371 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf26d26f-5a6c-4f19-b7f6-15c933177d51 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57539b6a6f3b4d589f5f5e1d211cd6a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b454f707d20347ada3d82aa85495635e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 20:00:13.445944 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf26d26f-5a6c-4f19-b7f6-15c933177d51 admin admin] REQUEST_METHOD: `GET` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:00:13.446230 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf26d26f-5a6c-4f19-b7f6-15c933177d51 admin admin] SCRIPT_NAME: `/identity` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:00:13.446508 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf26d26f-5a6c-4f19-b7f6-15c933177d51 admin admin] PATH_INFO: `/v3/roles` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:00:13.447165 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf26d26f-5a6c-4f19-b7f6-15c933177d51 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 20:00:13.448764 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf26d26f-5a6c-4f19-b7f6-15c933177d51 admin admin] RBAC: Authorization granted {{(pid=82026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 20:00:13.452166 dv-cinder-828806-6-smb devstack@keystone.service[82025]: [pid: 82025|app: 0|req: 796/1581] 10.222.0.33 () {60 vars in 1144 bytes} [Tue Sep 13 20:00:13 2022] POST /identity/v3/users => generated 286 bytes in 131 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 13 20:00:13.452967 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6d8f7a3-3bff-4a2a-b61e-c4e26afdbe61 admin admin] Authenticating user token {{(pid=82025) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 20:00:13.462087 dv-cinder-828806-6-smb devstack@keystone.service[82026]: [pid: 82026|app: 0|req: 786/1582] 10.222.0.33 () {58 vars in 1122 bytes} [Tue Sep 13 20:00:13 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 13 20:00:13.462087 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf26d26f-5a6c-4f19-b7f6-15c933177d51 admin admin] Authenticating user token {{(pid=82026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 20:00:13.465644 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6d8f7a3-3bff-4a2a-b61e-c4e26afdbe61 admin admin] Validating token access rules against request {{(pid=82025) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 20:00:13.469695 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf26d26f-5a6c-4f19-b7f6-15c933177d51 admin admin] Validating token access rules against request {{(pid=82026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 20:00:13.470873 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c7f5b4e-d61f-4724-9b0f-fca0d8a3ccd4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57539b6a6f3b4d589f5f5e1d211cd6a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b454f707d20347ada3d82aa85495635e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82025) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 20:00:13.471522 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c7f5b4e-d61f-4724-9b0f-fca0d8a3ccd4 admin admin] REQUEST_METHOD: `POST` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:00:13.471814 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c7f5b4e-d61f-4724-9b0f-fca0d8a3ccd4 admin admin] SCRIPT_NAME: `/identity` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:00:13.472095 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c7f5b4e-d61f-4724-9b0f-fca0d8a3ccd4 admin admin] PATH_INFO: `/v3/users` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:00:13.472736 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c7f5b4e-d61f-4724-9b0f-fca0d8a3ccd4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 20:00:13.475027 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a45f604-f7da-47c3-8188-c0072de4af47 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57539b6a6f3b4d589f5f5e1d211cd6a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b454f707d20347ada3d82aa85495635e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 20:00:13.475597 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c7f5b4e-d61f-4724-9b0f-fca0d8a3ccd4 admin admin] RBAC: Authorization granted {{(pid=82025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 20:00:13.475710 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a45f604-f7da-47c3-8188-c0072de4af47 admin admin] REQUEST_METHOD: `POST` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:00:13.475904 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a45f604-f7da-47c3-8188-c0072de4af47 admin admin] SCRIPT_NAME: `/identity` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:00:13.476179 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a45f604-f7da-47c3-8188-c0072de4af47 admin admin] PATH_INFO: `/v3/users` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:00:13.476810 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a45f604-f7da-47c3-8188-c0072de4af47 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 20:00:13.478731 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a45f604-f7da-47c3-8188-c0072de4af47 admin admin] RBAC: Authorization granted {{(pid=82026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 20:00:13.554905 dv-cinder-828806-6-smb devstack@keystone.service[82025]: [pid: 82025|app: 0|req: 797/1583] 10.222.0.33 () {60 vars in 1144 bytes} [Tue Sep 13 20:00:13 2022] POST /identity/v3/users => generated 292 bytes in 102 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 13 20:00:13.555753 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c7f5b4e-d61f-4724-9b0f-fca0d8a3ccd4 admin admin] Authenticating user token {{(pid=82025) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 20:00:13.565116 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c7f5b4e-d61f-4724-9b0f-fca0d8a3ccd4 admin admin] Validating token access rules against request {{(pid=82025) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 20:00:13.570056 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-584759eb-cc31-4c27-a03b-4ceae6a66a0d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57539b6a6f3b4d589f5f5e1d211cd6a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b454f707d20347ada3d82aa85495635e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82025) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 20:00:13.570698 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-584759eb-cc31-4c27-a03b-4ceae6a66a0d admin admin] REQUEST_METHOD: `GET` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:00:13.570982 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-584759eb-cc31-4c27-a03b-4ceae6a66a0d admin admin] SCRIPT_NAME: `/identity` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:00:13.571364 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-584759eb-cc31-4c27-a03b-4ceae6a66a0d admin admin] PATH_INFO: `/v3/roles` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:00:13.572042 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-584759eb-cc31-4c27-a03b-4ceae6a66a0d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 20:00:13.573652 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-584759eb-cc31-4c27-a03b-4ceae6a66a0d admin admin] RBAC: Authorization granted {{(pid=82025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 20:00:13.580354 dv-cinder-828806-6-smb devstack@keystone.service[82026]: [pid: 82026|app: 0|req: 787/1584] 10.222.0.33 () {60 vars in 1144 bytes} [Tue Sep 13 20:00:13 2022] POST /identity/v3/users => generated 296 bytes in 119 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 13 20:00:13.580354 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a45f604-f7da-47c3-8188-c0072de4af47 admin admin] Authenticating user token {{(pid=82026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 20:00:13.585437 dv-cinder-828806-6-smb devstack@keystone.service[82025]: [pid: 82025|app: 0|req: 798/1585] 10.222.0.33 () {58 vars in 1122 bytes} [Tue Sep 13 20:00:13 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 13 20:00:13.588544 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fbd452f-2ca8-471d-8334-e6a5ba1b9640 None None] REQUEST_METHOD: `POST` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:00:13.588544 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fbd452f-2ca8-471d-8334-e6a5ba1b9640 None None] SCRIPT_NAME: `/identity` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:00:13.588544 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fbd452f-2ca8-471d-8334-e6a5ba1b9640 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:00:13.593459 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a45f604-f7da-47c3-8188-c0072de4af47 admin admin] Validating token access rules against request {{(pid=82026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 20:00:13.598199 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-913ae83b-bee6-40ab-8fcc-8f0f8f550f25 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57539b6a6f3b4d589f5f5e1d211cd6a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b454f707d20347ada3d82aa85495635e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 20:00:13.598803 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-913ae83b-bee6-40ab-8fcc-8f0f8f550f25 admin admin] REQUEST_METHOD: `GET` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:00:13.599222 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-913ae83b-bee6-40ab-8fcc-8f0f8f550f25 admin admin] SCRIPT_NAME: `/identity` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:00:13.600179 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-913ae83b-bee6-40ab-8fcc-8f0f8f550f25 admin admin] PATH_INFO: `/v3/roles` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:00:13.600976 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-913ae83b-bee6-40ab-8fcc-8f0f8f550f25 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 20:00:13.602582 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-913ae83b-bee6-40ab-8fcc-8f0f8f550f25 admin admin] RBAC: Authorization granted {{(pid=82026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 20:00:13.606664 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.auth.core [None req-7fbd452f-2ca8-471d-8334-e6a5ba1b9640 None None] MFA Rules not processed for user `57539b6a6f3b4d589f5f5e1d211cd6a0`. Rule list: `[]` (Enabled: `True`). {{(pid=82025) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 20:00:13.607910 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.fernet_utils [None req-7fbd452f-2ca8-471d-8334-e6a5ba1b9640 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82025) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 20:00:13.613325 dv-cinder-828806-6-smb devstack@keystone.service[82026]: [pid: 82026|app: 0|req: 788/1586] 10.222.0.33 () {58 vars in 1122 bytes} [Tue Sep 13 20:00:13 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 13 20:00:13.614252 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-913ae83b-bee6-40ab-8fcc-8f0f8f550f25 admin admin] Authenticating user token {{(pid=82026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 20:00:13.619124 dv-cinder-828806-6-smb devstack@keystone.service[82025]: [pid: 82025|app: 0|req: 799/1587] 10.222.0.33 () {58 vars in 958 bytes} [Tue Sep 13 20:00:13 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 20:00:13.619124 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fbd452f-2ca8-471d-8334-e6a5ba1b9640 None None] Authenticating user token {{(pid=82025) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 20:00:13.625699 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-913ae83b-bee6-40ab-8fcc-8f0f8f550f25 admin admin] Validating token access rules against request {{(pid=82026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 20:00:13.627081 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fbd452f-2ca8-471d-8334-e6a5ba1b9640 None None] Validating token access rules against request {{(pid=82025) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 20:00:13.630832 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4be0e120-e682-4cbf-a494-3de9e1ed4dc0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57539b6a6f3b4d589f5f5e1d211cd6a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b454f707d20347ada3d82aa85495635e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 20:00:13.631470 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4be0e120-e682-4cbf-a494-3de9e1ed4dc0 admin admin] REQUEST_METHOD: `GET` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:00:13.631761 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4be0e120-e682-4cbf-a494-3de9e1ed4dc0 admin admin] SCRIPT_NAME: `/identity` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:00:13.632044 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4be0e120-e682-4cbf-a494-3de9e1ed4dc0 admin admin] PATH_INFO: `/v3/roles` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:00:13.632165 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f46ffb9-d18b-49e8-9946-fcd7951b5ab2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57539b6a6f3b4d589f5f5e1d211cd6a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b454f707d20347ada3d82aa85495635e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82025) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 20:00:13.632669 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f46ffb9-d18b-49e8-9946-fcd7951b5ab2 admin admin] REQUEST_METHOD: `GET` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:00:13.632775 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4be0e120-e682-4cbf-a494-3de9e1ed4dc0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 20:00:13.632953 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f46ffb9-d18b-49e8-9946-fcd7951b5ab2 admin admin] SCRIPT_NAME: `/identity` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:00:13.633228 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f46ffb9-d18b-49e8-9946-fcd7951b5ab2 admin admin] PATH_INFO: `/v3/roles` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:00:13.633874 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f46ffb9-d18b-49e8-9946-fcd7951b5ab2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 20:00:13.634285 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4be0e120-e682-4cbf-a494-3de9e1ed4dc0 admin admin] RBAC: Authorization granted {{(pid=82026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 20:00:13.635682 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f46ffb9-d18b-49e8-9946-fcd7951b5ab2 admin admin] RBAC: Authorization granted {{(pid=82025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 20:00:13.644422 dv-cinder-828806-6-smb devstack@keystone.service[82026]: [pid: 82026|app: 0|req: 789/1588] 10.222.0.33 () {58 vars in 1122 bytes} [Tue Sep 13 20:00:13 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 13 20:00:13.645290 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4be0e120-e682-4cbf-a494-3de9e1ed4dc0 admin admin] Authenticating user token {{(pid=82026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 20:00:13.645504 dv-cinder-828806-6-smb devstack@keystone.service[82025]: [pid: 82025|app: 0|req: 800/1589] 10.222.0.33 () {58 vars in 1122 bytes} [Tue Sep 13 20:00:13 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 13 20:00:13.647015 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f46ffb9-d18b-49e8-9946-fcd7951b5ab2 admin admin] Authenticating user token {{(pid=82025) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 20:00:13.655509 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG dbcounter [-] [82026] Writing DB stats keystone:INSERT=8,keystone:SELECT=92 {{(pid=82026) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 20:00:13.656763 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f46ffb9-d18b-49e8-9946-fcd7951b5ab2 admin admin] Validating token access rules against request {{(pid=82025) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 20:00:13.659992 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4be0e120-e682-4cbf-a494-3de9e1ed4dc0 admin admin] Validating token access rules against request {{(pid=82026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 20:00:13.662476 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e722861f-b2bc-4ef6-ba5e-1b9325b0fce1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57539b6a6f3b4d589f5f5e1d211cd6a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b454f707d20347ada3d82aa85495635e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82025) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 20:00:13.663227 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e722861f-b2bc-4ef6-ba5e-1b9325b0fce1 admin admin] REQUEST_METHOD: `GET` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:00:13.667355 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e722861f-b2bc-4ef6-ba5e-1b9325b0fce1 admin admin] SCRIPT_NAME: `/identity` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:00:13.667355 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e722861f-b2bc-4ef6-ba5e-1b9325b0fce1 admin admin] PATH_INFO: `/v3/roles` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:00:13.667355 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e722861f-b2bc-4ef6-ba5e-1b9325b0fce1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 20:00:13.667636 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7203cdd-e193-4429-8778-c2d1c5041195 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57539b6a6f3b4d589f5f5e1d211cd6a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b454f707d20347ada3d82aa85495635e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 20:00:13.667636 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7203cdd-e193-4429-8778-c2d1c5041195 admin admin] REQUEST_METHOD: `GET` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:00:13.667928 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e722861f-b2bc-4ef6-ba5e-1b9325b0fce1 admin admin] RBAC: Authorization granted {{(pid=82025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 20:00:13.668018 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7203cdd-e193-4429-8778-c2d1c5041195 admin admin] SCRIPT_NAME: `/identity` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:00:13.668018 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7203cdd-e193-4429-8778-c2d1c5041195 admin admin] PATH_INFO: `/v3/roles` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:00:13.668018 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7203cdd-e193-4429-8778-c2d1c5041195 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 20:00:13.668846 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7203cdd-e193-4429-8778-c2d1c5041195 admin admin] RBAC: Authorization granted {{(pid=82026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 20:00:13.679366 dv-cinder-828806-6-smb devstack@keystone.service[82025]: [pid: 82025|app: 0|req: 801/1590] 10.222.0.33 () {58 vars in 1122 bytes} [Tue Sep 13 20:00:13 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 13 20:00:13.679366 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e722861f-b2bc-4ef6-ba5e-1b9325b0fce1 admin admin] Authenticating user token {{(pid=82025) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 20:00:13.679633 dv-cinder-828806-6-smb devstack@keystone.service[82026]: [pid: 82026|app: 0|req: 790/1591] 10.222.0.33 () {58 vars in 1122 bytes} [Tue Sep 13 20:00:13 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 13 20:00:13.680259 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7203cdd-e193-4429-8778-c2d1c5041195 admin admin] Authenticating user token {{(pid=82026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 20:00:13.690184 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e722861f-b2bc-4ef6-ba5e-1b9325b0fce1 admin admin] Validating token access rules against request {{(pid=82025) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 20:00:13.691130 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7203cdd-e193-4429-8778-c2d1c5041195 admin admin] Validating token access rules against request {{(pid=82026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 20:00:13.695045 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aee16801-af19-48ec-8a19-17ab10e488af admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57539b6a6f3b4d589f5f5e1d211cd6a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b454f707d20347ada3d82aa85495635e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82025) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 20:00:13.696073 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aee16801-af19-48ec-8a19-17ab10e488af admin admin] REQUEST_METHOD: `GET` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:00:13.696073 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aee16801-af19-48ec-8a19-17ab10e488af admin admin] SCRIPT_NAME: `/identity` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:00:13.696274 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f9b49f9-98c9-4e15-a815-d96a9a936e8f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57539b6a6f3b4d589f5f5e1d211cd6a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b454f707d20347ada3d82aa85495635e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 20:00:13.696386 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aee16801-af19-48ec-8a19-17ab10e488af admin admin] PATH_INFO: `/v3/roles` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:00:13.696711 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f9b49f9-98c9-4e15-a815-d96a9a936e8f admin admin] REQUEST_METHOD: `GET` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:00:13.696826 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aee16801-af19-48ec-8a19-17ab10e488af admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 20:00:13.697027 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f9b49f9-98c9-4e15-a815-d96a9a936e8f admin admin] SCRIPT_NAME: `/identity` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:00:13.697309 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f9b49f9-98c9-4e15-a815-d96a9a936e8f admin admin] PATH_INFO: `/v3/roles` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:00:13.697955 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f9b49f9-98c9-4e15-a815-d96a9a936e8f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 20:00:13.698419 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aee16801-af19-48ec-8a19-17ab10e488af admin admin] RBAC: Authorization granted {{(pid=82025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 20:00:13.699882 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f9b49f9-98c9-4e15-a815-d96a9a936e8f admin admin] RBAC: Authorization granted {{(pid=82026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 20:00:13.710056 dv-cinder-828806-6-smb devstack@keystone.service[82025]: [pid: 82025|app: 0|req: 802/1592] 10.222.0.33 () {58 vars in 1122 bytes} [Tue Sep 13 20:00:13 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 13 20:00:13.714114 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aee16801-af19-48ec-8a19-17ab10e488af admin admin] Authenticating user token {{(pid=82025) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 20:00:13.714894 dv-cinder-828806-6-smb devstack@keystone.service[82026]: [pid: 82026|app: 0|req: 791/1593] 10.222.0.33 () {58 vars in 1122 bytes} [Tue Sep 13 20:00:13 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 13 20:00:13.714894 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f9b49f9-98c9-4e15-a815-d96a9a936e8f admin admin] Authenticating user token {{(pid=82026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 20:00:13.722158 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG dbcounter [-] [82025] Writing DB stats keystone:SELECT=87,keystone:INSERT=13 {{(pid=82025) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 20:00:13.726437 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aee16801-af19-48ec-8a19-17ab10e488af admin admin] Validating token access rules against request {{(pid=82025) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 20:00:13.731167 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb63b5e5-f8f8-4594-a46c-5299760ceff8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57539b6a6f3b4d589f5f5e1d211cd6a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b454f707d20347ada3d82aa85495635e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82025) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 20:00:13.731800 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb63b5e5-f8f8-4594-a46c-5299760ceff8 admin admin] REQUEST_METHOD: `GET` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:00:13.732087 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb63b5e5-f8f8-4594-a46c-5299760ceff8 admin admin] SCRIPT_NAME: `/identity` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:00:13.732368 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb63b5e5-f8f8-4594-a46c-5299760ceff8 admin admin] PATH_INFO: `/v3/roles` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:00:13.733017 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb63b5e5-f8f8-4594-a46c-5299760ceff8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 20:00:13.734614 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb63b5e5-f8f8-4594-a46c-5299760ceff8 admin admin] RBAC: Authorization granted {{(pid=82025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 20:00:13.744937 dv-cinder-828806-6-smb devstack@keystone.service[82025]: [pid: 82025|app: 0|req: 803/1594] 10.222.0.33 () {58 vars in 1122 bytes} [Tue Sep 13 20:00:13 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 13 20:00:13.748682 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb63b5e5-f8f8-4594-a46c-5299760ceff8 admin admin] Authenticating user token {{(pid=82025) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 20:00:13.759458 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb63b5e5-f8f8-4594-a46c-5299760ceff8 admin admin] Validating token access rules against request {{(pid=82025) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 20:00:13.764129 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88d8cee5-6c98-4afa-ba9f-653eb48eb2b2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57539b6a6f3b4d589f5f5e1d211cd6a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b454f707d20347ada3d82aa85495635e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82025) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 20:00:13.764972 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88d8cee5-6c98-4afa-ba9f-653eb48eb2b2 admin admin] REQUEST_METHOD: `PUT` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:00:13.765104 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88d8cee5-6c98-4afa-ba9f-653eb48eb2b2 admin admin] SCRIPT_NAME: `/identity` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:00:13.765388 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88d8cee5-6c98-4afa-ba9f-653eb48eb2b2 admin admin] PATH_INFO: `/v3/projects/bdc3c419ef344fefb2f15b54b9840c2f/users/cd153e7dc6924885a4e48810e8a05c67/roles/3618ab638a65401f82333da7596d1daf` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:00:13.768045 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f9b49f9-98c9-4e15-a815-d96a9a936e8f admin admin] Validating token access rules against request {{(pid=82026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 20:00:13.772379 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73dcbb87-a2c7-43c6-9c81-6a1ba05f0304 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '023a2c79c2444611b3d431928e56685d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8c6fba0f15b4d6a84ff601919b7b8e4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 20:00:13.772990 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73dcbb87-a2c7-43c6-9c81-6a1ba05f0304 service neutron] REQUEST_METHOD: `GET` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:00:13.773280 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73dcbb87-a2c7-43c6-9c81-6a1ba05f0304 service neutron] SCRIPT_NAME: `/identity` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:00:13.773563 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73dcbb87-a2c7-43c6-9c81-6a1ba05f0304 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:00:13.781201 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88d8cee5-6c98-4afa-ba9f-653eb48eb2b2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=bdc3c419ef344fefb2f15b54b9840c2f, user_id=cd153e7dc6924885a4e48810e8a05c67, role_id=3618ab638a65401f82333da7596d1daf)` {{(pid=82025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 20:00:13.783053 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73dcbb87-a2c7-43c6-9c81-6a1ba05f0304 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 20:00:13.784148 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88d8cee5-6c98-4afa-ba9f-653eb48eb2b2 admin admin] RBAC: Authorization granted {{(pid=82025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 20:00:13.784506 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73dcbb87-a2c7-43c6-9c81-6a1ba05f0304 service neutron] RBAC: Authorization granted {{(pid=82026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 20:00:13.795206 dv-cinder-828806-6-smb devstack@keystone.service[82026]: [pid: 82026|app: 0|req: 792/1595] 10.222.0.33 () {60 vars in 1365 bytes} [Tue Sep 13 20:00:13 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 20:00:13.799410 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73dcbb87-a2c7-43c6-9c81-6a1ba05f0304 service neutron] Authenticating user token {{(pid=82026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 20:00:13.805416 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73dcbb87-a2c7-43c6-9c81-6a1ba05f0304 service neutron] Validating token access rules against request {{(pid=82026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 20:00:13.810167 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffc8a370-cc27-4579-aa90-31786877fa59 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57539b6a6f3b4d589f5f5e1d211cd6a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b454f707d20347ada3d82aa85495635e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 20:00:13.810763 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffc8a370-cc27-4579-aa90-31786877fa59 admin admin] REQUEST_METHOD: `GET` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:00:13.811077 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffc8a370-cc27-4579-aa90-31786877fa59 admin admin] SCRIPT_NAME: `/identity` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:00:13.811369 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffc8a370-cc27-4579-aa90-31786877fa59 admin admin] PATH_INFO: `/v3/roles` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:00:13.812011 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffc8a370-cc27-4579-aa90-31786877fa59 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 20:00:13.813608 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffc8a370-cc27-4579-aa90-31786877fa59 admin admin] RBAC: Authorization granted {{(pid=82026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 20:00:13.824023 dv-cinder-828806-6-smb devstack@keystone.service[82026]: [pid: 82026|app: 0|req: 793/1596] 10.222.0.33 () {58 vars in 1122 bytes} [Tue Sep 13 20:00:13 2022] GET /identity/v3/roles => generated 1420 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 13 20:00:13.825129 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffc8a370-cc27-4579-aa90-31786877fa59 admin admin] Authenticating user token {{(pid=82026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 20:00:13.835615 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffc8a370-cc27-4579-aa90-31786877fa59 admin admin] Validating token access rules against request {{(pid=82026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 20:00:13.840202 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b77f7ff9-39fa-4c5a-9501-bfcd89233208 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57539b6a6f3b4d589f5f5e1d211cd6a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b454f707d20347ada3d82aa85495635e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 20:00:13.840766 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b77f7ff9-39fa-4c5a-9501-bfcd89233208 admin admin] REQUEST_METHOD: `GET` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:00:13.841053 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b77f7ff9-39fa-4c5a-9501-bfcd89233208 admin admin] SCRIPT_NAME: `/identity` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:00:13.841337 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b77f7ff9-39fa-4c5a-9501-bfcd89233208 admin admin] PATH_INFO: `/v3/roles` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:00:13.841958 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b77f7ff9-39fa-4c5a-9501-bfcd89233208 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 20:00:13.843559 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b77f7ff9-39fa-4c5a-9501-bfcd89233208 admin admin] RBAC: Authorization granted {{(pid=82026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 20:00:13.853926 dv-cinder-828806-6-smb devstack@keystone.service[82026]: [pid: 82026|app: 0|req: 794/1597] 10.222.0.33 () {58 vars in 1122 bytes} [Tue Sep 13 20:00:13 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 13 20:00:13.854691 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b77f7ff9-39fa-4c5a-9501-bfcd89233208 admin admin] Authenticating user token {{(pid=82026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 20:00:13.864033 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b77f7ff9-39fa-4c5a-9501-bfcd89233208 admin admin] Validating token access rules against request {{(pid=82026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 20:00:13.868834 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdf34551-25fd-4607-a7ea-a2122e988fb6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57539b6a6f3b4d589f5f5e1d211cd6a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b454f707d20347ada3d82aa85495635e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 20:00:13.869452 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdf34551-25fd-4607-a7ea-a2122e988fb6 admin admin] REQUEST_METHOD: `PUT` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:00:13.869740 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdf34551-25fd-4607-a7ea-a2122e988fb6 admin admin] SCRIPT_NAME: `/identity` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:00:13.870023 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdf34551-25fd-4607-a7ea-a2122e988fb6 admin admin] PATH_INFO: `/v3/projects/8e56a153f70a4c40811313d2b6c82fc8/users/0c3866a717f046d190f1a919bf12c07b/roles/3618ab638a65401f82333da7596d1daf` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:00:13.885086 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdf34551-25fd-4607-a7ea-a2122e988fb6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8e56a153f70a4c40811313d2b6c82fc8, user_id=0c3866a717f046d190f1a919bf12c07b, role_id=3618ab638a65401f82333da7596d1daf)` {{(pid=82026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 20:00:13.888328 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdf34551-25fd-4607-a7ea-a2122e988fb6 admin admin] RBAC: Authorization granted {{(pid=82026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 20:00:13.892133 dv-cinder-828806-6-smb devstack@keystone.service[82025]: [pid: 82025|app: 0|req: 804/1598] 10.222.0.33 () {60 vars in 1483 bytes} [Tue Sep 13 20:00:13 2022] PUT /identity/v3/projects/bdc3c419ef344fefb2f15b54b9840c2f/users/cd153e7dc6924885a4e48810e8a05c67/roles/3618ab638a65401f82333da7596d1daf => generated 0 bytes in 145 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 20:00:13.893112 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88d8cee5-6c98-4afa-ba9f-653eb48eb2b2 admin admin] Authenticating user token {{(pid=82025) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 20:00:13.957886 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88d8cee5-6c98-4afa-ba9f-653eb48eb2b2 admin admin] Validating token access rules against request {{(pid=82025) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 20:00:13.963249 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4f2f0aa-86df-4019-86e7-5b46fbacadd0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57539b6a6f3b4d589f5f5e1d211cd6a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b454f707d20347ada3d82aa85495635e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82025) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 20:00:13.963858 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4f2f0aa-86df-4019-86e7-5b46fbacadd0 admin admin] REQUEST_METHOD: `GET` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:00:13.964141 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4f2f0aa-86df-4019-86e7-5b46fbacadd0 admin admin] SCRIPT_NAME: `/identity` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:00:13.964414 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4f2f0aa-86df-4019-86e7-5b46fbacadd0 admin admin] PATH_INFO: `/v3/roles` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:00:13.965126 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4f2f0aa-86df-4019-86e7-5b46fbacadd0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 20:00:13.966760 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4f2f0aa-86df-4019-86e7-5b46fbacadd0 admin admin] RBAC: Authorization granted {{(pid=82025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 20:00:13.977712 dv-cinder-828806-6-smb devstack@keystone.service[82025]: [pid: 82025|app: 0|req: 805/1599] 10.222.0.33 () {58 vars in 1122 bytes} [Tue Sep 13 20:00:13 2022] GET /identity/v3/roles => generated 1420 bytes in 85 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 13 20:00:13.978519 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4f2f0aa-86df-4019-86e7-5b46fbacadd0 admin admin] Authenticating user token {{(pid=82025) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 20:00:13.988210 dv-cinder-828806-6-smb devstack@keystone.service[82026]: [pid: 82026|app: 0|req: 795/1600] 10.222.0.33 () {60 vars in 1483 bytes} [Tue Sep 13 20:00:13 2022] PUT /identity/v3/projects/8e56a153f70a4c40811313d2b6c82fc8/users/0c3866a717f046d190f1a919bf12c07b/roles/3618ab638a65401f82333da7596d1daf => generated 0 bytes in 125 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 20:00:13.988210 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdf34551-25fd-4607-a7ea-a2122e988fb6 admin admin] Authenticating user token {{(pid=82026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 20:00:14.000319 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4f2f0aa-86df-4019-86e7-5b46fbacadd0 admin admin] Validating token access rules against request {{(pid=82025) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 20:00:14.058361 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdf34551-25fd-4607-a7ea-a2122e988fb6 admin admin] Validating token access rules against request {{(pid=82026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 20:00:14.064680 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cb9500f-1f45-43e9-aa56-b401ead28aef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57539b6a6f3b4d589f5f5e1d211cd6a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b454f707d20347ada3d82aa85495635e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 20:00:14.065494 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cb9500f-1f45-43e9-aa56-b401ead28aef admin admin] REQUEST_METHOD: `PUT` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:00:14.065786 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cb9500f-1f45-43e9-aa56-b401ead28aef admin admin] SCRIPT_NAME: `/identity` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:00:14.066126 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cb9500f-1f45-43e9-aa56-b401ead28aef admin admin] PATH_INFO: `/v3/projects/0d5c083f20d94eb081216a6f93e083dc/users/6969cdddb54c4459837a6e477ab82431/roles/3618ab638a65401f82333da7596d1daf` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:00:14.073638 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ec7ac0d-b664-4bf3-a3cf-ee60df7d2500 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57539b6a6f3b4d589f5f5e1d211cd6a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b454f707d20347ada3d82aa85495635e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82025) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 20:00:14.075026 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ec7ac0d-b664-4bf3-a3cf-ee60df7d2500 admin admin] REQUEST_METHOD: `PUT` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:00:14.075487 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ec7ac0d-b664-4bf3-a3cf-ee60df7d2500 admin admin] SCRIPT_NAME: `/identity` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:00:14.075884 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ec7ac0d-b664-4bf3-a3cf-ee60df7d2500 admin admin] PATH_INFO: `/v3/projects/33bc98571321445183fc3115859a7836/users/c505119ab65747088a20a55280862330/roles/3618ab638a65401f82333da7596d1daf` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:00:14.083381 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cb9500f-1f45-43e9-aa56-b401ead28aef admin admin] RBAC: Authorizing `identity:create_grant(project_id=0d5c083f20d94eb081216a6f93e083dc, user_id=6969cdddb54c4459837a6e477ab82431, role_id=3618ab638a65401f82333da7596d1daf)` {{(pid=82026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 20:00:14.086243 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cb9500f-1f45-43e9-aa56-b401ead28aef admin admin] RBAC: Authorization granted {{(pid=82026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 20:00:14.096064 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ec7ac0d-b664-4bf3-a3cf-ee60df7d2500 admin admin] RBAC: Authorizing `identity:create_grant(project_id=33bc98571321445183fc3115859a7836, user_id=c505119ab65747088a20a55280862330, role_id=3618ab638a65401f82333da7596d1daf)` {{(pid=82025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 20:00:14.098817 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ec7ac0d-b664-4bf3-a3cf-ee60df7d2500 admin admin] RBAC: Authorization granted {{(pid=82025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 20:00:14.163341 dv-cinder-828806-6-smb devstack@keystone.service[82026]: [pid: 82026|app: 0|req: 796/1601] 10.222.0.33 () {60 vars in 1483 bytes} [Tue Sep 13 20:00:13 2022] PUT /identity/v3/projects/0d5c083f20d94eb081216a6f93e083dc/users/6969cdddb54c4459837a6e477ab82431/roles/3618ab638a65401f82333da7596d1daf => generated 0 bytes in 184 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 20:00:14.164550 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cb9500f-1f45-43e9-aa56-b401ead28aef admin admin] Authenticating user token {{(pid=82026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 20:00:14.192715 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG dbcounter [-] [82026] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=82026) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 20:00:14.196517 dv-cinder-828806-6-smb devstack@keystone.service[82025]: [pid: 82025|app: 0|req: 806/1602] 10.222.0.33 () {60 vars in 1483 bytes} [Tue Sep 13 20:00:13 2022] PUT /identity/v3/projects/33bc98571321445183fc3115859a7836/users/c505119ab65747088a20a55280862330/roles/3618ab638a65401f82333da7596d1daf => generated 0 bytes in 218 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 20:00:14.197319 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ec7ac0d-b664-4bf3-a3cf-ee60df7d2500 admin admin] Authenticating user token {{(pid=82025) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 20:00:14.230459 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cb9500f-1f45-43e9-aa56-b401ead28aef admin admin] Validating token access rules against request {{(pid=82026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 20:00:14.252446 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG dbcounter [-] [82025] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=82025) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 20:00:14.265999 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ec7ac0d-b664-4bf3-a3cf-ee60df7d2500 admin admin] Validating token access rules against request {{(pid=82025) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 20:00:14.270766 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11d2688f-3426-4086-a704-b1de2c11851f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57539b6a6f3b4d589f5f5e1d211cd6a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b454f707d20347ada3d82aa85495635e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82025) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 20:00:14.272264 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11d2688f-3426-4086-a704-b1de2c11851f admin admin] REQUEST_METHOD: `PUT` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:00:14.272652 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11d2688f-3426-4086-a704-b1de2c11851f admin admin] SCRIPT_NAME: `/identity` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:00:14.272941 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11d2688f-3426-4086-a704-b1de2c11851f admin admin] PATH_INFO: `/v3/projects/f013c72c3cbf4cc6969706788045ca68/users/f48da2d6429c41fab04088325a2c232f/roles/3618ab638a65401f82333da7596d1daf` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:00:14.294495 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11d2688f-3426-4086-a704-b1de2c11851f admin admin] RBAC: Authorizing `identity:create_grant(project_id=f013c72c3cbf4cc6969706788045ca68, user_id=f48da2d6429c41fab04088325a2c232f, role_id=3618ab638a65401f82333da7596d1daf)` {{(pid=82025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 20:00:14.297452 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11d2688f-3426-4086-a704-b1de2c11851f admin admin] RBAC: Authorization granted {{(pid=82025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 20:00:14.310501 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d82097b-ba3a-438e-a608-20805e7043a9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57539b6a6f3b4d589f5f5e1d211cd6a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b454f707d20347ada3d82aa85495635e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 20:00:14.310501 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d82097b-ba3a-438e-a608-20805e7043a9 admin admin] REQUEST_METHOD: `PUT` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:00:14.310501 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d82097b-ba3a-438e-a608-20805e7043a9 admin admin] SCRIPT_NAME: `/identity` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:00:14.310501 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d82097b-ba3a-438e-a608-20805e7043a9 admin admin] PATH_INFO: `/v3/projects/96e946d1fbe24044ae9f9656b050ce31/users/8653f4fb20ce4169a1419bd73e62e702/roles/3618ab638a65401f82333da7596d1daf` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:00:14.326839 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d82097b-ba3a-438e-a608-20805e7043a9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=96e946d1fbe24044ae9f9656b050ce31, user_id=8653f4fb20ce4169a1419bd73e62e702, role_id=3618ab638a65401f82333da7596d1daf)` {{(pid=82026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 20:00:14.329672 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d82097b-ba3a-438e-a608-20805e7043a9 admin admin] RBAC: Authorization granted {{(pid=82026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 20:00:14.381166 dv-cinder-828806-6-smb devstack@keystone.service[82025]: [pid: 82025|app: 0|req: 807/1603] 10.222.0.33 () {60 vars in 1483 bytes} [Tue Sep 13 20:00:14 2022] PUT /identity/v3/projects/f013c72c3cbf4cc6969706788045ca68/users/f48da2d6429c41fab04088325a2c232f/roles/3618ab638a65401f82333da7596d1daf => generated 0 bytes in 184 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 20:00:14.384761 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd7da031-8d66-4271-9603-2b72ea0094b6 None None] REQUEST_METHOD: `POST` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:00:14.385086 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd7da031-8d66-4271-9603-2b72ea0094b6 None None] SCRIPT_NAME: `/identity` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:00:14.385480 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd7da031-8d66-4271-9603-2b72ea0094b6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:00:14.388626 dv-cinder-828806-6-smb devstack@keystone.service[82026]: [pid: 82026|app: 0|req: 797/1604] 10.222.0.33 () {60 vars in 1483 bytes} [Tue Sep 13 20:00:14 2022] PUT /identity/v3/projects/96e946d1fbe24044ae9f9656b050ce31/users/8653f4fb20ce4169a1419bd73e62e702/roles/3618ab638a65401f82333da7596d1daf => generated 0 bytes in 224 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 20:00:14.400943 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d82097b-ba3a-438e-a608-20805e7043a9 admin admin] Authenticating user token {{(pid=82026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 20:00:14.419769 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.auth.core [None req-dd7da031-8d66-4271-9603-2b72ea0094b6 None None] MFA Rules not processed for user `cd153e7dc6924885a4e48810e8a05c67`. Rule list: `[]` (Enabled: `True`). {{(pid=82025) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 20:00:14.421050 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.fernet_utils [None req-dd7da031-8d66-4271-9603-2b72ea0094b6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82025) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 20:00:14.467696 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d82097b-ba3a-438e-a608-20805e7043a9 admin admin] Validating token access rules against request {{(pid=82026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 20:00:14.496848 dv-cinder-828806-6-smb devstack@keystone.service[82025]: [pid: 82025|app: 0|req: 808/1605] 10.222.0.33 () {58 vars in 958 bytes} [Tue Sep 13 20:00:14 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 20:00:14.496848 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b18edd1c-fb4d-46c2-a198-d9d8c3e2097d None None] REQUEST_METHOD: `POST` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:00:14.496848 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b18edd1c-fb4d-46c2-a198-d9d8c3e2097d None None] SCRIPT_NAME: `/identity` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:00:14.496848 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b18edd1c-fb4d-46c2-a198-d9d8c3e2097d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:00:14.544083 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.auth.core [None req-b18edd1c-fb4d-46c2-a198-d9d8c3e2097d None None] MFA Rules not processed for user `0c3866a717f046d190f1a919bf12c07b`. Rule list: `[]` (Enabled: `True`). {{(pid=82025) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 20:00:14.545600 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.fernet_utils [None req-b18edd1c-fb4d-46c2-a198-d9d8c3e2097d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82025) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 20:00:14.545917 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53d8115d-3a3c-4a56-ae7a-1202d8265e9d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57539b6a6f3b4d589f5f5e1d211cd6a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b454f707d20347ada3d82aa85495635e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 20:00:14.546671 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53d8115d-3a3c-4a56-ae7a-1202d8265e9d admin admin] REQUEST_METHOD: `PUT` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:00:14.546992 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53d8115d-3a3c-4a56-ae7a-1202d8265e9d admin admin] SCRIPT_NAME: `/identity` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:00:14.547267 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53d8115d-3a3c-4a56-ae7a-1202d8265e9d admin admin] PATH_INFO: `/v3/projects/2625a02465d9493c9e8200024b4cf585/users/8853527498a24a6c80c169929f9f48bc/roles/3618ab638a65401f82333da7596d1daf` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:00:14.550019 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG dbcounter [-] [82026] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82026) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 20:00:14.563403 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53d8115d-3a3c-4a56-ae7a-1202d8265e9d admin admin] RBAC: Authorizing `identity:create_grant(project_id=2625a02465d9493c9e8200024b4cf585, user_id=8853527498a24a6c80c169929f9f48bc, role_id=3618ab638a65401f82333da7596d1daf)` {{(pid=82026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 20:00:14.567017 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53d8115d-3a3c-4a56-ae7a-1202d8265e9d admin admin] RBAC: Authorization granted {{(pid=82026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 20:00:14.614479 dv-cinder-828806-6-smb devstack@keystone.service[82025]: [pid: 82025|app: 0|req: 809/1606] 10.222.0.33 () {58 vars in 958 bytes} [Tue Sep 13 20:00:14 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 20:00:14.616246 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a92eb117-0d60-4d0c-b102-e8e1b1a43e44 None None] REQUEST_METHOD: `POST` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:00:14.616543 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a92eb117-0d60-4d0c-b102-e8e1b1a43e44 None None] SCRIPT_NAME: `/identity` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:00:14.616816 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a92eb117-0d60-4d0c-b102-e8e1b1a43e44 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:00:14.645869 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.auth.core [None req-a92eb117-0d60-4d0c-b102-e8e1b1a43e44 None None] MFA Rules not processed for user `6969cdddb54c4459837a6e477ab82431`. Rule list: `[]` (Enabled: `True`). {{(pid=82025) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 20:00:14.647846 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.fernet_utils [None req-a92eb117-0d60-4d0c-b102-e8e1b1a43e44 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82025) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 20:00:14.652429 dv-cinder-828806-6-smb devstack@keystone.service[82026]: [pid: 82026|app: 0|req: 798/1607] 10.222.0.33 () {60 vars in 1483 bytes} [Tue Sep 13 20:00:14 2022] PUT /identity/v3/projects/2625a02465d9493c9e8200024b4cf585/users/8853527498a24a6c80c169929f9f48bc/roles/3618ab638a65401f82333da7596d1daf => generated 0 bytes in 263 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 20:00:14.653761 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b79580c0-b10d-4e7a-b2c8-c7d7d7e4348d None None] REQUEST_METHOD: `POST` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:00:14.654061 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b79580c0-b10d-4e7a-b2c8-c7d7d7e4348d None None] SCRIPT_NAME: `/identity` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:00:14.654327 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b79580c0-b10d-4e7a-b2c8-c7d7d7e4348d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:00:14.673553 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.auth.core [None req-b79580c0-b10d-4e7a-b2c8-c7d7d7e4348d None None] MFA Rules not processed for user `57539b6a6f3b4d589f5f5e1d211cd6a0`. Rule list: `[]` (Enabled: `True`). {{(pid=82026) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 20:00:14.674786 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.common.fernet_utils [None req-b79580c0-b10d-4e7a-b2c8-c7d7d7e4348d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82026) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 20:00:14.691730 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG dbcounter [-] [82025] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82025) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 20:00:14.731310 dv-cinder-828806-6-smb devstack@keystone.service[82025]: [pid: 82025|app: 0|req: 810/1608] 10.222.0.33 () {58 vars in 958 bytes} [Tue Sep 13 20:00:14 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 20:00:14.733213 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07a0361a-bb5c-49ff-b2a9-ce8aa251dfb5 None None] REQUEST_METHOD: `POST` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:00:14.733657 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07a0361a-bb5c-49ff-b2a9-ce8aa251dfb5 None None] SCRIPT_NAME: `/identity` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:00:14.734269 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07a0361a-bb5c-49ff-b2a9-ce8aa251dfb5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:00:14.749072 dv-cinder-828806-6-smb devstack@keystone.service[82026]: [pid: 82026|app: 0|req: 799/1609] 10.222.0.33 () {58 vars in 958 bytes} [Tue Sep 13 20:00:14 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 20:00:14.762673 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca7aa99d-aa56-418b-86ad-2947f9260705 None None] REQUEST_METHOD: `POST` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:00:14.762973 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca7aa99d-aa56-418b-86ad-2947f9260705 None None] SCRIPT_NAME: `/identity` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:00:14.763342 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca7aa99d-aa56-418b-86ad-2947f9260705 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:00:14.766760 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.auth.core [None req-07a0361a-bb5c-49ff-b2a9-ce8aa251dfb5 None None] MFA Rules not processed for user `f48da2d6429c41fab04088325a2c232f`. Rule list: `[]` (Enabled: `True`). {{(pid=82025) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 20:00:14.768022 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.fernet_utils [None req-07a0361a-bb5c-49ff-b2a9-ce8aa251dfb5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82025) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 20:00:14.800182 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.auth.core [None req-ca7aa99d-aa56-418b-86ad-2947f9260705 None None] MFA Rules not processed for user `8653f4fb20ce4169a1419bd73e62e702`. Rule list: `[]` (Enabled: `True`). {{(pid=82026) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 20:00:14.801415 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.common.fernet_utils [None req-ca7aa99d-aa56-418b-86ad-2947f9260705 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82026) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 20:00:14.839217 dv-cinder-828806-6-smb devstack@keystone.service[82025]: [pid: 82025|app: 0|req: 811/1610] 10.222.0.33 () {58 vars in 958 bytes} [Tue Sep 13 20:00:14 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 20:00:14.840606 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64bb5e9d-2e61-47e1-b2ef-a96580d9f20d None None] REQUEST_METHOD: `GET` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:00:14.840889 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64bb5e9d-2e61-47e1-b2ef-a96580d9f20d None None] SCRIPT_NAME: `/identity` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:00:14.841198 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64bb5e9d-2e61-47e1-b2ef-a96580d9f20d None None] PATH_INFO: `/` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:00:14.842699 dv-cinder-828806-6-smb devstack@keystone.service[82025]: [pid: 82025|app: 0|req: 812/1611] 10.222.0.33 () {54 vars in 962 bytes} [Tue Sep 13 20:00:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 20:00:14.843432 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64bb5e9d-2e61-47e1-b2ef-a96580d9f20d None None] Authenticating user token {{(pid=82025) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 20:00:14.876567 dv-cinder-828806-6-smb devstack@keystone.service[82026]: [pid: 82026|app: 0|req: 800/1612] 10.222.0.33 () {58 vars in 958 bytes} [Tue Sep 13 20:00:14 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 20:00:14.876567 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b179c71-c903-47fb-a28f-a4dc20e9e255 None None] REQUEST_METHOD: `POST` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:00:14.876567 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b179c71-c903-47fb-a28f-a4dc20e9e255 None None] SCRIPT_NAME: `/identity` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:00:14.876567 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b179c71-c903-47fb-a28f-a4dc20e9e255 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:00:14.894722 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.auth.core [None req-6b179c71-c903-47fb-a28f-a4dc20e9e255 None None] MFA Rules not processed for user `57539b6a6f3b4d589f5f5e1d211cd6a0`. Rule list: `[]` (Enabled: `True`). {{(pid=82026) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 20:00:14.895986 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.common.fernet_utils [None req-6b179c71-c903-47fb-a28f-a4dc20e9e255 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82026) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 20:00:14.905154 dv-cinder-828806-6-smb devstack@keystone.service[82026]: [pid: 82026|app: 0|req: 801/1613] 10.222.0.33 () {58 vars in 958 bytes} [Tue Sep 13 20:00:14 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 20:00:14.905866 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b179c71-c903-47fb-a28f-a4dc20e9e255 None None] Authenticating user token {{(pid=82026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 20:00:14.916438 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b179c71-c903-47fb-a28f-a4dc20e9e255 None None] Validating token access rules against request {{(pid=82026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 20:00:14.917405 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64bb5e9d-2e61-47e1-b2ef-a96580d9f20d None None] Validating token access rules against request {{(pid=82025) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 20:00:14.921551 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da278632-3b5f-41c1-b1f3-3610d492a8a4 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46024fc6167f4321818b1bed27a521a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8c6fba0f15b4d6a84ff601919b7b8e4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82025) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 20:00:14.924359 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da278632-3b5f-41c1-b1f3-3610d492a8a4 service cinder] REQUEST_METHOD: `GET` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:00:14.924476 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecea6a37-ac02-4d92-9282-b08dfcb5fb96 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57539b6a6f3b4d589f5f5e1d211cd6a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b454f707d20347ada3d82aa85495635e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 20:00:14.924667 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da278632-3b5f-41c1-b1f3-3610d492a8a4 service cinder] SCRIPT_NAME: `/identity` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:00:14.924667 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da278632-3b5f-41c1-b1f3-3610d492a8a4 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:00:14.924821 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecea6a37-ac02-4d92-9282-b08dfcb5fb96 admin admin] REQUEST_METHOD: `POST` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:00:14.924821 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecea6a37-ac02-4d92-9282-b08dfcb5fb96 admin admin] SCRIPT_NAME: `/identity` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:00:14.924821 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecea6a37-ac02-4d92-9282-b08dfcb5fb96 admin admin] PATH_INFO: `/v3/projects` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:00:14.924821 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecea6a37-ac02-4d92-9282-b08dfcb5fb96 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 20:00:14.926168 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecea6a37-ac02-4d92-9282-b08dfcb5fb96 admin admin] RBAC: Authorization granted {{(pid=82026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 20:00:14.979312 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da278632-3b5f-41c1-b1f3-3610d492a8a4 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=82025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 20:00:14.980754 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da278632-3b5f-41c1-b1f3-3610d492a8a4 service cinder] RBAC: Authorization granted {{(pid=82025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 20:00:14.989585 dv-cinder-828806-6-smb devstack@keystone.service[82025]: [pid: 82025|app: 0|req: 813/1614] 10.222.0.33 () {60 vars in 1365 bytes} [Tue Sep 13 20:00:14 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 146 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 20:00:14.998908 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da278632-3b5f-41c1-b1f3-3610d492a8a4 service cinder] Authenticating user token {{(pid=82025) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 20:00:15.049508 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG dbcounter [-] [82025] Writing DB stats keystone:SELECT=100 {{(pid=82025) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 20:00:15.055242 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da278632-3b5f-41c1-b1f3-3610d492a8a4 service cinder] Validating token access rules against request {{(pid=82025) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 20:00:15.059593 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d977e459-a6f4-4eab-84dd-c42667304bf3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '023a2c79c2444611b3d431928e56685d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8c6fba0f15b4d6a84ff601919b7b8e4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82025) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 20:00:15.060213 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d977e459-a6f4-4eab-84dd-c42667304bf3 service neutron] REQUEST_METHOD: `GET` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:00:15.060504 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d977e459-a6f4-4eab-84dd-c42667304bf3 service neutron] SCRIPT_NAME: `/identity` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:00:15.060613 dv-cinder-828806-6-smb devstack@keystone.service[82026]: [pid: 82026|app: 0|req: 802/1615] 10.222.0.33 () {60 vars in 1153 bytes} [Tue Sep 13 20:00:14 2022] POST /identity/v3/projects => generated 381 bytes in 155 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 13 20:00:15.060788 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d977e459-a6f4-4eab-84dd-c42667304bf3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:00:15.061962 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e8a4a82-4e9e-4a87-ba6c-20f7d653bbe5 None None] REQUEST_METHOD: `POST` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:00:15.062480 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e8a4a82-4e9e-4a87-ba6c-20f7d653bbe5 None None] SCRIPT_NAME: `/identity` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:00:15.062812 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e8a4a82-4e9e-4a87-ba6c-20f7d653bbe5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:00:15.073002 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d977e459-a6f4-4eab-84dd-c42667304bf3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 20:00:15.075831 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d977e459-a6f4-4eab-84dd-c42667304bf3 service neutron] RBAC: Authorization granted {{(pid=82025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 20:00:15.087410 dv-cinder-828806-6-smb devstack@keystone.service[82025]: [pid: 82025|app: 0|req: 814/1616] 10.222.0.33 () {60 vars in 1365 bytes} [Tue Sep 13 20:00:14 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 97 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 20:00:15.088855 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68de2d14-20f3-492c-9300-585a5dbdc831 None None] REQUEST_METHOD: `GET` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:00:15.088998 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68de2d14-20f3-492c-9300-585a5dbdc831 None None] SCRIPT_NAME: `/identity` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:00:15.089223 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68de2d14-20f3-492c-9300-585a5dbdc831 None None] PATH_INFO: `/` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:00:15.090850 dv-cinder-828806-6-smb devstack@keystone.service[82025]: [pid: 82025|app: 0|req: 815/1617] 10.222.0.33 () {54 vars in 962 bytes} [Tue Sep 13 20:00:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 20:00:15.091606 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68de2d14-20f3-492c-9300-585a5dbdc831 None None] Authenticating user token {{(pid=82025) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 20:00:15.133831 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.auth.core [None req-3e8a4a82-4e9e-4a87-ba6c-20f7d653bbe5 None None] MFA Rules not processed for user `e66e7034abed4e0bad1f4137520c1e70`. Rule list: `[]` (Enabled: `True`). {{(pid=82026) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 20:00:15.136209 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.common.fernet_utils [None req-3e8a4a82-4e9e-4a87-ba6c-20f7d653bbe5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82026) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 20:00:15.177117 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG dbcounter [-] [82026] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=82026) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 20:00:15.187562 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68de2d14-20f3-492c-9300-585a5dbdc831 None None] Validating token access rules against request {{(pid=82025) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 20:00:15.192333 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63a0d59e-7a79-4471-a0fe-fccb019f2b3c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57539b6a6f3b4d589f5f5e1d211cd6a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b454f707d20347ada3d82aa85495635e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82025) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 20:00:15.193558 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63a0d59e-7a79-4471-a0fe-fccb019f2b3c admin admin] REQUEST_METHOD: `POST` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:00:15.193847 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63a0d59e-7a79-4471-a0fe-fccb019f2b3c admin admin] SCRIPT_NAME: `/identity` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:00:15.194122 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63a0d59e-7a79-4471-a0fe-fccb019f2b3c admin admin] PATH_INFO: `/v3/projects` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:00:15.194854 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63a0d59e-7a79-4471-a0fe-fccb019f2b3c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 20:00:15.197433 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63a0d59e-7a79-4471-a0fe-fccb019f2b3c admin admin] RBAC: Authorization granted {{(pid=82025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 20:00:15.242514 dv-cinder-828806-6-smb devstack@keystone.service[82026]: [pid: 82026|app: 0|req: 803/1618] 10.222.0.33 () {58 vars in 1059 bytes} [Tue Sep 13 20:00:15 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 181 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 20:00:15.243590 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e8a4a82-4e9e-4a87-ba6c-20f7d653bbe5 None None] Authenticating user token {{(pid=82026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 20:00:15.345882 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e8a4a82-4e9e-4a87-ba6c-20f7d653bbe5 None None] Validating token access rules against request {{(pid=82026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 20:00:15.350906 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19b9e73b-3026-4b43-b9af-dac0da80e9f9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '023a2c79c2444611b3d431928e56685d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8c6fba0f15b4d6a84ff601919b7b8e4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 20:00:15.351629 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19b9e73b-3026-4b43-b9af-dac0da80e9f9 service neutron] REQUEST_METHOD: `GET` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:00:15.351919 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19b9e73b-3026-4b43-b9af-dac0da80e9f9 service neutron] SCRIPT_NAME: `/identity` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:00:15.352231 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19b9e73b-3026-4b43-b9af-dac0da80e9f9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:00:15.365542 dv-cinder-828806-6-smb devstack@keystone.service[82025]: [pid: 82025|app: 0|req: 816/1619] 10.222.0.33 () {60 vars in 1153 bytes} [Tue Sep 13 20:00:15 2022] POST /identity/v3/projects => generated 371 bytes in 274 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 13 20:00:15.366560 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63a0d59e-7a79-4471-a0fe-fccb019f2b3c admin admin] Authenticating user token {{(pid=82025) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 20:00:15.372179 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19b9e73b-3026-4b43-b9af-dac0da80e9f9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 20:00:15.376416 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19b9e73b-3026-4b43-b9af-dac0da80e9f9 service neutron] RBAC: Authorization granted {{(pid=82026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 20:00:15.394210 dv-cinder-828806-6-smb devstack@keystone.service[82026]: [pid: 82026|app: 0|req: 804/1620] 10.222.0.33 () {60 vars in 1365 bytes} [Tue Sep 13 20:00:15 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 151 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 20:00:15.400017 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5d78649-51de-444e-841f-406354cd67d4 None None] REQUEST_METHOD: `POST` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:00:15.400017 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5d78649-51de-444e-841f-406354cd67d4 None None] SCRIPT_NAME: `/identity` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:00:15.400017 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5d78649-51de-444e-841f-406354cd67d4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:00:15.421492 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.auth.core [None req-a5d78649-51de-444e-841f-406354cd67d4 None None] MFA Rules not processed for user `e66e7034abed4e0bad1f4137520c1e70`. Rule list: `[]` (Enabled: `True`). {{(pid=82026) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 20:00:15.423761 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.common.fernet_utils [None req-a5d78649-51de-444e-841f-406354cd67d4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82026) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 20:00:15.481797 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63a0d59e-7a79-4471-a0fe-fccb019f2b3c admin admin] Validating token access rules against request {{(pid=82025) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 20:00:15.487329 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-865cf249-6f52-422e-aefa-b3bb6abeae71 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57539b6a6f3b4d589f5f5e1d211cd6a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b454f707d20347ada3d82aa85495635e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82025) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 20:00:15.488015 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-865cf249-6f52-422e-aefa-b3bb6abeae71 admin admin] REQUEST_METHOD: `POST` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:00:15.488299 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-865cf249-6f52-422e-aefa-b3bb6abeae71 admin admin] SCRIPT_NAME: `/identity` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:00:15.488574 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-865cf249-6f52-422e-aefa-b3bb6abeae71 admin admin] PATH_INFO: `/v3/users` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:00:15.489218 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-865cf249-6f52-422e-aefa-b3bb6abeae71 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 20:00:15.492713 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-865cf249-6f52-422e-aefa-b3bb6abeae71 admin admin] RBAC: Authorization granted {{(pid=82025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 20:00:15.527240 dv-cinder-828806-6-smb devstack@keystone.service[82026]: [pid: 82026|app: 0|req: 805/1621] 10.222.0.33 () {58 vars in 1059 bytes} [Tue Sep 13 20:00:15 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 132 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 20:00:15.530009 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5d78649-51de-444e-841f-406354cd67d4 None None] Authenticating user token {{(pid=82026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 20:00:15.547416 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5d78649-51de-444e-841f-406354cd67d4 None None] Validating token access rules against request {{(pid=82026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 20:00:15.556582 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-def1ab07-676a-4089-9b0d-0b50d2603e68 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e66e7034abed4e0bad1f4137520c1e70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8c6fba0f15b4d6a84ff601919b7b8e4', 'project_domain_id': 'default', 'roles': ['service', 'member', 'reader', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 20:00:15.557486 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-def1ab07-676a-4089-9b0d-0b50d2603e68 service nova] REQUEST_METHOD: `GET` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:00:15.557865 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-def1ab07-676a-4089-9b0d-0b50d2603e68 service nova] SCRIPT_NAME: `/identity` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:00:15.558220 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-def1ab07-676a-4089-9b0d-0b50d2603e68 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:00:15.626868 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-def1ab07-676a-4089-9b0d-0b50d2603e68 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 20:00:15.629067 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-def1ab07-676a-4089-9b0d-0b50d2603e68 service nova] RBAC: Authorization granted {{(pid=82026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 20:00:15.631666 dv-cinder-828806-6-smb devstack@keystone.service[82025]: [pid: 82025|app: 0|req: 817/1622] 10.222.0.33 () {60 vars in 1144 bytes} [Tue Sep 13 20:00:15 2022] POST /identity/v3/users => generated 297 bytes in 265 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 13 20:00:15.632707 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-865cf249-6f52-422e-aefa-b3bb6abeae71 admin admin] Authenticating user token {{(pid=82025) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 20:00:15.647063 dv-cinder-828806-6-smb devstack@keystone.service[82026]: [pid: 82026|app: 0|req: 806/1623] 10.222.0.33 () {60 vars in 1365 bytes} [Tue Sep 13 20:00:15 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 119 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 20:00:15.648501 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-def1ab07-676a-4089-9b0d-0b50d2603e68 service nova] Authenticating user token {{(pid=82026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 20:00:15.652933 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-865cf249-6f52-422e-aefa-b3bb6abeae71 admin admin] Validating token access rules against request {{(pid=82025) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 20:00:15.665934 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f7e4162-53b0-4538-8c9f-0e825537d4ad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57539b6a6f3b4d589f5f5e1d211cd6a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b454f707d20347ada3d82aa85495635e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82025) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 20:00:15.666634 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f7e4162-53b0-4538-8c9f-0e825537d4ad admin admin] REQUEST_METHOD: `POST` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:00:15.667011 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-def1ab07-676a-4089-9b0d-0b50d2603e68 service nova] Validating token access rules against request {{(pid=82026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 20:00:15.667495 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f7e4162-53b0-4538-8c9f-0e825537d4ad admin admin] SCRIPT_NAME: `/identity` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:00:15.667582 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f7e4162-53b0-4538-8c9f-0e825537d4ad admin admin] PATH_INFO: `/v3/users` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:00:15.670645 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f7e4162-53b0-4538-8c9f-0e825537d4ad admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 20:00:15.672721 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f7e4162-53b0-4538-8c9f-0e825537d4ad admin admin] RBAC: Authorization granted {{(pid=82025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 20:00:15.672998 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e9e19fd-600e-4c4f-a426-e176727e0168 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e66e7034abed4e0bad1f4137520c1e70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8c6fba0f15b4d6a84ff601919b7b8e4', 'project_domain_id': 'default', 'roles': ['service', 'member', 'reader', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 20:00:15.673628 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e9e19fd-600e-4c4f-a426-e176727e0168 service nova] REQUEST_METHOD: `GET` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:00:15.673914 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e9e19fd-600e-4c4f-a426-e176727e0168 service nova] SCRIPT_NAME: `/identity` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:00:15.674198 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e9e19fd-600e-4c4f-a426-e176727e0168 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:00:15.743687 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e9e19fd-600e-4c4f-a426-e176727e0168 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 20:00:15.745478 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e9e19fd-600e-4c4f-a426-e176727e0168 service nova] RBAC: Authorization granted {{(pid=82026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 20:00:15.759484 dv-cinder-828806-6-smb devstack@keystone.service[82026]: [pid: 82026|app: 0|req: 807/1624] 10.222.0.33 () {60 vars in 1365 bytes} [Tue Sep 13 20:00:15 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 111 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 20:00:15.759697 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e9e19fd-600e-4c4f-a426-e176727e0168 service nova] Authenticating user token {{(pid=82026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 20:00:15.776633 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e9e19fd-600e-4c4f-a426-e176727e0168 service nova] Validating token access rules against request {{(pid=82026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 20:00:15.780211 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c944e8f8-2114-40fe-93d9-ecc60cac40d5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57539b6a6f3b4d589f5f5e1d211cd6a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b454f707d20347ada3d82aa85495635e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 20:00:15.780890 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c944e8f8-2114-40fe-93d9-ecc60cac40d5 admin admin] REQUEST_METHOD: `GET` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:00:15.781239 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c944e8f8-2114-40fe-93d9-ecc60cac40d5 admin admin] SCRIPT_NAME: `/identity` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:00:15.781528 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c944e8f8-2114-40fe-93d9-ecc60cac40d5 admin admin] PATH_INFO: `/v3/roles` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:00:15.782595 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c944e8f8-2114-40fe-93d9-ecc60cac40d5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 20:00:15.786074 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c944e8f8-2114-40fe-93d9-ecc60cac40d5 admin admin] RBAC: Authorization granted {{(pid=82026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 20:00:15.802130 dv-cinder-828806-6-smb devstack@keystone.service[82025]: [pid: 82025|app: 0|req: 818/1625] 10.222.0.33 () {60 vars in 1144 bytes} [Tue Sep 13 20:00:15 2022] POST /identity/v3/users => generated 292 bytes in 170 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 13 20:00:15.806694 dv-cinder-828806-6-smb devstack@keystone.service[82026]: [pid: 82026|app: 0|req: 808/1626] 10.222.0.33 () {58 vars in 1122 bytes} [Tue Sep 13 20:00:15 2022] GET /identity/v3/roles => generated 1420 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 13 20:00:15.807110 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f7e4162-53b0-4538-8c9f-0e825537d4ad admin admin] Authenticating user token {{(pid=82025) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 20:00:15.810743 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c944e8f8-2114-40fe-93d9-ecc60cac40d5 admin admin] Authenticating user token {{(pid=82026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 20:00:15.825989 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f7e4162-53b0-4538-8c9f-0e825537d4ad admin admin] Validating token access rules against request {{(pid=82025) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 20:00:15.827496 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c944e8f8-2114-40fe-93d9-ecc60cac40d5 admin admin] Validating token access rules against request {{(pid=82026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 20:00:15.835610 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01a434a0-8454-4bd6-b269-121feadc80ac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57539b6a6f3b4d589f5f5e1d211cd6a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b454f707d20347ada3d82aa85495635e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 20:00:15.836491 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01a434a0-8454-4bd6-b269-121feadc80ac admin admin] REQUEST_METHOD: `PUT` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:00:15.836906 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01a434a0-8454-4bd6-b269-121feadc80ac admin admin] SCRIPT_NAME: `/identity` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:00:15.837663 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01a434a0-8454-4bd6-b269-121feadc80ac admin admin] PATH_INFO: `/v3/projects/934c3f075419487d97bc09e4a5231b29/users/b2844d6e223c482dba01ff91739d3c02/roles/e5af7d5baa93469e9e486ef21c85474e` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:00:15.838303 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef5e1f3e-f62b-4283-9e60-e1091ae19bd7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57539b6a6f3b4d589f5f5e1d211cd6a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b454f707d20347ada3d82aa85495635e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82025) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 20:00:15.838940 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef5e1f3e-f62b-4283-9e60-e1091ae19bd7 admin admin] REQUEST_METHOD: `GET` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:00:15.839305 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef5e1f3e-f62b-4283-9e60-e1091ae19bd7 admin admin] SCRIPT_NAME: `/identity` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:00:15.839592 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef5e1f3e-f62b-4283-9e60-e1091ae19bd7 admin admin] PATH_INFO: `/v3/roles` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:00:15.840279 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef5e1f3e-f62b-4283-9e60-e1091ae19bd7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 20:00:15.844676 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef5e1f3e-f62b-4283-9e60-e1091ae19bd7 admin admin] RBAC: Authorization granted {{(pid=82025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 20:00:15.862708 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01a434a0-8454-4bd6-b269-121feadc80ac admin admin] RBAC: Authorizing `identity:create_grant(project_id=934c3f075419487d97bc09e4a5231b29, user_id=b2844d6e223c482dba01ff91739d3c02, role_id=e5af7d5baa93469e9e486ef21c85474e)` {{(pid=82026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 20:00:15.865705 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01a434a0-8454-4bd6-b269-121feadc80ac admin admin] RBAC: Authorization granted {{(pid=82026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 20:00:15.874644 dv-cinder-828806-6-smb devstack@keystone.service[82025]: [pid: 82025|app: 0|req: 819/1627] 10.222.0.33 () {58 vars in 1122 bytes} [Tue Sep 13 20:00:15 2022] GET /identity/v3/roles => generated 1420 bytes in 68 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 13 20:00:15.878401 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef5e1f3e-f62b-4283-9e60-e1091ae19bd7 admin admin] Authenticating user token {{(pid=82025) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 20:00:15.896751 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef5e1f3e-f62b-4283-9e60-e1091ae19bd7 admin admin] Validating token access rules against request {{(pid=82025) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 20:00:15.904267 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9e02609-d3ab-4255-959e-4818705c1f48 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57539b6a6f3b4d589f5f5e1d211cd6a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b454f707d20347ada3d82aa85495635e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82025) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 20:00:15.904937 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9e02609-d3ab-4255-959e-4818705c1f48 admin admin] REQUEST_METHOD: `PUT` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:00:15.905218 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9e02609-d3ab-4255-959e-4818705c1f48 admin admin] SCRIPT_NAME: `/identity` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:00:15.905620 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9e02609-d3ab-4255-959e-4818705c1f48 admin admin] PATH_INFO: `/v3/projects/af222842abec4ab79850e79a7b4ccd4b/users/b303a67d568c40638e8ef1b148225310/roles/e5af7d5baa93469e9e486ef21c85474e` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:00:15.916914 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG dbcounter [-] [82026] Writing DB stats keystone:SELECT=100 {{(pid=82026) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 20:00:15.957729 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG dbcounter [-] [82025] Writing DB stats keystone:SELECT=93,keystone:INSERT=7 {{(pid=82025) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 20:00:15.966913 dv-cinder-828806-6-smb devstack@keystone.service[82026]: [pid: 82026|app: 0|req: 809/1628] 10.222.0.33 () {60 vars in 1483 bytes} [Tue Sep 13 20:00:15 2022] PUT /identity/v3/projects/934c3f075419487d97bc09e4a5231b29/users/b2844d6e223c482dba01ff91739d3c02/roles/e5af7d5baa93469e9e486ef21c85474e => generated 0 bytes in 156 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 13 20:00:15.968499 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9e02609-d3ab-4255-959e-4818705c1f48 admin admin] RBAC: Authorizing `identity:create_grant(project_id=af222842abec4ab79850e79a7b4ccd4b, user_id=b303a67d568c40638e8ef1b148225310, role_id=e5af7d5baa93469e9e486ef21c85474e)` {{(pid=82025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 20:00:15.971051 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01a434a0-8454-4bd6-b269-121feadc80ac admin admin] Authenticating user token {{(pid=82026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 20:00:15.971358 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9e02609-d3ab-4255-959e-4818705c1f48 admin admin] RBAC: Authorization granted {{(pid=82025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 20:00:16.111264 dv-cinder-828806-6-smb devstack@keystone.service[82025]: [pid: 82025|app: 0|req: 820/1629] 10.222.0.33 () {60 vars in 1483 bytes} [Tue Sep 13 20:00:15 2022] PUT /identity/v3/projects/af222842abec4ab79850e79a7b4ccd4b/users/b303a67d568c40638e8ef1b148225310/roles/e5af7d5baa93469e9e486ef21c85474e => generated 0 bytes in 228 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 20:00:16.112225 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9e02609-d3ab-4255-959e-4818705c1f48 admin admin] Authenticating user token {{(pid=82025) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 20:00:16.160199 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01a434a0-8454-4bd6-b269-121feadc80ac admin admin] Validating token access rules against request {{(pid=82026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 20:00:16.262974 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9e02609-d3ab-4255-959e-4818705c1f48 admin admin] Validating token access rules against request {{(pid=82025) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 20:00:16.279556 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbbcfa9b-0a42-49a9-9544-acfecc559453 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57539b6a6f3b4d589f5f5e1d211cd6a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b454f707d20347ada3d82aa85495635e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82025) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 20:00:16.280490 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbbcfa9b-0a42-49a9-9544-acfecc559453 admin admin] REQUEST_METHOD: `GET` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:00:16.281199 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbbcfa9b-0a42-49a9-9544-acfecc559453 admin admin] SCRIPT_NAME: `/identity` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:00:16.281741 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbbcfa9b-0a42-49a9-9544-acfecc559453 admin admin] PATH_INFO: `/v3/roles` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:00:16.288544 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbbcfa9b-0a42-49a9-9544-acfecc559453 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 20:00:16.290704 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbbcfa9b-0a42-49a9-9544-acfecc559453 admin admin] RBAC: Authorization granted {{(pid=82025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 20:00:16.316250 dv-cinder-828806-6-smb devstack@keystone.service[82025]: [pid: 82025|app: 0|req: 821/1630] 10.222.0.33 () {58 vars in 1122 bytes} [Tue Sep 13 20:00:16 2022] GET /identity/v3/roles => generated 1420 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 13 20:00:16.325562 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97b2f1bb-6cb0-40f9-bc35-e366be5f910a None None] REQUEST_METHOD: `GET` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:00:16.326086 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97b2f1bb-6cb0-40f9-bc35-e366be5f910a None None] SCRIPT_NAME: `/identity` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:00:16.326568 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97b2f1bb-6cb0-40f9-bc35-e366be5f910a None None] PATH_INFO: `/` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:00:16.328752 dv-cinder-828806-6-smb devstack@keystone.service[82025]: [pid: 82025|app: 0|req: 822/1631] 10.222.0.33 () {54 vars in 912 bytes} [Tue Sep 13 20:00:16 2022] GET /identity => generated 270 bytes in 11 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 20:00:16.331349 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97b2f1bb-6cb0-40f9-bc35-e366be5f910a None None] Authenticating user token {{(pid=82025) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 20:00:16.359330 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97b2f1bb-6cb0-40f9-bc35-e366be5f910a None None] Validating token access rules against request {{(pid=82025) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 20:00:16.360738 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e40ecbfd-d3f5-4456-9f37-04f7b10af1b1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57539b6a6f3b4d589f5f5e1d211cd6a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b454f707d20347ada3d82aa85495635e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 20:00:16.362644 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e40ecbfd-d3f5-4456-9f37-04f7b10af1b1 admin admin] REQUEST_METHOD: `GET` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:00:16.364697 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e40ecbfd-d3f5-4456-9f37-04f7b10af1b1 admin admin] SCRIPT_NAME: `/identity` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:00:16.365038 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e40ecbfd-d3f5-4456-9f37-04f7b10af1b1 admin admin] PATH_INFO: `/v3/roles` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:00:16.366482 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e40ecbfd-d3f5-4456-9f37-04f7b10af1b1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 20:00:16.368675 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e40ecbfd-d3f5-4456-9f37-04f7b10af1b1 admin admin] RBAC: Authorization granted {{(pid=82026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 20:00:16.370284 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58210308-d832-47bc-bb13-995b27ebae3a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57539b6a6f3b4d589f5f5e1d211cd6a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b454f707d20347ada3d82aa85495635e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82025) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 20:00:16.371252 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58210308-d832-47bc-bb13-995b27ebae3a admin admin] REQUEST_METHOD: `PUT` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:00:16.371741 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58210308-d832-47bc-bb13-995b27ebae3a admin admin] SCRIPT_NAME: `/identity` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:00:16.372217 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58210308-d832-47bc-bb13-995b27ebae3a admin admin] PATH_INFO: `/v3/projects/af222842abec4ab79850e79a7b4ccd4b/users/b303a67d568c40638e8ef1b148225310/roles/e5af7d5baa93469e9e486ef21c85474e` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:00:16.378055 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58210308-d832-47bc-bb13-995b27ebae3a admin admin] RBAC: Authorizing `identity:create_grant(project_id=af222842abec4ab79850e79a7b4ccd4b, user_id=b303a67d568c40638e8ef1b148225310, role_id=e5af7d5baa93469e9e486ef21c85474e)` {{(pid=82025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 20:00:16.381053 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58210308-d832-47bc-bb13-995b27ebae3a admin admin] RBAC: Authorization granted {{(pid=82025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 20:00:16.400138 dv-cinder-828806-6-smb devstack@keystone.service[82026]: [pid: 82026|app: 0|req: 810/1632] 10.222.0.33 () {58 vars in 1122 bytes} [Tue Sep 13 20:00:15 2022] GET /identity/v3/roles => generated 1420 bytes in 430 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 13 20:00:16.401678 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba665fd1-1c75-431d-bf1c-12a5ee7d6c6c None None] REQUEST_METHOD: `POST` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:00:16.401979 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba665fd1-1c75-431d-bf1c-12a5ee7d6c6c None None] SCRIPT_NAME: `/identity` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:00:16.402266 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba665fd1-1c75-431d-bf1c-12a5ee7d6c6c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:00:16.413812 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG dbcounter [-] [82026] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82026) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 20:00:16.421979 dv-cinder-828806-6-smb devstack@keystone.service[82025]: [pid: 82025|app: 0|req: 823/1633] 10.222.0.33 () {60 vars in 1483 bytes} [Tue Sep 13 20:00:16 2022] PUT /identity/v3/projects/af222842abec4ab79850e79a7b4ccd4b/users/b303a67d568c40638e8ef1b148225310/roles/e5af7d5baa93469e9e486ef21c85474e => generated 0 bytes in 92 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 20:00:16.429021 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58210308-d832-47bc-bb13-995b27ebae3a admin admin] Authenticating user token {{(pid=82025) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 20:00:16.442811 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.auth.core [None req-ba665fd1-1c75-431d-bf1c-12a5ee7d6c6c None None] MFA Rules not processed for user `e66e7034abed4e0bad1f4137520c1e70`. Rule list: `[]` (Enabled: `True`). {{(pid=82026) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 20:00:16.445316 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.common.fernet_utils [None req-ba665fd1-1c75-431d-bf1c-12a5ee7d6c6c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82026) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 20:00:16.577305 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58210308-d832-47bc-bb13-995b27ebae3a admin admin] Validating token access rules against request {{(pid=82025) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 20:00:16.601080 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ba41b29-77b9-4ee5-bc20-2c7985cd1b16 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57539b6a6f3b4d589f5f5e1d211cd6a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b454f707d20347ada3d82aa85495635e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82025) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 20:00:16.602028 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ba41b29-77b9-4ee5-bc20-2c7985cd1b16 admin admin] REQUEST_METHOD: `PUT` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:00:16.602437 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ba41b29-77b9-4ee5-bc20-2c7985cd1b16 admin admin] SCRIPT_NAME: `/identity` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:00:16.603461 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ba41b29-77b9-4ee5-bc20-2c7985cd1b16 admin admin] PATH_INFO: `/v3/projects/934c3f075419487d97bc09e4a5231b29/users/b2844d6e223c482dba01ff91739d3c02/roles/e5af7d5baa93469e9e486ef21c85474e` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:00:16.606153 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ba41b29-77b9-4ee5-bc20-2c7985cd1b16 admin admin] RBAC: Authorizing `identity:create_grant(project_id=934c3f075419487d97bc09e4a5231b29, user_id=b2844d6e223c482dba01ff91739d3c02, role_id=e5af7d5baa93469e9e486ef21c85474e)` {{(pid=82025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 20:00:16.610184 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ba41b29-77b9-4ee5-bc20-2c7985cd1b16 admin admin] RBAC: Authorization granted {{(pid=82025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 20:00:16.612071 dv-cinder-828806-6-smb devstack@keystone.service[82026]: [pid: 82026|app: 0|req: 811/1634] 10.222.0.33 () {58 vars in 1009 bytes} [Tue Sep 13 20:00:16 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 211 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 20:00:16.613908 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e9eb302-3254-4287-9c19-9652b16e71d9 None None] REQUEST_METHOD: `GET` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:00:16.614588 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e9eb302-3254-4287-9c19-9652b16e71d9 None None] SCRIPT_NAME: `/identity` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:00:16.615130 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e9eb302-3254-4287-9c19-9652b16e71d9 None None] PATH_INFO: `/` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:00:16.618004 dv-cinder-828806-6-smb devstack@keystone.service[82026]: [pid: 82026|app: 0|req: 812/1635] 10.222.0.33 () {54 vars in 912 bytes} [Tue Sep 13 20:00:16 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 20:00:16.620685 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03ebb118-f120-4132-836c-24f098599cd8 None None] REQUEST_METHOD: `POST` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:00:16.624594 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03ebb118-f120-4132-836c-24f098599cd8 None None] SCRIPT_NAME: `/identity` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:00:16.624887 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03ebb118-f120-4132-836c-24f098599cd8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:00:16.886968 dv-cinder-828806-6-smb devstack@keystone.service[82025]: [pid: 82025|app: 0|req: 824/1636] 10.222.0.33 () {60 vars in 1483 bytes} [Tue Sep 13 20:00:16 2022] PUT /identity/v3/projects/934c3f075419487d97bc09e4a5231b29/users/b2844d6e223c482dba01ff91739d3c02/roles/e5af7d5baa93469e9e486ef21c85474e => generated 0 bytes in 236 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 20:00:16.886968 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d897de0-5503-4e28-a203-fd44ad9a9e87 None None] REQUEST_METHOD: `POST` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:00:16.886968 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d897de0-5503-4e28-a203-fd44ad9a9e87 None None] SCRIPT_NAME: `/identity` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:00:16.886968 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d897de0-5503-4e28-a203-fd44ad9a9e87 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:00:16.890866 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.auth.core [None req-03ebb118-f120-4132-836c-24f098599cd8 None None] MFA Rules not processed for user `b303a67d568c40638e8ef1b148225310`. Rule list: `[]` (Enabled: `True`). {{(pid=82026) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 20:00:16.890866 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.common.fernet_utils [None req-03ebb118-f120-4132-836c-24f098599cd8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82026) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 20:00:16.921189 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.auth.core [None req-3d897de0-5503-4e28-a203-fd44ad9a9e87 None None] MFA Rules not processed for user `e66e7034abed4e0bad1f4137520c1e70`. Rule list: `[]` (Enabled: `True`). {{(pid=82025) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 20:00:16.921189 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.fernet_utils [None req-3d897de0-5503-4e28-a203-fd44ad9a9e87 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82025) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 20:00:16.921189 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG dbcounter [-] [82025] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=82025) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 20:00:16.921189 dv-cinder-828806-6-smb devstack@keystone.service[82025]: [pid: 82025|app: 0|req: 825/1637] 10.222.0.33 () {58 vars in 1009 bytes} [Tue Sep 13 20:00:16 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 230 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 20:00:16.921189 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d897de0-5503-4e28-a203-fd44ad9a9e87 None None] Authenticating user token {{(pid=82025) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 20:00:16.923921 dv-cinder-828806-6-smb devstack@keystone.service[82026]: [pid: 82026|app: 0|req: 813/1638] 10.222.0.33 () {58 vars in 958 bytes} [Tue Sep 13 20:00:16 2022] POST /identity/v3/auth/tokens => generated 3315 bytes in 280 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 20:00:16.923921 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fd0ac85-50f4-46b4-9e91-3b2967cc0494 None None] REQUEST_METHOD: `POST` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:00:16.923921 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fd0ac85-50f4-46b4-9e91-3b2967cc0494 None None] SCRIPT_NAME: `/identity` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:00:16.923921 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fd0ac85-50f4-46b4-9e91-3b2967cc0494 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:00:16.945261 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.auth.core [None req-2fd0ac85-50f4-46b4-9e91-3b2967cc0494 None None] MFA Rules not processed for user `b2844d6e223c482dba01ff91739d3c02`. Rule list: `[]` (Enabled: `True`). {{(pid=82026) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 20:00:16.946815 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.common.fernet_utils [None req-2fd0ac85-50f4-46b4-9e91-3b2967cc0494 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82026) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 20:00:16.996279 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d897de0-5503-4e28-a203-fd44ad9a9e87 None None] Validating token access rules against request {{(pid=82025) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 20:00:17.001524 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4a2ad08-572c-463e-8969-391fda440b89 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46024fc6167f4321818b1bed27a521a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8c6fba0f15b4d6a84ff601919b7b8e4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82025) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 20:00:17.002398 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4a2ad08-572c-463e-8969-391fda440b89 service cinder] REQUEST_METHOD: `GET` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:00:17.003028 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4a2ad08-572c-463e-8969-391fda440b89 service cinder] SCRIPT_NAME: `/identity` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:00:17.003361 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4a2ad08-572c-463e-8969-391fda440b89 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:00:17.017002 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4a2ad08-572c-463e-8969-391fda440b89 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=82025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 20:00:17.018793 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4a2ad08-572c-463e-8969-391fda440b89 service cinder] RBAC: Authorization granted {{(pid=82025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 20:00:17.035327 dv-cinder-828806-6-smb devstack@keystone.service[82025]: [pid: 82025|app: 0|req: 826/1639] 10.222.0.33 () {60 vars in 1365 bytes} [Tue Sep 13 20:00:16 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 145 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 20:00:17.036047 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4a2ad08-572c-463e-8969-391fda440b89 service cinder] Authenticating user token {{(pid=82025) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 20:00:17.049518 dv-cinder-828806-6-smb devstack@keystone.service[82026]: [pid: 82026|app: 0|req: 814/1640] 10.222.0.33 () {58 vars in 958 bytes} [Tue Sep 13 20:00:16 2022] POST /identity/v3/auth/tokens => generated 3325 bytes in 144 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 20:00:17.049685 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4a2ad08-572c-463e-8969-391fda440b89 service cinder] Validating token access rules against request {{(pid=82025) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 20:00:17.053158 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4ba23ef-7735-4b2b-a542-b280dade2b8c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46024fc6167f4321818b1bed27a521a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8c6fba0f15b4d6a84ff601919b7b8e4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82025) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 20:00:17.053789 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4ba23ef-7735-4b2b-a542-b280dade2b8c service cinder] REQUEST_METHOD: `GET` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:00:17.054071 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4ba23ef-7735-4b2b-a542-b280dade2b8c service cinder] SCRIPT_NAME: `/identity` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:00:17.054346 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4ba23ef-7735-4b2b-a542-b280dade2b8c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:00:17.072088 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4ba23ef-7735-4b2b-a542-b280dade2b8c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=82025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 20:00:17.073769 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4ba23ef-7735-4b2b-a542-b280dade2b8c service cinder] RBAC: Authorization granted {{(pid=82025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 20:00:17.091826 dv-cinder-828806-6-smb devstack@keystone.service[82025]: [pid: 82025|app: 0|req: 827/1641] 10.222.0.33 () {60 vars in 1365 bytes} [Tue Sep 13 20:00:17 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 56 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 20:00:17.139357 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fd0ac85-50f4-46b4-9e91-3b2967cc0494 None None] Authenticating user token {{(pid=82026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 20:00:17.156705 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fd0ac85-50f4-46b4-9e91-3b2967cc0494 None None] Validating token access rules against request {{(pid=82026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 20:00:17.173421 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f437a1b1-5b2e-4e4c-985e-6fd15d419069 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46024fc6167f4321818b1bed27a521a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8c6fba0f15b4d6a84ff601919b7b8e4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 20:00:17.173946 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f437a1b1-5b2e-4e4c-985e-6fd15d419069 service cinder] REQUEST_METHOD: `GET` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:00:17.174451 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f437a1b1-5b2e-4e4c-985e-6fd15d419069 service cinder] SCRIPT_NAME: `/identity` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:00:17.174747 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f437a1b1-5b2e-4e4c-985e-6fd15d419069 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:00:17.189652 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f437a1b1-5b2e-4e4c-985e-6fd15d419069 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=82026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 20:00:17.193030 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f437a1b1-5b2e-4e4c-985e-6fd15d419069 service cinder] RBAC: Authorization granted {{(pid=82026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 20:00:17.212145 dv-cinder-828806-6-smb devstack@keystone.service[82026]: [pid: 82026|app: 0|req: 815/1642] 10.222.0.33 () {60 vars in 1365 bytes} [Tue Sep 13 20:00:17 2022] GET /identity/v3/auth/tokens => generated 3315 bytes in 74 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 20:00:17.387736 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4ba23ef-7735-4b2b-a542-b280dade2b8c service cinder] Authenticating user token {{(pid=82025) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 20:00:17.405880 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4ba23ef-7735-4b2b-a542-b280dade2b8c service cinder] Validating token access rules against request {{(pid=82025) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 20:00:17.411185 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd2b5425-c71e-452e-9d7c-0c97e1be8b1a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46024fc6167f4321818b1bed27a521a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8c6fba0f15b4d6a84ff601919b7b8e4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82025) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 20:00:17.412942 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd2b5425-c71e-452e-9d7c-0c97e1be8b1a service cinder] REQUEST_METHOD: `GET` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:00:17.413718 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd2b5425-c71e-452e-9d7c-0c97e1be8b1a service cinder] SCRIPT_NAME: `/identity` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:00:17.414080 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd2b5425-c71e-452e-9d7c-0c97e1be8b1a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:00:17.432244 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd2b5425-c71e-452e-9d7c-0c97e1be8b1a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=82025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 20:00:17.434032 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd2b5425-c71e-452e-9d7c-0c97e1be8b1a service cinder] RBAC: Authorization granted {{(pid=82025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 20:00:17.448222 dv-cinder-828806-6-smb devstack@keystone.service[82025]: [pid: 82025|app: 0|req: 828/1643] 10.222.0.33 () {60 vars in 1365 bytes} [Tue Sep 13 20:00:17 2022] GET /identity/v3/auth/tokens => generated 3325 bytes in 60 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 20:00:17.941444 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f437a1b1-5b2e-4e4c-985e-6fd15d419069 service cinder] Authenticating user token {{(pid=82026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 20:00:18.108364 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f437a1b1-5b2e-4e4c-985e-6fd15d419069 service cinder] Validating token access rules against request {{(pid=82026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 20:00:18.118267 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd2b5425-c71e-452e-9d7c-0c97e1be8b1a service cinder] Authenticating user token {{(pid=82025) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 20:00:18.129142 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f26fb841-a599-439f-a258-f726057a2e12 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57539b6a6f3b4d589f5f5e1d211cd6a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b454f707d20347ada3d82aa85495635e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 20:00:18.131962 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd2b5425-c71e-452e-9d7c-0c97e1be8b1a service cinder] Validating token access rules against request {{(pid=82025) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 20:00:18.134694 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f26fb841-a599-439f-a258-f726057a2e12 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:00:18.134694 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f26fb841-a599-439f-a258-f726057a2e12 admin admin] SCRIPT_NAME: `/identity` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:00:18.134871 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f26fb841-a599-439f-a258-f726057a2e12 admin admin] PATH_INFO: `/v3/users/cd153e7dc6924885a4e48810e8a05c67` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:00:18.136152 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f26fb841-a599-439f-a258-f726057a2e12 admin admin] RBAC: Authorizing `identity:delete_user(user_id=cd153e7dc6924885a4e48810e8a05c67)` {{(pid=82026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 20:00:18.136889 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e9462ec-7f5e-4099-b27e-62a865977b3e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46024fc6167f4321818b1bed27a521a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8c6fba0f15b4d6a84ff601919b7b8e4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82025) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 20:00:18.137896 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e9462ec-7f5e-4099-b27e-62a865977b3e service cinder] REQUEST_METHOD: `GET` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:00:18.138162 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e9462ec-7f5e-4099-b27e-62a865977b3e service cinder] SCRIPT_NAME: `/identity` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:00:18.138542 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e9462ec-7f5e-4099-b27e-62a865977b3e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:00:18.141632 dv-cinder-828806-6-smb devstack@keystone.service[82026]: WARNING py.warnings [None req-f26fb841-a599-439f-a258-f726057a2e12 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Sep 13 20:00:18.141632 dv-cinder-828806-6-smb devstack@keystone.service[82026]: warnings.warn(msg) Sep 13 20:00:18.141632 dv-cinder-828806-6-smb devstack@keystone.service[82026]: Sep 13 20:00:18.150377 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f26fb841-a599-439f-a258-f726057a2e12 admin admin] RBAC: Authorization granted {{(pid=82026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 20:00:18.298169 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG dbcounter [-] [82026] Writing DB stats keystone:SELECT=100 {{(pid=82026) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 20:00:18.300046 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e9462ec-7f5e-4099-b27e-62a865977b3e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=82025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 20:00:18.301918 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e9462ec-7f5e-4099-b27e-62a865977b3e service cinder] RBAC: Authorization granted {{(pid=82025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 20:00:18.319665 dv-cinder-828806-6-smb devstack@keystone.service[82025]: [pid: 82025|app: 0|req: 829/1644] 10.222.0.33 () {60 vars in 1365 bytes} [Tue Sep 13 20:00:18 2022] GET /identity/v3/auth/tokens => generated 3258 bytes in 202 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 20:00:18.422401 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.notifications [None req-f26fb841-a599-439f-a258-f726057a2e12 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'cd153e7dc6924885a4e48810e8a05c67'} {{(pid=82026) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 20:00:18.522050 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.notifications [None req-f26fb841-a599-439f-a258-f726057a2e12 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'cd153e7dc6924885a4e48810e8a05c67'} {{(pid=82026) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 20:00:18.565548 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.notifications [None req-f26fb841-a599-439f-a258-f726057a2e12 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'cd153e7dc6924885a4e48810e8a05c67'} {{(pid=82026) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 20:00:18.567060 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.notifications [None req-f26fb841-a599-439f-a258-f726057a2e12 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'cd153e7dc6924885a4e48810e8a05c67'} {{(pid=82026) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 20:00:18.587122 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.notifications [None req-f26fb841-a599-439f-a258-f726057a2e12 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'cd153e7dc6924885a4e48810e8a05c67'} {{(pid=82026) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 20:00:18.594510 dv-cinder-828806-6-smb devstack@keystone.service[82026]: [pid: 82026|app: 0|req: 816/1645] 10.222.0.33 () {58 vars in 1224 bytes} [Tue Sep 13 20:00:17 2022] DELETE /identity/v3/users/cd153e7dc6924885a4e48810e8a05c67 => generated 0 bytes in 654 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 20:00:18.624714 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6a81084-ec89-4c7a-a87a-2f57525ab606 None None] REQUEST_METHOD: `POST` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:00:18.625724 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6a81084-ec89-4c7a-a87a-2f57525ab606 None None] SCRIPT_NAME: `/identity` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:00:18.626234 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6a81084-ec89-4c7a-a87a-2f57525ab606 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:00:18.661094 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.auth.core [None req-e6a81084-ec89-4c7a-a87a-2f57525ab606 None None] MFA Rules not processed for user `57539b6a6f3b4d589f5f5e1d211cd6a0`. Rule list: `[]` (Enabled: `True`). {{(pid=82025) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 20:00:18.663689 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.fernet_utils [None req-e6a81084-ec89-4c7a-a87a-2f57525ab606 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82025) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 20:00:18.763501 dv-cinder-828806-6-smb devstack@keystone.service[82025]: [pid: 82025|app: 0|req: 830/1646] 10.222.0.33 () {58 vars in 958 bytes} [Tue Sep 13 20:00:18 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 142 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 20:00:18.774835 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f26fb841-a599-439f-a258-f726057a2e12 admin admin] Authenticating user token {{(pid=82026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 20:00:18.776480 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.common.fernet_utils [None req-f26fb841-a599-439f-a258-f726057a2e12 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82026) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 20:00:18.841937 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f26fb841-a599-439f-a258-f726057a2e12 admin admin] Validating token access rules against request {{(pid=82026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 20:00:18.846522 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a1a423c-c354-4075-97bb-052fa6741ee0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '023a2c79c2444611b3d431928e56685d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8c6fba0f15b4d6a84ff601919b7b8e4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 20:00:18.850238 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a1a423c-c354-4075-97bb-052fa6741ee0 service neutron] REQUEST_METHOD: `GET` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:00:18.850238 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a1a423c-c354-4075-97bb-052fa6741ee0 service neutron] SCRIPT_NAME: `/identity` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:00:18.850238 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a1a423c-c354-4075-97bb-052fa6741ee0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:00:18.858264 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a1a423c-c354-4075-97bb-052fa6741ee0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 20:00:18.859911 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a1a423c-c354-4075-97bb-052fa6741ee0 service neutron] RBAC: Authorization granted {{(pid=82026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 20:00:18.871365 dv-cinder-828806-6-smb devstack@keystone.service[82026]: [pid: 82026|app: 0|req: 817/1647] 10.222.0.33 () {60 vars in 1365 bytes} [Tue Sep 13 20:00:18 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 97 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 20:00:20.654946 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6a81084-ec89-4c7a-a87a-2f57525ab606 None None] Authenticating user token {{(pid=82025) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 20:00:20.655979 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.fernet_utils [None req-e6a81084-ec89-4c7a-a87a-2f57525ab606 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82025) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 20:00:20.681847 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6a81084-ec89-4c7a-a87a-2f57525ab606 None None] Validating token access rules against request {{(pid=82025) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 20:00:20.691820 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60072860-8bb5-4d41-b039-1d329df52c32 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57539b6a6f3b4d589f5f5e1d211cd6a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b454f707d20347ada3d82aa85495635e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82025) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 20:00:20.691962 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60072860-8bb5-4d41-b039-1d329df52c32 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:00:20.692244 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60072860-8bb5-4d41-b039-1d329df52c32 admin admin] SCRIPT_NAME: `/identity` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:00:20.692511 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60072860-8bb5-4d41-b039-1d329df52c32 admin admin] PATH_INFO: `/v3/users/8653f4fb20ce4169a1419bd73e62e702` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:00:20.694345 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60072860-8bb5-4d41-b039-1d329df52c32 admin admin] RBAC: Authorizing `identity:delete_user(user_id=8653f4fb20ce4169a1419bd73e62e702)` {{(pid=82025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 20:00:20.696383 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60072860-8bb5-4d41-b039-1d329df52c32 admin admin] RBAC: Authorization granted {{(pid=82025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 20:00:20.714276 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG dbcounter [-] [82025] Writing DB stats keystone:SELECT=100 {{(pid=82025) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 20:00:20.920875 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a1a423c-c354-4075-97bb-052fa6741ee0 service neutron] Authenticating user token {{(pid=82026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 20:00:20.922487 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.common.fernet_utils [None req-6a1a423c-c354-4075-97bb-052fa6741ee0 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82026) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 20:00:20.950662 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a1a423c-c354-4075-97bb-052fa6741ee0 service neutron] Validating token access rules against request {{(pid=82026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 20:00:20.970567 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.notifications [None req-60072860-8bb5-4d41-b039-1d329df52c32 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8653f4fb20ce4169a1419bd73e62e702'} {{(pid=82025) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 20:00:20.971513 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50e2aebf-e272-478f-a310-f2536624c1dd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57539b6a6f3b4d589f5f5e1d211cd6a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b454f707d20347ada3d82aa85495635e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 20:00:20.973152 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50e2aebf-e272-478f-a310-f2536624c1dd admin admin] REQUEST_METHOD: `DELETE` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:00:20.973517 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50e2aebf-e272-478f-a310-f2536624c1dd admin admin] SCRIPT_NAME: `/identity` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:00:20.973875 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50e2aebf-e272-478f-a310-f2536624c1dd admin admin] PATH_INFO: `/v3/projects/bdc3c419ef344fefb2f15b54b9840c2f` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:00:20.980312 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50e2aebf-e272-478f-a310-f2536624c1dd admin admin] RBAC: Authorizing `identity:delete_project(project_id=bdc3c419ef344fefb2f15b54b9840c2f)` {{(pid=82026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 20:00:20.982957 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50e2aebf-e272-478f-a310-f2536624c1dd admin admin] RBAC: Authorization granted {{(pid=82026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 20:00:21.014654 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG dbcounter [-] [82026] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82026) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 20:00:21.072162 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.notifications [None req-60072860-8bb5-4d41-b039-1d329df52c32 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8653f4fb20ce4169a1419bd73e62e702'} {{(pid=82025) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 20:00:21.074157 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.notifications [None req-60072860-8bb5-4d41-b039-1d329df52c32 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8653f4fb20ce4169a1419bd73e62e702'} {{(pid=82025) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 20:00:21.135681 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.notifications [None req-60072860-8bb5-4d41-b039-1d329df52c32 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8653f4fb20ce4169a1419bd73e62e702'} {{(pid=82025) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 20:00:21.160106 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.notifications [None req-60072860-8bb5-4d41-b039-1d329df52c32 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8653f4fb20ce4169a1419bd73e62e702'} {{(pid=82025) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 20:00:21.186404 dv-cinder-828806-6-smb devstack@keystone.service[82025]: [pid: 82025|app: 0|req: 831/1648] 10.222.0.33 () {58 vars in 1224 bytes} [Tue Sep 13 20:00:20 2022] DELETE /identity/v3/users/8653f4fb20ce4169a1419bd73e62e702 => generated 0 bytes in 531 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 20:00:21.208418 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fbdbdf3-1908-4997-91a3-d4a75dd552df None None] REQUEST_METHOD: `POST` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:00:21.209550 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fbdbdf3-1908-4997-91a3-d4a75dd552df None None] SCRIPT_NAME: `/identity` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:00:21.210141 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fbdbdf3-1908-4997-91a3-d4a75dd552df None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:00:21.256919 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.auth.core [None req-3fbdbdf3-1908-4997-91a3-d4a75dd552df None None] MFA Rules not processed for user `57539b6a6f3b4d589f5f5e1d211cd6a0`. Rule list: `[]` (Enabled: `True`). {{(pid=82025) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 20:00:21.263823 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.fernet_utils [None req-3fbdbdf3-1908-4997-91a3-d4a75dd552df None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82025) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 20:00:21.299675 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.notifications [None req-50e2aebf-e272-478f-a310-f2536624c1dd admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'bdc3c419ef344fefb2f15b54b9840c2f', 'request_id': 'req-50e2aebf-e272-478f-a310-f2536624c1dd'} {{(pid=82026) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 20:00:21.435284 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.notifications [None req-50e2aebf-e272-478f-a310-f2536624c1dd admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'bdc3c419ef344fefb2f15b54b9840c2f', 'request_id': 'req-50e2aebf-e272-478f-a310-f2536624c1dd'} {{(pid=82026) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 20:00:21.443921 dv-cinder-828806-6-smb devstack@keystone.service[82025]: [pid: 82025|app: 0|req: 832/1649] 10.222.0.33 () {58 vars in 958 bytes} [Tue Sep 13 20:00:21 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 237 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 13 20:00:21.444471 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.notifications [None req-50e2aebf-e272-478f-a310-f2536624c1dd admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'bdc3c419ef344fefb2f15b54b9840c2f', 'request_id': 'req-50e2aebf-e272-478f-a310-f2536624c1dd'} {{(pid=82026) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 20:00:21.456996 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fbdbdf3-1908-4997-91a3-d4a75dd552df None None] Authenticating user token {{(pid=82025) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 20:00:21.459667 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.fernet_utils [None req-3fbdbdf3-1908-4997-91a3-d4a75dd552df None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82025) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 20:00:21.483086 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.notifications [None req-50e2aebf-e272-478f-a310-f2536624c1dd admin admin] The token cache is being invalidate because project bdc3c419ef344fefb2f15b54b9840c2f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82026) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 13 20:00:21.483324 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.notifications [None req-50e2aebf-e272-478f-a310-f2536624c1dd admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82026) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 20:00:21.488027 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.notifications [None req-50e2aebf-e272-478f-a310-f2536624c1dd admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82026) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 20:00:21.497788 dv-cinder-828806-6-smb devstack@keystone.service[82026]: [pid: 82026|app: 0|req: 818/1650] 10.222.0.33 () {58 vars in 1233 bytes} [Tue Sep 13 20:00:20 2022] DELETE /identity/v3/projects/bdc3c419ef344fefb2f15b54b9840c2f => generated 0 bytes in 574 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 13 20:00:21.509472 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2817ecea-d836-43c0-ae0e-93461459d781 None None] REQUEST_METHOD: `POST` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:00:21.511098 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2817ecea-d836-43c0-ae0e-93461459d781 None None] SCRIPT_NAME: `/identity` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:00:21.511098 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2817ecea-d836-43c0-ae0e-93461459d781 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:00:21.591816 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.auth.core [None req-2817ecea-d836-43c0-ae0e-93461459d781 None None] MFA Rules not processed for user `57539b6a6f3b4d589f5f5e1d211cd6a0`. Rule list: `[]` (Enabled: `True`). {{(pid=82026) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 20:00:21.593322 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.common.fernet_utils [None req-2817ecea-d836-43c0-ae0e-93461459d781 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82026) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 20:00:21.633077 dv-cinder-828806-6-smb devstack@keystone.service[82026]: [pid: 82026|app: 0|req: 819/1651] 10.222.0.33 () {58 vars in 958 bytes} [Tue Sep 13 20:00:21 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 133 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 20:00:21.644974 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1ac1bb5-5e05-463d-9c5c-6c4a818ecdb4 None None] REQUEST_METHOD: `POST` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:00:21.645273 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1ac1bb5-5e05-463d-9c5c-6c4a818ecdb4 None None] SCRIPT_NAME: `/identity` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:00:21.655090 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1ac1bb5-5e05-463d-9c5c-6c4a818ecdb4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:00:21.660629 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fbdbdf3-1908-4997-91a3-d4a75dd552df None None] Validating token access rules against request {{(pid=82025) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 20:00:21.666609 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4d9fd82-921f-487d-ad17-7b151f091b60 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '023a2c79c2444611b3d431928e56685d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8c6fba0f15b4d6a84ff601919b7b8e4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82025) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 20:00:21.668204 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4d9fd82-921f-487d-ad17-7b151f091b60 service neutron] REQUEST_METHOD: `GET` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:00:21.668681 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4d9fd82-921f-487d-ad17-7b151f091b60 service neutron] SCRIPT_NAME: `/identity` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:00:21.670401 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4d9fd82-921f-487d-ad17-7b151f091b60 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:00:21.672707 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.fernet_utils [None req-a4d9fd82-921f-487d-ad17-7b151f091b60 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82025) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 20:00:21.697330 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.auth.core [None req-e1ac1bb5-5e05-463d-9c5c-6c4a818ecdb4 None None] MFA Rules not processed for user `57539b6a6f3b4d589f5f5e1d211cd6a0`. Rule list: `[]` (Enabled: `True`). {{(pid=82026) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 20:00:21.703223 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.common.fernet_utils [None req-e1ac1bb5-5e05-463d-9c5c-6c4a818ecdb4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82026) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 20:00:21.706403 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4d9fd82-921f-487d-ad17-7b151f091b60 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 20:00:21.709930 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4d9fd82-921f-487d-ad17-7b151f091b60 service neutron] RBAC: Authorization granted {{(pid=82025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 20:00:21.722536 dv-cinder-828806-6-smb devstack@keystone.service[82026]: [pid: 82026|app: 0|req: 820/1652] 10.222.0.33 () {58 vars in 958 bytes} [Tue Sep 13 20:00:21 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 20:00:21.725076 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1ac1bb5-5e05-463d-9c5c-6c4a818ecdb4 None None] Authenticating user token {{(pid=82026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 20:00:21.741499 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1ac1bb5-5e05-463d-9c5c-6c4a818ecdb4 None None] Validating token access rules against request {{(pid=82026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 20:00:21.750544 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38ca7443-367d-4e92-a4f4-0a2b91de13ed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57539b6a6f3b4d589f5f5e1d211cd6a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b454f707d20347ada3d82aa85495635e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 20:00:21.751453 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38ca7443-367d-4e92-a4f4-0a2b91de13ed admin admin] REQUEST_METHOD: `GET` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:00:21.752799 dv-cinder-828806-6-smb devstack@keystone.service[82025]: [pid: 82025|app: 0|req: 833/1653] 10.222.0.33 () {60 vars in 1365 bytes} [Tue Sep 13 20:00:21 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 296 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 20:00:21.753085 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38ca7443-367d-4e92-a4f4-0a2b91de13ed admin admin] SCRIPT_NAME: `/identity` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:00:21.753491 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38ca7443-367d-4e92-a4f4-0a2b91de13ed admin admin] PATH_INFO: `/v3/domains` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:00:21.757114 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38ca7443-367d-4e92-a4f4-0a2b91de13ed admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82026) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 20:00:21.757469 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38ca7443-367d-4e92-a4f4-0a2b91de13ed admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 20:00:21.769791 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38ca7443-367d-4e92-a4f4-0a2b91de13ed admin admin] RBAC: Authorization granted {{(pid=82026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 20:00:21.831229 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4d9fd82-921f-487d-ad17-7b151f091b60 service neutron] Authenticating user token {{(pid=82025) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 20:00:21.832666 dv-cinder-828806-6-smb devstack@keystone.service[82026]: [pid: 82026|app: 0|req: 821/1654] 10.222.0.33 () {58 vars in 1153 bytes} [Tue Sep 13 20:00:21 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 109 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 20:00:21.846534 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4d9fd82-921f-487d-ad17-7b151f091b60 service neutron] Validating token access rules against request {{(pid=82025) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 20:00:21.866309 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef10aa51-62a8-4d65-a497-4c2863cd563a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57539b6a6f3b4d589f5f5e1d211cd6a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b454f707d20347ada3d82aa85495635e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82025) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 20:00:21.867168 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef10aa51-62a8-4d65-a497-4c2863cd563a admin admin] REQUEST_METHOD: `POST` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:00:21.867627 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef10aa51-62a8-4d65-a497-4c2863cd563a admin admin] SCRIPT_NAME: `/identity` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:00:21.868002 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef10aa51-62a8-4d65-a497-4c2863cd563a admin admin] PATH_INFO: `/v3/projects` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:00:21.868907 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef10aa51-62a8-4d65-a497-4c2863cd563a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 20:00:21.872310 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef10aa51-62a8-4d65-a497-4c2863cd563a admin admin] RBAC: Authorization granted {{(pid=82025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 20:00:22.003424 dv-cinder-828806-6-smb devstack@keystone.service[82025]: [pid: 82025|app: 0|req: 834/1655] 10.222.0.33 () {60 vars in 1153 bytes} [Tue Sep 13 20:00:21 2022] POST /identity/v3/projects => generated 373 bytes in 173 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 13 20:00:22.010922 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38ca7443-367d-4e92-a4f4-0a2b91de13ed admin admin] Authenticating user token {{(pid=82026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 20:00:22.025436 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38ca7443-367d-4e92-a4f4-0a2b91de13ed admin admin] Validating token access rules against request {{(pid=82026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 20:00:22.233687 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caca44db-f535-41fb-90c3-5e241ddff525 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57539b6a6f3b4d589f5f5e1d211cd6a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b454f707d20347ada3d82aa85495635e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 20:00:22.243430 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caca44db-f535-41fb-90c3-5e241ddff525 admin admin] REQUEST_METHOD: `POST` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:00:22.243430 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caca44db-f535-41fb-90c3-5e241ddff525 admin admin] SCRIPT_NAME: `/identity` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:00:22.243430 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caca44db-f535-41fb-90c3-5e241ddff525 admin admin] PATH_INFO: `/v3/users` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:00:22.252148 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caca44db-f535-41fb-90c3-5e241ddff525 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 20:00:22.261254 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caca44db-f535-41fb-90c3-5e241ddff525 admin admin] RBAC: Authorization granted {{(pid=82026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 20:00:22.444386 dv-cinder-828806-6-smb devstack@keystone.service[82026]: [pid: 82026|app: 0|req: 822/1656] 10.222.0.33 () {60 vars in 1144 bytes} [Tue Sep 13 20:00:22 2022] POST /identity/v3/users => generated 287 bytes in 435 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 13 20:00:22.450457 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef10aa51-62a8-4d65-a497-4c2863cd563a admin admin] Authenticating user token {{(pid=82025) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 20:00:22.470827 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef10aa51-62a8-4d65-a497-4c2863cd563a admin admin] Validating token access rules against request {{(pid=82025) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 20:00:22.484454 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75068736-c329-4c94-8e28-edfe5f7b77e3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57539b6a6f3b4d589f5f5e1d211cd6a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b454f707d20347ada3d82aa85495635e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82025) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 20:00:22.488144 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75068736-c329-4c94-8e28-edfe5f7b77e3 admin admin] REQUEST_METHOD: `GET` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:00:22.489708 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75068736-c329-4c94-8e28-edfe5f7b77e3 admin admin] SCRIPT_NAME: `/identity` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:00:22.490174 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75068736-c329-4c94-8e28-edfe5f7b77e3 admin admin] PATH_INFO: `/v3/roles` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:00:22.494686 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75068736-c329-4c94-8e28-edfe5f7b77e3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 20:00:22.502346 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75068736-c329-4c94-8e28-edfe5f7b77e3 admin admin] RBAC: Authorization granted {{(pid=82025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 20:00:22.528391 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG dbcounter [-] [82025] Writing DB stats keystone:SELECT=88,keystone:DELETE=10,keystone:INSERT=2 {{(pid=82025) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 20:00:22.570036 dv-cinder-828806-6-smb devstack@keystone.service[82025]: [pid: 82025|app: 0|req: 835/1657] 10.222.0.33 () {58 vars in 1122 bytes} [Tue Sep 13 20:00:22 2022] GET /identity/v3/roles => generated 1420 bytes in 120 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 13 20:00:22.574594 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caca44db-f535-41fb-90c3-5e241ddff525 admin admin] Authenticating user token {{(pid=82026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 20:00:22.597867 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caca44db-f535-41fb-90c3-5e241ddff525 admin admin] Validating token access rules against request {{(pid=82026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 20:00:22.616300 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9fa1df0-7714-403a-9fae-a45c6afe0c19 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57539b6a6f3b4d589f5f5e1d211cd6a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b454f707d20347ada3d82aa85495635e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 20:00:22.622416 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9fa1df0-7714-403a-9fae-a45c6afe0c19 admin admin] REQUEST_METHOD: `GET` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:00:22.622561 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9fa1df0-7714-403a-9fae-a45c6afe0c19 admin admin] SCRIPT_NAME: `/identity` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:00:22.622844 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9fa1df0-7714-403a-9fae-a45c6afe0c19 admin admin] PATH_INFO: `/v3/roles` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:00:22.623547 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9fa1df0-7714-403a-9fae-a45c6afe0c19 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 20:00:22.625892 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9fa1df0-7714-403a-9fae-a45c6afe0c19 admin admin] RBAC: Authorization granted {{(pid=82026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 20:00:22.653784 dv-cinder-828806-6-smb devstack@keystone.service[82026]: [pid: 82026|app: 0|req: 823/1658] 10.222.0.33 () {58 vars in 1122 bytes} [Tue Sep 13 20:00:22 2022] GET /identity/v3/roles => generated 1420 bytes in 80 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 13 20:00:22.658301 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75068736-c329-4c94-8e28-edfe5f7b77e3 admin admin] Authenticating user token {{(pid=82025) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 20:00:22.673882 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75068736-c329-4c94-8e28-edfe5f7b77e3 admin admin] Validating token access rules against request {{(pid=82025) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 20:00:22.682543 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0591ddbe-ac1b-4ed8-bc19-f06b625ab948 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57539b6a6f3b4d589f5f5e1d211cd6a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b454f707d20347ada3d82aa85495635e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82025) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 20:00:22.685111 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0591ddbe-ac1b-4ed8-bc19-f06b625ab948 admin admin] REQUEST_METHOD: `PUT` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:00:22.685111 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0591ddbe-ac1b-4ed8-bc19-f06b625ab948 admin admin] SCRIPT_NAME: `/identity` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:00:22.685111 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0591ddbe-ac1b-4ed8-bc19-f06b625ab948 admin admin] PATH_INFO: `/v3/projects/4d82ac0477fc44baaf14cb6b3af5ceb1/users/2226fddf31f241cb9027b44960b237fa/roles/3618ab638a65401f82333da7596d1daf` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:00:22.720277 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0591ddbe-ac1b-4ed8-bc19-f06b625ab948 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4d82ac0477fc44baaf14cb6b3af5ceb1, user_id=2226fddf31f241cb9027b44960b237fa, role_id=3618ab638a65401f82333da7596d1daf)` {{(pid=82025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 20:00:22.743580 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0591ddbe-ac1b-4ed8-bc19-f06b625ab948 admin admin] RBAC: Authorization granted {{(pid=82025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 20:00:22.852873 dv-cinder-828806-6-smb devstack@keystone.service[82025]: [pid: 82025|app: 0|req: 836/1659] 10.222.0.33 () {60 vars in 1483 bytes} [Tue Sep 13 20:00:22 2022] PUT /identity/v3/projects/4d82ac0477fc44baaf14cb6b3af5ceb1/users/2226fddf31f241cb9027b44960b237fa/roles/3618ab638a65401f82333da7596d1daf => generated 0 bytes in 195 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 20:00:22.868898 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bc8f3a0-4000-42ec-9bc7-522dc72dbfd4 None None] REQUEST_METHOD: `POST` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:00:22.868898 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bc8f3a0-4000-42ec-9bc7-522dc72dbfd4 None None] SCRIPT_NAME: `/identity` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:00:22.868898 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bc8f3a0-4000-42ec-9bc7-522dc72dbfd4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:00:23.045560 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.auth.core [None req-2bc8f3a0-4000-42ec-9bc7-522dc72dbfd4 None None] MFA Rules not processed for user `2226fddf31f241cb9027b44960b237fa`. Rule list: `[]` (Enabled: `True`). {{(pid=82026) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 20:00:23.045560 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.common.fernet_utils [None req-2bc8f3a0-4000-42ec-9bc7-522dc72dbfd4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82026) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 20:00:23.189436 dv-cinder-828806-6-smb devstack@keystone.service[82026]: [pid: 82026|app: 0|req: 824/1660] 10.222.0.33 () {58 vars in 958 bytes} [Tue Sep 13 20:00:22 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 323 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 20:00:23.196695 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0591ddbe-ac1b-4ed8-bc19-f06b625ab948 admin admin] Authenticating user token {{(pid=82025) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 20:00:23.373486 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG dbcounter [-] [82026] Writing DB stats keystone:SELECT=89,keystone:DELETE=7,keystone:INSERT=4 {{(pid=82026) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 20:00:23.541366 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0591ddbe-ac1b-4ed8-bc19-f06b625ab948 admin admin] Validating token access rules against request {{(pid=82025) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 20:00:23.558788 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a280c7d7-26da-43a9-aeb7-995ebbd5b877 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57539b6a6f3b4d589f5f5e1d211cd6a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b454f707d20347ada3d82aa85495635e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82025) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 20:00:23.560871 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a280c7d7-26da-43a9-aeb7-995ebbd5b877 admin admin] REQUEST_METHOD: `POST` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:00:23.561504 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a280c7d7-26da-43a9-aeb7-995ebbd5b877 admin admin] SCRIPT_NAME: `/identity` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:00:23.562104 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a280c7d7-26da-43a9-aeb7-995ebbd5b877 admin admin] PATH_INFO: `/v3/projects` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:00:23.563413 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a280c7d7-26da-43a9-aeb7-995ebbd5b877 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 20:00:23.566652 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a280c7d7-26da-43a9-aeb7-995ebbd5b877 admin admin] RBAC: Authorization granted {{(pid=82025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 20:00:23.710731 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bc8f3a0-4000-42ec-9bc7-522dc72dbfd4 None None] Authenticating user token {{(pid=82026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 20:00:23.712431 dv-cinder-828806-6-smb devstack@keystone.service[82025]: [pid: 82025|app: 0|req: 837/1661] 10.222.0.33 () {60 vars in 1153 bytes} [Tue Sep 13 20:00:23 2022] POST /identity/v3/projects => generated 371 bytes in 518 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 13 20:00:23.734857 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bc8f3a0-4000-42ec-9bc7-522dc72dbfd4 None None] Validating token access rules against request {{(pid=82026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 20:00:23.913352 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5957a9c-6ef8-4937-bbcd-eee688685914 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57539b6a6f3b4d589f5f5e1d211cd6a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b454f707d20347ada3d82aa85495635e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 20:00:23.914001 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5957a9c-6ef8-4937-bbcd-eee688685914 admin admin] REQUEST_METHOD: `POST` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:00:23.914288 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5957a9c-6ef8-4937-bbcd-eee688685914 admin admin] SCRIPT_NAME: `/identity` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:00:23.914641 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5957a9c-6ef8-4937-bbcd-eee688685914 admin admin] PATH_INFO: `/v3/users` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:00:23.915357 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5957a9c-6ef8-4937-bbcd-eee688685914 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 20:00:23.918923 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5957a9c-6ef8-4937-bbcd-eee688685914 admin admin] RBAC: Authorization granted {{(pid=82026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 20:00:24.046702 dv-cinder-828806-6-smb devstack@keystone.service[82026]: [pid: 82026|app: 0|req: 825/1662] 10.222.0.33 () {60 vars in 1144 bytes} [Tue Sep 13 20:00:23 2022] POST /identity/v3/users => generated 292 bytes in 337 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 13 20:00:24.050800 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a280c7d7-26da-43a9-aeb7-995ebbd5b877 admin admin] Authenticating user token {{(pid=82025) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 20:00:24.081555 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a280c7d7-26da-43a9-aeb7-995ebbd5b877 admin admin] Validating token access rules against request {{(pid=82025) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 20:00:24.094914 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4461a5ed-fddf-47d4-a306-bd244a974c3d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57539b6a6f3b4d589f5f5e1d211cd6a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b454f707d20347ada3d82aa85495635e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82025) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 20:00:24.096302 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4461a5ed-fddf-47d4-a306-bd244a974c3d admin admin] REQUEST_METHOD: `GET` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:00:24.098411 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4461a5ed-fddf-47d4-a306-bd244a974c3d admin admin] SCRIPT_NAME: `/identity` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:00:24.099183 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4461a5ed-fddf-47d4-a306-bd244a974c3d admin admin] PATH_INFO: `/v3/roles` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:00:24.101352 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4461a5ed-fddf-47d4-a306-bd244a974c3d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 20:00:24.103903 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4461a5ed-fddf-47d4-a306-bd244a974c3d admin admin] RBAC: Authorization granted {{(pid=82025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 20:00:24.159998 dv-cinder-828806-6-smb devstack@keystone.service[82025]: [pid: 82025|app: 0|req: 838/1663] 10.222.0.33 () {58 vars in 1122 bytes} [Tue Sep 13 20:00:24 2022] GET /identity/v3/roles => generated 1420 bytes in 107 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 13 20:00:24.161307 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5957a9c-6ef8-4937-bbcd-eee688685914 admin admin] Authenticating user token {{(pid=82026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 20:00:24.183936 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5957a9c-6ef8-4937-bbcd-eee688685914 admin admin] Validating token access rules against request {{(pid=82026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 20:00:24.194836 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e89e391-4634-439c-b6cd-ca0eacf114e3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57539b6a6f3b4d589f5f5e1d211cd6a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b454f707d20347ada3d82aa85495635e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 20:00:24.195568 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e89e391-4634-439c-b6cd-ca0eacf114e3 admin admin] REQUEST_METHOD: `PUT` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:00:24.195859 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e89e391-4634-439c-b6cd-ca0eacf114e3 admin admin] SCRIPT_NAME: `/identity` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:00:24.196546 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e89e391-4634-439c-b6cd-ca0eacf114e3 admin admin] PATH_INFO: `/v3/projects/63b88918c0784d36b08a0c58c5ac46eb/users/5bb6510faaab445e8b70834d65ea2941/roles/e5af7d5baa93469e9e486ef21c85474e` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:00:24.247204 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e89e391-4634-439c-b6cd-ca0eacf114e3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=63b88918c0784d36b08a0c58c5ac46eb, user_id=5bb6510faaab445e8b70834d65ea2941, role_id=e5af7d5baa93469e9e486ef21c85474e)` {{(pid=82026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 20:00:24.249952 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e89e391-4634-439c-b6cd-ca0eacf114e3 admin admin] RBAC: Authorization granted {{(pid=82026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 20:00:24.363836 dv-cinder-828806-6-smb devstack@keystone.service[82026]: [pid: 82026|app: 0|req: 826/1664] 10.222.0.33 () {60 vars in 1483 bytes} [Tue Sep 13 20:00:24 2022] PUT /identity/v3/projects/63b88918c0784d36b08a0c58c5ac46eb/users/5bb6510faaab445e8b70834d65ea2941/roles/e5af7d5baa93469e9e486ef21c85474e => generated 0 bytes in 203 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 13 20:00:24.367755 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4461a5ed-fddf-47d4-a306-bd244a974c3d admin admin] Authenticating user token {{(pid=82025) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 20:00:24.389418 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4461a5ed-fddf-47d4-a306-bd244a974c3d admin admin] Validating token access rules against request {{(pid=82025) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 20:00:24.426543 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e89e391-4634-439c-b6cd-ca0eacf114e3 admin admin] Authenticating user token {{(pid=82026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 20:00:24.430768 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.common.fernet_utils [None req-4e89e391-4634-439c-b6cd-ca0eacf114e3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82026) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 20:00:24.616669 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbbf79cb-e1d6-420d-928c-2bb8fba27f3d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57539b6a6f3b4d589f5f5e1d211cd6a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b454f707d20347ada3d82aa85495635e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82025) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 20:00:24.618597 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbbf79cb-e1d6-420d-928c-2bb8fba27f3d admin admin] REQUEST_METHOD: `GET` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:00:24.619736 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbbf79cb-e1d6-420d-928c-2bb8fba27f3d admin admin] SCRIPT_NAME: `/identity` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:00:24.620275 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbbf79cb-e1d6-420d-928c-2bb8fba27f3d admin admin] PATH_INFO: `/v3/roles` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:00:24.621350 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbbf79cb-e1d6-420d-928c-2bb8fba27f3d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 20:00:24.625864 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbbf79cb-e1d6-420d-928c-2bb8fba27f3d admin admin] RBAC: Authorization granted {{(pid=82025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 20:00:24.646167 dv-cinder-828806-6-smb devstack@keystone.service[82025]: [pid: 82025|app: 0|req: 839/1665] 10.222.0.33 () {58 vars in 1122 bytes} [Tue Sep 13 20:00:24 2022] GET /identity/v3/roles => generated 1420 bytes in 279 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 13 20:00:24.655495 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbbf79cb-e1d6-420d-928c-2bb8fba27f3d admin admin] Authenticating user token {{(pid=82025) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 20:00:24.660041 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e89e391-4634-439c-b6cd-ca0eacf114e3 admin admin] Validating token access rules against request {{(pid=82026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 20:00:24.690527 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29bd18fe-cdf1-4b35-9428-b381ce21fdb8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57539b6a6f3b4d589f5f5e1d211cd6a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b454f707d20347ada3d82aa85495635e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 20:00:24.694063 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29bd18fe-cdf1-4b35-9428-b381ce21fdb8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:00:24.694750 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29bd18fe-cdf1-4b35-9428-b381ce21fdb8 admin admin] SCRIPT_NAME: `/identity` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:00:24.697981 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29bd18fe-cdf1-4b35-9428-b381ce21fdb8 admin admin] PATH_INFO: `/v3/projects/96e946d1fbe24044ae9f9656b050ce31` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:00:24.702254 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29bd18fe-cdf1-4b35-9428-b381ce21fdb8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=96e946d1fbe24044ae9f9656b050ce31)` {{(pid=82026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 20:00:24.712435 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29bd18fe-cdf1-4b35-9428-b381ce21fdb8 admin admin] RBAC: Authorization granted {{(pid=82026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 20:00:24.715361 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbbf79cb-e1d6-420d-928c-2bb8fba27f3d admin admin] Validating token access rules against request {{(pid=82025) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 20:00:24.769826 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10d595aa-adad-460a-9ad6-cee44a215f34 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57539b6a6f3b4d589f5f5e1d211cd6a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b454f707d20347ada3d82aa85495635e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82025) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 20:00:24.775248 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10d595aa-adad-460a-9ad6-cee44a215f34 admin admin] REQUEST_METHOD: `PUT` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:00:24.775907 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10d595aa-adad-460a-9ad6-cee44a215f34 admin admin] SCRIPT_NAME: `/identity` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:00:24.779196 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10d595aa-adad-460a-9ad6-cee44a215f34 admin admin] PATH_INFO: `/v3/projects/63b88918c0784d36b08a0c58c5ac46eb/users/5bb6510faaab445e8b70834d65ea2941/roles/e5af7d5baa93469e9e486ef21c85474e` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:00:24.786593 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10d595aa-adad-460a-9ad6-cee44a215f34 admin admin] RBAC: Authorizing `identity:create_grant(project_id=63b88918c0784d36b08a0c58c5ac46eb, user_id=5bb6510faaab445e8b70834d65ea2941, role_id=e5af7d5baa93469e9e486ef21c85474e)` {{(pid=82025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 20:00:24.794404 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10d595aa-adad-460a-9ad6-cee44a215f34 admin admin] RBAC: Authorization granted {{(pid=82025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 20:00:24.839363 dv-cinder-828806-6-smb devstack@keystone.service[82025]: [pid: 82025|app: 0|req: 840/1666] 10.222.0.33 () {60 vars in 1483 bytes} [Tue Sep 13 20:00:24 2022] PUT /identity/v3/projects/63b88918c0784d36b08a0c58c5ac46eb/users/5bb6510faaab445e8b70834d65ea2941/roles/e5af7d5baa93469e9e486ef21c85474e => generated 0 bytes in 179 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 20:00:24.841539 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4277d094-97dc-400b-a86c-f9a52767422b None None] REQUEST_METHOD: `POST` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:00:24.841900 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4277d094-97dc-400b-a86c-f9a52767422b None None] SCRIPT_NAME: `/identity` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:00:24.842254 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4277d094-97dc-400b-a86c-f9a52767422b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:00:24.924121 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.notifications [None req-29bd18fe-cdf1-4b35-9428-b381ce21fdb8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '96e946d1fbe24044ae9f9656b050ce31', 'request_id': 'req-29bd18fe-cdf1-4b35-9428-b381ce21fdb8'} {{(pid=82026) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 20:00:24.930449 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.auth.core [None req-4277d094-97dc-400b-a86c-f9a52767422b None None] MFA Rules not processed for user `5bb6510faaab445e8b70834d65ea2941`. Rule list: `[]` (Enabled: `True`). {{(pid=82025) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 20:00:24.931822 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.fernet_utils [None req-4277d094-97dc-400b-a86c-f9a52767422b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82025) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 20:00:24.960564 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG dbcounter [-] [82025] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=82025) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 20:00:25.001791 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.notifications [None req-29bd18fe-cdf1-4b35-9428-b381ce21fdb8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '96e946d1fbe24044ae9f9656b050ce31', 'request_id': 'req-29bd18fe-cdf1-4b35-9428-b381ce21fdb8'} {{(pid=82026) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 20:00:25.016716 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.notifications [None req-29bd18fe-cdf1-4b35-9428-b381ce21fdb8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '96e946d1fbe24044ae9f9656b050ce31', 'request_id': 'req-29bd18fe-cdf1-4b35-9428-b381ce21fdb8'} {{(pid=82026) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 20:00:25.060527 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.notifications [None req-29bd18fe-cdf1-4b35-9428-b381ce21fdb8 admin admin] The token cache is being invalidate because project 96e946d1fbe24044ae9f9656b050ce31 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82026) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 13 20:00:25.061203 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.notifications [None req-29bd18fe-cdf1-4b35-9428-b381ce21fdb8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82026) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 20:00:25.064321 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.notifications [None req-29bd18fe-cdf1-4b35-9428-b381ce21fdb8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82026) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 20:00:25.072582 dv-cinder-828806-6-smb devstack@keystone.service[82026]: [pid: 82026|app: 0|req: 827/1667] 10.222.0.33 () {58 vars in 1233 bytes} [Tue Sep 13 20:00:24 2022] DELETE /identity/v3/projects/96e946d1fbe24044ae9f9656b050ce31 => generated 0 bytes in 647 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 20:00:25.077109 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29bd18fe-cdf1-4b35-9428-b381ce21fdb8 admin admin] Authenticating user token {{(pid=82026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 20:00:25.079016 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.common.fernet_utils [None req-29bd18fe-cdf1-4b35-9428-b381ce21fdb8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82026) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 20:00:25.160440 dv-cinder-828806-6-smb devstack@keystone.service[82025]: [pid: 82025|app: 0|req: 841/1668] 10.222.0.33 () {58 vars in 958 bytes} [Tue Sep 13 20:00:24 2022] POST /identity/v3/auth/tokens => generated 3315 bytes in 316 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 13 20:00:25.171734 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4277d094-97dc-400b-a86c-f9a52767422b None None] Authenticating user token {{(pid=82025) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 20:00:25.174711 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.fernet_utils [None req-4277d094-97dc-400b-a86c-f9a52767422b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82025) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 20:00:25.243019 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29bd18fe-cdf1-4b35-9428-b381ce21fdb8 admin admin] Validating token access rules against request {{(pid=82026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 20:00:25.261855 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33722b66-bbe6-45ac-a178-ee7b5abf2eef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57539b6a6f3b4d589f5f5e1d211cd6a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b454f707d20347ada3d82aa85495635e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 20:00:25.261855 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33722b66-bbe6-45ac-a178-ee7b5abf2eef admin admin] REQUEST_METHOD: `DELETE` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:00:25.261855 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33722b66-bbe6-45ac-a178-ee7b5abf2eef admin admin] SCRIPT_NAME: `/identity` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:00:25.261855 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33722b66-bbe6-45ac-a178-ee7b5abf2eef admin admin] PATH_INFO: `/v3/users/b303a67d568c40638e8ef1b148225310` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:00:25.262305 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33722b66-bbe6-45ac-a178-ee7b5abf2eef admin admin] RBAC: Authorizing `identity:delete_user(user_id=b303a67d568c40638e8ef1b148225310)` {{(pid=82026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 20:00:25.267075 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33722b66-bbe6-45ac-a178-ee7b5abf2eef admin admin] RBAC: Authorization granted {{(pid=82026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 20:00:25.302376 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4277d094-97dc-400b-a86c-f9a52767422b None None] Validating token access rules against request {{(pid=82025) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 20:00:25.314947 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab713aa1-c798-478d-9ba4-af2f31f11288 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46024fc6167f4321818b1bed27a521a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8c6fba0f15b4d6a84ff601919b7b8e4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82025) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 20:00:25.315709 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab713aa1-c798-478d-9ba4-af2f31f11288 service cinder] REQUEST_METHOD: `GET` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:00:25.316131 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab713aa1-c798-478d-9ba4-af2f31f11288 service cinder] SCRIPT_NAME: `/identity` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:00:25.316549 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab713aa1-c798-478d-9ba4-af2f31f11288 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:00:25.332366 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab713aa1-c798-478d-9ba4-af2f31f11288 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=82025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 20:00:25.338482 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab713aa1-c798-478d-9ba4-af2f31f11288 service cinder] RBAC: Authorization granted {{(pid=82025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 20:00:25.351943 dv-cinder-828806-6-smb devstack@keystone.service[82025]: [pid: 82025|app: 0|req: 842/1669] 10.222.0.33 () {60 vars in 1365 bytes} [Tue Sep 13 20:00:25 2022] GET /identity/v3/auth/tokens => generated 3315 bytes in 181 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 20:00:25.436975 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG dbcounter [-] [82026] Writing DB stats keystone:SELECT=93,keystone:INSERT=4,keystone:DELETE=3 {{(pid=82026) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 20:00:25.578066 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.notifications [None req-33722b66-bbe6-45ac-a178-ee7b5abf2eef admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b303a67d568c40638e8ef1b148225310'} {{(pid=82026) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 20:00:25.687727 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.notifications [None req-33722b66-bbe6-45ac-a178-ee7b5abf2eef admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b303a67d568c40638e8ef1b148225310'} {{(pid=82026) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 20:00:25.716108 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.notifications [None req-33722b66-bbe6-45ac-a178-ee7b5abf2eef admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b303a67d568c40638e8ef1b148225310'} {{(pid=82026) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 20:00:25.716893 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.notifications [None req-33722b66-bbe6-45ac-a178-ee7b5abf2eef admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b303a67d568c40638e8ef1b148225310'} {{(pid=82026) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 20:00:25.733882 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.notifications [None req-33722b66-bbe6-45ac-a178-ee7b5abf2eef admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b303a67d568c40638e8ef1b148225310'} {{(pid=82026) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 20:00:25.774872 dv-cinder-828806-6-smb devstack@keystone.service[82026]: [pid: 82026|app: 0|req: 828/1670] 10.222.0.33 () {58 vars in 1224 bytes} [Tue Sep 13 20:00:25 2022] DELETE /identity/v3/users/b303a67d568c40638e8ef1b148225310 => generated 0 bytes in 695 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 13 20:00:25.863545 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab713aa1-c798-478d-9ba4-af2f31f11288 service cinder] Authenticating user token {{(pid=82025) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 20:00:25.865924 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.fernet_utils [None req-ab713aa1-c798-478d-9ba4-af2f31f11288 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82025) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 20:00:25.895151 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab713aa1-c798-478d-9ba4-af2f31f11288 service cinder] Validating token access rules against request {{(pid=82025) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 20:00:26.030722 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6852ed11-6e9a-4b57-8801-c6b40e5b6e01 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46024fc6167f4321818b1bed27a521a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8c6fba0f15b4d6a84ff601919b7b8e4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82025) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 20:00:26.031374 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6852ed11-6e9a-4b57-8801-c6b40e5b6e01 service cinder] REQUEST_METHOD: `GET` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:00:26.031849 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6852ed11-6e9a-4b57-8801-c6b40e5b6e01 service cinder] SCRIPT_NAME: `/identity` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:00:26.032286 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6852ed11-6e9a-4b57-8801-c6b40e5b6e01 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:00:26.048714 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.fernet_utils [None req-6852ed11-6e9a-4b57-8801-c6b40e5b6e01 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82025) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 20:00:26.052437 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33722b66-bbe6-45ac-a178-ee7b5abf2eef admin admin] Authenticating user token {{(pid=82026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 20:00:26.054653 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.common.fernet_utils [None req-33722b66-bbe6-45ac-a178-ee7b5abf2eef admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82026) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 20:00:26.190771 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33722b66-bbe6-45ac-a178-ee7b5abf2eef admin admin] Validating token access rules against request {{(pid=82026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 20:00:26.201184 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-561cfb78-d8a7-49df-91b9-638aba239629 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57539b6a6f3b4d589f5f5e1d211cd6a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b454f707d20347ada3d82aa85495635e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 20:00:26.203175 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-561cfb78-d8a7-49df-91b9-638aba239629 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:00:26.203358 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-561cfb78-d8a7-49df-91b9-638aba239629 admin admin] SCRIPT_NAME: `/identity` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:00:26.204602 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-561cfb78-d8a7-49df-91b9-638aba239629 admin admin] PATH_INFO: `/v3/users/f48da2d6429c41fab04088325a2c232f` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:00:26.208345 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-561cfb78-d8a7-49df-91b9-638aba239629 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f48da2d6429c41fab04088325a2c232f)` {{(pid=82026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 20:00:26.214732 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-561cfb78-d8a7-49df-91b9-638aba239629 admin admin] RBAC: Authorization granted {{(pid=82026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 20:00:26.247020 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6852ed11-6e9a-4b57-8801-c6b40e5b6e01 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=82025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 20:00:26.248655 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6852ed11-6e9a-4b57-8801-c6b40e5b6e01 service cinder] RBAC: Authorization granted {{(pid=82025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 20:00:26.267818 dv-cinder-828806-6-smb devstack@keystone.service[82025]: [pid: 82025|app: 0|req: 843/1671] 10.222.0.33 () {60 vars in 1365 bytes} [Tue Sep 13 20:00:25 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 405 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 20:00:26.583573 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.notifications [None req-561cfb78-d8a7-49df-91b9-638aba239629 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f48da2d6429c41fab04088325a2c232f'} {{(pid=82026) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 20:00:26.608147 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-297f096a-5588-45c6-8052-fbcb37dcb208 None None] REQUEST_METHOD: `POST` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:00:26.608587 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-297f096a-5588-45c6-8052-fbcb37dcb208 None None] SCRIPT_NAME: `/identity` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:00:26.609099 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-297f096a-5588-45c6-8052-fbcb37dcb208 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:00:26.656026 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG dbcounter [-] [82025] Writing DB stats keystone:SELECT=100 {{(pid=82025) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 20:00:26.669882 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.auth.core [None req-297f096a-5588-45c6-8052-fbcb37dcb208 None None] MFA Rules not processed for user `c505119ab65747088a20a55280862330`. Rule list: `[]` (Enabled: `True`). {{(pid=82025) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 20:00:26.672071 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.fernet_utils [None req-297f096a-5588-45c6-8052-fbcb37dcb208 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82025) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 20:00:26.710473 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.notifications [None req-561cfb78-d8a7-49df-91b9-638aba239629 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f48da2d6429c41fab04088325a2c232f'} {{(pid=82026) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 20:00:26.738457 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.notifications [None req-561cfb78-d8a7-49df-91b9-638aba239629 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f48da2d6429c41fab04088325a2c232f'} {{(pid=82026) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 20:00:26.739943 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.notifications [None req-561cfb78-d8a7-49df-91b9-638aba239629 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f48da2d6429c41fab04088325a2c232f'} {{(pid=82026) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 20:00:26.777367 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.notifications [None req-561cfb78-d8a7-49df-91b9-638aba239629 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f48da2d6429c41fab04088325a2c232f'} {{(pid=82026) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 20:00:26.801728 dv-cinder-828806-6-smb devstack@keystone.service[82026]: [pid: 82026|app: 0|req: 829/1672] 10.222.0.33 () {58 vars in 1224 bytes} [Tue Sep 13 20:00:26 2022] DELETE /identity/v3/users/f48da2d6429c41fab04088325a2c232f => generated 0 bytes in 750 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 13 20:00:26.806416 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-386eeee8-0a8f-4733-b553-3154169d44a5 None None] REQUEST_METHOD: `POST` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:00:26.806705 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-386eeee8-0a8f-4733-b553-3154169d44a5 None None] SCRIPT_NAME: `/identity` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:00:26.806991 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-386eeee8-0a8f-4733-b553-3154169d44a5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:00:26.829982 dv-cinder-828806-6-smb devstack@keystone.service[82025]: [pid: 82025|app: 0|req: 844/1673] 10.222.0.33 () {58 vars in 958 bytes} [Tue Sep 13 20:00:26 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 213 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 20:00:26.833304 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb6eef0e-b657-4733-a7fd-9b949ad22416 None None] REQUEST_METHOD: `POST` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:00:26.833304 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb6eef0e-b657-4733-a7fd-9b949ad22416 None None] SCRIPT_NAME: `/identity` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:00:26.833509 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb6eef0e-b657-4733-a7fd-9b949ad22416 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:00:26.859875 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.auth.core [None req-386eeee8-0a8f-4733-b553-3154169d44a5 None None] MFA Rules not processed for user `57539b6a6f3b4d589f5f5e1d211cd6a0`. Rule list: `[]` (Enabled: `True`). {{(pid=82026) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 20:00:26.863503 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.common.fernet_utils [None req-386eeee8-0a8f-4733-b553-3154169d44a5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82026) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 20:00:26.895743 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.auth.core [None req-bb6eef0e-b657-4733-a7fd-9b949ad22416 None None] MFA Rules not processed for user `c505119ab65747088a20a55280862330`. Rule list: `[]` (Enabled: `True`). {{(pid=82025) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 20:00:26.900533 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.fernet_utils [None req-bb6eef0e-b657-4733-a7fd-9b949ad22416 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82025) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 20:00:27.085827 dv-cinder-828806-6-smb devstack@keystone.service[82026]: [pid: 82026|app: 0|req: 830/1674] 10.222.0.33 () {58 vars in 958 bytes} [Tue Sep 13 20:00:26 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 280 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 13 20:00:27.087800 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-386eeee8-0a8f-4733-b553-3154169d44a5 None None] Authenticating user token {{(pid=82026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 20:00:27.096680 dv-cinder-828806-6-smb devstack@keystone.service[82025]: [pid: 82025|app: 0|req: 845/1675] 10.222.0.33 () {58 vars in 958 bytes} [Tue Sep 13 20:00:26 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 259 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 13 20:00:27.097555 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.common.fernet_utils [None req-386eeee8-0a8f-4733-b553-3154169d44a5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82026) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 20:00:27.097635 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb6eef0e-b657-4733-a7fd-9b949ad22416 None None] Authenticating user token {{(pid=82025) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 20:00:27.101784 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.fernet_utils [None req-bb6eef0e-b657-4733-a7fd-9b949ad22416 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82025) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 20:00:27.140466 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-386eeee8-0a8f-4733-b553-3154169d44a5 None None] Validating token access rules against request {{(pid=82026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 20:00:27.152783 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08b4726c-2075-4ac3-8325-6da2feee34ae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57539b6a6f3b4d589f5f5e1d211cd6a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b454f707d20347ada3d82aa85495635e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 20:00:27.153444 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08b4726c-2075-4ac3-8325-6da2feee34ae admin admin] REQUEST_METHOD: `DELETE` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:00:27.153730 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08b4726c-2075-4ac3-8325-6da2feee34ae admin admin] SCRIPT_NAME: `/identity` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:00:27.154011 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08b4726c-2075-4ac3-8325-6da2feee34ae admin admin] PATH_INFO: `/v3/projects/af222842abec4ab79850e79a7b4ccd4b` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:00:27.157189 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08b4726c-2075-4ac3-8325-6da2feee34ae admin admin] RBAC: Authorizing `identity:delete_project(project_id=af222842abec4ab79850e79a7b4ccd4b)` {{(pid=82026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 20:00:27.159161 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08b4726c-2075-4ac3-8325-6da2feee34ae admin admin] RBAC: Authorization granted {{(pid=82026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 20:00:27.238779 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb6eef0e-b657-4733-a7fd-9b949ad22416 None None] Validating token access rules against request {{(pid=82025) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 20:00:27.257129 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41686d47-2c73-437d-8ae5-34d5d2948d59 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '023a2c79c2444611b3d431928e56685d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8c6fba0f15b4d6a84ff601919b7b8e4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82025) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 20:00:27.258151 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41686d47-2c73-437d-8ae5-34d5d2948d59 service neutron] REQUEST_METHOD: `GET` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:00:27.258797 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41686d47-2c73-437d-8ae5-34d5d2948d59 service neutron] SCRIPT_NAME: `/identity` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:00:27.259279 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41686d47-2c73-437d-8ae5-34d5d2948d59 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:00:27.272563 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41686d47-2c73-437d-8ae5-34d5d2948d59 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 20:00:27.274629 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41686d47-2c73-437d-8ae5-34d5d2948d59 service neutron] RBAC: Authorization granted {{(pid=82025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 20:00:27.285864 dv-cinder-828806-6-smb devstack@keystone.service[82025]: [pid: 82025|app: 0|req: 846/1676] 10.222.0.33 () {60 vars in 1365 bytes} [Tue Sep 13 20:00:27 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 190 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 13 20:00:27.286800 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41686d47-2c73-437d-8ae5-34d5d2948d59 service neutron] Authenticating user token {{(pid=82025) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 20:00:27.288257 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.fernet_utils [None req-41686d47-2c73-437d-8ae5-34d5d2948d59 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82025) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 20:00:27.429477 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.notifications [None req-08b4726c-2075-4ac3-8325-6da2feee34ae admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'af222842abec4ab79850e79a7b4ccd4b', 'request_id': 'req-08b4726c-2075-4ac3-8325-6da2feee34ae'} {{(pid=82026) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 20:00:27.506335 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG dbcounter [-] [82025] Writing DB stats keystone:SELECT=100 {{(pid=82025) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 20:00:27.525018 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.notifications [None req-08b4726c-2075-4ac3-8325-6da2feee34ae admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'af222842abec4ab79850e79a7b4ccd4b', 'request_id': 'req-08b4726c-2075-4ac3-8325-6da2feee34ae'} {{(pid=82026) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 20:00:27.531449 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41686d47-2c73-437d-8ae5-34d5d2948d59 service neutron] Validating token access rules against request {{(pid=82025) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 20:00:27.543773 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.notifications [None req-08b4726c-2075-4ac3-8325-6da2feee34ae admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'af222842abec4ab79850e79a7b4ccd4b', 'request_id': 'req-08b4726c-2075-4ac3-8325-6da2feee34ae'} {{(pid=82026) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 20:00:27.565533 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.notifications [None req-08b4726c-2075-4ac3-8325-6da2feee34ae admin admin] The token cache is being invalidate because project af222842abec4ab79850e79a7b4ccd4b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82026) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 13 20:00:27.566410 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.notifications [None req-08b4726c-2075-4ac3-8325-6da2feee34ae admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82026) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 20:00:27.567448 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.notifications [None req-08b4726c-2075-4ac3-8325-6da2feee34ae admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82026) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 20:00:27.571088 dv-cinder-828806-6-smb devstack@keystone.service[82026]: [pid: 82026|app: 0|req: 831/1677] 10.222.0.33 () {58 vars in 1233 bytes} [Tue Sep 13 20:00:27 2022] DELETE /identity/v3/projects/af222842abec4ab79850e79a7b4ccd4b => generated 0 bytes in 485 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 20:00:27.574548 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f7c3bc6-0bb9-4cb5-960b-a8f13a06a545 None None] REQUEST_METHOD: `POST` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:00:27.575422 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f7c3bc6-0bb9-4cb5-960b-a8f13a06a545 None None] SCRIPT_NAME: `/identity` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:00:27.575998 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f7c3bc6-0bb9-4cb5-960b-a8f13a06a545 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:00:27.621081 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.auth.core [None req-3f7c3bc6-0bb9-4cb5-960b-a8f13a06a545 None None] MFA Rules not processed for user `abe7dd30d59f41b19efde48cc035aa4f`. Rule list: `[]` (Enabled: `True`). {{(pid=82026) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 20:00:27.622575 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.common.fernet_utils [None req-3f7c3bc6-0bb9-4cb5-960b-a8f13a06a545 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82026) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 20:00:27.731112 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64bc4102-1a04-489b-a172-d11f5d784af5 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e66e7034abed4e0bad1f4137520c1e70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8c6fba0f15b4d6a84ff601919b7b8e4', 'project_domain_id': 'default', 'roles': ['service', 'member', 'reader', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82025) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 20:00:27.731763 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64bc4102-1a04-489b-a172-d11f5d784af5 service nova] REQUEST_METHOD: `GET` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:00:27.733075 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64bc4102-1a04-489b-a172-d11f5d784af5 service nova] SCRIPT_NAME: `/identity` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:00:27.733199 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64bc4102-1a04-489b-a172-d11f5d784af5 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:00:27.736496 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.fernet_utils [None req-64bc4102-1a04-489b-a172-d11f5d784af5 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82025) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 20:00:27.744834 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG dbcounter [-] [82026] Writing DB stats keystone:DELETE=14,keystone:SELECT=84,keystone:INSERT=2 {{(pid=82026) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 20:00:27.833553 dv-cinder-828806-6-smb devstack@keystone.service[82026]: [pid: 82026|app: 0|req: 832/1678] 10.222.0.33 () {58 vars in 958 bytes} [Tue Sep 13 20:00:27 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 254 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 20:00:27.833553 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a3417f6-4f74-4064-ad52-4f2e3c2668f2 None None] REQUEST_METHOD: `POST` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:00:27.833553 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a3417f6-4f74-4064-ad52-4f2e3c2668f2 None None] SCRIPT_NAME: `/identity` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:00:27.833553 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a3417f6-4f74-4064-ad52-4f2e3c2668f2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:00:27.877663 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.auth.core [None req-0a3417f6-4f74-4064-ad52-4f2e3c2668f2 None None] MFA Rules not processed for user `57539b6a6f3b4d589f5f5e1d211cd6a0`. Rule list: `[]` (Enabled: `True`). {{(pid=82026) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 20:00:27.882077 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.common.fernet_utils [None req-0a3417f6-4f74-4064-ad52-4f2e3c2668f2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82026) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 20:00:27.894791 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64bc4102-1a04-489b-a172-d11f5d784af5 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 20:00:27.899775 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64bc4102-1a04-489b-a172-d11f5d784af5 service nova] RBAC: Authorization granted {{(pid=82025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 20:00:27.940939 dv-cinder-828806-6-smb devstack@keystone.service[82025]: [pid: 82025|app: 0|req: 847/1679] 10.222.0.33 () {60 vars in 1365 bytes} [Tue Sep 13 20:00:27 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 654 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 20:00:27.943593 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64bc4102-1a04-489b-a172-d11f5d784af5 service nova] Authenticating user token {{(pid=82025) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 20:00:27.947150 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.fernet_utils [None req-64bc4102-1a04-489b-a172-d11f5d784af5 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82025) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 20:00:28.018432 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64bc4102-1a04-489b-a172-d11f5d784af5 service nova] Validating token access rules against request {{(pid=82025) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 20:00:28.056206 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09b13f5c-7abe-4e3f-a6e3-6f43320a97eb service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e66e7034abed4e0bad1f4137520c1e70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8c6fba0f15b4d6a84ff601919b7b8e4', 'project_domain_id': 'default', 'roles': ['service', 'member', 'reader', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82025) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 20:00:28.057885 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09b13f5c-7abe-4e3f-a6e3-6f43320a97eb service nova] REQUEST_METHOD: `GET` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:00:28.058177 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09b13f5c-7abe-4e3f-a6e3-6f43320a97eb service nova] SCRIPT_NAME: `/identity` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:00:28.058455 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09b13f5c-7abe-4e3f-a6e3-6f43320a97eb service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:00:28.086270 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09b13f5c-7abe-4e3f-a6e3-6f43320a97eb service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 20:00:28.091432 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09b13f5c-7abe-4e3f-a6e3-6f43320a97eb service nova] RBAC: Authorization granted {{(pid=82025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 20:00:28.134203 dv-cinder-828806-6-smb devstack@keystone.service[82025]: [pid: 82025|app: 0|req: 848/1680] 10.222.0.33 () {60 vars in 1365 bytes} [Tue Sep 13 20:00:27 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 193 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 20:00:28.146818 dv-cinder-828806-6-smb devstack@keystone.service[82026]: [pid: 82026|app: 0|req: 833/1681] 10.222.0.33 () {58 vars in 958 bytes} [Tue Sep 13 20:00:27 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 319 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 20:00:28.158364 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7416a7e-5ef8-4a34-a258-d71c5cd8c2a3 None None] REQUEST_METHOD: `POST` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:00:28.158659 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7416a7e-5ef8-4a34-a258-d71c5cd8c2a3 None None] SCRIPT_NAME: `/identity` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:00:28.158940 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7416a7e-5ef8-4a34-a258-d71c5cd8c2a3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:00:28.210555 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a3417f6-4f74-4064-ad52-4f2e3c2668f2 None None] Authenticating user token {{(pid=82026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 20:00:28.214603 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.common.fernet_utils [None req-0a3417f6-4f74-4064-ad52-4f2e3c2668f2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82026) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 20:00:28.301026 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a3417f6-4f74-4064-ad52-4f2e3c2668f2 None None] Validating token access rules against request {{(pid=82026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 20:00:28.310113 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f57fc3fc-30ba-44e5-9817-406f31e42762 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57539b6a6f3b4d589f5f5e1d211cd6a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b454f707d20347ada3d82aa85495635e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 20:00:28.310999 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f57fc3fc-30ba-44e5-9817-406f31e42762 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:00:28.312474 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f57fc3fc-30ba-44e5-9817-406f31e42762 admin admin] SCRIPT_NAME: `/identity` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:00:28.313326 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f57fc3fc-30ba-44e5-9817-406f31e42762 admin admin] PATH_INFO: `/v3/projects/f013c72c3cbf4cc6969706788045ca68` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:00:28.318456 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f57fc3fc-30ba-44e5-9817-406f31e42762 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f013c72c3cbf4cc6969706788045ca68)` {{(pid=82026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 20:00:28.320184 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.auth.core [None req-f7416a7e-5ef8-4a34-a258-d71c5cd8c2a3 None None] MFA Rules not processed for user `57539b6a6f3b4d589f5f5e1d211cd6a0`. Rule list: `[]` (Enabled: `True`). {{(pid=82025) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 20:00:28.322328 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.fernet_utils [None req-f7416a7e-5ef8-4a34-a258-d71c5cd8c2a3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82025) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 20:00:28.323252 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f57fc3fc-30ba-44e5-9817-406f31e42762 admin admin] RBAC: Authorization granted {{(pid=82026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 20:00:28.343435 dv-cinder-828806-6-smb devstack@keystone.service[82025]: [pid: 82025|app: 0|req: 849/1682] 10.222.0.33 () {58 vars in 958 bytes} [Tue Sep 13 20:00:28 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 186 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 20:00:28.359235 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7416a7e-5ef8-4a34-a258-d71c5cd8c2a3 None None] Authenticating user token {{(pid=82025) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 20:00:28.401902 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7416a7e-5ef8-4a34-a258-d71c5cd8c2a3 None None] Validating token access rules against request {{(pid=82025) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 20:00:28.430735 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cba86079-48f4-40f5-a67a-fd7120d20439 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57539b6a6f3b4d589f5f5e1d211cd6a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b454f707d20347ada3d82aa85495635e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82025) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 20:00:28.433498 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cba86079-48f4-40f5-a67a-fd7120d20439 admin admin] REQUEST_METHOD: `GET` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:00:28.433980 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cba86079-48f4-40f5-a67a-fd7120d20439 admin admin] SCRIPT_NAME: `/identity` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:00:28.434492 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cba86079-48f4-40f5-a67a-fd7120d20439 admin admin] PATH_INFO: `/v3/domains` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:00:28.444956 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cba86079-48f4-40f5-a67a-fd7120d20439 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82025) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 20:00:28.444956 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cba86079-48f4-40f5-a67a-fd7120d20439 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 20:00:28.447103 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cba86079-48f4-40f5-a67a-fd7120d20439 admin admin] RBAC: Authorization granted {{(pid=82025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 20:00:28.500626 dv-cinder-828806-6-smb devstack@keystone.service[82025]: [pid: 82025|app: 0|req: 850/1683] 10.222.0.33 () {58 vars in 1153 bytes} [Tue Sep 13 20:00:28 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 20:00:28.509488 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cba86079-48f4-40f5-a67a-fd7120d20439 admin admin] Authenticating user token {{(pid=82025) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 20:00:28.542589 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cba86079-48f4-40f5-a67a-fd7120d20439 admin admin] Validating token access rules against request {{(pid=82025) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 20:00:28.543983 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.notifications [None req-f57fc3fc-30ba-44e5-9817-406f31e42762 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f013c72c3cbf4cc6969706788045ca68', 'request_id': 'req-f57fc3fc-30ba-44e5-9817-406f31e42762'} {{(pid=82026) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 20:00:28.967980 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG dbcounter [-] [82025] Writing DB stats keystone:SELECT=100 {{(pid=82025) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 20:00:28.967980 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1147c9f7-f1b4-4a0a-bdae-e06a1e9c7ffa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57539b6a6f3b4d589f5f5e1d211cd6a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b454f707d20347ada3d82aa85495635e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82025) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 20:00:28.967980 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1147c9f7-f1b4-4a0a-bdae-e06a1e9c7ffa admin admin] REQUEST_METHOD: `POST` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:00:28.967980 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1147c9f7-f1b4-4a0a-bdae-e06a1e9c7ffa admin admin] SCRIPT_NAME: `/identity` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:00:28.972470 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1147c9f7-f1b4-4a0a-bdae-e06a1e9c7ffa admin admin] PATH_INFO: `/v3/projects` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:00:28.972470 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1147c9f7-f1b4-4a0a-bdae-e06a1e9c7ffa admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 20:00:28.972470 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1147c9f7-f1b4-4a0a-bdae-e06a1e9c7ffa admin admin] RBAC: Authorization granted {{(pid=82025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 20:00:29.008845 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.notifications [None req-f57fc3fc-30ba-44e5-9817-406f31e42762 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f013c72c3cbf4cc6969706788045ca68', 'request_id': 'req-f57fc3fc-30ba-44e5-9817-406f31e42762'} {{(pid=82026) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 20:00:29.008845 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.notifications [None req-f57fc3fc-30ba-44e5-9817-406f31e42762 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f013c72c3cbf4cc6969706788045ca68', 'request_id': 'req-f57fc3fc-30ba-44e5-9817-406f31e42762'} {{(pid=82026) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 20:00:29.023238 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.notifications [None req-f57fc3fc-30ba-44e5-9817-406f31e42762 admin admin] The token cache is being invalidate because project f013c72c3cbf4cc6969706788045ca68 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82026) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 13 20:00:29.023594 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.notifications [None req-f57fc3fc-30ba-44e5-9817-406f31e42762 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82026) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 20:00:29.025404 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.notifications [None req-f57fc3fc-30ba-44e5-9817-406f31e42762 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82026) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 20:00:29.033283 dv-cinder-828806-6-smb devstack@keystone.service[82026]: [pid: 82026|app: 0|req: 834/1684] 10.222.0.33 () {58 vars in 1233 bytes} [Tue Sep 13 20:00:28 2022] DELETE /identity/v3/projects/f013c72c3cbf4cc6969706788045ca68 => generated 0 bytes in 820 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 20:00:29.035014 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a201c60d-5f62-4c22-b5cd-0f367b610414 None None] REQUEST_METHOD: `POST` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:00:29.035335 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a201c60d-5f62-4c22-b5cd-0f367b610414 None None] SCRIPT_NAME: `/identity` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:00:29.035621 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a201c60d-5f62-4c22-b5cd-0f367b610414 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:00:29.117465 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.auth.core [None req-a201c60d-5f62-4c22-b5cd-0f367b610414 None None] MFA Rules not processed for user `57539b6a6f3b4d589f5f5e1d211cd6a0`. Rule list: `[]` (Enabled: `True`). {{(pid=82026) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 20:00:29.121015 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.common.fernet_utils [None req-a201c60d-5f62-4c22-b5cd-0f367b610414 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82026) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 20:00:29.151755 dv-cinder-828806-6-smb devstack@keystone.service[82026]: [pid: 82026|app: 0|req: 835/1685] 10.222.0.33 () {58 vars in 958 bytes} [Tue Sep 13 20:00:29 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 20:00:29.154668 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a785c551-b7b2-424f-9c3c-373065cb805c None None] REQUEST_METHOD: `GET` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:00:29.157671 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a785c551-b7b2-424f-9c3c-373065cb805c None None] SCRIPT_NAME: `/identity` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:00:29.161294 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a785c551-b7b2-424f-9c3c-373065cb805c None None] PATH_INFO: `/` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:00:29.167070 dv-cinder-828806-6-smb devstack@keystone.service[82026]: [pid: 82026|app: 0|req: 836/1686] 10.222.0.33 () {54 vars in 912 bytes} [Tue Sep 13 20:00:29 2022] GET /identity => generated 270 bytes in 14 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 20:00:29.170790 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be560da7-2507-45f3-a78e-04b78c8c0763 None None] REQUEST_METHOD: `POST` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:00:29.173870 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be560da7-2507-45f3-a78e-04b78c8c0763 None None] SCRIPT_NAME: `/identity` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:00:29.175327 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be560da7-2507-45f3-a78e-04b78c8c0763 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:00:29.210416 dv-cinder-828806-6-smb devstack@keystone.service[82025]: [pid: 82025|app: 0|req: 851/1687] 10.222.0.33 () {60 vars in 1153 bytes} [Tue Sep 13 20:00:28 2022] POST /identity/v3/projects => generated 355 bytes in 709 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 13 20:00:29.214345 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06b4c83c-7fb8-4827-b85d-590227181a47 None None] REQUEST_METHOD: `POST` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:00:29.215192 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.auth.core [None req-be560da7-2507-45f3-a78e-04b78c8c0763 None None] MFA Rules not processed for user `57539b6a6f3b4d589f5f5e1d211cd6a0`. Rule list: `[]` (Enabled: `True`). {{(pid=82026) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 20:00:29.215484 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06b4c83c-7fb8-4827-b85d-590227181a47 None None] SCRIPT_NAME: `/identity` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:00:29.215768 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06b4c83c-7fb8-4827-b85d-590227181a47 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:00:29.242666 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.common.fernet_utils [None req-be560da7-2507-45f3-a78e-04b78c8c0763 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82026) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 20:00:29.336221 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.auth.core [None req-06b4c83c-7fb8-4827-b85d-590227181a47 None None] MFA Rules not processed for user `023a2c79c2444611b3d431928e56685d`. Rule list: `[]` (Enabled: `True`). {{(pid=82025) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 20:00:29.337818 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.fernet_utils [None req-06b4c83c-7fb8-4827-b85d-590227181a47 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82025) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 20:00:29.487609 dv-cinder-828806-6-smb devstack@keystone.service[82026]: [pid: 82026|app: 0|req: 837/1688] 10.222.0.33 () {58 vars in 958 bytes} [Tue Sep 13 20:00:29 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 317 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 20:00:29.492472 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be560da7-2507-45f3-a78e-04b78c8c0763 None None] Authenticating user token {{(pid=82026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 20:00:29.492472 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.common.fernet_utils [None req-be560da7-2507-45f3-a78e-04b78c8c0763 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82026) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 20:00:29.505260 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be560da7-2507-45f3-a78e-04b78c8c0763 None None] Validating token access rules against request {{(pid=82026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 20:00:29.512458 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5626b66b-2220-45dc-a9d8-3fd3b6124244 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57539b6a6f3b4d589f5f5e1d211cd6a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b454f707d20347ada3d82aa85495635e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 20:00:29.513300 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5626b66b-2220-45dc-a9d8-3fd3b6124244 admin admin] REQUEST_METHOD: `POST` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:00:29.513868 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5626b66b-2220-45dc-a9d8-3fd3b6124244 admin admin] SCRIPT_NAME: `/identity` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:00:29.514284 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5626b66b-2220-45dc-a9d8-3fd3b6124244 admin admin] PATH_INFO: `/v3/users` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:00:29.515322 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5626b66b-2220-45dc-a9d8-3fd3b6124244 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 20:00:29.517803 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5626b66b-2220-45dc-a9d8-3fd3b6124244 admin admin] RBAC: Authorization granted {{(pid=82026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 20:00:29.530589 dv-cinder-828806-6-smb devstack@keystone.service[82025]: [pid: 82025|app: 0|req: 852/1689] 10.222.0.33 () {58 vars in 1009 bytes} [Tue Sep 13 20:00:29 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 319 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 20:00:29.532054 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06b4c83c-7fb8-4827-b85d-590227181a47 None None] Authenticating user token {{(pid=82025) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 20:00:29.560763 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06b4c83c-7fb8-4827-b85d-590227181a47 None None] Validating token access rules against request {{(pid=82025) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 20:00:29.574818 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b271ce1f-bd1a-49da-a477-645771e5271c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57539b6a6f3b4d589f5f5e1d211cd6a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b454f707d20347ada3d82aa85495635e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82025) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 20:00:29.575843 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b271ce1f-bd1a-49da-a477-645771e5271c admin admin] REQUEST_METHOD: `GET` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:00:29.576609 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b271ce1f-bd1a-49da-a477-645771e5271c admin admin] SCRIPT_NAME: `/identity` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:00:29.576897 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b271ce1f-bd1a-49da-a477-645771e5271c admin admin] PATH_INFO: `/v3/domains` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:00:29.577825 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b271ce1f-bd1a-49da-a477-645771e5271c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82025) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 20:00:29.577953 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b271ce1f-bd1a-49da-a477-645771e5271c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 20:00:29.579575 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b271ce1f-bd1a-49da-a477-645771e5271c admin admin] RBAC: Authorization granted {{(pid=82025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 20:00:29.594505 dv-cinder-828806-6-smb devstack@keystone.service[82025]: [pid: 82025|app: 0|req: 853/1690] 10.222.0.33 () {58 vars in 1153 bytes} [Tue Sep 13 20:00:29 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 63 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 20:00:29.595289 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b271ce1f-bd1a-49da-a477-645771e5271c admin admin] Authenticating user token {{(pid=82025) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 20:00:29.597147 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.fernet_utils [None req-b271ce1f-bd1a-49da-a477-645771e5271c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82025) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 20:00:29.618189 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b271ce1f-bd1a-49da-a477-645771e5271c admin admin] Validating token access rules against request {{(pid=82025) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 20:00:29.626544 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df8fefb9-3b87-4f9f-adb9-f4d6eef384a3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '023a2c79c2444611b3d431928e56685d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8c6fba0f15b4d6a84ff601919b7b8e4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82025) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 20:00:29.627301 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df8fefb9-3b87-4f9f-adb9-f4d6eef384a3 service neutron] REQUEST_METHOD: `GET` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:00:29.627301 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df8fefb9-3b87-4f9f-adb9-f4d6eef384a3 service neutron] SCRIPT_NAME: `/identity` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:00:29.631632 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df8fefb9-3b87-4f9f-adb9-f4d6eef384a3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:00:29.638782 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df8fefb9-3b87-4f9f-adb9-f4d6eef384a3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 20:00:29.641954 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df8fefb9-3b87-4f9f-adb9-f4d6eef384a3 service neutron] RBAC: Authorization granted {{(pid=82025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 20:00:29.660133 dv-cinder-828806-6-smb devstack@keystone.service[82026]: [pid: 82026|app: 0|req: 838/1691] 10.222.0.33 () {60 vars in 1144 bytes} [Tue Sep 13 20:00:29 2022] POST /identity/v3/users => generated 278 bytes in 172 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 13 20:00:29.661572 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5626b66b-2220-45dc-a9d8-3fd3b6124244 admin admin] Authenticating user token {{(pid=82026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 20:00:29.673098 dv-cinder-828806-6-smb devstack@keystone.service[82025]: [pid: 82025|app: 0|req: 854/1692] 10.222.0.33 () {60 vars in 1365 bytes} [Tue Sep 13 20:00:29 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 78 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 20:00:29.674120 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df8fefb9-3b87-4f9f-adb9-f4d6eef384a3 service neutron] Authenticating user token {{(pid=82025) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 20:00:29.675695 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5626b66b-2220-45dc-a9d8-3fd3b6124244 admin admin] Validating token access rules against request {{(pid=82026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 20:00:29.694194 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df8fefb9-3b87-4f9f-adb9-f4d6eef384a3 service neutron] Validating token access rules against request {{(pid=82025) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 20:00:29.698588 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a113283-3d5f-4103-9463-e93cd4e77201 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57539b6a6f3b4d589f5f5e1d211cd6a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b454f707d20347ada3d82aa85495635e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82025) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 20:00:29.700046 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09f408c3-9b32-4e77-ad18-00b123087375 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57539b6a6f3b4d589f5f5e1d211cd6a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b454f707d20347ada3d82aa85495635e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 20:00:29.700947 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09f408c3-9b32-4e77-ad18-00b123087375 admin admin] REQUEST_METHOD: `POST` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:00:29.701227 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09f408c3-9b32-4e77-ad18-00b123087375 admin admin] SCRIPT_NAME: `/identity` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:00:29.701500 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09f408c3-9b32-4e77-ad18-00b123087375 admin admin] PATH_INFO: `/v3/projects` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:00:29.703416 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09f408c3-9b32-4e77-ad18-00b123087375 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 20:00:29.705802 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09f408c3-9b32-4e77-ad18-00b123087375 admin admin] RBAC: Authorization granted {{(pid=82026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 20:00:29.706268 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a113283-3d5f-4103-9463-e93cd4e77201 admin admin] REQUEST_METHOD: `GET` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:00:29.706725 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a113283-3d5f-4103-9463-e93cd4e77201 admin admin] SCRIPT_NAME: `/identity` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:00:29.707222 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a113283-3d5f-4103-9463-e93cd4e77201 admin admin] PATH_INFO: `/v3/roles` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:00:29.708080 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a113283-3d5f-4103-9463-e93cd4e77201 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 20:00:29.709930 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a113283-3d5f-4103-9463-e93cd4e77201 admin admin] RBAC: Authorization granted {{(pid=82025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 20:00:29.727464 dv-cinder-828806-6-smb devstack@keystone.service[82025]: [pid: 82025|app: 0|req: 855/1693] 10.222.0.33 () {58 vars in 1122 bytes} [Tue Sep 13 20:00:29 2022] GET /identity/v3/roles => generated 1420 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 13 20:00:29.731082 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a113283-3d5f-4103-9463-e93cd4e77201 admin admin] Authenticating user token {{(pid=82025) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 20:00:29.743838 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a113283-3d5f-4103-9463-e93cd4e77201 admin admin] Validating token access rules against request {{(pid=82025) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 20:00:29.764766 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c823852f-bd6b-4d86-8136-c0c49fc2d334 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57539b6a6f3b4d589f5f5e1d211cd6a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b454f707d20347ada3d82aa85495635e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82025) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 20:00:29.764766 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c823852f-bd6b-4d86-8136-c0c49fc2d334 admin admin] REQUEST_METHOD: `GET` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:00:29.764766 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c823852f-bd6b-4d86-8136-c0c49fc2d334 admin admin] SCRIPT_NAME: `/identity` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:00:29.764766 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c823852f-bd6b-4d86-8136-c0c49fc2d334 admin admin] PATH_INFO: `/v3/roles` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:00:29.765612 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c823852f-bd6b-4d86-8136-c0c49fc2d334 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 20:00:29.768014 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c823852f-bd6b-4d86-8136-c0c49fc2d334 admin admin] RBAC: Authorization granted {{(pid=82025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 20:00:29.783305 dv-cinder-828806-6-smb devstack@keystone.service[82025]: [pid: 82025|app: 0|req: 856/1694] 10.222.0.33 () {58 vars in 1122 bytes} [Tue Sep 13 20:00:29 2022] GET /identity/v3/roles => generated 1420 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 13 20:00:29.784840 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c823852f-bd6b-4d86-8136-c0c49fc2d334 admin admin] Authenticating user token {{(pid=82025) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 20:00:29.824726 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c823852f-bd6b-4d86-8136-c0c49fc2d334 admin admin] Validating token access rules against request {{(pid=82025) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 20:00:29.847980 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85768446-b079-41af-9fb2-15ddd75a9198 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57539b6a6f3b4d589f5f5e1d211cd6a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b454f707d20347ada3d82aa85495635e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82025) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 20:00:29.848697 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85768446-b079-41af-9fb2-15ddd75a9198 admin admin] REQUEST_METHOD: `PUT` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:00:29.848983 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85768446-b079-41af-9fb2-15ddd75a9198 admin admin] SCRIPT_NAME: `/identity` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:00:29.849263 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85768446-b079-41af-9fb2-15ddd75a9198 admin admin] PATH_INFO: `/v3/projects/81998043727d4c6ea53e2fae4f4b4eab/users/2bc4c5d9c1a54c218702bf0feba6419d/roles/3618ab638a65401f82333da7596d1daf` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:00:29.876568 dv-cinder-828806-6-smb devstack@keystone.service[82026]: [pid: 82026|app: 0|req: 839/1695] 10.222.0.33 () {60 vars in 1153 bytes} [Tue Sep 13 20:00:29 2022] POST /identity/v3/projects => generated 403 bytes in 216 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 13 20:00:29.880669 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09f408c3-9b32-4e77-ad18-00b123087375 admin admin] Authenticating user token {{(pid=82026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 20:00:29.904050 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85768446-b079-41af-9fb2-15ddd75a9198 admin admin] RBAC: Authorizing `identity:create_grant(project_id=81998043727d4c6ea53e2fae4f4b4eab, user_id=2bc4c5d9c1a54c218702bf0feba6419d, role_id=3618ab638a65401f82333da7596d1daf)` {{(pid=82025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 20:00:29.906753 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85768446-b079-41af-9fb2-15ddd75a9198 admin admin] RBAC: Authorization granted {{(pid=82025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 20:00:30.053854 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09f408c3-9b32-4e77-ad18-00b123087375 admin admin] Validating token access rules against request {{(pid=82026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 20:00:30.076351 dv-cinder-828806-6-smb devstack@keystone.service[82025]: [pid: 82025|app: 0|req: 857/1696] 10.222.0.33 () {60 vars in 1483 bytes} [Tue Sep 13 20:00:29 2022] PUT /identity/v3/projects/81998043727d4c6ea53e2fae4f4b4eab/users/2bc4c5d9c1a54c218702bf0feba6419d/roles/3618ab638a65401f82333da7596d1daf => generated 0 bytes in 292 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 20:00:30.088897 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b06edfaa-56b8-4809-a146-08dd477fae16 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57539b6a6f3b4d589f5f5e1d211cd6a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b454f707d20347ada3d82aa85495635e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 20:00:30.090844 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b06edfaa-56b8-4809-a146-08dd477fae16 admin admin] REQUEST_METHOD: `POST` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:00:30.091169 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b06edfaa-56b8-4809-a146-08dd477fae16 admin admin] SCRIPT_NAME: `/identity` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:00:30.093042 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de3188ed-cf04-4c62-9c24-329a516c128f None None] REQUEST_METHOD: `POST` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:00:30.093330 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de3188ed-cf04-4c62-9c24-329a516c128f None None] SCRIPT_NAME: `/identity` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:00:30.093815 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de3188ed-cf04-4c62-9c24-329a516c128f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:00:30.098540 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b06edfaa-56b8-4809-a146-08dd477fae16 admin admin] PATH_INFO: `/v3/users` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:00:30.104404 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b06edfaa-56b8-4809-a146-08dd477fae16 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 20:00:30.106456 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b06edfaa-56b8-4809-a146-08dd477fae16 admin admin] RBAC: Authorization granted {{(pid=82026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 20:00:30.192774 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.auth.core [None req-de3188ed-cf04-4c62-9c24-329a516c128f None None] MFA Rules not processed for user `2bc4c5d9c1a54c218702bf0feba6419d`. Rule list: `[]` (Enabled: `True`). {{(pid=82025) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 20:00:30.202082 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.fernet_utils [None req-de3188ed-cf04-4c62-9c24-329a516c128f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82025) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 20:00:30.295133 dv-cinder-828806-6-smb devstack@keystone.service[82026]: [pid: 82026|app: 0|req: 840/1697] 10.222.0.33 () {60 vars in 1144 bytes} [Tue Sep 13 20:00:29 2022] POST /identity/v3/users => generated 302 bytes in 415 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 13 20:00:30.300042 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b06edfaa-56b8-4809-a146-08dd477fae16 admin admin] Authenticating user token {{(pid=82026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 20:00:30.323949 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b06edfaa-56b8-4809-a146-08dd477fae16 admin admin] Validating token access rules against request {{(pid=82026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 20:00:30.368696 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG dbcounter [-] [82025] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=82025) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 20:00:30.369079 dv-cinder-828806-6-smb devstack@keystone.service[82025]: [pid: 82025|app: 0|req: 858/1698] 10.222.0.33 () {58 vars in 958 bytes} [Tue Sep 13 20:00:30 2022] POST /identity/v3/auth/tokens => generated 3232 bytes in 277 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 13 20:00:30.382642 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de3188ed-cf04-4c62-9c24-329a516c128f None None] Authenticating user token {{(pid=82025) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 20:00:30.464991 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0cd8b18-9125-4899-8f8d-083307a49dee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57539b6a6f3b4d589f5f5e1d211cd6a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b454f707d20347ada3d82aa85495635e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 20:00:30.465712 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0cd8b18-9125-4899-8f8d-083307a49dee admin admin] REQUEST_METHOD: `GET` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:00:30.466001 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0cd8b18-9125-4899-8f8d-083307a49dee admin admin] SCRIPT_NAME: `/identity` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:00:30.466280 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0cd8b18-9125-4899-8f8d-083307a49dee admin admin] PATH_INFO: `/v3/roles` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:00:30.468119 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0cd8b18-9125-4899-8f8d-083307a49dee admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 20:00:30.473375 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0cd8b18-9125-4899-8f8d-083307a49dee admin admin] RBAC: Authorization granted {{(pid=82026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 20:00:30.519623 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de3188ed-cf04-4c62-9c24-329a516c128f None None] Validating token access rules against request {{(pid=82025) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 20:00:30.524695 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b026f499-0886-4688-a602-bd530225face admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57539b6a6f3b4d589f5f5e1d211cd6a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b454f707d20347ada3d82aa85495635e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82025) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 20:00:30.525414 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b026f499-0886-4688-a602-bd530225face admin admin] REQUEST_METHOD: `POST` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:00:30.525705 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b026f499-0886-4688-a602-bd530225face admin admin] SCRIPT_NAME: `/identity` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:00:30.525991 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b026f499-0886-4688-a602-bd530225face admin admin] PATH_INFO: `/v3/projects` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:00:30.526651 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b026f499-0886-4688-a602-bd530225face admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 20:00:30.529024 dv-cinder-828806-6-smb devstack@keystone.service[82026]: [pid: 82026|app: 0|req: 841/1699] 10.222.0.33 () {58 vars in 1122 bytes} [Tue Sep 13 20:00:30 2022] GET /identity/v3/roles => generated 1420 bytes in 230 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 13 20:00:30.532979 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0cd8b18-9125-4899-8f8d-083307a49dee admin admin] Authenticating user token {{(pid=82026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 20:00:30.542191 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b026f499-0886-4688-a602-bd530225face admin admin] RBAC: Authorization granted {{(pid=82025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 20:00:30.565121 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0cd8b18-9125-4899-8f8d-083307a49dee admin admin] Validating token access rules against request {{(pid=82026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 20:00:30.589040 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4847bdbf-8b25-47d8-8d0a-f33ce8a6c8fb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57539b6a6f3b4d589f5f5e1d211cd6a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b454f707d20347ada3d82aa85495635e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 20:00:30.590292 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4847bdbf-8b25-47d8-8d0a-f33ce8a6c8fb admin admin] REQUEST_METHOD: `GET` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:00:30.590589 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4847bdbf-8b25-47d8-8d0a-f33ce8a6c8fb admin admin] SCRIPT_NAME: `/identity` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:00:30.590869 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4847bdbf-8b25-47d8-8d0a-f33ce8a6c8fb admin admin] PATH_INFO: `/v3/roles` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:00:30.591614 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4847bdbf-8b25-47d8-8d0a-f33ce8a6c8fb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 20:00:30.605820 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4847bdbf-8b25-47d8-8d0a-f33ce8a6c8fb admin admin] RBAC: Authorization granted {{(pid=82026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 20:00:30.670712 dv-cinder-828806-6-smb devstack@keystone.service[82026]: [pid: 82026|app: 0|req: 842/1700] 10.222.0.33 () {58 vars in 1122 bytes} [Tue Sep 13 20:00:30 2022] GET /identity/v3/roles => generated 1420 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 13 20:00:30.673533 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4847bdbf-8b25-47d8-8d0a-f33ce8a6c8fb admin admin] Authenticating user token {{(pid=82026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 20:00:30.703376 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4847bdbf-8b25-47d8-8d0a-f33ce8a6c8fb admin admin] Validating token access rules against request {{(pid=82026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 20:00:30.714026 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91881d8d-cdd9-4499-a222-dc28b8bfc24c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57539b6a6f3b4d589f5f5e1d211cd6a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b454f707d20347ada3d82aa85495635e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 20:00:30.714815 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91881d8d-cdd9-4499-a222-dc28b8bfc24c admin admin] REQUEST_METHOD: `PUT` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:00:30.716021 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91881d8d-cdd9-4499-a222-dc28b8bfc24c admin admin] SCRIPT_NAME: `/identity` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:00:30.716544 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91881d8d-cdd9-4499-a222-dc28b8bfc24c admin admin] PATH_INFO: `/v3/projects/aed69eae14d54740bf597847ea8535f1/users/83dd14b10cb14d7da167a41d452b8446/roles/3618ab638a65401f82333da7596d1daf` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:00:30.745521 dv-cinder-828806-6-smb devstack@keystone.service[82025]: [pid: 82025|app: 0|req: 859/1701] 10.222.0.33 () {60 vars in 1153 bytes} [Tue Sep 13 20:00:30 2022] POST /identity/v3/projects => generated 357 bytes in 376 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 13 20:00:30.747198 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f53c2d3-5681-435c-aeee-39a45d873b64 None None] REQUEST_METHOD: `POST` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:00:30.747198 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f53c2d3-5681-435c-aeee-39a45d873b64 None None] SCRIPT_NAME: `/identity` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:00:30.750241 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f53c2d3-5681-435c-aeee-39a45d873b64 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:00:30.781130 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91881d8d-cdd9-4499-a222-dc28b8bfc24c admin admin] RBAC: Authorizing `identity:create_grant(project_id=aed69eae14d54740bf597847ea8535f1, user_id=83dd14b10cb14d7da167a41d452b8446, role_id=3618ab638a65401f82333da7596d1daf)` {{(pid=82026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 20:00:30.789491 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91881d8d-cdd9-4499-a222-dc28b8bfc24c admin admin] RBAC: Authorization granted {{(pid=82026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 20:00:30.813163 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.auth.core [None req-0f53c2d3-5681-435c-aeee-39a45d873b64 None None] MFA Rules not processed for user `8853527498a24a6c80c169929f9f48bc`. Rule list: `[]` (Enabled: `True`). {{(pid=82025) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 20:00:30.814805 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.fernet_utils [None req-0f53c2d3-5681-435c-aeee-39a45d873b64 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82025) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 20:00:30.899274 dv-cinder-828806-6-smb devstack@keystone.service[82026]: [pid: 82026|app: 0|req: 843/1702] 10.222.0.33 () {60 vars in 1483 bytes} [Tue Sep 13 20:00:30 2022] PUT /identity/v3/projects/aed69eae14d54740bf597847ea8535f1/users/83dd14b10cb14d7da167a41d452b8446/roles/3618ab638a65401f82333da7596d1daf => generated 0 bytes in 217 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 13 20:00:30.899274 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91881d8d-cdd9-4499-a222-dc28b8bfc24c admin admin] Authenticating user token {{(pid=82026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 20:00:30.934040 dv-cinder-828806-6-smb devstack@keystone.service[82025]: [pid: 82025|app: 0|req: 860/1703] 10.222.0.33 () {58 vars in 958 bytes} [Tue Sep 13 20:00:30 2022] POST /identity/v3/auth/tokens => generated 3268 bytes in 188 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 20:00:30.934935 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f53c2d3-5681-435c-aeee-39a45d873b64 None None] Authenticating user token {{(pid=82025) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 20:00:30.936314 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.fernet_utils [None req-0f53c2d3-5681-435c-aeee-39a45d873b64 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82025) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 20:00:31.004940 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91881d8d-cdd9-4499-a222-dc28b8bfc24c admin admin] Validating token access rules against request {{(pid=82026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 20:00:31.010487 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e78dff9-9fb1-47e7-8db6-61744b453cb9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57539b6a6f3b4d589f5f5e1d211cd6a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b454f707d20347ada3d82aa85495635e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 20:00:31.016245 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e78dff9-9fb1-47e7-8db6-61744b453cb9 admin admin] REQUEST_METHOD: `POST` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:00:31.016245 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e78dff9-9fb1-47e7-8db6-61744b453cb9 admin admin] SCRIPT_NAME: `/identity` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:00:31.016245 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e78dff9-9fb1-47e7-8db6-61744b453cb9 admin admin] PATH_INFO: `/v3/users` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:00:31.016245 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e78dff9-9fb1-47e7-8db6-61744b453cb9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 20:00:31.016245 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e78dff9-9fb1-47e7-8db6-61744b453cb9 admin admin] RBAC: Authorization granted {{(pid=82026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 20:00:31.027130 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f53c2d3-5681-435c-aeee-39a45d873b64 None None] Validating token access rules against request {{(pid=82025) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 20:00:31.157403 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a6d31a1-34b2-43f0-8182-1322a7f3a40b service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '060ea3dea2134429967c164bd158b272', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8c6fba0f15b4d6a84ff601919b7b8e4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82025) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 20:00:31.158129 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a6d31a1-34b2-43f0-8182-1322a7f3a40b service placement] REQUEST_METHOD: `GET` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:00:31.158425 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a6d31a1-34b2-43f0-8182-1322a7f3a40b service placement] SCRIPT_NAME: `/identity` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:00:31.158815 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a6d31a1-34b2-43f0-8182-1322a7f3a40b service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:00:31.161937 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.fernet_utils [None req-9a6d31a1-34b2-43f0-8182-1322a7f3a40b service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82025) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 20:00:31.181493 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a6d31a1-34b2-43f0-8182-1322a7f3a40b service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=82025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 20:00:31.181493 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a6d31a1-34b2-43f0-8182-1322a7f3a40b service placement] RBAC: Authorization granted {{(pid=82025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 20:00:31.185925 dv-cinder-828806-6-smb devstack@keystone.service[82026]: [pid: 82026|app: 0|req: 844/1704] 10.222.0.33 () {60 vars in 1144 bytes} [Tue Sep 13 20:00:30 2022] POST /identity/v3/users => generated 285 bytes in 293 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 13 20:00:31.188671 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70abf412-a683-4c68-b377-67857635ae46 None None] REQUEST_METHOD: `POST` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:00:31.189069 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70abf412-a683-4c68-b377-67857635ae46 None None] SCRIPT_NAME: `/identity` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:00:31.191266 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70abf412-a683-4c68-b377-67857635ae46 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:00:31.202162 dv-cinder-828806-6-smb devstack@keystone.service[82025]: [pid: 82025|app: 0|req: 861/1705] 10.222.0.33 () {60 vars in 1365 bytes} [Tue Sep 13 20:00:30 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 267 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 20:00:31.203780 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b25366c1-8dbf-474c-96e6-879be28170c4 None None] REQUEST_METHOD: `POST` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:00:31.204077 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b25366c1-8dbf-474c-96e6-879be28170c4 None None] SCRIPT_NAME: `/identity` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:00:31.204358 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b25366c1-8dbf-474c-96e6-879be28170c4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:00:31.258116 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.auth.core [None req-b25366c1-8dbf-474c-96e6-879be28170c4 None None] MFA Rules not processed for user `8853527498a24a6c80c169929f9f48bc`. Rule list: `[]` (Enabled: `True`). {{(pid=82025) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 20:00:31.259026 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.auth.core [None req-70abf412-a683-4c68-b377-67857635ae46 None None] MFA Rules not processed for user `83dd14b10cb14d7da167a41d452b8446`. Rule list: `[]` (Enabled: `True`). {{(pid=82026) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 20:00:31.259935 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.fernet_utils [None req-b25366c1-8dbf-474c-96e6-879be28170c4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82025) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 20:00:31.262393 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.common.fernet_utils [None req-70abf412-a683-4c68-b377-67857635ae46 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82026) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 20:00:31.452253 dv-cinder-828806-6-smb devstack@keystone.service[82025]: [pid: 82025|app: 0|req: 862/1706] 10.222.0.33 () {58 vars in 958 bytes} [Tue Sep 13 20:00:31 2022] POST /identity/v3/auth/tokens => generated 3268 bytes in 249 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 20:00:31.456129 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b25366c1-8dbf-474c-96e6-879be28170c4 None None] Authenticating user token {{(pid=82025) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 20:00:31.482033 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b25366c1-8dbf-474c-96e6-879be28170c4 None None] Validating token access rules against request {{(pid=82025) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 20:00:31.497092 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8055e9d9-b75a-4fe1-8a3c-d4771afadaef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57539b6a6f3b4d589f5f5e1d211cd6a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b454f707d20347ada3d82aa85495635e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82025) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 20:00:31.497961 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8055e9d9-b75a-4fe1-8a3c-d4771afadaef admin admin] REQUEST_METHOD: `GET` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:00:31.498396 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8055e9d9-b75a-4fe1-8a3c-d4771afadaef admin admin] SCRIPT_NAME: `/identity` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:00:31.499386 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8055e9d9-b75a-4fe1-8a3c-d4771afadaef admin admin] PATH_INFO: `/v3/roles` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:00:31.500230 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8055e9d9-b75a-4fe1-8a3c-d4771afadaef admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 20:00:31.502798 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8055e9d9-b75a-4fe1-8a3c-d4771afadaef admin admin] RBAC: Authorization granted {{(pid=82025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 20:00:31.506774 dv-cinder-828806-6-smb devstack@keystone.service[82026]: [pid: 82026|app: 0|req: 845/1707] 10.222.0.33 () {58 vars in 958 bytes} [Tue Sep 13 20:00:31 2022] POST /identity/v3/auth/tokens => generated 3280 bytes in 319 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 20:00:31.508113 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70abf412-a683-4c68-b377-67857635ae46 None None] Authenticating user token {{(pid=82026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 20:00:31.514979 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.common.fernet_utils [None req-70abf412-a683-4c68-b377-67857635ae46 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82026) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 20:00:31.538966 dv-cinder-828806-6-smb devstack@keystone.service[82025]: [pid: 82025|app: 0|req: 863/1708] 10.222.0.33 () {58 vars in 1122 bytes} [Tue Sep 13 20:00:31 2022] GET /identity/v3/roles => generated 1420 bytes in 85 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 13 20:00:31.539934 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8055e9d9-b75a-4fe1-8a3c-d4771afadaef admin admin] Authenticating user token {{(pid=82025) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 20:00:31.567243 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8055e9d9-b75a-4fe1-8a3c-d4771afadaef admin admin] Validating token access rules against request {{(pid=82025) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 20:00:31.582483 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8ce8906-8122-4987-b265-0e3153986bd4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57539b6a6f3b4d589f5f5e1d211cd6a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b454f707d20347ada3d82aa85495635e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82025) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 20:00:31.585460 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8ce8906-8122-4987-b265-0e3153986bd4 admin admin] REQUEST_METHOD: `POST` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:00:31.585460 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8ce8906-8122-4987-b265-0e3153986bd4 admin admin] SCRIPT_NAME: `/identity` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:00:31.585460 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8ce8906-8122-4987-b265-0e3153986bd4 admin admin] PATH_INFO: `/v3/projects` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:00:31.585460 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8ce8906-8122-4987-b265-0e3153986bd4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 20:00:31.585786 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8ce8906-8122-4987-b265-0e3153986bd4 admin admin] RBAC: Authorization granted {{(pid=82025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 20:00:31.638390 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70abf412-a683-4c68-b377-67857635ae46 None None] Validating token access rules against request {{(pid=82026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 20:00:31.657761 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f9c5d60-30f2-4d7f-91ee-eee7479d0195 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e66e7034abed4e0bad1f4137520c1e70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8c6fba0f15b4d6a84ff601919b7b8e4', 'project_domain_id': 'default', 'roles': ['service', 'member', 'reader', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 20:00:31.660867 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f9c5d60-30f2-4d7f-91ee-eee7479d0195 service nova] REQUEST_METHOD: `GET` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:00:31.661259 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f9c5d60-30f2-4d7f-91ee-eee7479d0195 service nova] SCRIPT_NAME: `/identity` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:00:31.661651 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f9c5d60-30f2-4d7f-91ee-eee7479d0195 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:00:31.685822 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f9c5d60-30f2-4d7f-91ee-eee7479d0195 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 20:00:31.691521 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f9c5d60-30f2-4d7f-91ee-eee7479d0195 service nova] RBAC: Authorization granted {{(pid=82026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 20:00:31.720928 dv-cinder-828806-6-smb devstack@keystone.service[82026]: [pid: 82026|app: 0|req: 846/1709] 10.222.0.33 () {60 vars in 1365 bytes} [Tue Sep 13 20:00:31 2022] GET /identity/v3/auth/tokens => generated 3268 bytes in 213 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 20:00:31.723161 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f9c5d60-30f2-4d7f-91ee-eee7479d0195 service nova] Authenticating user token {{(pid=82026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 20:00:31.728355 dv-cinder-828806-6-smb devstack@keystone.service[82025]: [pid: 82025|app: 0|req: 864/1710] 10.222.0.33 () {60 vars in 1153 bytes} [Tue Sep 13 20:00:31 2022] POST /identity/v3/projects => generated 405 bytes in 189 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 13 20:00:31.733602 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8ce8906-8122-4987-b265-0e3153986bd4 admin admin] Authenticating user token {{(pid=82025) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 20:00:31.757640 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f9c5d60-30f2-4d7f-91ee-eee7479d0195 service nova] Validating token access rules against request {{(pid=82026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 20:00:31.872880 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG dbcounter [-] [82026] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=82026) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 20:00:31.928609 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6bacb10-f666-41a8-8059-b39765fae12b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57539b6a6f3b4d589f5f5e1d211cd6a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b454f707d20347ada3d82aa85495635e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 20:00:31.929642 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6bacb10-f666-41a8-8059-b39765fae12b admin admin] REQUEST_METHOD: `PUT` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:00:31.929933 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6bacb10-f666-41a8-8059-b39765fae12b admin admin] SCRIPT_NAME: `/identity` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:00:31.930216 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6bacb10-f666-41a8-8059-b39765fae12b admin admin] PATH_INFO: `/v3/projects/db242f15a8634109a509ccb3083e7444/users/48b7fb96143a43ec8ff79afd735478dc/roles/e5af7d5baa93469e9e486ef21c85474e` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:00:31.934677 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8ce8906-8122-4987-b265-0e3153986bd4 admin admin] Validating token access rules against request {{(pid=82025) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 20:00:31.952342 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35dc6391-da15-422c-b7fd-9c5b69df7d75 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57539b6a6f3b4d589f5f5e1d211cd6a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b454f707d20347ada3d82aa85495635e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82025) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 20:00:31.953116 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35dc6391-da15-422c-b7fd-9c5b69df7d75 admin admin] REQUEST_METHOD: `POST` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:00:31.953549 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35dc6391-da15-422c-b7fd-9c5b69df7d75 admin admin] SCRIPT_NAME: `/identity` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:00:31.953935 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35dc6391-da15-422c-b7fd-9c5b69df7d75 admin admin] PATH_INFO: `/v3/users` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:00:31.954693 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35dc6391-da15-422c-b7fd-9c5b69df7d75 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 20:00:31.959177 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35dc6391-da15-422c-b7fd-9c5b69df7d75 admin admin] RBAC: Authorization granted {{(pid=82025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 20:00:31.990732 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6bacb10-f666-41a8-8059-b39765fae12b admin admin] RBAC: Authorizing `identity:create_grant(project_id=db242f15a8634109a509ccb3083e7444, user_id=48b7fb96143a43ec8ff79afd735478dc, role_id=e5af7d5baa93469e9e486ef21c85474e)` {{(pid=82026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 20:00:31.995414 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6bacb10-f666-41a8-8059-b39765fae12b admin admin] RBAC: Authorization granted {{(pid=82026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 20:00:32.087363 dv-cinder-828806-6-smb devstack@keystone.service[82026]: [pid: 82026|app: 0|req: 847/1711] 10.222.0.33 () {60 vars in 1483 bytes} [Tue Sep 13 20:00:31 2022] PUT /identity/v3/projects/db242f15a8634109a509ccb3083e7444/users/48b7fb96143a43ec8ff79afd735478dc/roles/e5af7d5baa93469e9e486ef21c85474e => generated 0 bytes in 359 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 20:00:32.087363 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6bacb10-f666-41a8-8059-b39765fae12b admin admin] Authenticating user token {{(pid=82026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 20:00:32.087363 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.common.fernet_utils [None req-e6bacb10-f666-41a8-8059-b39765fae12b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82026) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 20:00:32.138836 dv-cinder-828806-6-smb devstack@keystone.service[82025]: [pid: 82025|app: 0|req: 865/1712] 10.222.0.33 () {60 vars in 1144 bytes} [Tue Sep 13 20:00:31 2022] POST /identity/v3/users => generated 309 bytes in 397 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 13 20:00:32.138836 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35dc6391-da15-422c-b7fd-9c5b69df7d75 admin admin] Authenticating user token {{(pid=82025) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 20:00:32.150926 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35dc6391-da15-422c-b7fd-9c5b69df7d75 admin admin] Validating token access rules against request {{(pid=82025) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 20:00:32.222917 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6bacb10-f666-41a8-8059-b39765fae12b admin admin] Validating token access rules against request {{(pid=82026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 20:00:32.259887 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36dc91f9-7b5f-4627-9152-5eb9f49b13ee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57539b6a6f3b4d589f5f5e1d211cd6a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b454f707d20347ada3d82aa85495635e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 20:00:32.259887 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36dc91f9-7b5f-4627-9152-5eb9f49b13ee admin admin] REQUEST_METHOD: `DELETE` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:00:32.259887 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36dc91f9-7b5f-4627-9152-5eb9f49b13ee admin admin] SCRIPT_NAME: `/identity` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:00:32.262676 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36dc91f9-7b5f-4627-9152-5eb9f49b13ee admin admin] PATH_INFO: `/v3/users/0c3866a717f046d190f1a919bf12c07b` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:00:32.265919 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36dc91f9-7b5f-4627-9152-5eb9f49b13ee admin admin] RBAC: Authorizing `identity:delete_user(user_id=0c3866a717f046d190f1a919bf12c07b)` {{(pid=82026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 20:00:32.273576 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36dc91f9-7b5f-4627-9152-5eb9f49b13ee admin admin] RBAC: Authorization granted {{(pid=82026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 20:00:32.299675 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10d2ef84-c8da-424c-8b59-0ac3ef5522ad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57539b6a6f3b4d589f5f5e1d211cd6a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b454f707d20347ada3d82aa85495635e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82025) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 20:00:32.300317 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10d2ef84-c8da-424c-8b59-0ac3ef5522ad admin admin] REQUEST_METHOD: `GET` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:00:32.300752 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10d2ef84-c8da-424c-8b59-0ac3ef5522ad admin admin] SCRIPT_NAME: `/identity` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:00:32.301045 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10d2ef84-c8da-424c-8b59-0ac3ef5522ad admin admin] PATH_INFO: `/v3/roles` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:00:32.301780 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10d2ef84-c8da-424c-8b59-0ac3ef5522ad admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 20:00:32.306083 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10d2ef84-c8da-424c-8b59-0ac3ef5522ad admin admin] RBAC: Authorization granted {{(pid=82025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 20:00:32.337172 dv-cinder-828806-6-smb devstack@keystone.service[82025]: [pid: 82025|app: 0|req: 866/1713] 10.222.0.33 () {58 vars in 1122 bytes} [Tue Sep 13 20:00:32 2022] GET /identity/v3/roles => generated 1420 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 13 20:00:32.346789 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10d2ef84-c8da-424c-8b59-0ac3ef5522ad admin admin] Authenticating user token {{(pid=82025) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 20:00:32.367652 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10d2ef84-c8da-424c-8b59-0ac3ef5522ad admin admin] Validating token access rules against request {{(pid=82025) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 20:00:32.383103 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b100202-9753-436a-8b3e-b4ed700001ec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57539b6a6f3b4d589f5f5e1d211cd6a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b454f707d20347ada3d82aa85495635e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82025) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 20:00:32.383832 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b100202-9753-436a-8b3e-b4ed700001ec admin admin] REQUEST_METHOD: `GET` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:00:32.384127 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b100202-9753-436a-8b3e-b4ed700001ec admin admin] SCRIPT_NAME: `/identity` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:00:32.384458 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b100202-9753-436a-8b3e-b4ed700001ec admin admin] PATH_INFO: `/v3/roles` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:00:32.385392 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b100202-9753-436a-8b3e-b4ed700001ec admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 20:00:32.388183 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b100202-9753-436a-8b3e-b4ed700001ec admin admin] RBAC: Authorization granted {{(pid=82025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 20:00:32.421065 dv-cinder-828806-6-smb devstack@keystone.service[82025]: [pid: 82025|app: 0|req: 867/1714] 10.222.0.33 () {58 vars in 1122 bytes} [Tue Sep 13 20:00:32 2022] GET /identity/v3/roles => generated 1420 bytes in 83 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 13 20:00:32.423009 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b100202-9753-436a-8b3e-b4ed700001ec admin admin] Authenticating user token {{(pid=82025) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 20:00:32.440523 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b100202-9753-436a-8b3e-b4ed700001ec admin admin] Validating token access rules against request {{(pid=82025) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 20:00:32.469133 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28d29fe2-3c8e-4c68-aefd-f2a6ebac7d87 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57539b6a6f3b4d589f5f5e1d211cd6a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b454f707d20347ada3d82aa85495635e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82025) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 20:00:32.473063 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28d29fe2-3c8e-4c68-aefd-f2a6ebac7d87 admin admin] REQUEST_METHOD: `PUT` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:00:32.473949 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28d29fe2-3c8e-4c68-aefd-f2a6ebac7d87 admin admin] SCRIPT_NAME: `/identity` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:00:32.476084 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28d29fe2-3c8e-4c68-aefd-f2a6ebac7d87 admin admin] PATH_INFO: `/v3/projects/db242f15a8634109a509ccb3083e7444/users/48b7fb96143a43ec8ff79afd735478dc/roles/e5af7d5baa93469e9e486ef21c85474e` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:00:32.481224 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28d29fe2-3c8e-4c68-aefd-f2a6ebac7d87 admin admin] RBAC: Authorizing `identity:create_grant(project_id=db242f15a8634109a509ccb3083e7444, user_id=48b7fb96143a43ec8ff79afd735478dc, role_id=e5af7d5baa93469e9e486ef21c85474e)` {{(pid=82025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 20:00:32.483563 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28d29fe2-3c8e-4c68-aefd-f2a6ebac7d87 admin admin] RBAC: Authorization granted {{(pid=82025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 20:00:32.504210 dv-cinder-828806-6-smb devstack@keystone.service[82025]: [pid: 82025|app: 0|req: 868/1715] 10.222.0.33 () {60 vars in 1483 bytes} [Tue Sep 13 20:00:32 2022] PUT /identity/v3/projects/db242f15a8634109a509ccb3083e7444/users/48b7fb96143a43ec8ff79afd735478dc/roles/e5af7d5baa93469e9e486ef21c85474e => generated 0 bytes in 82 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 20:00:32.505369 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28d29fe2-3c8e-4c68-aefd-f2a6ebac7d87 admin admin] Authenticating user token {{(pid=82025) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 20:00:32.609704 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.notifications [None req-36dc91f9-7b5f-4627-9152-5eb9f49b13ee admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0c3866a717f046d190f1a919bf12c07b'} {{(pid=82026) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 20:00:32.671679 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28d29fe2-3c8e-4c68-aefd-f2a6ebac7d87 admin admin] Validating token access rules against request {{(pid=82025) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 20:00:32.685014 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48cab3c2-9be5-4295-94fe-732a03f656e3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57539b6a6f3b4d589f5f5e1d211cd6a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b454f707d20347ada3d82aa85495635e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82025) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 20:00:32.693373 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48cab3c2-9be5-4295-94fe-732a03f656e3 admin admin] REQUEST_METHOD: `PUT` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:00:32.693373 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48cab3c2-9be5-4295-94fe-732a03f656e3 admin admin] SCRIPT_NAME: `/identity` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:00:32.693373 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48cab3c2-9be5-4295-94fe-732a03f656e3 admin admin] PATH_INFO: `/v3/projects/428ce6943181444695c189588ae9d624/users/8703006593484f86ba3800e769dc868f/roles/e5af7d5baa93469e9e486ef21c85474e` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:00:32.721301 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.notifications [None req-36dc91f9-7b5f-4627-9152-5eb9f49b13ee admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0c3866a717f046d190f1a919bf12c07b'} {{(pid=82026) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 20:00:32.725923 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48cab3c2-9be5-4295-94fe-732a03f656e3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=428ce6943181444695c189588ae9d624, user_id=8703006593484f86ba3800e769dc868f, role_id=e5af7d5baa93469e9e486ef21c85474e)` {{(pid=82025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 20:00:32.729942 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48cab3c2-9be5-4295-94fe-732a03f656e3 admin admin] RBAC: Authorization granted {{(pid=82025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 20:00:32.738843 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.notifications [None req-36dc91f9-7b5f-4627-9152-5eb9f49b13ee admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0c3866a717f046d190f1a919bf12c07b'} {{(pid=82026) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 20:00:32.739838 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.notifications [None req-36dc91f9-7b5f-4627-9152-5eb9f49b13ee admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0c3866a717f046d190f1a919bf12c07b'} {{(pid=82026) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 20:00:32.750283 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.notifications [None req-36dc91f9-7b5f-4627-9152-5eb9f49b13ee admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0c3866a717f046d190f1a919bf12c07b'} {{(pid=82026) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 20:00:32.758757 dv-cinder-828806-6-smb devstack@keystone.service[82026]: [pid: 82026|app: 0|req: 848/1716] 10.222.0.33 () {58 vars in 1224 bytes} [Tue Sep 13 20:00:32 2022] DELETE /identity/v3/users/0c3866a717f046d190f1a919bf12c07b => generated 0 bytes in 677 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 20:00:32.762265 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-964d083f-4a5c-4e66-aeb5-68940d4aa7b8 None None] REQUEST_METHOD: `POST` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:00:32.762564 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-964d083f-4a5c-4e66-aeb5-68940d4aa7b8 None None] SCRIPT_NAME: `/identity` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:00:32.763000 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-964d083f-4a5c-4e66-aeb5-68940d4aa7b8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:00:32.799229 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.auth.core [None req-964d083f-4a5c-4e66-aeb5-68940d4aa7b8 None None] MFA Rules not processed for user `48b7fb96143a43ec8ff79afd735478dc`. Rule list: `[]` (Enabled: `True`). {{(pid=82026) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 20:00:32.800502 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.common.fernet_utils [None req-964d083f-4a5c-4e66-aeb5-68940d4aa7b8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82026) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 20:00:32.888900 dv-cinder-828806-6-smb devstack@keystone.service[82025]: [pid: 82025|app: 0|req: 869/1717] 10.222.0.33 () {60 vars in 1483 bytes} [Tue Sep 13 20:00:32 2022] PUT /identity/v3/projects/428ce6943181444695c189588ae9d624/users/8703006593484f86ba3800e769dc868f/roles/e5af7d5baa93469e9e486ef21c85474e => generated 0 bytes in 384 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 20:00:32.893137 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48cab3c2-9be5-4295-94fe-732a03f656e3 admin admin] Authenticating user token {{(pid=82025) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 20:00:32.897984 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.fernet_utils [None req-48cab3c2-9be5-4295-94fe-732a03f656e3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82025) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 20:00:32.911383 dv-cinder-828806-6-smb devstack@keystone.service[82026]: [pid: 82026|app: 0|req: 849/1718] 10.222.0.33 () {58 vars in 958 bytes} [Tue Sep 13 20:00:32 2022] POST /identity/v3/auth/tokens => generated 3301 bytes in 152 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 20:00:32.917138 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6456a98f-0d5a-4afc-91e4-b43eda3ead15 None None] REQUEST_METHOD: `POST` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:00:32.917138 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6456a98f-0d5a-4afc-91e4-b43eda3ead15 None None] SCRIPT_NAME: `/identity` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:00:32.917138 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6456a98f-0d5a-4afc-91e4-b43eda3ead15 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:00:32.998211 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.auth.core [None req-6456a98f-0d5a-4afc-91e4-b43eda3ead15 None None] MFA Rules not processed for user `57539b6a6f3b4d589f5f5e1d211cd6a0`. Rule list: `[]` (Enabled: `True`). {{(pid=82026) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 20:00:33.001384 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.common.fernet_utils [None req-6456a98f-0d5a-4afc-91e4-b43eda3ead15 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82026) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 20:00:33.087429 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48cab3c2-9be5-4295-94fe-732a03f656e3 admin admin] Validating token access rules against request {{(pid=82025) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 20:00:33.116292 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1904f5e2-25eb-43ec-bbac-96d7002aea5a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57539b6a6f3b4d589f5f5e1d211cd6a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b454f707d20347ada3d82aa85495635e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82025) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 20:00:33.116992 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1904f5e2-25eb-43ec-bbac-96d7002aea5a admin admin] REQUEST_METHOD: `DELETE` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:00:33.117287 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1904f5e2-25eb-43ec-bbac-96d7002aea5a admin admin] SCRIPT_NAME: `/identity` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:00:33.117569 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1904f5e2-25eb-43ec-bbac-96d7002aea5a admin admin] PATH_INFO: `/v3/users/6969cdddb54c4459837a6e477ab82431` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:00:33.125018 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1904f5e2-25eb-43ec-bbac-96d7002aea5a admin admin] RBAC: Authorizing `identity:delete_user(user_id=6969cdddb54c4459837a6e477ab82431)` {{(pid=82025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 20:00:33.134589 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1904f5e2-25eb-43ec-bbac-96d7002aea5a admin admin] RBAC: Authorization granted {{(pid=82025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 20:00:33.200158 dv-cinder-828806-6-smb devstack@keystone.service[82026]: [pid: 82026|app: 0|req: 850/1719] 10.222.0.33 () {58 vars in 958 bytes} [Tue Sep 13 20:00:32 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 288 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 20:00:33.202013 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6456a98f-0d5a-4afc-91e4-b43eda3ead15 None None] Authenticating user token {{(pid=82026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 20:00:33.207369 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.common.fernet_utils [None req-6456a98f-0d5a-4afc-91e4-b43eda3ead15 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82026) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 20:00:33.239984 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6456a98f-0d5a-4afc-91e4-b43eda3ead15 None None] Validating token access rules against request {{(pid=82026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 20:00:33.255164 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe2e2c98-b570-467d-833b-dab33ffdf2b8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57539b6a6f3b4d589f5f5e1d211cd6a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b454f707d20347ada3d82aa85495635e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 20:00:33.255164 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe2e2c98-b570-467d-833b-dab33ffdf2b8 admin admin] REQUEST_METHOD: `GET` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:00:33.258170 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe2e2c98-b570-467d-833b-dab33ffdf2b8 admin admin] SCRIPT_NAME: `/identity` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:00:33.259409 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe2e2c98-b570-467d-833b-dab33ffdf2b8 admin admin] PATH_INFO: `/v3/roles` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:00:33.261430 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe2e2c98-b570-467d-833b-dab33ffdf2b8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 20:00:33.267691 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe2e2c98-b570-467d-833b-dab33ffdf2b8 admin admin] RBAC: Authorization granted {{(pid=82026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 20:00:33.307146 dv-cinder-828806-6-smb devstack@keystone.service[82026]: [pid: 82026|app: 0|req: 851/1720] 10.222.0.33 () {58 vars in 1122 bytes} [Tue Sep 13 20:00:33 2022] GET /identity/v3/roles => generated 1420 bytes in 105 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 13 20:00:33.310948 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe2e2c98-b570-467d-833b-dab33ffdf2b8 admin admin] Authenticating user token {{(pid=82026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 20:00:33.317776 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.common.fernet_utils [None req-fe2e2c98-b570-467d-833b-dab33ffdf2b8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82026) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 20:00:33.402928 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG dbcounter [-] [82025] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82025) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 20:00:33.474836 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe2e2c98-b570-467d-833b-dab33ffdf2b8 admin admin] Validating token access rules against request {{(pid=82026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 20:00:33.478531 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.notifications [None req-1904f5e2-25eb-43ec-bbac-96d7002aea5a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6969cdddb54c4459837a6e477ab82431'} {{(pid=82025) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 20:00:33.479414 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e245a08-7cad-46dc-867d-286b413b9e92 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46024fc6167f4321818b1bed27a521a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8c6fba0f15b4d6a84ff601919b7b8e4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 20:00:33.480164 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e245a08-7cad-46dc-867d-286b413b9e92 service cinder] REQUEST_METHOD: `GET` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:00:33.480556 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e245a08-7cad-46dc-867d-286b413b9e92 service cinder] SCRIPT_NAME: `/identity` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:00:33.480937 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e245a08-7cad-46dc-867d-286b413b9e92 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:00:33.579815 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.notifications [None req-1904f5e2-25eb-43ec-bbac-96d7002aea5a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6969cdddb54c4459837a6e477ab82431'} {{(pid=82025) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 20:00:33.580777 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.notifications [None req-1904f5e2-25eb-43ec-bbac-96d7002aea5a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6969cdddb54c4459837a6e477ab82431'} {{(pid=82025) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 20:00:33.604422 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.notifications [None req-1904f5e2-25eb-43ec-bbac-96d7002aea5a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6969cdddb54c4459837a6e477ab82431'} {{(pid=82025) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 20:00:33.618957 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.notifications [None req-1904f5e2-25eb-43ec-bbac-96d7002aea5a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6969cdddb54c4459837a6e477ab82431'} {{(pid=82025) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 20:00:33.621889 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e245a08-7cad-46dc-867d-286b413b9e92 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=82026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 20:00:33.623946 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e245a08-7cad-46dc-867d-286b413b9e92 service cinder] RBAC: Authorization granted {{(pid=82026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 20:00:33.636586 dv-cinder-828806-6-smb devstack@keystone.service[82025]: [pid: 82025|app: 0|req: 870/1721] 10.222.0.33 () {58 vars in 1224 bytes} [Tue Sep 13 20:00:32 2022] DELETE /identity/v3/users/6969cdddb54c4459837a6e477ab82431 => generated 0 bytes in 744 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 20:00:33.638928 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1904f5e2-25eb-43ec-bbac-96d7002aea5a admin admin] Authenticating user token {{(pid=82025) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 20:00:33.641753 dv-cinder-828806-6-smb devstack@keystone.service[82026]: [pid: 82026|app: 0|req: 852/1722] 10.222.0.33 () {60 vars in 1365 bytes} [Tue Sep 13 20:00:33 2022] GET /identity/v3/auth/tokens => generated 3301 bytes in 334 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 20:00:33.642647 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e245a08-7cad-46dc-867d-286b413b9e92 service cinder] Authenticating user token {{(pid=82026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 20:00:33.659083 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.fernet_utils [None req-1904f5e2-25eb-43ec-bbac-96d7002aea5a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82025) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 20:00:33.663993 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e245a08-7cad-46dc-867d-286b413b9e92 service cinder] Validating token access rules against request {{(pid=82026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 20:00:33.781468 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30d16803-f1d9-4b67-8d78-233046c752cc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57539b6a6f3b4d589f5f5e1d211cd6a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b454f707d20347ada3d82aa85495635e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 20:00:33.782917 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30d16803-f1d9-4b67-8d78-233046c752cc admin admin] REQUEST_METHOD: `PUT` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:00:33.783950 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30d16803-f1d9-4b67-8d78-233046c752cc admin admin] SCRIPT_NAME: `/identity` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:00:33.784480 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30d16803-f1d9-4b67-8d78-233046c752cc admin admin] PATH_INFO: `/v3/projects/428ce6943181444695c189588ae9d624/users/8703006593484f86ba3800e769dc868f/roles/e5af7d5baa93469e9e486ef21c85474e` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:00:33.790777 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30d16803-f1d9-4b67-8d78-233046c752cc admin admin] RBAC: Authorizing `identity:create_grant(project_id=428ce6943181444695c189588ae9d624, user_id=8703006593484f86ba3800e769dc868f, role_id=e5af7d5baa93469e9e486ef21c85474e)` {{(pid=82026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 20:00:33.804856 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30d16803-f1d9-4b67-8d78-233046c752cc admin admin] RBAC: Authorization granted {{(pid=82026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 20:00:33.840927 dv-cinder-828806-6-smb devstack@keystone.service[82026]: [pid: 82026|app: 0|req: 853/1723] 10.222.0.33 () {60 vars in 1483 bytes} [Tue Sep 13 20:00:33 2022] PUT /identity/v3/projects/428ce6943181444695c189588ae9d624/users/8703006593484f86ba3800e769dc868f/roles/e5af7d5baa93469e9e486ef21c85474e => generated 0 bytes in 189 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 20:00:33.843565 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75938c3b-1072-432e-aa79-6deb1b0a7101 None None] REQUEST_METHOD: `POST` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:00:33.843993 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75938c3b-1072-432e-aa79-6deb1b0a7101 None None] SCRIPT_NAME: `/identity` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:00:33.844930 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75938c3b-1072-432e-aa79-6deb1b0a7101 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:00:33.873934 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1904f5e2-25eb-43ec-bbac-96d7002aea5a admin admin] Validating token access rules against request {{(pid=82025) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 20:00:33.888241 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.auth.core [None req-75938c3b-1072-432e-aa79-6deb1b0a7101 None None] MFA Rules not processed for user `57539b6a6f3b4d589f5f5e1d211cd6a0`. Rule list: `[]` (Enabled: `True`). {{(pid=82026) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 20:00:33.891494 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.common.fernet_utils [None req-75938c3b-1072-432e-aa79-6deb1b0a7101 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82026) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 20:00:33.990273 dv-cinder-828806-6-smb devstack@keystone.service[82026]: [pid: 82026|app: 0|req: 854/1724] 10.222.0.33 () {58 vars in 958 bytes} [Tue Sep 13 20:00:33 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 149 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 20:00:33.992543 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd1425d9-16cd-4790-b599-b8bdc294fcf3 None None] REQUEST_METHOD: `POST` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:00:33.992815 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd1425d9-16cd-4790-b599-b8bdc294fcf3 None None] SCRIPT_NAME: `/identity` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:00:33.993099 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd1425d9-16cd-4790-b599-b8bdc294fcf3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:00:34.040610 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.auth.core [None req-cd1425d9-16cd-4790-b599-b8bdc294fcf3 None None] MFA Rules not processed for user `8703006593484f86ba3800e769dc868f`. Rule list: `[]` (Enabled: `True`). {{(pid=82026) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 20:00:34.042287 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.common.fernet_utils [None req-cd1425d9-16cd-4790-b599-b8bdc294fcf3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82026) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 20:00:34.063010 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10562785-e23f-4638-9e29-a7171c22c362 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '023a2c79c2444611b3d431928e56685d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8c6fba0f15b4d6a84ff601919b7b8e4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82025) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 20:00:34.063884 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10562785-e23f-4638-9e29-a7171c22c362 service neutron] REQUEST_METHOD: `GET` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:00:34.064363 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10562785-e23f-4638-9e29-a7171c22c362 service neutron] SCRIPT_NAME: `/identity` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:00:34.064863 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10562785-e23f-4638-9e29-a7171c22c362 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:00:34.082282 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.fernet_utils [None req-10562785-e23f-4638-9e29-a7171c22c362 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82025) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 20:00:34.099102 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10562785-e23f-4638-9e29-a7171c22c362 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 20:00:34.105185 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10562785-e23f-4638-9e29-a7171c22c362 service neutron] RBAC: Authorization granted {{(pid=82025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 20:00:34.119277 dv-cinder-828806-6-smb devstack@keystone.service[82025]: [pid: 82025|app: 0|req: 871/1725] 10.222.0.33 () {60 vars in 1365 bytes} [Tue Sep 13 20:00:33 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 484 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 20:00:34.120903 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10562785-e23f-4638-9e29-a7171c22c362 service neutron] Authenticating user token {{(pid=82025) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 20:00:34.131087 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10562785-e23f-4638-9e29-a7171c22c362 service neutron] Validating token access rules against request {{(pid=82025) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 20:00:34.136734 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11da586c-7e9e-4fb6-bda6-9c7b76016e0b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '023a2c79c2444611b3d431928e56685d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8c6fba0f15b4d6a84ff601919b7b8e4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82025) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 20:00:34.137349 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11da586c-7e9e-4fb6-bda6-9c7b76016e0b service neutron] REQUEST_METHOD: `GET` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:00:34.137885 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11da586c-7e9e-4fb6-bda6-9c7b76016e0b service neutron] SCRIPT_NAME: `/identity` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:00:34.138171 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11da586c-7e9e-4fb6-bda6-9c7b76016e0b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:00:34.184374 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11da586c-7e9e-4fb6-bda6-9c7b76016e0b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 20:00:34.190576 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11da586c-7e9e-4fb6-bda6-9c7b76016e0b service neutron] RBAC: Authorization granted {{(pid=82025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 20:00:34.216393 dv-cinder-828806-6-smb devstack@keystone.service[82025]: [pid: 82025|app: 0|req: 872/1726] 10.222.0.33 () {60 vars in 1365 bytes} [Tue Sep 13 20:00:34 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 96 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 20:00:34.219157 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11da586c-7e9e-4fb6-bda6-9c7b76016e0b service neutron] Authenticating user token {{(pid=82025) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 20:00:34.222542 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.fernet_utils [None req-11da586c-7e9e-4fb6-bda6-9c7b76016e0b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82025) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 20:00:34.259546 dv-cinder-828806-6-smb devstack@keystone.service[82026]: [pid: 82026|app: 0|req: 855/1727] 10.222.0.33 () {58 vars in 958 bytes} [Tue Sep 13 20:00:33 2022] POST /identity/v3/auth/tokens => generated 3349 bytes in 262 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 20:00:34.259546 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb30d854-e925-4bbd-b832-f7f7aaacadf0 None None] REQUEST_METHOD: `POST` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:00:34.259546 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb30d854-e925-4bbd-b832-f7f7aaacadf0 None None] SCRIPT_NAME: `/identity` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:00:34.259546 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb30d854-e925-4bbd-b832-f7f7aaacadf0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:00:34.297077 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.auth.core [None req-fb30d854-e925-4bbd-b832-f7f7aaacadf0 None None] MFA Rules not processed for user `8853527498a24a6c80c169929f9f48bc`. Rule list: `[]` (Enabled: `True`). {{(pid=82026) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 20:00:34.302065 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.common.fernet_utils [None req-fb30d854-e925-4bbd-b832-f7f7aaacadf0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82026) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 20:00:34.372034 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11da586c-7e9e-4fb6-bda6-9c7b76016e0b service neutron] Validating token access rules against request {{(pid=82025) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 20:00:34.377632 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3725daa1-2359-4507-b5c5-3f49e789c07d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46024fc6167f4321818b1bed27a521a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8c6fba0f15b4d6a84ff601919b7b8e4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82025) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 20:00:34.378687 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3725daa1-2359-4507-b5c5-3f49e789c07d service cinder] REQUEST_METHOD: `GET` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:00:34.379562 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3725daa1-2359-4507-b5c5-3f49e789c07d service cinder] SCRIPT_NAME: `/identity` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:00:34.380119 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3725daa1-2359-4507-b5c5-3f49e789c07d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:00:34.383278 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.fernet_utils [None req-3725daa1-2359-4507-b5c5-3f49e789c07d service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82025) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 20:00:34.476890 dv-cinder-828806-6-smb devstack@keystone.service[82026]: [pid: 82026|app: 0|req: 856/1728] 10.222.0.33 () {58 vars in 958 bytes} [Tue Sep 13 20:00:34 2022] POST /identity/v3/auth/tokens => generated 3268 bytes in 223 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 20:00:34.478466 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b781a115-b511-473b-94b6-59d76127eba4 None None] REQUEST_METHOD: `POST` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:00:34.480162 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b781a115-b511-473b-94b6-59d76127eba4 None None] SCRIPT_NAME: `/identity` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:00:34.481609 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b781a115-b511-473b-94b6-59d76127eba4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:00:34.532775 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3725daa1-2359-4507-b5c5-3f49e789c07d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=82025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 20:00:34.533342 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.auth.core [None req-b781a115-b511-473b-94b6-59d76127eba4 None None] MFA Rules not processed for user `abe7dd30d59f41b19efde48cc035aa4f`. Rule list: `[]` (Enabled: `True`). {{(pid=82026) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 20:00:34.536728 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3725daa1-2359-4507-b5c5-3f49e789c07d service cinder] RBAC: Authorization granted {{(pid=82025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 20:00:34.536842 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.common.fernet_utils [None req-b781a115-b511-473b-94b6-59d76127eba4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82026) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 20:00:34.564054 dv-cinder-828806-6-smb devstack@keystone.service[82025]: [pid: 82025|app: 0|req: 873/1729] 10.222.0.33 () {60 vars in 1365 bytes} [Tue Sep 13 20:00:34 2022] GET /identity/v3/auth/tokens => generated 3232 bytes in 347 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 20:00:34.679270 dv-cinder-828806-6-smb devstack@keystone.service[82026]: [pid: 82026|app: 0|req: 857/1730] 10.222.0.33 () {58 vars in 958 bytes} [Tue Sep 13 20:00:34 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 197 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 20:00:35.029376 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3725daa1-2359-4507-b5c5-3f49e789c07d service cinder] Authenticating user token {{(pid=82025) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 20:00:35.031068 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.fernet_utils [None req-3725daa1-2359-4507-b5c5-3f49e789c07d service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82025) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 20:00:35.061156 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3725daa1-2359-4507-b5c5-3f49e789c07d service cinder] Validating token access rules against request {{(pid=82025) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 20:00:35.068424 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1209fea-955a-4be6-a654-e1fedd640145 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57539b6a6f3b4d589f5f5e1d211cd6a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b454f707d20347ada3d82aa85495635e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82025) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 20:00:35.077237 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1209fea-955a-4be6-a654-e1fedd640145 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:00:35.077237 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1209fea-955a-4be6-a654-e1fedd640145 admin admin] SCRIPT_NAME: `/identity` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:00:35.077237 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1209fea-955a-4be6-a654-e1fedd640145 admin admin] PATH_INFO: `/v3/projects/0d5c083f20d94eb081216a6f93e083dc` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:00:35.077237 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1209fea-955a-4be6-a654-e1fedd640145 admin admin] RBAC: Authorizing `identity:delete_project(project_id=0d5c083f20d94eb081216a6f93e083dc)` {{(pid=82025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 20:00:35.077237 dv-cinder-828806-6-smb devstack@keystone.service[82025]: WARNING py.warnings [None req-b1209fea-955a-4be6-a654-e1fedd640145 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Sep 13 20:00:35.077237 dv-cinder-828806-6-smb devstack@keystone.service[82025]: warnings.warn(msg) Sep 13 20:00:35.077237 dv-cinder-828806-6-smb devstack@keystone.service[82025]: Sep 13 20:00:35.077831 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1209fea-955a-4be6-a654-e1fedd640145 admin admin] RBAC: Authorization granted {{(pid=82025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 20:00:35.307243 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40f4c920-ead4-4841-a754-eb510544428a None None] REQUEST_METHOD: `GET` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:00:35.307718 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40f4c920-ead4-4841-a754-eb510544428a None None] SCRIPT_NAME: `/identity` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:00:35.307827 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40f4c920-ead4-4841-a754-eb510544428a None None] PATH_INFO: `/` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:00:35.309942 dv-cinder-828806-6-smb devstack@keystone.service[82026]: [pid: 82026|app: 0|req: 858/1731] 10.222.0.33 () {54 vars in 912 bytes} [Tue Sep 13 20:00:35 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 20:00:35.311905 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40f4c920-ead4-4841-a754-eb510544428a None None] Authenticating user token {{(pid=82026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 20:00:35.315418 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.common.fernet_utils [None req-40f4c920-ead4-4841-a754-eb510544428a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82026) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 20:00:35.327447 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.notifications [None req-b1209fea-955a-4be6-a654-e1fedd640145 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0d5c083f20d94eb081216a6f93e083dc', 'request_id': 'req-b1209fea-955a-4be6-a654-e1fedd640145'} {{(pid=82025) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 20:00:35.336246 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.notifications [None req-b1209fea-955a-4be6-a654-e1fedd640145 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0d5c083f20d94eb081216a6f93e083dc', 'request_id': 'req-b1209fea-955a-4be6-a654-e1fedd640145'} {{(pid=82025) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 20:00:35.355948 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.notifications [None req-b1209fea-955a-4be6-a654-e1fedd640145 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0d5c083f20d94eb081216a6f93e083dc', 'request_id': 'req-b1209fea-955a-4be6-a654-e1fedd640145'} {{(pid=82025) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 20:00:35.409057 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40f4c920-ead4-4841-a754-eb510544428a None None] Validating token access rules against request {{(pid=82026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 20:00:35.415361 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dc6479c-ff0f-4023-9915-8824bda41a08 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46024fc6167f4321818b1bed27a521a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8c6fba0f15b4d6a84ff601919b7b8e4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 20:00:35.418730 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dc6479c-ff0f-4023-9915-8824bda41a08 service cinder] REQUEST_METHOD: `GET` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:00:35.418730 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dc6479c-ff0f-4023-9915-8824bda41a08 service cinder] SCRIPT_NAME: `/identity` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:00:35.418730 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dc6479c-ff0f-4023-9915-8824bda41a08 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:00:35.473138 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.notifications [None req-b1209fea-955a-4be6-a654-e1fedd640145 admin admin] The token cache is being invalidate because project 0d5c083f20d94eb081216a6f93e083dc was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82025) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 13 20:00:35.473138 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.notifications [None req-b1209fea-955a-4be6-a654-e1fedd640145 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82025) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 20:00:35.473736 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.notifications [None req-b1209fea-955a-4be6-a654-e1fedd640145 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82025) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 20:00:35.480447 dv-cinder-828806-6-smb devstack@keystone.service[82025]: [pid: 82025|app: 0|req: 874/1732] 10.222.0.33 () {58 vars in 1233 bytes} [Tue Sep 13 20:00:35 2022] DELETE /identity/v3/projects/0d5c083f20d94eb081216a6f93e083dc => generated 0 bytes in 449 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 20:00:35.481965 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2449651f-1099-4b67-83ae-bdd41a8f944f None None] REQUEST_METHOD: `POST` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:00:35.484435 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2449651f-1099-4b67-83ae-bdd41a8f944f None None] SCRIPT_NAME: `/identity` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:00:35.484805 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2449651f-1099-4b67-83ae-bdd41a8f944f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:00:35.584012 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dc6479c-ff0f-4023-9915-8824bda41a08 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=82026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 20:00:35.587168 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dc6479c-ff0f-4023-9915-8824bda41a08 service cinder] RBAC: Authorization granted {{(pid=82026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 20:00:35.587284 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.auth.core [None req-2449651f-1099-4b67-83ae-bdd41a8f944f None None] MFA Rules not processed for user `023a2c79c2444611b3d431928e56685d`. Rule list: `[]` (Enabled: `True`). {{(pid=82025) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 20:00:35.588472 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.fernet_utils [None req-2449651f-1099-4b67-83ae-bdd41a8f944f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82025) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 20:00:35.617463 dv-cinder-828806-6-smb devstack@keystone.service[82026]: [pid: 82026|app: 0|req: 859/1733] 10.222.0.33 () {60 vars in 1365 bytes} [Tue Sep 13 20:00:35 2022] GET /identity/v3/auth/tokens => generated 3349 bytes in 306 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 13 20:00:35.621487 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dc6479c-ff0f-4023-9915-8824bda41a08 service cinder] Authenticating user token {{(pid=82026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 20:00:35.650939 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.common.fernet_utils [None req-7dc6479c-ff0f-4023-9915-8824bda41a08 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82026) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 20:00:35.746940 dv-cinder-828806-6-smb devstack@keystone.service[82025]: [pid: 82025|app: 0|req: 875/1734] 10.222.0.33 () {58 vars in 1009 bytes} [Tue Sep 13 20:00:35 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 266 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 20:00:35.752657 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2449651f-1099-4b67-83ae-bdd41a8f944f None None] Authenticating user token {{(pid=82025) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 20:00:35.755315 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.fernet_utils [None req-2449651f-1099-4b67-83ae-bdd41a8f944f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82025) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 20:00:35.936650 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dc6479c-ff0f-4023-9915-8824bda41a08 service cinder] Validating token access rules against request {{(pid=82026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 20:00:35.946592 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17e8a945-e99f-4f15-9496-f19a747d7279 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57539b6a6f3b4d589f5f5e1d211cd6a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b454f707d20347ada3d82aa85495635e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 20:00:35.947292 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17e8a945-e99f-4f15-9496-f19a747d7279 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:00:35.947588 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17e8a945-e99f-4f15-9496-f19a747d7279 admin admin] SCRIPT_NAME: `/identity` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:00:35.948679 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17e8a945-e99f-4f15-9496-f19a747d7279 admin admin] PATH_INFO: `/v3/projects/8e56a153f70a4c40811313d2b6c82fc8` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:00:35.951157 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17e8a945-e99f-4f15-9496-f19a747d7279 admin admin] RBAC: Authorizing `identity:delete_project(project_id=8e56a153f70a4c40811313d2b6c82fc8)` {{(pid=82026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 20:00:35.953189 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17e8a945-e99f-4f15-9496-f19a747d7279 admin admin] RBAC: Authorization granted {{(pid=82026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 20:00:35.976792 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2449651f-1099-4b67-83ae-bdd41a8f944f None None] Validating token access rules against request {{(pid=82025) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 20:00:35.983414 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-577a8580-ea08-437a-b08b-6b3b36f3fd49 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57539b6a6f3b4d589f5f5e1d211cd6a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b454f707d20347ada3d82aa85495635e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82025) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 20:00:35.985611 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-577a8580-ea08-437a-b08b-6b3b36f3fd49 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:00:35.987565 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-577a8580-ea08-437a-b08b-6b3b36f3fd49 admin admin] SCRIPT_NAME: `/identity` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:00:35.987565 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-577a8580-ea08-437a-b08b-6b3b36f3fd49 admin admin] PATH_INFO: `/v3/users/b2844d6e223c482dba01ff91739d3c02` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:00:35.988906 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-577a8580-ea08-437a-b08b-6b3b36f3fd49 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b2844d6e223c482dba01ff91739d3c02)` {{(pid=82025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 20:00:35.990806 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG dbcounter [-] [82026] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=82026) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 20:00:35.991602 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-577a8580-ea08-437a-b08b-6b3b36f3fd49 admin admin] RBAC: Authorization granted {{(pid=82025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 20:00:36.157791 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG dbcounter [-] [82025] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=82025) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 20:00:36.230130 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.notifications [None req-577a8580-ea08-437a-b08b-6b3b36f3fd49 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b2844d6e223c482dba01ff91739d3c02'} {{(pid=82025) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 20:00:36.232511 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.notifications [None req-17e8a945-e99f-4f15-9496-f19a747d7279 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8e56a153f70a4c40811313d2b6c82fc8', 'request_id': 'req-17e8a945-e99f-4f15-9496-f19a747d7279'} {{(pid=82026) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 20:00:36.339875 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.notifications [None req-577a8580-ea08-437a-b08b-6b3b36f3fd49 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b2844d6e223c482dba01ff91739d3c02'} {{(pid=82025) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 20:00:36.343208 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.notifications [None req-577a8580-ea08-437a-b08b-6b3b36f3fd49 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b2844d6e223c482dba01ff91739d3c02'} {{(pid=82025) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 20:00:36.359898 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.notifications [None req-577a8580-ea08-437a-b08b-6b3b36f3fd49 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b2844d6e223c482dba01ff91739d3c02'} {{(pid=82025) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 20:00:36.369549 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.notifications [None req-577a8580-ea08-437a-b08b-6b3b36f3fd49 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b2844d6e223c482dba01ff91739d3c02'} {{(pid=82025) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 20:00:36.377723 dv-cinder-828806-6-smb devstack@keystone.service[82025]: [pid: 82025|app: 0|req: 876/1735] 10.222.0.33 () {58 vars in 1224 bytes} [Tue Sep 13 20:00:35 2022] DELETE /identity/v3/users/b2844d6e223c482dba01ff91739d3c02 => generated 0 bytes in 630 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 20:00:36.380566 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-577a8580-ea08-437a-b08b-6b3b36f3fd49 admin admin] Authenticating user token {{(pid=82025) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 20:00:36.386264 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.fernet_utils [None req-577a8580-ea08-437a-b08b-6b3b36f3fd49 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82025) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 20:00:36.493496 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.notifications [None req-17e8a945-e99f-4f15-9496-f19a747d7279 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8e56a153f70a4c40811313d2b6c82fc8', 'request_id': 'req-17e8a945-e99f-4f15-9496-f19a747d7279'} {{(pid=82026) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 20:00:36.511735 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.notifications [None req-17e8a945-e99f-4f15-9496-f19a747d7279 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8e56a153f70a4c40811313d2b6c82fc8', 'request_id': 'req-17e8a945-e99f-4f15-9496-f19a747d7279'} {{(pid=82026) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 20:00:36.537147 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-577a8580-ea08-437a-b08b-6b3b36f3fd49 admin admin] Validating token access rules against request {{(pid=82025) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 20:00:36.545699 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.notifications [None req-17e8a945-e99f-4f15-9496-f19a747d7279 admin admin] The token cache is being invalidate because project 8e56a153f70a4c40811313d2b6c82fc8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82026) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 13 20:00:36.546005 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.notifications [None req-17e8a945-e99f-4f15-9496-f19a747d7279 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82026) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 20:00:36.549356 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35989e5a-1019-406a-ab0b-a9aeca6ebc18 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '023a2c79c2444611b3d431928e56685d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8c6fba0f15b4d6a84ff601919b7b8e4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82025) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 20:00:36.550032 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35989e5a-1019-406a-ab0b-a9aeca6ebc18 service neutron] REQUEST_METHOD: `GET` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:00:36.550318 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35989e5a-1019-406a-ab0b-a9aeca6ebc18 service neutron] SCRIPT_NAME: `/identity` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:00:36.550594 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35989e5a-1019-406a-ab0b-a9aeca6ebc18 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:00:36.551789 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.notifications [None req-17e8a945-e99f-4f15-9496-f19a747d7279 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82026) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 20:00:36.557740 dv-cinder-828806-6-smb devstack@keystone.service[82026]: [pid: 82026|app: 0|req: 860/1736] 10.222.0.33 () {58 vars in 1233 bytes} [Tue Sep 13 20:00:35 2022] DELETE /identity/v3/projects/8e56a153f70a4c40811313d2b6c82fc8 => generated 0 bytes in 936 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 20:00:36.558058 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.fernet_utils [None req-35989e5a-1019-406a-ab0b-a9aeca6ebc18 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82025) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 20:00:36.564869 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17e8a945-e99f-4f15-9496-f19a747d7279 admin admin] Authenticating user token {{(pid=82026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 20:00:36.569279 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.common.fernet_utils [None req-17e8a945-e99f-4f15-9496-f19a747d7279 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82026) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 20:00:36.572252 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35989e5a-1019-406a-ab0b-a9aeca6ebc18 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 20:00:36.575733 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35989e5a-1019-406a-ab0b-a9aeca6ebc18 service neutron] RBAC: Authorization granted {{(pid=82025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 20:00:36.612064 dv-cinder-828806-6-smb devstack@keystone.service[82025]: [pid: 82025|app: 0|req: 877/1737] 10.222.0.33 () {60 vars in 1365 bytes} [Tue Sep 13 20:00:36 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 232 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 20:00:36.624280 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a2aeabd-c5fc-4df9-a98c-e0935bb7e969 None None] REQUEST_METHOD: `POST` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:00:36.625485 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a2aeabd-c5fc-4df9-a98c-e0935bb7e969 None None] SCRIPT_NAME: `/identity` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:00:36.631811 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a2aeabd-c5fc-4df9-a98c-e0935bb7e969 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:00:36.691936 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17e8a945-e99f-4f15-9496-f19a747d7279 admin admin] Validating token access rules against request {{(pid=82026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 20:00:36.729284 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.auth.core [None req-1a2aeabd-c5fc-4df9-a98c-e0935bb7e969 None None] MFA Rules not processed for user `57539b6a6f3b4d589f5f5e1d211cd6a0`. Rule list: `[]` (Enabled: `True`). {{(pid=82025) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 20:00:36.732755 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.fernet_utils [None req-1a2aeabd-c5fc-4df9-a98c-e0935bb7e969 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82025) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 20:00:36.779410 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-352aaf43-9e9e-4043-afcd-676f1c100da0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57539b6a6f3b4d589f5f5e1d211cd6a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b454f707d20347ada3d82aa85495635e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 20:00:36.780244 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-352aaf43-9e9e-4043-afcd-676f1c100da0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:00:36.780808 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-352aaf43-9e9e-4043-afcd-676f1c100da0 admin admin] SCRIPT_NAME: `/identity` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:00:36.782046 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-352aaf43-9e9e-4043-afcd-676f1c100da0 admin admin] PATH_INFO: `/v3/users/83dd14b10cb14d7da167a41d452b8446` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:00:36.784163 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-352aaf43-9e9e-4043-afcd-676f1c100da0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=83dd14b10cb14d7da167a41d452b8446)` {{(pid=82026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 20:00:36.787169 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-352aaf43-9e9e-4043-afcd-676f1c100da0 admin admin] RBAC: Authorization granted {{(pid=82026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 20:00:36.937456 dv-cinder-828806-6-smb devstack@keystone.service[82025]: [pid: 82025|app: 0|req: 878/1738] 10.222.0.33 () {58 vars in 958 bytes} [Tue Sep 13 20:00:36 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 318 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 20:00:36.940353 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc1d8980-3674-4f83-9d72-3493da7e24c3 None None] REQUEST_METHOD: `POST` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:00:36.940353 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc1d8980-3674-4f83-9d72-3493da7e24c3 None None] SCRIPT_NAME: `/identity` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:00:36.940353 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc1d8980-3674-4f83-9d72-3493da7e24c3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:00:36.997655 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.notifications [None req-352aaf43-9e9e-4043-afcd-676f1c100da0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '83dd14b10cb14d7da167a41d452b8446'} {{(pid=82026) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 20:00:37.026566 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.auth.core [None req-dc1d8980-3674-4f83-9d72-3493da7e24c3 None None] MFA Rules not processed for user `57539b6a6f3b4d589f5f5e1d211cd6a0`. Rule list: `[]` (Enabled: `True`). {{(pid=82025) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 20:00:37.028494 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.fernet_utils [None req-dc1d8980-3674-4f83-9d72-3493da7e24c3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82025) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 20:00:37.087672 dv-cinder-828806-6-smb devstack@keystone.service[82025]: [pid: 82025|app: 0|req: 879/1739] 10.222.0.33 () {58 vars in 958 bytes} [Tue Sep 13 20:00:36 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 150 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 20:00:37.093412 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc1d8980-3674-4f83-9d72-3493da7e24c3 None None] Authenticating user token {{(pid=82025) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 20:00:37.115421 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.notifications [None req-352aaf43-9e9e-4043-afcd-676f1c100da0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '83dd14b10cb14d7da167a41d452b8446'} {{(pid=82026) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 20:00:37.131723 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc1d8980-3674-4f83-9d72-3493da7e24c3 None None] Validating token access rules against request {{(pid=82025) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 20:00:37.139976 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.notifications [None req-352aaf43-9e9e-4043-afcd-676f1c100da0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '83dd14b10cb14d7da167a41d452b8446'} {{(pid=82026) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 20:00:37.140896 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.notifications [None req-352aaf43-9e9e-4043-afcd-676f1c100da0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '83dd14b10cb14d7da167a41d452b8446'} {{(pid=82026) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 20:00:37.144699 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b9a450c-82a4-4442-b259-f3cd18d23321 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57539b6a6f3b4d589f5f5e1d211cd6a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b454f707d20347ada3d82aa85495635e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82025) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 20:00:37.145333 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b9a450c-82a4-4442-b259-f3cd18d23321 admin admin] REQUEST_METHOD: `GET` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:00:37.145621 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b9a450c-82a4-4442-b259-f3cd18d23321 admin admin] SCRIPT_NAME: `/identity` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:00:37.145903 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b9a450c-82a4-4442-b259-f3cd18d23321 admin admin] PATH_INFO: `/v3/domains` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:00:37.148958 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b9a450c-82a4-4442-b259-f3cd18d23321 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82025) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 20:00:37.149526 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b9a450c-82a4-4442-b259-f3cd18d23321 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 20:00:37.153210 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b9a450c-82a4-4442-b259-f3cd18d23321 admin admin] RBAC: Authorization granted {{(pid=82025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 20:00:37.158258 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.notifications [None req-352aaf43-9e9e-4043-afcd-676f1c100da0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '83dd14b10cb14d7da167a41d452b8446'} {{(pid=82026) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 20:00:37.172400 dv-cinder-828806-6-smb devstack@keystone.service[82026]: [pid: 82026|app: 0|req: 861/1740] 10.222.0.33 () {58 vars in 1224 bytes} [Tue Sep 13 20:00:36 2022] DELETE /identity/v3/users/83dd14b10cb14d7da167a41d452b8446 => generated 0 bytes in 617 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 20:00:37.176596 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e0b6a2c-1563-40df-864d-b9c051c65e91 None None] REQUEST_METHOD: `POST` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:00:37.176894 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e0b6a2c-1563-40df-864d-b9c051c65e91 None None] SCRIPT_NAME: `/identity` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:00:37.177181 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e0b6a2c-1563-40df-864d-b9c051c65e91 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:00:37.186101 dv-cinder-828806-6-smb devstack@keystone.service[82025]: [pid: 82025|app: 0|req: 880/1741] 10.222.0.33 () {58 vars in 1153 bytes} [Tue Sep 13 20:00:37 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 94 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 20:00:37.188063 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b9a450c-82a4-4442-b259-f3cd18d23321 admin admin] Authenticating user token {{(pid=82025) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 20:00:37.194174 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.fernet_utils [None req-0b9a450c-82a4-4442-b259-f3cd18d23321 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82025) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 20:00:37.217015 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.auth.core [None req-6e0b6a2c-1563-40df-864d-b9c051c65e91 None None] MFA Rules not processed for user `57539b6a6f3b4d589f5f5e1d211cd6a0`. Rule list: `[]` (Enabled: `True`). {{(pid=82026) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 20:00:37.218295 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.common.fernet_utils [None req-6e0b6a2c-1563-40df-864d-b9c051c65e91 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82026) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 20:00:37.222151 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b9a450c-82a4-4442-b259-f3cd18d23321 admin admin] Validating token access rules against request {{(pid=82025) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 20:00:37.312014 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5df8706-5a0d-430e-8dec-f415bd44ae44 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57539b6a6f3b4d589f5f5e1d211cd6a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b454f707d20347ada3d82aa85495635e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82025) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 20:00:37.313363 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5df8706-5a0d-430e-8dec-f415bd44ae44 admin admin] REQUEST_METHOD: `POST` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:00:37.314061 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5df8706-5a0d-430e-8dec-f415bd44ae44 admin admin] SCRIPT_NAME: `/identity` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:00:37.338420 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5df8706-5a0d-430e-8dec-f415bd44ae44 admin admin] PATH_INFO: `/v3/projects` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:00:37.342607 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5df8706-5a0d-430e-8dec-f415bd44ae44 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 20:00:37.351476 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5df8706-5a0d-430e-8dec-f415bd44ae44 admin admin] RBAC: Authorization granted {{(pid=82025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 20:00:37.404094 dv-cinder-828806-6-smb devstack@keystone.service[82026]: [pid: 82026|app: 0|req: 862/1742] 10.222.0.33 () {58 vars in 958 bytes} [Tue Sep 13 20:00:37 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 228 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 20:00:37.405121 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e0b6a2c-1563-40df-864d-b9c051c65e91 None None] Authenticating user token {{(pid=82026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 20:00:37.410074 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.common.fernet_utils [None req-6e0b6a2c-1563-40df-864d-b9c051c65e91 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82026) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 20:00:37.434838 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e0b6a2c-1563-40df-864d-b9c051c65e91 None None] Validating token access rules against request {{(pid=82026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 20:00:37.445478 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4188662a-57ef-4c70-b9ce-5824d46d470c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57539b6a6f3b4d589f5f5e1d211cd6a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b454f707d20347ada3d82aa85495635e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 20:00:37.446320 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4188662a-57ef-4c70-b9ce-5824d46d470c admin admin] REQUEST_METHOD: `DELETE` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:00:37.446619 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4188662a-57ef-4c70-b9ce-5824d46d470c admin admin] SCRIPT_NAME: `/identity` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:00:37.446921 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4188662a-57ef-4c70-b9ce-5824d46d470c admin admin] PATH_INFO: `/v3/projects/934c3f075419487d97bc09e4a5231b29` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:00:37.448494 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4188662a-57ef-4c70-b9ce-5824d46d470c admin admin] RBAC: Authorizing `identity:delete_project(project_id=934c3f075419487d97bc09e4a5231b29)` {{(pid=82026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 20:00:37.450550 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4188662a-57ef-4c70-b9ce-5824d46d470c admin admin] RBAC: Authorization granted {{(pid=82026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 20:00:37.508158 dv-cinder-828806-6-smb devstack@keystone.service[82025]: [pid: 82025|app: 0|req: 881/1743] 10.222.0.33 () {60 vars in 1153 bytes} [Tue Sep 13 20:00:37 2022] POST /identity/v3/projects => generated 387 bytes in 322 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 13 20:00:37.513286 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5df8706-5a0d-430e-8dec-f415bd44ae44 admin admin] Authenticating user token {{(pid=82025) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 20:00:37.515373 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.fernet_utils [None req-d5df8706-5a0d-430e-8dec-f415bd44ae44 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82025) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 20:00:37.610091 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5df8706-5a0d-430e-8dec-f415bd44ae44 admin admin] Validating token access rules against request {{(pid=82025) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 20:00:37.611684 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.notifications [None req-4188662a-57ef-4c70-b9ce-5824d46d470c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '934c3f075419487d97bc09e4a5231b29', 'request_id': 'req-4188662a-57ef-4c70-b9ce-5824d46d470c'} {{(pid=82026) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 20:00:37.694761 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.notifications [None req-4188662a-57ef-4c70-b9ce-5824d46d470c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '934c3f075419487d97bc09e4a5231b29', 'request_id': 'req-4188662a-57ef-4c70-b9ce-5824d46d470c'} {{(pid=82026) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 20:00:37.698528 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34e02503-584a-4617-8f65-16ee3e35200c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '023a2c79c2444611b3d431928e56685d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8c6fba0f15b4d6a84ff601919b7b8e4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82025) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 20:00:37.699200 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34e02503-584a-4617-8f65-16ee3e35200c service neutron] REQUEST_METHOD: `GET` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:00:37.699490 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34e02503-584a-4617-8f65-16ee3e35200c service neutron] SCRIPT_NAME: `/identity` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:00:37.699769 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34e02503-584a-4617-8f65-16ee3e35200c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:00:37.714945 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.notifications [None req-4188662a-57ef-4c70-b9ce-5824d46d470c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '934c3f075419487d97bc09e4a5231b29', 'request_id': 'req-4188662a-57ef-4c70-b9ce-5824d46d470c'} {{(pid=82026) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 20:00:37.732840 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.notifications [None req-4188662a-57ef-4c70-b9ce-5824d46d470c admin admin] The token cache is being invalidate because project 934c3f075419487d97bc09e4a5231b29 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82026) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 13 20:00:37.733701 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.notifications [None req-4188662a-57ef-4c70-b9ce-5824d46d470c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82026) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 20:00:37.733888 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.notifications [None req-4188662a-57ef-4c70-b9ce-5824d46d470c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82026) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 20:00:37.735877 dv-cinder-828806-6-smb devstack@keystone.service[82026]: [pid: 82026|app: 0|req: 863/1744] 10.222.0.33 () {58 vars in 1233 bytes} [Tue Sep 13 20:00:37 2022] DELETE /identity/v3/projects/934c3f075419487d97bc09e4a5231b29 => generated 0 bytes in 331 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 20:00:37.741638 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9276dc89-2252-4c30-a95f-a6ffe72c7d67 None None] REQUEST_METHOD: `POST` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:00:37.741930 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9276dc89-2252-4c30-a95f-a6ffe72c7d67 None None] SCRIPT_NAME: `/identity` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:00:37.742125 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9276dc89-2252-4c30-a95f-a6ffe72c7d67 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:00:37.801190 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34e02503-584a-4617-8f65-16ee3e35200c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 20:00:37.802664 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34e02503-584a-4617-8f65-16ee3e35200c service neutron] RBAC: Authorization granted {{(pid=82025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 20:00:37.818546 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.auth.core [None req-9276dc89-2252-4c30-a95f-a6ffe72c7d67 None None] MFA Rules not processed for user `a28e738b894442e2bc9880eeb64fc0c8`. Rule list: `[]` (Enabled: `True`). {{(pid=82026) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 20:00:37.820787 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.common.fernet_utils [None req-9276dc89-2252-4c30-a95f-a6ffe72c7d67 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82026) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 20:00:37.827802 dv-cinder-828806-6-smb devstack@keystone.service[82025]: [pid: 82025|app: 0|req: 882/1745] 10.222.0.33 () {60 vars in 1365 bytes} [Tue Sep 13 20:00:37 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 314 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 20:00:37.829237 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34e02503-584a-4617-8f65-16ee3e35200c service neutron] Authenticating user token {{(pid=82025) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 20:00:37.875458 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34e02503-584a-4617-8f65-16ee3e35200c service neutron] Validating token access rules against request {{(pid=82025) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 20:00:37.892938 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efedf9dc-f967-4433-be21-f3e692129620 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57539b6a6f3b4d589f5f5e1d211cd6a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b454f707d20347ada3d82aa85495635e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82025) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 20:00:37.895242 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efedf9dc-f967-4433-be21-f3e692129620 admin admin] REQUEST_METHOD: `POST` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:00:37.895955 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efedf9dc-f967-4433-be21-f3e692129620 admin admin] SCRIPT_NAME: `/identity` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:00:37.896181 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efedf9dc-f967-4433-be21-f3e692129620 admin admin] PATH_INFO: `/v3/users` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:00:37.896911 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efedf9dc-f967-4433-be21-f3e692129620 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 20:00:37.899329 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efedf9dc-f967-4433-be21-f3e692129620 admin admin] RBAC: Authorization granted {{(pid=82025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 20:00:37.950194 dv-cinder-828806-6-smb devstack@keystone.service[82026]: [pid: 82026|app: 0|req: 864/1746] 10.222.0.33 () {58 vars in 1009 bytes} [Tue Sep 13 20:00:37 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 214 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 20:00:37.953170 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e974b11-6207-45fe-988d-bd6c1700e25f None None] REQUEST_METHOD: `POST` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:00:37.954870 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e974b11-6207-45fe-988d-bd6c1700e25f None None] SCRIPT_NAME: `/identity` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:00:37.955326 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e974b11-6207-45fe-988d-bd6c1700e25f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:00:38.002842 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG dbcounter [-] [82025] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=82025) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 20:00:38.060271 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.auth.core [None req-2e974b11-6207-45fe-988d-bd6c1700e25f None None] MFA Rules not processed for user `57539b6a6f3b4d589f5f5e1d211cd6a0`. Rule list: `[]` (Enabled: `True`). {{(pid=82026) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 20:00:38.071723 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.common.fernet_utils [None req-2e974b11-6207-45fe-988d-bd6c1700e25f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82026) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 20:00:38.101973 dv-cinder-828806-6-smb devstack@keystone.service[82026]: [pid: 82026|app: 0|req: 865/1747] 10.222.0.33 () {58 vars in 958 bytes} [Tue Sep 13 20:00:37 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 151 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 20:00:38.112644 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eabf989d-441f-43ca-bb35-db573ac26d22 None None] REQUEST_METHOD: `POST` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:00:38.112950 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eabf989d-441f-43ca-bb35-db573ac26d22 None None] SCRIPT_NAME: `/identity` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:00:38.116635 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eabf989d-441f-43ca-bb35-db573ac26d22 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:00:38.123088 dv-cinder-828806-6-smb devstack@keystone.service[82025]: [pid: 82025|app: 0|req: 883/1748] 10.222.0.33 () {60 vars in 1144 bytes} [Tue Sep 13 20:00:37 2022] POST /identity/v3/users => generated 294 bytes in 294 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 13 20:00:38.127684 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efedf9dc-f967-4433-be21-f3e692129620 admin admin] Authenticating user token {{(pid=82025) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 20:00:38.133314 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.fernet_utils [None req-efedf9dc-f967-4433-be21-f3e692129620 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82025) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 20:00:38.152457 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.auth.core [None req-eabf989d-441f-43ca-bb35-db573ac26d22 None None] MFA Rules not processed for user `57539b6a6f3b4d589f5f5e1d211cd6a0`. Rule list: `[]` (Enabled: `True`). {{(pid=82026) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 20:00:38.164580 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.common.fernet_utils [None req-eabf989d-441f-43ca-bb35-db573ac26d22 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82026) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 20:00:38.188333 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efedf9dc-f967-4433-be21-f3e692129620 admin admin] Validating token access rules against request {{(pid=82025) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 20:00:38.189030 dv-cinder-828806-6-smb devstack@keystone.service[82026]: [pid: 82026|app: 0|req: 866/1749] 10.222.0.33 () {58 vars in 958 bytes} [Tue Sep 13 20:00:38 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 20:00:38.192877 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eabf989d-441f-43ca-bb35-db573ac26d22 None None] Authenticating user token {{(pid=82026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 20:00:38.208300 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d088fbf-0ad2-4fb5-8f6a-bb2bf0390d6b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57539b6a6f3b4d589f5f5e1d211cd6a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b454f707d20347ada3d82aa85495635e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82025) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 20:00:38.209032 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d088fbf-0ad2-4fb5-8f6a-bb2bf0390d6b admin admin] REQUEST_METHOD: `GET` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:00:38.209430 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d088fbf-0ad2-4fb5-8f6a-bb2bf0390d6b admin admin] SCRIPT_NAME: `/identity` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:00:38.209793 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d088fbf-0ad2-4fb5-8f6a-bb2bf0390d6b admin admin] PATH_INFO: `/v3/roles` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:00:38.210648 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d088fbf-0ad2-4fb5-8f6a-bb2bf0390d6b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 20:00:38.210917 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eabf989d-441f-43ca-bb35-db573ac26d22 None None] Validating token access rules against request {{(pid=82026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 20:00:38.212933 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d088fbf-0ad2-4fb5-8f6a-bb2bf0390d6b admin admin] RBAC: Authorization granted {{(pid=82025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 20:00:38.224245 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fc1ee9b-1fbc-45d5-822d-0272115862d0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57539b6a6f3b4d589f5f5e1d211cd6a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b454f707d20347ada3d82aa85495635e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 20:00:38.224579 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fc1ee9b-1fbc-45d5-822d-0272115862d0 admin admin] REQUEST_METHOD: `GET` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:00:38.224873 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fc1ee9b-1fbc-45d5-822d-0272115862d0 admin admin] SCRIPT_NAME: `/identity` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:00:38.225264 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fc1ee9b-1fbc-45d5-822d-0272115862d0 admin admin] PATH_INFO: `/v3/domains` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:00:38.226315 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fc1ee9b-1fbc-45d5-822d-0272115862d0 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82026) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 20:00:38.228509 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fc1ee9b-1fbc-45d5-822d-0272115862d0 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 20:00:38.234134 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fc1ee9b-1fbc-45d5-822d-0272115862d0 admin admin] RBAC: Authorization granted {{(pid=82026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 20:00:38.250043 dv-cinder-828806-6-smb devstack@keystone.service[82025]: [pid: 82025|app: 0|req: 884/1750] 10.222.0.33 () {58 vars in 1122 bytes} [Tue Sep 13 20:00:38 2022] GET /identity/v3/roles => generated 1420 bytes in 123 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 13 20:00:38.253290 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d088fbf-0ad2-4fb5-8f6a-bb2bf0390d6b admin admin] Authenticating user token {{(pid=82025) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 20:00:38.276282 dv-cinder-828806-6-smb devstack@keystone.service[82026]: [pid: 82026|app: 0|req: 867/1751] 10.222.0.33 () {58 vars in 1153 bytes} [Tue Sep 13 20:00:38 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 82 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 20:00:38.277958 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fc1ee9b-1fbc-45d5-822d-0272115862d0 admin admin] Authenticating user token {{(pid=82026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 20:00:38.289151 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d088fbf-0ad2-4fb5-8f6a-bb2bf0390d6b admin admin] Validating token access rules against request {{(pid=82025) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 20:00:38.304104 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fc1ee9b-1fbc-45d5-822d-0272115862d0 admin admin] Validating token access rules against request {{(pid=82026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 20:00:38.304218 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-656deaa7-9f8a-4bc0-a2d9-b0621c1e4bcf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57539b6a6f3b4d589f5f5e1d211cd6a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b454f707d20347ada3d82aa85495635e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82025) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 20:00:38.304586 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-656deaa7-9f8a-4bc0-a2d9-b0621c1e4bcf admin admin] REQUEST_METHOD: `GET` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:00:38.304876 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-656deaa7-9f8a-4bc0-a2d9-b0621c1e4bcf admin admin] SCRIPT_NAME: `/identity` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:00:38.305156 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-656deaa7-9f8a-4bc0-a2d9-b0621c1e4bcf admin admin] PATH_INFO: `/v3/roles` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:00:38.307596 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-656deaa7-9f8a-4bc0-a2d9-b0621c1e4bcf admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 20:00:38.311663 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-656deaa7-9f8a-4bc0-a2d9-b0621c1e4bcf admin admin] RBAC: Authorization granted {{(pid=82025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 20:00:38.317385 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e67c9b7-d6c8-44a1-8cfb-fbe45b9a0def admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57539b6a6f3b4d589f5f5e1d211cd6a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b454f707d20347ada3d82aa85495635e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 20:00:38.318465 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e67c9b7-d6c8-44a1-8cfb-fbe45b9a0def admin admin] REQUEST_METHOD: `POST` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:00:38.318465 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e67c9b7-d6c8-44a1-8cfb-fbe45b9a0def admin admin] SCRIPT_NAME: `/identity` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:00:38.318660 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e67c9b7-d6c8-44a1-8cfb-fbe45b9a0def admin admin] PATH_INFO: `/v3/projects` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:00:38.319956 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e67c9b7-d6c8-44a1-8cfb-fbe45b9a0def admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 20:00:38.327333 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e67c9b7-d6c8-44a1-8cfb-fbe45b9a0def admin admin] RBAC: Authorization granted {{(pid=82026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 20:00:38.346936 dv-cinder-828806-6-smb devstack@keystone.service[82025]: [pid: 82025|app: 0|req: 885/1752] 10.222.0.33 () {58 vars in 1122 bytes} [Tue Sep 13 20:00:38 2022] GET /identity/v3/roles => generated 1420 bytes in 94 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 13 20:00:38.350651 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-656deaa7-9f8a-4bc0-a2d9-b0621c1e4bcf admin admin] Authenticating user token {{(pid=82025) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 20:00:38.381369 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-656deaa7-9f8a-4bc0-a2d9-b0621c1e4bcf admin admin] Validating token access rules against request {{(pid=82025) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 20:00:38.391188 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61ec82f6-472d-4b53-9513-d865ac49f500 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57539b6a6f3b4d589f5f5e1d211cd6a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b454f707d20347ada3d82aa85495635e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82025) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 20:00:38.395361 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61ec82f6-472d-4b53-9513-d865ac49f500 admin admin] REQUEST_METHOD: `PUT` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:00:38.395361 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61ec82f6-472d-4b53-9513-d865ac49f500 admin admin] SCRIPT_NAME: `/identity` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:00:38.395361 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61ec82f6-472d-4b53-9513-d865ac49f500 admin admin] PATH_INFO: `/v3/projects/59e91acd10f84954b9816f48a6e5930c/users/91cf93c6b4c14801abab39b292ca77d8/roles/3618ab638a65401f82333da7596d1daf` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:00:38.425655 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61ec82f6-472d-4b53-9513-d865ac49f500 admin admin] RBAC: Authorizing `identity:create_grant(project_id=59e91acd10f84954b9816f48a6e5930c, user_id=91cf93c6b4c14801abab39b292ca77d8, role_id=3618ab638a65401f82333da7596d1daf)` {{(pid=82025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 20:00:38.430716 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61ec82f6-472d-4b53-9513-d865ac49f500 admin admin] RBAC: Authorization granted {{(pid=82025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 20:00:38.529303 dv-cinder-828806-6-smb devstack@keystone.service[82026]: [pid: 82026|app: 0|req: 868/1753] 10.222.0.33 () {60 vars in 1153 bytes} [Tue Sep 13 20:00:38 2022] POST /identity/v3/projects => generated 365 bytes in 252 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 13 20:00:38.531360 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e67c9b7-d6c8-44a1-8cfb-fbe45b9a0def admin admin] Authenticating user token {{(pid=82026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 20:00:38.542552 dv-cinder-828806-6-smb devstack@keystone.service[82025]: [pid: 82025|app: 0|req: 886/1754] 10.222.0.33 () {60 vars in 1483 bytes} [Tue Sep 13 20:00:38 2022] PUT /identity/v3/projects/59e91acd10f84954b9816f48a6e5930c/users/91cf93c6b4c14801abab39b292ca77d8/roles/3618ab638a65401f82333da7596d1daf => generated 0 bytes in 194 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 20:00:38.544093 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61ec82f6-472d-4b53-9513-d865ac49f500 admin admin] Authenticating user token {{(pid=82025) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 20:00:38.555729 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.common.fernet_utils [None req-5e67c9b7-d6c8-44a1-8cfb-fbe45b9a0def admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82026) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 20:00:38.739733 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61ec82f6-472d-4b53-9513-d865ac49f500 admin admin] Validating token access rules against request {{(pid=82025) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 20:00:38.757340 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b99de2a0-000e-4d9e-b18a-7654eca5924f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57539b6a6f3b4d589f5f5e1d211cd6a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b454f707d20347ada3d82aa85495635e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82025) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 20:00:38.758937 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b99de2a0-000e-4d9e-b18a-7654eca5924f admin admin] REQUEST_METHOD: `POST` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:00:38.758937 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b99de2a0-000e-4d9e-b18a-7654eca5924f admin admin] SCRIPT_NAME: `/identity` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:00:38.758937 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b99de2a0-000e-4d9e-b18a-7654eca5924f admin admin] PATH_INFO: `/v3/users` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:00:38.760807 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b99de2a0-000e-4d9e-b18a-7654eca5924f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 20:00:38.766080 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b99de2a0-000e-4d9e-b18a-7654eca5924f admin admin] RBAC: Authorization granted {{(pid=82025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 20:00:38.793022 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e67c9b7-d6c8-44a1-8cfb-fbe45b9a0def admin admin] Validating token access rules against request {{(pid=82026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 20:00:38.837611 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG dbcounter [-] [82026] Writing DB stats keystone:SELECT=93,keystone:INSERT=7 {{(pid=82026) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 20:00:38.900375 dv-cinder-828806-6-smb devstack@keystone.service[82025]: [pid: 82025|app: 0|req: 887/1755] 10.222.0.33 () {60 vars in 1144 bytes} [Tue Sep 13 20:00:38 2022] POST /identity/v3/users => generated 283 bytes in 357 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 13 20:00:38.901843 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-110f4602-23a4-408c-9ff8-c7996ee5233a None None] REQUEST_METHOD: `POST` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:00:38.902134 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-110f4602-23a4-408c-9ff8-c7996ee5233a None None] SCRIPT_NAME: `/identity` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:00:38.902406 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-110f4602-23a4-408c-9ff8-c7996ee5233a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:00:38.906877 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4702036-cb95-4ef5-af11-0141e0578664 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa5a83574f7f424c805e130c462d5969', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8c6fba0f15b4d6a84ff601919b7b8e4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 20:00:38.907544 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4702036-cb95-4ef5-af11-0141e0578664 service swift] REQUEST_METHOD: `GET` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:00:38.907830 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4702036-cb95-4ef5-af11-0141e0578664 service swift] SCRIPT_NAME: `/identity` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:00:38.908109 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4702036-cb95-4ef5-af11-0141e0578664 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:00:38.933787 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.auth.core [None req-110f4602-23a4-408c-9ff8-c7996ee5233a None None] MFA Rules not processed for user `91cf93c6b4c14801abab39b292ca77d8`. Rule list: `[]` (Enabled: `True`). {{(pid=82025) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 20:00:38.935136 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.fernet_utils [None req-110f4602-23a4-408c-9ff8-c7996ee5233a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82025) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 20:00:39.000828 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4702036-cb95-4ef5-af11-0141e0578664 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=82026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 20:00:39.002612 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4702036-cb95-4ef5-af11-0141e0578664 service swift] RBAC: Authorization granted {{(pid=82026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 20:00:39.013446 dv-cinder-828806-6-smb devstack@keystone.service[82026]: [pid: 82026|app: 0|req: 869/1756] 10.222.0.33 () {60 vars in 1384 bytes} [Tue Sep 13 20:00:38 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 483 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Sep 13 20:00:39.014335 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4702036-cb95-4ef5-af11-0141e0578664 service swift] Authenticating user token {{(pid=82026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 20:00:39.035742 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4702036-cb95-4ef5-af11-0141e0578664 service swift] Validating token access rules against request {{(pid=82026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 20:00:39.042199 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21760c57-e9ba-401f-b878-0a4b8f0964ae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57539b6a6f3b4d589f5f5e1d211cd6a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b454f707d20347ada3d82aa85495635e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 20:00:39.042912 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21760c57-e9ba-401f-b878-0a4b8f0964ae admin admin] REQUEST_METHOD: `GET` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:00:39.043337 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21760c57-e9ba-401f-b878-0a4b8f0964ae admin admin] SCRIPT_NAME: `/identity` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:00:39.043698 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21760c57-e9ba-401f-b878-0a4b8f0964ae admin admin] PATH_INFO: `/v3/roles` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:00:39.043949 dv-cinder-828806-6-smb devstack@keystone.service[82025]: [pid: 82025|app: 0|req: 888/1757] 10.222.0.33 () {58 vars in 958 bytes} [Tue Sep 13 20:00:38 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 143 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 20:00:39.044695 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21760c57-e9ba-401f-b878-0a4b8f0964ae admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 20:00:39.045452 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-110f4602-23a4-408c-9ff8-c7996ee5233a None None] Authenticating user token {{(pid=82025) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 20:00:39.047897 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21760c57-e9ba-401f-b878-0a4b8f0964ae admin admin] RBAC: Authorization granted {{(pid=82026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 20:00:39.049401 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.fernet_utils [None req-110f4602-23a4-408c-9ff8-c7996ee5233a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82025) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 20:00:39.072251 dv-cinder-828806-6-smb devstack@keystone.service[82026]: [pid: 82026|app: 0|req: 870/1758] 10.222.0.33 () {58 vars in 1122 bytes} [Tue Sep 13 20:00:39 2022] GET /identity/v3/roles => generated 1420 bytes in 58 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 13 20:00:39.073375 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21760c57-e9ba-401f-b878-0a4b8f0964ae admin admin] Authenticating user token {{(pid=82026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 20:00:39.110940 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-110f4602-23a4-408c-9ff8-c7996ee5233a None None] Validating token access rules against request {{(pid=82025) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 20:00:39.127355 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21760c57-e9ba-401f-b878-0a4b8f0964ae admin admin] Validating token access rules against request {{(pid=82026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 20:00:39.151990 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-981cdfe8-a4f3-4982-95b3-e9b93458b3a3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57539b6a6f3b4d589f5f5e1d211cd6a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b454f707d20347ada3d82aa85495635e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82025) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 20:00:39.152875 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-981cdfe8-a4f3-4982-95b3-e9b93458b3a3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:00:39.153258 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-981cdfe8-a4f3-4982-95b3-e9b93458b3a3 admin admin] SCRIPT_NAME: `/identity` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:00:39.153568 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-981cdfe8-a4f3-4982-95b3-e9b93458b3a3 admin admin] PATH_INFO: `/v3/projects/aed69eae14d54740bf597847ea8535f1` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:00:39.155729 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-981cdfe8-a4f3-4982-95b3-e9b93458b3a3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=aed69eae14d54740bf597847ea8535f1)` {{(pid=82025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 20:00:39.158085 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-981cdfe8-a4f3-4982-95b3-e9b93458b3a3 admin admin] RBAC: Authorization granted {{(pid=82025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 20:00:39.159475 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e6c24ba-6ca5-40aa-ba25-be149ff7fe4c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57539b6a6f3b4d589f5f5e1d211cd6a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b454f707d20347ada3d82aa85495635e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 20:00:39.160949 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e6c24ba-6ca5-40aa-ba25-be149ff7fe4c admin admin] REQUEST_METHOD: `POST` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:00:39.173226 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e6c24ba-6ca5-40aa-ba25-be149ff7fe4c admin admin] SCRIPT_NAME: `/identity` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:00:39.194566 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e6c24ba-6ca5-40aa-ba25-be149ff7fe4c admin admin] PATH_INFO: `/v3/projects` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:00:39.203421 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e6c24ba-6ca5-40aa-ba25-be149ff7fe4c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 20:00:39.204410 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e6c24ba-6ca5-40aa-ba25-be149ff7fe4c admin admin] RBAC: Authorization granted {{(pid=82026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 20:00:39.360245 dv-cinder-828806-6-smb devstack@keystone.service[82026]: [pid: 82026|app: 0|req: 871/1759] 10.222.0.33 () {60 vars in 1153 bytes} [Tue Sep 13 20:00:39 2022] POST /identity/v3/projects => generated 387 bytes in 287 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 13 20:00:39.363752 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e6c24ba-6ca5-40aa-ba25-be149ff7fe4c admin admin] Authenticating user token {{(pid=82026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 20:00:39.385328 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.notifications [None req-981cdfe8-a4f3-4982-95b3-e9b93458b3a3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'aed69eae14d54740bf597847ea8535f1', 'request_id': 'req-981cdfe8-a4f3-4982-95b3-e9b93458b3a3'} {{(pid=82025) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 20:00:39.396327 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.notifications [None req-981cdfe8-a4f3-4982-95b3-e9b93458b3a3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'aed69eae14d54740bf597847ea8535f1', 'request_id': 'req-981cdfe8-a4f3-4982-95b3-e9b93458b3a3'} {{(pid=82025) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 20:00:39.431094 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.notifications [None req-981cdfe8-a4f3-4982-95b3-e9b93458b3a3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'aed69eae14d54740bf597847ea8535f1', 'request_id': 'req-981cdfe8-a4f3-4982-95b3-e9b93458b3a3'} {{(pid=82025) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 20:00:39.514701 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.notifications [None req-981cdfe8-a4f3-4982-95b3-e9b93458b3a3 admin admin] The token cache is being invalidate because project aed69eae14d54740bf597847ea8535f1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82025) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 13 20:00:39.515450 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.notifications [None req-981cdfe8-a4f3-4982-95b3-e9b93458b3a3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82025) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 20:00:39.517814 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.notifications [None req-981cdfe8-a4f3-4982-95b3-e9b93458b3a3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82025) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 20:00:39.526113 dv-cinder-828806-6-smb devstack@keystone.service[82025]: [pid: 82025|app: 0|req: 889/1760] 10.222.0.33 () {58 vars in 1233 bytes} [Tue Sep 13 20:00:39 2022] DELETE /identity/v3/projects/aed69eae14d54740bf597847ea8535f1 => generated 0 bytes in 481 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 20:00:39.527159 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-981cdfe8-a4f3-4982-95b3-e9b93458b3a3 admin admin] Authenticating user token {{(pid=82025) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 20:00:39.529417 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.fernet_utils [None req-981cdfe8-a4f3-4982-95b3-e9b93458b3a3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82025) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 20:00:39.674344 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e6c24ba-6ca5-40aa-ba25-be149ff7fe4c admin admin] Validating token access rules against request {{(pid=82026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 20:00:39.711182 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-981cdfe8-a4f3-4982-95b3-e9b93458b3a3 admin admin] Validating token access rules against request {{(pid=82025) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 20:00:39.726238 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ccec906-4bec-4d1a-a7ac-c5afad7de3ef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57539b6a6f3b4d589f5f5e1d211cd6a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b454f707d20347ada3d82aa85495635e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82025) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 20:00:39.726879 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ccec906-4bec-4d1a-a7ac-c5afad7de3ef admin admin] REQUEST_METHOD: `POST` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:00:39.729067 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ccec906-4bec-4d1a-a7ac-c5afad7de3ef admin admin] SCRIPT_NAME: `/identity` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:00:39.729067 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ccec906-4bec-4d1a-a7ac-c5afad7de3ef admin admin] PATH_INFO: `/v3/users` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:00:39.729067 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ccec906-4bec-4d1a-a7ac-c5afad7de3ef admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 20:00:39.739515 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ccec906-4bec-4d1a-a7ac-c5afad7de3ef admin admin] RBAC: Authorization granted {{(pid=82025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 20:00:39.751231 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edae1072-41a9-446d-915d-e87260119ae4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57539b6a6f3b4d589f5f5e1d211cd6a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b454f707d20347ada3d82aa85495635e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 20:00:39.760962 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edae1072-41a9-446d-915d-e87260119ae4 admin admin] REQUEST_METHOD: `GET` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:00:39.760962 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edae1072-41a9-446d-915d-e87260119ae4 admin admin] SCRIPT_NAME: `/identity` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:00:39.760962 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edae1072-41a9-446d-915d-e87260119ae4 admin admin] PATH_INFO: `/v3/roles` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:00:39.769993 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edae1072-41a9-446d-915d-e87260119ae4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 20:00:39.802663 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edae1072-41a9-446d-915d-e87260119ae4 admin admin] RBAC: Authorization granted {{(pid=82026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 20:00:39.844733 dv-cinder-828806-6-smb devstack@keystone.service[82025]: [pid: 82025|app: 0|req: 890/1761] 10.222.0.33 () {60 vars in 1144 bytes} [Tue Sep 13 20:00:39 2022] POST /identity/v3/users => generated 294 bytes in 318 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 13 20:00:39.846076 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-265db72d-cc9e-496c-961d-ef55e7f9e5eb None None] REQUEST_METHOD: `POST` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:00:39.846357 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-265db72d-cc9e-496c-961d-ef55e7f9e5eb None None] SCRIPT_NAME: `/identity` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:00:39.846639 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-265db72d-cc9e-496c-961d-ef55e7f9e5eb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:00:39.854925 dv-cinder-828806-6-smb devstack@keystone.service[82026]: [pid: 82026|app: 0|req: 872/1762] 10.222.0.33 () {58 vars in 1122 bytes} [Tue Sep 13 20:00:39 2022] GET /identity/v3/roles => generated 1420 bytes in 494 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 13 20:00:39.861585 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edae1072-41a9-446d-915d-e87260119ae4 admin admin] Authenticating user token {{(pid=82026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 20:00:39.870139 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG dbcounter [-] [82025] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82025) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 20:00:39.873784 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.common.fernet_utils [None req-edae1072-41a9-446d-915d-e87260119ae4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82026) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 20:00:39.897839 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edae1072-41a9-446d-915d-e87260119ae4 admin admin] Validating token access rules against request {{(pid=82026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 20:00:39.923077 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3b64637-4267-4fa4-b43a-66dce2f7021e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57539b6a6f3b4d589f5f5e1d211cd6a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b454f707d20347ada3d82aa85495635e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 20:00:39.923077 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3b64637-4267-4fa4-b43a-66dce2f7021e admin admin] REQUEST_METHOD: `DELETE` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:00:39.923077 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3b64637-4267-4fa4-b43a-66dce2f7021e admin admin] SCRIPT_NAME: `/identity` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:00:39.923077 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3b64637-4267-4fa4-b43a-66dce2f7021e admin admin] PATH_INFO: `/v3/users/8703006593484f86ba3800e769dc868f` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:00:39.927858 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3b64637-4267-4fa4-b43a-66dce2f7021e admin admin] RBAC: Authorizing `identity:delete_user(user_id=8703006593484f86ba3800e769dc868f)` {{(pid=82026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 20:00:39.938553 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3b64637-4267-4fa4-b43a-66dce2f7021e admin admin] RBAC: Authorization granted {{(pid=82026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 20:00:39.993148 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.auth.core [None req-265db72d-cc9e-496c-961d-ef55e7f9e5eb None None] MFA Rules not processed for user `023a2c79c2444611b3d431928e56685d`. Rule list: `[]` (Enabled: `True`). {{(pid=82025) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 20:00:39.994458 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.fernet_utils [None req-265db72d-cc9e-496c-961d-ef55e7f9e5eb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82025) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 20:00:40.165979 dv-cinder-828806-6-smb devstack@keystone.service[82025]: [pid: 82025|app: 0|req: 891/1763] 10.222.0.16 () {58 vars in 1015 bytes} [Tue Sep 13 20:00:39 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 321 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 20:00:40.169068 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-265db72d-cc9e-496c-961d-ef55e7f9e5eb None None] Authenticating user token {{(pid=82025) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 20:00:40.200954 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-265db72d-cc9e-496c-961d-ef55e7f9e5eb None None] Validating token access rules against request {{(pid=82025) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 20:00:40.209247 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bfe4751-5e63-4fa3-9e5d-132bb9a7e73e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57539b6a6f3b4d589f5f5e1d211cd6a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b454f707d20347ada3d82aa85495635e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82025) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 20:00:40.210703 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bfe4751-5e63-4fa3-9e5d-132bb9a7e73e admin admin] REQUEST_METHOD: `GET` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:00:40.211185 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bfe4751-5e63-4fa3-9e5d-132bb9a7e73e admin admin] SCRIPT_NAME: `/identity` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:00:40.211399 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bfe4751-5e63-4fa3-9e5d-132bb9a7e73e admin admin] PATH_INFO: `/v3/roles` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:00:40.212741 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bfe4751-5e63-4fa3-9e5d-132bb9a7e73e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 20:00:40.215504 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bfe4751-5e63-4fa3-9e5d-132bb9a7e73e admin admin] RBAC: Authorization granted {{(pid=82025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 20:00:40.252942 dv-cinder-828806-6-smb devstack@keystone.service[82025]: [pid: 82025|app: 0|req: 892/1764] 10.222.0.33 () {58 vars in 1122 bytes} [Tue Sep 13 20:00:40 2022] GET /identity/v3/roles => generated 1420 bytes in 86 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 13 20:00:40.255875 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bfe4751-5e63-4fa3-9e5d-132bb9a7e73e admin admin] Authenticating user token {{(pid=82025) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 20:00:40.265619 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.fernet_utils [None req-9bfe4751-5e63-4fa3-9e5d-132bb9a7e73e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82025) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 20:00:40.274193 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.notifications [None req-e3b64637-4267-4fa4-b43a-66dce2f7021e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8703006593484f86ba3800e769dc868f'} {{(pid=82026) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 20:00:40.319266 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bfe4751-5e63-4fa3-9e5d-132bb9a7e73e admin admin] Validating token access rules against request {{(pid=82025) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 20:00:40.353213 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-148e2d33-c52b-4c28-ab0f-fa3be472b397 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57539b6a6f3b4d589f5f5e1d211cd6a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b454f707d20347ada3d82aa85495635e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82025) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 20:00:40.355250 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-148e2d33-c52b-4c28-ab0f-fa3be472b397 admin admin] REQUEST_METHOD: `PUT` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:00:40.355613 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-148e2d33-c52b-4c28-ab0f-fa3be472b397 admin admin] SCRIPT_NAME: `/identity` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:00:40.355910 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-148e2d33-c52b-4c28-ab0f-fa3be472b397 admin admin] PATH_INFO: `/v3/projects/b7da0d2b5dc749e8b92286d64ec857ab/users/e42bf5e6c3b4469b8cfc74a6a40ce82b/roles/3618ab638a65401f82333da7596d1daf` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:00:40.408956 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.notifications [None req-e3b64637-4267-4fa4-b43a-66dce2f7021e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8703006593484f86ba3800e769dc868f'} {{(pid=82026) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 20:00:40.415862 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-148e2d33-c52b-4c28-ab0f-fa3be472b397 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b7da0d2b5dc749e8b92286d64ec857ab, user_id=e42bf5e6c3b4469b8cfc74a6a40ce82b, role_id=3618ab638a65401f82333da7596d1daf)` {{(pid=82025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 20:00:40.418562 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-148e2d33-c52b-4c28-ab0f-fa3be472b397 admin admin] RBAC: Authorization granted {{(pid=82025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 20:00:40.473604 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.notifications [None req-e3b64637-4267-4fa4-b43a-66dce2f7021e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8703006593484f86ba3800e769dc868f'} {{(pid=82026) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 20:00:40.476418 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.notifications [None req-e3b64637-4267-4fa4-b43a-66dce2f7021e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8703006593484f86ba3800e769dc868f'} {{(pid=82026) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 20:00:40.512076 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.notifications [None req-e3b64637-4267-4fa4-b43a-66dce2f7021e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8703006593484f86ba3800e769dc868f'} {{(pid=82026) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 20:00:40.534655 dv-cinder-828806-6-smb devstack@keystone.service[82025]: [pid: 82025|app: 0|req: 893/1765] 10.222.0.33 () {60 vars in 1483 bytes} [Tue Sep 13 20:00:40 2022] PUT /identity/v3/projects/b7da0d2b5dc749e8b92286d64ec857ab/users/e42bf5e6c3b4469b8cfc74a6a40ce82b/roles/3618ab638a65401f82333da7596d1daf => generated 0 bytes in 277 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 20:00:40.534655 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-148e2d33-c52b-4c28-ab0f-fa3be472b397 admin admin] Authenticating user token {{(pid=82025) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 20:00:40.542921 dv-cinder-828806-6-smb devstack@keystone.service[82026]: [pid: 82026|app: 0|req: 873/1766] 10.222.0.33 () {58 vars in 1224 bytes} [Tue Sep 13 20:00:39 2022] DELETE /identity/v3/users/8703006593484f86ba3800e769dc868f => generated 0 bytes in 687 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 20:00:40.544083 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.fernet_utils [None req-148e2d33-c52b-4c28-ab0f-fa3be472b397 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82025) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 20:00:40.547019 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3b64637-4267-4fa4-b43a-66dce2f7021e admin admin] Authenticating user token {{(pid=82026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 20:00:40.551393 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.common.fernet_utils [None req-e3b64637-4267-4fa4-b43a-66dce2f7021e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82026) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 20:00:40.605483 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG dbcounter [-] [82026] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=82026) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 20:00:40.741307 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3b64637-4267-4fa4-b43a-66dce2f7021e admin admin] Validating token access rules against request {{(pid=82026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 20:00:40.744402 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-148e2d33-c52b-4c28-ab0f-fa3be472b397 admin admin] Validating token access rules against request {{(pid=82025) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 20:00:40.750447 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e64bc87-38d9-40ca-82c2-f2230a28c073 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '023a2c79c2444611b3d431928e56685d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8c6fba0f15b4d6a84ff601919b7b8e4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 20:00:40.751116 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e64bc87-38d9-40ca-82c2-f2230a28c073 service neutron] REQUEST_METHOD: `GET` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:00:40.751423 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e64bc87-38d9-40ca-82c2-f2230a28c073 service neutron] SCRIPT_NAME: `/identity` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:00:40.751683 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e64bc87-38d9-40ca-82c2-f2230a28c073 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:00:40.757104 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.common.fernet_utils [None req-2e64bc87-38d9-40ca-82c2-f2230a28c073 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82026) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 20:00:40.783581 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e64bc87-38d9-40ca-82c2-f2230a28c073 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 20:00:40.791238 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e64bc87-38d9-40ca-82c2-f2230a28c073 service neutron] RBAC: Authorization granted {{(pid=82026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 20:00:40.810517 dv-cinder-828806-6-smb devstack@keystone.service[82026]: [pid: 82026|app: 0|req: 874/1767] 10.222.0.33 () {60 vars in 1365 bytes} [Tue Sep 13 20:00:40 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 264 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 20:00:40.814244 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82c2bb05-c28d-45cd-b0e3-1430c8466741 None None] REQUEST_METHOD: `POST` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:00:40.814646 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82c2bb05-c28d-45cd-b0e3-1430c8466741 None None] SCRIPT_NAME: `/identity` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:00:40.814938 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82c2bb05-c28d-45cd-b0e3-1430c8466741 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:00:40.877625 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-211478d8-a4a3-4d0e-9550-7c0cad78956e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57539b6a6f3b4d589f5f5e1d211cd6a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b454f707d20347ada3d82aa85495635e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82025) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 20:00:40.879277 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-211478d8-a4a3-4d0e-9550-7c0cad78956e admin admin] REQUEST_METHOD: `GET` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:00:40.879563 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-211478d8-a4a3-4d0e-9550-7c0cad78956e admin admin] SCRIPT_NAME: `/identity` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:00:40.879837 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-211478d8-a4a3-4d0e-9550-7c0cad78956e admin admin] PATH_INFO: `/v3/roles` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:00:40.880496 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-211478d8-a4a3-4d0e-9550-7c0cad78956e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 20:00:40.884946 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-211478d8-a4a3-4d0e-9550-7c0cad78956e admin admin] RBAC: Authorization granted {{(pid=82025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 20:00:40.897967 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.auth.core [None req-82c2bb05-c28d-45cd-b0e3-1430c8466741 None None] MFA Rules not processed for user `e42bf5e6c3b4469b8cfc74a6a40ce82b`. Rule list: `[]` (Enabled: `True`). {{(pid=82026) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 20:00:40.899418 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.common.fernet_utils [None req-82c2bb05-c28d-45cd-b0e3-1430c8466741 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82026) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 20:00:40.945743 dv-cinder-828806-6-smb devstack@keystone.service[82025]: [pid: 82025|app: 0|req: 894/1768] 10.222.0.33 () {58 vars in 1122 bytes} [Tue Sep 13 20:00:40 2022] GET /identity/v3/roles => generated 1420 bytes in 413 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 13 20:00:40.951974 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-211478d8-a4a3-4d0e-9550-7c0cad78956e admin admin] Authenticating user token {{(pid=82025) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 20:00:41.000852 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-211478d8-a4a3-4d0e-9550-7c0cad78956e admin admin] Validating token access rules against request {{(pid=82025) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 20:00:41.060269 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77b7d354-c603-46c9-8b0d-4bec1a86bc57 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57539b6a6f3b4d589f5f5e1d211cd6a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b454f707d20347ada3d82aa85495635e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82025) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 20:00:41.060269 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77b7d354-c603-46c9-8b0d-4bec1a86bc57 admin admin] REQUEST_METHOD: `PUT` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:00:41.060269 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77b7d354-c603-46c9-8b0d-4bec1a86bc57 admin admin] SCRIPT_NAME: `/identity` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:00:41.060269 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77b7d354-c603-46c9-8b0d-4bec1a86bc57 admin admin] PATH_INFO: `/v3/projects/1443ad8454cf460b97625cc8e2dc6de6/users/08b661d4d07c4f0ba20b1695bfdca4d2/roles/3618ab638a65401f82333da7596d1daf` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:00:41.079002 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77b7d354-c603-46c9-8b0d-4bec1a86bc57 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1443ad8454cf460b97625cc8e2dc6de6, user_id=08b661d4d07c4f0ba20b1695bfdca4d2, role_id=3618ab638a65401f82333da7596d1daf)` {{(pid=82025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 20:00:41.079002 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77b7d354-c603-46c9-8b0d-4bec1a86bc57 admin admin] RBAC: Authorization granted {{(pid=82025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 20:00:41.093683 dv-cinder-828806-6-smb devstack@keystone.service[82026]: [pid: 82026|app: 0|req: 875/1769] 10.222.0.33 () {58 vars in 958 bytes} [Tue Sep 13 20:00:40 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 283 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 20:00:41.099821 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82c2bb05-c28d-45cd-b0e3-1430c8466741 None None] Authenticating user token {{(pid=82026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 20:00:41.101797 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.common.fernet_utils [None req-82c2bb05-c28d-45cd-b0e3-1430c8466741 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82026) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 20:00:41.151491 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82c2bb05-c28d-45cd-b0e3-1430c8466741 None None] Validating token access rules against request {{(pid=82026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 20:00:41.151491 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e59a2804-e399-4132-9f11-542814a02201 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57539b6a6f3b4d589f5f5e1d211cd6a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b454f707d20347ada3d82aa85495635e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 20:00:41.151491 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e59a2804-e399-4132-9f11-542814a02201 admin admin] REQUEST_METHOD: `POST` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:00:41.151491 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e59a2804-e399-4132-9f11-542814a02201 admin admin] SCRIPT_NAME: `/identity` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:00:41.151839 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e59a2804-e399-4132-9f11-542814a02201 admin admin] PATH_INFO: `/v3/projects` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:00:41.151839 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e59a2804-e399-4132-9f11-542814a02201 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 20:00:41.151839 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e59a2804-e399-4132-9f11-542814a02201 admin admin] RBAC: Authorization granted {{(pid=82026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 20:00:41.428292 dv-cinder-828806-6-smb devstack@keystone.service[82025]: [pid: 82025|app: 0|req: 895/1770] 10.222.0.33 () {60 vars in 1483 bytes} [Tue Sep 13 20:00:40 2022] PUT /identity/v3/projects/1443ad8454cf460b97625cc8e2dc6de6/users/08b661d4d07c4f0ba20b1695bfdca4d2/roles/3618ab638a65401f82333da7596d1daf => generated 0 bytes in 477 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 20:00:41.441774 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-455f86f4-0e6c-4210-a93c-29f048e3f252 None None] REQUEST_METHOD: `POST` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:00:41.442694 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-455f86f4-0e6c-4210-a93c-29f048e3f252 None None] SCRIPT_NAME: `/identity` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:00:41.443551 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-455f86f4-0e6c-4210-a93c-29f048e3f252 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:00:41.519808 dv-cinder-828806-6-smb devstack@keystone.service[82026]: [pid: 82026|app: 0|req: 876/1771] 10.222.0.33 () {60 vars in 1153 bytes} [Tue Sep 13 20:00:41 2022] POST /identity/v3/projects => generated 363 bytes in 421 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 13 20:00:41.524576 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e59a2804-e399-4132-9f11-542814a02201 admin admin] Authenticating user token {{(pid=82026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 20:00:41.525206 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.auth.core [None req-455f86f4-0e6c-4210-a93c-29f048e3f252 None None] MFA Rules not processed for user `08b661d4d07c4f0ba20b1695bfdca4d2`. Rule list: `[]` (Enabled: `True`). {{(pid=82025) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 20:00:41.528204 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.fernet_utils [None req-455f86f4-0e6c-4210-a93c-29f048e3f252 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82025) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 20:00:41.764644 dv-cinder-828806-6-smb devstack@keystone.service[82025]: [pid: 82025|app: 0|req: 896/1772] 10.222.0.33 () {58 vars in 958 bytes} [Tue Sep 13 20:00:41 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 326 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 13 20:00:41.771310 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-455f86f4-0e6c-4210-a93c-29f048e3f252 None None] Authenticating user token {{(pid=82025) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 20:00:41.782924 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e59a2804-e399-4132-9f11-542814a02201 admin admin] Validating token access rules against request {{(pid=82026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 20:00:41.810756 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-455f86f4-0e6c-4210-a93c-29f048e3f252 None None] Validating token access rules against request {{(pid=82025) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 20:00:41.814902 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3988547d-1057-4505-a378-68eff1523fd1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57539b6a6f3b4d589f5f5e1d211cd6a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b454f707d20347ada3d82aa85495635e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 20:00:41.815875 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3988547d-1057-4505-a378-68eff1523fd1 admin admin] REQUEST_METHOD: `POST` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:00:41.816009 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3988547d-1057-4505-a378-68eff1523fd1 admin admin] SCRIPT_NAME: `/identity` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:00:41.816218 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3988547d-1057-4505-a378-68eff1523fd1 admin admin] PATH_INFO: `/v3/users` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:00:41.818841 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3988547d-1057-4505-a378-68eff1523fd1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 20:00:41.820880 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3988547d-1057-4505-a378-68eff1523fd1 admin admin] RBAC: Authorization granted {{(pid=82026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 20:00:41.839231 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd12b95e-3e7a-4d1e-a410-9de6b7ca2c13 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57539b6a6f3b4d589f5f5e1d211cd6a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b454f707d20347ada3d82aa85495635e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82025) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 20:00:41.839231 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd12b95e-3e7a-4d1e-a410-9de6b7ca2c13 admin admin] REQUEST_METHOD: `POST` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:00:41.839231 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd12b95e-3e7a-4d1e-a410-9de6b7ca2c13 admin admin] SCRIPT_NAME: `/identity` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:00:41.839231 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd12b95e-3e7a-4d1e-a410-9de6b7ca2c13 admin admin] PATH_INFO: `/v3/projects` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:00:41.847460 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd12b95e-3e7a-4d1e-a410-9de6b7ca2c13 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 20:00:41.849524 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd12b95e-3e7a-4d1e-a410-9de6b7ca2c13 admin admin] RBAC: Authorization granted {{(pid=82025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 20:00:41.973862 dv-cinder-828806-6-smb devstack@keystone.service[82026]: [pid: 82026|app: 0|req: 877/1773] 10.222.0.33 () {60 vars in 1144 bytes} [Tue Sep 13 20:00:41 2022] POST /identity/v3/users => generated 288 bytes in 450 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 13 20:00:41.979655 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3988547d-1057-4505-a378-68eff1523fd1 admin admin] Authenticating user token {{(pid=82026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 20:00:41.990138 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.common.fernet_utils [None req-3988547d-1057-4505-a378-68eff1523fd1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82026) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 20:00:42.038676 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3988547d-1057-4505-a378-68eff1523fd1 admin admin] Validating token access rules against request {{(pid=82026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 20:00:42.057315 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a509b04-71a0-476a-ab17-4cea28d43e34 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57539b6a6f3b4d589f5f5e1d211cd6a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b454f707d20347ada3d82aa85495635e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 20:00:42.058599 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a509b04-71a0-476a-ab17-4cea28d43e34 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:00:42.059626 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a509b04-71a0-476a-ab17-4cea28d43e34 admin admin] SCRIPT_NAME: `/identity` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:00:42.060651 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a509b04-71a0-476a-ab17-4cea28d43e34 admin admin] PATH_INFO: `/v3/projects/428ce6943181444695c189588ae9d624` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:00:42.066904 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a509b04-71a0-476a-ab17-4cea28d43e34 admin admin] RBAC: Authorizing `identity:delete_project(project_id=428ce6943181444695c189588ae9d624)` {{(pid=82026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 20:00:42.070874 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a509b04-71a0-476a-ab17-4cea28d43e34 admin admin] RBAC: Authorization granted {{(pid=82026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 20:00:42.086208 dv-cinder-828806-6-smb devstack@keystone.service[82025]: [pid: 82025|app: 0|req: 897/1774] 10.222.0.33 () {60 vars in 1153 bytes} [Tue Sep 13 20:00:41 2022] POST /identity/v3/projects => generated 385 bytes in 315 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 13 20:00:42.087849 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd12b95e-3e7a-4d1e-a410-9de6b7ca2c13 admin admin] Authenticating user token {{(pid=82025) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 20:00:42.214993 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd12b95e-3e7a-4d1e-a410-9de6b7ca2c13 admin admin] Validating token access rules against request {{(pid=82025) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 20:00:42.221708 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30853282-ed7a-4159-be12-7bebe326ea16 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57539b6a6f3b4d589f5f5e1d211cd6a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b454f707d20347ada3d82aa85495635e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82025) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 20:00:42.224479 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30853282-ed7a-4159-be12-7bebe326ea16 admin admin] REQUEST_METHOD: `GET` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:00:42.224479 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30853282-ed7a-4159-be12-7bebe326ea16 admin admin] SCRIPT_NAME: `/identity` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:00:42.224479 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30853282-ed7a-4159-be12-7bebe326ea16 admin admin] PATH_INFO: `/v3/roles` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:00:42.224479 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30853282-ed7a-4159-be12-7bebe326ea16 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 20:00:42.227071 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30853282-ed7a-4159-be12-7bebe326ea16 admin admin] RBAC: Authorization granted {{(pid=82025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 20:00:42.261496 dv-cinder-828806-6-smb devstack@keystone.service[82025]: [pid: 82025|app: 0|req: 898/1775] 10.222.0.33 () {58 vars in 1122 bytes} [Tue Sep 13 20:00:42 2022] GET /identity/v3/roles => generated 1420 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 13 20:00:42.262972 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30853282-ed7a-4159-be12-7bebe326ea16 admin admin] Authenticating user token {{(pid=82025) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 20:00:42.315063 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.notifications [None req-9a509b04-71a0-476a-ab17-4cea28d43e34 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '428ce6943181444695c189588ae9d624', 'request_id': 'req-9a509b04-71a0-476a-ab17-4cea28d43e34'} {{(pid=82026) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 20:00:42.325289 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30853282-ed7a-4159-be12-7bebe326ea16 admin admin] Validating token access rules against request {{(pid=82025) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 20:00:42.397796 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.notifications [None req-9a509b04-71a0-476a-ab17-4cea28d43e34 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '428ce6943181444695c189588ae9d624', 'request_id': 'req-9a509b04-71a0-476a-ab17-4cea28d43e34'} {{(pid=82026) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 20:00:42.406413 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.notifications [None req-9a509b04-71a0-476a-ab17-4cea28d43e34 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '428ce6943181444695c189588ae9d624', 'request_id': 'req-9a509b04-71a0-476a-ab17-4cea28d43e34'} {{(pid=82026) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 20:00:42.458718 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.notifications [None req-9a509b04-71a0-476a-ab17-4cea28d43e34 admin admin] The token cache is being invalidate because project 428ce6943181444695c189588ae9d624 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82026) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 13 20:00:42.459112 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.notifications [None req-9a509b04-71a0-476a-ab17-4cea28d43e34 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82026) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 20:00:42.461828 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.notifications [None req-9a509b04-71a0-476a-ab17-4cea28d43e34 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82026) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 20:00:42.468750 dv-cinder-828806-6-smb devstack@keystone.service[82026]: [pid: 82026|app: 0|req: 878/1776] 10.222.0.33 () {58 vars in 1233 bytes} [Tue Sep 13 20:00:41 2022] DELETE /identity/v3/projects/428ce6943181444695c189588ae9d624 => generated 0 bytes in 489 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 20:00:42.470017 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a509b04-71a0-476a-ab17-4cea28d43e34 admin admin] Authenticating user token {{(pid=82026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 20:00:42.474138 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.common.fernet_utils [None req-9a509b04-71a0-476a-ab17-4cea28d43e34 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82026) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 20:00:42.521901 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d1fdd44-73a4-49c8-a303-cd746a2d7cb8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57539b6a6f3b4d589f5f5e1d211cd6a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b454f707d20347ada3d82aa85495635e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82025) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 20:00:42.523110 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d1fdd44-73a4-49c8-a303-cd746a2d7cb8 admin admin] REQUEST_METHOD: `POST` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:00:42.523395 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d1fdd44-73a4-49c8-a303-cd746a2d7cb8 admin admin] SCRIPT_NAME: `/identity` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:00:42.527216 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d1fdd44-73a4-49c8-a303-cd746a2d7cb8 admin admin] PATH_INFO: `/v3/users` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:00:42.528995 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d1fdd44-73a4-49c8-a303-cd746a2d7cb8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 20:00:42.538792 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d1fdd44-73a4-49c8-a303-cd746a2d7cb8 admin admin] RBAC: Authorization granted {{(pid=82025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 20:00:42.658973 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a509b04-71a0-476a-ab17-4cea28d43e34 admin admin] Validating token access rules against request {{(pid=82026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 20:00:42.690335 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09cda6f4-573e-49ca-9d91-a736922e5892 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57539b6a6f3b4d589f5f5e1d211cd6a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b454f707d20347ada3d82aa85495635e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 20:00:42.690335 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09cda6f4-573e-49ca-9d91-a736922e5892 admin admin] REQUEST_METHOD: `PUT` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:00:42.690335 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09cda6f4-573e-49ca-9d91-a736922e5892 admin admin] SCRIPT_NAME: `/identity` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:00:42.690335 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09cda6f4-573e-49ca-9d91-a736922e5892 admin admin] PATH_INFO: `/v3/projects/cde4f00a3dce432a9e85f3481beae98c/users/86f36467fa08420883221c464d50f2b9/roles/e5af7d5baa93469e9e486ef21c85474e` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:00:42.690861 dv-cinder-828806-6-smb devstack@keystone.service[82025]: [pid: 82025|app: 0|req: 899/1777] 10.222.0.33 () {60 vars in 1144 bytes} [Tue Sep 13 20:00:42 2022] POST /identity/v3/users => generated 299 bytes in 417 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 13 20:00:42.690861 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61446775-74bb-4457-96b3-ce76e7874707 None None] REQUEST_METHOD: `POST` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:00:42.690861 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61446775-74bb-4457-96b3-ce76e7874707 None None] SCRIPT_NAME: `/identity` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:00:42.690861 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61446775-74bb-4457-96b3-ce76e7874707 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:00:42.712716 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09cda6f4-573e-49ca-9d91-a736922e5892 admin admin] RBAC: Authorizing `identity:create_grant(project_id=cde4f00a3dce432a9e85f3481beae98c, user_id=86f36467fa08420883221c464d50f2b9, role_id=e5af7d5baa93469e9e486ef21c85474e)` {{(pid=82026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 20:00:42.717291 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09cda6f4-573e-49ca-9d91-a736922e5892 admin admin] RBAC: Authorization granted {{(pid=82026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 20:00:42.733272 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.auth.core [None req-61446775-74bb-4457-96b3-ce76e7874707 None None] MFA Rules not processed for user `57539b6a6f3b4d589f5f5e1d211cd6a0`. Rule list: `[]` (Enabled: `True`). {{(pid=82025) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 20:00:42.734652 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.fernet_utils [None req-61446775-74bb-4457-96b3-ce76e7874707 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82025) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 20:00:42.749841 dv-cinder-828806-6-smb devstack@keystone.service[82025]: [pid: 82025|app: 0|req: 900/1778] 10.222.0.33 () {58 vars in 958 bytes} [Tue Sep 13 20:00:42 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 70 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 20:00:42.750915 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61446775-74bb-4457-96b3-ce76e7874707 None None] Authenticating user token {{(pid=82025) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 20:00:42.761255 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.fernet_utils [None req-61446775-74bb-4457-96b3-ce76e7874707 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82025) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 20:00:42.779500 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61446775-74bb-4457-96b3-ce76e7874707 None None] Validating token access rules against request {{(pid=82025) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 20:00:42.789448 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48aa2c2e-3a58-4e36-9f52-66b5fbf9f5c3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57539b6a6f3b4d589f5f5e1d211cd6a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b454f707d20347ada3d82aa85495635e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82025) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 20:00:42.799547 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48aa2c2e-3a58-4e36-9f52-66b5fbf9f5c3 admin admin] REQUEST_METHOD: `GET` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:00:42.800787 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48aa2c2e-3a58-4e36-9f52-66b5fbf9f5c3 admin admin] SCRIPT_NAME: `/identity` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:00:42.800787 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48aa2c2e-3a58-4e36-9f52-66b5fbf9f5c3 admin admin] PATH_INFO: `/v3/roles` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:00:42.801332 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48aa2c2e-3a58-4e36-9f52-66b5fbf9f5c3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 20:00:42.804411 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48aa2c2e-3a58-4e36-9f52-66b5fbf9f5c3 admin admin] RBAC: Authorization granted {{(pid=82025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 20:00:42.806789 dv-cinder-828806-6-smb devstack@keystone.service[82026]: [pid: 82026|app: 0|req: 879/1779] 10.222.0.33 () {60 vars in 1483 bytes} [Tue Sep 13 20:00:42 2022] PUT /identity/v3/projects/cde4f00a3dce432a9e85f3481beae98c/users/86f36467fa08420883221c464d50f2b9/roles/e5af7d5baa93469e9e486ef21c85474e => generated 0 bytes in 337 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 20:00:42.808830 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cac1ccfb-e323-4a76-98d8-83adfa4470d2 None None] REQUEST_METHOD: `POST` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:00:42.809428 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cac1ccfb-e323-4a76-98d8-83adfa4470d2 None None] SCRIPT_NAME: `/identity` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:00:42.809853 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cac1ccfb-e323-4a76-98d8-83adfa4470d2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:00:42.823303 dv-cinder-828806-6-smb devstack@keystone.service[82025]: [pid: 82025|app: 0|req: 901/1780] 10.222.0.33 () {58 vars in 1122 bytes} [Tue Sep 13 20:00:42 2022] GET /identity/v3/roles => generated 1420 bytes in 72 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 13 20:00:42.826962 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48aa2c2e-3a58-4e36-9f52-66b5fbf9f5c3 admin admin] Authenticating user token {{(pid=82025) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 20:00:42.839485 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48aa2c2e-3a58-4e36-9f52-66b5fbf9f5c3 admin admin] Validating token access rules against request {{(pid=82025) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 20:00:42.846078 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.auth.core [None req-cac1ccfb-e323-4a76-98d8-83adfa4470d2 None None] MFA Rules not processed for user `57539b6a6f3b4d589f5f5e1d211cd6a0`. Rule list: `[]` (Enabled: `True`). {{(pid=82026) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 20:00:42.849957 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.common.fernet_utils [None req-cac1ccfb-e323-4a76-98d8-83adfa4470d2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82026) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 20:00:42.943219 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9de445f3-751e-49ab-b1d9-918835272be5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57539b6a6f3b4d589f5f5e1d211cd6a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b454f707d20347ada3d82aa85495635e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82025) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 20:00:42.944263 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9de445f3-751e-49ab-b1d9-918835272be5 admin admin] REQUEST_METHOD: `GET` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:00:42.944924 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9de445f3-751e-49ab-b1d9-918835272be5 admin admin] SCRIPT_NAME: `/identity` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:00:42.945278 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9de445f3-751e-49ab-b1d9-918835272be5 admin admin] PATH_INFO: `/v3/roles` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:00:42.946010 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9de445f3-751e-49ab-b1d9-918835272be5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 20:00:42.947967 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9de445f3-751e-49ab-b1d9-918835272be5 admin admin] RBAC: Authorization granted {{(pid=82025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 20:00:42.964124 dv-cinder-828806-6-smb devstack@keystone.service[82025]: [pid: 82025|app: 0|req: 902/1781] 10.222.0.33 () {58 vars in 1122 bytes} [Tue Sep 13 20:00:42 2022] GET /identity/v3/roles => generated 1420 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 13 20:00:42.964760 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9de445f3-751e-49ab-b1d9-918835272be5 admin admin] Authenticating user token {{(pid=82025) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 20:00:42.964928 dv-cinder-828806-6-smb devstack@keystone.service[82026]: [pid: 82026|app: 0|req: 880/1782] 10.222.0.33 () {58 vars in 958 bytes} [Tue Sep 13 20:00:42 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 157 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 20:00:42.966003 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cac1ccfb-e323-4a76-98d8-83adfa4470d2 None None] Authenticating user token {{(pid=82026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 20:00:42.976702 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cac1ccfb-e323-4a76-98d8-83adfa4470d2 None None] Validating token access rules against request {{(pid=82026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 20:00:42.977578 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9de445f3-751e-49ab-b1d9-918835272be5 admin admin] Validating token access rules against request {{(pid=82025) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 20:00:42.982121 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-482b740d-ce30-4547-adb4-67f2382a077d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57539b6a6f3b4d589f5f5e1d211cd6a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b454f707d20347ada3d82aa85495635e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 20:00:42.982750 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-482b740d-ce30-4547-adb4-67f2382a077d admin admin] REQUEST_METHOD: `GET` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:00:42.983207 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-482b740d-ce30-4547-adb4-67f2382a077d admin admin] SCRIPT_NAME: `/identity` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:00:42.983494 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-482b740d-ce30-4547-adb4-67f2382a077d admin admin] PATH_INFO: `/v3/domains` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:00:42.984123 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91192c24-90ef-4ca0-b241-26de6ee458c7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57539b6a6f3b4d589f5f5e1d211cd6a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b454f707d20347ada3d82aa85495635e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82025) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 20:00:42.984309 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-482b740d-ce30-4547-adb4-67f2382a077d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82026) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 20:00:42.984529 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-482b740d-ce30-4547-adb4-67f2382a077d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 20:00:42.985490 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91192c24-90ef-4ca0-b241-26de6ee458c7 admin admin] REQUEST_METHOD: `PUT` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:00:42.985935 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91192c24-90ef-4ca0-b241-26de6ee458c7 admin admin] SCRIPT_NAME: `/identity` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:00:42.986156 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-482b740d-ce30-4547-adb4-67f2382a077d admin admin] RBAC: Authorization granted {{(pid=82026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 20:00:42.986607 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91192c24-90ef-4ca0-b241-26de6ee458c7 admin admin] PATH_INFO: `/v3/projects/8361b86ef1d94715bade591e07fba637/users/9c853c7a3f85477eac059dd98b7eed0d/roles/e5af7d5baa93469e9e486ef21c85474e` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:00:43.000926 dv-cinder-828806-6-smb devstack@keystone.service[82026]: [pid: 82026|app: 0|req: 881/1783] 10.222.0.33 () {58 vars in 1153 bytes} [Tue Sep 13 20:00:42 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 20:00:43.002324 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-482b740d-ce30-4547-adb4-67f2382a077d admin admin] Authenticating user token {{(pid=82026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 20:00:43.009825 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91192c24-90ef-4ca0-b241-26de6ee458c7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8361b86ef1d94715bade591e07fba637, user_id=9c853c7a3f85477eac059dd98b7eed0d, role_id=e5af7d5baa93469e9e486ef21c85474e)` {{(pid=82025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 20:00:43.012915 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91192c24-90ef-4ca0-b241-26de6ee458c7 admin admin] RBAC: Authorization granted {{(pid=82025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 20:00:43.017968 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-482b740d-ce30-4547-adb4-67f2382a077d admin admin] Validating token access rules against request {{(pid=82026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 20:00:43.027839 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5eb0b40d-0e57-4bea-99a1-14f6a6970fc8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57539b6a6f3b4d589f5f5e1d211cd6a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b454f707d20347ada3d82aa85495635e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 20:00:43.029028 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eb0b40d-0e57-4bea-99a1-14f6a6970fc8 admin admin] REQUEST_METHOD: `PUT` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:00:43.029028 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eb0b40d-0e57-4bea-99a1-14f6a6970fc8 admin admin] SCRIPT_NAME: `/identity` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:00:43.029252 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eb0b40d-0e57-4bea-99a1-14f6a6970fc8 admin admin] PATH_INFO: `/v3/projects/cde4f00a3dce432a9e85f3481beae98c/users/86f36467fa08420883221c464d50f2b9/roles/e5af7d5baa93469e9e486ef21c85474e` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:00:43.031307 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5eb0b40d-0e57-4bea-99a1-14f6a6970fc8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=cde4f00a3dce432a9e85f3481beae98c, user_id=86f36467fa08420883221c464d50f2b9, role_id=e5af7d5baa93469e9e486ef21c85474e)` {{(pid=82026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 20:00:43.034054 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5eb0b40d-0e57-4bea-99a1-14f6a6970fc8 admin admin] RBAC: Authorization granted {{(pid=82026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 20:00:43.051896 dv-cinder-828806-6-smb devstack@keystone.service[82026]: [pid: 82026|app: 0|req: 882/1784] 10.222.0.33 () {60 vars in 1483 bytes} [Tue Sep 13 20:00:43 2022] PUT /identity/v3/projects/cde4f00a3dce432a9e85f3481beae98c/users/86f36467fa08420883221c464d50f2b9/roles/e5af7d5baa93469e9e486ef21c85474e => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 20:00:43.052746 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5eb0b40d-0e57-4bea-99a1-14f6a6970fc8 admin admin] Authenticating user token {{(pid=82026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 20:00:43.134507 dv-cinder-828806-6-smb devstack@keystone.service[82025]: [pid: 82025|app: 0|req: 903/1785] 10.222.0.33 () {60 vars in 1483 bytes} [Tue Sep 13 20:00:42 2022] PUT /identity/v3/projects/8361b86ef1d94715bade591e07fba637/users/9c853c7a3f85477eac059dd98b7eed0d/roles/e5af7d5baa93469e9e486ef21c85474e => generated 0 bytes in 167 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 20:00:43.134507 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68d3f078-3afe-4140-9128-c2d1526caff0 None None] REQUEST_METHOD: `POST` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:00:43.137467 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68d3f078-3afe-4140-9128-c2d1526caff0 None None] SCRIPT_NAME: `/identity` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:00:43.138386 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68d3f078-3afe-4140-9128-c2d1526caff0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:00:43.168477 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5eb0b40d-0e57-4bea-99a1-14f6a6970fc8 admin admin] Validating token access rules against request {{(pid=82026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 20:00:43.227488 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.auth.core [None req-68d3f078-3afe-4140-9128-c2d1526caff0 None None] MFA Rules not processed for user `86f36467fa08420883221c464d50f2b9`. Rule list: `[]` (Enabled: `True`). {{(pid=82025) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 20:00:43.228854 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.fernet_utils [None req-68d3f078-3afe-4140-9128-c2d1526caff0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82025) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 20:00:43.246799 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG dbcounter [-] [82026] Writing DB stats keystone:SELECT=93,keystone:INSERT=1,keystone:DELETE=6 {{(pid=82026) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 20:00:43.356589 dv-cinder-828806-6-smb devstack@keystone.service[82025]: [pid: 82025|app: 0|req: 904/1786] 10.222.0.33 () {58 vars in 958 bytes} [Tue Sep 13 20:00:43 2022] POST /identity/v3/auth/tokens => generated 3307 bytes in 225 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 20:00:43.357463 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68d3f078-3afe-4140-9128-c2d1526caff0 None None] Authenticating user token {{(pid=82025) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 20:00:43.393278 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b3d77cc-14c1-4537-a8c8-e05b1d1e6e84 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57539b6a6f3b4d589f5f5e1d211cd6a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b454f707d20347ada3d82aa85495635e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 20:00:43.395464 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b3d77cc-14c1-4537-a8c8-e05b1d1e6e84 admin admin] REQUEST_METHOD: `POST` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:00:43.398871 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b3d77cc-14c1-4537-a8c8-e05b1d1e6e84 admin admin] SCRIPT_NAME: `/identity` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:00:43.400285 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b3d77cc-14c1-4537-a8c8-e05b1d1e6e84 admin admin] PATH_INFO: `/v3/projects` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:00:43.401700 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b3d77cc-14c1-4537-a8c8-e05b1d1e6e84 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 20:00:43.407121 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b3d77cc-14c1-4537-a8c8-e05b1d1e6e84 admin admin] RBAC: Authorization granted {{(pid=82026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 20:00:43.459160 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG dbcounter [-] [82025] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=82025) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 20:00:43.536851 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68d3f078-3afe-4140-9128-c2d1526caff0 None None] Validating token access rules against request {{(pid=82025) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 20:00:43.541427 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bb07f79-3b4b-4856-a976-9414182a89c7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57539b6a6f3b4d589f5f5e1d211cd6a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b454f707d20347ada3d82aa85495635e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82025) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 20:00:43.542451 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bb07f79-3b4b-4856-a976-9414182a89c7 admin admin] REQUEST_METHOD: `GET` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:00:43.543539 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bb07f79-3b4b-4856-a976-9414182a89c7 admin admin] SCRIPT_NAME: `/identity` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:00:43.544010 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bb07f79-3b4b-4856-a976-9414182a89c7 admin admin] PATH_INFO: `/v3/roles` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:00:43.545102 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bb07f79-3b4b-4856-a976-9414182a89c7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 20:00:43.547538 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bb07f79-3b4b-4856-a976-9414182a89c7 admin admin] RBAC: Authorization granted {{(pid=82025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 20:00:43.567127 dv-cinder-828806-6-smb devstack@keystone.service[82026]: [pid: 82026|app: 0|req: 883/1787] 10.222.0.33 () {60 vars in 1153 bytes} [Tue Sep 13 20:00:43 2022] POST /identity/v3/projects => generated 385 bytes in 514 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 13 20:00:43.568650 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b3d77cc-14c1-4537-a8c8-e05b1d1e6e84 admin admin] Authenticating user token {{(pid=82026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 20:00:43.571579 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.common.fernet_utils [None req-2b3d77cc-14c1-4537-a8c8-e05b1d1e6e84 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82026) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 20:00:43.590557 dv-cinder-828806-6-smb devstack@keystone.service[82025]: [pid: 82025|app: 0|req: 905/1788] 10.222.0.33 () {58 vars in 1122 bytes} [Tue Sep 13 20:00:43 2022] GET /identity/v3/roles => generated 1420 bytes in 233 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 13 20:00:43.595487 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bb07f79-3b4b-4856-a976-9414182a89c7 admin admin] Authenticating user token {{(pid=82025) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 20:00:43.603946 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bb07f79-3b4b-4856-a976-9414182a89c7 admin admin] Validating token access rules against request {{(pid=82025) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 20:00:43.827906 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b3d77cc-14c1-4537-a8c8-e05b1d1e6e84 admin admin] Validating token access rules against request {{(pid=82026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 20:00:43.829254 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbbac588-8893-4e6b-a31f-3fa896e81c96 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57539b6a6f3b4d589f5f5e1d211cd6a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b454f707d20347ada3d82aa85495635e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82025) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 20:00:43.831387 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbbac588-8893-4e6b-a31f-3fa896e81c96 admin admin] REQUEST_METHOD: `POST` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:00:43.834108 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbbac588-8893-4e6b-a31f-3fa896e81c96 admin admin] SCRIPT_NAME: `/identity` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:00:43.834108 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbbac588-8893-4e6b-a31f-3fa896e81c96 admin admin] PATH_INFO: `/v3/users` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:00:43.834108 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbbac588-8893-4e6b-a31f-3fa896e81c96 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 20:00:43.836631 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbbac588-8893-4e6b-a31f-3fa896e81c96 admin admin] RBAC: Authorization granted {{(pid=82025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 20:00:43.850871 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-023f1ff4-6236-4672-af72-17c917b40ff4 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46024fc6167f4321818b1bed27a521a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8c6fba0f15b4d6a84ff601919b7b8e4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 20:00:43.852240 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-023f1ff4-6236-4672-af72-17c917b40ff4 service cinder] REQUEST_METHOD: `GET` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:00:43.858841 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-023f1ff4-6236-4672-af72-17c917b40ff4 service cinder] SCRIPT_NAME: `/identity` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:00:43.858841 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-023f1ff4-6236-4672-af72-17c917b40ff4 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:00:43.991448 dv-cinder-828806-6-smb devstack@keystone.service[82025]: [pid: 82025|app: 0|req: 906/1789] 10.222.0.33 () {60 vars in 1144 bytes} [Tue Sep 13 20:00:43 2022] POST /identity/v3/users => generated 293 bytes in 400 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 13 20:00:43.994201 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbbac588-8893-4e6b-a31f-3fa896e81c96 admin admin] Authenticating user token {{(pid=82025) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 20:00:44.025487 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbbac588-8893-4e6b-a31f-3fa896e81c96 admin admin] Validating token access rules against request {{(pid=82025) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 20:00:44.032654 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bafff222-9318-4cb1-97d1-0c7db31eaa96 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57539b6a6f3b4d589f5f5e1d211cd6a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b454f707d20347ada3d82aa85495635e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82025) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 20:00:44.032870 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-023f1ff4-6236-4672-af72-17c917b40ff4 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=82026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 20:00:44.033728 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bafff222-9318-4cb1-97d1-0c7db31eaa96 admin admin] REQUEST_METHOD: `PUT` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:00:44.034567 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-023f1ff4-6236-4672-af72-17c917b40ff4 service cinder] RBAC: Authorization granted {{(pid=82026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 20:00:44.035492 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bafff222-9318-4cb1-97d1-0c7db31eaa96 admin admin] SCRIPT_NAME: `/identity` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:00:44.035951 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bafff222-9318-4cb1-97d1-0c7db31eaa96 admin admin] PATH_INFO: `/v3/projects/8361b86ef1d94715bade591e07fba637/users/9c853c7a3f85477eac059dd98b7eed0d/roles/e5af7d5baa93469e9e486ef21c85474e` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:00:44.041698 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bafff222-9318-4cb1-97d1-0c7db31eaa96 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8361b86ef1d94715bade591e07fba637, user_id=9c853c7a3f85477eac059dd98b7eed0d, role_id=e5af7d5baa93469e9e486ef21c85474e)` {{(pid=82025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 20:00:44.046996 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bafff222-9318-4cb1-97d1-0c7db31eaa96 admin admin] RBAC: Authorization granted {{(pid=82025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 20:00:44.090958 dv-cinder-828806-6-smb devstack@keystone.service[82025]: [pid: 82025|app: 0|req: 907/1790] 10.222.0.33 () {60 vars in 1483 bytes} [Tue Sep 13 20:00:43 2022] PUT /identity/v3/projects/8361b86ef1d94715bade591e07fba637/users/9c853c7a3f85477eac059dd98b7eed0d/roles/e5af7d5baa93469e9e486ef21c85474e => generated 0 bytes in 89 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 20:00:44.091674 dv-cinder-828806-6-smb devstack@keystone.service[82026]: [pid: 82026|app: 0|req: 884/1791] 10.222.0.33 () {60 vars in 1365 bytes} [Tue Sep 13 20:00:43 2022] GET /identity/v3/auth/tokens => generated 3307 bytes in 513 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 20:00:44.091779 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bafff222-9318-4cb1-97d1-0c7db31eaa96 admin admin] Authenticating user token {{(pid=82025) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 20:00:44.093227 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79ebfce0-7e53-43e0-bc83-f45a2433b501 None None] REQUEST_METHOD: `POST` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:00:44.094829 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79ebfce0-7e53-43e0-bc83-f45a2433b501 None None] SCRIPT_NAME: `/identity` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:00:44.095213 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79ebfce0-7e53-43e0-bc83-f45a2433b501 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:00:44.130759 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.auth.core [None req-79ebfce0-7e53-43e0-bc83-f45a2433b501 None None] MFA Rules not processed for user `9c853c7a3f85477eac059dd98b7eed0d`. Rule list: `[]` (Enabled: `True`). {{(pid=82026) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 20:00:44.132173 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.common.fernet_utils [None req-79ebfce0-7e53-43e0-bc83-f45a2433b501 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82026) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 20:00:44.219090 dv-cinder-828806-6-smb devstack@keystone.service[82026]: [pid: 82026|app: 0|req: 885/1792] 10.222.0.33 () {58 vars in 958 bytes} [Tue Sep 13 20:00:44 2022] POST /identity/v3/auth/tokens => generated 3329 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 20:00:44.237158 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bafff222-9318-4cb1-97d1-0c7db31eaa96 admin admin] Validating token access rules against request {{(pid=82025) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 20:00:44.247662 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47f76c30-489d-4966-895f-9237ef21bc26 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57539b6a6f3b4d589f5f5e1d211cd6a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b454f707d20347ada3d82aa85495635e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82025) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 20:00:44.248289 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47f76c30-489d-4966-895f-9237ef21bc26 admin admin] REQUEST_METHOD: `GET` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:00:44.249003 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47f76c30-489d-4966-895f-9237ef21bc26 admin admin] SCRIPT_NAME: `/identity` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:00:44.249685 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47f76c30-489d-4966-895f-9237ef21bc26 admin admin] PATH_INFO: `/v3/roles` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:00:44.251066 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47f76c30-489d-4966-895f-9237ef21bc26 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 20:00:44.254991 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47f76c30-489d-4966-895f-9237ef21bc26 admin admin] RBAC: Authorization granted {{(pid=82025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 20:00:44.308978 dv-cinder-828806-6-smb devstack@keystone.service[82025]: [pid: 82025|app: 0|req: 908/1793] 10.222.0.33 () {58 vars in 1122 bytes} [Tue Sep 13 20:00:44 2022] GET /identity/v3/roles => generated 1420 bytes in 225 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 13 20:00:44.310626 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79ebfce0-7e53-43e0-bc83-f45a2433b501 None None] Authenticating user token {{(pid=82026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 20:00:44.311873 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47f76c30-489d-4966-895f-9237ef21bc26 admin admin] Authenticating user token {{(pid=82025) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 20:00:44.319573 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.fernet_utils [None req-47f76c30-489d-4966-895f-9237ef21bc26 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82025) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 20:00:44.328902 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79ebfce0-7e53-43e0-bc83-f45a2433b501 None None] Validating token access rules against request {{(pid=82026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 20:00:44.341153 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a970bc0-80ed-4506-b3da-09d1cfff464d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57539b6a6f3b4d589f5f5e1d211cd6a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b454f707d20347ada3d82aa85495635e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 20:00:44.341844 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a970bc0-80ed-4506-b3da-09d1cfff464d admin admin] REQUEST_METHOD: `GET` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:00:44.342224 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a970bc0-80ed-4506-b3da-09d1cfff464d admin admin] SCRIPT_NAME: `/identity` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:00:44.342469 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a970bc0-80ed-4506-b3da-09d1cfff464d admin admin] PATH_INFO: `/v3/roles` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:00:44.343191 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a970bc0-80ed-4506-b3da-09d1cfff464d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 20:00:44.345951 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a970bc0-80ed-4506-b3da-09d1cfff464d admin admin] RBAC: Authorization granted {{(pid=82026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 20:00:44.373791 dv-cinder-828806-6-smb devstack@keystone.service[82026]: [pid: 82026|app: 0|req: 886/1794] 10.222.0.33 () {58 vars in 1122 bytes} [Tue Sep 13 20:00:44 2022] GET /identity/v3/roles => generated 1420 bytes in 64 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 13 20:00:44.377939 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a970bc0-80ed-4506-b3da-09d1cfff464d admin admin] Authenticating user token {{(pid=82026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 20:00:44.397227 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a970bc0-80ed-4506-b3da-09d1cfff464d admin admin] Validating token access rules against request {{(pid=82026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 20:00:44.406084 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1945e29-8001-46e3-8288-d07a4be43313 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57539b6a6f3b4d589f5f5e1d211cd6a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b454f707d20347ada3d82aa85495635e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 20:00:44.407392 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1945e29-8001-46e3-8288-d07a4be43313 admin admin] REQUEST_METHOD: `PUT` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:00:44.407946 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1945e29-8001-46e3-8288-d07a4be43313 admin admin] SCRIPT_NAME: `/identity` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:00:44.408843 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1945e29-8001-46e3-8288-d07a4be43313 admin admin] PATH_INFO: `/v3/projects/704cd8d828374c4aae144935d4ec2dbb/users/1c9169f1652149cfadc8c2b2193773dc/roles/3618ab638a65401f82333da7596d1daf` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:00:44.441100 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1945e29-8001-46e3-8288-d07a4be43313 admin admin] RBAC: Authorizing `identity:create_grant(project_id=704cd8d828374c4aae144935d4ec2dbb, user_id=1c9169f1652149cfadc8c2b2193773dc, role_id=3618ab638a65401f82333da7596d1daf)` {{(pid=82026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 20:00:44.448236 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1945e29-8001-46e3-8288-d07a4be43313 admin admin] RBAC: Authorization granted {{(pid=82026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 20:00:44.465421 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47f76c30-489d-4966-895f-9237ef21bc26 admin admin] Validating token access rules against request {{(pid=82025) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 20:00:44.478096 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aeb67cca-4da1-43b3-88ad-84bdfab83b20 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46024fc6167f4321818b1bed27a521a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8c6fba0f15b4d6a84ff601919b7b8e4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82025) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 20:00:44.479334 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeb67cca-4da1-43b3-88ad-84bdfab83b20 service cinder] REQUEST_METHOD: `GET` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:00:44.479782 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeb67cca-4da1-43b3-88ad-84bdfab83b20 service cinder] SCRIPT_NAME: `/identity` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:00:44.480180 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeb67cca-4da1-43b3-88ad-84bdfab83b20 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:00:44.517769 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aeb67cca-4da1-43b3-88ad-84bdfab83b20 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=82025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 20:00:44.546797 dv-cinder-828806-6-smb devstack@keystone.service[82026]: [pid: 82026|app: 0|req: 887/1795] 10.222.0.33 () {60 vars in 1483 bytes} [Tue Sep 13 20:00:44 2022] PUT /identity/v3/projects/704cd8d828374c4aae144935d4ec2dbb/users/1c9169f1652149cfadc8c2b2193773dc/roles/3618ab638a65401f82333da7596d1daf => generated 0 bytes in 169 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 20:00:44.549365 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aeb67cca-4da1-43b3-88ad-84bdfab83b20 service cinder] RBAC: Authorization granted {{(pid=82025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 20:00:44.562896 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11601d2e-1a68-40f7-8c57-ff55682a661a None None] REQUEST_METHOD: `GET` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:00:44.567142 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11601d2e-1a68-40f7-8c57-ff55682a661a None None] SCRIPT_NAME: `/identity` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:00:44.568104 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11601d2e-1a68-40f7-8c57-ff55682a661a None None] PATH_INFO: `/` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:00:44.571472 dv-cinder-828806-6-smb devstack@keystone.service[82026]: [pid: 82026|app: 0|req: 888/1796] 10.222.0.33 () {54 vars in 921 bytes} [Tue Sep 13 20:00:44 2022] GET /identity => generated 270 bytes in 23 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 20:00:44.578498 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de45b175-5d4b-4c16-819e-1f06c50e4293 None None] REQUEST_METHOD: `POST` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:00:44.578862 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de45b175-5d4b-4c16-819e-1f06c50e4293 None None] SCRIPT_NAME: `/identity` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:00:44.579185 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de45b175-5d4b-4c16-819e-1f06c50e4293 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:00:44.595018 dv-cinder-828806-6-smb devstack@keystone.service[82025]: [pid: 82025|app: 0|req: 909/1797] 10.222.0.33 () {60 vars in 1365 bytes} [Tue Sep 13 20:00:44 2022] GET /identity/v3/auth/tokens => generated 3329 bytes in 284 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 13 20:00:44.638325 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.auth.core [None req-de45b175-5d4b-4c16-819e-1f06c50e4293 None None] MFA Rules not processed for user `1c9169f1652149cfadc8c2b2193773dc`. Rule list: `[]` (Enabled: `True`). {{(pid=82026) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 20:00:44.642758 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.common.fernet_utils [None req-de45b175-5d4b-4c16-819e-1f06c50e4293 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82026) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 20:00:44.658875 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eddf5ac9-6ee9-4cb6-89b1-4afd4cfaf460 None None] REQUEST_METHOD: `POST` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:00:44.659222 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eddf5ac9-6ee9-4cb6-89b1-4afd4cfaf460 None None] SCRIPT_NAME: `/identity` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:00:44.659535 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eddf5ac9-6ee9-4cb6-89b1-4afd4cfaf460 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:00:44.722041 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.auth.core [None req-eddf5ac9-6ee9-4cb6-89b1-4afd4cfaf460 None None] MFA Rules not processed for user `e66e7034abed4e0bad1f4137520c1e70`. Rule list: `[]` (Enabled: `True`). {{(pid=82025) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 20:00:44.737965 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.fernet_utils [None req-eddf5ac9-6ee9-4cb6-89b1-4afd4cfaf460 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82025) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 20:00:44.858492 dv-cinder-828806-6-smb devstack@keystone.service[82026]: [pid: 82026|app: 0|req: 889/1798] 10.222.0.33 () {58 vars in 958 bytes} [Tue Sep 13 20:00:44 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 287 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 20:00:44.863815 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de45b175-5d4b-4c16-819e-1f06c50e4293 None None] Authenticating user token {{(pid=82026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 20:00:45.070407 dv-cinder-828806-6-smb devstack@keystone.service[82025]: [pid: 82025|app: 0|req: 910/1799] 10.222.0.33 () {58 vars in 1018 bytes} [Tue Sep 13 20:00:44 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 411 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 13 20:00:45.073006 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eddf5ac9-6ee9-4cb6-89b1-4afd4cfaf460 None None] Authenticating user token {{(pid=82025) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 20:00:45.087492 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de45b175-5d4b-4c16-819e-1f06c50e4293 None None] Validating token access rules against request {{(pid=82026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 20:00:45.098073 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2313d1f-21a4-4ff7-960e-8f7e5bcf6e1c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46024fc6167f4321818b1bed27a521a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8c6fba0f15b4d6a84ff601919b7b8e4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 20:00:45.098755 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2313d1f-21a4-4ff7-960e-8f7e5bcf6e1c service cinder] REQUEST_METHOD: `GET` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:00:45.099214 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2313d1f-21a4-4ff7-960e-8f7e5bcf6e1c service cinder] SCRIPT_NAME: `/identity` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:00:45.101164 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2313d1f-21a4-4ff7-960e-8f7e5bcf6e1c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:00:45.111381 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.common.fernet_utils [None req-c2313d1f-21a4-4ff7-960e-8f7e5bcf6e1c service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82026) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 20:00:45.293901 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2313d1f-21a4-4ff7-960e-8f7e5bcf6e1c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=82026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 20:00:45.295256 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2313d1f-21a4-4ff7-960e-8f7e5bcf6e1c service cinder] RBAC: Authorization granted {{(pid=82026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 20:00:45.308418 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eddf5ac9-6ee9-4cb6-89b1-4afd4cfaf460 None None] Validating token access rules against request {{(pid=82025) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 20:00:45.321450 dv-cinder-828806-6-smb devstack@keystone.service[82026]: [pid: 82026|app: 0|req: 890/1800] 10.222.0.33 () {60 vars in 1365 bytes} [Tue Sep 13 20:00:44 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 462 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 20:00:45.322679 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2313d1f-21a4-4ff7-960e-8f7e5bcf6e1c service cinder] Authenticating user token {{(pid=82026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 20:00:45.329076 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.common.fernet_utils [None req-c2313d1f-21a4-4ff7-960e-8f7e5bcf6e1c service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82026) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 20:00:45.329438 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17ea3fa5-31cd-4742-8b5e-7ce94864abb5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57539b6a6f3b4d589f5f5e1d211cd6a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b454f707d20347ada3d82aa85495635e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82025) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 20:00:45.330182 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17ea3fa5-31cd-4742-8b5e-7ce94864abb5 admin admin] REQUEST_METHOD: `POST` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:00:45.330921 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17ea3fa5-31cd-4742-8b5e-7ce94864abb5 admin admin] SCRIPT_NAME: `/identity` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:00:45.332804 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17ea3fa5-31cd-4742-8b5e-7ce94864abb5 admin admin] PATH_INFO: `/v3/projects` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:00:45.333890 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17ea3fa5-31cd-4742-8b5e-7ce94864abb5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 20:00:45.339563 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17ea3fa5-31cd-4742-8b5e-7ce94864abb5 admin admin] RBAC: Authorization granted {{(pid=82025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 20:00:45.363613 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2313d1f-21a4-4ff7-960e-8f7e5bcf6e1c service cinder] Validating token access rules against request {{(pid=82026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 20:00:45.374375 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46634940-09c4-4a8b-aafa-5b065f8d3d0a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e66e7034abed4e0bad1f4137520c1e70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8c6fba0f15b4d6a84ff601919b7b8e4', 'project_domain_id': 'default', 'roles': ['service', 'member', 'reader', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 20:00:45.375255 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46634940-09c4-4a8b-aafa-5b065f8d3d0a service nova] REQUEST_METHOD: `GET` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:00:45.376498 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46634940-09c4-4a8b-aafa-5b065f8d3d0a service nova] SCRIPT_NAME: `/identity` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:00:45.376498 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46634940-09c4-4a8b-aafa-5b065f8d3d0a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:00:45.412041 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46634940-09c4-4a8b-aafa-5b065f8d3d0a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 20:00:45.417198 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46634940-09c4-4a8b-aafa-5b065f8d3d0a service nova] RBAC: Authorization granted {{(pid=82026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 20:00:45.434013 dv-cinder-828806-6-smb devstack@keystone.service[82026]: [pid: 82026|app: 0|req: 891/1801] 10.222.0.33 () {60 vars in 1365 bytes} [Tue Sep 13 20:00:45 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 112 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 20:00:45.480399 dv-cinder-828806-6-smb devstack@keystone.service[82025]: [pid: 82025|app: 0|req: 911/1802] 10.222.0.33 () {60 vars in 1153 bytes} [Tue Sep 13 20:00:45 2022] POST /identity/v3/projects => generated 385 bytes in 409 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 13 20:00:45.481880 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46634940-09c4-4a8b-aafa-5b065f8d3d0a service nova] Authenticating user token {{(pid=82026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 20:00:45.510005 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46634940-09c4-4a8b-aafa-5b065f8d3d0a service nova] Validating token access rules against request {{(pid=82026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 20:00:45.693410 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e09a333e-3b15-4748-8f04-d43fa911f9f0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57539b6a6f3b4d589f5f5e1d211cd6a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b454f707d20347ada3d82aa85495635e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 20:00:45.694295 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e09a333e-3b15-4748-8f04-d43fa911f9f0 admin admin] REQUEST_METHOD: `POST` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:00:45.694623 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e09a333e-3b15-4748-8f04-d43fa911f9f0 admin admin] SCRIPT_NAME: `/identity` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:00:45.694974 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e09a333e-3b15-4748-8f04-d43fa911f9f0 admin admin] PATH_INFO: `/v3/users` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:00:45.695947 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e09a333e-3b15-4748-8f04-d43fa911f9f0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 20:00:45.702364 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e09a333e-3b15-4748-8f04-d43fa911f9f0 admin admin] RBAC: Authorization granted {{(pid=82026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 20:00:45.837542 dv-cinder-828806-6-smb devstack@keystone.service[82026]: [pid: 82026|app: 0|req: 892/1803] 10.222.0.33 () {60 vars in 1144 bytes} [Tue Sep 13 20:00:45 2022] POST /identity/v3/users => generated 299 bytes in 356 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 13 20:00:45.840021 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17ea3fa5-31cd-4742-8b5e-7ce94864abb5 admin admin] Authenticating user token {{(pid=82025) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 20:00:45.853767 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17ea3fa5-31cd-4742-8b5e-7ce94864abb5 admin admin] Validating token access rules against request {{(pid=82025) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 20:00:45.890929 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-905a8047-ffeb-421c-b00f-273e0abd297f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57539b6a6f3b4d589f5f5e1d211cd6a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b454f707d20347ada3d82aa85495635e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82025) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 20:00:45.892013 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-905a8047-ffeb-421c-b00f-273e0abd297f admin admin] REQUEST_METHOD: `GET` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:00:45.893425 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-905a8047-ffeb-421c-b00f-273e0abd297f admin admin] SCRIPT_NAME: `/identity` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:00:45.893961 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-905a8047-ffeb-421c-b00f-273e0abd297f admin admin] PATH_INFO: `/v3/roles` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:00:45.899297 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-905a8047-ffeb-421c-b00f-273e0abd297f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 20:00:45.905653 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG dbcounter [-] [82026] Writing DB stats keystone:DELETE=4,keystone:SELECT=95,keystone:INSERT=1 {{(pid=82026) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 20:00:45.906343 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-905a8047-ffeb-421c-b00f-273e0abd297f admin admin] RBAC: Authorization granted {{(pid=82025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 20:00:45.963673 dv-cinder-828806-6-smb devstack@keystone.service[82025]: [pid: 82025|app: 0|req: 912/1804] 10.222.0.33 () {58 vars in 1122 bytes} [Tue Sep 13 20:00:45 2022] GET /identity/v3/roles => generated 1420 bytes in 124 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 13 20:00:45.969260 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e09a333e-3b15-4748-8f04-d43fa911f9f0 admin admin] Authenticating user token {{(pid=82026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 20:00:45.988811 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e09a333e-3b15-4748-8f04-d43fa911f9f0 admin admin] Validating token access rules against request {{(pid=82026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 20:00:46.017705 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f746e70-d79a-4906-8246-c45350ce247d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57539b6a6f3b4d589f5f5e1d211cd6a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b454f707d20347ada3d82aa85495635e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 20:00:46.017705 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f746e70-d79a-4906-8246-c45350ce247d admin admin] REQUEST_METHOD: `PUT` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:00:46.017705 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f746e70-d79a-4906-8246-c45350ce247d admin admin] SCRIPT_NAME: `/identity` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:00:46.017705 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f746e70-d79a-4906-8246-c45350ce247d admin admin] PATH_INFO: `/v3/projects/a0b02af9acdd4f13931138d64ea558ef/users/b63288767def44f881338677186f0ef7/roles/e5af7d5baa93469e9e486ef21c85474e` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:00:46.043784 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG dbcounter [-] [82025] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82025) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 20:00:46.066603 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f746e70-d79a-4906-8246-c45350ce247d admin admin] RBAC: Authorizing `identity:create_grant(project_id=a0b02af9acdd4f13931138d64ea558ef, user_id=b63288767def44f881338677186f0ef7, role_id=e5af7d5baa93469e9e486ef21c85474e)` {{(pid=82026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 20:00:46.070364 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f746e70-d79a-4906-8246-c45350ce247d admin admin] RBAC: Authorization granted {{(pid=82026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 20:00:46.120010 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-588ef633-05c6-4a88-8558-75ba6b4af385 None None] REQUEST_METHOD: `GET` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:00:46.120350 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-588ef633-05c6-4a88-8558-75ba6b4af385 None None] SCRIPT_NAME: `/identity` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:00:46.120584 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-588ef633-05c6-4a88-8558-75ba6b4af385 None None] PATH_INFO: `/` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:00:46.123059 dv-cinder-828806-6-smb devstack@keystone.service[82025]: [pid: 82025|app: 0|req: 913/1805] 10.222.0.33 () {54 vars in 921 bytes} [Tue Sep 13 20:00:46 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 13 20:00:46.185759 dv-cinder-828806-6-smb devstack@keystone.service[82026]: [pid: 82026|app: 0|req: 893/1806] 10.222.0.33 () {60 vars in 1483 bytes} [Tue Sep 13 20:00:45 2022] PUT /identity/v3/projects/a0b02af9acdd4f13931138d64ea558ef/users/b63288767def44f881338677186f0ef7/roles/e5af7d5baa93469e9e486ef21c85474e => generated 0 bytes in 215 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 20:00:46.187118 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-588ef633-05c6-4a88-8558-75ba6b4af385 None None] Authenticating user token {{(pid=82025) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 20:00:46.276885 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37aa964f-0275-41d8-bb8f-40cbae621125 None None] REQUEST_METHOD: `POST` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:00:46.276885 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37aa964f-0275-41d8-bb8f-40cbae621125 None None] SCRIPT_NAME: `/identity` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:00:46.276885 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37aa964f-0275-41d8-bb8f-40cbae621125 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:00:46.329049 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.auth.core [None req-37aa964f-0275-41d8-bb8f-40cbae621125 None None] MFA Rules not processed for user `e66e7034abed4e0bad1f4137520c1e70`. Rule list: `[]` (Enabled: `True`). {{(pid=82026) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 20:00:46.330460 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.common.fernet_utils [None req-37aa964f-0275-41d8-bb8f-40cbae621125 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82026) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 20:00:46.402207 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-588ef633-05c6-4a88-8558-75ba6b4af385 None None] Validating token access rules against request {{(pid=82025) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 20:00:46.408897 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-577c3840-6c1f-442d-b4c7-18fe3596b6e5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57539b6a6f3b4d589f5f5e1d211cd6a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b454f707d20347ada3d82aa85495635e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82025) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 20:00:46.409888 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-577c3840-6c1f-442d-b4c7-18fe3596b6e5 admin admin] REQUEST_METHOD: `GET` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:00:46.410448 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-577c3840-6c1f-442d-b4c7-18fe3596b6e5 admin admin] SCRIPT_NAME: `/identity` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:00:46.410982 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-577c3840-6c1f-442d-b4c7-18fe3596b6e5 admin admin] PATH_INFO: `/v3/roles` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:00:46.412045 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-577c3840-6c1f-442d-b4c7-18fe3596b6e5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 20:00:46.419509 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-577c3840-6c1f-442d-b4c7-18fe3596b6e5 admin admin] RBAC: Authorization granted {{(pid=82025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 20:00:46.430010 dv-cinder-828806-6-smb devstack@keystone.service[82025]: [pid: 82025|app: 0|req: 914/1807] 10.222.0.33 () {58 vars in 1122 bytes} [Tue Sep 13 20:00:46 2022] GET /identity/v3/roles => generated 1420 bytes in 243 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 13 20:00:46.431090 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-577c3840-6c1f-442d-b4c7-18fe3596b6e5 admin admin] Authenticating user token {{(pid=82025) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 20:00:46.442578 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-577c3840-6c1f-442d-b4c7-18fe3596b6e5 admin admin] Validating token access rules against request {{(pid=82025) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 20:00:46.448270 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8463ce5-f2a7-4413-aaf3-8fa2a162110f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57539b6a6f3b4d589f5f5e1d211cd6a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b454f707d20347ada3d82aa85495635e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82025) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 20:00:46.455981 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8463ce5-f2a7-4413-aaf3-8fa2a162110f admin admin] REQUEST_METHOD: `PUT` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:00:46.455981 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8463ce5-f2a7-4413-aaf3-8fa2a162110f admin admin] SCRIPT_NAME: `/identity` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:00:46.455981 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8463ce5-f2a7-4413-aaf3-8fa2a162110f admin admin] PATH_INFO: `/v3/projects/a0b02af9acdd4f13931138d64ea558ef/users/b63288767def44f881338677186f0ef7/roles/e5af7d5baa93469e9e486ef21c85474e` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:00:46.455981 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8463ce5-f2a7-4413-aaf3-8fa2a162110f admin admin] RBAC: Authorizing `identity:create_grant(project_id=a0b02af9acdd4f13931138d64ea558ef, user_id=b63288767def44f881338677186f0ef7, role_id=e5af7d5baa93469e9e486ef21c85474e)` {{(pid=82025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 20:00:46.455981 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8463ce5-f2a7-4413-aaf3-8fa2a162110f admin admin] RBAC: Authorization granted {{(pid=82025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 20:00:46.480344 dv-cinder-828806-6-smb devstack@keystone.service[82025]: [pid: 82025|app: 0|req: 915/1808] 10.222.0.33 () {60 vars in 1483 bytes} [Tue Sep 13 20:00:46 2022] PUT /identity/v3/projects/a0b02af9acdd4f13931138d64ea558ef/users/b63288767def44f881338677186f0ef7/roles/e5af7d5baa93469e9e486ef21c85474e => generated 0 bytes in 39 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 20:00:46.482635 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a178e635-0916-452a-a2c6-67cf94194ca8 None None] REQUEST_METHOD: `POST` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:00:46.483182 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a178e635-0916-452a-a2c6-67cf94194ca8 None None] SCRIPT_NAME: `/identity` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:00:46.483664 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a178e635-0916-452a-a2c6-67cf94194ca8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:00:46.496298 dv-cinder-828806-6-smb devstack@keystone.service[82026]: [pid: 82026|app: 0|req: 894/1809] 10.222.0.33 () {58 vars in 1018 bytes} [Tue Sep 13 20:00:46 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 227 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 13 20:00:46.544586 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.auth.core [None req-a178e635-0916-452a-a2c6-67cf94194ca8 None None] MFA Rules not processed for user `b63288767def44f881338677186f0ef7`. Rule list: `[]` (Enabled: `True`). {{(pid=82025) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 20:00:46.546226 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.fernet_utils [None req-a178e635-0916-452a-a2c6-67cf94194ca8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82025) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 20:00:46.622017 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37aa964f-0275-41d8-bb8f-40cbae621125 None None] Authenticating user token {{(pid=82026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 20:00:46.637129 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37aa964f-0275-41d8-bb8f-40cbae621125 None None] Validating token access rules against request {{(pid=82026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 20:00:46.821798 dv-cinder-828806-6-smb devstack@keystone.service[82025]: [pid: 82025|app: 0|req: 916/1810] 10.222.0.33 () {58 vars in 958 bytes} [Tue Sep 13 20:00:46 2022] POST /identity/v3/auth/tokens => generated 3329 bytes in 337 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 20:00:46.846798 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-479066d0-33d8-44e3-83ba-28e04ac602f6 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e66e7034abed4e0bad1f4137520c1e70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8c6fba0f15b4d6a84ff601919b7b8e4', 'project_domain_id': 'default', 'roles': ['service', 'member', 'reader', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 20:00:46.847363 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-479066d0-33d8-44e3-83ba-28e04ac602f6 service nova] REQUEST_METHOD: `GET` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:00:46.847648 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-479066d0-33d8-44e3-83ba-28e04ac602f6 service nova] SCRIPT_NAME: `/identity` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:00:46.847927 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-479066d0-33d8-44e3-83ba-28e04ac602f6 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:00:46.873413 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-479066d0-33d8-44e3-83ba-28e04ac602f6 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 20:00:46.875073 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-479066d0-33d8-44e3-83ba-28e04ac602f6 service nova] RBAC: Authorization granted {{(pid=82026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 20:00:46.905055 dv-cinder-828806-6-smb devstack@keystone.service[82026]: [pid: 82026|app: 0|req: 895/1811] 10.222.0.33 () {60 vars in 1365 bytes} [Tue Sep 13 20:00:46 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 285 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 13 20:00:46.961578 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a178e635-0916-452a-a2c6-67cf94194ca8 None None] Authenticating user token {{(pid=82025) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 20:00:47.097913 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a178e635-0916-452a-a2c6-67cf94194ca8 None None] Validating token access rules against request {{(pid=82025) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 20:00:47.109208 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d2fa324-4c34-4e50-a774-b299668e87fb service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46024fc6167f4321818b1bed27a521a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8c6fba0f15b4d6a84ff601919b7b8e4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82025) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 20:00:47.119627 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d2fa324-4c34-4e50-a774-b299668e87fb service cinder] REQUEST_METHOD: `GET` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:00:47.119627 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d2fa324-4c34-4e50-a774-b299668e87fb service cinder] SCRIPT_NAME: `/identity` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:00:47.119904 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d2fa324-4c34-4e50-a774-b299668e87fb service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:00:47.141367 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d2fa324-4c34-4e50-a774-b299668e87fb service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=82025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 20:00:47.146822 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d2fa324-4c34-4e50-a774-b299668e87fb service cinder] RBAC: Authorization granted {{(pid=82025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 20:00:47.175716 dv-cinder-828806-6-smb devstack@keystone.service[82025]: [pid: 82025|app: 0|req: 917/1812] 10.222.0.33 () {60 vars in 1365 bytes} [Tue Sep 13 20:00:46 2022] GET /identity/v3/auth/tokens => generated 3329 bytes in 214 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 20:00:47.254932 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-479066d0-33d8-44e3-83ba-28e04ac602f6 service nova] Authenticating user token {{(pid=82026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 20:00:47.392793 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d2fa324-4c34-4e50-a774-b299668e87fb service cinder] Authenticating user token {{(pid=82025) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 20:00:47.413038 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d2fa324-4c34-4e50-a774-b299668e87fb service cinder] Validating token access rules against request {{(pid=82025) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 20:00:47.430257 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18d4f4b4-d9a4-4647-b22f-82878242aad4 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46024fc6167f4321818b1bed27a521a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8c6fba0f15b4d6a84ff601919b7b8e4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82025) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 20:00:47.435070 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18d4f4b4-d9a4-4647-b22f-82878242aad4 service cinder] REQUEST_METHOD: `GET` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:00:47.435070 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18d4f4b4-d9a4-4647-b22f-82878242aad4 service cinder] SCRIPT_NAME: `/identity` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:00:47.435070 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18d4f4b4-d9a4-4647-b22f-82878242aad4 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:00:47.440222 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.fernet_utils [None req-18d4f4b4-d9a4-4647-b22f-82878242aad4 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82025) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 20:00:47.524694 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-479066d0-33d8-44e3-83ba-28e04ac602f6 service nova] Validating token access rules against request {{(pid=82026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 20:00:47.544275 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5df75b8f-a837-4cb7-9302-4c05c837db82 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57539b6a6f3b4d589f5f5e1d211cd6a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b454f707d20347ada3d82aa85495635e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 20:00:47.545228 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5df75b8f-a837-4cb7-9302-4c05c837db82 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:00:47.551267 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5df75b8f-a837-4cb7-9302-4c05c837db82 admin admin] SCRIPT_NAME: `/identity` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:00:47.551267 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5df75b8f-a837-4cb7-9302-4c05c837db82 admin admin] PATH_INFO: `/v3/users/1c9169f1652149cfadc8c2b2193773dc` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:00:47.555827 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5df75b8f-a837-4cb7-9302-4c05c837db82 admin admin] RBAC: Authorizing `identity:delete_user(user_id=1c9169f1652149cfadc8c2b2193773dc)` {{(pid=82026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 20:00:47.571733 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5df75b8f-a837-4cb7-9302-4c05c837db82 admin admin] RBAC: Authorization granted {{(pid=82026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 20:00:47.580589 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18d4f4b4-d9a4-4647-b22f-82878242aad4 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=82025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 20:00:47.582122 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18d4f4b4-d9a4-4647-b22f-82878242aad4 service cinder] RBAC: Authorization granted {{(pid=82025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 20:00:47.606112 dv-cinder-828806-6-smb devstack@keystone.service[82025]: [pid: 82025|app: 0|req: 918/1813] 10.222.0.33 () {60 vars in 1365 bytes} [Tue Sep 13 20:00:47 2022] GET /identity/v3/auth/tokens => generated 3264 bytes in 210 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 13 20:00:47.882368 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.notifications [None req-5df75b8f-a837-4cb7-9302-4c05c837db82 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1c9169f1652149cfadc8c2b2193773dc'} {{(pid=82026) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 20:00:47.973399 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.notifications [None req-5df75b8f-a837-4cb7-9302-4c05c837db82 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1c9169f1652149cfadc8c2b2193773dc'} {{(pid=82026) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 20:00:47.999722 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.notifications [None req-5df75b8f-a837-4cb7-9302-4c05c837db82 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1c9169f1652149cfadc8c2b2193773dc'} {{(pid=82026) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 20:00:48.000810 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.notifications [None req-5df75b8f-a837-4cb7-9302-4c05c837db82 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1c9169f1652149cfadc8c2b2193773dc'} {{(pid=82026) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 20:00:48.023200 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.notifications [None req-5df75b8f-a837-4cb7-9302-4c05c837db82 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1c9169f1652149cfadc8c2b2193773dc'} {{(pid=82026) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 20:00:48.031376 dv-cinder-828806-6-smb devstack@keystone.service[82026]: [pid: 82026|app: 0|req: 896/1814] 10.222.0.33 () {58 vars in 1224 bytes} [Tue Sep 13 20:00:47 2022] DELETE /identity/v3/users/1c9169f1652149cfadc8c2b2193773dc => generated 0 bytes in 777 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 20:00:48.038604 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe8b8dd4-2e3c-479f-a5de-f0df9f410653 None None] REQUEST_METHOD: `POST` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:00:48.041612 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe8b8dd4-2e3c-479f-a5de-f0df9f410653 None None] SCRIPT_NAME: `/identity` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:00:48.041954 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe8b8dd4-2e3c-479f-a5de-f0df9f410653 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:00:48.072394 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG dbcounter [-] [82026] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82026) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 20:00:48.115310 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.auth.core [None req-fe8b8dd4-2e3c-479f-a5de-f0df9f410653 None None] MFA Rules not processed for user `57539b6a6f3b4d589f5f5e1d211cd6a0`. Rule list: `[]` (Enabled: `True`). {{(pid=82025) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 20:00:48.119358 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.fernet_utils [None req-fe8b8dd4-2e3c-479f-a5de-f0df9f410653 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82025) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 20:00:48.194912 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG dbcounter [-] [82025] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82025) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 20:00:48.263723 dv-cinder-828806-6-smb devstack@keystone.service[82025]: [pid: 82025|app: 0|req: 919/1815] 10.222.0.33 () {58 vars in 958 bytes} [Tue Sep 13 20:00:48 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 228 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 20:00:48.278396 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5df75b8f-a837-4cb7-9302-4c05c837db82 admin admin] Authenticating user token {{(pid=82026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 20:00:48.280246 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.common.fernet_utils [None req-5df75b8f-a837-4cb7-9302-4c05c837db82 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82026) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 20:00:48.370468 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5df75b8f-a837-4cb7-9302-4c05c837db82 admin admin] Validating token access rules against request {{(pid=82026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 20:00:48.377444 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24aa5df4-af17-4266-a263-8f394c2a0dc0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '023a2c79c2444611b3d431928e56685d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8c6fba0f15b4d6a84ff601919b7b8e4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 20:00:48.378521 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24aa5df4-af17-4266-a263-8f394c2a0dc0 service neutron] REQUEST_METHOD: `GET` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:00:48.379064 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24aa5df4-af17-4266-a263-8f394c2a0dc0 service neutron] SCRIPT_NAME: `/identity` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:00:48.379579 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24aa5df4-af17-4266-a263-8f394c2a0dc0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:00:48.392555 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24aa5df4-af17-4266-a263-8f394c2a0dc0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 20:00:48.394363 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24aa5df4-af17-4266-a263-8f394c2a0dc0 service neutron] RBAC: Authorization granted {{(pid=82026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 20:00:48.418769 dv-cinder-828806-6-smb devstack@keystone.service[82026]: [pid: 82026|app: 0|req: 897/1816] 10.222.0.33 () {60 vars in 1365 bytes} [Tue Sep 13 20:00:48 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 141 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 20:00:49.889103 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG dbcounter [-] [82026] Writing DB stats keystone:SELECT=100 {{(pid=82026) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 20:00:50.453347 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe8b8dd4-2e3c-479f-a5de-f0df9f410653 None None] Authenticating user token {{(pid=82025) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 20:00:50.453347 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.fernet_utils [None req-fe8b8dd4-2e3c-479f-a5de-f0df9f410653 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82025) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 20:00:50.482456 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe8b8dd4-2e3c-479f-a5de-f0df9f410653 None None] Validating token access rules against request {{(pid=82025) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 20:00:50.505249 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG dbcounter [-] [82025] Writing DB stats keystone:SELECT=93,keystone:INSERT=7 {{(pid=82025) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 20:00:50.513906 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29674ba8-8063-4b49-9561-9d97fb600a47 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57539b6a6f3b4d589f5f5e1d211cd6a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b454f707d20347ada3d82aa85495635e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82025) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 20:00:50.523425 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29674ba8-8063-4b49-9561-9d97fb600a47 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:00:50.523767 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29674ba8-8063-4b49-9561-9d97fb600a47 admin admin] SCRIPT_NAME: `/identity` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:00:50.524914 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29674ba8-8063-4b49-9561-9d97fb600a47 admin admin] PATH_INFO: `/v3/projects/704cd8d828374c4aae144935d4ec2dbb` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:00:50.526301 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29674ba8-8063-4b49-9561-9d97fb600a47 admin admin] RBAC: Authorizing `identity:delete_project(project_id=704cd8d828374c4aae144935d4ec2dbb)` {{(pid=82025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 20:00:50.528468 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29674ba8-8063-4b49-9561-9d97fb600a47 admin admin] RBAC: Authorization granted {{(pid=82025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 20:00:50.762410 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.notifications [None req-29674ba8-8063-4b49-9561-9d97fb600a47 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '704cd8d828374c4aae144935d4ec2dbb', 'request_id': 'req-29674ba8-8063-4b49-9561-9d97fb600a47'} {{(pid=82025) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 20:00:50.771960 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.notifications [None req-29674ba8-8063-4b49-9561-9d97fb600a47 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '704cd8d828374c4aae144935d4ec2dbb', 'request_id': 'req-29674ba8-8063-4b49-9561-9d97fb600a47'} {{(pid=82025) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 20:00:50.782071 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.notifications [None req-29674ba8-8063-4b49-9561-9d97fb600a47 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '704cd8d828374c4aae144935d4ec2dbb', 'request_id': 'req-29674ba8-8063-4b49-9561-9d97fb600a47'} {{(pid=82025) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 20:00:50.946925 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.notifications [None req-29674ba8-8063-4b49-9561-9d97fb600a47 admin admin] The token cache is being invalidate because project 704cd8d828374c4aae144935d4ec2dbb was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82025) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 13 20:00:50.947455 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.notifications [None req-29674ba8-8063-4b49-9561-9d97fb600a47 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82025) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 20:00:50.948150 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.notifications [None req-29674ba8-8063-4b49-9561-9d97fb600a47 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82025) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 20:00:50.950491 dv-cinder-828806-6-smb devstack@keystone.service[82025]: [pid: 82025|app: 0|req: 920/1817] 10.222.0.33 () {58 vars in 1233 bytes} [Tue Sep 13 20:00:50 2022] DELETE /identity/v3/projects/704cd8d828374c4aae144935d4ec2dbb => generated 0 bytes in 502 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 20:00:50.954542 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24aa5df4-af17-4266-a263-8f394c2a0dc0 service neutron] Authenticating user token {{(pid=82026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 20:00:50.965030 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24aa5df4-af17-4266-a263-8f394c2a0dc0 service neutron] Validating token access rules against request {{(pid=82026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 20:00:51.071839 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-141fb995-b952-4b78-985c-28a32fe3a34a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57539b6a6f3b4d589f5f5e1d211cd6a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b454f707d20347ada3d82aa85495635e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 20:00:51.073049 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-141fb995-b952-4b78-985c-28a32fe3a34a admin admin] REQUEST_METHOD: `DELETE` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:00:51.073333 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-141fb995-b952-4b78-985c-28a32fe3a34a admin admin] SCRIPT_NAME: `/identity` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:00:51.073654 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-141fb995-b952-4b78-985c-28a32fe3a34a admin admin] PATH_INFO: `/v3/users/b63288767def44f881338677186f0ef7` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:00:51.074899 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-141fb995-b952-4b78-985c-28a32fe3a34a admin admin] RBAC: Authorizing `identity:delete_user(user_id=b63288767def44f881338677186f0ef7)` {{(pid=82026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 20:00:51.077322 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-141fb995-b952-4b78-985c-28a32fe3a34a admin admin] RBAC: Authorization granted {{(pid=82026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 20:00:51.320535 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.notifications [None req-141fb995-b952-4b78-985c-28a32fe3a34a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b63288767def44f881338677186f0ef7'} {{(pid=82026) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 20:00:51.421732 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.notifications [None req-141fb995-b952-4b78-985c-28a32fe3a34a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b63288767def44f881338677186f0ef7'} {{(pid=82026) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 20:00:51.442346 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.notifications [None req-141fb995-b952-4b78-985c-28a32fe3a34a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b63288767def44f881338677186f0ef7'} {{(pid=82026) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 20:00:51.445054 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.notifications [None req-141fb995-b952-4b78-985c-28a32fe3a34a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b63288767def44f881338677186f0ef7'} {{(pid=82026) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 20:00:51.478573 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.notifications [None req-141fb995-b952-4b78-985c-28a32fe3a34a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b63288767def44f881338677186f0ef7'} {{(pid=82026) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 20:00:51.490535 dv-cinder-828806-6-smb devstack@keystone.service[82026]: [pid: 82026|app: 0|req: 898/1818] 10.222.0.33 () {58 vars in 1224 bytes} [Tue Sep 13 20:00:50 2022] DELETE /identity/v3/users/b63288767def44f881338677186f0ef7 => generated 0 bytes in 536 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 20:00:51.513261 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG dbcounter [-] [82026] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=82026) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 20:00:52.592671 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29674ba8-8063-4b49-9561-9d97fb600a47 admin admin] Authenticating user token {{(pid=82025) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 20:00:52.594253 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.fernet_utils [None req-29674ba8-8063-4b49-9561-9d97fb600a47 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82025) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 20:00:52.615085 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29674ba8-8063-4b49-9561-9d97fb600a47 admin admin] Validating token access rules against request {{(pid=82025) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 20:00:52.691906 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8473b7e8-c04f-4b27-b224-a78e0c6022aa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57539b6a6f3b4d589f5f5e1d211cd6a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b454f707d20347ada3d82aa85495635e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82025) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 20:00:52.692512 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8473b7e8-c04f-4b27-b224-a78e0c6022aa admin admin] REQUEST_METHOD: `DELETE` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:00:52.692859 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8473b7e8-c04f-4b27-b224-a78e0c6022aa admin admin] SCRIPT_NAME: `/identity` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:00:52.693141 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8473b7e8-c04f-4b27-b224-a78e0c6022aa admin admin] PATH_INFO: `/v3/projects/a0b02af9acdd4f13931138d64ea558ef` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:00:52.695059 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8473b7e8-c04f-4b27-b224-a78e0c6022aa admin admin] RBAC: Authorizing `identity:delete_project(project_id=a0b02af9acdd4f13931138d64ea558ef)` {{(pid=82025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 20:00:52.697078 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8473b7e8-c04f-4b27-b224-a78e0c6022aa admin admin] RBAC: Authorization granted {{(pid=82025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 20:00:52.835922 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.notifications [None req-8473b7e8-c04f-4b27-b224-a78e0c6022aa admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a0b02af9acdd4f13931138d64ea558ef', 'request_id': 'req-8473b7e8-c04f-4b27-b224-a78e0c6022aa'} {{(pid=82025) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 20:00:52.844884 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.notifications [None req-8473b7e8-c04f-4b27-b224-a78e0c6022aa admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a0b02af9acdd4f13931138d64ea558ef', 'request_id': 'req-8473b7e8-c04f-4b27-b224-a78e0c6022aa'} {{(pid=82025) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 20:00:52.853099 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.notifications [None req-8473b7e8-c04f-4b27-b224-a78e0c6022aa admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a0b02af9acdd4f13931138d64ea558ef', 'request_id': 'req-8473b7e8-c04f-4b27-b224-a78e0c6022aa'} {{(pid=82025) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 20:00:52.975633 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.notifications [None req-8473b7e8-c04f-4b27-b224-a78e0c6022aa admin admin] The token cache is being invalidate because project a0b02af9acdd4f13931138d64ea558ef was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82025) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 13 20:00:52.976709 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.notifications [None req-8473b7e8-c04f-4b27-b224-a78e0c6022aa admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82025) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 20:00:52.977520 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.notifications [None req-8473b7e8-c04f-4b27-b224-a78e0c6022aa admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82025) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 20:00:52.979368 dv-cinder-828806-6-smb devstack@keystone.service[82025]: [pid: 82025|app: 0|req: 921/1819] 10.222.0.33 () {58 vars in 1233 bytes} [Tue Sep 13 20:00:52 2022] DELETE /identity/v3/projects/a0b02af9acdd4f13931138d64ea558ef => generated 0 bytes in 387 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 13 20:00:52.984274 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d30bd02-a329-4b62-a4ce-ee426d9e0195 None None] REQUEST_METHOD: `POST` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:00:52.984798 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d30bd02-a329-4b62-a4ce-ee426d9e0195 None None] SCRIPT_NAME: `/identity` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:00:52.984798 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d30bd02-a329-4b62-a4ce-ee426d9e0195 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:00:53.005976 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.auth.core [None req-4d30bd02-a329-4b62-a4ce-ee426d9e0195 None None] MFA Rules not processed for user `57539b6a6f3b4d589f5f5e1d211cd6a0`. Rule list: `[]` (Enabled: `True`). {{(pid=82026) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 20:00:53.007973 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.common.fernet_utils [None req-4d30bd02-a329-4b62-a4ce-ee426d9e0195 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82026) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 20:00:53.094388 dv-cinder-828806-6-smb devstack@keystone.service[82026]: [pid: 82026|app: 0|req: 899/1820] 10.222.0.33 () {58 vars in 958 bytes} [Tue Sep 13 20:00:52 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 20:00:53.102486 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81660ce6-6349-4fcb-adb8-4def1157c859 None None] REQUEST_METHOD: `POST` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:00:53.102809 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81660ce6-6349-4fcb-adb8-4def1157c859 None None] SCRIPT_NAME: `/identity` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:00:53.103134 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81660ce6-6349-4fcb-adb8-4def1157c859 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:00:53.125624 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.auth.core [None req-81660ce6-6349-4fcb-adb8-4def1157c859 None None] MFA Rules not processed for user `57539b6a6f3b4d589f5f5e1d211cd6a0`. Rule list: `[]` (Enabled: `True`). {{(pid=82025) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 20:00:53.126836 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.fernet_utils [None req-81660ce6-6349-4fcb-adb8-4def1157c859 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82025) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 20:00:53.135426 dv-cinder-828806-6-smb devstack@keystone.service[82025]: [pid: 82025|app: 0|req: 922/1821] 10.222.0.33 () {58 vars in 958 bytes} [Tue Sep 13 20:00:53 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 20:00:53.139767 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d30bd02-a329-4b62-a4ce-ee426d9e0195 None None] Authenticating user token {{(pid=82026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 20:00:53.152192 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d30bd02-a329-4b62-a4ce-ee426d9e0195 None None] Validating token access rules against request {{(pid=82026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 20:00:53.157926 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4ad51af-b2b8-488d-8387-4fa3ee56f18e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57539b6a6f3b4d589f5f5e1d211cd6a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b454f707d20347ada3d82aa85495635e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 20:00:53.158568 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4ad51af-b2b8-488d-8387-4fa3ee56f18e admin admin] REQUEST_METHOD: `GET` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:00:53.158850 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4ad51af-b2b8-488d-8387-4fa3ee56f18e admin admin] SCRIPT_NAME: `/identity` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:00:53.159155 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4ad51af-b2b8-488d-8387-4fa3ee56f18e admin admin] PATH_INFO: `/v3/domains` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:00:53.159811 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4ad51af-b2b8-488d-8387-4fa3ee56f18e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82026) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 20:00:53.160116 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4ad51af-b2b8-488d-8387-4fa3ee56f18e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 20:00:53.161710 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4ad51af-b2b8-488d-8387-4fa3ee56f18e admin admin] RBAC: Authorization granted {{(pid=82026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 20:00:53.174935 dv-cinder-828806-6-smb devstack@keystone.service[82026]: [pid: 82026|app: 0|req: 900/1822] 10.222.0.33 () {58 vars in 1153 bytes} [Tue Sep 13 20:00:53 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 20:00:53.180950 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81660ce6-6349-4fcb-adb8-4def1157c859 None None] Authenticating user token {{(pid=82025) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 20:00:53.190423 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81660ce6-6349-4fcb-adb8-4def1157c859 None None] Validating token access rules against request {{(pid=82025) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 20:00:53.195549 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6ec73e7-5660-470d-8e25-7d37703a270f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57539b6a6f3b4d589f5f5e1d211cd6a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b454f707d20347ada3d82aa85495635e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82025) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 20:00:53.196160 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6ec73e7-5660-470d-8e25-7d37703a270f admin admin] REQUEST_METHOD: `POST` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:00:53.196458 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6ec73e7-5660-470d-8e25-7d37703a270f admin admin] SCRIPT_NAME: `/identity` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:00:53.196723 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6ec73e7-5660-470d-8e25-7d37703a270f admin admin] PATH_INFO: `/v3/projects` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:00:53.197379 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6ec73e7-5660-470d-8e25-7d37703a270f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 20:00:53.199422 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6ec73e7-5660-470d-8e25-7d37703a270f admin admin] RBAC: Authorization granted {{(pid=82025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 20:00:53.330161 dv-cinder-828806-6-smb devstack@keystone.service[82025]: [pid: 82025|app: 0|req: 923/1823] 10.222.0.33 () {60 vars in 1153 bytes} [Tue Sep 13 20:00:53 2022] POST /identity/v3/projects => generated 381 bytes in 151 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 13 20:00:53.335850 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4ad51af-b2b8-488d-8387-4fa3ee56f18e admin admin] Authenticating user token {{(pid=82026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 20:00:53.349160 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4ad51af-b2b8-488d-8387-4fa3ee56f18e admin admin] Validating token access rules against request {{(pid=82026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 20:00:53.411478 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff85cae1-7fc3-4374-9471-0334b14d59d5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57539b6a6f3b4d589f5f5e1d211cd6a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b454f707d20347ada3d82aa85495635e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 20:00:53.412101 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff85cae1-7fc3-4374-9471-0334b14d59d5 admin admin] REQUEST_METHOD: `POST` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:00:53.412389 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff85cae1-7fc3-4374-9471-0334b14d59d5 admin admin] SCRIPT_NAME: `/identity` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:00:53.412665 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff85cae1-7fc3-4374-9471-0334b14d59d5 admin admin] PATH_INFO: `/v3/users` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:00:53.414126 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff85cae1-7fc3-4374-9471-0334b14d59d5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 20:00:53.417332 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff85cae1-7fc3-4374-9471-0334b14d59d5 admin admin] RBAC: Authorization granted {{(pid=82026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 20:00:53.499393 dv-cinder-828806-6-smb devstack@keystone.service[82026]: [pid: 82026|app: 0|req: 901/1824] 10.222.0.33 () {60 vars in 1144 bytes} [Tue Sep 13 20:00:53 2022] POST /identity/v3/users => generated 291 bytes in 165 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 13 20:00:53.503498 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6ec73e7-5660-470d-8e25-7d37703a270f admin admin] Authenticating user token {{(pid=82025) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 20:00:53.514261 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6ec73e7-5660-470d-8e25-7d37703a270f admin admin] Validating token access rules against request {{(pid=82025) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 20:00:53.518873 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-714a8c81-4359-4896-b7a8-31bcf23236ed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57539b6a6f3b4d589f5f5e1d211cd6a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b454f707d20347ada3d82aa85495635e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82025) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 20:00:53.519522 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-714a8c81-4359-4896-b7a8-31bcf23236ed admin admin] REQUEST_METHOD: `GET` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:00:53.519806 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-714a8c81-4359-4896-b7a8-31bcf23236ed admin admin] SCRIPT_NAME: `/identity` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:00:53.520085 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-714a8c81-4359-4896-b7a8-31bcf23236ed admin admin] PATH_INFO: `/v3/roles` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:00:53.520829 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-714a8c81-4359-4896-b7a8-31bcf23236ed admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 20:00:53.522947 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-714a8c81-4359-4896-b7a8-31bcf23236ed admin admin] RBAC: Authorization granted {{(pid=82025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 20:00:53.533142 dv-cinder-828806-6-smb devstack@keystone.service[82025]: [pid: 82025|app: 0|req: 924/1825] 10.222.0.33 () {58 vars in 1122 bytes} [Tue Sep 13 20:00:53 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 13 20:00:53.537161 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff85cae1-7fc3-4374-9471-0334b14d59d5 admin admin] Authenticating user token {{(pid=82026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 20:00:53.548711 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff85cae1-7fc3-4374-9471-0334b14d59d5 admin admin] Validating token access rules against request {{(pid=82026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 20:00:53.553334 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2734460-0316-4a88-89bf-cb3df28a9185 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57539b6a6f3b4d589f5f5e1d211cd6a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b454f707d20347ada3d82aa85495635e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 20:00:53.553963 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2734460-0316-4a88-89bf-cb3df28a9185 admin admin] REQUEST_METHOD: `GET` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:00:53.554389 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2734460-0316-4a88-89bf-cb3df28a9185 admin admin] SCRIPT_NAME: `/identity` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:00:53.554671 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2734460-0316-4a88-89bf-cb3df28a9185 admin admin] PATH_INFO: `/v3/roles` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:00:53.555354 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2734460-0316-4a88-89bf-cb3df28a9185 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 20:00:53.556984 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2734460-0316-4a88-89bf-cb3df28a9185 admin admin] RBAC: Authorization granted {{(pid=82026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 20:00:53.567536 dv-cinder-828806-6-smb devstack@keystone.service[82026]: [pid: 82026|app: 0|req: 902/1826] 10.222.0.33 () {58 vars in 1122 bytes} [Tue Sep 13 20:00:53 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 13 20:00:53.572577 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-714a8c81-4359-4896-b7a8-31bcf23236ed admin admin] Authenticating user token {{(pid=82025) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 20:00:53.582859 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-714a8c81-4359-4896-b7a8-31bcf23236ed admin admin] Validating token access rules against request {{(pid=82025) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 20:00:53.588114 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c953dda-eaad-4709-8afa-440c5d052a74 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57539b6a6f3b4d589f5f5e1d211cd6a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b454f707d20347ada3d82aa85495635e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82025) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 20:00:53.588772 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c953dda-eaad-4709-8afa-440c5d052a74 admin admin] REQUEST_METHOD: `PUT` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:00:53.589056 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c953dda-eaad-4709-8afa-440c5d052a74 admin admin] SCRIPT_NAME: `/identity` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:00:53.589339 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c953dda-eaad-4709-8afa-440c5d052a74 admin admin] PATH_INFO: `/v3/projects/aae31f9807104ab6a83620e8cbe9d33c/users/2c854e32587a4aa0b0744406abb64dee/roles/3618ab638a65401f82333da7596d1daf` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:00:53.599935 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG dbcounter [-] [82025] Writing DB stats keystone:SELECT=89,keystone:DELETE=7,keystone:INSERT=4 {{(pid=82025) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 20:00:53.607413 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c953dda-eaad-4709-8afa-440c5d052a74 admin admin] RBAC: Authorizing `identity:create_grant(project_id=aae31f9807104ab6a83620e8cbe9d33c, user_id=2c854e32587a4aa0b0744406abb64dee, role_id=3618ab638a65401f82333da7596d1daf)` {{(pid=82025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 20:00:53.610056 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c953dda-eaad-4709-8afa-440c5d052a74 admin admin] RBAC: Authorization granted {{(pid=82025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 20:00:53.691454 dv-cinder-828806-6-smb devstack@keystone.service[82025]: [pid: 82025|app: 0|req: 925/1827] 10.222.0.33 () {60 vars in 1483 bytes} [Tue Sep 13 20:00:53 2022] PUT /identity/v3/projects/aae31f9807104ab6a83620e8cbe9d33c/users/2c854e32587a4aa0b0744406abb64dee/roles/3618ab638a65401f82333da7596d1daf => generated 0 bytes in 119 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 20:00:53.703284 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53f35eea-f730-4d41-b7e7-7a45c1d54556 None None] REQUEST_METHOD: `POST` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:00:53.703584 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53f35eea-f730-4d41-b7e7-7a45c1d54556 None None] SCRIPT_NAME: `/identity` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:00:53.703867 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53f35eea-f730-4d41-b7e7-7a45c1d54556 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:00:53.734506 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.auth.core [None req-53f35eea-f730-4d41-b7e7-7a45c1d54556 None None] MFA Rules not processed for user `2c854e32587a4aa0b0744406abb64dee`. Rule list: `[]` (Enabled: `True`). {{(pid=82026) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 20:00:53.736465 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.common.fernet_utils [None req-53f35eea-f730-4d41-b7e7-7a45c1d54556 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82026) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 20:00:53.812556 dv-cinder-828806-6-smb devstack@keystone.service[82026]: [pid: 82026|app: 0|req: 903/1828] 10.222.0.33 () {58 vars in 958 bytes} [Tue Sep 13 20:00:53 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 13 20:00:53.817045 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c953dda-eaad-4709-8afa-440c5d052a74 admin admin] Authenticating user token {{(pid=82025) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 20:00:53.889001 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c953dda-eaad-4709-8afa-440c5d052a74 admin admin] Validating token access rules against request {{(pid=82025) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 20:00:53.893761 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c005520-88d5-4e69-a99f-f13980b35a1e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57539b6a6f3b4d589f5f5e1d211cd6a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b454f707d20347ada3d82aa85495635e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82025) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 20:00:53.894399 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c005520-88d5-4e69-a99f-f13980b35a1e admin admin] REQUEST_METHOD: `POST` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:00:53.894681 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c005520-88d5-4e69-a99f-f13980b35a1e admin admin] SCRIPT_NAME: `/identity` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:00:53.894957 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c005520-88d5-4e69-a99f-f13980b35a1e admin admin] PATH_INFO: `/v3/projects` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:00:53.895630 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c005520-88d5-4e69-a99f-f13980b35a1e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 20:00:53.898282 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c005520-88d5-4e69-a99f-f13980b35a1e admin admin] RBAC: Authorization granted {{(pid=82025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 20:00:54.003095 dv-cinder-828806-6-smb devstack@keystone.service[82025]: [pid: 82025|app: 0|req: 926/1829] 10.222.0.33 () {60 vars in 1153 bytes} [Tue Sep 13 20:00:53 2022] POST /identity/v3/projects => generated 381 bytes in 184 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 13 20:00:54.004988 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53f35eea-f730-4d41-b7e7-7a45c1d54556 None None] Authenticating user token {{(pid=82026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 20:00:54.016886 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53f35eea-f730-4d41-b7e7-7a45c1d54556 None None] Validating token access rules against request {{(pid=82026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 20:00:54.080103 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58ddc13b-bede-4ab3-8d5b-c593f4456d80 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57539b6a6f3b4d589f5f5e1d211cd6a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b454f707d20347ada3d82aa85495635e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 20:00:54.080949 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58ddc13b-bede-4ab3-8d5b-c593f4456d80 admin admin] REQUEST_METHOD: `POST` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:00:54.081235 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58ddc13b-bede-4ab3-8d5b-c593f4456d80 admin admin] SCRIPT_NAME: `/identity` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:00:54.081504 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58ddc13b-bede-4ab3-8d5b-c593f4456d80 admin admin] PATH_INFO: `/v3/users` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:00:54.082168 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58ddc13b-bede-4ab3-8d5b-c593f4456d80 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 20:00:54.084191 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58ddc13b-bede-4ab3-8d5b-c593f4456d80 admin admin] RBAC: Authorization granted {{(pid=82026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 20:00:54.146594 dv-cinder-828806-6-smb devstack@keystone.service[82026]: [pid: 82026|app: 0|req: 904/1830] 10.222.0.33 () {60 vars in 1144 bytes} [Tue Sep 13 20:00:54 2022] POST /identity/v3/users => generated 297 bytes in 142 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 13 20:00:54.152115 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c005520-88d5-4e69-a99f-f13980b35a1e admin admin] Authenticating user token {{(pid=82025) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 20:00:54.163740 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c005520-88d5-4e69-a99f-f13980b35a1e admin admin] Validating token access rules against request {{(pid=82025) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 20:00:54.169232 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f823d45-b65d-4084-ad8c-4f8b7264a4bf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57539b6a6f3b4d589f5f5e1d211cd6a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b454f707d20347ada3d82aa85495635e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82025) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 20:00:54.173142 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f823d45-b65d-4084-ad8c-4f8b7264a4bf admin admin] REQUEST_METHOD: `GET` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:00:54.173142 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f823d45-b65d-4084-ad8c-4f8b7264a4bf admin admin] SCRIPT_NAME: `/identity` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:00:54.173142 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f823d45-b65d-4084-ad8c-4f8b7264a4bf admin admin] PATH_INFO: `/v3/roles` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:00:54.173142 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f823d45-b65d-4084-ad8c-4f8b7264a4bf admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 20:00:54.173142 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f823d45-b65d-4084-ad8c-4f8b7264a4bf admin admin] RBAC: Authorization granted {{(pid=82025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 20:00:54.185029 dv-cinder-828806-6-smb devstack@keystone.service[82025]: [pid: 82025|app: 0|req: 927/1831] 10.222.0.33 () {58 vars in 1122 bytes} [Tue Sep 13 20:00:54 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 13 20:00:54.189405 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58ddc13b-bede-4ab3-8d5b-c593f4456d80 admin admin] Authenticating user token {{(pid=82026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 20:00:54.199506 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58ddc13b-bede-4ab3-8d5b-c593f4456d80 admin admin] Validating token access rules against request {{(pid=82026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 20:00:54.205029 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08362081-47ef-41f7-8cdf-a47a67ead9b9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57539b6a6f3b4d589f5f5e1d211cd6a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b454f707d20347ada3d82aa85495635e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 20:00:54.205710 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08362081-47ef-41f7-8cdf-a47a67ead9b9 admin admin] REQUEST_METHOD: `PUT` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:00:54.205994 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08362081-47ef-41f7-8cdf-a47a67ead9b9 admin admin] SCRIPT_NAME: `/identity` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:00:54.206274 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08362081-47ef-41f7-8cdf-a47a67ead9b9 admin admin] PATH_INFO: `/v3/projects/77ca9d83f6a740cfb0e2d847afb6ab55/users/5de95bc3368549db985c90d6c7dd6f91/roles/e5af7d5baa93469e9e486ef21c85474e` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:00:54.221348 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08362081-47ef-41f7-8cdf-a47a67ead9b9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=77ca9d83f6a740cfb0e2d847afb6ab55, user_id=5de95bc3368549db985c90d6c7dd6f91, role_id=e5af7d5baa93469e9e486ef21c85474e)` {{(pid=82026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 20:00:54.224128 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08362081-47ef-41f7-8cdf-a47a67ead9b9 admin admin] RBAC: Authorization granted {{(pid=82026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 20:00:54.312292 dv-cinder-828806-6-smb devstack@keystone.service[82026]: [pid: 82026|app: 0|req: 905/1832] 10.222.0.33 () {60 vars in 1483 bytes} [Tue Sep 13 20:00:54 2022] PUT /identity/v3/projects/77ca9d83f6a740cfb0e2d847afb6ab55/users/5de95bc3368549db985c90d6c7dd6f91/roles/e5af7d5baa93469e9e486ef21c85474e => generated 0 bytes in 123 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 20:00:54.316380 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f823d45-b65d-4084-ad8c-4f8b7264a4bf admin admin] Authenticating user token {{(pid=82025) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 20:00:54.345823 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f823d45-b65d-4084-ad8c-4f8b7264a4bf admin admin] Validating token access rules against request {{(pid=82025) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 20:00:54.410681 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfe747d5-8bea-4bd3-ae12-e8263c0f595f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57539b6a6f3b4d589f5f5e1d211cd6a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b454f707d20347ada3d82aa85495635e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82025) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 20:00:54.411336 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfe747d5-8bea-4bd3-ae12-e8263c0f595f admin admin] REQUEST_METHOD: `GET` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:00:54.413167 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfe747d5-8bea-4bd3-ae12-e8263c0f595f admin admin] SCRIPT_NAME: `/identity` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:00:54.413167 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfe747d5-8bea-4bd3-ae12-e8263c0f595f admin admin] PATH_INFO: `/v3/roles` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:00:54.413167 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfe747d5-8bea-4bd3-ae12-e8263c0f595f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 20:00:54.414923 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfe747d5-8bea-4bd3-ae12-e8263c0f595f admin admin] RBAC: Authorization granted {{(pid=82025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 20:00:54.430131 dv-cinder-828806-6-smb devstack@keystone.service[82025]: [pid: 82025|app: 0|req: 928/1833] 10.222.0.33 () {58 vars in 1122 bytes} [Tue Sep 13 20:00:54 2022] GET /identity/v3/roles => generated 1420 bytes in 111 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 13 20:00:54.431811 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08362081-47ef-41f7-8cdf-a47a67ead9b9 admin admin] Authenticating user token {{(pid=82026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 20:00:54.443061 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08362081-47ef-41f7-8cdf-a47a67ead9b9 admin admin] Validating token access rules against request {{(pid=82026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 20:00:54.448834 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b628d5a5-7f2b-47fd-b880-3d17d3a1a1ce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57539b6a6f3b4d589f5f5e1d211cd6a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b454f707d20347ada3d82aa85495635e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 20:00:54.449503 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b628d5a5-7f2b-47fd-b880-3d17d3a1a1ce admin admin] REQUEST_METHOD: `PUT` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:00:54.449791 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b628d5a5-7f2b-47fd-b880-3d17d3a1a1ce admin admin] SCRIPT_NAME: `/identity` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:00:54.450218 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b628d5a5-7f2b-47fd-b880-3d17d3a1a1ce admin admin] PATH_INFO: `/v3/projects/77ca9d83f6a740cfb0e2d847afb6ab55/users/5de95bc3368549db985c90d6c7dd6f91/roles/e5af7d5baa93469e9e486ef21c85474e` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:00:54.452499 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b628d5a5-7f2b-47fd-b880-3d17d3a1a1ce admin admin] RBAC: Authorizing `identity:create_grant(project_id=77ca9d83f6a740cfb0e2d847afb6ab55, user_id=5de95bc3368549db985c90d6c7dd6f91, role_id=e5af7d5baa93469e9e486ef21c85474e)` {{(pid=82026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 20:00:54.455241 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b628d5a5-7f2b-47fd-b880-3d17d3a1a1ce admin admin] RBAC: Authorization granted {{(pid=82026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 20:00:54.467409 dv-cinder-828806-6-smb devstack@keystone.service[82026]: [pid: 82026|app: 0|req: 906/1834] 10.222.0.33 () {60 vars in 1483 bytes} [Tue Sep 13 20:00:54 2022] PUT /identity/v3/projects/77ca9d83f6a740cfb0e2d847afb6ab55/users/5de95bc3368549db985c90d6c7dd6f91/roles/e5af7d5baa93469e9e486ef21c85474e => generated 0 bytes in 36 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 20:00:54.480811 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7bc965a-53c8-4f64-aa58-12c164d2f486 None None] REQUEST_METHOD: `POST` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:00:54.481120 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7bc965a-53c8-4f64-aa58-12c164d2f486 None None] SCRIPT_NAME: `/identity` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:00:54.481404 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7bc965a-53c8-4f64-aa58-12c164d2f486 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:00:54.532254 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.auth.core [None req-a7bc965a-53c8-4f64-aa58-12c164d2f486 None None] MFA Rules not processed for user `5de95bc3368549db985c90d6c7dd6f91`. Rule list: `[]` (Enabled: `True`). {{(pid=82025) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 20:00:54.539336 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.fernet_utils [None req-a7bc965a-53c8-4f64-aa58-12c164d2f486 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82025) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 20:00:54.624667 dv-cinder-828806-6-smb devstack@keystone.service[82025]: [pid: 82025|app: 0|req: 929/1835] 10.222.0.33 () {58 vars in 958 bytes} [Tue Sep 13 20:00:54 2022] POST /identity/v3/auth/tokens => generated 3325 bytes in 145 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 20:00:54.745288 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b628d5a5-7f2b-47fd-b880-3d17d3a1a1ce admin admin] Authenticating user token {{(pid=82026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 20:00:54.747246 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.common.fernet_utils [None req-b628d5a5-7f2b-47fd-b880-3d17d3a1a1ce admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82026) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 20:00:54.808444 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b628d5a5-7f2b-47fd-b880-3d17d3a1a1ce admin admin] Validating token access rules against request {{(pid=82026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 20:00:54.812264 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28df9026-6297-41c9-8324-6d1c4904dada service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46024fc6167f4321818b1bed27a521a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8c6fba0f15b4d6a84ff601919b7b8e4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 20:00:54.812902 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28df9026-6297-41c9-8324-6d1c4904dada service cinder] REQUEST_METHOD: `GET` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:00:54.813183 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28df9026-6297-41c9-8324-6d1c4904dada service cinder] SCRIPT_NAME: `/identity` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:00:54.813458 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28df9026-6297-41c9-8324-6d1c4904dada service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:00:54.815250 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.common.fernet_utils [None req-28df9026-6297-41c9-8324-6d1c4904dada service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82026) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 20:00:54.880282 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28df9026-6297-41c9-8324-6d1c4904dada service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=82026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 20:00:54.885620 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28df9026-6297-41c9-8324-6d1c4904dada service cinder] RBAC: Authorization granted {{(pid=82026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 20:00:54.897900 dv-cinder-828806-6-smb devstack@keystone.service[82026]: [pid: 82026|app: 0|req: 907/1836] 10.222.0.33 () {60 vars in 1365 bytes} [Tue Sep 13 20:00:54 2022] GET /identity/v3/auth/tokens => generated 3264 bytes in 153 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 20:00:55.139629 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG dbcounter [-] [82026] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82026) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 20:00:56.204796 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG dbcounter [-] [82025] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=82025) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 20:00:56.378621 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7bc965a-53c8-4f64-aa58-12c164d2f486 None None] Authenticating user token {{(pid=82025) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 20:00:56.380534 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.fernet_utils [None req-a7bc965a-53c8-4f64-aa58-12c164d2f486 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82025) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 20:00:56.472625 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7bc965a-53c8-4f64-aa58-12c164d2f486 None None] Validating token access rules against request {{(pid=82025) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 20:00:56.472625 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b612fbb2-2e64-4782-9a8b-59e1099be320 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57539b6a6f3b4d589f5f5e1d211cd6a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b454f707d20347ada3d82aa85495635e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82025) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 20:00:56.472625 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b612fbb2-2e64-4782-9a8b-59e1099be320 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:00:56.472625 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b612fbb2-2e64-4782-9a8b-59e1099be320 admin admin] SCRIPT_NAME: `/identity` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:00:56.472975 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b612fbb2-2e64-4782-9a8b-59e1099be320 admin admin] PATH_INFO: `/v3/users/e42bf5e6c3b4469b8cfc74a6a40ce82b` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:00:56.472975 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b612fbb2-2e64-4782-9a8b-59e1099be320 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e42bf5e6c3b4469b8cfc74a6a40ce82b)` {{(pid=82025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 20:00:56.472975 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b612fbb2-2e64-4782-9a8b-59e1099be320 admin admin] RBAC: Authorization granted {{(pid=82025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 20:00:56.886543 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.notifications [None req-b612fbb2-2e64-4782-9a8b-59e1099be320 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e42bf5e6c3b4469b8cfc74a6a40ce82b'} {{(pid=82025) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 20:00:56.957799 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.notifications [None req-b612fbb2-2e64-4782-9a8b-59e1099be320 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e42bf5e6c3b4469b8cfc74a6a40ce82b'} {{(pid=82025) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 20:00:56.958433 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.notifications [None req-b612fbb2-2e64-4782-9a8b-59e1099be320 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e42bf5e6c3b4469b8cfc74a6a40ce82b'} {{(pid=82025) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 20:00:56.973851 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.notifications [None req-b612fbb2-2e64-4782-9a8b-59e1099be320 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e42bf5e6c3b4469b8cfc74a6a40ce82b'} {{(pid=82025) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 20:00:56.982069 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.notifications [None req-b612fbb2-2e64-4782-9a8b-59e1099be320 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e42bf5e6c3b4469b8cfc74a6a40ce82b'} {{(pid=82025) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 20:00:56.988475 dv-cinder-828806-6-smb devstack@keystone.service[82025]: [pid: 82025|app: 0|req: 930/1837] 10.222.0.33 () {58 vars in 1224 bytes} [Tue Sep 13 20:00:56 2022] DELETE /identity/v3/users/e42bf5e6c3b4469b8cfc74a6a40ce82b => generated 0 bytes in 610 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 20:00:56.993040 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b7923fe-48a0-42a3-9277-e9a2243967b1 None None] REQUEST_METHOD: `POST` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:00:56.993538 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b7923fe-48a0-42a3-9277-e9a2243967b1 None None] SCRIPT_NAME: `/identity` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:00:56.993632 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b7923fe-48a0-42a3-9277-e9a2243967b1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:00:57.015665 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.auth.core [None req-6b7923fe-48a0-42a3-9277-e9a2243967b1 None None] MFA Rules not processed for user `57539b6a6f3b4d589f5f5e1d211cd6a0`. Rule list: `[]` (Enabled: `True`). {{(pid=82026) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 20:00:57.017132 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.common.fernet_utils [None req-6b7923fe-48a0-42a3-9277-e9a2243967b1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82026) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 20:00:57.099872 dv-cinder-828806-6-smb devstack@keystone.service[82026]: [pid: 82026|app: 0|req: 908/1838] 10.222.0.33 () {58 vars in 958 bytes} [Tue Sep 13 20:00:56 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 20:00:57.114209 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b612fbb2-2e64-4782-9a8b-59e1099be320 admin admin] Authenticating user token {{(pid=82025) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 20:00:57.114209 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.fernet_utils [None req-b612fbb2-2e64-4782-9a8b-59e1099be320 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82025) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 20:00:57.223273 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b612fbb2-2e64-4782-9a8b-59e1099be320 admin admin] Validating token access rules against request {{(pid=82025) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 20:00:57.228044 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c58df013-ef9a-4890-b20a-59445bc0f04a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '023a2c79c2444611b3d431928e56685d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8c6fba0f15b4d6a84ff601919b7b8e4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82025) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 20:00:57.228992 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c58df013-ef9a-4890-b20a-59445bc0f04a service neutron] REQUEST_METHOD: `GET` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:00:57.229366 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c58df013-ef9a-4890-b20a-59445bc0f04a service neutron] SCRIPT_NAME: `/identity` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:00:57.230306 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c58df013-ef9a-4890-b20a-59445bc0f04a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:00:57.263906 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c58df013-ef9a-4890-b20a-59445bc0f04a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 20:00:57.265627 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c58df013-ef9a-4890-b20a-59445bc0f04a service neutron] RBAC: Authorization granted {{(pid=82025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 20:00:57.301907 dv-cinder-828806-6-smb devstack@keystone.service[82025]: [pid: 82025|app: 0|req: 931/1839] 10.222.0.33 () {60 vars in 1365 bytes} [Tue Sep 13 20:00:57 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 191 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 20:00:57.494312 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG dbcounter [-] [82026] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=82026) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 20:00:57.803427 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG dbcounter [-] [82025] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=82025) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 20:00:57.862531 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b7923fe-48a0-42a3-9277-e9a2243967b1 None None] Authenticating user token {{(pid=82026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 20:00:57.864288 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.common.fernet_utils [None req-6b7923fe-48a0-42a3-9277-e9a2243967b1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82026) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 20:00:57.885997 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b7923fe-48a0-42a3-9277-e9a2243967b1 None None] Validating token access rules against request {{(pid=82026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 20:00:57.891005 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05c79d19-86e9-4176-8914-4c2974171461 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57539b6a6f3b4d589f5f5e1d211cd6a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b454f707d20347ada3d82aa85495635e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 20:00:57.891878 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05c79d19-86e9-4176-8914-4c2974171461 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:00:57.892210 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05c79d19-86e9-4176-8914-4c2974171461 admin admin] SCRIPT_NAME: `/identity` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:00:57.892576 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05c79d19-86e9-4176-8914-4c2974171461 admin admin] PATH_INFO: `/v3/projects/b7da0d2b5dc749e8b92286d64ec857ab` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:00:57.894048 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05c79d19-86e9-4176-8914-4c2974171461 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b7da0d2b5dc749e8b92286d64ec857ab)` {{(pid=82026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 20:00:57.895951 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05c79d19-86e9-4176-8914-4c2974171461 admin admin] RBAC: Authorization granted {{(pid=82026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 20:00:58.024446 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.notifications [None req-05c79d19-86e9-4176-8914-4c2974171461 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b7da0d2b5dc749e8b92286d64ec857ab', 'request_id': 'req-05c79d19-86e9-4176-8914-4c2974171461'} {{(pid=82026) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 20:00:58.140402 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.notifications [None req-05c79d19-86e9-4176-8914-4c2974171461 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b7da0d2b5dc749e8b92286d64ec857ab', 'request_id': 'req-05c79d19-86e9-4176-8914-4c2974171461'} {{(pid=82026) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 20:00:58.150448 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.notifications [None req-05c79d19-86e9-4176-8914-4c2974171461 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b7da0d2b5dc749e8b92286d64ec857ab', 'request_id': 'req-05c79d19-86e9-4176-8914-4c2974171461'} {{(pid=82026) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 20:00:58.165779 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.notifications [None req-05c79d19-86e9-4176-8914-4c2974171461 admin admin] The token cache is being invalidate because project b7da0d2b5dc749e8b92286d64ec857ab was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82026) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 13 20:00:58.166530 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.notifications [None req-05c79d19-86e9-4176-8914-4c2974171461 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82026) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 20:00:58.167620 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.notifications [None req-05c79d19-86e9-4176-8914-4c2974171461 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82026) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 20:00:58.170353 dv-cinder-828806-6-smb devstack@keystone.service[82026]: [pid: 82026|app: 0|req: 909/1840] 10.222.0.33 () {58 vars in 1233 bytes} [Tue Sep 13 20:00:57 2022] DELETE /identity/v3/projects/b7da0d2b5dc749e8b92286d64ec857ab => generated 0 bytes in 309 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 13 20:00:58.174371 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c58df013-ef9a-4890-b20a-59445bc0f04a service neutron] Authenticating user token {{(pid=82025) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 20:00:58.186466 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c58df013-ef9a-4890-b20a-59445bc0f04a service neutron] Validating token access rules against request {{(pid=82025) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 20:00:58.250849 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d96587c-c0d9-4b11-a883-cdd92230a372 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57539b6a6f3b4d589f5f5e1d211cd6a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b454f707d20347ada3d82aa85495635e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82025) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 20:00:58.252387 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d96587c-c0d9-4b11-a883-cdd92230a372 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:00:58.253007 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d96587c-c0d9-4b11-a883-cdd92230a372 admin admin] SCRIPT_NAME: `/identity` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:00:58.253602 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d96587c-c0d9-4b11-a883-cdd92230a372 admin admin] PATH_INFO: `/v3/users/86f36467fa08420883221c464d50f2b9` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:00:58.255688 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d96587c-c0d9-4b11-a883-cdd92230a372 admin admin] RBAC: Authorizing `identity:delete_user(user_id=86f36467fa08420883221c464d50f2b9)` {{(pid=82025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 20:00:58.257718 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d96587c-c0d9-4b11-a883-cdd92230a372 admin admin] RBAC: Authorization granted {{(pid=82025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 20:00:58.449040 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.notifications [None req-8d96587c-c0d9-4b11-a883-cdd92230a372 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '86f36467fa08420883221c464d50f2b9'} {{(pid=82025) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 20:00:58.552503 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.notifications [None req-8d96587c-c0d9-4b11-a883-cdd92230a372 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '86f36467fa08420883221c464d50f2b9'} {{(pid=82025) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 20:00:58.555442 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.notifications [None req-8d96587c-c0d9-4b11-a883-cdd92230a372 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '86f36467fa08420883221c464d50f2b9'} {{(pid=82025) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 20:00:58.572544 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.notifications [None req-8d96587c-c0d9-4b11-a883-cdd92230a372 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '86f36467fa08420883221c464d50f2b9'} {{(pid=82025) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 20:00:58.605970 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.notifications [None req-8d96587c-c0d9-4b11-a883-cdd92230a372 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '86f36467fa08420883221c464d50f2b9'} {{(pid=82025) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 20:00:58.616701 dv-cinder-828806-6-smb devstack@keystone.service[82025]: [pid: 82025|app: 0|req: 932/1841] 10.222.0.33 () {58 vars in 1224 bytes} [Tue Sep 13 20:00:58 2022] DELETE /identity/v3/users/86f36467fa08420883221c464d50f2b9 => generated 0 bytes in 440 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 13 20:00:59.141678 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05c79d19-86e9-4176-8914-4c2974171461 admin admin] Authenticating user token {{(pid=82026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 20:00:59.143194 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.common.fernet_utils [None req-05c79d19-86e9-4176-8914-4c2974171461 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82026) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 20:00:59.156929 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05c79d19-86e9-4176-8914-4c2974171461 admin admin] Validating token access rules against request {{(pid=82026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 20:00:59.220240 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-546118bd-0060-4256-9e90-da7513aa3983 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57539b6a6f3b4d589f5f5e1d211cd6a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b454f707d20347ada3d82aa85495635e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 20:00:59.220889 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-546118bd-0060-4256-9e90-da7513aa3983 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:00:59.221189 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-546118bd-0060-4256-9e90-da7513aa3983 admin admin] SCRIPT_NAME: `/identity` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:00:59.221520 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-546118bd-0060-4256-9e90-da7513aa3983 admin admin] PATH_INFO: `/v3/projects/cde4f00a3dce432a9e85f3481beae98c` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:00:59.222661 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-546118bd-0060-4256-9e90-da7513aa3983 admin admin] RBAC: Authorizing `identity:delete_project(project_id=cde4f00a3dce432a9e85f3481beae98c)` {{(pid=82026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 20:00:59.224645 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-546118bd-0060-4256-9e90-da7513aa3983 admin admin] RBAC: Authorization granted {{(pid=82026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 20:00:59.324312 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG dbcounter [-] [82025] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82025) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 20:00:59.351550 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.notifications [None req-546118bd-0060-4256-9e90-da7513aa3983 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'cde4f00a3dce432a9e85f3481beae98c', 'request_id': 'req-546118bd-0060-4256-9e90-da7513aa3983'} {{(pid=82026) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 20:00:59.443278 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.notifications [None req-546118bd-0060-4256-9e90-da7513aa3983 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'cde4f00a3dce432a9e85f3481beae98c', 'request_id': 'req-546118bd-0060-4256-9e90-da7513aa3983'} {{(pid=82026) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 20:00:59.455338 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.notifications [None req-546118bd-0060-4256-9e90-da7513aa3983 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'cde4f00a3dce432a9e85f3481beae98c', 'request_id': 'req-546118bd-0060-4256-9e90-da7513aa3983'} {{(pid=82026) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 20:00:59.464995 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.notifications [None req-546118bd-0060-4256-9e90-da7513aa3983 admin admin] The token cache is being invalidate because project cde4f00a3dce432a9e85f3481beae98c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82026) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 13 20:00:59.465411 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.notifications [None req-546118bd-0060-4256-9e90-da7513aa3983 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82026) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 20:00:59.466312 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.notifications [None req-546118bd-0060-4256-9e90-da7513aa3983 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82026) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 20:00:59.468080 dv-cinder-828806-6-smb devstack@keystone.service[82026]: [pid: 82026|app: 0|req: 910/1842] 10.222.0.33 () {58 vars in 1233 bytes} [Tue Sep 13 20:00:59 2022] DELETE /identity/v3/projects/cde4f00a3dce432a9e85f3481beae98c => generated 0 bytes in 327 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 20:00:59.473044 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab7637dc-d747-469f-a1d9-f52d7c8431bd None None] REQUEST_METHOD: `POST` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:00:59.473448 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab7637dc-d747-469f-a1d9-f52d7c8431bd None None] SCRIPT_NAME: `/identity` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:00:59.473825 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab7637dc-d747-469f-a1d9-f52d7c8431bd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:00:59.496903 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.auth.core [None req-ab7637dc-d747-469f-a1d9-f52d7c8431bd None None] MFA Rules not processed for user `57539b6a6f3b4d589f5f5e1d211cd6a0`. Rule list: `[]` (Enabled: `True`). {{(pid=82025) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 20:00:59.498414 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.fernet_utils [None req-ab7637dc-d747-469f-a1d9-f52d7c8431bd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82025) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 20:00:59.573501 dv-cinder-828806-6-smb devstack@keystone.service[82025]: [pid: 82025|app: 0|req: 933/1843] 10.222.0.33 () {58 vars in 958 bytes} [Tue Sep 13 20:00:59 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 20:00:59.579660 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b209bd5e-b48d-484f-9fa8-ef6bb3154593 None None] REQUEST_METHOD: `POST` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:00:59.580302 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b209bd5e-b48d-484f-9fa8-ef6bb3154593 None None] SCRIPT_NAME: `/identity` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:00:59.580858 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b209bd5e-b48d-484f-9fa8-ef6bb3154593 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:00:59.604577 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.auth.core [None req-b209bd5e-b48d-484f-9fa8-ef6bb3154593 None None] MFA Rules not processed for user `57539b6a6f3b4d589f5f5e1d211cd6a0`. Rule list: `[]` (Enabled: `True`). {{(pid=82026) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 20:00:59.606124 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.common.fernet_utils [None req-b209bd5e-b48d-484f-9fa8-ef6bb3154593 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82026) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 20:00:59.615414 dv-cinder-828806-6-smb devstack@keystone.service[82026]: [pid: 82026|app: 0|req: 911/1844] 10.222.0.33 () {58 vars in 958 bytes} [Tue Sep 13 20:00:59 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 13 20:00:59.620105 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab7637dc-d747-469f-a1d9-f52d7c8431bd None None] Authenticating user token {{(pid=82025) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 20:00:59.632198 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab7637dc-d747-469f-a1d9-f52d7c8431bd None None] Validating token access rules against request {{(pid=82025) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 20:00:59.646681 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c756e34d-08a5-4211-bb4c-e0df7c909dbe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57539b6a6f3b4d589f5f5e1d211cd6a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b454f707d20347ada3d82aa85495635e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82025) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 20:00:59.648076 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c756e34d-08a5-4211-bb4c-e0df7c909dbe admin admin] REQUEST_METHOD: `GET` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:00:59.649213 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c756e34d-08a5-4211-bb4c-e0df7c909dbe admin admin] SCRIPT_NAME: `/identity` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:00:59.649775 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c756e34d-08a5-4211-bb4c-e0df7c909dbe admin admin] PATH_INFO: `/v3/domains` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:00:59.651717 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c756e34d-08a5-4211-bb4c-e0df7c909dbe admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82025) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 20:00:59.654259 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c756e34d-08a5-4211-bb4c-e0df7c909dbe admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 20:00:59.656137 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c756e34d-08a5-4211-bb4c-e0df7c909dbe admin admin] RBAC: Authorization granted {{(pid=82025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 20:00:59.658059 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG dbcounter [-] [82026] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82026) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 20:00:59.694958 dv-cinder-828806-6-smb devstack@keystone.service[82025]: [pid: 82025|app: 0|req: 934/1845] 10.222.0.33 () {58 vars in 1153 bytes} [Tue Sep 13 20:00:59 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 71 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 20:00:59.697170 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b209bd5e-b48d-484f-9fa8-ef6bb3154593 None None] Authenticating user token {{(pid=82026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 20:00:59.705113 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c756e34d-08a5-4211-bb4c-e0df7c909dbe admin admin] Authenticating user token {{(pid=82025) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 20:00:59.706978 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.fernet_utils [None req-c756e34d-08a5-4211-bb4c-e0df7c909dbe admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82025) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 20:00:59.718430 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b209bd5e-b48d-484f-9fa8-ef6bb3154593 None None] Validating token access rules against request {{(pid=82026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 20:00:59.728516 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb825988-2457-4e34-ba8e-117fee6e43b0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57539b6a6f3b4d589f5f5e1d211cd6a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b454f707d20347ada3d82aa85495635e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 20:00:59.729806 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb825988-2457-4e34-ba8e-117fee6e43b0 admin admin] REQUEST_METHOD: `POST` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:00:59.730883 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c756e34d-08a5-4211-bb4c-e0df7c909dbe admin admin] Validating token access rules against request {{(pid=82025) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 20:00:59.731354 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb825988-2457-4e34-ba8e-117fee6e43b0 admin admin] SCRIPT_NAME: `/identity` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:00:59.732395 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb825988-2457-4e34-ba8e-117fee6e43b0 admin admin] PATH_INFO: `/v3/projects` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:00:59.733952 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb825988-2457-4e34-ba8e-117fee6e43b0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 20:00:59.736578 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb825988-2457-4e34-ba8e-117fee6e43b0 admin admin] RBAC: Authorization granted {{(pid=82026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 20:00:59.745644 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b0bed72-ea84-4b95-9208-09e59031e7e9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57539b6a6f3b4d589f5f5e1d211cd6a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b454f707d20347ada3d82aa85495635e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82025) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 20:00:59.746859 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b0bed72-ea84-4b95-9208-09e59031e7e9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:00:59.747428 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b0bed72-ea84-4b95-9208-09e59031e7e9 admin admin] SCRIPT_NAME: `/identity` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:00:59.747809 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b0bed72-ea84-4b95-9208-09e59031e7e9 admin admin] PATH_INFO: `/v3/users/91cf93c6b4c14801abab39b292ca77d8` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:00:59.749755 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b0bed72-ea84-4b95-9208-09e59031e7e9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=91cf93c6b4c14801abab39b292ca77d8)` {{(pid=82025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 20:00:59.752426 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b0bed72-ea84-4b95-9208-09e59031e7e9 admin admin] RBAC: Authorization granted {{(pid=82025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 20:00:59.862608 dv-cinder-828806-6-smb devstack@keystone.service[82026]: [pid: 82026|app: 0|req: 912/1846] 10.222.0.33 () {60 vars in 1153 bytes} [Tue Sep 13 20:00:59 2022] POST /identity/v3/projects => generated 367 bytes in 165 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 13 20:00:59.869748 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb825988-2457-4e34-ba8e-117fee6e43b0 admin admin] Authenticating user token {{(pid=82026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 20:00:59.869748 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.common.fernet_utils [None req-bb825988-2457-4e34-ba8e-117fee6e43b0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82026) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 20:00:59.948242 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb825988-2457-4e34-ba8e-117fee6e43b0 admin admin] Validating token access rules against request {{(pid=82026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 20:00:59.953644 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4866be46-dd29-47b2-b4f0-3dbe44c3adf7 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46024fc6167f4321818b1bed27a521a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8c6fba0f15b4d6a84ff601919b7b8e4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 20:00:59.954464 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4866be46-dd29-47b2-b4f0-3dbe44c3adf7 service cinder] REQUEST_METHOD: `GET` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:00:59.954845 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4866be46-dd29-47b2-b4f0-3dbe44c3adf7 service cinder] SCRIPT_NAME: `/identity` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:00:59.955121 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4866be46-dd29-47b2-b4f0-3dbe44c3adf7 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:00:59.959379 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.common.fernet_utils [None req-4866be46-dd29-47b2-b4f0-3dbe44c3adf7 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82026) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 20:01:00.057267 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.notifications [None req-4b0bed72-ea84-4b95-9208-09e59031e7e9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '91cf93c6b4c14801abab39b292ca77d8'} {{(pid=82025) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 20:01:00.067785 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4866be46-dd29-47b2-b4f0-3dbe44c3adf7 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=82026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 20:01:00.069216 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4866be46-dd29-47b2-b4f0-3dbe44c3adf7 service cinder] RBAC: Authorization granted {{(pid=82026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 20:01:00.081558 dv-cinder-828806-6-smb devstack@keystone.service[82026]: [pid: 82026|app: 0|req: 913/1847] 10.222.0.33 () {60 vars in 1365 bytes} [Tue Sep 13 20:00:59 2022] GET /identity/v3/auth/tokens => generated 3325 bytes in 218 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 20:01:00.083060 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5046b8e-a2c5-4e7d-839e-0abfef2af0ac None None] REQUEST_METHOD: `GET` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:01:00.083453 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5046b8e-a2c5-4e7d-839e-0abfef2af0ac None None] SCRIPT_NAME: `/identity` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:01:00.091794 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5046b8e-a2c5-4e7d-839e-0abfef2af0ac None None] PATH_INFO: `/` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:01:00.091794 dv-cinder-828806-6-smb devstack@keystone.service[82026]: [pid: 82026|app: 0|req: 914/1848] 10.222.0.33 () {54 vars in 921 bytes} [Tue Sep 13 20:01:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 20:01:00.091794 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5046b8e-a2c5-4e7d-839e-0abfef2af0ac None None] Authenticating user token {{(pid=82026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 20:01:00.140102 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.notifications [None req-4b0bed72-ea84-4b95-9208-09e59031e7e9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '91cf93c6b4c14801abab39b292ca77d8'} {{(pid=82025) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 20:01:00.143400 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.notifications [None req-4b0bed72-ea84-4b95-9208-09e59031e7e9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '91cf93c6b4c14801abab39b292ca77d8'} {{(pid=82025) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 20:01:00.174282 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.notifications [None req-4b0bed72-ea84-4b95-9208-09e59031e7e9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '91cf93c6b4c14801abab39b292ca77d8'} {{(pid=82025) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 20:01:00.191179 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.notifications [None req-4b0bed72-ea84-4b95-9208-09e59031e7e9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '91cf93c6b4c14801abab39b292ca77d8'} {{(pid=82025) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 20:01:00.200762 dv-cinder-828806-6-smb devstack@keystone.service[82025]: [pid: 82025|app: 0|req: 935/1849] 10.222.0.33 () {58 vars in 1224 bytes} [Tue Sep 13 20:00:59 2022] DELETE /identity/v3/users/91cf93c6b4c14801abab39b292ca77d8 => generated 0 bytes in 494 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 20:01:00.200762 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-358e1fde-6f24-44f8-a086-89153bc8496f None None] REQUEST_METHOD: `POST` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:01:00.200762 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-358e1fde-6f24-44f8-a086-89153bc8496f None None] SCRIPT_NAME: `/identity` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:01:00.200762 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-358e1fde-6f24-44f8-a086-89153bc8496f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:01:00.223422 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.auth.core [None req-358e1fde-6f24-44f8-a086-89153bc8496f None None] MFA Rules not processed for user `e66e7034abed4e0bad1f4137520c1e70`. Rule list: `[]` (Enabled: `True`). {{(pid=82025) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 20:01:00.224955 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.fernet_utils [None req-358e1fde-6f24-44f8-a086-89153bc8496f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82025) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 20:01:00.233162 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5046b8e-a2c5-4e7d-839e-0abfef2af0ac None None] Validating token access rules against request {{(pid=82026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 20:01:00.295661 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0d05926-227a-45e3-8880-83e3cf88cbb6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57539b6a6f3b4d589f5f5e1d211cd6a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b454f707d20347ada3d82aa85495635e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 20:01:00.296311 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0d05926-227a-45e3-8880-83e3cf88cbb6 admin admin] REQUEST_METHOD: `POST` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:01:00.296599 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0d05926-227a-45e3-8880-83e3cf88cbb6 admin admin] SCRIPT_NAME: `/identity` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:01:00.296879 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0d05926-227a-45e3-8880-83e3cf88cbb6 admin admin] PATH_INFO: `/v3/users` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:01:00.297530 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0d05926-227a-45e3-8880-83e3cf88cbb6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 20:01:00.299552 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0d05926-227a-45e3-8880-83e3cf88cbb6 admin admin] RBAC: Authorization granted {{(pid=82026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 20:01:00.323393 dv-cinder-828806-6-smb devstack@keystone.service[82025]: [pid: 82025|app: 0|req: 936/1850] 10.222.0.33 () {58 vars in 1018 bytes} [Tue Sep 13 20:01:00 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 20:01:00.324696 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f4715ee-dfd6-4372-9208-a92a2a4b5f54 None None] REQUEST_METHOD: `POST` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:01:00.325248 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f4715ee-dfd6-4372-9208-a92a2a4b5f54 None None] SCRIPT_NAME: `/identity` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:01:00.325333 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f4715ee-dfd6-4372-9208-a92a2a4b5f54 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:01:00.346917 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.auth.core [None req-1f4715ee-dfd6-4372-9208-a92a2a4b5f54 None None] MFA Rules not processed for user `57539b6a6f3b4d589f5f5e1d211cd6a0`. Rule list: `[]` (Enabled: `True`). {{(pid=82025) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 20:01:00.352686 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.fernet_utils [None req-1f4715ee-dfd6-4372-9208-a92a2a4b5f54 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82025) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 20:01:00.367702 dv-cinder-828806-6-smb devstack@keystone.service[82025]: [pid: 82025|app: 0|req: 937/1851] 10.222.0.33 () {58 vars in 958 bytes} [Tue Sep 13 20:01:00 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 20:01:00.367702 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f4715ee-dfd6-4372-9208-a92a2a4b5f54 None None] Authenticating user token {{(pid=82025) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 20:01:00.375343 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.fernet_utils [None req-1f4715ee-dfd6-4372-9208-a92a2a4b5f54 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82025) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 20:01:00.393467 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f4715ee-dfd6-4372-9208-a92a2a4b5f54 None None] Validating token access rules against request {{(pid=82025) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 20:01:00.401036 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2e9835a-0645-4567-9e51-a3e415884e9c service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e66e7034abed4e0bad1f4137520c1e70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8c6fba0f15b4d6a84ff601919b7b8e4', 'project_domain_id': 'default', 'roles': ['service', 'member', 'reader', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82025) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 20:01:00.401906 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2e9835a-0645-4567-9e51-a3e415884e9c service nova] REQUEST_METHOD: `GET` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:01:00.402040 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2e9835a-0645-4567-9e51-a3e415884e9c service nova] SCRIPT_NAME: `/identity` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:01:00.402385 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2e9835a-0645-4567-9e51-a3e415884e9c service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:01:00.411286 dv-cinder-828806-6-smb devstack@keystone.service[82026]: [pid: 82026|app: 0|req: 915/1852] 10.222.0.33 () {60 vars in 1144 bytes} [Tue Sep 13 20:01:00 2022] POST /identity/v3/users => generated 284 bytes in 323 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 13 20:01:00.411286 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0d05926-227a-45e3-8880-83e3cf88cbb6 admin admin] Authenticating user token {{(pid=82026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 20:01:00.412487 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.common.fernet_utils [None req-b0d05926-227a-45e3-8880-83e3cf88cbb6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82026) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 20:01:00.415288 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2e9835a-0645-4567-9e51-a3e415884e9c service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 20:01:00.417746 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2e9835a-0645-4567-9e51-a3e415884e9c service nova] RBAC: Authorization granted {{(pid=82025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 20:01:00.432758 dv-cinder-828806-6-smb devstack@keystone.service[82025]: [pid: 82025|app: 0|req: 938/1853] 10.222.0.33 () {60 vars in 1365 bytes} [Tue Sep 13 20:01:00 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 66 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 20:01:00.433728 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2e9835a-0645-4567-9e51-a3e415884e9c service nova] Authenticating user token {{(pid=82025) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 20:01:00.435670 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.fernet_utils [None req-e2e9835a-0645-4567-9e51-a3e415884e9c service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82025) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 20:01:00.465283 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2e9835a-0645-4567-9e51-a3e415884e9c service nova] Validating token access rules against request {{(pid=82025) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 20:01:00.478601 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84ea134b-bc67-49e8-a28d-16315895b5e6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57539b6a6f3b4d589f5f5e1d211cd6a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b454f707d20347ada3d82aa85495635e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82025) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 20:01:00.481462 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84ea134b-bc67-49e8-a28d-16315895b5e6 admin admin] REQUEST_METHOD: `GET` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:01:00.481761 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84ea134b-bc67-49e8-a28d-16315895b5e6 admin admin] SCRIPT_NAME: `/identity` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:01:00.482046 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84ea134b-bc67-49e8-a28d-16315895b5e6 admin admin] PATH_INFO: `/v3/roles` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:01:00.483950 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84ea134b-bc67-49e8-a28d-16315895b5e6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 20:01:00.487772 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84ea134b-bc67-49e8-a28d-16315895b5e6 admin admin] RBAC: Authorization granted {{(pid=82025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 20:01:00.503187 dv-cinder-828806-6-smb devstack@keystone.service[82025]: [pid: 82025|app: 0|req: 939/1854] 10.222.0.33 () {58 vars in 1122 bytes} [Tue Sep 13 20:01:00 2022] GET /identity/v3/roles => generated 1420 bytes in 70 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 13 20:01:00.507272 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84ea134b-bc67-49e8-a28d-16315895b5e6 admin admin] Authenticating user token {{(pid=82025) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 20:01:00.522990 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84ea134b-bc67-49e8-a28d-16315895b5e6 admin admin] Validating token access rules against request {{(pid=82025) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 20:01:00.543167 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-781aba3d-fd7c-4901-95db-bd65f0dd16af admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57539b6a6f3b4d589f5f5e1d211cd6a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b454f707d20347ada3d82aa85495635e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82025) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 20:01:00.543838 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-781aba3d-fd7c-4901-95db-bd65f0dd16af admin admin] REQUEST_METHOD: `GET` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:01:00.544683 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-781aba3d-fd7c-4901-95db-bd65f0dd16af admin admin] SCRIPT_NAME: `/identity` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:01:00.544997 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-781aba3d-fd7c-4901-95db-bd65f0dd16af admin admin] PATH_INFO: `/v3/roles` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:01:00.545996 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-781aba3d-fd7c-4901-95db-bd65f0dd16af admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 20:01:00.547960 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-781aba3d-fd7c-4901-95db-bd65f0dd16af admin admin] RBAC: Authorization granted {{(pid=82025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 20:01:00.572860 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0d05926-227a-45e3-8880-83e3cf88cbb6 admin admin] Validating token access rules against request {{(pid=82026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 20:01:00.581703 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eede34a3-2523-42eb-a5cc-d54d400fb2f7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '023a2c79c2444611b3d431928e56685d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8c6fba0f15b4d6a84ff601919b7b8e4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 20:01:00.582637 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eede34a3-2523-42eb-a5cc-d54d400fb2f7 service neutron] REQUEST_METHOD: `GET` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:01:00.583168 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eede34a3-2523-42eb-a5cc-d54d400fb2f7 service neutron] SCRIPT_NAME: `/identity` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:01:00.583617 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eede34a3-2523-42eb-a5cc-d54d400fb2f7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:01:00.592870 dv-cinder-828806-6-smb devstack@keystone.service[82025]: [pid: 82025|app: 0|req: 940/1855] 10.222.0.33 () {58 vars in 1122 bytes} [Tue Sep 13 20:01:00 2022] GET /identity/v3/roles => generated 1420 bytes in 86 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 13 20:01:00.597063 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-781aba3d-fd7c-4901-95db-bd65f0dd16af admin admin] Authenticating user token {{(pid=82025) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 20:01:00.599011 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eede34a3-2523-42eb-a5cc-d54d400fb2f7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 20:01:00.602750 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eede34a3-2523-42eb-a5cc-d54d400fb2f7 service neutron] RBAC: Authorization granted {{(pid=82026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 20:01:00.612730 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-781aba3d-fd7c-4901-95db-bd65f0dd16af admin admin] Validating token access rules against request {{(pid=82025) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 20:01:00.624970 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad2e3242-0cb9-4f87-b695-620dffe4b78b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57539b6a6f3b4d589f5f5e1d211cd6a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b454f707d20347ada3d82aa85495635e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82025) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 20:01:00.626366 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad2e3242-0cb9-4f87-b695-620dffe4b78b admin admin] REQUEST_METHOD: `PUT` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:01:00.626832 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad2e3242-0cb9-4f87-b695-620dffe4b78b admin admin] SCRIPT_NAME: `/identity` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:01:00.627798 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad2e3242-0cb9-4f87-b695-620dffe4b78b admin admin] PATH_INFO: `/v3/projects/b787deb555b342228935e2011e534dd9/users/266922010e9c48e5bbe3d3272b0d148d/roles/3618ab638a65401f82333da7596d1daf` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:01:00.629300 dv-cinder-828806-6-smb devstack@keystone.service[82026]: [pid: 82026|app: 0|req: 916/1856] 10.222.0.33 () {60 vars in 1365 bytes} [Tue Sep 13 20:01:00 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 220 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 20:01:00.650895 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad2e3242-0cb9-4f87-b695-620dffe4b78b admin admin] RBAC: Authorizing `identity:create_grant(project_id=b787deb555b342228935e2011e534dd9, user_id=266922010e9c48e5bbe3d3272b0d148d, role_id=3618ab638a65401f82333da7596d1daf)` {{(pid=82025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 20:01:00.653842 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad2e3242-0cb9-4f87-b695-620dffe4b78b admin admin] RBAC: Authorization granted {{(pid=82025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 20:01:00.747435 dv-cinder-828806-6-smb devstack@keystone.service[82025]: [pid: 82025|app: 0|req: 941/1857] 10.222.0.33 () {60 vars in 1483 bytes} [Tue Sep 13 20:01:00 2022] PUT /identity/v3/projects/b787deb555b342228935e2011e534dd9/users/266922010e9c48e5bbe3d3272b0d148d/roles/3618ab638a65401f82333da7596d1daf => generated 0 bytes in 151 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 13 20:01:00.758318 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efc992d0-7598-4789-aaf4-517535990e8f None None] REQUEST_METHOD: `POST` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:01:00.758843 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efc992d0-7598-4789-aaf4-517535990e8f None None] SCRIPT_NAME: `/identity` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:01:00.759175 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efc992d0-7598-4789-aaf4-517535990e8f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:01:00.787475 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.auth.core [None req-efc992d0-7598-4789-aaf4-517535990e8f None None] MFA Rules not processed for user `266922010e9c48e5bbe3d3272b0d148d`. Rule list: `[]` (Enabled: `True`). {{(pid=82026) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 20:01:00.788693 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.common.fernet_utils [None req-efc992d0-7598-4789-aaf4-517535990e8f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82026) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 20:01:00.865343 dv-cinder-828806-6-smb devstack@keystone.service[82026]: [pid: 82026|app: 0|req: 917/1858] 10.222.0.33 () {58 vars in 958 bytes} [Tue Sep 13 20:01:00 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 20:01:00.869555 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad2e3242-0cb9-4f87-b695-620dffe4b78b admin admin] Authenticating user token {{(pid=82025) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 20:01:00.921012 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG dbcounter [-] [82025] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=82025) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 20:01:00.948759 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad2e3242-0cb9-4f87-b695-620dffe4b78b admin admin] Validating token access rules against request {{(pid=82025) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 20:01:00.959550 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22a96346-49a3-4d06-8c22-422a6fa4369f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57539b6a6f3b4d589f5f5e1d211cd6a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b454f707d20347ada3d82aa85495635e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82025) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 20:01:00.959550 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22a96346-49a3-4d06-8c22-422a6fa4369f admin admin] REQUEST_METHOD: `POST` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:01:00.959550 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22a96346-49a3-4d06-8c22-422a6fa4369f admin admin] SCRIPT_NAME: `/identity` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:01:00.959550 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22a96346-49a3-4d06-8c22-422a6fa4369f admin admin] PATH_INFO: `/v3/projects` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:01:00.959994 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22a96346-49a3-4d06-8c22-422a6fa4369f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 20:01:00.962274 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22a96346-49a3-4d06-8c22-422a6fa4369f admin admin] RBAC: Authorization granted {{(pid=82025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 20:01:01.051062 dv-cinder-828806-6-smb devstack@keystone.service[82025]: [pid: 82025|app: 0|req: 942/1859] 10.222.0.33 () {60 vars in 1153 bytes} [Tue Sep 13 20:01:00 2022] POST /identity/v3/projects => generated 369 bytes in 182 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 13 20:01:01.055067 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efc992d0-7598-4789-aaf4-517535990e8f None None] Authenticating user token {{(pid=82026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 20:01:01.066339 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efc992d0-7598-4789-aaf4-517535990e8f None None] Validating token access rules against request {{(pid=82026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 20:01:01.127546 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-364e514b-8673-4b74-a8bb-928aceee8e10 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57539b6a6f3b4d589f5f5e1d211cd6a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b454f707d20347ada3d82aa85495635e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 20:01:01.128177 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-364e514b-8673-4b74-a8bb-928aceee8e10 admin admin] REQUEST_METHOD: `POST` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:01:01.128494 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-364e514b-8673-4b74-a8bb-928aceee8e10 admin admin] SCRIPT_NAME: `/identity` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:01:01.128778 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-364e514b-8673-4b74-a8bb-928aceee8e10 admin admin] PATH_INFO: `/v3/users` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:01:01.129799 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-364e514b-8673-4b74-a8bb-928aceee8e10 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 20:01:01.131831 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-364e514b-8673-4b74-a8bb-928aceee8e10 admin admin] RBAC: Authorization granted {{(pid=82026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 20:01:01.246608 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22a96346-49a3-4d06-8c22-422a6fa4369f admin admin] Authenticating user token {{(pid=82025) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 20:01:01.247684 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.fernet_utils [None req-22a96346-49a3-4d06-8c22-422a6fa4369f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82025) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 20:01:01.291362 dv-cinder-828806-6-smb devstack@keystone.service[82026]: [pid: 82026|app: 0|req: 918/1860] 10.222.0.33 () {60 vars in 1144 bytes} [Tue Sep 13 20:01:01 2022] POST /identity/v3/users => generated 291 bytes in 234 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 13 20:01:01.293615 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-364e514b-8673-4b74-a8bb-928aceee8e10 admin admin] Authenticating user token {{(pid=82026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 20:01:01.306849 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-364e514b-8673-4b74-a8bb-928aceee8e10 admin admin] Validating token access rules against request {{(pid=82026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 20:01:01.313418 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7e804b3-7464-4314-a558-ffefb187733d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57539b6a6f3b4d589f5f5e1d211cd6a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b454f707d20347ada3d82aa85495635e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 20:01:01.314998 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7e804b3-7464-4314-a558-ffefb187733d admin admin] REQUEST_METHOD: `GET` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:01:01.315914 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7e804b3-7464-4314-a558-ffefb187733d admin admin] SCRIPT_NAME: `/identity` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:01:01.316306 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7e804b3-7464-4314-a558-ffefb187733d admin admin] PATH_INFO: `/v3/roles` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:01:01.317072 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7e804b3-7464-4314-a558-ffefb187733d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 20:01:01.318814 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7e804b3-7464-4314-a558-ffefb187733d admin admin] RBAC: Authorization granted {{(pid=82026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 20:01:01.333454 dv-cinder-828806-6-smb devstack@keystone.service[82026]: [pid: 82026|app: 0|req: 919/1861] 10.222.0.33 () {58 vars in 1122 bytes} [Tue Sep 13 20:01:01 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 13 20:01:01.334816 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7e804b3-7464-4314-a558-ffefb187733d admin admin] Authenticating user token {{(pid=82026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 20:01:01.335276 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22a96346-49a3-4d06-8c22-422a6fa4369f admin admin] Validating token access rules against request {{(pid=82025) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 20:01:01.340681 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41917111-3cac-407c-8ba7-8937627970f7 tempest-VolumeQuotaClassesTest-1076310711 tempest-VolumeQuotaClassesTest-1076310711-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5de95bc3368549db985c90d6c7dd6f91', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '77ca9d83f6a740cfb0e2d847afb6ab55', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82025) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 20:01:01.341430 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41917111-3cac-407c-8ba7-8937627970f7 tempest-VolumeQuotaClassesTest-1076310711 tempest-VolumeQuotaClassesTest-1076310711-project-admin] REQUEST_METHOD: `GET` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:01:01.341819 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41917111-3cac-407c-8ba7-8937627970f7 tempest-VolumeQuotaClassesTest-1076310711 tempest-VolumeQuotaClassesTest-1076310711-project-admin] SCRIPT_NAME: `/identity` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:01:01.342205 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41917111-3cac-407c-8ba7-8937627970f7 tempest-VolumeQuotaClassesTest-1076310711 tempest-VolumeQuotaClassesTest-1076310711-project-admin] PATH_INFO: `/v3/domains` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:01:01.342968 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41917111-3cac-407c-8ba7-8937627970f7 tempest-VolumeQuotaClassesTest-1076310711 tempest-VolumeQuotaClassesTest-1076310711-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=82025) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 20:01:01.343426 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41917111-3cac-407c-8ba7-8937627970f7 tempest-VolumeQuotaClassesTest-1076310711 tempest-VolumeQuotaClassesTest-1076310711-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 20:01:01.345132 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41917111-3cac-407c-8ba7-8937627970f7 tempest-VolumeQuotaClassesTest-1076310711 tempest-VolumeQuotaClassesTest-1076310711-project-admin] RBAC: Authorization granted {{(pid=82025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 20:01:01.348591 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7e804b3-7464-4314-a558-ffefb187733d admin admin] Validating token access rules against request {{(pid=82026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 20:01:01.354449 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fe166f4-5ab6-4378-8d17-41fd9827d03a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57539b6a6f3b4d589f5f5e1d211cd6a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b454f707d20347ada3d82aa85495635e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 20:01:01.362611 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fe166f4-5ab6-4378-8d17-41fd9827d03a admin admin] REQUEST_METHOD: `PUT` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:01:01.362611 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fe166f4-5ab6-4378-8d17-41fd9827d03a admin admin] SCRIPT_NAME: `/identity` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:01:01.362611 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fe166f4-5ab6-4378-8d17-41fd9827d03a admin admin] PATH_INFO: `/v3/projects/f38844322511401796214bf25821c1b4/users/c5ad5116d24542f9b4be3e65ad63ccdf/roles/e5af7d5baa93469e9e486ef21c85474e` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:01:01.362887 dv-cinder-828806-6-smb devstack@keystone.service[82025]: [pid: 82025|app: 0|req: 943/1862] 10.222.0.33 () {58 vars in 1153 bytes} [Tue Sep 13 20:01:01 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 115 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 13 20:01:01.363846 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41917111-3cac-407c-8ba7-8937627970f7 tempest-VolumeQuotaClassesTest-1076310711 tempest-VolumeQuotaClassesTest-1076310711-project-admin] Authenticating user token {{(pid=82025) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 20:01:01.378138 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41917111-3cac-407c-8ba7-8937627970f7 tempest-VolumeQuotaClassesTest-1076310711 tempest-VolumeQuotaClassesTest-1076310711-project-admin] Validating token access rules against request {{(pid=82025) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 20:01:01.380855 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fe166f4-5ab6-4378-8d17-41fd9827d03a admin admin] RBAC: Authorizing `identity:create_grant(project_id=f38844322511401796214bf25821c1b4, user_id=c5ad5116d24542f9b4be3e65ad63ccdf, role_id=e5af7d5baa93469e9e486ef21c85474e)` {{(pid=82026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 20:01:01.384685 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-947e9b31-999c-46ff-9d2a-e52b3c9e8f55 tempest-VolumeQuotaClassesTest-1076310711 tempest-VolumeQuotaClassesTest-1076310711-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5de95bc3368549db985c90d6c7dd6f91', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '77ca9d83f6a740cfb0e2d847afb6ab55', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82025) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 20:01:01.384942 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fe166f4-5ab6-4378-8d17-41fd9827d03a admin admin] RBAC: Authorization granted {{(pid=82026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 20:01:01.385533 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-947e9b31-999c-46ff-9d2a-e52b3c9e8f55 tempest-VolumeQuotaClassesTest-1076310711 tempest-VolumeQuotaClassesTest-1076310711-project-admin] REQUEST_METHOD: `POST` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:01:01.385916 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-947e9b31-999c-46ff-9d2a-e52b3c9e8f55 tempest-VolumeQuotaClassesTest-1076310711 tempest-VolumeQuotaClassesTest-1076310711-project-admin] SCRIPT_NAME: `/identity` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:01:01.386300 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-947e9b31-999c-46ff-9d2a-e52b3c9e8f55 tempest-VolumeQuotaClassesTest-1076310711 tempest-VolumeQuotaClassesTest-1076310711-project-admin] PATH_INFO: `/v3/projects` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:01:01.387100 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-947e9b31-999c-46ff-9d2a-e52b3c9e8f55 tempest-VolumeQuotaClassesTest-1076310711 tempest-VolumeQuotaClassesTest-1076310711-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=82025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 20:01:01.389096 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-947e9b31-999c-46ff-9d2a-e52b3c9e8f55 tempest-VolumeQuotaClassesTest-1076310711 tempest-VolumeQuotaClassesTest-1076310711-project-admin] RBAC: Authorization granted {{(pid=82025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 20:01:01.414951 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG dbcounter [-] [82026] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82026) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 20:01:01.500294 dv-cinder-828806-6-smb devstack@keystone.service[82026]: [pid: 82026|app: 0|req: 920/1863] 10.222.0.33 () {60 vars in 1483 bytes} [Tue Sep 13 20:01:01 2022] PUT /identity/v3/projects/f38844322511401796214bf25821c1b4/users/c5ad5116d24542f9b4be3e65ad63ccdf/roles/e5af7d5baa93469e9e486ef21c85474e => generated 0 bytes in 166 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 20:01:01.503394 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fe166f4-5ab6-4378-8d17-41fd9827d03a admin admin] Authenticating user token {{(pid=82026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 20:01:01.507220 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.common.fernet_utils [None req-2fe166f4-5ab6-4378-8d17-41fd9827d03a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82026) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 20:01:01.515637 dv-cinder-828806-6-smb devstack@keystone.service[82025]: [pid: 82025|app: 0|req: 944/1864] 10.222.0.33 () {60 vars in 1153 bytes} [Tue Sep 13 20:01:01 2022] POST /identity/v3/projects => generated 355 bytes in 150 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 13 20:01:01.515637 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-947e9b31-999c-46ff-9d2a-e52b3c9e8f55 tempest-VolumeQuotaClassesTest-1076310711 tempest-VolumeQuotaClassesTest-1076310711-project-admin] Authenticating user token {{(pid=82025) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 20:01:01.584309 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fe166f4-5ab6-4378-8d17-41fd9827d03a admin admin] Validating token access rules against request {{(pid=82026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 20:01:01.589124 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e91a30c3-eef7-40c1-b7a4-764e9ef62863 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57539b6a6f3b4d589f5f5e1d211cd6a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b454f707d20347ada3d82aa85495635e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 20:01:01.589763 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e91a30c3-eef7-40c1-b7a4-764e9ef62863 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:01:01.590059 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e91a30c3-eef7-40c1-b7a4-764e9ef62863 admin admin] SCRIPT_NAME: `/identity` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:01:01.590530 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e91a30c3-eef7-40c1-b7a4-764e9ef62863 admin admin] PATH_INFO: `/v3/projects/59e91acd10f84954b9816f48a6e5930c` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:01:01.590636 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-947e9b31-999c-46ff-9d2a-e52b3c9e8f55 tempest-VolumeQuotaClassesTest-1076310711 tempest-VolumeQuotaClassesTest-1076310711-project-admin] Validating token access rules against request {{(pid=82025) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 20:01:01.591565 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e91a30c3-eef7-40c1-b7a4-764e9ef62863 admin admin] RBAC: Authorizing `identity:delete_project(project_id=59e91acd10f84954b9816f48a6e5930c)` {{(pid=82026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 20:01:01.593496 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e91a30c3-eef7-40c1-b7a4-764e9ef62863 admin admin] RBAC: Authorization granted {{(pid=82026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 20:01:01.595424 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddbf089a-8ca4-436f-a81d-89b66d325b9d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57539b6a6f3b4d589f5f5e1d211cd6a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b454f707d20347ada3d82aa85495635e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82025) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 20:01:01.598957 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddbf089a-8ca4-436f-a81d-89b66d325b9d admin admin] REQUEST_METHOD: `GET` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:01:01.598957 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddbf089a-8ca4-436f-a81d-89b66d325b9d admin admin] SCRIPT_NAME: `/identity` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:01:01.598957 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddbf089a-8ca4-436f-a81d-89b66d325b9d admin admin] PATH_INFO: `/v3/roles` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:01:01.598957 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddbf089a-8ca4-436f-a81d-89b66d325b9d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 20:01:01.598957 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddbf089a-8ca4-436f-a81d-89b66d325b9d admin admin] RBAC: Authorization granted {{(pid=82025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 20:01:01.609775 dv-cinder-828806-6-smb devstack@keystone.service[82025]: [pid: 82025|app: 0|req: 945/1865] 10.222.0.33 () {58 vars in 1122 bytes} [Tue Sep 13 20:01:01 2022] GET /identity/v3/roles => generated 1420 bytes in 96 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 13 20:01:01.610749 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddbf089a-8ca4-436f-a81d-89b66d325b9d admin admin] Authenticating user token {{(pid=82025) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 20:01:01.677766 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddbf089a-8ca4-436f-a81d-89b66d325b9d admin admin] Validating token access rules against request {{(pid=82025) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 20:01:01.683472 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c64e7172-aab9-46b0-a777-dbb3e77bf1b6 tempest-VolumeQuotaClassesTest-1076310711 tempest-VolumeQuotaClassesTest-1076310711-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5de95bc3368549db985c90d6c7dd6f91', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '77ca9d83f6a740cfb0e2d847afb6ab55', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82025) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 20:01:01.684086 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c64e7172-aab9-46b0-a777-dbb3e77bf1b6 tempest-VolumeQuotaClassesTest-1076310711 tempest-VolumeQuotaClassesTest-1076310711-project-admin] REQUEST_METHOD: `GET` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:01:01.684378 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c64e7172-aab9-46b0-a777-dbb3e77bf1b6 tempest-VolumeQuotaClassesTest-1076310711 tempest-VolumeQuotaClassesTest-1076310711-project-admin] SCRIPT_NAME: `/identity` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:01:01.684654 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c64e7172-aab9-46b0-a777-dbb3e77bf1b6 tempest-VolumeQuotaClassesTest-1076310711 tempest-VolumeQuotaClassesTest-1076310711-project-admin] PATH_INFO: `/v3/domains` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:01:01.685354 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c64e7172-aab9-46b0-a777-dbb3e77bf1b6 tempest-VolumeQuotaClassesTest-1076310711 tempest-VolumeQuotaClassesTest-1076310711-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=82025) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 20:01:01.685662 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c64e7172-aab9-46b0-a777-dbb3e77bf1b6 tempest-VolumeQuotaClassesTest-1076310711 tempest-VolumeQuotaClassesTest-1076310711-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 20:01:01.687280 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c64e7172-aab9-46b0-a777-dbb3e77bf1b6 tempest-VolumeQuotaClassesTest-1076310711 tempest-VolumeQuotaClassesTest-1076310711-project-admin] RBAC: Authorization granted {{(pid=82025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 20:01:01.707527 dv-cinder-828806-6-smb devstack@keystone.service[82025]: [pid: 82025|app: 0|req: 946/1866] 10.222.0.33 () {58 vars in 1153 bytes} [Tue Sep 13 20:01:01 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 94 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 20:01:01.707527 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c64e7172-aab9-46b0-a777-dbb3e77bf1b6 tempest-VolumeQuotaClassesTest-1076310711 tempest-VolumeQuotaClassesTest-1076310711-project-admin] Authenticating user token {{(pid=82025) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 20:01:01.715796 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.notifications [None req-e91a30c3-eef7-40c1-b7a4-764e9ef62863 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '59e91acd10f84954b9816f48a6e5930c', 'request_id': 'req-e91a30c3-eef7-40c1-b7a4-764e9ef62863'} {{(pid=82026) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 20:01:01.716720 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c64e7172-aab9-46b0-a777-dbb3e77bf1b6 tempest-VolumeQuotaClassesTest-1076310711 tempest-VolumeQuotaClassesTest-1076310711-project-admin] Validating token access rules against request {{(pid=82025) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 20:01:01.781521 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-205e5469-4f07-41bf-8877-6f29fec8d90c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57539b6a6f3b4d589f5f5e1d211cd6a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b454f707d20347ada3d82aa85495635e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82025) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 20:01:01.781521 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-205e5469-4f07-41bf-8877-6f29fec8d90c admin admin] REQUEST_METHOD: `PUT` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:01:01.781521 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-205e5469-4f07-41bf-8877-6f29fec8d90c admin admin] SCRIPT_NAME: `/identity` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:01:01.781521 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-205e5469-4f07-41bf-8877-6f29fec8d90c admin admin] PATH_INFO: `/v3/projects/f38844322511401796214bf25821c1b4/users/c5ad5116d24542f9b4be3e65ad63ccdf/roles/e5af7d5baa93469e9e486ef21c85474e` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:01:01.782268 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-205e5469-4f07-41bf-8877-6f29fec8d90c admin admin] RBAC: Authorizing `identity:create_grant(project_id=f38844322511401796214bf25821c1b4, user_id=c5ad5116d24542f9b4be3e65ad63ccdf, role_id=e5af7d5baa93469e9e486ef21c85474e)` {{(pid=82025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 20:01:01.785507 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-205e5469-4f07-41bf-8877-6f29fec8d90c admin admin] RBAC: Authorization granted {{(pid=82025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 20:01:01.793678 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.notifications [None req-e91a30c3-eef7-40c1-b7a4-764e9ef62863 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '59e91acd10f84954b9816f48a6e5930c', 'request_id': 'req-e91a30c3-eef7-40c1-b7a4-764e9ef62863'} {{(pid=82026) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 20:01:01.801684 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.notifications [None req-e91a30c3-eef7-40c1-b7a4-764e9ef62863 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '59e91acd10f84954b9816f48a6e5930c', 'request_id': 'req-e91a30c3-eef7-40c1-b7a4-764e9ef62863'} {{(pid=82026) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 20:01:01.803621 dv-cinder-828806-6-smb devstack@keystone.service[82025]: [pid: 82025|app: 0|req: 947/1867] 10.222.0.33 () {60 vars in 1483 bytes} [Tue Sep 13 20:01:01 2022] PUT /identity/v3/projects/f38844322511401796214bf25821c1b4/users/c5ad5116d24542f9b4be3e65ad63ccdf/roles/e5af7d5baa93469e9e486ef21c85474e => generated 0 bytes in 98 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 20:01:01.805373 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-205e5469-4f07-41bf-8877-6f29fec8d90c admin admin] Authenticating user token {{(pid=82025) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 20:01:01.819299 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.notifications [None req-e91a30c3-eef7-40c1-b7a4-764e9ef62863 admin admin] The token cache is being invalidate because project 59e91acd10f84954b9816f48a6e5930c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82026) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 13 20:01:01.819984 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.notifications [None req-e91a30c3-eef7-40c1-b7a4-764e9ef62863 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82026) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 20:01:01.821326 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.notifications [None req-e91a30c3-eef7-40c1-b7a4-764e9ef62863 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82026) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 20:01:01.823769 dv-cinder-828806-6-smb devstack@keystone.service[82026]: [pid: 82026|app: 0|req: 921/1868] 10.222.0.33 () {58 vars in 1233 bytes} [Tue Sep 13 20:01:01 2022] DELETE /identity/v3/projects/59e91acd10f84954b9816f48a6e5930c => generated 0 bytes in 323 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 20:01:01.826878 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84655681-4189-4d1f-8ae0-a57166be9f41 None None] REQUEST_METHOD: `POST` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:01:01.826878 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84655681-4189-4d1f-8ae0-a57166be9f41 None None] SCRIPT_NAME: `/identity` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:01:01.826878 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84655681-4189-4d1f-8ae0-a57166be9f41 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:01:01.861920 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.auth.core [None req-84655681-4189-4d1f-8ae0-a57166be9f41 None None] MFA Rules not processed for user `c5ad5116d24542f9b4be3e65ad63ccdf`. Rule list: `[]` (Enabled: `True`). {{(pid=82026) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 20:01:01.863853 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.common.fernet_utils [None req-84655681-4189-4d1f-8ae0-a57166be9f41 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82026) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 20:01:01.921887 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-205e5469-4f07-41bf-8877-6f29fec8d90c admin admin] Validating token access rules against request {{(pid=82025) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 20:01:01.941774 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eec2691-3184-4c0f-9515-94fea4e22074 tempest-VolumeQuotaClassesTest-1076310711 tempest-VolumeQuotaClassesTest-1076310711-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5de95bc3368549db985c90d6c7dd6f91', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '77ca9d83f6a740cfb0e2d847afb6ab55', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82025) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 20:01:01.942468 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eec2691-3184-4c0f-9515-94fea4e22074 tempest-VolumeQuotaClassesTest-1076310711 tempest-VolumeQuotaClassesTest-1076310711-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:01:01.942793 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eec2691-3184-4c0f-9515-94fea4e22074 tempest-VolumeQuotaClassesTest-1076310711 tempest-VolumeQuotaClassesTest-1076310711-project-admin] SCRIPT_NAME: `/identity` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:01:01.943129 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eec2691-3184-4c0f-9515-94fea4e22074 tempest-VolumeQuotaClassesTest-1076310711 tempest-VolumeQuotaClassesTest-1076310711-project-admin] PATH_INFO: `/v3/projects/272176bbc7a74b2aa2b7b1c7b50943ce` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:01:01.944368 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4eec2691-3184-4c0f-9515-94fea4e22074 tempest-VolumeQuotaClassesTest-1076310711 tempest-VolumeQuotaClassesTest-1076310711-project-admin] RBAC: Authorizing `identity:delete_project(project_id=272176bbc7a74b2aa2b7b1c7b50943ce)` {{(pid=82025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 20:01:01.947890 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4eec2691-3184-4c0f-9515-94fea4e22074 tempest-VolumeQuotaClassesTest-1076310711 tempest-VolumeQuotaClassesTest-1076310711-project-admin] RBAC: Authorization granted {{(pid=82025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 20:01:01.985413 dv-cinder-828806-6-smb devstack@keystone.service[82026]: [pid: 82026|app: 0|req: 922/1869] 10.222.0.33 () {58 vars in 958 bytes} [Tue Sep 13 20:01:01 2022] POST /identity/v3/auth/tokens => generated 3313 bytes in 161 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 20:01:01.986780 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84655681-4189-4d1f-8ae0-a57166be9f41 None None] Authenticating user token {{(pid=82026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 20:01:01.988717 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.common.fernet_utils [None req-84655681-4189-4d1f-8ae0-a57166be9f41 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82026) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 20:01:02.061979 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84655681-4189-4d1f-8ae0-a57166be9f41 None None] Validating token access rules against request {{(pid=82026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 20:01:02.063610 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fac979b-16d9-4085-bc44-2124435919bb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57539b6a6f3b4d589f5f5e1d211cd6a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b454f707d20347ada3d82aa85495635e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 20:01:02.063797 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fac979b-16d9-4085-bc44-2124435919bb admin admin] REQUEST_METHOD: `DELETE` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:01:02.064012 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fac979b-16d9-4085-bc44-2124435919bb admin admin] SCRIPT_NAME: `/identity` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:01:02.064295 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fac979b-16d9-4085-bc44-2124435919bb admin admin] PATH_INFO: `/v3/users/08b661d4d07c4f0ba20b1695bfdca4d2` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:01:02.065504 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fac979b-16d9-4085-bc44-2124435919bb admin admin] RBAC: Authorizing `identity:delete_user(user_id=08b661d4d07c4f0ba20b1695bfdca4d2)` {{(pid=82026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 20:01:02.067490 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fac979b-16d9-4085-bc44-2124435919bb admin admin] RBAC: Authorization granted {{(pid=82026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 20:01:03.235176 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.notifications [None req-4eec2691-3184-4c0f-9515-94fea4e22074 tempest-VolumeQuotaClassesTest-1076310711 tempest-VolumeQuotaClassesTest-1076310711-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '272176bbc7a74b2aa2b7b1c7b50943ce', 'request_id': 'req-4eec2691-3184-4c0f-9515-94fea4e22074'} {{(pid=82025) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 20:01:03.241569 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.notifications [None req-4eec2691-3184-4c0f-9515-94fea4e22074 tempest-VolumeQuotaClassesTest-1076310711 tempest-VolumeQuotaClassesTest-1076310711-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '272176bbc7a74b2aa2b7b1c7b50943ce', 'request_id': 'req-4eec2691-3184-4c0f-9515-94fea4e22074'} {{(pid=82025) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 20:01:03.279265 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.notifications [None req-4eec2691-3184-4c0f-9515-94fea4e22074 tempest-VolumeQuotaClassesTest-1076310711 tempest-VolumeQuotaClassesTest-1076310711-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '272176bbc7a74b2aa2b7b1c7b50943ce', 'request_id': 'req-4eec2691-3184-4c0f-9515-94fea4e22074'} {{(pid=82025) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 20:01:03.346253 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.notifications [None req-4eec2691-3184-4c0f-9515-94fea4e22074 tempest-VolumeQuotaClassesTest-1076310711 tempest-VolumeQuotaClassesTest-1076310711-project-admin] The token cache is being invalidate because project 272176bbc7a74b2aa2b7b1c7b50943ce was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82025) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 13 20:01:03.346725 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.notifications [None req-4eec2691-3184-4c0f-9515-94fea4e22074 tempest-VolumeQuotaClassesTest-1076310711 tempest-VolumeQuotaClassesTest-1076310711-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82025) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 20:01:03.347493 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.notifications [None req-4eec2691-3184-4c0f-9515-94fea4e22074 tempest-VolumeQuotaClassesTest-1076310711 tempest-VolumeQuotaClassesTest-1076310711-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82025) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 20:01:03.349125 dv-cinder-828806-6-smb devstack@keystone.service[82025]: [pid: 82025|app: 0|req: 948/1870] 10.222.0.33 () {58 vars in 1233 bytes} [Tue Sep 13 20:01:01 2022] DELETE /identity/v3/projects/272176bbc7a74b2aa2b7b1c7b50943ce => generated 0 bytes in 1545 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 20:01:03.349981 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eec2691-3184-4c0f-9515-94fea4e22074 tempest-VolumeQuotaClassesTest-1076310711 tempest-VolumeQuotaClassesTest-1076310711-project-admin] Authenticating user token {{(pid=82025) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 20:01:03.351450 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.fernet_utils [None req-4eec2691-3184-4c0f-9515-94fea4e22074 tempest-VolumeQuotaClassesTest-1076310711 tempest-VolumeQuotaClassesTest-1076310711-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82025) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 20:01:03.359281 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.notifications [None req-8fac979b-16d9-4085-bc44-2124435919bb admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '08b661d4d07c4f0ba20b1695bfdca4d2'} {{(pid=82026) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 20:01:03.428695 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eec2691-3184-4c0f-9515-94fea4e22074 tempest-VolumeQuotaClassesTest-1076310711 tempest-VolumeQuotaClassesTest-1076310711-project-admin] Validating token access rules against request {{(pid=82025) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 20:01:03.432917 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc59e23c-a615-4fcc-ba63-fb6b8230a315 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46024fc6167f4321818b1bed27a521a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8c6fba0f15b4d6a84ff601919b7b8e4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82025) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 20:01:03.433706 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc59e23c-a615-4fcc-ba63-fb6b8230a315 service cinder] REQUEST_METHOD: `GET` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:01:03.434096 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc59e23c-a615-4fcc-ba63-fb6b8230a315 service cinder] SCRIPT_NAME: `/identity` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:01:03.434673 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc59e23c-a615-4fcc-ba63-fb6b8230a315 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:01:03.436841 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.fernet_utils [None req-dc59e23c-a615-4fcc-ba63-fb6b8230a315 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82025) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 20:01:03.437864 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.notifications [None req-8fac979b-16d9-4085-bc44-2124435919bb admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '08b661d4d07c4f0ba20b1695bfdca4d2'} {{(pid=82026) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 20:01:03.454356 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.notifications [None req-8fac979b-16d9-4085-bc44-2124435919bb admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '08b661d4d07c4f0ba20b1695bfdca4d2'} {{(pid=82026) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 20:01:03.455261 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.notifications [None req-8fac979b-16d9-4085-bc44-2124435919bb admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '08b661d4d07c4f0ba20b1695bfdca4d2'} {{(pid=82026) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 20:01:03.463688 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.notifications [None req-8fac979b-16d9-4085-bc44-2124435919bb admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '08b661d4d07c4f0ba20b1695bfdca4d2'} {{(pid=82026) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 20:01:03.470157 dv-cinder-828806-6-smb devstack@keystone.service[82026]: [pid: 82026|app: 0|req: 923/1871] 10.222.0.33 () {58 vars in 1224 bytes} [Tue Sep 13 20:01:01 2022] DELETE /identity/v3/users/08b661d4d07c4f0ba20b1695bfdca4d2 => generated 0 bytes in 1484 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 20:01:03.517389 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc59e23c-a615-4fcc-ba63-fb6b8230a315 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=82025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 20:01:03.519378 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc59e23c-a615-4fcc-ba63-fb6b8230a315 service cinder] RBAC: Authorization granted {{(pid=82025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 20:01:03.532556 dv-cinder-828806-6-smb devstack@keystone.service[82025]: [pid: 82025|app: 0|req: 949/1872] 10.222.0.33 () {60 vars in 1365 bytes} [Tue Sep 13 20:01:03 2022] GET /identity/v3/auth/tokens => generated 3313 bytes in 183 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 20:01:03.656014 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG dbcounter [-] [82025] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82025) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 20:01:03.705158 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fac979b-16d9-4085-bc44-2124435919bb admin admin] Authenticating user token {{(pid=82026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 20:01:03.706683 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.common.fernet_utils [None req-8fac979b-16d9-4085-bc44-2124435919bb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82026) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 20:01:03.721558 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc59e23c-a615-4fcc-ba63-fb6b8230a315 service cinder] Authenticating user token {{(pid=82025) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 20:01:03.737583 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc59e23c-a615-4fcc-ba63-fb6b8230a315 service cinder] Validating token access rules against request {{(pid=82025) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 20:01:03.828253 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1470bad-0d64-44dd-ba4c-8c9a080754fe service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46024fc6167f4321818b1bed27a521a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8c6fba0f15b4d6a84ff601919b7b8e4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82025) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 20:01:03.829568 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1470bad-0d64-44dd-ba4c-8c9a080754fe service cinder] REQUEST_METHOD: `GET` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:01:03.830450 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1470bad-0d64-44dd-ba4c-8c9a080754fe service cinder] SCRIPT_NAME: `/identity` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:01:03.830839 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1470bad-0d64-44dd-ba4c-8c9a080754fe service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:01:03.832821 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.fernet_utils [None req-d1470bad-0d64-44dd-ba4c-8c9a080754fe service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82025) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 20:01:03.849685 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fac979b-16d9-4085-bc44-2124435919bb admin admin] Validating token access rules against request {{(pid=82026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 20:01:03.857631 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47734384-477b-448e-8336-e5571ed9c1b6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57539b6a6f3b4d589f5f5e1d211cd6a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b454f707d20347ada3d82aa85495635e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 20:01:03.858938 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47734384-477b-448e-8336-e5571ed9c1b6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:01:03.859501 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47734384-477b-448e-8336-e5571ed9c1b6 admin admin] SCRIPT_NAME: `/identity` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:01:03.859960 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47734384-477b-448e-8336-e5571ed9c1b6 admin admin] PATH_INFO: `/v3/users/2bc4c5d9c1a54c218702bf0feba6419d` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:01:03.861944 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47734384-477b-448e-8336-e5571ed9c1b6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=2bc4c5d9c1a54c218702bf0feba6419d)` {{(pid=82026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 20:01:03.865277 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47734384-477b-448e-8336-e5571ed9c1b6 admin admin] RBAC: Authorization granted {{(pid=82026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 20:01:03.965316 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1470bad-0d64-44dd-ba4c-8c9a080754fe service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=82025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 20:01:03.970953 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1470bad-0d64-44dd-ba4c-8c9a080754fe service cinder] RBAC: Authorization granted {{(pid=82025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 20:01:03.989301 dv-cinder-828806-6-smb devstack@keystone.service[82025]: [pid: 82025|app: 0|req: 950/1873] 10.222.0.33 () {60 vars in 1365 bytes} [Tue Sep 13 20:01:03 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 273 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 20:01:04.123537 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1470bad-0d64-44dd-ba4c-8c9a080754fe service cinder] Authenticating user token {{(pid=82025) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 20:01:04.125697 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.fernet_utils [None req-d1470bad-0d64-44dd-ba4c-8c9a080754fe service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82025) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 20:01:04.134000 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.notifications [None req-47734384-477b-448e-8336-e5571ed9c1b6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2bc4c5d9c1a54c218702bf0feba6419d'} {{(pid=82026) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 20:01:04.156978 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1470bad-0d64-44dd-ba4c-8c9a080754fe service cinder] Validating token access rules against request {{(pid=82025) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 20:01:04.159428 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96f1009a-aa0d-447d-8b6b-d58c10b5627a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57539b6a6f3b4d589f5f5e1d211cd6a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b454f707d20347ada3d82aa85495635e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82025) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 20:01:04.160149 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96f1009a-aa0d-447d-8b6b-d58c10b5627a admin admin] REQUEST_METHOD: `DELETE` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:01:04.160549 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96f1009a-aa0d-447d-8b6b-d58c10b5627a admin admin] SCRIPT_NAME: `/identity` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:01:04.160832 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96f1009a-aa0d-447d-8b6b-d58c10b5627a admin admin] PATH_INFO: `/v3/projects/1443ad8454cf460b97625cc8e2dc6de6` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:01:04.162062 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96f1009a-aa0d-447d-8b6b-d58c10b5627a admin admin] RBAC: Authorizing `identity:delete_project(project_id=1443ad8454cf460b97625cc8e2dc6de6)` {{(pid=82025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 20:01:04.164057 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96f1009a-aa0d-447d-8b6b-d58c10b5627a admin admin] RBAC: Authorization granted {{(pid=82025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 20:01:04.226115 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.notifications [None req-47734384-477b-448e-8336-e5571ed9c1b6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2bc4c5d9c1a54c218702bf0feba6419d'} {{(pid=82026) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 20:01:04.244318 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.notifications [None req-47734384-477b-448e-8336-e5571ed9c1b6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2bc4c5d9c1a54c218702bf0feba6419d'} {{(pid=82026) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 20:01:04.244979 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.notifications [None req-47734384-477b-448e-8336-e5571ed9c1b6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2bc4c5d9c1a54c218702bf0feba6419d'} {{(pid=82026) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 20:01:04.252823 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.notifications [None req-47734384-477b-448e-8336-e5571ed9c1b6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2bc4c5d9c1a54c218702bf0feba6419d'} {{(pid=82026) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 20:01:04.259183 dv-cinder-828806-6-smb devstack@keystone.service[82026]: [pid: 82026|app: 0|req: 924/1874] 10.222.0.33 () {58 vars in 1224 bytes} [Tue Sep 13 20:01:03 2022] DELETE /identity/v3/users/2bc4c5d9c1a54c218702bf0feba6419d => generated 0 bytes in 555 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 20:01:04.263575 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79b2edc4-f746-4caf-8b49-75723786b093 None None] REQUEST_METHOD: `POST` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:01:04.263863 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79b2edc4-f746-4caf-8b49-75723786b093 None None] SCRIPT_NAME: `/identity` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:01:04.264144 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79b2edc4-f746-4caf-8b49-75723786b093 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:01:04.283858 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.auth.core [None req-79b2edc4-f746-4caf-8b49-75723786b093 None None] MFA Rules not processed for user `57539b6a6f3b4d589f5f5e1d211cd6a0`. Rule list: `[]` (Enabled: `True`). {{(pid=82026) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 20:01:04.285056 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.common.fernet_utils [None req-79b2edc4-f746-4caf-8b49-75723786b093 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82026) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 20:01:04.303056 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.notifications [None req-96f1009a-aa0d-447d-8b6b-d58c10b5627a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1443ad8454cf460b97625cc8e2dc6de6', 'request_id': 'req-96f1009a-aa0d-447d-8b6b-d58c10b5627a'} {{(pid=82025) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 20:01:04.309630 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.notifications [None req-96f1009a-aa0d-447d-8b6b-d58c10b5627a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1443ad8454cf460b97625cc8e2dc6de6', 'request_id': 'req-96f1009a-aa0d-447d-8b6b-d58c10b5627a'} {{(pid=82025) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 20:01:04.317464 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.notifications [None req-96f1009a-aa0d-447d-8b6b-d58c10b5627a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1443ad8454cf460b97625cc8e2dc6de6', 'request_id': 'req-96f1009a-aa0d-447d-8b6b-d58c10b5627a'} {{(pid=82025) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 20:01:04.356403 dv-cinder-828806-6-smb devstack@keystone.service[82026]: [pid: 82026|app: 0|req: 925/1875] 10.222.0.33 () {58 vars in 958 bytes} [Tue Sep 13 20:01:04 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 13 20:01:04.366109 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79b2edc4-f746-4caf-8b49-75723786b093 None None] Authenticating user token {{(pid=82026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 20:01:04.367720 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.common.fernet_utils [None req-79b2edc4-f746-4caf-8b49-75723786b093 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82026) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 20:01:04.413960 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.notifications [None req-96f1009a-aa0d-447d-8b6b-d58c10b5627a admin admin] The token cache is being invalidate because project 1443ad8454cf460b97625cc8e2dc6de6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82025) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 13 20:01:04.418058 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.notifications [None req-96f1009a-aa0d-447d-8b6b-d58c10b5627a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82025) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 20:01:04.418058 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.notifications [None req-96f1009a-aa0d-447d-8b6b-d58c10b5627a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82025) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 20:01:04.418058 dv-cinder-828806-6-smb devstack@keystone.service[82025]: [pid: 82025|app: 0|req: 951/1876] 10.222.0.33 () {58 vars in 1233 bytes} [Tue Sep 13 20:01:04 2022] DELETE /identity/v3/projects/1443ad8454cf460b97625cc8e2dc6de6 => generated 0 bytes in 295 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 13 20:01:04.422032 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96f1009a-aa0d-447d-8b6b-d58c10b5627a admin admin] Authenticating user token {{(pid=82025) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 20:01:04.423510 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.fernet_utils [None req-96f1009a-aa0d-447d-8b6b-d58c10b5627a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82025) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 20:01:04.425536 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79b2edc4-f746-4caf-8b49-75723786b093 None None] Validating token access rules against request {{(pid=82026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 20:01:04.478946 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2bf79b1-7d56-4b0b-b028-019051da2b84 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '023a2c79c2444611b3d431928e56685d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8c6fba0f15b4d6a84ff601919b7b8e4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 20:01:04.479591 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2bf79b1-7d56-4b0b-b028-019051da2b84 service neutron] REQUEST_METHOD: `GET` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:01:04.479964 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2bf79b1-7d56-4b0b-b028-019051da2b84 service neutron] SCRIPT_NAME: `/identity` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:01:04.480238 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2bf79b1-7d56-4b0b-b028-019051da2b84 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:01:04.482022 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.common.fernet_utils [None req-f2bf79b1-7d56-4b0b-b028-019051da2b84 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82026) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 20:01:04.500401 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96f1009a-aa0d-447d-8b6b-d58c10b5627a admin admin] Validating token access rules against request {{(pid=82025) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 20:01:04.507299 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de54c5d5-08b9-4d13-8b29-ccdba21ebe1e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57539b6a6f3b4d589f5f5e1d211cd6a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b454f707d20347ada3d82aa85495635e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82025) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 20:01:04.508731 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de54c5d5-08b9-4d13-8b29-ccdba21ebe1e admin admin] REQUEST_METHOD: `DELETE` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:01:04.509000 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de54c5d5-08b9-4d13-8b29-ccdba21ebe1e admin admin] SCRIPT_NAME: `/identity` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:01:04.509273 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de54c5d5-08b9-4d13-8b29-ccdba21ebe1e admin admin] PATH_INFO: `/v3/users/9c853c7a3f85477eac059dd98b7eed0d` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:01:04.515378 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de54c5d5-08b9-4d13-8b29-ccdba21ebe1e admin admin] RBAC: Authorizing `identity:delete_user(user_id=9c853c7a3f85477eac059dd98b7eed0d)` {{(pid=82025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 20:01:04.518315 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de54c5d5-08b9-4d13-8b29-ccdba21ebe1e admin admin] RBAC: Authorization granted {{(pid=82025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 20:01:04.550639 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2bf79b1-7d56-4b0b-b028-019051da2b84 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 20:01:04.553066 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2bf79b1-7d56-4b0b-b028-019051da2b84 service neutron] RBAC: Authorization granted {{(pid=82026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 20:01:04.563431 dv-cinder-828806-6-smb devstack@keystone.service[82026]: [pid: 82026|app: 0|req: 926/1877] 10.222.0.33 () {60 vars in 1365 bytes} [Tue Sep 13 20:01:04 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 198 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 13 20:01:04.645849 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2bf79b1-7d56-4b0b-b028-019051da2b84 service neutron] Authenticating user token {{(pid=82026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 20:01:04.648432 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.common.fernet_utils [None req-f2bf79b1-7d56-4b0b-b028-019051da2b84 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82026) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 20:01:04.669766 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2bf79b1-7d56-4b0b-b028-019051da2b84 service neutron] Validating token access rules against request {{(pid=82026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 20:01:04.671987 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebaba149-daaf-40b0-a4ea-cacbcd3e36fb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57539b6a6f3b4d589f5f5e1d211cd6a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b454f707d20347ada3d82aa85495635e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 20:01:04.672652 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebaba149-daaf-40b0-a4ea-cacbcd3e36fb admin admin] REQUEST_METHOD: `DELETE` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:01:04.672943 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebaba149-daaf-40b0-a4ea-cacbcd3e36fb admin admin] SCRIPT_NAME: `/identity` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:01:04.673254 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebaba149-daaf-40b0-a4ea-cacbcd3e36fb admin admin] PATH_INFO: `/v3/users/2c854e32587a4aa0b0744406abb64dee` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:01:04.674666 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebaba149-daaf-40b0-a4ea-cacbcd3e36fb admin admin] RBAC: Authorizing `identity:delete_user(user_id=2c854e32587a4aa0b0744406abb64dee)` {{(pid=82026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 20:01:04.676733 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebaba149-daaf-40b0-a4ea-cacbcd3e36fb admin admin] RBAC: Authorization granted {{(pid=82026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 20:01:04.732100 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.notifications [None req-de54c5d5-08b9-4d13-8b29-ccdba21ebe1e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9c853c7a3f85477eac059dd98b7eed0d'} {{(pid=82025) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 20:01:04.834293 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG dbcounter [-] [82026] Writing DB stats keystone:SELECT=88,keystone:INSERT=5,keystone:DELETE=7 {{(pid=82026) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 20:01:04.834862 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.notifications [None req-de54c5d5-08b9-4d13-8b29-ccdba21ebe1e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9c853c7a3f85477eac059dd98b7eed0d'} {{(pid=82025) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 20:01:04.834862 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.notifications [None req-de54c5d5-08b9-4d13-8b29-ccdba21ebe1e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9c853c7a3f85477eac059dd98b7eed0d'} {{(pid=82025) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 20:01:04.855259 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.notifications [None req-de54c5d5-08b9-4d13-8b29-ccdba21ebe1e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9c853c7a3f85477eac059dd98b7eed0d'} {{(pid=82025) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 20:01:04.874581 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.notifications [None req-de54c5d5-08b9-4d13-8b29-ccdba21ebe1e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9c853c7a3f85477eac059dd98b7eed0d'} {{(pid=82025) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 20:01:04.874581 dv-cinder-828806-6-smb devstack@keystone.service[82025]: [pid: 82025|app: 0|req: 952/1878] 10.222.0.33 () {58 vars in 1224 bytes} [Tue Sep 13 20:01:04 2022] DELETE /identity/v3/users/9c853c7a3f85477eac059dd98b7eed0d => generated 0 bytes in 448 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 20:01:04.923656 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.notifications [None req-ebaba149-daaf-40b0-a4ea-cacbcd3e36fb admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2c854e32587a4aa0b0744406abb64dee'} {{(pid=82026) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 20:01:05.006922 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.notifications [None req-ebaba149-daaf-40b0-a4ea-cacbcd3e36fb admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2c854e32587a4aa0b0744406abb64dee'} {{(pid=82026) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 20:01:05.032857 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.notifications [None req-ebaba149-daaf-40b0-a4ea-cacbcd3e36fb admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2c854e32587a4aa0b0744406abb64dee'} {{(pid=82026) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 20:01:05.190795 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.notifications [None req-ebaba149-daaf-40b0-a4ea-cacbcd3e36fb admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2c854e32587a4aa0b0744406abb64dee'} {{(pid=82026) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 20:01:05.190795 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.notifications [None req-ebaba149-daaf-40b0-a4ea-cacbcd3e36fb admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2c854e32587a4aa0b0744406abb64dee'} {{(pid=82026) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 20:01:05.190795 dv-cinder-828806-6-smb devstack@keystone.service[82026]: [pid: 82026|app: 0|req: 927/1879] 10.222.0.33 () {58 vars in 1224 bytes} [Tue Sep 13 20:01:04 2022] DELETE /identity/v3/users/2c854e32587a4aa0b0744406abb64dee => generated 0 bytes in 408 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 13 20:01:05.191894 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df84d756-f79f-47ba-bc73-d796561c06b3 None None] REQUEST_METHOD: `POST` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:01:05.191894 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df84d756-f79f-47ba-bc73-d796561c06b3 None None] SCRIPT_NAME: `/identity` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:01:05.191894 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df84d756-f79f-47ba-bc73-d796561c06b3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:01:05.191894 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.auth.core [None req-df84d756-f79f-47ba-bc73-d796561c06b3 None None] MFA Rules not processed for user `57539b6a6f3b4d589f5f5e1d211cd6a0`. Rule list: `[]` (Enabled: `True`). {{(pid=82025) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 20:01:05.191894 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.fernet_utils [None req-df84d756-f79f-47ba-bc73-d796561c06b3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82025) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 20:01:05.191894 dv-cinder-828806-6-smb devstack@keystone.service[82025]: [pid: 82025|app: 0|req: 953/1880] 10.222.0.33 () {58 vars in 958 bytes} [Tue Sep 13 20:01:05 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 20:01:05.192660 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebaba149-daaf-40b0-a4ea-cacbcd3e36fb admin admin] Authenticating user token {{(pid=82026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 20:01:05.192660 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.common.fernet_utils [None req-ebaba149-daaf-40b0-a4ea-cacbcd3e36fb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82026) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 20:01:05.196621 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG dbcounter [-] [82025] Writing DB stats keystone:INSERT=1,keystone:SELECT=99 {{(pid=82025) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 20:01:05.212773 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df84d756-f79f-47ba-bc73-d796561c06b3 None None] Authenticating user token {{(pid=82025) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 20:01:05.215367 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.fernet_utils [None req-df84d756-f79f-47ba-bc73-d796561c06b3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82025) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 20:01:05.237637 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebaba149-daaf-40b0-a4ea-cacbcd3e36fb admin admin] Validating token access rules against request {{(pid=82026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 20:01:05.238307 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeea2b3e-3345-404c-98b3-b67463b1b30e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '023a2c79c2444611b3d431928e56685d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8c6fba0f15b4d6a84ff601919b7b8e4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 20:01:05.239313 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeea2b3e-3345-404c-98b3-b67463b1b30e service neutron] REQUEST_METHOD: `GET` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:01:05.239954 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeea2b3e-3345-404c-98b3-b67463b1b30e service neutron] SCRIPT_NAME: `/identity` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:01:05.240397 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeea2b3e-3345-404c-98b3-b67463b1b30e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:01:05.253198 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eeea2b3e-3345-404c-98b3-b67463b1b30e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 20:01:05.255996 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eeea2b3e-3345-404c-98b3-b67463b1b30e service neutron] RBAC: Authorization granted {{(pid=82026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 20:01:05.269836 dv-cinder-828806-6-smb devstack@keystone.service[82026]: [pid: 82026|app: 0|req: 928/1881] 10.222.0.33 () {60 vars in 1365 bytes} [Tue Sep 13 20:01:05 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 115 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 20:01:05.282783 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df84d756-f79f-47ba-bc73-d796561c06b3 None None] Validating token access rules against request {{(pid=82025) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 20:01:05.293008 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e6bf9b6-a921-4300-94a1-4fc35eefd344 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57539b6a6f3b4d589f5f5e1d211cd6a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b454f707d20347ada3d82aa85495635e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82025) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 20:01:05.293837 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e6bf9b6-a921-4300-94a1-4fc35eefd344 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:01:05.294124 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e6bf9b6-a921-4300-94a1-4fc35eefd344 admin admin] SCRIPT_NAME: `/identity` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:01:05.294399 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e6bf9b6-a921-4300-94a1-4fc35eefd344 admin admin] PATH_INFO: `/v3/projects/81998043727d4c6ea53e2fae4f4b4eab` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:01:05.296660 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e6bf9b6-a921-4300-94a1-4fc35eefd344 admin admin] RBAC: Authorizing `identity:delete_project(project_id=81998043727d4c6ea53e2fae4f4b4eab)` {{(pid=82025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 20:01:05.298624 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e6bf9b6-a921-4300-94a1-4fc35eefd344 admin admin] RBAC: Authorization granted {{(pid=82025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 20:01:05.470744 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.notifications [None req-6e6bf9b6-a921-4300-94a1-4fc35eefd344 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '81998043727d4c6ea53e2fae4f4b4eab', 'request_id': 'req-6e6bf9b6-a921-4300-94a1-4fc35eefd344'} {{(pid=82025) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 20:01:05.476957 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.notifications [None req-6e6bf9b6-a921-4300-94a1-4fc35eefd344 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '81998043727d4c6ea53e2fae4f4b4eab', 'request_id': 'req-6e6bf9b6-a921-4300-94a1-4fc35eefd344'} {{(pid=82025) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 20:01:05.484098 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.notifications [None req-6e6bf9b6-a921-4300-94a1-4fc35eefd344 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '81998043727d4c6ea53e2fae4f4b4eab', 'request_id': 'req-6e6bf9b6-a921-4300-94a1-4fc35eefd344'} {{(pid=82025) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 20:01:05.544003 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeea2b3e-3345-404c-98b3-b67463b1b30e service neutron] Authenticating user token {{(pid=82026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 20:01:05.545611 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.common.fernet_utils [None req-eeea2b3e-3345-404c-98b3-b67463b1b30e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82026) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 20:01:05.563365 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeea2b3e-3345-404c-98b3-b67463b1b30e service neutron] Validating token access rules against request {{(pid=82026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 20:01:05.563947 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.notifications [None req-6e6bf9b6-a921-4300-94a1-4fc35eefd344 admin admin] The token cache is being invalidate because project 81998043727d4c6ea53e2fae4f4b4eab was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82025) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 13 20:01:05.564195 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.notifications [None req-6e6bf9b6-a921-4300-94a1-4fc35eefd344 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82025) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 20:01:05.565051 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.notifications [None req-6e6bf9b6-a921-4300-94a1-4fc35eefd344 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82025) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 20:01:05.566901 dv-cinder-828806-6-smb devstack@keystone.service[82025]: [pid: 82025|app: 0|req: 954/1882] 10.222.0.33 () {58 vars in 1233 bytes} [Tue Sep 13 20:01:05 2022] DELETE /identity/v3/projects/81998043727d4c6ea53e2fae4f4b4eab => generated 0 bytes in 356 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 20:01:05.571970 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e6bf9b6-a921-4300-94a1-4fc35eefd344 admin admin] Authenticating user token {{(pid=82025) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 20:01:05.573516 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.fernet_utils [None req-6e6bf9b6-a921-4300-94a1-4fc35eefd344 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82025) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 20:01:05.663770 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e6bf9b6-a921-4300-94a1-4fc35eefd344 admin admin] Validating token access rules against request {{(pid=82025) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 20:01:05.664959 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35a78953-eb1d-4342-af1c-0be8a22763d0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57539b6a6f3b4d589f5f5e1d211cd6a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b454f707d20347ada3d82aa85495635e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 20:01:05.665797 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35a78953-eb1d-4342-af1c-0be8a22763d0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:01:05.666091 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35a78953-eb1d-4342-af1c-0be8a22763d0 admin admin] SCRIPT_NAME: `/identity` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:01:05.666376 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35a78953-eb1d-4342-af1c-0be8a22763d0 admin admin] PATH_INFO: `/v3/projects/8361b86ef1d94715bade591e07fba637` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:01:05.667632 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35a78953-eb1d-4342-af1c-0be8a22763d0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=8361b86ef1d94715bade591e07fba637)` {{(pid=82026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 20:01:05.669113 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd6424fe-20bd-490a-b6d4-b86672f087b3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57539b6a6f3b4d589f5f5e1d211cd6a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b454f707d20347ada3d82aa85495635e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82025) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 20:01:05.669683 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35a78953-eb1d-4342-af1c-0be8a22763d0 admin admin] RBAC: Authorization granted {{(pid=82026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 20:01:05.669808 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd6424fe-20bd-490a-b6d4-b86672f087b3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:01:05.670020 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd6424fe-20bd-490a-b6d4-b86672f087b3 admin admin] SCRIPT_NAME: `/identity` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:01:05.670301 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd6424fe-20bd-490a-b6d4-b86672f087b3 admin admin] PATH_INFO: `/v3/users/48b7fb96143a43ec8ff79afd735478dc` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:01:05.671638 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd6424fe-20bd-490a-b6d4-b86672f087b3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=48b7fb96143a43ec8ff79afd735478dc)` {{(pid=82025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 20:01:05.673605 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd6424fe-20bd-490a-b6d4-b86672f087b3 admin admin] RBAC: Authorization granted {{(pid=82025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 20:01:05.899212 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.notifications [None req-35a78953-eb1d-4342-af1c-0be8a22763d0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8361b86ef1d94715bade591e07fba637', 'request_id': 'req-35a78953-eb1d-4342-af1c-0be8a22763d0'} {{(pid=82026) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 20:01:05.901380 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.notifications [None req-dd6424fe-20bd-490a-b6d4-b86672f087b3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '48b7fb96143a43ec8ff79afd735478dc'} {{(pid=82025) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 20:01:06.026946 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.notifications [None req-35a78953-eb1d-4342-af1c-0be8a22763d0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8361b86ef1d94715bade591e07fba637', 'request_id': 'req-35a78953-eb1d-4342-af1c-0be8a22763d0'} {{(pid=82026) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 20:01:06.035075 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.notifications [None req-35a78953-eb1d-4342-af1c-0be8a22763d0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8361b86ef1d94715bade591e07fba637', 'request_id': 'req-35a78953-eb1d-4342-af1c-0be8a22763d0'} {{(pid=82026) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 20:01:06.059485 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.notifications [None req-35a78953-eb1d-4342-af1c-0be8a22763d0 admin admin] The token cache is being invalidate because project 8361b86ef1d94715bade591e07fba637 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82026) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 13 20:01:06.059786 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.notifications [None req-35a78953-eb1d-4342-af1c-0be8a22763d0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82026) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 20:01:06.060454 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.notifications [None req-35a78953-eb1d-4342-af1c-0be8a22763d0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82026) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 20:01:06.062149 dv-cinder-828806-6-smb devstack@keystone.service[82026]: [pid: 82026|app: 0|req: 929/1883] 10.222.0.33 () {58 vars in 1233 bytes} [Tue Sep 13 20:01:05 2022] DELETE /identity/v3/projects/8361b86ef1d94715bade591e07fba637 => generated 0 bytes in 519 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 20:01:06.064245 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35a78953-eb1d-4342-af1c-0be8a22763d0 admin admin] Authenticating user token {{(pid=82026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 20:01:06.068496 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.common.fernet_utils [None req-35a78953-eb1d-4342-af1c-0be8a22763d0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82026) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 20:01:06.102660 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.notifications [None req-dd6424fe-20bd-490a-b6d4-b86672f087b3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '48b7fb96143a43ec8ff79afd735478dc'} {{(pid=82025) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 20:01:06.103513 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.notifications [None req-dd6424fe-20bd-490a-b6d4-b86672f087b3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '48b7fb96143a43ec8ff79afd735478dc'} {{(pid=82025) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 20:01:06.122948 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.notifications [None req-dd6424fe-20bd-490a-b6d4-b86672f087b3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '48b7fb96143a43ec8ff79afd735478dc'} {{(pid=82025) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 20:01:06.132786 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.notifications [None req-dd6424fe-20bd-490a-b6d4-b86672f087b3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '48b7fb96143a43ec8ff79afd735478dc'} {{(pid=82025) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 20:01:06.143413 dv-cinder-828806-6-smb devstack@keystone.service[82025]: [pid: 82025|app: 0|req: 955/1884] 10.222.0.33 () {58 vars in 1224 bytes} [Tue Sep 13 20:01:05 2022] DELETE /identity/v3/users/48b7fb96143a43ec8ff79afd735478dc => generated 0 bytes in 571 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 13 20:01:06.144818 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4315a160-d7a1-471d-ad43-05d232b2b5aa None None] REQUEST_METHOD: `POST` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:01:06.146264 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4315a160-d7a1-471d-ad43-05d232b2b5aa None None] SCRIPT_NAME: `/identity` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:01:06.146564 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4315a160-d7a1-471d-ad43-05d232b2b5aa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:01:06.153672 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35a78953-eb1d-4342-af1c-0be8a22763d0 admin admin] Validating token access rules against request {{(pid=82026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 20:01:06.173864 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.auth.core [None req-4315a160-d7a1-471d-ad43-05d232b2b5aa None None] MFA Rules not processed for user `57539b6a6f3b4d589f5f5e1d211cd6a0`. Rule list: `[]` (Enabled: `True`). {{(pid=82025) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 20:01:06.175984 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.fernet_utils [None req-4315a160-d7a1-471d-ad43-05d232b2b5aa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82025) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 20:01:06.229499 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72ccc309-8956-4751-9c9e-068ca3290e10 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57539b6a6f3b4d589f5f5e1d211cd6a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b454f707d20347ada3d82aa85495635e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 20:01:06.230336 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72ccc309-8956-4751-9c9e-068ca3290e10 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:01:06.231145 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72ccc309-8956-4751-9c9e-068ca3290e10 admin admin] SCRIPT_NAME: `/identity` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:01:06.231732 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72ccc309-8956-4751-9c9e-068ca3290e10 admin admin] PATH_INFO: `/v3/projects/aae31f9807104ab6a83620e8cbe9d33c` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:01:06.233227 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72ccc309-8956-4751-9c9e-068ca3290e10 admin admin] RBAC: Authorizing `identity:delete_project(project_id=aae31f9807104ab6a83620e8cbe9d33c)` {{(pid=82026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 20:01:06.235849 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72ccc309-8956-4751-9c9e-068ca3290e10 admin admin] RBAC: Authorization granted {{(pid=82026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 20:01:06.262915 dv-cinder-828806-6-smb devstack@keystone.service[82025]: [pid: 82025|app: 0|req: 956/1885] 10.222.0.33 () {58 vars in 958 bytes} [Tue Sep 13 20:01:06 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 20:01:06.274777 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20844ebf-2d96-4d26-b547-5ab259c569d6 None None] REQUEST_METHOD: `POST` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:01:06.274777 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20844ebf-2d96-4d26-b547-5ab259c569d6 None None] SCRIPT_NAME: `/identity` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:01:06.274777 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20844ebf-2d96-4d26-b547-5ab259c569d6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:01:06.303450 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.auth.core [None req-20844ebf-2d96-4d26-b547-5ab259c569d6 None None] MFA Rules not processed for user `57539b6a6f3b4d589f5f5e1d211cd6a0`. Rule list: `[]` (Enabled: `True`). {{(pid=82025) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 20:01:06.303450 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.fernet_utils [None req-20844ebf-2d96-4d26-b547-5ab259c569d6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82025) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 20:01:06.311132 dv-cinder-828806-6-smb devstack@keystone.service[82025]: [pid: 82025|app: 0|req: 957/1886] 10.222.0.33 () {58 vars in 958 bytes} [Tue Sep 13 20:01:06 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 13 20:01:06.315427 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20844ebf-2d96-4d26-b547-5ab259c569d6 None None] Authenticating user token {{(pid=82025) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 20:01:06.326183 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20844ebf-2d96-4d26-b547-5ab259c569d6 None None] Validating token access rules against request {{(pid=82025) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 20:01:06.331209 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4ec2f02-af4f-4cf4-93b9-026581e1a834 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57539b6a6f3b4d589f5f5e1d211cd6a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b454f707d20347ada3d82aa85495635e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82025) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 20:01:06.331823 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4ec2f02-af4f-4cf4-93b9-026581e1a834 admin admin] REQUEST_METHOD: `GET` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:01:06.332105 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4ec2f02-af4f-4cf4-93b9-026581e1a834 admin admin] SCRIPT_NAME: `/identity` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:01:06.332377 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4ec2f02-af4f-4cf4-93b9-026581e1a834 admin admin] PATH_INFO: `/v3/domains` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:01:06.333026 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4ec2f02-af4f-4cf4-93b9-026581e1a834 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82025) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 20:01:06.333431 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4ec2f02-af4f-4cf4-93b9-026581e1a834 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 20:01:06.335114 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4ec2f02-af4f-4cf4-93b9-026581e1a834 admin admin] RBAC: Authorization granted {{(pid=82025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 20:01:06.348751 dv-cinder-828806-6-smb devstack@keystone.service[82025]: [pid: 82025|app: 0|req: 958/1887] 10.222.0.33 () {58 vars in 1153 bytes} [Tue Sep 13 20:01:06 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 20:01:06.354157 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4ec2f02-af4f-4cf4-93b9-026581e1a834 admin admin] Authenticating user token {{(pid=82025) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 20:01:06.365542 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4ec2f02-af4f-4cf4-93b9-026581e1a834 admin admin] Validating token access rules against request {{(pid=82025) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 20:01:06.371207 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfebfe76-a3ca-4026-bd52-abc9ff1eba5f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57539b6a6f3b4d589f5f5e1d211cd6a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b454f707d20347ada3d82aa85495635e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82025) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 20:01:06.371554 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfebfe76-a3ca-4026-bd52-abc9ff1eba5f admin admin] REQUEST_METHOD: `POST` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:01:06.372177 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfebfe76-a3ca-4026-bd52-abc9ff1eba5f admin admin] SCRIPT_NAME: `/identity` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:01:06.372454 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfebfe76-a3ca-4026-bd52-abc9ff1eba5f admin admin] PATH_INFO: `/v3/projects` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:01:06.373146 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfebfe76-a3ca-4026-bd52-abc9ff1eba5f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 20:01:06.375251 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfebfe76-a3ca-4026-bd52-abc9ff1eba5f admin admin] RBAC: Authorization granted {{(pid=82025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 20:01:06.389687 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.notifications [None req-72ccc309-8956-4751-9c9e-068ca3290e10 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'aae31f9807104ab6a83620e8cbe9d33c', 'request_id': 'req-72ccc309-8956-4751-9c9e-068ca3290e10'} {{(pid=82026) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 20:01:06.472471 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.notifications [None req-72ccc309-8956-4751-9c9e-068ca3290e10 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'aae31f9807104ab6a83620e8cbe9d33c', 'request_id': 'req-72ccc309-8956-4751-9c9e-068ca3290e10'} {{(pid=82026) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 20:01:06.481090 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.notifications [None req-72ccc309-8956-4751-9c9e-068ca3290e10 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'aae31f9807104ab6a83620e8cbe9d33c', 'request_id': 'req-72ccc309-8956-4751-9c9e-068ca3290e10'} {{(pid=82026) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 20:01:06.491462 dv-cinder-828806-6-smb devstack@keystone.service[82025]: [pid: 82025|app: 0|req: 959/1888] 10.222.0.33 () {60 vars in 1153 bytes} [Tue Sep 13 20:01:06 2022] POST /identity/v3/projects => generated 383 bytes in 138 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 13 20:01:06.492370 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfebfe76-a3ca-4026-bd52-abc9ff1eba5f admin admin] Authenticating user token {{(pid=82025) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 20:01:06.500876 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.notifications [None req-72ccc309-8956-4751-9c9e-068ca3290e10 admin admin] The token cache is being invalidate because project aae31f9807104ab6a83620e8cbe9d33c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82026) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 13 20:01:06.506987 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.notifications [None req-72ccc309-8956-4751-9c9e-068ca3290e10 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82026) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 20:01:06.506987 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.notifications [None req-72ccc309-8956-4751-9c9e-068ca3290e10 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82026) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 20:01:06.506987 dv-cinder-828806-6-smb devstack@keystone.service[82026]: [pid: 82026|app: 0|req: 930/1889] 10.222.0.33 () {58 vars in 1233 bytes} [Tue Sep 13 20:01:06 2022] DELETE /identity/v3/projects/aae31f9807104ab6a83620e8cbe9d33c => generated 0 bytes in 442 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 20:01:06.510602 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72ccc309-8956-4751-9c9e-068ca3290e10 admin admin] Authenticating user token {{(pid=82026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 20:01:06.512229 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.common.fernet_utils [None req-72ccc309-8956-4751-9c9e-068ca3290e10 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82026) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 20:01:06.620242 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72ccc309-8956-4751-9c9e-068ca3290e10 admin admin] Validating token access rules against request {{(pid=82026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 20:01:06.624776 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfebfe76-a3ca-4026-bd52-abc9ff1eba5f admin admin] Validating token access rules against request {{(pid=82025) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 20:01:06.629161 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79e9f104-10dc-4537-8f6e-ce4e6c6dbddf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57539b6a6f3b4d589f5f5e1d211cd6a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b454f707d20347ada3d82aa85495635e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 20:01:06.634994 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79e9f104-10dc-4537-8f6e-ce4e6c6dbddf admin admin] REQUEST_METHOD: `DELETE` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:01:06.634994 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79e9f104-10dc-4537-8f6e-ce4e6c6dbddf admin admin] SCRIPT_NAME: `/identity` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:01:06.635221 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6c59bd2-6be2-48e1-ab49-07b3252e8255 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57539b6a6f3b4d589f5f5e1d211cd6a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b454f707d20347ada3d82aa85495635e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82025) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 20:01:06.635320 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79e9f104-10dc-4537-8f6e-ce4e6c6dbddf admin admin] PATH_INFO: `/v3/users/5de95bc3368549db985c90d6c7dd6f91` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:01:06.635400 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6c59bd2-6be2-48e1-ab49-07b3252e8255 admin admin] REQUEST_METHOD: `POST` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:01:06.635400 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6c59bd2-6be2-48e1-ab49-07b3252e8255 admin admin] SCRIPT_NAME: `/identity` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:01:06.635400 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6c59bd2-6be2-48e1-ab49-07b3252e8255 admin admin] PATH_INFO: `/v3/users` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:01:06.635627 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79e9f104-10dc-4537-8f6e-ce4e6c6dbddf admin admin] RBAC: Authorizing `identity:delete_user(user_id=5de95bc3368549db985c90d6c7dd6f91)` {{(pid=82026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 20:01:06.635721 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6c59bd2-6be2-48e1-ab49-07b3252e8255 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 20:01:06.635801 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79e9f104-10dc-4537-8f6e-ce4e6c6dbddf admin admin] RBAC: Authorization granted {{(pid=82026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 20:01:06.635876 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6c59bd2-6be2-48e1-ab49-07b3252e8255 admin admin] RBAC: Authorization granted {{(pid=82025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 20:01:06.719926 dv-cinder-828806-6-smb devstack@keystone.service[82025]: [pid: 82025|app: 0|req: 960/1890] 10.222.0.33 () {60 vars in 1144 bytes} [Tue Sep 13 20:01:06 2022] POST /identity/v3/users => generated 292 bytes in 228 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 13 20:01:06.723775 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6c59bd2-6be2-48e1-ab49-07b3252e8255 admin admin] Authenticating user token {{(pid=82025) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 20:01:06.725793 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.fernet_utils [None req-d6c59bd2-6be2-48e1-ab49-07b3252e8255 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82025) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 20:01:06.738977 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6c59bd2-6be2-48e1-ab49-07b3252e8255 admin admin] Validating token access rules against request {{(pid=82025) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 20:01:06.760466 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG dbcounter [-] [82025] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82025) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 20:01:06.771970 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1ee9e50-66e5-4f86-8dde-9f7f775c154e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57539b6a6f3b4d589f5f5e1d211cd6a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b454f707d20347ada3d82aa85495635e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82025) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 20:01:06.772873 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1ee9e50-66e5-4f86-8dde-9f7f775c154e admin admin] REQUEST_METHOD: `GET` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:01:06.773315 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1ee9e50-66e5-4f86-8dde-9f7f775c154e admin admin] SCRIPT_NAME: `/identity` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:01:06.775113 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1ee9e50-66e5-4f86-8dde-9f7f775c154e admin admin] PATH_INFO: `/v3/roles` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:01:06.775980 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1ee9e50-66e5-4f86-8dde-9f7f775c154e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 20:01:06.778241 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1ee9e50-66e5-4f86-8dde-9f7f775c154e admin admin] RBAC: Authorization granted {{(pid=82025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 20:01:06.791275 dv-cinder-828806-6-smb devstack@keystone.service[82025]: [pid: 82025|app: 0|req: 961/1891] 10.222.0.33 () {58 vars in 1122 bytes} [Tue Sep 13 20:01:06 2022] GET /identity/v3/roles => generated 1420 bytes in 68 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 13 20:01:06.795976 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1ee9e50-66e5-4f86-8dde-9f7f775c154e admin admin] Authenticating user token {{(pid=82025) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 20:01:06.809189 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1ee9e50-66e5-4f86-8dde-9f7f775c154e admin admin] Validating token access rules against request {{(pid=82025) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 20:01:06.814761 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2be02f2-e42a-4bed-aa5c-66b48096fab3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57539b6a6f3b4d589f5f5e1d211cd6a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b454f707d20347ada3d82aa85495635e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82025) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 20:01:06.815880 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2be02f2-e42a-4bed-aa5c-66b48096fab3 admin admin] REQUEST_METHOD: `GET` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:01:06.822825 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2be02f2-e42a-4bed-aa5c-66b48096fab3 admin admin] SCRIPT_NAME: `/identity` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:01:06.822825 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2be02f2-e42a-4bed-aa5c-66b48096fab3 admin admin] PATH_INFO: `/v3/roles` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:01:06.822825 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2be02f2-e42a-4bed-aa5c-66b48096fab3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 20:01:06.822825 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2be02f2-e42a-4bed-aa5c-66b48096fab3 admin admin] RBAC: Authorization granted {{(pid=82025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 20:01:06.835737 dv-cinder-828806-6-smb devstack@keystone.service[82025]: [pid: 82025|app: 0|req: 962/1892] 10.222.0.33 () {58 vars in 1122 bytes} [Tue Sep 13 20:01:06 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 13 20:01:06.839175 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2be02f2-e42a-4bed-aa5c-66b48096fab3 admin admin] Authenticating user token {{(pid=82025) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 20:01:06.851239 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2be02f2-e42a-4bed-aa5c-66b48096fab3 admin admin] Validating token access rules against request {{(pid=82025) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 20:01:06.856087 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08bbe6ad-c947-4b58-8d6a-7b9fd3a343cf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57539b6a6f3b4d589f5f5e1d211cd6a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b454f707d20347ada3d82aa85495635e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82025) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 20:01:06.856745 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08bbe6ad-c947-4b58-8d6a-7b9fd3a343cf admin admin] REQUEST_METHOD: `PUT` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:01:06.857027 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08bbe6ad-c947-4b58-8d6a-7b9fd3a343cf admin admin] SCRIPT_NAME: `/identity` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:01:06.857304 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08bbe6ad-c947-4b58-8d6a-7b9fd3a343cf admin admin] PATH_INFO: `/v3/projects/d0b94037a611492f9daa0c5414ad25ca/users/cb6ebb07a6e14b51bfe4a6d335cc67e8/roles/3618ab638a65401f82333da7596d1daf` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:01:06.874349 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08bbe6ad-c947-4b58-8d6a-7b9fd3a343cf admin admin] RBAC: Authorizing `identity:create_grant(project_id=d0b94037a611492f9daa0c5414ad25ca, user_id=cb6ebb07a6e14b51bfe4a6d335cc67e8, role_id=3618ab638a65401f82333da7596d1daf)` {{(pid=82025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 20:01:06.878265 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08bbe6ad-c947-4b58-8d6a-7b9fd3a343cf admin admin] RBAC: Authorization granted {{(pid=82025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 20:01:06.897305 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.notifications [None req-79e9f104-10dc-4537-8f6e-ce4e6c6dbddf admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5de95bc3368549db985c90d6c7dd6f91'} {{(pid=82026) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 20:01:06.981603 dv-cinder-828806-6-smb devstack@keystone.service[82025]: [pid: 82025|app: 0|req: 963/1893] 10.222.0.33 () {60 vars in 1483 bytes} [Tue Sep 13 20:01:06 2022] PUT /identity/v3/projects/d0b94037a611492f9daa0c5414ad25ca/users/cb6ebb07a6e14b51bfe4a6d335cc67e8/roles/3618ab638a65401f82333da7596d1daf => generated 0 bytes in 143 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 13 20:01:06.994244 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86e8bd24-64b8-4d22-aa32-fe2423f740c5 None None] REQUEST_METHOD: `POST` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:01:06.994627 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86e8bd24-64b8-4d22-aa32-fe2423f740c5 None None] SCRIPT_NAME: `/identity` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:01:06.994875 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86e8bd24-64b8-4d22-aa32-fe2423f740c5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:01:07.010459 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.notifications [None req-79e9f104-10dc-4537-8f6e-ce4e6c6dbddf admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5de95bc3368549db985c90d6c7dd6f91'} {{(pid=82026) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 20:01:07.037506 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.auth.core [None req-86e8bd24-64b8-4d22-aa32-fe2423f740c5 None None] MFA Rules not processed for user `cb6ebb07a6e14b51bfe4a6d335cc67e8`. Rule list: `[]` (Enabled: `True`). {{(pid=82025) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 20:01:07.037991 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.notifications [None req-79e9f104-10dc-4537-8f6e-ce4e6c6dbddf admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5de95bc3368549db985c90d6c7dd6f91'} {{(pid=82026) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 20:01:07.038832 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.fernet_utils [None req-86e8bd24-64b8-4d22-aa32-fe2423f740c5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82025) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 20:01:07.039404 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.notifications [None req-79e9f104-10dc-4537-8f6e-ce4e6c6dbddf admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5de95bc3368549db985c90d6c7dd6f91'} {{(pid=82026) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 20:01:07.049144 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.notifications [None req-79e9f104-10dc-4537-8f6e-ce4e6c6dbddf admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5de95bc3368549db985c90d6c7dd6f91'} {{(pid=82026) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 20:01:07.057703 dv-cinder-828806-6-smb devstack@keystone.service[82026]: [pid: 82026|app: 0|req: 931/1894] 10.222.0.33 () {58 vars in 1224 bytes} [Tue Sep 13 20:01:06 2022] DELETE /identity/v3/users/5de95bc3368549db985c90d6c7dd6f91 => generated 0 bytes in 548 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 20:01:07.058803 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79e9f104-10dc-4537-8f6e-ce4e6c6dbddf admin admin] Authenticating user token {{(pid=82026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 20:01:07.060553 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.common.fernet_utils [None req-79e9f104-10dc-4537-8f6e-ce4e6c6dbddf admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82026) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 20:01:07.102420 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG dbcounter [-] [82026] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=82026) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 20:01:07.191770 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79e9f104-10dc-4537-8f6e-ce4e6c6dbddf admin admin] Validating token access rules against request {{(pid=82026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 20:01:07.195182 dv-cinder-828806-6-smb devstack@keystone.service[82025]: [pid: 82025|app: 0|req: 964/1895] 10.222.0.33 () {58 vars in 958 bytes} [Tue Sep 13 20:01:06 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 202 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 13 20:01:07.197552 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86e8bd24-64b8-4d22-aa32-fe2423f740c5 None None] Authenticating user token {{(pid=82025) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 20:01:07.199458 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9915b385-81fd-41e1-9019-b5bd12c9f003 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57539b6a6f3b4d589f5f5e1d211cd6a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b454f707d20347ada3d82aa85495635e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 20:01:07.200437 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9915b385-81fd-41e1-9019-b5bd12c9f003 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:01:07.201029 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.fernet_utils [None req-86e8bd24-64b8-4d22-aa32-fe2423f740c5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82025) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 20:01:07.201152 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9915b385-81fd-41e1-9019-b5bd12c9f003 admin admin] SCRIPT_NAME: `/identity` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:01:07.201487 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9915b385-81fd-41e1-9019-b5bd12c9f003 admin admin] PATH_INFO: `/v3/projects/db242f15a8634109a509ccb3083e7444` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:01:07.203241 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9915b385-81fd-41e1-9019-b5bd12c9f003 admin admin] RBAC: Authorizing `identity:delete_project(project_id=db242f15a8634109a509ccb3083e7444)` {{(pid=82026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 20:01:07.205233 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9915b385-81fd-41e1-9019-b5bd12c9f003 admin admin] RBAC: Authorization granted {{(pid=82026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 20:01:07.273495 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86e8bd24-64b8-4d22-aa32-fe2423f740c5 None None] Validating token access rules against request {{(pid=82025) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 20:01:07.280698 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7944ae06-25ef-4fce-b3ea-6f99a13e0081 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57539b6a6f3b4d589f5f5e1d211cd6a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b454f707d20347ada3d82aa85495635e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82025) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 20:01:07.281431 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7944ae06-25ef-4fce-b3ea-6f99a13e0081 admin admin] REQUEST_METHOD: `POST` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:01:07.282443 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7944ae06-25ef-4fce-b3ea-6f99a13e0081 admin admin] SCRIPT_NAME: `/identity` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:01:07.282799 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7944ae06-25ef-4fce-b3ea-6f99a13e0081 admin admin] PATH_INFO: `/v3/projects` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:01:07.283578 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7944ae06-25ef-4fce-b3ea-6f99a13e0081 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 20:01:07.285648 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7944ae06-25ef-4fce-b3ea-6f99a13e0081 admin admin] RBAC: Authorization granted {{(pid=82025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 20:01:07.355574 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.notifications [None req-9915b385-81fd-41e1-9019-b5bd12c9f003 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'db242f15a8634109a509ccb3083e7444', 'request_id': 'req-9915b385-81fd-41e1-9019-b5bd12c9f003'} {{(pid=82026) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 20:01:07.433299 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.notifications [None req-9915b385-81fd-41e1-9019-b5bd12c9f003 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'db242f15a8634109a509ccb3083e7444', 'request_id': 'req-9915b385-81fd-41e1-9019-b5bd12c9f003'} {{(pid=82026) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 20:01:07.445843 dv-cinder-828806-6-smb devstack@keystone.service[82025]: [pid: 82025|app: 0|req: 965/1896] 10.222.0.33 () {60 vars in 1153 bytes} [Tue Sep 13 20:01:07 2022] POST /identity/v3/projects => generated 385 bytes in 249 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 13 20:01:07.446831 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.notifications [None req-9915b385-81fd-41e1-9019-b5bd12c9f003 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'db242f15a8634109a509ccb3083e7444', 'request_id': 'req-9915b385-81fd-41e1-9019-b5bd12c9f003'} {{(pid=82026) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 20:01:07.447340 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7944ae06-25ef-4fce-b3ea-6f99a13e0081 admin admin] Authenticating user token {{(pid=82025) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 20:01:07.464509 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.notifications [None req-9915b385-81fd-41e1-9019-b5bd12c9f003 admin admin] The token cache is being invalidate because project db242f15a8634109a509ccb3083e7444 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82026) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 13 20:01:07.465066 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.notifications [None req-9915b385-81fd-41e1-9019-b5bd12c9f003 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82026) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 20:01:07.473694 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.notifications [None req-9915b385-81fd-41e1-9019-b5bd12c9f003 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82026) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 20:01:07.473694 dv-cinder-828806-6-smb devstack@keystone.service[82026]: [pid: 82026|app: 0|req: 932/1897] 10.222.0.33 () {58 vars in 1233 bytes} [Tue Sep 13 20:01:07 2022] DELETE /identity/v3/projects/db242f15a8634109a509ccb3083e7444 => generated 0 bytes in 410 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 20:01:07.479639 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62f878a3-23e0-4a81-b63f-f9c2d5f3837e None None] REQUEST_METHOD: `POST` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:01:07.480187 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62f878a3-23e0-4a81-b63f-f9c2d5f3837e None None] SCRIPT_NAME: `/identity` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:01:07.480715 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62f878a3-23e0-4a81-b63f-f9c2d5f3837e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:01:07.513719 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.auth.core [None req-62f878a3-23e0-4a81-b63f-f9c2d5f3837e None None] MFA Rules not processed for user `57539b6a6f3b4d589f5f5e1d211cd6a0`. Rule list: `[]` (Enabled: `True`). {{(pid=82026) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 20:01:07.515025 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.common.fernet_utils [None req-62f878a3-23e0-4a81-b63f-f9c2d5f3837e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82026) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 20:01:07.533299 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7944ae06-25ef-4fce-b3ea-6f99a13e0081 admin admin] Validating token access rules against request {{(pid=82025) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 20:01:07.538621 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb515224-a72a-41a5-a119-d4aaf35476fd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57539b6a6f3b4d589f5f5e1d211cd6a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b454f707d20347ada3d82aa85495635e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82025) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 20:01:07.539962 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb515224-a72a-41a5-a119-d4aaf35476fd admin admin] REQUEST_METHOD: `POST` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:01:07.541564 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb515224-a72a-41a5-a119-d4aaf35476fd admin admin] SCRIPT_NAME: `/identity` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:01:07.542022 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb515224-a72a-41a5-a119-d4aaf35476fd admin admin] PATH_INFO: `/v3/users` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:01:07.542955 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb515224-a72a-41a5-a119-d4aaf35476fd admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 20:01:07.545009 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb515224-a72a-41a5-a119-d4aaf35476fd admin admin] RBAC: Authorization granted {{(pid=82025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 20:01:07.613104 dv-cinder-828806-6-smb devstack@keystone.service[82026]: [pid: 82026|app: 0|req: 933/1898] 10.222.0.33 () {58 vars in 958 bytes} [Tue Sep 13 20:01:07 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 135 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 20:01:07.621237 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16c28f7a-9503-4acc-b1d3-68cf8e6e6c05 None None] REQUEST_METHOD: `POST` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:01:07.621945 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16c28f7a-9503-4acc-b1d3-68cf8e6e6c05 None None] SCRIPT_NAME: `/identity` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:01:07.621945 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16c28f7a-9503-4acc-b1d3-68cf8e6e6c05 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:01:07.644445 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.auth.core [None req-16c28f7a-9503-4acc-b1d3-68cf8e6e6c05 None None] MFA Rules not processed for user `57539b6a6f3b4d589f5f5e1d211cd6a0`. Rule list: `[]` (Enabled: `True`). {{(pid=82026) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 20:01:07.646291 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.common.fernet_utils [None req-16c28f7a-9503-4acc-b1d3-68cf8e6e6c05 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82026) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 20:01:07.652374 dv-cinder-828806-6-smb devstack@keystone.service[82025]: [pid: 82025|app: 0|req: 966/1899] 10.222.0.33 () {60 vars in 1144 bytes} [Tue Sep 13 20:01:07 2022] POST /identity/v3/users => generated 299 bytes in 206 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 13 20:01:07.656588 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb515224-a72a-41a5-a119-d4aaf35476fd admin admin] Authenticating user token {{(pid=82025) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 20:01:07.659312 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.fernet_utils [None req-fb515224-a72a-41a5-a119-d4aaf35476fd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82025) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 20:01:07.665157 dv-cinder-828806-6-smb devstack@keystone.service[82026]: [pid: 82026|app: 0|req: 934/1900] 10.222.0.33 () {58 vars in 958 bytes} [Tue Sep 13 20:01:07 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 13 20:01:07.674197 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16c28f7a-9503-4acc-b1d3-68cf8e6e6c05 None None] Authenticating user token {{(pid=82026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 20:01:07.676733 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb515224-a72a-41a5-a119-d4aaf35476fd admin admin] Validating token access rules against request {{(pid=82025) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 20:01:07.701776 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a63ec63e-bb88-4c95-88c0-b7102b0b1a6f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57539b6a6f3b4d589f5f5e1d211cd6a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b454f707d20347ada3d82aa85495635e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82025) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 20:01:07.702616 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a63ec63e-bb88-4c95-88c0-b7102b0b1a6f admin admin] REQUEST_METHOD: `GET` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:01:07.703724 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a63ec63e-bb88-4c95-88c0-b7102b0b1a6f admin admin] SCRIPT_NAME: `/identity` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:01:07.705765 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a63ec63e-bb88-4c95-88c0-b7102b0b1a6f admin admin] PATH_INFO: `/v3/roles` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:01:07.706620 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a63ec63e-bb88-4c95-88c0-b7102b0b1a6f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 20:01:07.709179 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a63ec63e-bb88-4c95-88c0-b7102b0b1a6f admin admin] RBAC: Authorization granted {{(pid=82025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 20:01:07.715168 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16c28f7a-9503-4acc-b1d3-68cf8e6e6c05 None None] Validating token access rules against request {{(pid=82026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 20:01:07.730012 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16b9820f-241a-4ed5-b856-0642eaf8c49f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57539b6a6f3b4d589f5f5e1d211cd6a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b454f707d20347ada3d82aa85495635e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 20:01:07.730653 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16b9820f-241a-4ed5-b856-0642eaf8c49f admin admin] REQUEST_METHOD: `GET` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:01:07.730944 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16b9820f-241a-4ed5-b856-0642eaf8c49f admin admin] SCRIPT_NAME: `/identity` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:01:07.732753 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16b9820f-241a-4ed5-b856-0642eaf8c49f admin admin] PATH_INFO: `/v3/domains` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:01:07.733471 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16b9820f-241a-4ed5-b856-0642eaf8c49f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82026) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 20:01:07.734986 dv-cinder-828806-6-smb devstack@keystone.service[82025]: [pid: 82025|app: 0|req: 967/1901] 10.222.0.33 () {58 vars in 1122 bytes} [Tue Sep 13 20:01:07 2022] GET /identity/v3/roles => generated 1420 bytes in 79 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 13 20:01:07.738631 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16b9820f-241a-4ed5-b856-0642eaf8c49f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 20:01:07.741007 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a63ec63e-bb88-4c95-88c0-b7102b0b1a6f admin admin] Authenticating user token {{(pid=82025) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 20:01:07.741588 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16b9820f-241a-4ed5-b856-0642eaf8c49f admin admin] RBAC: Authorization granted {{(pid=82026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 20:01:07.754089 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a63ec63e-bb88-4c95-88c0-b7102b0b1a6f admin admin] Validating token access rules against request {{(pid=82025) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 20:01:07.760090 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9d623a3-05f0-473c-980e-bcd25853adbf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57539b6a6f3b4d589f5f5e1d211cd6a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b454f707d20347ada3d82aa85495635e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82025) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 20:01:07.760986 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9d623a3-05f0-473c-980e-bcd25853adbf admin admin] REQUEST_METHOD: `PUT` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:01:07.761439 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9d623a3-05f0-473c-980e-bcd25853adbf admin admin] SCRIPT_NAME: `/identity` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:01:07.762037 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9d623a3-05f0-473c-980e-bcd25853adbf admin admin] PATH_INFO: `/v3/projects/6bc8066a789345b39e4d63a6aed3ea91/users/fabb22bba75a4f60bf5d3f6b0462b2d7/roles/e5af7d5baa93469e9e486ef21c85474e` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:01:07.763297 dv-cinder-828806-6-smb devstack@keystone.service[82026]: [pid: 82026|app: 0|req: 935/1902] 10.222.0.33 () {58 vars in 1153 bytes} [Tue Sep 13 20:01:07 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 89 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 20:01:07.764280 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16b9820f-241a-4ed5-b856-0642eaf8c49f admin admin] Authenticating user token {{(pid=82026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 20:01:07.777364 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16b9820f-241a-4ed5-b856-0642eaf8c49f admin admin] Validating token access rules against request {{(pid=82026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 20:01:07.782514 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-453ec00f-3e32-455d-b5c3-09fe9a0a3f74 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57539b6a6f3b4d589f5f5e1d211cd6a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b454f707d20347ada3d82aa85495635e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 20:01:07.783189 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9d623a3-05f0-473c-980e-bcd25853adbf admin admin] RBAC: Authorizing `identity:create_grant(project_id=6bc8066a789345b39e4d63a6aed3ea91, user_id=fabb22bba75a4f60bf5d3f6b0462b2d7, role_id=e5af7d5baa93469e9e486ef21c85474e)` {{(pid=82025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 20:01:07.783371 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-453ec00f-3e32-455d-b5c3-09fe9a0a3f74 admin admin] REQUEST_METHOD: `POST` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:01:07.783758 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-453ec00f-3e32-455d-b5c3-09fe9a0a3f74 admin admin] SCRIPT_NAME: `/identity` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:01:07.784132 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-453ec00f-3e32-455d-b5c3-09fe9a0a3f74 admin admin] PATH_INFO: `/v3/projects` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:01:07.784930 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-453ec00f-3e32-455d-b5c3-09fe9a0a3f74 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 20:01:07.786756 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9d623a3-05f0-473c-980e-bcd25853adbf admin admin] RBAC: Authorization granted {{(pid=82025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 20:01:07.787143 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-453ec00f-3e32-455d-b5c3-09fe9a0a3f74 admin admin] RBAC: Authorization granted {{(pid=82026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 20:01:07.880794 dv-cinder-828806-6-smb devstack@keystone.service[82025]: [pid: 82025|app: 0|req: 968/1903] 10.222.0.33 () {60 vars in 1483 bytes} [Tue Sep 13 20:01:07 2022] PUT /identity/v3/projects/6bc8066a789345b39e4d63a6aed3ea91/users/fabb22bba75a4f60bf5d3f6b0462b2d7/roles/e5af7d5baa93469e9e486ef21c85474e => generated 0 bytes in 142 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 20:01:07.886607 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9d623a3-05f0-473c-980e-bcd25853adbf admin admin] Authenticating user token {{(pid=82025) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 20:01:07.911975 dv-cinder-828806-6-smb devstack@keystone.service[82026]: [pid: 82026|app: 0|req: 936/1904] 10.222.0.33 () {60 vars in 1153 bytes} [Tue Sep 13 20:01:07 2022] POST /identity/v3/projects => generated 367 bytes in 148 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 13 20:01:07.912879 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-453ec00f-3e32-455d-b5c3-09fe9a0a3f74 admin admin] Authenticating user token {{(pid=82026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 20:01:07.918450 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.common.fernet_utils [None req-453ec00f-3e32-455d-b5c3-09fe9a0a3f74 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82026) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 20:01:07.989137 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9d623a3-05f0-473c-980e-bcd25853adbf admin admin] Validating token access rules against request {{(pid=82025) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 20:01:08.025572 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-453ec00f-3e32-455d-b5c3-09fe9a0a3f74 admin admin] Validating token access rules against request {{(pid=82026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 20:01:08.035989 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46b1d888-2b59-47c5-a800-d395d03efae1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57539b6a6f3b4d589f5f5e1d211cd6a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b454f707d20347ada3d82aa85495635e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 20:01:08.036651 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46b1d888-2b59-47c5-a800-d395d03efae1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:01:08.036938 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46b1d888-2b59-47c5-a800-d395d03efae1 admin admin] SCRIPT_NAME: `/identity` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:01:08.037216 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46b1d888-2b59-47c5-a800-d395d03efae1 admin admin] PATH_INFO: `/v3/projects/77ca9d83f6a740cfb0e2d847afb6ab55` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:01:08.038523 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46b1d888-2b59-47c5-a800-d395d03efae1 admin admin] RBAC: Authorizing `identity:delete_project(project_id=77ca9d83f6a740cfb0e2d847afb6ab55)` {{(pid=82026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 20:01:08.043674 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46b1d888-2b59-47c5-a800-d395d03efae1 admin admin] RBAC: Authorization granted {{(pid=82026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 20:01:08.065014 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-610747a3-6d5d-436d-9779-4e1ebc134170 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57539b6a6f3b4d589f5f5e1d211cd6a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b454f707d20347ada3d82aa85495635e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82025) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 20:01:08.065641 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-610747a3-6d5d-436d-9779-4e1ebc134170 admin admin] REQUEST_METHOD: `GET` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:01:08.065932 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-610747a3-6d5d-436d-9779-4e1ebc134170 admin admin] SCRIPT_NAME: `/identity` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:01:08.066215 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-610747a3-6d5d-436d-9779-4e1ebc134170 admin admin] PATH_INFO: `/v3/roles` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:01:08.066943 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-610747a3-6d5d-436d-9779-4e1ebc134170 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 20:01:08.068562 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-610747a3-6d5d-436d-9779-4e1ebc134170 admin admin] RBAC: Authorization granted {{(pid=82025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 20:01:08.080077 dv-cinder-828806-6-smb devstack@keystone.service[82025]: [pid: 82025|app: 0|req: 969/1905] 10.222.0.33 () {58 vars in 1122 bytes} [Tue Sep 13 20:01:07 2022] GET /identity/v3/roles => generated 1420 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 13 20:01:08.080779 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-610747a3-6d5d-436d-9779-4e1ebc134170 admin admin] Authenticating user token {{(pid=82025) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 20:01:08.093560 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-610747a3-6d5d-436d-9779-4e1ebc134170 admin admin] Validating token access rules against request {{(pid=82025) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 20:01:08.098416 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dc7c615-dc60-4173-afee-f4b966288e4d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57539b6a6f3b4d589f5f5e1d211cd6a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b454f707d20347ada3d82aa85495635e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82025) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 20:01:08.099180 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dc7c615-dc60-4173-afee-f4b966288e4d admin admin] REQUEST_METHOD: `POST` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:01:08.104048 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dc7c615-dc60-4173-afee-f4b966288e4d admin admin] SCRIPT_NAME: `/identity` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:01:08.104048 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dc7c615-dc60-4173-afee-f4b966288e4d admin admin] PATH_INFO: `/v3/users` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:01:08.104048 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dc7c615-dc60-4173-afee-f4b966288e4d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 20:01:08.104048 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dc7c615-dc60-4173-afee-f4b966288e4d admin admin] RBAC: Authorization granted {{(pid=82025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 20:01:08.184948 dv-cinder-828806-6-smb devstack@keystone.service[82025]: [pid: 82025|app: 0|req: 970/1906] 10.222.0.33 () {60 vars in 1144 bytes} [Tue Sep 13 20:01:08 2022] POST /identity/v3/users => generated 284 bytes in 101 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 13 20:01:08.184948 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dc7c615-dc60-4173-afee-f4b966288e4d admin admin] Authenticating user token {{(pid=82025) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 20:01:08.194175 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dc7c615-dc60-4173-afee-f4b966288e4d admin admin] Validating token access rules against request {{(pid=82025) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 20:01:08.206560 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.notifications [None req-46b1d888-2b59-47c5-a800-d395d03efae1 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '77ca9d83f6a740cfb0e2d847afb6ab55', 'request_id': 'req-46b1d888-2b59-47c5-a800-d395d03efae1'} {{(pid=82026) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 20:01:08.289858 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.notifications [None req-46b1d888-2b59-47c5-a800-d395d03efae1 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '77ca9d83f6a740cfb0e2d847afb6ab55', 'request_id': 'req-46b1d888-2b59-47c5-a800-d395d03efae1'} {{(pid=82026) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 20:01:08.299263 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.notifications [None req-46b1d888-2b59-47c5-a800-d395d03efae1 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '77ca9d83f6a740cfb0e2d847afb6ab55', 'request_id': 'req-46b1d888-2b59-47c5-a800-d395d03efae1'} {{(pid=82026) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 20:01:08.301095 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-550f727a-6ba1-46c9-8ffe-8f9bbfe7a358 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57539b6a6f3b4d589f5f5e1d211cd6a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b454f707d20347ada3d82aa85495635e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82025) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 20:01:08.301893 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-550f727a-6ba1-46c9-8ffe-8f9bbfe7a358 admin admin] REQUEST_METHOD: `PUT` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:01:08.302290 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-550f727a-6ba1-46c9-8ffe-8f9bbfe7a358 admin admin] SCRIPT_NAME: `/identity` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:01:08.303293 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-550f727a-6ba1-46c9-8ffe-8f9bbfe7a358 admin admin] PATH_INFO: `/v3/projects/6bc8066a789345b39e4d63a6aed3ea91/users/fabb22bba75a4f60bf5d3f6b0462b2d7/roles/e5af7d5baa93469e9e486ef21c85474e` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:01:08.308652 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-550f727a-6ba1-46c9-8ffe-8f9bbfe7a358 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6bc8066a789345b39e4d63a6aed3ea91, user_id=fabb22bba75a4f60bf5d3f6b0462b2d7, role_id=e5af7d5baa93469e9e486ef21c85474e)` {{(pid=82025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 20:01:08.313044 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-550f727a-6ba1-46c9-8ffe-8f9bbfe7a358 admin admin] RBAC: Authorization granted {{(pid=82025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 20:01:08.315737 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.notifications [None req-46b1d888-2b59-47c5-a800-d395d03efae1 admin admin] The token cache is being invalidate because project 77ca9d83f6a740cfb0e2d847afb6ab55 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82026) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 13 20:01:08.316042 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.notifications [None req-46b1d888-2b59-47c5-a800-d395d03efae1 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82026) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 20:01:08.316727 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.notifications [None req-46b1d888-2b59-47c5-a800-d395d03efae1 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82026) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 20:01:08.322554 dv-cinder-828806-6-smb devstack@keystone.service[82026]: [pid: 82026|app: 0|req: 937/1907] 10.222.0.33 () {58 vars in 1233 bytes} [Tue Sep 13 20:01:07 2022] DELETE /identity/v3/projects/77ca9d83f6a740cfb0e2d847afb6ab55 => generated 0 bytes in 406 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 20:01:08.322554 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46b1d888-2b59-47c5-a800-d395d03efae1 admin admin] Authenticating user token {{(pid=82026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 20:01:08.322554 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.common.fernet_utils [None req-46b1d888-2b59-47c5-a800-d395d03efae1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82026) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 20:01:08.332107 dv-cinder-828806-6-smb devstack@keystone.service[82025]: [pid: 82025|app: 0|req: 971/1908] 10.222.0.33 () {60 vars in 1483 bytes} [Tue Sep 13 20:01:08 2022] PUT /identity/v3/projects/6bc8066a789345b39e4d63a6aed3ea91/users/fabb22bba75a4f60bf5d3f6b0462b2d7/roles/e5af7d5baa93469e9e486ef21c85474e => generated 0 bytes in 149 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 20:01:08.335405 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e0a8431-b340-4f7c-b080-6d7be16cbab8 None None] REQUEST_METHOD: `POST` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:01:08.335707 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e0a8431-b340-4f7c-b080-6d7be16cbab8 None None] SCRIPT_NAME: `/identity` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:01:08.335985 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e0a8431-b340-4f7c-b080-6d7be16cbab8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:01:08.336915 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG dbcounter [-] [82026] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82026) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 20:01:08.349667 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46b1d888-2b59-47c5-a800-d395d03efae1 admin admin] Validating token access rules against request {{(pid=82026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 20:01:08.360208 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.auth.core [None req-5e0a8431-b340-4f7c-b080-6d7be16cbab8 None None] MFA Rules not processed for user `57539b6a6f3b4d589f5f5e1d211cd6a0`. Rule list: `[]` (Enabled: `True`). {{(pid=82025) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 20:01:08.361441 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.fernet_utils [None req-5e0a8431-b340-4f7c-b080-6d7be16cbab8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82025) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 20:01:08.455248 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cd41f87-a839-4a59-961b-b081c16acb13 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57539b6a6f3b4d589f5f5e1d211cd6a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b454f707d20347ada3d82aa85495635e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 20:01:08.455248 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cd41f87-a839-4a59-961b-b081c16acb13 admin admin] REQUEST_METHOD: `GET` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:01:08.455248 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cd41f87-a839-4a59-961b-b081c16acb13 admin admin] SCRIPT_NAME: `/identity` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:01:08.455248 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cd41f87-a839-4a59-961b-b081c16acb13 admin admin] PATH_INFO: `/v3/roles` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:01:08.455773 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cd41f87-a839-4a59-961b-b081c16acb13 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 20:01:08.455773 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cd41f87-a839-4a59-961b-b081c16acb13 admin admin] RBAC: Authorization granted {{(pid=82026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 20:01:08.469049 dv-cinder-828806-6-smb devstack@keystone.service[82026]: [pid: 82026|app: 0|req: 938/1909] 10.222.0.33 () {58 vars in 1122 bytes} [Tue Sep 13 20:01:08 2022] GET /identity/v3/roles => generated 1420 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 13 20:01:08.469049 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4596fe1d-e179-488b-a927-c8019b0541c4 None None] REQUEST_METHOD: `POST` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:01:08.469049 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4596fe1d-e179-488b-a927-c8019b0541c4 None None] SCRIPT_NAME: `/identity` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:01:08.469049 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4596fe1d-e179-488b-a927-c8019b0541c4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:01:08.503707 dv-cinder-828806-6-smb devstack@keystone.service[82025]: [pid: 82025|app: 0|req: 972/1910] 10.222.0.33 () {58 vars in 958 bytes} [Tue Sep 13 20:01:08 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 170 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 20:01:08.505476 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e0a8431-b340-4f7c-b080-6d7be16cbab8 None None] Authenticating user token {{(pid=82025) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 20:01:08.506700 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.auth.core [None req-4596fe1d-e179-488b-a927-c8019b0541c4 None None] MFA Rules not processed for user `fabb22bba75a4f60bf5d3f6b0462b2d7`. Rule list: `[]` (Enabled: `True`). {{(pid=82026) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 20:01:08.508216 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.common.fernet_utils [None req-4596fe1d-e179-488b-a927-c8019b0541c4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82026) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 20:01:08.517287 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e0a8431-b340-4f7c-b080-6d7be16cbab8 None None] Validating token access rules against request {{(pid=82025) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 20:01:08.522788 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de4c2936-2ff4-4d5f-add8-51e8f4c8a582 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57539b6a6f3b4d589f5f5e1d211cd6a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b454f707d20347ada3d82aa85495635e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82025) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 20:01:08.525989 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de4c2936-2ff4-4d5f-add8-51e8f4c8a582 admin admin] REQUEST_METHOD: `GET` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:01:08.525989 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de4c2936-2ff4-4d5f-add8-51e8f4c8a582 admin admin] SCRIPT_NAME: `/identity` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:01:08.525989 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de4c2936-2ff4-4d5f-add8-51e8f4c8a582 admin admin] PATH_INFO: `/v3/roles` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:01:08.527294 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de4c2936-2ff4-4d5f-add8-51e8f4c8a582 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 20:01:08.528551 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de4c2936-2ff4-4d5f-add8-51e8f4c8a582 admin admin] RBAC: Authorization granted {{(pid=82025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 20:01:08.543711 dv-cinder-828806-6-smb devstack@keystone.service[82025]: [pid: 82025|app: 0|req: 973/1911] 10.222.0.33 () {58 vars in 1122 bytes} [Tue Sep 13 20:01:08 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 13 20:01:08.548314 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42f88325-3ba7-4a41-90ea-413d0315cd5d None None] REQUEST_METHOD: `POST` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:01:08.560386 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42f88325-3ba7-4a41-90ea-413d0315cd5d None None] SCRIPT_NAME: `/identity` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:01:08.560386 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42f88325-3ba7-4a41-90ea-413d0315cd5d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:01:08.592215 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.auth.core [None req-42f88325-3ba7-4a41-90ea-413d0315cd5d None None] MFA Rules not processed for user `57539b6a6f3b4d589f5f5e1d211cd6a0`. Rule list: `[]` (Enabled: `True`). {{(pid=82025) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 20:01:08.593477 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.fernet_utils [None req-42f88325-3ba7-4a41-90ea-413d0315cd5d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82025) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 20:01:08.617148 dv-cinder-828806-6-smb devstack@keystone.service[82025]: [pid: 82025|app: 0|req: 974/1912] 10.222.0.33 () {58 vars in 958 bytes} [Tue Sep 13 20:01:08 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 72 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 20:01:08.620432 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42f88325-3ba7-4a41-90ea-413d0315cd5d None None] Authenticating user token {{(pid=82025) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 20:01:08.629164 dv-cinder-828806-6-smb devstack@keystone.service[82026]: [pid: 82026|app: 0|req: 939/1913] 10.222.0.33 () {58 vars in 958 bytes} [Tue Sep 13 20:01:08 2022] POST /identity/v3/auth/tokens => generated 3329 bytes in 159 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 20:01:08.629164 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4596fe1d-e179-488b-a927-c8019b0541c4 None None] Authenticating user token {{(pid=82026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 20:01:08.633708 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42f88325-3ba7-4a41-90ea-413d0315cd5d None None] Validating token access rules against request {{(pid=82025) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 20:01:08.639436 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5490e47e-d9b6-4464-9910-1e1f7181e927 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57539b6a6f3b4d589f5f5e1d211cd6a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b454f707d20347ada3d82aa85495635e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82025) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 20:01:08.639887 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5490e47e-d9b6-4464-9910-1e1f7181e927 admin admin] REQUEST_METHOD: `PUT` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:01:08.640176 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5490e47e-d9b6-4464-9910-1e1f7181e927 admin admin] SCRIPT_NAME: `/identity` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:01:08.640460 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5490e47e-d9b6-4464-9910-1e1f7181e927 admin admin] PATH_INFO: `/v3/projects/072ac529b69c44058689245471b0e762/users/d8b90b6575b2401ea82844fccf9122b7/roles/3618ab638a65401f82333da7596d1daf` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:01:08.645756 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4596fe1d-e179-488b-a927-c8019b0541c4 None None] Validating token access rules against request {{(pid=82026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 20:01:08.653105 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-431ac193-b2d7-434b-9f33-394c1f192cb4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57539b6a6f3b4d589f5f5e1d211cd6a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b454f707d20347ada3d82aa85495635e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 20:01:08.653105 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-431ac193-b2d7-434b-9f33-394c1f192cb4 admin admin] REQUEST_METHOD: `GET` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:01:08.653985 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-431ac193-b2d7-434b-9f33-394c1f192cb4 admin admin] SCRIPT_NAME: `/identity` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:01:08.654276 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-431ac193-b2d7-434b-9f33-394c1f192cb4 admin admin] PATH_INFO: `/v3/domains` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:01:08.654978 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-431ac193-b2d7-434b-9f33-394c1f192cb4 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82026) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 20:01:08.655340 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-431ac193-b2d7-434b-9f33-394c1f192cb4 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 20:01:08.657163 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-431ac193-b2d7-434b-9f33-394c1f192cb4 admin admin] RBAC: Authorization granted {{(pid=82026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 20:01:08.667207 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5490e47e-d9b6-4464-9910-1e1f7181e927 admin admin] RBAC: Authorizing `identity:create_grant(project_id=072ac529b69c44058689245471b0e762, user_id=d8b90b6575b2401ea82844fccf9122b7, role_id=3618ab638a65401f82333da7596d1daf)` {{(pid=82025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 20:01:08.669905 dv-cinder-828806-6-smb devstack@keystone.service[82026]: [pid: 82026|app: 0|req: 940/1914] 10.222.0.33 () {58 vars in 1153 bytes} [Tue Sep 13 20:01:08 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 20:01:08.670970 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-431ac193-b2d7-434b-9f33-394c1f192cb4 admin admin] Authenticating user token {{(pid=82026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 20:01:08.672963 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.common.fernet_utils [None req-431ac193-b2d7-434b-9f33-394c1f192cb4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82026) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 20:01:08.674222 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5490e47e-d9b6-4464-9910-1e1f7181e927 admin admin] RBAC: Authorization granted {{(pid=82025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 20:01:08.712514 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG dbcounter [-] [82025] Writing DB stats keystone:DELETE=4,keystone:SELECT=92,keystone:INSERT=4 {{(pid=82025) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 20:01:08.736653 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-431ac193-b2d7-434b-9f33-394c1f192cb4 admin admin] Validating token access rules against request {{(pid=82026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 20:01:08.741676 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df522ee9-12b2-49ff-8464-96f4ba7db1d3 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46024fc6167f4321818b1bed27a521a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8c6fba0f15b4d6a84ff601919b7b8e4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 20:01:08.743882 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df522ee9-12b2-49ff-8464-96f4ba7db1d3 service cinder] REQUEST_METHOD: `GET` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:01:08.744180 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df522ee9-12b2-49ff-8464-96f4ba7db1d3 service cinder] SCRIPT_NAME: `/identity` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:01:08.744518 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df522ee9-12b2-49ff-8464-96f4ba7db1d3 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:01:08.746588 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.common.fernet_utils [None req-df522ee9-12b2-49ff-8464-96f4ba7db1d3 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82026) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 20:01:08.778856 dv-cinder-828806-6-smb devstack@keystone.service[82025]: [pid: 82025|app: 0|req: 975/1915] 10.222.0.33 () {60 vars in 1483 bytes} [Tue Sep 13 20:01:08 2022] PUT /identity/v3/projects/072ac529b69c44058689245471b0e762/users/d8b90b6575b2401ea82844fccf9122b7/roles/3618ab638a65401f82333da7596d1daf => generated 0 bytes in 161 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 20:01:08.779552 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5490e47e-d9b6-4464-9910-1e1f7181e927 admin admin] Authenticating user token {{(pid=82025) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 20:01:08.847876 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df522ee9-12b2-49ff-8464-96f4ba7db1d3 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=82026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 20:01:08.847876 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df522ee9-12b2-49ff-8464-96f4ba7db1d3 service cinder] RBAC: Authorization granted {{(pid=82026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 20:01:08.855251 dv-cinder-828806-6-smb devstack@keystone.service[82026]: [pid: 82026|app: 0|req: 941/1916] 10.222.0.33 () {60 vars in 1365 bytes} [Tue Sep 13 20:01:08 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 185 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 20:01:08.856530 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78b0bd22-bb5b-44ba-9d6d-191de8dc63cc None None] REQUEST_METHOD: `POST` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:01:08.857088 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78b0bd22-bb5b-44ba-9d6d-191de8dc63cc None None] SCRIPT_NAME: `/identity` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:01:08.857820 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78b0bd22-bb5b-44ba-9d6d-191de8dc63cc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:01:08.874314 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5490e47e-d9b6-4464-9910-1e1f7181e927 admin admin] Validating token access rules against request {{(pid=82025) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 20:01:08.879791 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d817dc6-cb0e-4995-bbdb-b1bc29bd6661 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57539b6a6f3b4d589f5f5e1d211cd6a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b454f707d20347ada3d82aa85495635e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82025) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 20:01:08.882118 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d817dc6-cb0e-4995-bbdb-b1bc29bd6661 admin admin] REQUEST_METHOD: `POST` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:01:08.882118 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d817dc6-cb0e-4995-bbdb-b1bc29bd6661 admin admin] SCRIPT_NAME: `/identity` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:01:08.882118 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d817dc6-cb0e-4995-bbdb-b1bc29bd6661 admin admin] PATH_INFO: `/v3/projects` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:01:08.882118 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d817dc6-cb0e-4995-bbdb-b1bc29bd6661 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 20:01:08.885102 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d817dc6-cb0e-4995-bbdb-b1bc29bd6661 admin admin] RBAC: Authorization granted {{(pid=82025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 20:01:08.891087 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.auth.core [None req-78b0bd22-bb5b-44ba-9d6d-191de8dc63cc None None] MFA Rules not processed for user `d8b90b6575b2401ea82844fccf9122b7`. Rule list: `[]` (Enabled: `True`). {{(pid=82026) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 20:01:08.892481 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.common.fernet_utils [None req-78b0bd22-bb5b-44ba-9d6d-191de8dc63cc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82026) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 20:01:08.978879 dv-cinder-828806-6-smb devstack@keystone.service[82025]: [pid: 82025|app: 0|req: 976/1917] 10.222.0.33 () {60 vars in 1153 bytes} [Tue Sep 13 20:01:08 2022] POST /identity/v3/projects => generated 401 bytes in 199 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 13 20:01:08.984081 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d817dc6-cb0e-4995-bbdb-b1bc29bd6661 admin admin] Authenticating user token {{(pid=82025) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 20:01:09.037878 dv-cinder-828806-6-smb devstack@keystone.service[82026]: [pid: 82026|app: 0|req: 942/1918] 10.222.0.33 () {58 vars in 958 bytes} [Tue Sep 13 20:01:08 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 182 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 20:01:09.043804 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78b0bd22-bb5b-44ba-9d6d-191de8dc63cc None None] Authenticating user token {{(pid=82026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 20:01:09.067064 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78b0bd22-bb5b-44ba-9d6d-191de8dc63cc None None] Validating token access rules against request {{(pid=82026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 20:01:09.082533 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d817dc6-cb0e-4995-bbdb-b1bc29bd6661 admin admin] Validating token access rules against request {{(pid=82025) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 20:01:09.089289 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db270f99-6ebd-4993-a34b-aa933a81f069 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57539b6a6f3b4d589f5f5e1d211cd6a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b454f707d20347ada3d82aa85495635e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82025) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 20:01:09.090085 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db270f99-6ebd-4993-a34b-aa933a81f069 admin admin] REQUEST_METHOD: `POST` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:01:09.090429 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db270f99-6ebd-4993-a34b-aa933a81f069 admin admin] SCRIPT_NAME: `/identity` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:01:09.091993 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db270f99-6ebd-4993-a34b-aa933a81f069 admin admin] PATH_INFO: `/v3/users` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:01:09.091993 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db270f99-6ebd-4993-a34b-aa933a81f069 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 20:01:09.093957 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db270f99-6ebd-4993-a34b-aa933a81f069 admin admin] RBAC: Authorization granted {{(pid=82025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 20:01:09.181196 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc6ab417-768f-4fc9-abd7-da3afa2f1cab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57539b6a6f3b4d589f5f5e1d211cd6a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b454f707d20347ada3d82aa85495635e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 20:01:09.181833 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc6ab417-768f-4fc9-abd7-da3afa2f1cab admin admin] REQUEST_METHOD: `POST` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:01:09.182174 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc6ab417-768f-4fc9-abd7-da3afa2f1cab admin admin] SCRIPT_NAME: `/identity` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:01:09.182512 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc6ab417-768f-4fc9-abd7-da3afa2f1cab admin admin] PATH_INFO: `/v3/projects` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:01:09.183138 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc6ab417-768f-4fc9-abd7-da3afa2f1cab admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 20:01:09.185313 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc6ab417-768f-4fc9-abd7-da3afa2f1cab admin admin] RBAC: Authorization granted {{(pid=82026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 20:01:09.205697 dv-cinder-828806-6-smb devstack@keystone.service[82025]: [pid: 82025|app: 0|req: 977/1919] 10.222.0.33 () {60 vars in 1144 bytes} [Tue Sep 13 20:01:08 2022] POST /identity/v3/users => generated 301 bytes in 222 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 13 20:01:09.209493 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db270f99-6ebd-4993-a34b-aa933a81f069 admin admin] Authenticating user token {{(pid=82025) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 20:01:09.229938 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db270f99-6ebd-4993-a34b-aa933a81f069 admin admin] Validating token access rules against request {{(pid=82025) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 20:01:09.239932 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e8c7525-dbf7-4ce6-a0ef-7b02aba5a19c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57539b6a6f3b4d589f5f5e1d211cd6a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b454f707d20347ada3d82aa85495635e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82025) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 20:01:09.240507 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e8c7525-dbf7-4ce6-a0ef-7b02aba5a19c admin admin] REQUEST_METHOD: `GET` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:01:09.240844 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e8c7525-dbf7-4ce6-a0ef-7b02aba5a19c admin admin] SCRIPT_NAME: `/identity` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:01:09.241120 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e8c7525-dbf7-4ce6-a0ef-7b02aba5a19c admin admin] PATH_INFO: `/v3/roles` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:01:09.242099 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e8c7525-dbf7-4ce6-a0ef-7b02aba5a19c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 20:01:09.246350 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e8c7525-dbf7-4ce6-a0ef-7b02aba5a19c admin admin] RBAC: Authorization granted {{(pid=82025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 20:01:09.271799 dv-cinder-828806-6-smb devstack@keystone.service[82025]: [pid: 82025|app: 0|req: 978/1920] 10.222.0.33 () {58 vars in 1122 bytes} [Tue Sep 13 20:01:09 2022] GET /identity/v3/roles => generated 1420 bytes in 63 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 13 20:01:09.276329 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e8c7525-dbf7-4ce6-a0ef-7b02aba5a19c admin admin] Authenticating user token {{(pid=82025) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 20:01:09.296879 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e8c7525-dbf7-4ce6-a0ef-7b02aba5a19c admin admin] Validating token access rules against request {{(pid=82025) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 20:01:09.308263 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc9c53d4-36ba-47e7-a495-4e5211046ba5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57539b6a6f3b4d589f5f5e1d211cd6a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b454f707d20347ada3d82aa85495635e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82025) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 20:01:09.308871 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc9c53d4-36ba-47e7-a495-4e5211046ba5 admin admin] REQUEST_METHOD: `GET` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:01:09.309154 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc9c53d4-36ba-47e7-a495-4e5211046ba5 admin admin] SCRIPT_NAME: `/identity` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:01:09.309430 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc9c53d4-36ba-47e7-a495-4e5211046ba5 admin admin] PATH_INFO: `/v3/roles` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:01:09.310086 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc9c53d4-36ba-47e7-a495-4e5211046ba5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 20:01:09.311787 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc9c53d4-36ba-47e7-a495-4e5211046ba5 admin admin] RBAC: Authorization granted {{(pid=82025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 20:01:09.324702 dv-cinder-828806-6-smb devstack@keystone.service[82026]: [pid: 82026|app: 0|req: 943/1921] 10.222.0.33 () {60 vars in 1153 bytes} [Tue Sep 13 20:01:09 2022] POST /identity/v3/projects => generated 369 bytes in 277 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 13 20:01:09.325781 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc6ab417-768f-4fc9-abd7-da3afa2f1cab admin admin] Authenticating user token {{(pid=82026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 20:01:09.356418 dv-cinder-828806-6-smb devstack@keystone.service[82025]: [pid: 82025|app: 0|req: 979/1922] 10.222.0.33 () {58 vars in 1122 bytes} [Tue Sep 13 20:01:09 2022] GET /identity/v3/roles => generated 1420 bytes in 81 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 13 20:01:09.357663 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc9c53d4-36ba-47e7-a495-4e5211046ba5 admin admin] Authenticating user token {{(pid=82025) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 20:01:09.378748 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc9c53d4-36ba-47e7-a495-4e5211046ba5 admin admin] Validating token access rules against request {{(pid=82025) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 20:01:09.489779 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc6ab417-768f-4fc9-abd7-da3afa2f1cab admin admin] Validating token access rules against request {{(pid=82026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 20:01:09.496479 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c28cdb0b-a66e-4fdc-8e8b-199aa40b93aa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57539b6a6f3b4d589f5f5e1d211cd6a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b454f707d20347ada3d82aa85495635e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 20:01:09.497191 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c28cdb0b-a66e-4fdc-8e8b-199aa40b93aa admin admin] REQUEST_METHOD: `POST` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:01:09.497489 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c28cdb0b-a66e-4fdc-8e8b-199aa40b93aa admin admin] SCRIPT_NAME: `/identity` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:01:09.497813 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c28cdb0b-a66e-4fdc-8e8b-199aa40b93aa admin admin] PATH_INFO: `/v3/users` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:01:09.498563 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c28cdb0b-a66e-4fdc-8e8b-199aa40b93aa admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 20:01:09.500770 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c28cdb0b-a66e-4fdc-8e8b-199aa40b93aa admin admin] RBAC: Authorization granted {{(pid=82026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 20:01:09.509422 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45ec31ac-94ed-43e4-805d-5e146090ea42 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57539b6a6f3b4d589f5f5e1d211cd6a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b454f707d20347ada3d82aa85495635e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82025) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 20:01:09.510304 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45ec31ac-94ed-43e4-805d-5e146090ea42 admin admin] REQUEST_METHOD: `PUT` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:01:09.510586 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45ec31ac-94ed-43e4-805d-5e146090ea42 admin admin] SCRIPT_NAME: `/identity` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:01:09.510860 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45ec31ac-94ed-43e4-805d-5e146090ea42 admin admin] PATH_INFO: `/v3/projects/84d028e2b8be4bbfabda69e3897a653c/users/fd234ae6aafe4bfc9df72a6b60c00170/roles/3618ab638a65401f82333da7596d1daf` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:01:09.529633 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45ec31ac-94ed-43e4-805d-5e146090ea42 admin admin] RBAC: Authorizing `identity:create_grant(project_id=84d028e2b8be4bbfabda69e3897a653c, user_id=fd234ae6aafe4bfc9df72a6b60c00170, role_id=3618ab638a65401f82333da7596d1daf)` {{(pid=82025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 20:01:09.532467 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45ec31ac-94ed-43e4-805d-5e146090ea42 admin admin] RBAC: Authorization granted {{(pid=82025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 20:01:09.604744 dv-cinder-828806-6-smb devstack@keystone.service[82026]: [pid: 82026|app: 0|req: 944/1923] 10.222.0.33 () {60 vars in 1144 bytes} [Tue Sep 13 20:01:09 2022] POST /identity/v3/users => generated 291 bytes in 279 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 13 20:01:09.608445 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c28cdb0b-a66e-4fdc-8e8b-199aa40b93aa admin admin] Authenticating user token {{(pid=82026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 20:01:09.619188 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c28cdb0b-a66e-4fdc-8e8b-199aa40b93aa admin admin] Validating token access rules against request {{(pid=82026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 20:01:09.634338 dv-cinder-828806-6-smb devstack@keystone.service[82025]: [pid: 82025|app: 0|req: 980/1924] 10.222.0.33 () {60 vars in 1483 bytes} [Tue Sep 13 20:01:09 2022] PUT /identity/v3/projects/84d028e2b8be4bbfabda69e3897a653c/users/fd234ae6aafe4bfc9df72a6b60c00170/roles/3618ab638a65401f82333da7596d1daf => generated 0 bytes in 274 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 20:01:09.641599 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad66261a-a506-4087-a8b4-eeb42778189e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57539b6a6f3b4d589f5f5e1d211cd6a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b454f707d20347ada3d82aa85495635e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 20:01:09.642376 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad66261a-a506-4087-a8b4-eeb42778189e admin admin] REQUEST_METHOD: `GET` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:01:09.643186 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad66261a-a506-4087-a8b4-eeb42778189e admin admin] SCRIPT_NAME: `/identity` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:01:09.643186 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad66261a-a506-4087-a8b4-eeb42778189e admin admin] PATH_INFO: `/v3/roles` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:01:09.643749 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad66261a-a506-4087-a8b4-eeb42778189e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 20:01:09.645472 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad66261a-a506-4087-a8b4-eeb42778189e admin admin] RBAC: Authorization granted {{(pid=82026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 20:01:09.658211 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a83595cf-c0e3-49db-8033-90c568a6fc9e None None] REQUEST_METHOD: `POST` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:01:09.658570 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a83595cf-c0e3-49db-8033-90c568a6fc9e None None] SCRIPT_NAME: `/identity` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:01:09.663187 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a83595cf-c0e3-49db-8033-90c568a6fc9e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:01:09.668270 dv-cinder-828806-6-smb devstack@keystone.service[82026]: [pid: 82026|app: 0|req: 945/1925] 10.222.0.33 () {58 vars in 1122 bytes} [Tue Sep 13 20:01:09 2022] GET /identity/v3/roles => generated 1420 bytes in 60 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 13 20:01:09.672684 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad66261a-a506-4087-a8b4-eeb42778189e admin admin] Authenticating user token {{(pid=82026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 20:01:09.684771 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad66261a-a506-4087-a8b4-eeb42778189e admin admin] Validating token access rules against request {{(pid=82026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 20:01:09.705524 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.auth.core [None req-a83595cf-c0e3-49db-8033-90c568a6fc9e None None] MFA Rules not processed for user `fd234ae6aafe4bfc9df72a6b60c00170`. Rule list: `[]` (Enabled: `True`). {{(pid=82025) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 20:01:09.706887 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.fernet_utils [None req-a83595cf-c0e3-49db-8033-90c568a6fc9e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82025) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 20:01:09.750473 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG dbcounter [-] [82026] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82026) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 20:01:09.783663 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73310c16-f4b2-4b37-971b-6a2b5be5c966 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57539b6a6f3b4d589f5f5e1d211cd6a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b454f707d20347ada3d82aa85495635e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 20:01:09.784361 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73310c16-f4b2-4b37-971b-6a2b5be5c966 admin admin] REQUEST_METHOD: `PUT` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:01:09.784648 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73310c16-f4b2-4b37-971b-6a2b5be5c966 admin admin] SCRIPT_NAME: `/identity` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:01:09.784931 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73310c16-f4b2-4b37-971b-6a2b5be5c966 admin admin] PATH_INFO: `/v3/projects/cf118a9e8f4c401b9bbdfc2003afc4f8/users/cb167069bfc3459b905543543da217ab/roles/e5af7d5baa93469e9e486ef21c85474e` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:01:09.806368 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73310c16-f4b2-4b37-971b-6a2b5be5c966 admin admin] RBAC: Authorizing `identity:create_grant(project_id=cf118a9e8f4c401b9bbdfc2003afc4f8, user_id=cb167069bfc3459b905543543da217ab, role_id=e5af7d5baa93469e9e486ef21c85474e)` {{(pid=82026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 20:01:09.809379 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73310c16-f4b2-4b37-971b-6a2b5be5c966 admin admin] RBAC: Authorization granted {{(pid=82026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 20:01:09.833453 dv-cinder-828806-6-smb devstack@keystone.service[82025]: [pid: 82025|app: 0|req: 981/1926] 10.222.0.33 () {58 vars in 958 bytes} [Tue Sep 13 20:01:09 2022] POST /identity/v3/auth/tokens => generated 3278 bytes in 176 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 20:01:09.835460 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a83595cf-c0e3-49db-8033-90c568a6fc9e None None] Authenticating user token {{(pid=82025) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 20:01:09.849306 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a83595cf-c0e3-49db-8033-90c568a6fc9e None None] Validating token access rules against request {{(pid=82025) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 20:01:09.858097 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36b5a52f-3d84-4a8e-a6ed-2b81ae344692 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57539b6a6f3b4d589f5f5e1d211cd6a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b454f707d20347ada3d82aa85495635e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82025) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 20:01:09.863183 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36b5a52f-3d84-4a8e-a6ed-2b81ae344692 admin admin] REQUEST_METHOD: `POST` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:01:09.863690 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36b5a52f-3d84-4a8e-a6ed-2b81ae344692 admin admin] SCRIPT_NAME: `/identity` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:01:09.864225 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36b5a52f-3d84-4a8e-a6ed-2b81ae344692 admin admin] PATH_INFO: `/v3/projects` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:01:09.865185 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36b5a52f-3d84-4a8e-a6ed-2b81ae344692 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 20:01:09.867319 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36b5a52f-3d84-4a8e-a6ed-2b81ae344692 admin admin] RBAC: Authorization granted {{(pid=82025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 20:01:09.926633 dv-cinder-828806-6-smb devstack@keystone.service[82026]: [pid: 82026|app: 0|req: 946/1927] 10.222.0.33 () {60 vars in 1483 bytes} [Tue Sep 13 20:01:09 2022] PUT /identity/v3/projects/cf118a9e8f4c401b9bbdfc2003afc4f8/users/cb167069bfc3459b905543543da217ab/roles/e5af7d5baa93469e9e486ef21c85474e => generated 0 bytes in 251 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 13 20:01:09.928158 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73310c16-f4b2-4b37-971b-6a2b5be5c966 admin admin] Authenticating user token {{(pid=82026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 20:01:09.993930 dv-cinder-828806-6-smb devstack@keystone.service[82025]: [pid: 82025|app: 0|req: 982/1928] 10.222.0.33 () {60 vars in 1153 bytes} [Tue Sep 13 20:01:09 2022] POST /identity/v3/projects => generated 401 bytes in 157 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 13 20:01:09.996064 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36b5a52f-3d84-4a8e-a6ed-2b81ae344692 admin admin] Authenticating user token {{(pid=82025) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 20:01:10.102678 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73310c16-f4b2-4b37-971b-6a2b5be5c966 admin admin] Validating token access rules against request {{(pid=82026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 20:01:10.126115 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36b5a52f-3d84-4a8e-a6ed-2b81ae344692 admin admin] Validating token access rules against request {{(pid=82025) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 20:01:10.132625 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-512919bb-5a4c-4585-ab30-97b0da55a9e3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57539b6a6f3b4d589f5f5e1d211cd6a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b454f707d20347ada3d82aa85495635e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82025) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 20:01:10.133828 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-512919bb-5a4c-4585-ab30-97b0da55a9e3 admin admin] REQUEST_METHOD: `POST` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:01:10.134113 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-512919bb-5a4c-4585-ab30-97b0da55a9e3 admin admin] SCRIPT_NAME: `/identity` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:01:10.134389 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-512919bb-5a4c-4585-ab30-97b0da55a9e3 admin admin] PATH_INFO: `/v3/users` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:01:10.135655 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-512919bb-5a4c-4585-ab30-97b0da55a9e3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 20:01:10.137233 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-512919bb-5a4c-4585-ab30-97b0da55a9e3 admin admin] RBAC: Authorization granted {{(pid=82025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 20:01:10.239065 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-564c1680-dd06-4259-b521-2faf50a3352c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57539b6a6f3b4d589f5f5e1d211cd6a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b454f707d20347ada3d82aa85495635e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 20:01:10.239879 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-564c1680-dd06-4259-b521-2faf50a3352c admin admin] REQUEST_METHOD: `GET` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:01:10.240392 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-564c1680-dd06-4259-b521-2faf50a3352c admin admin] SCRIPT_NAME: `/identity` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:01:10.241040 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-564c1680-dd06-4259-b521-2faf50a3352c admin admin] PATH_INFO: `/v3/roles` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:01:10.241934 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-564c1680-dd06-4259-b521-2faf50a3352c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 20:01:10.244915 dv-cinder-828806-6-smb devstack@keystone.service[82025]: [pid: 82025|app: 0|req: 983/1929] 10.222.0.33 () {60 vars in 1144 bytes} [Tue Sep 13 20:01:09 2022] POST /identity/v3/users => generated 307 bytes in 249 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 13 20:01:10.247960 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-564c1680-dd06-4259-b521-2faf50a3352c admin admin] RBAC: Authorization granted {{(pid=82026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 20:01:10.248870 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-512919bb-5a4c-4585-ab30-97b0da55a9e3 admin admin] Authenticating user token {{(pid=82025) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 20:01:10.259081 dv-cinder-828806-6-smb devstack@keystone.service[82026]: [pid: 82026|app: 0|req: 947/1930] 10.222.0.33 () {58 vars in 1122 bytes} [Tue Sep 13 20:01:09 2022] GET /identity/v3/roles => generated 1420 bytes in 331 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 13 20:01:10.263680 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-564c1680-dd06-4259-b521-2faf50a3352c admin admin] Authenticating user token {{(pid=82026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 20:01:10.272103 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-512919bb-5a4c-4585-ab30-97b0da55a9e3 admin admin] Validating token access rules against request {{(pid=82025) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 20:01:10.277092 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-564c1680-dd06-4259-b521-2faf50a3352c admin admin] Validating token access rules against request {{(pid=82026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 20:01:10.283922 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-804566d3-eb4f-4b1c-8a70-21a01e564711 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57539b6a6f3b4d589f5f5e1d211cd6a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b454f707d20347ada3d82aa85495635e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82025) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 20:01:10.284666 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-804566d3-eb4f-4b1c-8a70-21a01e564711 admin admin] REQUEST_METHOD: `GET` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:01:10.285031 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-804566d3-eb4f-4b1c-8a70-21a01e564711 admin admin] SCRIPT_NAME: `/identity` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:01:10.286351 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-804566d3-eb4f-4b1c-8a70-21a01e564711 admin admin] PATH_INFO: `/v3/roles` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:01:10.287322 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-804566d3-eb4f-4b1c-8a70-21a01e564711 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 20:01:10.288158 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f105d631-710d-44d8-98a2-aac5782f76d6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57539b6a6f3b4d589f5f5e1d211cd6a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b454f707d20347ada3d82aa85495635e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 20:01:10.290538 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-804566d3-eb4f-4b1c-8a70-21a01e564711 admin admin] RBAC: Authorization granted {{(pid=82025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 20:01:10.292305 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f105d631-710d-44d8-98a2-aac5782f76d6 admin admin] REQUEST_METHOD: `PUT` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:01:10.292305 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f105d631-710d-44d8-98a2-aac5782f76d6 admin admin] SCRIPT_NAME: `/identity` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:01:10.292305 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f105d631-710d-44d8-98a2-aac5782f76d6 admin admin] PATH_INFO: `/v3/projects/cf118a9e8f4c401b9bbdfc2003afc4f8/users/cb167069bfc3459b905543543da217ab/roles/e5af7d5baa93469e9e486ef21c85474e` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:01:10.295261 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f105d631-710d-44d8-98a2-aac5782f76d6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=cf118a9e8f4c401b9bbdfc2003afc4f8, user_id=cb167069bfc3459b905543543da217ab, role_id=e5af7d5baa93469e9e486ef21c85474e)` {{(pid=82026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 20:01:10.298191 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f105d631-710d-44d8-98a2-aac5782f76d6 admin admin] RBAC: Authorization granted {{(pid=82026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 20:01:10.310446 dv-cinder-828806-6-smb devstack@keystone.service[82026]: [pid: 82026|app: 0|req: 948/1931] 10.222.0.33 () {60 vars in 1483 bytes} [Tue Sep 13 20:01:10 2022] PUT /identity/v3/projects/cf118a9e8f4c401b9bbdfc2003afc4f8/users/cb167069bfc3459b905543543da217ab/roles/e5af7d5baa93469e9e486ef21c85474e => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 13 20:01:10.313905 dv-cinder-828806-6-smb devstack@keystone.service[82025]: [pid: 82025|app: 0|req: 984/1932] 10.222.0.33 () {58 vars in 1122 bytes} [Tue Sep 13 20:01:10 2022] GET /identity/v3/roles => generated 1420 bytes in 65 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 13 20:01:10.317668 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f105d631-710d-44d8-98a2-aac5782f76d6 admin admin] Authenticating user token {{(pid=82026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 20:01:10.323912 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7e63ee4-40ba-4079-a5fc-13b322e6ff2f None None] REQUEST_METHOD: `POST` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:01:10.324479 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7e63ee4-40ba-4079-a5fc-13b322e6ff2f None None] SCRIPT_NAME: `/identity` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:01:10.324983 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7e63ee4-40ba-4079-a5fc-13b322e6ff2f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:01:10.374002 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.auth.core [None req-f7e63ee4-40ba-4079-a5fc-13b322e6ff2f None None] MFA Rules not processed for user `cb167069bfc3459b905543543da217ab`. Rule list: `[]` (Enabled: `True`). {{(pid=82025) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 20:01:10.375291 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.fernet_utils [None req-f7e63ee4-40ba-4079-a5fc-13b322e6ff2f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82025) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 20:01:10.421980 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f105d631-710d-44d8-98a2-aac5782f76d6 admin admin] Validating token access rules against request {{(pid=82026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 20:01:10.427422 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d078ad6-265a-4db1-b64a-2ce03c672bf1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57539b6a6f3b4d589f5f5e1d211cd6a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b454f707d20347ada3d82aa85495635e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 20:01:10.432559 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d078ad6-265a-4db1-b64a-2ce03c672bf1 admin admin] REQUEST_METHOD: `PUT` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:01:10.432559 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d078ad6-265a-4db1-b64a-2ce03c672bf1 admin admin] SCRIPT_NAME: `/identity` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:01:10.432559 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d078ad6-265a-4db1-b64a-2ce03c672bf1 admin admin] PATH_INFO: `/v3/projects/5d10c0da391047199d35ffbbd0c54ca2/users/06c0aadf30264decafed97c045f1f829/roles/e5af7d5baa93469e9e486ef21c85474e` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:01:10.446760 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d078ad6-265a-4db1-b64a-2ce03c672bf1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5d10c0da391047199d35ffbbd0c54ca2, user_id=06c0aadf30264decafed97c045f1f829, role_id=e5af7d5baa93469e9e486ef21c85474e)` {{(pid=82026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 20:01:10.450120 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d078ad6-265a-4db1-b64a-2ce03c672bf1 admin admin] RBAC: Authorization granted {{(pid=82026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 20:01:10.463312 dv-cinder-828806-6-smb devstack@keystone.service[82025]: [pid: 82025|app: 0|req: 985/1933] 10.222.0.33 () {58 vars in 958 bytes} [Tue Sep 13 20:01:10 2022] POST /identity/v3/auth/tokens => generated 3313 bytes in 142 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 20:01:10.464402 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7e63ee4-40ba-4079-a5fc-13b322e6ff2f None None] Authenticating user token {{(pid=82025) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 20:01:10.467197 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.fernet_utils [None req-f7e63ee4-40ba-4079-a5fc-13b322e6ff2f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82025) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 20:01:10.481869 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7e63ee4-40ba-4079-a5fc-13b322e6ff2f None None] Validating token access rules against request {{(pid=82025) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 20:01:10.486731 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db53c97b-4551-40e1-b2b9-dcd2d9043f08 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57539b6a6f3b4d589f5f5e1d211cd6a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b454f707d20347ada3d82aa85495635e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82025) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 20:01:10.487517 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db53c97b-4551-40e1-b2b9-dcd2d9043f08 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:01:10.488890 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db53c97b-4551-40e1-b2b9-dcd2d9043f08 admin admin] SCRIPT_NAME: `/identity` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:01:10.488890 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db53c97b-4551-40e1-b2b9-dcd2d9043f08 admin admin] PATH_INFO: `/v3/users/266922010e9c48e5bbe3d3272b0d148d` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:01:10.489587 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db53c97b-4551-40e1-b2b9-dcd2d9043f08 admin admin] RBAC: Authorizing `identity:delete_user(user_id=266922010e9c48e5bbe3d3272b0d148d)` {{(pid=82025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 20:01:10.491650 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db53c97b-4551-40e1-b2b9-dcd2d9043f08 admin admin] RBAC: Authorization granted {{(pid=82025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 20:01:10.511878 dv-cinder-828806-6-smb devstack@keystone.service[82026]: [pid: 82026|app: 0|req: 949/1934] 10.222.0.33 () {60 vars in 1483 bytes} [Tue Sep 13 20:01:10 2022] PUT /identity/v3/projects/5d10c0da391047199d35ffbbd0c54ca2/users/06c0aadf30264decafed97c045f1f829/roles/e5af7d5baa93469e9e486ef21c85474e => generated 0 bytes in 195 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 13 20:01:10.512919 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d078ad6-265a-4db1-b64a-2ce03c672bf1 admin admin] Authenticating user token {{(pid=82026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 20:01:10.594784 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d078ad6-265a-4db1-b64a-2ce03c672bf1 admin admin] Validating token access rules against request {{(pid=82026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 20:01:10.598700 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b08955f-2fde-49fb-9a40-b652dc1737d6 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46024fc6167f4321818b1bed27a521a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8c6fba0f15b4d6a84ff601919b7b8e4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 20:01:10.599408 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b08955f-2fde-49fb-9a40-b652dc1737d6 service cinder] REQUEST_METHOD: `GET` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:01:10.599855 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b08955f-2fde-49fb-9a40-b652dc1737d6 service cinder] SCRIPT_NAME: `/identity` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:01:10.599983 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b08955f-2fde-49fb-9a40-b652dc1737d6 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:01:10.675440 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b08955f-2fde-49fb-9a40-b652dc1737d6 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=82026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 20:01:10.676818 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b08955f-2fde-49fb-9a40-b652dc1737d6 service cinder] RBAC: Authorization granted {{(pid=82026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 20:01:10.690052 dv-cinder-828806-6-smb devstack@keystone.service[82026]: [pid: 82026|app: 0|req: 950/1935] 10.222.0.33 () {60 vars in 1365 bytes} [Tue Sep 13 20:01:10 2022] GET /identity/v3/auth/tokens => generated 3313 bytes in 178 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 20:01:10.691251 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b08955f-2fde-49fb-9a40-b652dc1737d6 service cinder] Authenticating user token {{(pid=82026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 20:01:10.721548 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.notifications [None req-db53c97b-4551-40e1-b2b9-dcd2d9043f08 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '266922010e9c48e5bbe3d3272b0d148d'} {{(pid=82025) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 20:01:10.767550 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b08955f-2fde-49fb-9a40-b652dc1737d6 service cinder] Validating token access rules against request {{(pid=82026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 20:01:10.772737 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68af90c0-d0b1-45ee-9493-1de584c7ced9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57539b6a6f3b4d589f5f5e1d211cd6a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b454f707d20347ada3d82aa85495635e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 20:01:10.774576 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68af90c0-d0b1-45ee-9493-1de584c7ced9 admin admin] REQUEST_METHOD: `GET` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:01:10.774866 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68af90c0-d0b1-45ee-9493-1de584c7ced9 admin admin] SCRIPT_NAME: `/identity` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:01:10.775208 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68af90c0-d0b1-45ee-9493-1de584c7ced9 admin admin] PATH_INFO: `/v3/roles` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:01:10.776123 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68af90c0-d0b1-45ee-9493-1de584c7ced9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 20:01:10.781652 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68af90c0-d0b1-45ee-9493-1de584c7ced9 admin admin] RBAC: Authorization granted {{(pid=82026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 20:01:10.786154 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.notifications [None req-db53c97b-4551-40e1-b2b9-dcd2d9043f08 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '266922010e9c48e5bbe3d3272b0d148d'} {{(pid=82025) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 20:01:10.788230 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.notifications [None req-db53c97b-4551-40e1-b2b9-dcd2d9043f08 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '266922010e9c48e5bbe3d3272b0d148d'} {{(pid=82025) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 20:01:10.790382 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG dbcounter [-] [82025] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=82025) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 20:01:10.807976 dv-cinder-828806-6-smb devstack@keystone.service[82026]: [pid: 82026|app: 0|req: 951/1936] 10.222.0.33 () {58 vars in 1122 bytes} [Tue Sep 13 20:01:10 2022] GET /identity/v3/roles => generated 1420 bytes in 117 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 13 20:01:10.811291 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68af90c0-d0b1-45ee-9493-1de584c7ced9 admin admin] Authenticating user token {{(pid=82026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 20:01:10.814475 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.common.fernet_utils [None req-68af90c0-d0b1-45ee-9493-1de584c7ced9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82026) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 20:01:10.828413 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.notifications [None req-db53c97b-4551-40e1-b2b9-dcd2d9043f08 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '266922010e9c48e5bbe3d3272b0d148d'} {{(pid=82025) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 20:01:10.830586 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68af90c0-d0b1-45ee-9493-1de584c7ced9 admin admin] Validating token access rules against request {{(pid=82026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 20:01:10.838006 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd29486a-8258-4ebe-8c7b-c98bcd448006 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57539b6a6f3b4d589f5f5e1d211cd6a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b454f707d20347ada3d82aa85495635e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 20:01:10.839487 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd29486a-8258-4ebe-8c7b-c98bcd448006 admin admin] REQUEST_METHOD: `PUT` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:01:10.839781 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd29486a-8258-4ebe-8c7b-c98bcd448006 admin admin] SCRIPT_NAME: `/identity` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:01:10.840072 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd29486a-8258-4ebe-8c7b-c98bcd448006 admin admin] PATH_INFO: `/v3/projects/5d10c0da391047199d35ffbbd0c54ca2/users/06c0aadf30264decafed97c045f1f829/roles/e5af7d5baa93469e9e486ef21c85474e` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:01:10.841424 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.notifications [None req-db53c97b-4551-40e1-b2b9-dcd2d9043f08 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '266922010e9c48e5bbe3d3272b0d148d'} {{(pid=82025) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 20:01:10.848720 dv-cinder-828806-6-smb devstack@keystone.service[82025]: [pid: 82025|app: 0|req: 986/1937] 10.222.0.33 () {58 vars in 1224 bytes} [Tue Sep 13 20:01:10 2022] DELETE /identity/v3/users/266922010e9c48e5bbe3d3272b0d148d => generated 0 bytes in 385 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 20:01:10.853957 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd29486a-8258-4ebe-8c7b-c98bcd448006 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5d10c0da391047199d35ffbbd0c54ca2, user_id=06c0aadf30264decafed97c045f1f829, role_id=e5af7d5baa93469e9e486ef21c85474e)` {{(pid=82026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 20:01:10.856479 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1ddb5ed-1d04-4a38-9666-cfe3af759360 None None] REQUEST_METHOD: `POST` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:01:10.856853 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1ddb5ed-1d04-4a38-9666-cfe3af759360 None None] SCRIPT_NAME: `/identity` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:01:10.858671 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1ddb5ed-1d04-4a38-9666-cfe3af759360 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:01:10.860765 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd29486a-8258-4ebe-8c7b-c98bcd448006 admin admin] RBAC: Authorization granted {{(pid=82026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 20:01:10.884391 dv-cinder-828806-6-smb devstack@keystone.service[82026]: [pid: 82026|app: 0|req: 952/1938] 10.222.0.33 () {60 vars in 1483 bytes} [Tue Sep 13 20:01:10 2022] PUT /identity/v3/projects/5d10c0da391047199d35ffbbd0c54ca2/users/06c0aadf30264decafed97c045f1f829/roles/e5af7d5baa93469e9e486ef21c85474e => generated 0 bytes in 73 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 20:01:10.889930 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.auth.core [None req-d1ddb5ed-1d04-4a38-9666-cfe3af759360 None None] MFA Rules not processed for user `57539b6a6f3b4d589f5f5e1d211cd6a0`. Rule list: `[]` (Enabled: `True`). {{(pid=82025) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 20:01:10.891270 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.fernet_utils [None req-d1ddb5ed-1d04-4a38-9666-cfe3af759360 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82025) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 20:01:10.896434 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-262009d3-8881-4dbe-9d09-65b8c33f6b71 None None] REQUEST_METHOD: `POST` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:01:10.897439 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-262009d3-8881-4dbe-9d09-65b8c33f6b71 None None] SCRIPT_NAME: `/identity` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:01:10.898010 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-262009d3-8881-4dbe-9d09-65b8c33f6b71 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:01:10.939228 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.auth.core [None req-262009d3-8881-4dbe-9d09-65b8c33f6b71 None None] MFA Rules not processed for user `06c0aadf30264decafed97c045f1f829`. Rule list: `[]` (Enabled: `True`). {{(pid=82026) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 20:01:10.939228 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.common.fernet_utils [None req-262009d3-8881-4dbe-9d09-65b8c33f6b71 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82026) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 20:01:11.004217 dv-cinder-828806-6-smb devstack@keystone.service[82025]: [pid: 82025|app: 0|req: 987/1939] 10.222.0.33 () {58 vars in 958 bytes} [Tue Sep 13 20:01:10 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 152 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 20:01:11.012462 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1ddb5ed-1d04-4a38-9666-cfe3af759360 None None] Authenticating user token {{(pid=82025) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 20:01:11.015207 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.fernet_utils [None req-d1ddb5ed-1d04-4a38-9666-cfe3af759360 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82025) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 20:01:11.058528 dv-cinder-828806-6-smb devstack@keystone.service[82026]: [pid: 82026|app: 0|req: 953/1940] 10.222.0.33 () {58 vars in 958 bytes} [Tue Sep 13 20:01:10 2022] POST /identity/v3/auth/tokens => generated 3345 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 20:01:11.115293 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-262009d3-8881-4dbe-9d09-65b8c33f6b71 None None] Authenticating user token {{(pid=82026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 20:01:11.116974 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.common.fernet_utils [None req-262009d3-8881-4dbe-9d09-65b8c33f6b71 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82026) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 20:01:11.125391 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1ddb5ed-1d04-4a38-9666-cfe3af759360 None None] Validating token access rules against request {{(pid=82025) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 20:01:11.129357 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e184d2bf-27c2-459b-b945-f9b7c4e4d5b2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '023a2c79c2444611b3d431928e56685d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8c6fba0f15b4d6a84ff601919b7b8e4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82025) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 20:01:11.129977 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e184d2bf-27c2-459b-b945-f9b7c4e4d5b2 service neutron] REQUEST_METHOD: `GET` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:01:11.130271 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e184d2bf-27c2-459b-b945-f9b7c4e4d5b2 service neutron] SCRIPT_NAME: `/identity` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:01:11.130548 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e184d2bf-27c2-459b-b945-f9b7c4e4d5b2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:01:11.141791 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e184d2bf-27c2-459b-b945-f9b7c4e4d5b2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 20:01:11.143314 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e184d2bf-27c2-459b-b945-f9b7c4e4d5b2 service neutron] RBAC: Authorization granted {{(pid=82025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 20:01:11.155320 dv-cinder-828806-6-smb devstack@keystone.service[82025]: [pid: 82025|app: 0|req: 988/1941] 10.222.0.33 () {60 vars in 1365 bytes} [Tue Sep 13 20:01:11 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 143 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 13 20:01:11.183949 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-262009d3-8881-4dbe-9d09-65b8c33f6b71 None None] Validating token access rules against request {{(pid=82026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 20:01:11.187761 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39f58752-304e-4517-b261-24ee001a8547 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46024fc6167f4321818b1bed27a521a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8c6fba0f15b4d6a84ff601919b7b8e4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 20:01:11.188776 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39f58752-304e-4517-b261-24ee001a8547 service cinder] REQUEST_METHOD: `GET` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:01:11.188776 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39f58752-304e-4517-b261-24ee001a8547 service cinder] SCRIPT_NAME: `/identity` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:01:11.189286 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39f58752-304e-4517-b261-24ee001a8547 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:01:11.198872 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG dbcounter [-] [82026] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=82026) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 20:01:11.201372 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39f58752-304e-4517-b261-24ee001a8547 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=82026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 20:01:11.202930 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39f58752-304e-4517-b261-24ee001a8547 service cinder] RBAC: Authorization granted {{(pid=82026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 20:01:11.223921 dv-cinder-828806-6-smb devstack@keystone.service[82026]: [pid: 82026|app: 0|req: 954/1942] 10.222.0.33 () {60 vars in 1365 bytes} [Tue Sep 13 20:01:11 2022] GET /identity/v3/auth/tokens => generated 3345 bytes in 109 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 13 20:01:11.561580 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e184d2bf-27c2-459b-b945-f9b7c4e4d5b2 service neutron] Authenticating user token {{(pid=82025) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 20:01:11.573622 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e184d2bf-27c2-459b-b945-f9b7c4e4d5b2 service neutron] Validating token access rules against request {{(pid=82025) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 20:01:11.580126 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b3621f5-08c0-447f-b334-6c5dc9f7ac3e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46024fc6167f4321818b1bed27a521a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8c6fba0f15b4d6a84ff601919b7b8e4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82025) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 20:01:11.580741 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b3621f5-08c0-447f-b334-6c5dc9f7ac3e service cinder] REQUEST_METHOD: `GET` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:01:11.581465 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b3621f5-08c0-447f-b334-6c5dc9f7ac3e service cinder] SCRIPT_NAME: `/identity` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:01:11.581746 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b3621f5-08c0-447f-b334-6c5dc9f7ac3e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:01:11.584004 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.fernet_utils [None req-0b3621f5-08c0-447f-b334-6c5dc9f7ac3e service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82025) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 20:01:11.649462 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b3621f5-08c0-447f-b334-6c5dc9f7ac3e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=82025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 20:01:11.651990 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b3621f5-08c0-447f-b334-6c5dc9f7ac3e service cinder] RBAC: Authorization granted {{(pid=82025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 20:01:11.666606 dv-cinder-828806-6-smb devstack@keystone.service[82025]: [pid: 82025|app: 0|req: 989/1943] 10.222.0.33 () {60 vars in 1365 bytes} [Tue Sep 13 20:01:11 2022] GET /identity/v3/auth/tokens => generated 3278 bytes in 103 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 20:01:11.670153 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39f58752-304e-4517-b261-24ee001a8547 service cinder] Authenticating user token {{(pid=82026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 20:01:11.676057 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.common.fernet_utils [None req-39f58752-304e-4517-b261-24ee001a8547 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82026) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 20:01:11.719292 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39f58752-304e-4517-b261-24ee001a8547 service cinder] Validating token access rules against request {{(pid=82026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 20:01:11.724730 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13581257-1a78-40ca-9917-cbcfbcf7b125 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57539b6a6f3b4d589f5f5e1d211cd6a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b454f707d20347ada3d82aa85495635e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 20:01:11.725396 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13581257-1a78-40ca-9917-cbcfbcf7b125 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:01:11.725662 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13581257-1a78-40ca-9917-cbcfbcf7b125 admin admin] SCRIPT_NAME: `/identity` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:01:11.725990 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13581257-1a78-40ca-9917-cbcfbcf7b125 admin admin] PATH_INFO: `/v3/projects/b787deb555b342228935e2011e534dd9` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:01:11.727306 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13581257-1a78-40ca-9917-cbcfbcf7b125 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b787deb555b342228935e2011e534dd9)` {{(pid=82026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 20:01:11.730386 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13581257-1a78-40ca-9917-cbcfbcf7b125 admin admin] RBAC: Authorization granted {{(pid=82026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 20:01:11.858145 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.notifications [None req-13581257-1a78-40ca-9917-cbcfbcf7b125 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b787deb555b342228935e2011e534dd9', 'request_id': 'req-13581257-1a78-40ca-9917-cbcfbcf7b125'} {{(pid=82026) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 20:01:11.984004 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.notifications [None req-13581257-1a78-40ca-9917-cbcfbcf7b125 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b787deb555b342228935e2011e534dd9', 'request_id': 'req-13581257-1a78-40ca-9917-cbcfbcf7b125'} {{(pid=82026) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 20:01:11.991435 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.notifications [None req-13581257-1a78-40ca-9917-cbcfbcf7b125 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b787deb555b342228935e2011e534dd9', 'request_id': 'req-13581257-1a78-40ca-9917-cbcfbcf7b125'} {{(pid=82026) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 20:01:12.005356 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.notifications [None req-13581257-1a78-40ca-9917-cbcfbcf7b125 admin admin] The token cache is being invalidate because project b787deb555b342228935e2011e534dd9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82026) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 13 20:01:12.005725 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.notifications [None req-13581257-1a78-40ca-9917-cbcfbcf7b125 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82026) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 20:01:12.006523 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.notifications [None req-13581257-1a78-40ca-9917-cbcfbcf7b125 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82026) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 20:01:12.008097 dv-cinder-828806-6-smb devstack@keystone.service[82026]: [pid: 82026|app: 0|req: 955/1944] 10.222.0.33 () {58 vars in 1233 bytes} [Tue Sep 13 20:01:11 2022] DELETE /identity/v3/projects/b787deb555b342228935e2011e534dd9 => generated 0 bytes in 338 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 20:01:12.013069 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b3621f5-08c0-447f-b334-6c5dc9f7ac3e service cinder] Authenticating user token {{(pid=82025) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 20:01:12.025162 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b3621f5-08c0-447f-b334-6c5dc9f7ac3e service cinder] Validating token access rules against request {{(pid=82025) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 20:01:12.084935 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fce1a76-8782-4236-89d1-d3b23432bcfe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57539b6a6f3b4d589f5f5e1d211cd6a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b454f707d20347ada3d82aa85495635e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82025) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 20:01:12.085643 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fce1a76-8782-4236-89d1-d3b23432bcfe admin admin] REQUEST_METHOD: `DELETE` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:01:12.085927 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fce1a76-8782-4236-89d1-d3b23432bcfe admin admin] SCRIPT_NAME: `/identity` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:01:12.086284 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fce1a76-8782-4236-89d1-d3b23432bcfe admin admin] PATH_INFO: `/v3/users/c5ad5116d24542f9b4be3e65ad63ccdf` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:01:12.087359 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fce1a76-8782-4236-89d1-d3b23432bcfe admin admin] RBAC: Authorizing `identity:delete_user(user_id=c5ad5116d24542f9b4be3e65ad63ccdf)` {{(pid=82025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 20:01:12.089771 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fce1a76-8782-4236-89d1-d3b23432bcfe admin admin] RBAC: Authorization granted {{(pid=82025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 20:01:12.215514 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG dbcounter [-] [82026] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82026) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 20:01:12.264965 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.notifications [None req-0fce1a76-8782-4236-89d1-d3b23432bcfe admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c5ad5116d24542f9b4be3e65ad63ccdf'} {{(pid=82025) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 20:01:12.317739 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.notifications [None req-0fce1a76-8782-4236-89d1-d3b23432bcfe admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c5ad5116d24542f9b4be3e65ad63ccdf'} {{(pid=82025) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 20:01:12.318829 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.notifications [None req-0fce1a76-8782-4236-89d1-d3b23432bcfe admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c5ad5116d24542f9b4be3e65ad63ccdf'} {{(pid=82025) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 20:01:12.330087 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG dbcounter [-] [82025] Writing DB stats keystone:DELETE=11,keystone:SELECT=88,keystone:INSERT=1 {{(pid=82025) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 20:01:12.335183 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.notifications [None req-0fce1a76-8782-4236-89d1-d3b23432bcfe admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c5ad5116d24542f9b4be3e65ad63ccdf'} {{(pid=82025) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 20:01:12.343603 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.notifications [None req-0fce1a76-8782-4236-89d1-d3b23432bcfe admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c5ad5116d24542f9b4be3e65ad63ccdf'} {{(pid=82025) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 20:01:12.356917 dv-cinder-828806-6-smb devstack@keystone.service[82025]: [pid: 82025|app: 0|req: 990/1945] 10.222.0.33 () {58 vars in 1224 bytes} [Tue Sep 13 20:01:12 2022] DELETE /identity/v3/users/c5ad5116d24542f9b4be3e65ad63ccdf => generated 0 bytes in 344 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 20:01:12.992599 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13581257-1a78-40ca-9917-cbcfbcf7b125 admin admin] Authenticating user token {{(pid=82026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 20:01:12.994915 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.common.fernet_utils [None req-13581257-1a78-40ca-9917-cbcfbcf7b125 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82026) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 20:01:13.011352 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13581257-1a78-40ca-9917-cbcfbcf7b125 admin admin] Validating token access rules against request {{(pid=82026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 20:01:13.086418 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-262e494d-1f68-4ea9-b821-2e6d24b29f55 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57539b6a6f3b4d589f5f5e1d211cd6a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b454f707d20347ada3d82aa85495635e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 20:01:13.087078 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-262e494d-1f68-4ea9-b821-2e6d24b29f55 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:01:13.087370 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-262e494d-1f68-4ea9-b821-2e6d24b29f55 admin admin] SCRIPT_NAME: `/identity` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:01:13.087867 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-262e494d-1f68-4ea9-b821-2e6d24b29f55 admin admin] PATH_INFO: `/v3/projects/f38844322511401796214bf25821c1b4` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:01:13.089300 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-262e494d-1f68-4ea9-b821-2e6d24b29f55 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f38844322511401796214bf25821c1b4)` {{(pid=82026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 20:01:13.091301 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-262e494d-1f68-4ea9-b821-2e6d24b29f55 admin admin] RBAC: Authorization granted {{(pid=82026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 20:01:13.256571 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.notifications [None req-262e494d-1f68-4ea9-b821-2e6d24b29f55 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f38844322511401796214bf25821c1b4', 'request_id': 'req-262e494d-1f68-4ea9-b821-2e6d24b29f55'} {{(pid=82026) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 20:01:13.289927 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG dbcounter [-] [82026] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82026) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 20:01:13.317900 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.notifications [None req-262e494d-1f68-4ea9-b821-2e6d24b29f55 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f38844322511401796214bf25821c1b4', 'request_id': 'req-262e494d-1f68-4ea9-b821-2e6d24b29f55'} {{(pid=82026) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 20:01:13.324334 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.notifications [None req-262e494d-1f68-4ea9-b821-2e6d24b29f55 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f38844322511401796214bf25821c1b4', 'request_id': 'req-262e494d-1f68-4ea9-b821-2e6d24b29f55'} {{(pid=82026) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 20:01:13.339000 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.notifications [None req-262e494d-1f68-4ea9-b821-2e6d24b29f55 admin admin] The token cache is being invalidate because project f38844322511401796214bf25821c1b4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82026) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 13 20:01:13.339324 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.notifications [None req-262e494d-1f68-4ea9-b821-2e6d24b29f55 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82026) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 20:01:13.339981 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.notifications [None req-262e494d-1f68-4ea9-b821-2e6d24b29f55 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82026) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 20:01:13.341466 dv-cinder-828806-6-smb devstack@keystone.service[82026]: [pid: 82026|app: 0|req: 956/1946] 10.222.0.33 () {58 vars in 1233 bytes} [Tue Sep 13 20:01:12 2022] DELETE /identity/v3/projects/f38844322511401796214bf25821c1b4 => generated 0 bytes in 349 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 20:01:13.346418 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d20e13d-b10e-429d-8215-9624d9ae6a6e None None] REQUEST_METHOD: `POST` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:01:13.346905 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d20e13d-b10e-429d-8215-9624d9ae6a6e None None] SCRIPT_NAME: `/identity` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:01:13.347213 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d20e13d-b10e-429d-8215-9624d9ae6a6e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:01:13.368020 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.auth.core [None req-6d20e13d-b10e-429d-8215-9624d9ae6a6e None None] MFA Rules not processed for user `57539b6a6f3b4d589f5f5e1d211cd6a0`. Rule list: `[]` (Enabled: `True`). {{(pid=82025) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 20:01:13.369813 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.fernet_utils [None req-6d20e13d-b10e-429d-8215-9624d9ae6a6e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82025) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 20:01:13.429755 dv-cinder-828806-6-smb devstack@keystone.service[82025]: [pid: 82025|app: 0|req: 991/1947] 10.222.0.33 () {58 vars in 958 bytes} [Tue Sep 13 20:01:13 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 20:01:13.433398 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG dbcounter [-] [82025] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82025) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 20:01:13.439107 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b517557e-adb9-458f-b5ac-a27099b9454f None None] REQUEST_METHOD: `POST` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:01:13.439438 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b517557e-adb9-458f-b5ac-a27099b9454f None None] SCRIPT_NAME: `/identity` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:01:13.439719 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b517557e-adb9-458f-b5ac-a27099b9454f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:01:13.465008 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.auth.core [None req-b517557e-adb9-458f-b5ac-a27099b9454f None None] MFA Rules not processed for user `57539b6a6f3b4d589f5f5e1d211cd6a0`. Rule list: `[]` (Enabled: `True`). {{(pid=82026) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 20:01:13.466271 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.common.fernet_utils [None req-b517557e-adb9-458f-b5ac-a27099b9454f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82026) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 20:01:13.474865 dv-cinder-828806-6-smb devstack@keystone.service[82026]: [pid: 82026|app: 0|req: 957/1948] 10.222.0.33 () {58 vars in 958 bytes} [Tue Sep 13 20:01:13 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 20:01:13.482629 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d20e13d-b10e-429d-8215-9624d9ae6a6e None None] Authenticating user token {{(pid=82025) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 20:01:13.500774 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d20e13d-b10e-429d-8215-9624d9ae6a6e None None] Validating token access rules against request {{(pid=82025) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 20:01:13.506241 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a0c4d87-264f-4fbb-9da6-99e2ac7584f1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57539b6a6f3b4d589f5f5e1d211cd6a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b454f707d20347ada3d82aa85495635e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82025) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 20:01:13.511302 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a0c4d87-264f-4fbb-9da6-99e2ac7584f1 admin admin] REQUEST_METHOD: `GET` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:01:13.511302 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a0c4d87-264f-4fbb-9da6-99e2ac7584f1 admin admin] SCRIPT_NAME: `/identity` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:01:13.511302 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a0c4d87-264f-4fbb-9da6-99e2ac7584f1 admin admin] PATH_INFO: `/v3/domains` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:01:13.511302 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a0c4d87-264f-4fbb-9da6-99e2ac7584f1 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82025) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 20:01:13.511302 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a0c4d87-264f-4fbb-9da6-99e2ac7584f1 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 20:01:13.511720 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a0c4d87-264f-4fbb-9da6-99e2ac7584f1 admin admin] RBAC: Authorization granted {{(pid=82025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 20:01:13.525613 dv-cinder-828806-6-smb devstack@keystone.service[82025]: [pid: 82025|app: 0|req: 992/1949] 10.222.0.33 () {58 vars in 1153 bytes} [Tue Sep 13 20:01:13 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 20:01:13.529729 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b517557e-adb9-458f-b5ac-a27099b9454f None None] Authenticating user token {{(pid=82026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 20:01:13.540648 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b517557e-adb9-458f-b5ac-a27099b9454f None None] Validating token access rules against request {{(pid=82026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 20:01:13.548918 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc962430-e83e-4f9e-8967-ff6b4e1a3cae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57539b6a6f3b4d589f5f5e1d211cd6a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b454f707d20347ada3d82aa85495635e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 20:01:13.548918 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc962430-e83e-4f9e-8967-ff6b4e1a3cae admin admin] REQUEST_METHOD: `POST` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:01:13.548918 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc962430-e83e-4f9e-8967-ff6b4e1a3cae admin admin] SCRIPT_NAME: `/identity` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:01:13.548918 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc962430-e83e-4f9e-8967-ff6b4e1a3cae admin admin] PATH_INFO: `/v3/projects` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:01:13.549238 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc962430-e83e-4f9e-8967-ff6b4e1a3cae admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 20:01:13.551026 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc962430-e83e-4f9e-8967-ff6b4e1a3cae admin admin] RBAC: Authorization granted {{(pid=82026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 20:01:13.645922 dv-cinder-828806-6-smb devstack@keystone.service[82026]: [pid: 82026|app: 0|req: 958/1950] 10.222.0.33 () {60 vars in 1153 bytes} [Tue Sep 13 20:01:13 2022] POST /identity/v3/projects => generated 385 bytes in 117 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 13 20:01:13.650821 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a0c4d87-264f-4fbb-9da6-99e2ac7584f1 admin admin] Authenticating user token {{(pid=82025) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 20:01:13.660877 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a0c4d87-264f-4fbb-9da6-99e2ac7584f1 admin admin] Validating token access rules against request {{(pid=82025) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 20:01:13.723733 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c597a287-4328-4ee0-a95b-bde43434c3ad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57539b6a6f3b4d589f5f5e1d211cd6a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b454f707d20347ada3d82aa85495635e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82025) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 20:01:13.724418 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c597a287-4328-4ee0-a95b-bde43434c3ad admin admin] REQUEST_METHOD: `POST` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:01:13.724812 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c597a287-4328-4ee0-a95b-bde43434c3ad admin admin] SCRIPT_NAME: `/identity` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:01:13.725153 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c597a287-4328-4ee0-a95b-bde43434c3ad admin admin] PATH_INFO: `/v3/users` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:01:13.725810 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c597a287-4328-4ee0-a95b-bde43434c3ad admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 20:01:13.727760 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c597a287-4328-4ee0-a95b-bde43434c3ad admin admin] RBAC: Authorization granted {{(pid=82025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 20:01:13.838532 dv-cinder-828806-6-smb devstack@keystone.service[82025]: [pid: 82025|app: 0|req: 993/1951] 10.222.0.33 () {60 vars in 1144 bytes} [Tue Sep 13 20:01:13 2022] POST /identity/v3/users => generated 293 bytes in 189 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 13 20:01:13.843189 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc962430-e83e-4f9e-8967-ff6b4e1a3cae admin admin] Authenticating user token {{(pid=82026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 20:01:13.854221 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc962430-e83e-4f9e-8967-ff6b4e1a3cae admin admin] Validating token access rules against request {{(pid=82026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 20:01:13.859109 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20c2573d-c1f9-4033-b6ab-c9b511685861 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57539b6a6f3b4d589f5f5e1d211cd6a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b454f707d20347ada3d82aa85495635e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 20:01:13.860243 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20c2573d-c1f9-4033-b6ab-c9b511685861 admin admin] REQUEST_METHOD: `GET` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:01:13.860243 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20c2573d-c1f9-4033-b6ab-c9b511685861 admin admin] SCRIPT_NAME: `/identity` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:01:13.860401 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20c2573d-c1f9-4033-b6ab-c9b511685861 admin admin] PATH_INFO: `/v3/roles` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:01:13.860953 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20c2573d-c1f9-4033-b6ab-c9b511685861 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 20:01:13.862604 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20c2573d-c1f9-4033-b6ab-c9b511685861 admin admin] RBAC: Authorization granted {{(pid=82026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 20:01:13.872896 dv-cinder-828806-6-smb devstack@keystone.service[82026]: [pid: 82026|app: 0|req: 959/1952] 10.222.0.33 () {58 vars in 1122 bytes} [Tue Sep 13 20:01:13 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 13 20:01:13.876982 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c597a287-4328-4ee0-a95b-bde43434c3ad admin admin] Authenticating user token {{(pid=82025) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 20:01:13.887311 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c597a287-4328-4ee0-a95b-bde43434c3ad admin admin] Validating token access rules against request {{(pid=82025) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 20:01:13.892135 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b148fb1c-ffa0-457f-ac2a-3b2938f5fd5e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57539b6a6f3b4d589f5f5e1d211cd6a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b454f707d20347ada3d82aa85495635e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82025) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 20:01:13.892754 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b148fb1c-ffa0-457f-ac2a-3b2938f5fd5e admin admin] REQUEST_METHOD: `GET` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:01:13.893037 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b148fb1c-ffa0-457f-ac2a-3b2938f5fd5e admin admin] SCRIPT_NAME: `/identity` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:01:13.893315 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b148fb1c-ffa0-457f-ac2a-3b2938f5fd5e admin admin] PATH_INFO: `/v3/roles` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:01:13.894052 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b148fb1c-ffa0-457f-ac2a-3b2938f5fd5e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 20:01:13.895677 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b148fb1c-ffa0-457f-ac2a-3b2938f5fd5e admin admin] RBAC: Authorization granted {{(pid=82025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 20:01:13.907259 dv-cinder-828806-6-smb devstack@keystone.service[82025]: [pid: 82025|app: 0|req: 994/1953] 10.222.0.33 () {58 vars in 1122 bytes} [Tue Sep 13 20:01:13 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 13 20:01:13.915099 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20c2573d-c1f9-4033-b6ab-c9b511685861 admin admin] Authenticating user token {{(pid=82026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 20:01:13.926012 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20c2573d-c1f9-4033-b6ab-c9b511685861 admin admin] Validating token access rules against request {{(pid=82026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 20:01:13.930844 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-566bcac2-e6e1-49a1-a2f6-6076403868bf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57539b6a6f3b4d589f5f5e1d211cd6a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b454f707d20347ada3d82aa85495635e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 20:01:13.931560 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-566bcac2-e6e1-49a1-a2f6-6076403868bf admin admin] REQUEST_METHOD: `PUT` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:01:13.931874 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-566bcac2-e6e1-49a1-a2f6-6076403868bf admin admin] SCRIPT_NAME: `/identity` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:01:13.932161 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-566bcac2-e6e1-49a1-a2f6-6076403868bf admin admin] PATH_INFO: `/v3/projects/1297a2c528f14361869c952debc76e35/users/af452bd801cd47fe86dfa50101a03532/roles/3618ab638a65401f82333da7596d1daf` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:01:13.950252 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-566bcac2-e6e1-49a1-a2f6-6076403868bf admin admin] RBAC: Authorizing `identity:create_grant(project_id=1297a2c528f14361869c952debc76e35, user_id=af452bd801cd47fe86dfa50101a03532, role_id=3618ab638a65401f82333da7596d1daf)` {{(pid=82026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 20:01:13.954211 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-566bcac2-e6e1-49a1-a2f6-6076403868bf admin admin] RBAC: Authorization granted {{(pid=82026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 20:01:14.057366 dv-cinder-828806-6-smb devstack@keystone.service[82026]: [pid: 82026|app: 0|req: 960/1954] 10.222.0.33 () {60 vars in 1483 bytes} [Tue Sep 13 20:01:13 2022] PUT /identity/v3/projects/1297a2c528f14361869c952debc76e35/users/af452bd801cd47fe86dfa50101a03532/roles/3618ab638a65401f82333da7596d1daf => generated 0 bytes in 143 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 20:01:14.070543 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f242a52f-bc97-4b0f-aeeb-bb2d18d25075 None None] REQUEST_METHOD: `POST` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:01:14.075718 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f242a52f-bc97-4b0f-aeeb-bb2d18d25075 None None] SCRIPT_NAME: `/identity` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:01:14.075718 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f242a52f-bc97-4b0f-aeeb-bb2d18d25075 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:01:14.128496 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.auth.core [None req-f242a52f-bc97-4b0f-aeeb-bb2d18d25075 None None] MFA Rules not processed for user `af452bd801cd47fe86dfa50101a03532`. Rule list: `[]` (Enabled: `True`). {{(pid=82025) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 20:01:14.130097 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.fernet_utils [None req-f242a52f-bc97-4b0f-aeeb-bb2d18d25075 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82025) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 20:01:14.221765 dv-cinder-828806-6-smb devstack@keystone.service[82025]: [pid: 82025|app: 0|req: 995/1955] 10.222.0.33 () {58 vars in 958 bytes} [Tue Sep 13 20:01:14 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 149 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 20:01:14.223358 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-566bcac2-e6e1-49a1-a2f6-6076403868bf admin admin] Authenticating user token {{(pid=82026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 20:01:14.255337 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG dbcounter [-] [82026] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=82026) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 20:01:14.313365 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG dbcounter [-] [82025] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=82025) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 20:01:14.342015 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-566bcac2-e6e1-49a1-a2f6-6076403868bf admin admin] Validating token access rules against request {{(pid=82026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 20:01:14.355848 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-551ee029-b2a1-4ea1-95db-4394578ceb7d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57539b6a6f3b4d589f5f5e1d211cd6a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b454f707d20347ada3d82aa85495635e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 20:01:14.359087 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-551ee029-b2a1-4ea1-95db-4394578ceb7d admin admin] REQUEST_METHOD: `POST` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:01:14.359552 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-551ee029-b2a1-4ea1-95db-4394578ceb7d admin admin] SCRIPT_NAME: `/identity` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:01:14.359988 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-551ee029-b2a1-4ea1-95db-4394578ceb7d admin admin] PATH_INFO: `/v3/projects` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:01:14.361326 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-551ee029-b2a1-4ea1-95db-4394578ceb7d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 20:01:14.364039 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-551ee029-b2a1-4ea1-95db-4394578ceb7d admin admin] RBAC: Authorization granted {{(pid=82026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 20:01:14.472308 dv-cinder-828806-6-smb devstack@keystone.service[82026]: [pid: 82026|app: 0|req: 961/1956] 10.222.0.33 () {60 vars in 1153 bytes} [Tue Sep 13 20:01:14 2022] POST /identity/v3/projects => generated 385 bytes in 250 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 13 20:01:14.476442 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f242a52f-bc97-4b0f-aeeb-bb2d18d25075 None None] Authenticating user token {{(pid=82025) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 20:01:14.487733 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f242a52f-bc97-4b0f-aeeb-bb2d18d25075 None None] Validating token access rules against request {{(pid=82025) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 20:01:14.546215 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2675194e-b0be-461b-be17-e72ddccffecb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57539b6a6f3b4d589f5f5e1d211cd6a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b454f707d20347ada3d82aa85495635e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82025) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 20:01:14.546838 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2675194e-b0be-461b-be17-e72ddccffecb admin admin] REQUEST_METHOD: `POST` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:01:14.547163 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2675194e-b0be-461b-be17-e72ddccffecb admin admin] SCRIPT_NAME: `/identity` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:01:14.547452 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2675194e-b0be-461b-be17-e72ddccffecb admin admin] PATH_INFO: `/v3/users` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:01:14.548090 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2675194e-b0be-461b-be17-e72ddccffecb admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 20:01:14.550043 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2675194e-b0be-461b-be17-e72ddccffecb admin admin] RBAC: Authorization granted {{(pid=82025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 20:01:14.665381 dv-cinder-828806-6-smb devstack@keystone.service[82025]: [pid: 82025|app: 0|req: 996/1957] 10.222.0.33 () {60 vars in 1144 bytes} [Tue Sep 13 20:01:14 2022] POST /identity/v3/users => generated 299 bytes in 189 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 13 20:01:14.683711 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-551ee029-b2a1-4ea1-95db-4394578ceb7d admin admin] Authenticating user token {{(pid=82026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 20:01:14.698096 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-551ee029-b2a1-4ea1-95db-4394578ceb7d admin admin] Validating token access rules against request {{(pid=82026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 20:01:14.713860 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2118b73-3862-4777-97a4-159bccccde12 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57539b6a6f3b4d589f5f5e1d211cd6a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b454f707d20347ada3d82aa85495635e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 20:01:14.715630 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2118b73-3862-4777-97a4-159bccccde12 admin admin] REQUEST_METHOD: `GET` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:01:14.716651 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2118b73-3862-4777-97a4-159bccccde12 admin admin] SCRIPT_NAME: `/identity` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:01:14.716651 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2118b73-3862-4777-97a4-159bccccde12 admin admin] PATH_INFO: `/v3/roles` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:01:14.717413 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2118b73-3862-4777-97a4-159bccccde12 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 20:01:14.719250 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2118b73-3862-4777-97a4-159bccccde12 admin admin] RBAC: Authorization granted {{(pid=82026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 20:01:14.724013 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG dbcounter [-] [82026] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=82026) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 20:01:14.738132 dv-cinder-828806-6-smb devstack@keystone.service[82026]: [pid: 82026|app: 0|req: 962/1958] 10.222.0.33 () {58 vars in 1122 bytes} [Tue Sep 13 20:01:14 2022] GET /identity/v3/roles => generated 1420 bytes in 56 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 13 20:01:14.742660 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2675194e-b0be-461b-be17-e72ddccffecb admin admin] Authenticating user token {{(pid=82025) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 20:01:14.757296 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2675194e-b0be-461b-be17-e72ddccffecb admin admin] Validating token access rules against request {{(pid=82025) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 20:01:14.764276 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6acb7a4b-f764-4892-ae25-a634c7013377 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57539b6a6f3b4d589f5f5e1d211cd6a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b454f707d20347ada3d82aa85495635e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82025) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 20:01:14.765392 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6acb7a4b-f764-4892-ae25-a634c7013377 admin admin] REQUEST_METHOD: `PUT` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:01:14.766296 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6acb7a4b-f764-4892-ae25-a634c7013377 admin admin] SCRIPT_NAME: `/identity` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:01:14.767453 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6acb7a4b-f764-4892-ae25-a634c7013377 admin admin] PATH_INFO: `/v3/projects/e845d3a1d35b4c3194a77c98a95facc4/users/eade86384d81417986a9b077656846b0/roles/e5af7d5baa93469e9e486ef21c85474e` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:01:14.804092 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6acb7a4b-f764-4892-ae25-a634c7013377 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e845d3a1d35b4c3194a77c98a95facc4, user_id=eade86384d81417986a9b077656846b0, role_id=e5af7d5baa93469e9e486ef21c85474e)` {{(pid=82025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 20:01:14.807807 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6acb7a4b-f764-4892-ae25-a634c7013377 admin admin] RBAC: Authorization granted {{(pid=82025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 20:01:14.960944 dv-cinder-828806-6-smb devstack@keystone.service[82025]: [pid: 82025|app: 0|req: 997/1959] 10.222.0.33 () {60 vars in 1483 bytes} [Tue Sep 13 20:01:14 2022] PUT /identity/v3/projects/e845d3a1d35b4c3194a77c98a95facc4/users/eade86384d81417986a9b077656846b0/roles/e5af7d5baa93469e9e486ef21c85474e => generated 0 bytes in 219 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 20:01:14.965905 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2118b73-3862-4777-97a4-159bccccde12 admin admin] Authenticating user token {{(pid=82026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 20:01:14.979116 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2118b73-3862-4777-97a4-159bccccde12 admin admin] Validating token access rules against request {{(pid=82026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 20:01:15.008996 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG dbcounter [-] [82025] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=82025) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 20:01:15.079742 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f14c459-3ef2-4089-8d33-52337cb9b59d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57539b6a6f3b4d589f5f5e1d211cd6a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b454f707d20347ada3d82aa85495635e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 20:01:15.080546 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f14c459-3ef2-4089-8d33-52337cb9b59d admin admin] REQUEST_METHOD: `GET` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:01:15.080666 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f14c459-3ef2-4089-8d33-52337cb9b59d admin admin] SCRIPT_NAME: `/identity` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:01:15.080871 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f14c459-3ef2-4089-8d33-52337cb9b59d admin admin] PATH_INFO: `/v3/roles` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:01:15.081561 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f14c459-3ef2-4089-8d33-52337cb9b59d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 20:01:15.083490 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f14c459-3ef2-4089-8d33-52337cb9b59d admin admin] RBAC: Authorization granted {{(pid=82026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 20:01:15.093637 dv-cinder-828806-6-smb devstack@keystone.service[82026]: [pid: 82026|app: 0|req: 963/1960] 10.222.0.33 () {58 vars in 1122 bytes} [Tue Sep 13 20:01:14 2022] GET /identity/v3/roles => generated 1420 bytes in 128 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 13 20:01:15.097834 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6acb7a4b-f764-4892-ae25-a634c7013377 admin admin] Authenticating user token {{(pid=82025) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 20:01:15.108559 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6acb7a4b-f764-4892-ae25-a634c7013377 admin admin] Validating token access rules against request {{(pid=82025) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 20:01:15.113324 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d61a87c6-f97f-496d-b01c-b38b9b721a1c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57539b6a6f3b4d589f5f5e1d211cd6a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b454f707d20347ada3d82aa85495635e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82025) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 20:01:15.113987 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d61a87c6-f97f-496d-b01c-b38b9b721a1c admin admin] REQUEST_METHOD: `PUT` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:01:15.115480 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d61a87c6-f97f-496d-b01c-b38b9b721a1c admin admin] SCRIPT_NAME: `/identity` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:01:15.115480 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d61a87c6-f97f-496d-b01c-b38b9b721a1c admin admin] PATH_INFO: `/v3/projects/e845d3a1d35b4c3194a77c98a95facc4/users/eade86384d81417986a9b077656846b0/roles/e5af7d5baa93469e9e486ef21c85474e` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:01:15.116530 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d61a87c6-f97f-496d-b01c-b38b9b721a1c admin admin] RBAC: Authorizing `identity:create_grant(project_id=e845d3a1d35b4c3194a77c98a95facc4, user_id=eade86384d81417986a9b077656846b0, role_id=e5af7d5baa93469e9e486ef21c85474e)` {{(pid=82025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 20:01:15.119780 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d61a87c6-f97f-496d-b01c-b38b9b721a1c admin admin] RBAC: Authorization granted {{(pid=82025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 20:01:15.130159 dv-cinder-828806-6-smb devstack@keystone.service[82025]: [pid: 82025|app: 0|req: 998/1961] 10.222.0.33 () {60 vars in 1483 bytes} [Tue Sep 13 20:01:15 2022] PUT /identity/v3/projects/e845d3a1d35b4c3194a77c98a95facc4/users/eade86384d81417986a9b077656846b0/roles/e5af7d5baa93469e9e486ef21c85474e => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 20:01:15.141190 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82019cad-6e8b-41df-9153-623a0e175b3c None None] REQUEST_METHOD: `POST` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:01:15.141488 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82019cad-6e8b-41df-9153-623a0e175b3c None None] SCRIPT_NAME: `/identity` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:01:15.141782 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82019cad-6e8b-41df-9153-623a0e175b3c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:01:15.171314 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.auth.core [None req-82019cad-6e8b-41df-9153-623a0e175b3c None None] MFA Rules not processed for user `eade86384d81417986a9b077656846b0`. Rule list: `[]` (Enabled: `True`). {{(pid=82026) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 20:01:15.172598 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.common.fernet_utils [None req-82019cad-6e8b-41df-9153-623a0e175b3c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82026) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 20:01:15.241542 dv-cinder-828806-6-smb devstack@keystone.service[82026]: [pid: 82026|app: 0|req: 964/1962] 10.222.0.33 () {58 vars in 958 bytes} [Tue Sep 13 20:01:15 2022] POST /identity/v3/auth/tokens => generated 3329 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 20:01:15.606388 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d61a87c6-f97f-496d-b01c-b38b9b721a1c admin admin] Authenticating user token {{(pid=82025) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 20:01:15.608130 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.fernet_utils [None req-d61a87c6-f97f-496d-b01c-b38b9b721a1c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82025) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 20:01:15.664587 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d61a87c6-f97f-496d-b01c-b38b9b721a1c admin admin] Validating token access rules against request {{(pid=82025) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 20:01:15.668850 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2018c05-449b-4ce0-bf80-ba7b6e73082c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46024fc6167f4321818b1bed27a521a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8c6fba0f15b4d6a84ff601919b7b8e4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82025) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 20:01:15.669459 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2018c05-449b-4ce0-bf80-ba7b6e73082c service cinder] REQUEST_METHOD: `GET` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:01:15.669744 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2018c05-449b-4ce0-bf80-ba7b6e73082c service cinder] SCRIPT_NAME: `/identity` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:01:15.670020 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2018c05-449b-4ce0-bf80-ba7b6e73082c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:01:15.679795 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2018c05-449b-4ce0-bf80-ba7b6e73082c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=82025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 20:01:15.681238 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2018c05-449b-4ce0-bf80-ba7b6e73082c service cinder] RBAC: Authorization granted {{(pid=82025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 20:01:15.692884 dv-cinder-828806-6-smb devstack@keystone.service[82025]: [pid: 82025|app: 0|req: 999/1963] 10.222.0.33 () {60 vars in 1365 bytes} [Tue Sep 13 20:01:15 2022] GET /identity/v3/auth/tokens => generated 3329 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 20:01:15.696311 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG dbcounter [-] [82026] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=82026) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 20:01:15.776886 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82019cad-6e8b-41df-9153-623a0e175b3c None None] Authenticating user token {{(pid=82026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 20:01:15.778412 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.common.fernet_utils [None req-82019cad-6e8b-41df-9153-623a0e175b3c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82026) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 20:01:15.811832 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2018c05-449b-4ce0-bf80-ba7b6e73082c service cinder] Authenticating user token {{(pid=82025) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 20:01:15.873158 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82019cad-6e8b-41df-9153-623a0e175b3c None None] Validating token access rules against request {{(pid=82026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 20:01:15.879090 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-117f3ada-faf1-446e-8585-a0202b19b288 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57539b6a6f3b4d589f5f5e1d211cd6a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b454f707d20347ada3d82aa85495635e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 20:01:15.880060 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-117f3ada-faf1-446e-8585-a0202b19b288 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:01:15.880389 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-117f3ada-faf1-446e-8585-a0202b19b288 admin admin] SCRIPT_NAME: `/identity` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:01:15.880675 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-117f3ada-faf1-446e-8585-a0202b19b288 admin admin] PATH_INFO: `/v3/users/d8b90b6575b2401ea82844fccf9122b7` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:01:15.890141 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-117f3ada-faf1-446e-8585-a0202b19b288 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d8b90b6575b2401ea82844fccf9122b7)` {{(pid=82026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 20:01:15.892402 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-117f3ada-faf1-446e-8585-a0202b19b288 admin admin] RBAC: Authorization granted {{(pid=82026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 20:01:15.909181 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2018c05-449b-4ce0-bf80-ba7b6e73082c service cinder] Validating token access rules against request {{(pid=82025) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 20:01:15.914691 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-441c439f-2783-41a9-9049-69454e50941c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57539b6a6f3b4d589f5f5e1d211cd6a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b454f707d20347ada3d82aa85495635e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82025) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 20:01:15.915484 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-441c439f-2783-41a9-9049-69454e50941c admin admin] REQUEST_METHOD: `DELETE` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:01:15.916509 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-441c439f-2783-41a9-9049-69454e50941c admin admin] SCRIPT_NAME: `/identity` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:01:15.916979 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-441c439f-2783-41a9-9049-69454e50941c admin admin] PATH_INFO: `/v3/users/af452bd801cd47fe86dfa50101a03532` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:01:15.918685 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-441c439f-2783-41a9-9049-69454e50941c admin admin] RBAC: Authorizing `identity:delete_user(user_id=af452bd801cd47fe86dfa50101a03532)` {{(pid=82025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 20:01:15.923670 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-441c439f-2783-41a9-9049-69454e50941c admin admin] RBAC: Authorization granted {{(pid=82025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 20:01:15.930599 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG dbcounter [-] [82025] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=82025) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 20:01:16.200643 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.notifications [None req-117f3ada-faf1-446e-8585-a0202b19b288 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd8b90b6575b2401ea82844fccf9122b7'} {{(pid=82026) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 20:01:16.209526 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.notifications [None req-441c439f-2783-41a9-9049-69454e50941c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'af452bd801cd47fe86dfa50101a03532'} {{(pid=82025) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 20:01:16.281653 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.notifications [None req-117f3ada-faf1-446e-8585-a0202b19b288 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd8b90b6575b2401ea82844fccf9122b7'} {{(pid=82026) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 20:01:16.303233 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.notifications [None req-117f3ada-faf1-446e-8585-a0202b19b288 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd8b90b6575b2401ea82844fccf9122b7'} {{(pid=82026) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 20:01:16.303974 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.notifications [None req-117f3ada-faf1-446e-8585-a0202b19b288 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd8b90b6575b2401ea82844fccf9122b7'} {{(pid=82026) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 20:01:16.311618 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.notifications [None req-117f3ada-faf1-446e-8585-a0202b19b288 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd8b90b6575b2401ea82844fccf9122b7'} {{(pid=82026) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 20:01:16.318048 dv-cinder-828806-6-smb devstack@keystone.service[82026]: [pid: 82026|app: 0|req: 965/1964] 10.222.0.33 () {58 vars in 1224 bytes} [Tue Sep 13 20:01:15 2022] DELETE /identity/v3/users/d8b90b6575b2401ea82844fccf9122b7 => generated 0 bytes in 542 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 20:01:16.322936 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-109ea0c6-ac3c-4fcd-aee2-7aa40089f98d None None] REQUEST_METHOD: `POST` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:01:16.323265 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-109ea0c6-ac3c-4fcd-aee2-7aa40089f98d None None] SCRIPT_NAME: `/identity` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:01:16.323548 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-109ea0c6-ac3c-4fcd-aee2-7aa40089f98d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:01:16.340916 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.notifications [None req-441c439f-2783-41a9-9049-69454e50941c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'af452bd801cd47fe86dfa50101a03532'} {{(pid=82025) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 20:01:16.341637 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.notifications [None req-441c439f-2783-41a9-9049-69454e50941c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'af452bd801cd47fe86dfa50101a03532'} {{(pid=82025) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 20:01:16.344732 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.auth.core [None req-109ea0c6-ac3c-4fcd-aee2-7aa40089f98d None None] MFA Rules not processed for user `57539b6a6f3b4d589f5f5e1d211cd6a0`. Rule list: `[]` (Enabled: `True`). {{(pid=82026) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 20:01:16.345959 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.common.fernet_utils [None req-109ea0c6-ac3c-4fcd-aee2-7aa40089f98d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82026) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 20:01:16.355133 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.notifications [None req-441c439f-2783-41a9-9049-69454e50941c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'af452bd801cd47fe86dfa50101a03532'} {{(pid=82025) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 20:01:16.363693 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.notifications [None req-441c439f-2783-41a9-9049-69454e50941c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'af452bd801cd47fe86dfa50101a03532'} {{(pid=82025) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 20:01:16.373582 dv-cinder-828806-6-smb devstack@keystone.service[82025]: [pid: 82025|app: 0|req: 1000/1965] 10.222.0.33 () {58 vars in 1224 bytes} [Tue Sep 13 20:01:15 2022] DELETE /identity/v3/users/af452bd801cd47fe86dfa50101a03532 => generated 0 bytes in 560 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 13 20:01:16.375135 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-299d975a-5a23-458d-bc3d-bfed6f61ae64 None None] REQUEST_METHOD: `POST` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:01:16.375498 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-299d975a-5a23-458d-bc3d-bfed6f61ae64 None None] SCRIPT_NAME: `/identity` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:01:16.375879 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-299d975a-5a23-458d-bc3d-bfed6f61ae64 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:01:16.398522 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.auth.core [None req-299d975a-5a23-458d-bc3d-bfed6f61ae64 None None] MFA Rules not processed for user `57539b6a6f3b4d589f5f5e1d211cd6a0`. Rule list: `[]` (Enabled: `True`). {{(pid=82025) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 20:01:16.401167 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.fernet_utils [None req-299d975a-5a23-458d-bc3d-bfed6f61ae64 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82025) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 20:01:16.408671 dv-cinder-828806-6-smb devstack@keystone.service[82026]: [pid: 82026|app: 0|req: 966/1966] 10.222.0.33 () {58 vars in 958 bytes} [Tue Sep 13 20:01:16 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 13 20:01:16.418476 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-109ea0c6-ac3c-4fcd-aee2-7aa40089f98d None None] Authenticating user token {{(pid=82026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 20:01:16.419942 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.common.fernet_utils [None req-109ea0c6-ac3c-4fcd-aee2-7aa40089f98d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82026) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 20:01:16.473651 dv-cinder-828806-6-smb devstack@keystone.service[82025]: [pid: 82025|app: 0|req: 1001/1967] 10.222.0.33 () {58 vars in 958 bytes} [Tue Sep 13 20:01:16 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 20:01:16.480747 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-299d975a-5a23-458d-bc3d-bfed6f61ae64 None None] Authenticating user token {{(pid=82025) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 20:01:16.482135 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.fernet_utils [None req-299d975a-5a23-458d-bc3d-bfed6f61ae64 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82025) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 20:01:16.488586 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-109ea0c6-ac3c-4fcd-aee2-7aa40089f98d None None] Validating token access rules against request {{(pid=82026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 20:01:16.546115 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d3595e5-eebc-4fce-b094-e6cc9d3a58c0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '023a2c79c2444611b3d431928e56685d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8c6fba0f15b4d6a84ff601919b7b8e4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 20:01:16.546800 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d3595e5-eebc-4fce-b094-e6cc9d3a58c0 service neutron] REQUEST_METHOD: `GET` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:01:16.547122 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d3595e5-eebc-4fce-b094-e6cc9d3a58c0 service neutron] SCRIPT_NAME: `/identity` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:01:16.547411 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d3595e5-eebc-4fce-b094-e6cc9d3a58c0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:01:16.555115 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-299d975a-5a23-458d-bc3d-bfed6f61ae64 None None] Validating token access rules against request {{(pid=82025) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 20:01:16.558485 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d3595e5-eebc-4fce-b094-e6cc9d3a58c0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 20:01:16.562634 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d3595e5-eebc-4fce-b094-e6cc9d3a58c0 service neutron] RBAC: Authorization granted {{(pid=82026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 20:01:16.562747 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ff26c54-3867-4dc5-9841-72d7cbc4d618 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '023a2c79c2444611b3d431928e56685d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8c6fba0f15b4d6a84ff601919b7b8e4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82025) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 20:01:16.562747 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ff26c54-3867-4dc5-9841-72d7cbc4d618 service neutron] REQUEST_METHOD: `GET` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:01:16.562747 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ff26c54-3867-4dc5-9841-72d7cbc4d618 service neutron] SCRIPT_NAME: `/identity` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:01:16.562747 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ff26c54-3867-4dc5-9841-72d7cbc4d618 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:01:16.571180 dv-cinder-828806-6-smb devstack@keystone.service[82026]: [pid: 82026|app: 0|req: 967/1968] 10.222.0.33 () {60 vars in 1365 bytes} [Tue Sep 13 20:01:16 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 153 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 13 20:01:16.579758 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ff26c54-3867-4dc5-9841-72d7cbc4d618 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 20:01:16.581414 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ff26c54-3867-4dc5-9841-72d7cbc4d618 service neutron] RBAC: Authorization granted {{(pid=82025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 20:01:16.593548 dv-cinder-828806-6-smb devstack@keystone.service[82025]: [pid: 82025|app: 0|req: 1002/1969] 10.222.0.33 () {60 vars in 1365 bytes} [Tue Sep 13 20:01:16 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 113 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 20:01:16.724228 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG dbcounter [-] [82026] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82026) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 20:01:16.886968 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d3595e5-eebc-4fce-b094-e6cc9d3a58c0 service neutron] Authenticating user token {{(pid=82026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 20:01:16.888840 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.common.fernet_utils [None req-4d3595e5-eebc-4fce-b094-e6cc9d3a58c0 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82026) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 20:01:16.936085 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG dbcounter [-] [82025] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=82025) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 20:01:16.959335 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d3595e5-eebc-4fce-b094-e6cc9d3a58c0 service neutron] Validating token access rules against request {{(pid=82026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 20:01:16.963789 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fce3ecea-9423-42c9-a534-184e579a7f4b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46024fc6167f4321818b1bed27a521a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8c6fba0f15b4d6a84ff601919b7b8e4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 20:01:16.964441 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fce3ecea-9423-42c9-a534-184e579a7f4b service cinder] REQUEST_METHOD: `GET` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:01:16.964744 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fce3ecea-9423-42c9-a534-184e579a7f4b service cinder] SCRIPT_NAME: `/identity` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:01:16.965014 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fce3ecea-9423-42c9-a534-184e579a7f4b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:01:16.967001 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.common.fernet_utils [None req-fce3ecea-9423-42c9-a534-184e579a7f4b service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82026) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 20:01:17.040403 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fce3ecea-9423-42c9-a534-184e579a7f4b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=82026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 20:01:17.042643 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fce3ecea-9423-42c9-a534-184e579a7f4b service cinder] RBAC: Authorization granted {{(pid=82026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 20:01:17.056484 dv-cinder-828806-6-smb devstack@keystone.service[82026]: [pid: 82026|app: 0|req: 968/1970] 10.222.0.33 () {60 vars in 1365 bytes} [Tue Sep 13 20:01:16 2022] GET /identity/v3/auth/tokens => generated 3329 bytes in 170 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 13 20:01:17.194907 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ff26c54-3867-4dc5-9841-72d7cbc4d618 service neutron] Authenticating user token {{(pid=82025) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 20:01:17.198944 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.fernet_utils [None req-3ff26c54-3867-4dc5-9841-72d7cbc4d618 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82025) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 20:01:17.218510 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ff26c54-3867-4dc5-9841-72d7cbc4d618 service neutron] Validating token access rules against request {{(pid=82025) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 20:01:17.223655 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3348e35-6804-4543-8262-238d4af451f6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57539b6a6f3b4d589f5f5e1d211cd6a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b454f707d20347ada3d82aa85495635e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82025) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 20:01:17.224362 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3348e35-6804-4543-8262-238d4af451f6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:01:17.224725 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3348e35-6804-4543-8262-238d4af451f6 admin admin] SCRIPT_NAME: `/identity` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:01:17.225244 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3348e35-6804-4543-8262-238d4af451f6 admin admin] PATH_INFO: `/v3/projects/1297a2c528f14361869c952debc76e35` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:01:17.226283 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3348e35-6804-4543-8262-238d4af451f6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=1297a2c528f14361869c952debc76e35)` {{(pid=82025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 20:01:17.228784 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3348e35-6804-4543-8262-238d4af451f6 admin admin] RBAC: Authorization granted {{(pid=82025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 20:01:17.245902 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fce3ecea-9423-42c9-a534-184e579a7f4b service cinder] Authenticating user token {{(pid=82026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 20:01:17.246865 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.common.fernet_utils [None req-fce3ecea-9423-42c9-a534-184e579a7f4b service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82026) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 20:01:17.269623 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fce3ecea-9423-42c9-a534-184e579a7f4b service cinder] Validating token access rules against request {{(pid=82026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 20:01:17.274319 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac8a57e9-ed89-4613-a4f2-abd73b1522e6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57539b6a6f3b4d589f5f5e1d211cd6a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b454f707d20347ada3d82aa85495635e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 20:01:17.274966 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac8a57e9-ed89-4613-a4f2-abd73b1522e6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:01:17.275840 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac8a57e9-ed89-4613-a4f2-abd73b1522e6 admin admin] SCRIPT_NAME: `/identity` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:01:17.276121 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac8a57e9-ed89-4613-a4f2-abd73b1522e6 admin admin] PATH_INFO: `/v3/projects/072ac529b69c44058689245471b0e762` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:01:17.277801 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac8a57e9-ed89-4613-a4f2-abd73b1522e6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=072ac529b69c44058689245471b0e762)` {{(pid=82026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 20:01:17.279982 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac8a57e9-ed89-4613-a4f2-abd73b1522e6 admin admin] RBAC: Authorization granted {{(pid=82026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 20:01:17.356133 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.notifications [None req-b3348e35-6804-4543-8262-238d4af451f6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1297a2c528f14361869c952debc76e35', 'request_id': 'req-b3348e35-6804-4543-8262-238d4af451f6'} {{(pid=82025) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 20:01:17.362439 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.notifications [None req-b3348e35-6804-4543-8262-238d4af451f6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1297a2c528f14361869c952debc76e35', 'request_id': 'req-b3348e35-6804-4543-8262-238d4af451f6'} {{(pid=82025) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 20:01:17.369464 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.notifications [None req-b3348e35-6804-4543-8262-238d4af451f6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1297a2c528f14361869c952debc76e35', 'request_id': 'req-b3348e35-6804-4543-8262-238d4af451f6'} {{(pid=82025) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 20:01:17.407941 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.notifications [None req-ac8a57e9-ed89-4613-a4f2-abd73b1522e6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '072ac529b69c44058689245471b0e762', 'request_id': 'req-ac8a57e9-ed89-4613-a4f2-abd73b1522e6'} {{(pid=82026) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 20:01:17.471112 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.notifications [None req-b3348e35-6804-4543-8262-238d4af451f6 admin admin] The token cache is being invalidate because project 1297a2c528f14361869c952debc76e35 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82025) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 13 20:01:17.471417 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.notifications [None req-b3348e35-6804-4543-8262-238d4af451f6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82025) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 20:01:17.472048 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.notifications [None req-b3348e35-6804-4543-8262-238d4af451f6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82025) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 20:01:17.473809 dv-cinder-828806-6-smb devstack@keystone.service[82025]: [pid: 82025|app: 0|req: 1003/1971] 10.222.0.33 () {58 vars in 1233 bytes} [Tue Sep 13 20:01:17 2022] DELETE /identity/v3/projects/1297a2c528f14361869c952debc76e35 => generated 0 bytes in 279 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 20:01:17.477675 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3348e35-6804-4543-8262-238d4af451f6 admin admin] Authenticating user token {{(pid=82025) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 20:01:17.479841 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.fernet_utils [None req-b3348e35-6804-4543-8262-238d4af451f6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82025) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 20:01:17.513186 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG dbcounter [-] [82026] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=82026) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 20:01:17.539870 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.notifications [None req-ac8a57e9-ed89-4613-a4f2-abd73b1522e6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '072ac529b69c44058689245471b0e762', 'request_id': 'req-ac8a57e9-ed89-4613-a4f2-abd73b1522e6'} {{(pid=82026) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 20:01:17.546950 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.notifications [None req-ac8a57e9-ed89-4613-a4f2-abd73b1522e6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '072ac529b69c44058689245471b0e762', 'request_id': 'req-ac8a57e9-ed89-4613-a4f2-abd73b1522e6'} {{(pid=82026) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 20:01:17.555617 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3348e35-6804-4543-8262-238d4af451f6 admin admin] Validating token access rules against request {{(pid=82025) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 20:01:17.559278 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.notifications [None req-ac8a57e9-ed89-4613-a4f2-abd73b1522e6 admin admin] The token cache is being invalidate because project 072ac529b69c44058689245471b0e762 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82026) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 13 20:01:17.559581 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.notifications [None req-ac8a57e9-ed89-4613-a4f2-abd73b1522e6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82026) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 20:01:17.560234 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.notifications [None req-ac8a57e9-ed89-4613-a4f2-abd73b1522e6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82026) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 20:01:17.562059 dv-cinder-828806-6-smb devstack@keystone.service[82026]: [pid: 82026|app: 0|req: 969/1972] 10.222.0.33 () {58 vars in 1233 bytes} [Tue Sep 13 20:01:17 2022] DELETE /identity/v3/projects/072ac529b69c44058689245471b0e762 => generated 0 bytes in 318 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 20:01:17.566275 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac8a57e9-ed89-4613-a4f2-abd73b1522e6 admin admin] Authenticating user token {{(pid=82026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 20:01:17.567654 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.common.fernet_utils [None req-ac8a57e9-ed89-4613-a4f2-abd73b1522e6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82026) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 20:01:17.628677 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6911b62-66b6-4840-8dcc-39433d0ea13f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57539b6a6f3b4d589f5f5e1d211cd6a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b454f707d20347ada3d82aa85495635e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82025) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 20:01:17.629419 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6911b62-66b6-4840-8dcc-39433d0ea13f admin admin] REQUEST_METHOD: `DELETE` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:01:17.629796 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6911b62-66b6-4840-8dcc-39433d0ea13f admin admin] SCRIPT_NAME: `/identity` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:01:17.630147 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6911b62-66b6-4840-8dcc-39433d0ea13f admin admin] PATH_INFO: `/v3/users/eade86384d81417986a9b077656846b0` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:01:17.633674 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6911b62-66b6-4840-8dcc-39433d0ea13f admin admin] RBAC: Authorizing `identity:delete_user(user_id=eade86384d81417986a9b077656846b0)` {{(pid=82025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 20:01:17.636023 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6911b62-66b6-4840-8dcc-39433d0ea13f admin admin] RBAC: Authorization granted {{(pid=82025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 20:01:17.645166 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac8a57e9-ed89-4613-a4f2-abd73b1522e6 admin admin] Validating token access rules against request {{(pid=82026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 20:01:17.651789 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0862d4a6-6ed5-42ef-9c76-171a4ddffabc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57539b6a6f3b4d589f5f5e1d211cd6a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b454f707d20347ada3d82aa85495635e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 20:01:17.652626 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0862d4a6-6ed5-42ef-9c76-171a4ddffabc admin admin] REQUEST_METHOD: `DELETE` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:01:17.652973 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0862d4a6-6ed5-42ef-9c76-171a4ddffabc admin admin] SCRIPT_NAME: `/identity` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:01:17.653259 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0862d4a6-6ed5-42ef-9c76-171a4ddffabc admin admin] PATH_INFO: `/v3/users/cb167069bfc3459b905543543da217ab` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:01:17.654944 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0862d4a6-6ed5-42ef-9c76-171a4ddffabc admin admin] RBAC: Authorizing `identity:delete_user(user_id=cb167069bfc3459b905543543da217ab)` {{(pid=82026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 20:01:17.657227 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0862d4a6-6ed5-42ef-9c76-171a4ddffabc admin admin] RBAC: Authorization granted {{(pid=82026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 20:01:17.876191 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.notifications [None req-d6911b62-66b6-4840-8dcc-39433d0ea13f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'eade86384d81417986a9b077656846b0'} {{(pid=82025) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 20:01:17.888805 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.notifications [None req-0862d4a6-6ed5-42ef-9c76-171a4ddffabc admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'cb167069bfc3459b905543543da217ab'} {{(pid=82026) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 20:01:17.980874 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.notifications [None req-d6911b62-66b6-4840-8dcc-39433d0ea13f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'eade86384d81417986a9b077656846b0'} {{(pid=82025) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 20:01:17.981572 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.notifications [None req-d6911b62-66b6-4840-8dcc-39433d0ea13f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'eade86384d81417986a9b077656846b0'} {{(pid=82025) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 20:01:17.996724 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.notifications [None req-d6911b62-66b6-4840-8dcc-39433d0ea13f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'eade86384d81417986a9b077656846b0'} {{(pid=82025) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 20:01:18.003851 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.notifications [None req-d6911b62-66b6-4840-8dcc-39433d0ea13f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'eade86384d81417986a9b077656846b0'} {{(pid=82025) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 20:01:18.010494 dv-cinder-828806-6-smb devstack@keystone.service[82025]: [pid: 82025|app: 0|req: 1004/1973] 10.222.0.33 () {58 vars in 1224 bytes} [Tue Sep 13 20:01:17 2022] DELETE /identity/v3/users/eade86384d81417986a9b077656846b0 => generated 0 bytes in 533 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 13 20:01:18.011490 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6911b62-66b6-4840-8dcc-39433d0ea13f admin admin] Authenticating user token {{(pid=82025) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 20:01:18.012824 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.fernet_utils [None req-d6911b62-66b6-4840-8dcc-39433d0ea13f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82025) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 20:01:18.084639 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6911b62-66b6-4840-8dcc-39433d0ea13f admin admin] Validating token access rules against request {{(pid=82025) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 20:01:18.090252 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7d6d44a-5897-4e35-bf47-87d3d59578b2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57539b6a6f3b4d589f5f5e1d211cd6a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b454f707d20347ada3d82aa85495635e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82025) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 20:01:18.090901 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7d6d44a-5897-4e35-bf47-87d3d59578b2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:01:18.091228 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7d6d44a-5897-4e35-bf47-87d3d59578b2 admin admin] SCRIPT_NAME: `/identity` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:01:18.091512 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7d6d44a-5897-4e35-bf47-87d3d59578b2 admin admin] PATH_INFO: `/v3/users/fd234ae6aafe4bfc9df72a6b60c00170` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:01:18.092697 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7d6d44a-5897-4e35-bf47-87d3d59578b2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=fd234ae6aafe4bfc9df72a6b60c00170)` {{(pid=82025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 20:01:18.094672 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7d6d44a-5897-4e35-bf47-87d3d59578b2 admin admin] RBAC: Authorization granted {{(pid=82025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 20:01:18.121677 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.notifications [None req-0862d4a6-6ed5-42ef-9c76-171a4ddffabc admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'cb167069bfc3459b905543543da217ab'} {{(pid=82026) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 20:01:18.134305 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.notifications [None req-0862d4a6-6ed5-42ef-9c76-171a4ddffabc admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'cb167069bfc3459b905543543da217ab'} {{(pid=82026) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 20:01:18.135550 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.notifications [None req-0862d4a6-6ed5-42ef-9c76-171a4ddffabc admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'cb167069bfc3459b905543543da217ab'} {{(pid=82026) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 20:01:18.142445 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.notifications [None req-0862d4a6-6ed5-42ef-9c76-171a4ddffabc admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'cb167069bfc3459b905543543da217ab'} {{(pid=82026) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 20:01:18.148452 dv-cinder-828806-6-smb devstack@keystone.service[82026]: [pid: 82026|app: 0|req: 970/1974] 10.222.0.33 () {58 vars in 1224 bytes} [Tue Sep 13 20:01:17 2022] DELETE /identity/v3/users/cb167069bfc3459b905543543da217ab => generated 0 bytes in 582 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 20:01:18.172225 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG dbcounter [-] [82025] Writing DB stats keystone:SELECT=86,keystone:DELETE=13,keystone:INSERT=1 {{(pid=82025) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 20:01:18.297702 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.notifications [None req-e7d6d44a-5897-4e35-bf47-87d3d59578b2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'fd234ae6aafe4bfc9df72a6b60c00170'} {{(pid=82025) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 20:01:18.358174 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.notifications [None req-e7d6d44a-5897-4e35-bf47-87d3d59578b2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'fd234ae6aafe4bfc9df72a6b60c00170'} {{(pid=82025) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 20:01:18.359161 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.notifications [None req-e7d6d44a-5897-4e35-bf47-87d3d59578b2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'fd234ae6aafe4bfc9df72a6b60c00170'} {{(pid=82025) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 20:01:18.375757 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.notifications [None req-e7d6d44a-5897-4e35-bf47-87d3d59578b2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'fd234ae6aafe4bfc9df72a6b60c00170'} {{(pid=82025) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 20:01:18.376741 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG dbcounter [-] [82026] Writing DB stats keystone:SELECT=88,keystone:INSERT=5,keystone:DELETE=7 {{(pid=82026) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 20:01:18.384016 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.notifications [None req-e7d6d44a-5897-4e35-bf47-87d3d59578b2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'fd234ae6aafe4bfc9df72a6b60c00170'} {{(pid=82025) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 20:01:18.402618 dv-cinder-828806-6-smb devstack@keystone.service[82025]: [pid: 82025|app: 0|req: 1005/1975] 10.222.0.33 () {58 vars in 1224 bytes} [Tue Sep 13 20:01:18 2022] DELETE /identity/v3/users/fd234ae6aafe4bfc9df72a6b60c00170 => generated 0 bytes in 392 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 20:01:18.408319 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e44428ac-c541-4c5b-8396-a14529d96dde None None] REQUEST_METHOD: `POST` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:01:18.408584 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e44428ac-c541-4c5b-8396-a14529d96dde None None] SCRIPT_NAME: `/identity` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:01:18.408987 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e44428ac-c541-4c5b-8396-a14529d96dde None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:01:18.429819 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7d6d44a-5897-4e35-bf47-87d3d59578b2 admin admin] Authenticating user token {{(pid=82025) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 20:01:18.432774 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.fernet_utils [None req-e7d6d44a-5897-4e35-bf47-87d3d59578b2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82025) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 20:01:18.434045 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.auth.core [None req-e44428ac-c541-4c5b-8396-a14529d96dde None None] MFA Rules not processed for user `57539b6a6f3b4d589f5f5e1d211cd6a0`. Rule list: `[]` (Enabled: `True`). {{(pid=82026) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 20:01:18.435474 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.common.fernet_utils [None req-e44428ac-c541-4c5b-8396-a14529d96dde None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82026) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 20:01:18.516299 dv-cinder-828806-6-smb devstack@keystone.service[82026]: [pid: 82026|app: 0|req: 971/1976] 10.222.0.33 () {58 vars in 958 bytes} [Tue Sep 13 20:01:18 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 20:01:18.526902 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e44428ac-c541-4c5b-8396-a14529d96dde None None] Authenticating user token {{(pid=82026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 20:01:18.530315 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.common.fernet_utils [None req-e44428ac-c541-4c5b-8396-a14529d96dde None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82026) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 20:01:18.552486 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7d6d44a-5897-4e35-bf47-87d3d59578b2 admin admin] Validating token access rules against request {{(pid=82025) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 20:01:18.561395 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acdd0bec-7a96-4a47-ad78-fbb9b721445c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57539b6a6f3b4d589f5f5e1d211cd6a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b454f707d20347ada3d82aa85495635e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82025) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 20:01:18.562114 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acdd0bec-7a96-4a47-ad78-fbb9b721445c admin admin] REQUEST_METHOD: `DELETE` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:01:18.562412 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acdd0bec-7a96-4a47-ad78-fbb9b721445c admin admin] SCRIPT_NAME: `/identity` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:01:18.562692 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acdd0bec-7a96-4a47-ad78-fbb9b721445c admin admin] PATH_INFO: `/v3/projects/e845d3a1d35b4c3194a77c98a95facc4` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:01:18.564719 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acdd0bec-7a96-4a47-ad78-fbb9b721445c admin admin] RBAC: Authorizing `identity:delete_project(project_id=e845d3a1d35b4c3194a77c98a95facc4)` {{(pid=82025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 20:01:18.567220 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acdd0bec-7a96-4a47-ad78-fbb9b721445c admin admin] RBAC: Authorization granted {{(pid=82025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 20:01:18.630181 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e44428ac-c541-4c5b-8396-a14529d96dde None None] Validating token access rules against request {{(pid=82026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 20:01:18.635418 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-295ce501-6660-4628-bb95-30c5db1fee97 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '023a2c79c2444611b3d431928e56685d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8c6fba0f15b4d6a84ff601919b7b8e4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 20:01:18.636128 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-295ce501-6660-4628-bb95-30c5db1fee97 service neutron] REQUEST_METHOD: `GET` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:01:18.636482 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-295ce501-6660-4628-bb95-30c5db1fee97 service neutron] SCRIPT_NAME: `/identity` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:01:18.637022 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-295ce501-6660-4628-bb95-30c5db1fee97 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:01:18.648521 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-295ce501-6660-4628-bb95-30c5db1fee97 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 20:01:18.650794 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-295ce501-6660-4628-bb95-30c5db1fee97 service neutron] RBAC: Authorization granted {{(pid=82026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 20:01:18.673667 dv-cinder-828806-6-smb devstack@keystone.service[82026]: [pid: 82026|app: 0|req: 972/1977] 10.222.0.33 () {60 vars in 1365 bytes} [Tue Sep 13 20:01:18 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 141 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 20:01:18.714493 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.notifications [None req-acdd0bec-7a96-4a47-ad78-fbb9b721445c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e845d3a1d35b4c3194a77c98a95facc4', 'request_id': 'req-acdd0bec-7a96-4a47-ad78-fbb9b721445c'} {{(pid=82025) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 20:01:18.720106 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.notifications [None req-acdd0bec-7a96-4a47-ad78-fbb9b721445c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e845d3a1d35b4c3194a77c98a95facc4', 'request_id': 'req-acdd0bec-7a96-4a47-ad78-fbb9b721445c'} {{(pid=82025) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 20:01:18.727976 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.notifications [None req-acdd0bec-7a96-4a47-ad78-fbb9b721445c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e845d3a1d35b4c3194a77c98a95facc4', 'request_id': 'req-acdd0bec-7a96-4a47-ad78-fbb9b721445c'} {{(pid=82025) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 20:01:18.734240 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-295ce501-6660-4628-bb95-30c5db1fee97 service neutron] Authenticating user token {{(pid=82026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 20:01:18.735993 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.common.fernet_utils [None req-295ce501-6660-4628-bb95-30c5db1fee97 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82026) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 20:01:18.766429 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-295ce501-6660-4628-bb95-30c5db1fee97 service neutron] Validating token access rules against request {{(pid=82026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 20:01:18.826700 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1d4c555-dc37-4c47-b96d-8036b558fd82 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57539b6a6f3b4d589f5f5e1d211cd6a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b454f707d20347ada3d82aa85495635e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 20:01:18.827402 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1d4c555-dc37-4c47-b96d-8036b558fd82 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:01:18.827687 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1d4c555-dc37-4c47-b96d-8036b558fd82 admin admin] SCRIPT_NAME: `/identity` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:01:18.827965 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1d4c555-dc37-4c47-b96d-8036b558fd82 admin admin] PATH_INFO: `/v3/projects/cf118a9e8f4c401b9bbdfc2003afc4f8` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:01:18.829136 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.notifications [None req-acdd0bec-7a96-4a47-ad78-fbb9b721445c admin admin] The token cache is being invalidate because project e845d3a1d35b4c3194a77c98a95facc4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82025) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 13 20:01:18.834856 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1d4c555-dc37-4c47-b96d-8036b558fd82 admin admin] RBAC: Authorizing `identity:delete_project(project_id=cf118a9e8f4c401b9bbdfc2003afc4f8)` {{(pid=82026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 20:01:18.835088 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.notifications [None req-acdd0bec-7a96-4a47-ad78-fbb9b721445c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82025) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 20:01:18.835088 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.notifications [None req-acdd0bec-7a96-4a47-ad78-fbb9b721445c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82025) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 20:01:18.835267 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1d4c555-dc37-4c47-b96d-8036b558fd82 admin admin] RBAC: Authorization granted {{(pid=82026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 20:01:18.835344 dv-cinder-828806-6-smb devstack@keystone.service[82025]: [pid: 82025|app: 0|req: 1006/1978] 10.222.0.33 () {58 vars in 1233 bytes} [Tue Sep 13 20:01:18 2022] DELETE /identity/v3/projects/e845d3a1d35b4c3194a77c98a95facc4 => generated 0 bytes in 402 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 13 20:01:18.839011 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2c7b130-bbaa-496c-8509-8d76c64f0c89 None None] REQUEST_METHOD: `POST` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:01:18.839346 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2c7b130-bbaa-496c-8509-8d76c64f0c89 None None] SCRIPT_NAME: `/identity` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:01:18.839626 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2c7b130-bbaa-496c-8509-8d76c64f0c89 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:01:18.866303 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.auth.core [None req-d2c7b130-bbaa-496c-8509-8d76c64f0c89 None None] MFA Rules not processed for user `57539b6a6f3b4d589f5f5e1d211cd6a0`. Rule list: `[]` (Enabled: `True`). {{(pid=82025) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 20:01:18.867978 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.fernet_utils [None req-d2c7b130-bbaa-496c-8509-8d76c64f0c89 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82025) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 20:01:18.879886 dv-cinder-828806-6-smb devstack@keystone.service[82025]: [pid: 82025|app: 0|req: 1007/1979] 10.222.0.33 () {58 vars in 958 bytes} [Tue Sep 13 20:01:18 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 43 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 13 20:01:18.888586 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f89bedf-8069-4c13-91e0-63a01b3d2fed None None] REQUEST_METHOD: `POST` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:01:18.897880 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f89bedf-8069-4c13-91e0-63a01b3d2fed None None] SCRIPT_NAME: `/identity` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:01:18.897880 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f89bedf-8069-4c13-91e0-63a01b3d2fed None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:01:18.914554 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.auth.core [None req-5f89bedf-8069-4c13-91e0-63a01b3d2fed None None] MFA Rules not processed for user `57539b6a6f3b4d589f5f5e1d211cd6a0`. Rule list: `[]` (Enabled: `True`). {{(pid=82025) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 20:01:18.916225 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.fernet_utils [None req-5f89bedf-8069-4c13-91e0-63a01b3d2fed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82025) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 20:01:18.931319 dv-cinder-828806-6-smb devstack@keystone.service[82025]: [pid: 82025|app: 0|req: 1008/1980] 10.222.0.33 () {58 vars in 958 bytes} [Tue Sep 13 20:01:18 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 20:01:18.935002 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f89bedf-8069-4c13-91e0-63a01b3d2fed None None] Authenticating user token {{(pid=82025) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 20:01:18.949127 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f89bedf-8069-4c13-91e0-63a01b3d2fed None None] Validating token access rules against request {{(pid=82025) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 20:01:18.956099 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e70555b-51a4-4666-aeda-336578e5dc60 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57539b6a6f3b4d589f5f5e1d211cd6a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b454f707d20347ada3d82aa85495635e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82025) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 20:01:18.957091 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e70555b-51a4-4666-aeda-336578e5dc60 admin admin] REQUEST_METHOD: `GET` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:01:18.957553 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e70555b-51a4-4666-aeda-336578e5dc60 admin admin] SCRIPT_NAME: `/identity` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:01:18.958213 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e70555b-51a4-4666-aeda-336578e5dc60 admin admin] PATH_INFO: `/v3/domains` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:01:18.959277 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e70555b-51a4-4666-aeda-336578e5dc60 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82025) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 20:01:18.959749 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e70555b-51a4-4666-aeda-336578e5dc60 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 20:01:18.962579 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e70555b-51a4-4666-aeda-336578e5dc60 admin admin] RBAC: Authorization granted {{(pid=82025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 20:01:18.980903 dv-cinder-828806-6-smb devstack@keystone.service[82025]: [pid: 82025|app: 0|req: 1009/1981] 10.222.0.33 () {58 vars in 1153 bytes} [Tue Sep 13 20:01:18 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 13 20:01:18.982901 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e70555b-51a4-4666-aeda-336578e5dc60 admin admin] Authenticating user token {{(pid=82025) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 20:01:18.994572 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e70555b-51a4-4666-aeda-336578e5dc60 admin admin] Validating token access rules against request {{(pid=82025) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 20:01:18.999572 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf5978de-7061-4d55-940f-392984daee0b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57539b6a6f3b4d589f5f5e1d211cd6a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b454f707d20347ada3d82aa85495635e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82025) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 20:01:19.001916 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf5978de-7061-4d55-940f-392984daee0b admin admin] REQUEST_METHOD: `POST` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:01:19.001916 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf5978de-7061-4d55-940f-392984daee0b admin admin] SCRIPT_NAME: `/identity` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:01:19.001916 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf5978de-7061-4d55-940f-392984daee0b admin admin] PATH_INFO: `/v3/projects` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:01:19.001916 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf5978de-7061-4d55-940f-392984daee0b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 20:01:19.003713 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf5978de-7061-4d55-940f-392984daee0b admin admin] RBAC: Authorization granted {{(pid=82025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 20:01:19.030009 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.notifications [None req-b1d4c555-dc37-4c47-b96d-8036b558fd82 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'cf118a9e8f4c401b9bbdfc2003afc4f8', 'request_id': 'req-b1d4c555-dc37-4c47-b96d-8036b558fd82'} {{(pid=82026) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 20:01:19.186912 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.notifications [None req-b1d4c555-dc37-4c47-b96d-8036b558fd82 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'cf118a9e8f4c401b9bbdfc2003afc4f8', 'request_id': 'req-b1d4c555-dc37-4c47-b96d-8036b558fd82'} {{(pid=82026) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 20:01:19.193932 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.notifications [None req-b1d4c555-dc37-4c47-b96d-8036b558fd82 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'cf118a9e8f4c401b9bbdfc2003afc4f8', 'request_id': 'req-b1d4c555-dc37-4c47-b96d-8036b558fd82'} {{(pid=82026) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 20:01:19.194687 dv-cinder-828806-6-smb devstack@keystone.service[82025]: [pid: 82025|app: 0|req: 1010/1982] 10.222.0.33 () {60 vars in 1153 bytes} [Tue Sep 13 20:01:18 2022] POST /identity/v3/projects => generated 393 bytes in 212 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 13 20:01:19.199157 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf5978de-7061-4d55-940f-392984daee0b admin admin] Authenticating user token {{(pid=82025) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 20:01:19.206488 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.notifications [None req-b1d4c555-dc37-4c47-b96d-8036b558fd82 admin admin] The token cache is being invalidate because project cf118a9e8f4c401b9bbdfc2003afc4f8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82026) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 13 20:01:19.206783 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.notifications [None req-b1d4c555-dc37-4c47-b96d-8036b558fd82 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82026) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 20:01:19.207513 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.notifications [None req-b1d4c555-dc37-4c47-b96d-8036b558fd82 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82026) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 20:01:19.209124 dv-cinder-828806-6-smb devstack@keystone.service[82026]: [pid: 82026|app: 0|req: 973/1983] 10.222.0.33 () {58 vars in 1233 bytes} [Tue Sep 13 20:01:18 2022] DELETE /identity/v3/projects/cf118a9e8f4c401b9bbdfc2003afc4f8 => generated 0 bytes in 475 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 20:01:19.214159 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31437f7f-b65c-4676-88fb-4b3000250c4e None None] REQUEST_METHOD: `POST` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:01:19.214448 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31437f7f-b65c-4676-88fb-4b3000250c4e None None] SCRIPT_NAME: `/identity` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:01:19.215116 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31437f7f-b65c-4676-88fb-4b3000250c4e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:01:19.239258 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.auth.core [None req-31437f7f-b65c-4676-88fb-4b3000250c4e None None] MFA Rules not processed for user `57539b6a6f3b4d589f5f5e1d211cd6a0`. Rule list: `[]` (Enabled: `True`). {{(pid=82026) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 20:01:19.240635 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.common.fernet_utils [None req-31437f7f-b65c-4676-88fb-4b3000250c4e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82026) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 20:01:19.295328 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf5978de-7061-4d55-940f-392984daee0b admin admin] Validating token access rules against request {{(pid=82025) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 20:01:19.303574 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0288ca69-2a89-44af-ad2f-d9196a7ae60a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57539b6a6f3b4d589f5f5e1d211cd6a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b454f707d20347ada3d82aa85495635e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82025) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 20:01:19.304427 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0288ca69-2a89-44af-ad2f-d9196a7ae60a admin admin] REQUEST_METHOD: `POST` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:01:19.304901 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0288ca69-2a89-44af-ad2f-d9196a7ae60a admin admin] SCRIPT_NAME: `/identity` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:01:19.305487 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0288ca69-2a89-44af-ad2f-d9196a7ae60a admin admin] PATH_INFO: `/v3/users` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:01:19.307723 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0288ca69-2a89-44af-ad2f-d9196a7ae60a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 20:01:19.309359 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0288ca69-2a89-44af-ad2f-d9196a7ae60a admin admin] RBAC: Authorization granted {{(pid=82025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 20:01:19.327082 dv-cinder-828806-6-smb devstack@keystone.service[82026]: [pid: 82026|app: 0|req: 974/1984] 10.222.0.33 () {58 vars in 958 bytes} [Tue Sep 13 20:01:19 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 13 20:01:19.328354 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31437f7f-b65c-4676-88fb-4b3000250c4e None None] Authenticating user token {{(pid=82026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 20:01:19.330036 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.common.fernet_utils [None req-31437f7f-b65c-4676-88fb-4b3000250c4e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82026) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 20:01:19.342988 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31437f7f-b65c-4676-88fb-4b3000250c4e None None] Validating token access rules against request {{(pid=82026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 20:01:19.348406 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fab96f2b-a6e9-41e8-8c55-8fe2d039fd39 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57539b6a6f3b4d589f5f5e1d211cd6a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b454f707d20347ada3d82aa85495635e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 20:01:19.349043 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fab96f2b-a6e9-41e8-8c55-8fe2d039fd39 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:01:19.349330 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fab96f2b-a6e9-41e8-8c55-8fe2d039fd39 admin admin] SCRIPT_NAME: `/identity` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:01:19.349609 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fab96f2b-a6e9-41e8-8c55-8fe2d039fd39 admin admin] PATH_INFO: `/v3/projects/84d028e2b8be4bbfabda69e3897a653c` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:01:19.350750 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fab96f2b-a6e9-41e8-8c55-8fe2d039fd39 admin admin] RBAC: Authorizing `identity:delete_project(project_id=84d028e2b8be4bbfabda69e3897a653c)` {{(pid=82026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 20:01:19.352705 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fab96f2b-a6e9-41e8-8c55-8fe2d039fd39 admin admin] RBAC: Authorization granted {{(pid=82026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 20:01:19.410335 dv-cinder-828806-6-smb devstack@keystone.service[82025]: [pid: 82025|app: 0|req: 1011/1985] 10.222.0.33 () {60 vars in 1144 bytes} [Tue Sep 13 20:01:19 2022] POST /identity/v3/users => generated 297 bytes in 212 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 13 20:01:19.414636 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0288ca69-2a89-44af-ad2f-d9196a7ae60a admin admin] Authenticating user token {{(pid=82025) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 20:01:19.416984 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.fernet_utils [None req-0288ca69-2a89-44af-ad2f-d9196a7ae60a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82025) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 20:01:19.429565 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0288ca69-2a89-44af-ad2f-d9196a7ae60a admin admin] Validating token access rules against request {{(pid=82025) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 20:01:19.435815 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20995af1-4fbe-4180-8c97-5c53fc169f0c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57539b6a6f3b4d589f5f5e1d211cd6a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b454f707d20347ada3d82aa85495635e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82025) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 20:01:19.440669 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20995af1-4fbe-4180-8c97-5c53fc169f0c admin admin] REQUEST_METHOD: `DELETE` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:01:19.440669 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20995af1-4fbe-4180-8c97-5c53fc169f0c admin admin] SCRIPT_NAME: `/identity` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:01:19.440669 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20995af1-4fbe-4180-8c97-5c53fc169f0c admin admin] PATH_INFO: `/v3/users/2226fddf31f241cb9027b44960b237fa` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:01:19.440669 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20995af1-4fbe-4180-8c97-5c53fc169f0c admin admin] RBAC: Authorizing `identity:delete_user(user_id=2226fddf31f241cb9027b44960b237fa)` {{(pid=82025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 20:01:19.440669 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20995af1-4fbe-4180-8c97-5c53fc169f0c admin admin] RBAC: Authorization granted {{(pid=82025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 20:01:19.506532 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.notifications [None req-fab96f2b-a6e9-41e8-8c55-8fe2d039fd39 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '84d028e2b8be4bbfabda69e3897a653c', 'request_id': 'req-fab96f2b-a6e9-41e8-8c55-8fe2d039fd39'} {{(pid=82026) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 20:01:19.593027 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.notifications [None req-fab96f2b-a6e9-41e8-8c55-8fe2d039fd39 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '84d028e2b8be4bbfabda69e3897a653c', 'request_id': 'req-fab96f2b-a6e9-41e8-8c55-8fe2d039fd39'} {{(pid=82026) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 20:01:19.601509 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.notifications [None req-fab96f2b-a6e9-41e8-8c55-8fe2d039fd39 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '84d028e2b8be4bbfabda69e3897a653c', 'request_id': 'req-fab96f2b-a6e9-41e8-8c55-8fe2d039fd39'} {{(pid=82026) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 20:01:19.613275 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.notifications [None req-fab96f2b-a6e9-41e8-8c55-8fe2d039fd39 admin admin] The token cache is being invalidate because project 84d028e2b8be4bbfabda69e3897a653c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82026) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 13 20:01:19.613648 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.notifications [None req-fab96f2b-a6e9-41e8-8c55-8fe2d039fd39 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82026) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 20:01:19.614384 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.notifications [None req-fab96f2b-a6e9-41e8-8c55-8fe2d039fd39 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82026) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 20:01:19.615973 dv-cinder-828806-6-smb devstack@keystone.service[82026]: [pid: 82026|app: 0|req: 975/1986] 10.222.0.33 () {58 vars in 1233 bytes} [Tue Sep 13 20:01:19 2022] DELETE /identity/v3/projects/84d028e2b8be4bbfabda69e3897a653c => generated 0 bytes in 288 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 20:01:19.617383 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68015f8f-e0ef-4f75-aaa3-a73daa9e462a None None] REQUEST_METHOD: `POST` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:01:19.617753 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68015f8f-e0ef-4f75-aaa3-a73daa9e462a None None] SCRIPT_NAME: `/identity` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:01:19.618101 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68015f8f-e0ef-4f75-aaa3-a73daa9e462a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:01:19.640722 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.auth.core [None req-68015f8f-e0ef-4f75-aaa3-a73daa9e462a None None] MFA Rules not processed for user `57539b6a6f3b4d589f5f5e1d211cd6a0`. Rule list: `[]` (Enabled: `True`). {{(pid=82026) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 20:01:19.642095 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.common.fernet_utils [None req-68015f8f-e0ef-4f75-aaa3-a73daa9e462a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82026) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 20:01:19.667355 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.notifications [None req-20995af1-4fbe-4180-8c97-5c53fc169f0c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2226fddf31f241cb9027b44960b237fa'} {{(pid=82025) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 20:01:19.706448 dv-cinder-828806-6-smb devstack@keystone.service[82026]: [pid: 82026|app: 0|req: 976/1987] 10.222.0.33 () {58 vars in 958 bytes} [Tue Sep 13 20:01:19 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 20:01:19.707120 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68015f8f-e0ef-4f75-aaa3-a73daa9e462a None None] Authenticating user token {{(pid=82026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 20:01:19.715439 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.common.fernet_utils [None req-68015f8f-e0ef-4f75-aaa3-a73daa9e462a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82026) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 20:01:19.725780 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68015f8f-e0ef-4f75-aaa3-a73daa9e462a None None] Validating token access rules against request {{(pid=82026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 20:01:19.730874 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63a90273-5783-40ca-bd0a-fde278bbbcba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57539b6a6f3b4d589f5f5e1d211cd6a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b454f707d20347ada3d82aa85495635e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 20:01:19.731651 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63a90273-5783-40ca-bd0a-fde278bbbcba admin admin] REQUEST_METHOD: `GET` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:01:19.731949 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63a90273-5783-40ca-bd0a-fde278bbbcba admin admin] SCRIPT_NAME: `/identity` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:01:19.732227 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63a90273-5783-40ca-bd0a-fde278bbbcba admin admin] PATH_INFO: `/v3/roles` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:01:19.732916 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63a90273-5783-40ca-bd0a-fde278bbbcba admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 20:01:19.734482 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63a90273-5783-40ca-bd0a-fde278bbbcba admin admin] RBAC: Authorization granted {{(pid=82026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 20:01:19.746543 dv-cinder-828806-6-smb devstack@keystone.service[82026]: [pid: 82026|app: 0|req: 977/1988] 10.222.0.33 () {58 vars in 1122 bytes} [Tue Sep 13 20:01:19 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 13 20:01:19.748135 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63a90273-5783-40ca-bd0a-fde278bbbcba admin admin] Authenticating user token {{(pid=82026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 20:01:19.750906 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.common.fernet_utils [None req-63a90273-5783-40ca-bd0a-fde278bbbcba admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82026) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 20:01:19.757018 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.notifications [None req-20995af1-4fbe-4180-8c97-5c53fc169f0c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2226fddf31f241cb9027b44960b237fa'} {{(pid=82025) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 20:01:19.758054 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.notifications [None req-20995af1-4fbe-4180-8c97-5c53fc169f0c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2226fddf31f241cb9027b44960b237fa'} {{(pid=82025) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 20:01:19.768256 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63a90273-5783-40ca-bd0a-fde278bbbcba admin admin] Validating token access rules against request {{(pid=82026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 20:01:19.773338 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fe5de91-2390-4358-b5db-a0a7c321452d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57539b6a6f3b4d589f5f5e1d211cd6a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b454f707d20347ada3d82aa85495635e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 20:01:19.773974 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fe5de91-2390-4358-b5db-a0a7c321452d admin admin] REQUEST_METHOD: `DELETE` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:01:19.774261 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fe5de91-2390-4358-b5db-a0a7c321452d admin admin] SCRIPT_NAME: `/identity` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:01:19.774543 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fe5de91-2390-4358-b5db-a0a7c321452d admin admin] PATH_INFO: `/v3/users/06c0aadf30264decafed97c045f1f829` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:01:19.776037 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fe5de91-2390-4358-b5db-a0a7c321452d admin admin] RBAC: Authorizing `identity:delete_user(user_id=06c0aadf30264decafed97c045f1f829)` {{(pid=82026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 20:01:19.778062 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fe5de91-2390-4358-b5db-a0a7c321452d admin admin] RBAC: Authorization granted {{(pid=82026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 20:01:19.778516 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.notifications [None req-20995af1-4fbe-4180-8c97-5c53fc169f0c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2226fddf31f241cb9027b44960b237fa'} {{(pid=82025) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 20:01:19.788655 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.notifications [None req-20995af1-4fbe-4180-8c97-5c53fc169f0c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2226fddf31f241cb9027b44960b237fa'} {{(pid=82025) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 20:01:19.800990 dv-cinder-828806-6-smb devstack@keystone.service[82025]: [pid: 82025|app: 0|req: 1012/1989] 10.222.0.33 () {58 vars in 1224 bytes} [Tue Sep 13 20:01:19 2022] DELETE /identity/v3/users/2226fddf31f241cb9027b44960b237fa => generated 0 bytes in 385 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 20:01:19.802535 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20995af1-4fbe-4180-8c97-5c53fc169f0c admin admin] Authenticating user token {{(pid=82025) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 20:01:19.804384 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.fernet_utils [None req-20995af1-4fbe-4180-8c97-5c53fc169f0c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82025) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 20:01:19.879354 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG dbcounter [-] [82025] Writing DB stats keystone:DELETE=14,keystone:SELECT=84,keystone:INSERT=2 {{(pid=82025) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 20:01:19.883891 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20995af1-4fbe-4180-8c97-5c53fc169f0c admin admin] Validating token access rules against request {{(pid=82025) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 20:01:19.893858 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba438eac-b277-4bcb-8485-a540b3fe7caf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57539b6a6f3b4d589f5f5e1d211cd6a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b454f707d20347ada3d82aa85495635e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82025) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 20:01:19.894496 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba438eac-b277-4bcb-8485-a540b3fe7caf admin admin] REQUEST_METHOD: `GET` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:01:19.894812 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba438eac-b277-4bcb-8485-a540b3fe7caf admin admin] SCRIPT_NAME: `/identity` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:01:19.895156 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba438eac-b277-4bcb-8485-a540b3fe7caf admin admin] PATH_INFO: `/v3/domains` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:01:19.895831 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba438eac-b277-4bcb-8485-a540b3fe7caf admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82025) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 20:01:19.896141 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba438eac-b277-4bcb-8485-a540b3fe7caf admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 20:01:19.897776 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba438eac-b277-4bcb-8485-a540b3fe7caf admin admin] RBAC: Authorization granted {{(pid=82025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 20:01:19.912445 dv-cinder-828806-6-smb devstack@keystone.service[82025]: [pid: 82025|app: 0|req: 1013/1990] 10.222.0.33 () {58 vars in 1153 bytes} [Tue Sep 13 20:01:19 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 109 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 20:01:19.912445 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba438eac-b277-4bcb-8485-a540b3fe7caf admin admin] Authenticating user token {{(pid=82025) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 20:01:19.919245 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.fernet_utils [None req-ba438eac-b277-4bcb-8485-a540b3fe7caf admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82025) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 20:01:19.928610 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba438eac-b277-4bcb-8485-a540b3fe7caf admin admin] Validating token access rules against request {{(pid=82025) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 20:01:19.933749 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2967e404-9b74-4be2-af45-ccf82d14bbf1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57539b6a6f3b4d589f5f5e1d211cd6a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b454f707d20347ada3d82aa85495635e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82025) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 20:01:19.934250 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2967e404-9b74-4be2-af45-ccf82d14bbf1 admin admin] REQUEST_METHOD: `GET` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:01:19.934543 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2967e404-9b74-4be2-af45-ccf82d14bbf1 admin admin] SCRIPT_NAME: `/identity` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:01:19.934824 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2967e404-9b74-4be2-af45-ccf82d14bbf1 admin admin] PATH_INFO: `/v3/roles` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:01:19.935518 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2967e404-9b74-4be2-af45-ccf82d14bbf1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 20:01:19.937156 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2967e404-9b74-4be2-af45-ccf82d14bbf1 admin admin] RBAC: Authorization granted {{(pid=82025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 20:01:19.949110 dv-cinder-828806-6-smb devstack@keystone.service[82025]: [pid: 82025|app: 0|req: 1014/1991] 10.222.0.33 () {58 vars in 1122 bytes} [Tue Sep 13 20:01:19 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 13 20:01:19.950496 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcd5822d-12ad-4846-8be2-5ac8e1bf53f1 None None] REQUEST_METHOD: `POST` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:01:19.950791 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcd5822d-12ad-4846-8be2-5ac8e1bf53f1 None None] SCRIPT_NAME: `/identity` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:01:19.951104 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcd5822d-12ad-4846-8be2-5ac8e1bf53f1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:01:19.975290 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.auth.core [None req-dcd5822d-12ad-4846-8be2-5ac8e1bf53f1 None None] MFA Rules not processed for user `57539b6a6f3b4d589f5f5e1d211cd6a0`. Rule list: `[]` (Enabled: `True`). {{(pid=82025) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 20:01:19.975290 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.fernet_utils [None req-dcd5822d-12ad-4846-8be2-5ac8e1bf53f1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82025) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 20:01:19.984986 dv-cinder-828806-6-smb devstack@keystone.service[82025]: [pid: 82025|app: 0|req: 1015/1992] 10.222.0.33 () {58 vars in 958 bytes} [Tue Sep 13 20:01:19 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 20:01:19.984986 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcd5822d-12ad-4846-8be2-5ac8e1bf53f1 None None] Authenticating user token {{(pid=82025) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 20:01:19.987744 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.notifications [None req-9fe5de91-2390-4358-b5db-a0a7c321452d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '06c0aadf30264decafed97c045f1f829'} {{(pid=82026) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 20:01:19.997269 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcd5822d-12ad-4846-8be2-5ac8e1bf53f1 None None] Validating token access rules against request {{(pid=82025) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 20:01:20.001789 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04d16368-19e7-41b1-9e17-8a8a27b83a35 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57539b6a6f3b4d589f5f5e1d211cd6a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b454f707d20347ada3d82aa85495635e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82025) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 20:01:20.002503 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04d16368-19e7-41b1-9e17-8a8a27b83a35 admin admin] REQUEST_METHOD: `POST` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:01:20.002790 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04d16368-19e7-41b1-9e17-8a8a27b83a35 admin admin] SCRIPT_NAME: `/identity` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:01:20.003097 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04d16368-19e7-41b1-9e17-8a8a27b83a35 admin admin] PATH_INFO: `/v3/projects` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:01:20.003757 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04d16368-19e7-41b1-9e17-8a8a27b83a35 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 20:01:20.005680 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04d16368-19e7-41b1-9e17-8a8a27b83a35 admin admin] RBAC: Authorization granted {{(pid=82025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 20:01:20.084261 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.notifications [None req-9fe5de91-2390-4358-b5db-a0a7c321452d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '06c0aadf30264decafed97c045f1f829'} {{(pid=82026) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 20:01:20.098688 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.notifications [None req-9fe5de91-2390-4358-b5db-a0a7c321452d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '06c0aadf30264decafed97c045f1f829'} {{(pid=82026) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 20:01:20.099500 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.notifications [None req-9fe5de91-2390-4358-b5db-a0a7c321452d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '06c0aadf30264decafed97c045f1f829'} {{(pid=82026) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 20:01:20.106754 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.notifications [None req-9fe5de91-2390-4358-b5db-a0a7c321452d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '06c0aadf30264decafed97c045f1f829'} {{(pid=82026) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 20:01:20.112820 dv-cinder-828806-6-smb devstack@keystone.service[82026]: [pid: 82026|app: 0|req: 978/1993] 10.222.0.33 () {58 vars in 1224 bytes} [Tue Sep 13 20:01:19 2022] DELETE /identity/v3/users/06c0aadf30264decafed97c045f1f829 => generated 0 bytes in 365 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 20:01:20.113720 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fe5de91-2390-4358-b5db-a0a7c321452d admin admin] Authenticating user token {{(pid=82026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 20:01:20.123050 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.common.fernet_utils [None req-9fe5de91-2390-4358-b5db-a0a7c321452d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82026) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 20:01:20.139807 dv-cinder-828806-6-smb devstack@keystone.service[82025]: [pid: 82025|app: 0|req: 1016/1994] 10.222.0.33 () {60 vars in 1153 bytes} [Tue Sep 13 20:01:19 2022] POST /identity/v3/projects => generated 387 bytes in 157 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 13 20:01:20.140760 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04d16368-19e7-41b1-9e17-8a8a27b83a35 admin admin] Authenticating user token {{(pid=82025) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 20:01:20.145847 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.fernet_utils [None req-04d16368-19e7-41b1-9e17-8a8a27b83a35 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82025) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 20:01:20.170276 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG dbcounter [-] [82026] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82026) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 20:01:20.229906 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fe5de91-2390-4358-b5db-a0a7c321452d admin admin] Validating token access rules against request {{(pid=82026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 20:01:20.232729 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04d16368-19e7-41b1-9e17-8a8a27b83a35 admin admin] Validating token access rules against request {{(pid=82025) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 20:01:20.237533 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5e50fae-130d-4992-9a4c-8b02fe3d204d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '023a2c79c2444611b3d431928e56685d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8c6fba0f15b4d6a84ff601919b7b8e4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82025) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 20:01:20.238142 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5e50fae-130d-4992-9a4c-8b02fe3d204d service neutron] REQUEST_METHOD: `GET` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:01:20.238424 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5e50fae-130d-4992-9a4c-8b02fe3d204d service neutron] SCRIPT_NAME: `/identity` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:01:20.238698 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5e50fae-130d-4992-9a4c-8b02fe3d204d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:01:20.240590 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.fernet_utils [None req-d5e50fae-130d-4992-9a4c-8b02fe3d204d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82025) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 20:01:20.297108 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbff8c3f-e026-4c84-b431-cca9c607dd74 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57539b6a6f3b4d589f5f5e1d211cd6a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b454f707d20347ada3d82aa85495635e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 20:01:20.298842 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbff8c3f-e026-4c84-b431-cca9c607dd74 admin admin] REQUEST_METHOD: `PUT` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:01:20.298842 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbff8c3f-e026-4c84-b431-cca9c607dd74 admin admin] SCRIPT_NAME: `/identity` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:01:20.299185 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbff8c3f-e026-4c84-b431-cca9c607dd74 admin admin] PATH_INFO: `/v3/projects/48fc06140d7e46fbb505aa2c3dd0a13f/users/ab6531df40574bd1988649c6783e714f/roles/3618ab638a65401f82333da7596d1daf` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:01:20.316388 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbff8c3f-e026-4c84-b431-cca9c607dd74 admin admin] RBAC: Authorizing `identity:create_grant(project_id=48fc06140d7e46fbb505aa2c3dd0a13f, user_id=ab6531df40574bd1988649c6783e714f, role_id=3618ab638a65401f82333da7596d1daf)` {{(pid=82026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 20:01:20.319898 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbff8c3f-e026-4c84-b431-cca9c607dd74 admin admin] RBAC: Authorization granted {{(pid=82026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 20:01:20.324571 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5e50fae-130d-4992-9a4c-8b02fe3d204d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 20:01:20.326056 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5e50fae-130d-4992-9a4c-8b02fe3d204d service neutron] RBAC: Authorization granted {{(pid=82025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 20:01:20.346487 dv-cinder-828806-6-smb devstack@keystone.service[82025]: [pid: 82025|app: 0|req: 1017/1995] 10.222.0.33 () {60 vars in 1365 bytes} [Tue Sep 13 20:01:20 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 206 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 20:01:20.347642 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5e50fae-130d-4992-9a4c-8b02fe3d204d service neutron] Authenticating user token {{(pid=82025) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 20:01:20.349621 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.fernet_utils [None req-d5e50fae-130d-4992-9a4c-8b02fe3d204d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82025) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 20:01:20.363493 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5e50fae-130d-4992-9a4c-8b02fe3d204d service neutron] Validating token access rules against request {{(pid=82025) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 20:01:20.368969 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2fdf7a8-1a82-44fa-9e3e-3f409a4558c1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57539b6a6f3b4d589f5f5e1d211cd6a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b454f707d20347ada3d82aa85495635e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82025) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 20:01:20.370152 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2fdf7a8-1a82-44fa-9e3e-3f409a4558c1 admin admin] REQUEST_METHOD: `POST` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:01:20.370419 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2fdf7a8-1a82-44fa-9e3e-3f409a4558c1 admin admin] SCRIPT_NAME: `/identity` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:01:20.370720 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2fdf7a8-1a82-44fa-9e3e-3f409a4558c1 admin admin] PATH_INFO: `/v3/users` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:01:20.371379 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2fdf7a8-1a82-44fa-9e3e-3f409a4558c1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 20:01:20.373598 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2fdf7a8-1a82-44fa-9e3e-3f409a4558c1 admin admin] RBAC: Authorization granted {{(pid=82025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 20:01:20.423348 dv-cinder-828806-6-smb devstack@keystone.service[82026]: [pid: 82026|app: 0|req: 979/1996] 10.222.0.33 () {60 vars in 1483 bytes} [Tue Sep 13 20:01:20 2022] PUT /identity/v3/projects/48fc06140d7e46fbb505aa2c3dd0a13f/users/ab6531df40574bd1988649c6783e714f/roles/3618ab638a65401f82333da7596d1daf => generated 0 bytes in 310 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 20:01:20.436770 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2d88f6d-4ebe-4963-bdd9-7ac228626dd5 None None] REQUEST_METHOD: `POST` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:01:20.437269 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2d88f6d-4ebe-4963-bdd9-7ac228626dd5 None None] SCRIPT_NAME: `/identity` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:01:20.437669 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2d88f6d-4ebe-4963-bdd9-7ac228626dd5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:01:20.473587 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.auth.core [None req-f2d88f6d-4ebe-4963-bdd9-7ac228626dd5 None None] MFA Rules not processed for user `ab6531df40574bd1988649c6783e714f`. Rule list: `[]` (Enabled: `True`). {{(pid=82026) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 20:01:20.474922 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.common.fernet_utils [None req-f2d88f6d-4ebe-4963-bdd9-7ac228626dd5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82026) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 20:01:20.507296 dv-cinder-828806-6-smb devstack@keystone.service[82025]: [pid: 82025|app: 0|req: 1018/1997] 10.222.0.33 () {60 vars in 1144 bytes} [Tue Sep 13 20:01:20 2022] POST /identity/v3/users => generated 294 bytes in 160 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 13 20:01:20.512163 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2fdf7a8-1a82-44fa-9e3e-3f409a4558c1 admin admin] Authenticating user token {{(pid=82025) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 20:01:20.536887 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2fdf7a8-1a82-44fa-9e3e-3f409a4558c1 admin admin] Validating token access rules against request {{(pid=82025) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 20:01:20.571567 dv-cinder-828806-6-smb devstack@keystone.service[82026]: [pid: 82026|app: 0|req: 980/1998] 10.222.0.33 () {58 vars in 958 bytes} [Tue Sep 13 20:01:20 2022] POST /identity/v3/auth/tokens => generated 3270 bytes in 137 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 13 20:01:20.576952 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2d88f6d-4ebe-4963-bdd9-7ac228626dd5 None None] Authenticating user token {{(pid=82026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 20:01:20.626289 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da0b78b6-b108-47c2-b5dc-45658bfa171b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57539b6a6f3b4d589f5f5e1d211cd6a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b454f707d20347ada3d82aa85495635e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82025) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 20:01:20.627141 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da0b78b6-b108-47c2-b5dc-45658bfa171b admin admin] REQUEST_METHOD: `GET` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:01:20.627478 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da0b78b6-b108-47c2-b5dc-45658bfa171b admin admin] SCRIPT_NAME: `/identity` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:01:20.627763 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da0b78b6-b108-47c2-b5dc-45658bfa171b admin admin] PATH_INFO: `/v3/roles` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:01:20.628429 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da0b78b6-b108-47c2-b5dc-45658bfa171b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 20:01:20.630245 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da0b78b6-b108-47c2-b5dc-45658bfa171b admin admin] RBAC: Authorization granted {{(pid=82025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 20:01:20.647857 dv-cinder-828806-6-smb devstack@keystone.service[82025]: [pid: 82025|app: 0|req: 1019/1999] 10.222.0.33 () {58 vars in 1122 bytes} [Tue Sep 13 20:01:20 2022] GET /identity/v3/roles => generated 1420 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 13 20:01:20.649213 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da0b78b6-b108-47c2-b5dc-45658bfa171b admin admin] Authenticating user token {{(pid=82025) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 20:01:20.663814 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da0b78b6-b108-47c2-b5dc-45658bfa171b admin admin] Validating token access rules against request {{(pid=82025) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 20:01:20.669044 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2d88f6d-4ebe-4963-bdd9-7ac228626dd5 None None] Validating token access rules against request {{(pid=82026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 20:01:20.670999 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-958e3be5-a209-44ea-98f2-b1f8d16157f5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57539b6a6f3b4d589f5f5e1d211cd6a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b454f707d20347ada3d82aa85495635e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82025) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 20:01:20.671697 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-958e3be5-a209-44ea-98f2-b1f8d16157f5 admin admin] REQUEST_METHOD: `GET` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:01:20.672238 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-958e3be5-a209-44ea-98f2-b1f8d16157f5 admin admin] SCRIPT_NAME: `/identity` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:01:20.672527 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-958e3be5-a209-44ea-98f2-b1f8d16157f5 admin admin] PATH_INFO: `/v3/roles` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:01:20.673238 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-958e3be5-a209-44ea-98f2-b1f8d16157f5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 20:01:20.675228 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-958e3be5-a209-44ea-98f2-b1f8d16157f5 admin admin] RBAC: Authorization granted {{(pid=82025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 20:01:20.691674 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1b01c6c-2a75-4b81-8820-83ef063f0fa6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57539b6a6f3b4d589f5f5e1d211cd6a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b454f707d20347ada3d82aa85495635e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 20:01:20.693839 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1b01c6c-2a75-4b81-8820-83ef063f0fa6 admin admin] REQUEST_METHOD: `POST` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:01:20.694134 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1b01c6c-2a75-4b81-8820-83ef063f0fa6 admin admin] SCRIPT_NAME: `/identity` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:01:20.694419 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1b01c6c-2a75-4b81-8820-83ef063f0fa6 admin admin] PATH_INFO: `/v3/projects` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:01:20.695104 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1b01c6c-2a75-4b81-8820-83ef063f0fa6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 20:01:20.697069 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1b01c6c-2a75-4b81-8820-83ef063f0fa6 admin admin] RBAC: Authorization granted {{(pid=82026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 20:01:20.698930 dv-cinder-828806-6-smb devstack@keystone.service[82025]: [pid: 82025|app: 0|req: 1020/2000] 10.222.0.33 () {58 vars in 1122 bytes} [Tue Sep 13 20:01:20 2022] GET /identity/v3/roles => generated 1420 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 13 20:01:20.703017 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-958e3be5-a209-44ea-98f2-b1f8d16157f5 admin admin] Authenticating user token {{(pid=82025) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 20:01:20.707834 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.fernet_utils [None req-958e3be5-a209-44ea-98f2-b1f8d16157f5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82025) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 20:01:20.732344 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-958e3be5-a209-44ea-98f2-b1f8d16157f5 admin admin] Validating token access rules against request {{(pid=82025) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 20:01:20.739745 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a6d50ec-63e2-473d-bc21-edc1f5767e14 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57539b6a6f3b4d589f5f5e1d211cd6a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b454f707d20347ada3d82aa85495635e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82025) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 20:01:20.741460 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a6d50ec-63e2-473d-bc21-edc1f5767e14 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:01:20.741460 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a6d50ec-63e2-473d-bc21-edc1f5767e14 admin admin] SCRIPT_NAME: `/identity` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:01:20.744899 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a6d50ec-63e2-473d-bc21-edc1f5767e14 admin admin] PATH_INFO: `/v3/projects/5d10c0da391047199d35ffbbd0c54ca2` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:01:20.744899 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a6d50ec-63e2-473d-bc21-edc1f5767e14 admin admin] RBAC: Authorizing `identity:delete_project(project_id=5d10c0da391047199d35ffbbd0c54ca2)` {{(pid=82025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 20:01:20.745511 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a6d50ec-63e2-473d-bc21-edc1f5767e14 admin admin] RBAC: Authorization granted {{(pid=82025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 20:01:20.831073 dv-cinder-828806-6-smb devstack@keystone.service[82026]: [pid: 82026|app: 0|req: 981/2001] 10.222.0.33 () {60 vars in 1153 bytes} [Tue Sep 13 20:01:20 2022] POST /identity/v3/projects => generated 393 bytes in 253 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 13 20:01:20.831073 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1b01c6c-2a75-4b81-8820-83ef063f0fa6 admin admin] Authenticating user token {{(pid=82026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 20:01:20.890194 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.notifications [None req-2a6d50ec-63e2-473d-bc21-edc1f5767e14 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5d10c0da391047199d35ffbbd0c54ca2', 'request_id': 'req-2a6d50ec-63e2-473d-bc21-edc1f5767e14'} {{(pid=82025) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 20:01:20.902390 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.notifications [None req-2a6d50ec-63e2-473d-bc21-edc1f5767e14 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5d10c0da391047199d35ffbbd0c54ca2', 'request_id': 'req-2a6d50ec-63e2-473d-bc21-edc1f5767e14'} {{(pid=82025) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 20:01:20.911337 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.notifications [None req-2a6d50ec-63e2-473d-bc21-edc1f5767e14 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5d10c0da391047199d35ffbbd0c54ca2', 'request_id': 'req-2a6d50ec-63e2-473d-bc21-edc1f5767e14'} {{(pid=82025) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 20:01:20.923010 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1b01c6c-2a75-4b81-8820-83ef063f0fa6 admin admin] Validating token access rules against request {{(pid=82026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 20:01:21.008341 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0eca1597-cdea-4297-a6db-396493d5d1d6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57539b6a6f3b4d589f5f5e1d211cd6a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b454f707d20347ada3d82aa85495635e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 20:01:21.008864 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eca1597-cdea-4297-a6db-396493d5d1d6 admin admin] REQUEST_METHOD: `PUT` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:01:21.009232 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eca1597-cdea-4297-a6db-396493d5d1d6 admin admin] SCRIPT_NAME: `/identity` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:01:21.009585 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eca1597-cdea-4297-a6db-396493d5d1d6 admin admin] PATH_INFO: `/v3/projects/5049bbcdf2d942a68baba660b2e37523/users/fb178ba38fea4064b5ef0b4c8bf92e2b/roles/3618ab638a65401f82333da7596d1daf` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:01:21.050147 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0eca1597-cdea-4297-a6db-396493d5d1d6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5049bbcdf2d942a68baba660b2e37523, user_id=fb178ba38fea4064b5ef0b4c8bf92e2b, role_id=3618ab638a65401f82333da7596d1daf)` {{(pid=82026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 20:01:21.051747 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.notifications [None req-2a6d50ec-63e2-473d-bc21-edc1f5767e14 admin admin] The token cache is being invalidate because project 5d10c0da391047199d35ffbbd0c54ca2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82025) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 13 20:01:21.052239 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.notifications [None req-2a6d50ec-63e2-473d-bc21-edc1f5767e14 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82025) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 20:01:21.052896 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0eca1597-cdea-4297-a6db-396493d5d1d6 admin admin] RBAC: Authorization granted {{(pid=82026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 20:01:21.053015 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.notifications [None req-2a6d50ec-63e2-473d-bc21-edc1f5767e14 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82025) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 20:01:21.059751 dv-cinder-828806-6-smb devstack@keystone.service[82025]: [pid: 82025|app: 0|req: 1021/2002] 10.222.0.33 () {58 vars in 1233 bytes} [Tue Sep 13 20:01:20 2022] DELETE /identity/v3/projects/5d10c0da391047199d35ffbbd0c54ca2 => generated 0 bytes in 353 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 20:01:21.059751 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a6d50ec-63e2-473d-bc21-edc1f5767e14 admin admin] Authenticating user token {{(pid=82025) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 20:01:21.062102 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.fernet_utils [None req-2a6d50ec-63e2-473d-bc21-edc1f5767e14 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82025) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 20:01:21.077700 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a6d50ec-63e2-473d-bc21-edc1f5767e14 admin admin] Validating token access rules against request {{(pid=82025) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 20:01:21.084349 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b40fc315-fedd-4392-acd5-38785656ce9b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57539b6a6f3b4d589f5f5e1d211cd6a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b454f707d20347ada3d82aa85495635e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82025) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 20:01:21.088082 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b40fc315-fedd-4392-acd5-38785656ce9b admin admin] REQUEST_METHOD: `POST` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:01:21.088082 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b40fc315-fedd-4392-acd5-38785656ce9b admin admin] SCRIPT_NAME: `/identity` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:01:21.088082 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b40fc315-fedd-4392-acd5-38785656ce9b admin admin] PATH_INFO: `/v3/users` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:01:21.088082 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b40fc315-fedd-4392-acd5-38785656ce9b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 20:01:21.089786 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b40fc315-fedd-4392-acd5-38785656ce9b admin admin] RBAC: Authorization granted {{(pid=82025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 20:01:21.145019 dv-cinder-828806-6-smb devstack@keystone.service[82026]: [pid: 82026|app: 0|req: 982/2003] 10.222.0.33 () {60 vars in 1483 bytes} [Tue Sep 13 20:01:20 2022] PUT /identity/v3/projects/5049bbcdf2d942a68baba660b2e37523/users/fb178ba38fea4064b5ef0b4c8bf92e2b/roles/3618ab638a65401f82333da7596d1daf => generated 0 bytes in 315 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 20:01:21.148551 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0eca1597-cdea-4297-a6db-396493d5d1d6 admin admin] Authenticating user token {{(pid=82026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 20:01:21.152698 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.common.fernet_utils [None req-0eca1597-cdea-4297-a6db-396493d5d1d6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82026) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 20:01:21.173065 dv-cinder-828806-6-smb devstack@keystone.service[82025]: [pid: 82025|app: 0|req: 1022/2004] 10.222.0.33 () {60 vars in 1144 bytes} [Tue Sep 13 20:01:21 2022] POST /identity/v3/users => generated 303 bytes in 115 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 13 20:01:21.175092 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85a00a68-8805-4786-96cc-dc04096dc3fb None None] REQUEST_METHOD: `POST` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:01:21.175092 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85a00a68-8805-4786-96cc-dc04096dc3fb None None] SCRIPT_NAME: `/identity` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:01:21.175092 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85a00a68-8805-4786-96cc-dc04096dc3fb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:01:21.197185 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.auth.core [None req-85a00a68-8805-4786-96cc-dc04096dc3fb None None] MFA Rules not processed for user `57539b6a6f3b4d589f5f5e1d211cd6a0`. Rule list: `[]` (Enabled: `True`). {{(pid=82025) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 20:01:21.199300 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.fernet_utils [None req-85a00a68-8805-4786-96cc-dc04096dc3fb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82025) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 20:01:21.255255 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0eca1597-cdea-4297-a6db-396493d5d1d6 admin admin] Validating token access rules against request {{(pid=82026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 20:01:21.260884 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe0130f7-6cdd-4214-b035-1cf2446147e3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57539b6a6f3b4d589f5f5e1d211cd6a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b454f707d20347ada3d82aa85495635e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 20:01:21.261536 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe0130f7-6cdd-4214-b035-1cf2446147e3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:01:21.261840 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe0130f7-6cdd-4214-b035-1cf2446147e3 admin admin] SCRIPT_NAME: `/identity` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:01:21.262106 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe0130f7-6cdd-4214-b035-1cf2446147e3 admin admin] PATH_INFO: `/v3/projects/4d82ac0477fc44baaf14cb6b3af5ceb1` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:01:21.263294 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe0130f7-6cdd-4214-b035-1cf2446147e3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=4d82ac0477fc44baaf14cb6b3af5ceb1)` {{(pid=82026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 20:01:21.265363 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe0130f7-6cdd-4214-b035-1cf2446147e3 admin admin] RBAC: Authorization granted {{(pid=82026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 20:01:21.266668 dv-cinder-828806-6-smb devstack@keystone.service[82025]: [pid: 82025|app: 0|req: 1023/2005] 10.222.0.33 () {58 vars in 958 bytes} [Tue Sep 13 20:01:21 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 20:01:21.267972 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64a417dc-206a-4837-971b-7519a734c44a None None] REQUEST_METHOD: `POST` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:01:21.268268 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64a417dc-206a-4837-971b-7519a734c44a None None] SCRIPT_NAME: `/identity` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:01:21.268548 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64a417dc-206a-4837-971b-7519a734c44a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:01:21.302967 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.auth.core [None req-64a417dc-206a-4837-971b-7519a734c44a None None] MFA Rules not processed for user `fb178ba38fea4064b5ef0b4c8bf92e2b`. Rule list: `[]` (Enabled: `True`). {{(pid=82025) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 20:01:21.304385 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.fernet_utils [None req-64a417dc-206a-4837-971b-7519a734c44a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82025) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 20:01:21.371704 dv-cinder-828806-6-smb devstack@keystone.service[82025]: [pid: 82025|app: 0|req: 1024/2006] 10.222.0.33 () {58 vars in 958 bytes} [Tue Sep 13 20:01:21 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 20:01:21.372564 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64a417dc-206a-4837-971b-7519a734c44a None None] Authenticating user token {{(pid=82025) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 20:01:21.383301 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64a417dc-206a-4837-971b-7519a734c44a None None] Validating token access rules against request {{(pid=82025) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 20:01:21.389432 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64ccc31b-1737-4c1f-b3fe-997b805973f0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57539b6a6f3b4d589f5f5e1d211cd6a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b454f707d20347ada3d82aa85495635e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82025) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 20:01:21.390647 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64ccc31b-1737-4c1f-b3fe-997b805973f0 admin admin] REQUEST_METHOD: `GET` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:01:21.390987 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64ccc31b-1737-4c1f-b3fe-997b805973f0 admin admin] SCRIPT_NAME: `/identity` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:01:21.391327 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64ccc31b-1737-4c1f-b3fe-997b805973f0 admin admin] PATH_INFO: `/v3/roles` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:01:21.391975 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64ccc31b-1737-4c1f-b3fe-997b805973f0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 20:01:21.393572 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64ccc31b-1737-4c1f-b3fe-997b805973f0 admin admin] RBAC: Authorization granted {{(pid=82025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 20:01:21.399913 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.notifications [None req-fe0130f7-6cdd-4214-b035-1cf2446147e3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4d82ac0477fc44baaf14cb6b3af5ceb1', 'request_id': 'req-fe0130f7-6cdd-4214-b035-1cf2446147e3'} {{(pid=82026) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 20:01:21.408047 dv-cinder-828806-6-smb devstack@keystone.service[82025]: [pid: 82025|app: 0|req: 1025/2007] 10.222.0.33 () {58 vars in 1122 bytes} [Tue Sep 13 20:01:21 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 13 20:01:21.408047 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb68191f-6c75-4360-9bdb-0ab3aed58950 None None] REQUEST_METHOD: `POST` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:01:21.408047 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb68191f-6c75-4360-9bdb-0ab3aed58950 None None] SCRIPT_NAME: `/identity` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:01:21.408047 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb68191f-6c75-4360-9bdb-0ab3aed58950 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:01:21.427559 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.auth.core [None req-cb68191f-6c75-4360-9bdb-0ab3aed58950 None None] MFA Rules not processed for user `57539b6a6f3b4d589f5f5e1d211cd6a0`. Rule list: `[]` (Enabled: `True`). {{(pid=82025) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 20:01:21.428783 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.fernet_utils [None req-cb68191f-6c75-4360-9bdb-0ab3aed58950 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82025) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 20:01:21.497230 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.notifications [None req-fe0130f7-6cdd-4214-b035-1cf2446147e3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4d82ac0477fc44baaf14cb6b3af5ceb1', 'request_id': 'req-fe0130f7-6cdd-4214-b035-1cf2446147e3'} {{(pid=82026) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 20:01:21.507530 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.notifications [None req-fe0130f7-6cdd-4214-b035-1cf2446147e3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4d82ac0477fc44baaf14cb6b3af5ceb1', 'request_id': 'req-fe0130f7-6cdd-4214-b035-1cf2446147e3'} {{(pid=82026) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 20:01:21.514300 dv-cinder-828806-6-smb devstack@keystone.service[82025]: [pid: 82025|app: 0|req: 1026/2008] 10.222.0.33 () {58 vars in 958 bytes} [Tue Sep 13 20:01:21 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 20:01:21.515827 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb68191f-6c75-4360-9bdb-0ab3aed58950 None None] Authenticating user token {{(pid=82025) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 20:01:21.517620 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.fernet_utils [None req-cb68191f-6c75-4360-9bdb-0ab3aed58950 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82025) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 20:01:21.521928 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.notifications [None req-fe0130f7-6cdd-4214-b035-1cf2446147e3 admin admin] The token cache is being invalidate because project 4d82ac0477fc44baaf14cb6b3af5ceb1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82026) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 13 20:01:21.527842 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.notifications [None req-fe0130f7-6cdd-4214-b035-1cf2446147e3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82026) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 20:01:21.531719 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.notifications [None req-fe0130f7-6cdd-4214-b035-1cf2446147e3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82026) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 20:01:21.533927 dv-cinder-828806-6-smb devstack@keystone.service[82026]: [pid: 82026|app: 0|req: 983/2009] 10.222.0.33 () {58 vars in 1233 bytes} [Tue Sep 13 20:01:21 2022] DELETE /identity/v3/projects/4d82ac0477fc44baaf14cb6b3af5ceb1 => generated 0 bytes in 388 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 20:01:21.534344 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb68191f-6c75-4360-9bdb-0ab3aed58950 None None] Validating token access rules against request {{(pid=82025) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 20:01:21.534766 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe0130f7-6cdd-4214-b035-1cf2446147e3 admin admin] Authenticating user token {{(pid=82026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 20:01:21.536448 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.common.fernet_utils [None req-fe0130f7-6cdd-4214-b035-1cf2446147e3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82026) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 20:01:21.541776 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-895d2253-e361-49de-bf4a-829dfb40936b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57539b6a6f3b4d589f5f5e1d211cd6a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b454f707d20347ada3d82aa85495635e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82025) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 20:01:21.542565 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-895d2253-e361-49de-bf4a-829dfb40936b admin admin] REQUEST_METHOD: `POST` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:01:21.543094 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-895d2253-e361-49de-bf4a-829dfb40936b admin admin] SCRIPT_NAME: `/identity` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:01:21.543463 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-895d2253-e361-49de-bf4a-829dfb40936b admin admin] PATH_INFO: `/v3/projects` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:01:21.544424 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-895d2253-e361-49de-bf4a-829dfb40936b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 20:01:21.548148 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-895d2253-e361-49de-bf4a-829dfb40936b admin admin] RBAC: Authorization granted {{(pid=82025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 20:01:21.552340 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe0130f7-6cdd-4214-b035-1cf2446147e3 admin admin] Validating token access rules against request {{(pid=82026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 20:01:21.567565 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8a9362c-67bb-4dc7-ae87-93c0edc04355 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57539b6a6f3b4d589f5f5e1d211cd6a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b454f707d20347ada3d82aa85495635e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 20:01:21.568465 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8a9362c-67bb-4dc7-ae87-93c0edc04355 admin admin] REQUEST_METHOD: `PUT` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:01:21.568824 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8a9362c-67bb-4dc7-ae87-93c0edc04355 admin admin] SCRIPT_NAME: `/identity` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:01:21.569182 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8a9362c-67bb-4dc7-ae87-93c0edc04355 admin admin] PATH_INFO: `/v3/projects/342192aefb3f479db131502f3a72d6df/users/d92f7a1c19344327b9023f4230840172/roles/e5af7d5baa93469e9e486ef21c85474e` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:01:21.593096 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8a9362c-67bb-4dc7-ae87-93c0edc04355 admin admin] RBAC: Authorizing `identity:create_grant(project_id=342192aefb3f479db131502f3a72d6df, user_id=d92f7a1c19344327b9023f4230840172, role_id=e5af7d5baa93469e9e486ef21c85474e)` {{(pid=82026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 20:01:21.596524 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8a9362c-67bb-4dc7-ae87-93c0edc04355 admin admin] RBAC: Authorization granted {{(pid=82026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 20:01:21.686863 dv-cinder-828806-6-smb devstack@keystone.service[82025]: [pid: 82025|app: 0|req: 1027/2010] 10.222.0.33 () {60 vars in 1153 bytes} [Tue Sep 13 20:01:21 2022] POST /identity/v3/projects => generated 389 bytes in 172 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 13 20:01:21.687820 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-895d2253-e361-49de-bf4a-829dfb40936b admin admin] Authenticating user token {{(pid=82025) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 20:01:21.691122 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.fernet_utils [None req-895d2253-e361-49de-bf4a-829dfb40936b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82025) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 20:01:21.694217 dv-cinder-828806-6-smb devstack@keystone.service[82026]: [pid: 82026|app: 0|req: 984/2011] 10.222.0.33 () {60 vars in 1483 bytes} [Tue Sep 13 20:01:21 2022] PUT /identity/v3/projects/342192aefb3f479db131502f3a72d6df/users/d92f7a1c19344327b9023f4230840172/roles/e5af7d5baa93469e9e486ef21c85474e => generated 0 bytes in 160 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 20:01:21.694886 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8a9362c-67bb-4dc7-ae87-93c0edc04355 admin admin] Authenticating user token {{(pid=82026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 20:01:21.697099 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.common.fernet_utils [None req-a8a9362c-67bb-4dc7-ae87-93c0edc04355 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82026) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 20:01:21.776489 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-895d2253-e361-49de-bf4a-829dfb40936b admin admin] Validating token access rules against request {{(pid=82025) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 20:01:21.782465 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb6e4312-4a80-43fe-9018-1eedf96676f9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57539b6a6f3b4d589f5f5e1d211cd6a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b454f707d20347ada3d82aa85495635e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82025) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 20:01:21.783132 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb6e4312-4a80-43fe-9018-1eedf96676f9 admin admin] REQUEST_METHOD: `GET` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:01:21.783488 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb6e4312-4a80-43fe-9018-1eedf96676f9 admin admin] SCRIPT_NAME: `/identity` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:01:21.783771 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb6e4312-4a80-43fe-9018-1eedf96676f9 admin admin] PATH_INFO: `/v3/domains` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:01:21.785798 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb6e4312-4a80-43fe-9018-1eedf96676f9 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82025) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 20:01:21.785798 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb6e4312-4a80-43fe-9018-1eedf96676f9 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 20:01:21.787207 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb6e4312-4a80-43fe-9018-1eedf96676f9 admin admin] RBAC: Authorization granted {{(pid=82025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 20:01:21.790133 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8a9362c-67bb-4dc7-ae87-93c0edc04355 admin admin] Validating token access rules against request {{(pid=82026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 20:01:21.796377 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99ff8078-a11d-4eab-8771-e6327335361d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57539b6a6f3b4d589f5f5e1d211cd6a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b454f707d20347ada3d82aa85495635e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 20:01:21.797032 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99ff8078-a11d-4eab-8771-e6327335361d admin admin] REQUEST_METHOD: `DELETE` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:01:21.797829 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99ff8078-a11d-4eab-8771-e6327335361d admin admin] SCRIPT_NAME: `/identity` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:01:21.798328 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99ff8078-a11d-4eab-8771-e6327335361d admin admin] PATH_INFO: `/v3/users/5bb6510faaab445e8b70834d65ea2941` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:01:21.799596 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99ff8078-a11d-4eab-8771-e6327335361d admin admin] RBAC: Authorizing `identity:delete_user(user_id=5bb6510faaab445e8b70834d65ea2941)` {{(pid=82026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 20:01:21.804319 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99ff8078-a11d-4eab-8771-e6327335361d admin admin] RBAC: Authorization granted {{(pid=82026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 20:01:21.805332 dv-cinder-828806-6-smb devstack@keystone.service[82025]: [pid: 82025|app: 0|req: 1028/2012] 10.222.0.33 () {58 vars in 1153 bytes} [Tue Sep 13 20:01:21 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 118 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 20:01:21.808309 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb6e4312-4a80-43fe-9018-1eedf96676f9 admin admin] Authenticating user token {{(pid=82025) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 20:01:21.810333 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.fernet_utils [None req-bb6e4312-4a80-43fe-9018-1eedf96676f9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82025) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 20:01:21.825236 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb6e4312-4a80-43fe-9018-1eedf96676f9 admin admin] Validating token access rules against request {{(pid=82025) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 20:01:21.830312 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6dc8bc8-a54d-4730-9b6c-51592e967862 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57539b6a6f3b4d589f5f5e1d211cd6a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b454f707d20347ada3d82aa85495635e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82025) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 20:01:21.831172 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6dc8bc8-a54d-4730-9b6c-51592e967862 admin admin] REQUEST_METHOD: `POST` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:01:21.832004 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6dc8bc8-a54d-4730-9b6c-51592e967862 admin admin] SCRIPT_NAME: `/identity` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:01:21.832783 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6dc8bc8-a54d-4730-9b6c-51592e967862 admin admin] PATH_INFO: `/v3/users` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:01:21.833943 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6dc8bc8-a54d-4730-9b6c-51592e967862 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 20:01:21.835705 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG dbcounter [-] [82025] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=82025) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 20:01:21.839214 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6dc8bc8-a54d-4730-9b6c-51592e967862 admin admin] RBAC: Authorization granted {{(pid=82025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 20:01:21.982436 dv-cinder-828806-6-smb devstack@keystone.service[82025]: [pid: 82025|app: 0|req: 1029/2013] 10.222.0.33 () {60 vars in 1144 bytes} [Tue Sep 13 20:01:21 2022] POST /identity/v3/users => generated 301 bytes in 176 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 13 20:01:21.983289 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6dc8bc8-a54d-4730-9b6c-51592e967862 admin admin] Authenticating user token {{(pid=82025) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 20:01:22.009684 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6dc8bc8-a54d-4730-9b6c-51592e967862 admin admin] Validating token access rules against request {{(pid=82025) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 20:01:22.017763 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97ab6230-1302-494a-b3a3-4246b59d28d9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57539b6a6f3b4d589f5f5e1d211cd6a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b454f707d20347ada3d82aa85495635e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82025) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 20:01:22.018778 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97ab6230-1302-494a-b3a3-4246b59d28d9 admin admin] REQUEST_METHOD: `GET` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:01:22.018977 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97ab6230-1302-494a-b3a3-4246b59d28d9 admin admin] SCRIPT_NAME: `/identity` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:01:22.019303 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97ab6230-1302-494a-b3a3-4246b59d28d9 admin admin] PATH_INFO: `/v3/roles` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:01:22.020445 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97ab6230-1302-494a-b3a3-4246b59d28d9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 20:01:22.022692 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97ab6230-1302-494a-b3a3-4246b59d28d9 admin admin] RBAC: Authorization granted {{(pid=82025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 20:01:22.038997 dv-cinder-828806-6-smb devstack@keystone.service[82025]: [pid: 82025|app: 0|req: 1030/2014] 10.222.0.33 () {58 vars in 1122 bytes} [Tue Sep 13 20:01:21 2022] GET /identity/v3/roles => generated 1420 bytes in 56 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 13 20:01:22.040771 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97ab6230-1302-494a-b3a3-4246b59d28d9 admin admin] Authenticating user token {{(pid=82025) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 20:01:22.051243 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.notifications [None req-99ff8078-a11d-4eab-8771-e6327335361d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5bb6510faaab445e8b70834d65ea2941'} {{(pid=82026) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 20:01:22.054679 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97ab6230-1302-494a-b3a3-4246b59d28d9 admin admin] Validating token access rules against request {{(pid=82025) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 20:01:22.061449 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff4d5545-da2a-4c90-a16d-654552e6f7d4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57539b6a6f3b4d589f5f5e1d211cd6a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b454f707d20347ada3d82aa85495635e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82025) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 20:01:22.062062 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff4d5545-da2a-4c90-a16d-654552e6f7d4 admin admin] REQUEST_METHOD: `POST` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:01:22.062381 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff4d5545-da2a-4c90-a16d-654552e6f7d4 admin admin] SCRIPT_NAME: `/identity` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:01:22.062618 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff4d5545-da2a-4c90-a16d-654552e6f7d4 admin admin] PATH_INFO: `/v3/projects` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:01:22.064811 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff4d5545-da2a-4c90-a16d-654552e6f7d4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 20:01:22.065229 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff4d5545-da2a-4c90-a16d-654552e6f7d4 admin admin] RBAC: Authorization granted {{(pid=82025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 20:01:22.176907 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.notifications [None req-99ff8078-a11d-4eab-8771-e6327335361d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5bb6510faaab445e8b70834d65ea2941'} {{(pid=82026) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 20:01:22.184898 dv-cinder-828806-6-smb devstack@keystone.service[82025]: [pid: 82025|app: 0|req: 1031/2015] 10.222.0.33 () {60 vars in 1153 bytes} [Tue Sep 13 20:01:22 2022] POST /identity/v3/projects => generated 371 bytes in 145 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 13 20:01:22.185755 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff4d5545-da2a-4c90-a16d-654552e6f7d4 admin admin] Authenticating user token {{(pid=82025) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 20:01:22.199215 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.notifications [None req-99ff8078-a11d-4eab-8771-e6327335361d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5bb6510faaab445e8b70834d65ea2941'} {{(pid=82026) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 20:01:22.200332 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.notifications [None req-99ff8078-a11d-4eab-8771-e6327335361d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5bb6510faaab445e8b70834d65ea2941'} {{(pid=82026) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 20:01:22.214694 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.notifications [None req-99ff8078-a11d-4eab-8771-e6327335361d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5bb6510faaab445e8b70834d65ea2941'} {{(pid=82026) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 20:01:22.221976 dv-cinder-828806-6-smb devstack@keystone.service[82026]: [pid: 82026|app: 0|req: 985/2016] 10.222.0.33 () {58 vars in 1224 bytes} [Tue Sep 13 20:01:21 2022] DELETE /identity/v3/users/5bb6510faaab445e8b70834d65ea2941 => generated 0 bytes in 527 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 20:01:22.222981 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99ff8078-a11d-4eab-8771-e6327335361d admin admin] Authenticating user token {{(pid=82026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 20:01:22.224881 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.common.fernet_utils [None req-99ff8078-a11d-4eab-8771-e6327335361d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82026) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 20:01:22.268843 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG dbcounter [-] [82026] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82026) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 20:01:22.326628 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff4d5545-da2a-4c90-a16d-654552e6f7d4 admin admin] Validating token access rules against request {{(pid=82025) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 20:01:22.411856 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99ff8078-a11d-4eab-8771-e6327335361d admin admin] Validating token access rules against request {{(pid=82026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 20:01:22.415420 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fd8fb23-6577-4edb-8f1c-bc0e30cd8915 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57539b6a6f3b4d589f5f5e1d211cd6a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b454f707d20347ada3d82aa85495635e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82025) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 20:01:22.416271 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fd8fb23-6577-4edb-8f1c-bc0e30cd8915 admin admin] REQUEST_METHOD: `GET` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:01:22.416831 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fd8fb23-6577-4edb-8f1c-bc0e30cd8915 admin admin] SCRIPT_NAME: `/identity` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:01:22.419616 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8de2d170-2e56-4309-aef6-ed03e6f3ba28 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57539b6a6f3b4d589f5f5e1d211cd6a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b454f707d20347ada3d82aa85495635e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 20:01:22.419758 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fd8fb23-6577-4edb-8f1c-bc0e30cd8915 admin admin] PATH_INFO: `/v3/roles` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:01:22.419758 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fd8fb23-6577-4edb-8f1c-bc0e30cd8915 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 20:01:22.419924 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8de2d170-2e56-4309-aef6-ed03e6f3ba28 admin admin] REQUEST_METHOD: `PUT` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:01:22.419924 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8de2d170-2e56-4309-aef6-ed03e6f3ba28 admin admin] SCRIPT_NAME: `/identity` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:01:22.419924 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8de2d170-2e56-4309-aef6-ed03e6f3ba28 admin admin] PATH_INFO: `/v3/projects/342192aefb3f479db131502f3a72d6df/users/d92f7a1c19344327b9023f4230840172/roles/e5af7d5baa93469e9e486ef21c85474e` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:01:22.420948 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fd8fb23-6577-4edb-8f1c-bc0e30cd8915 admin admin] RBAC: Authorization granted {{(pid=82025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 20:01:22.421373 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8de2d170-2e56-4309-aef6-ed03e6f3ba28 admin admin] RBAC: Authorizing `identity:create_grant(project_id=342192aefb3f479db131502f3a72d6df, user_id=d92f7a1c19344327b9023f4230840172, role_id=e5af7d5baa93469e9e486ef21c85474e)` {{(pid=82026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 20:01:22.425442 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8de2d170-2e56-4309-aef6-ed03e6f3ba28 admin admin] RBAC: Authorization granted {{(pid=82026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 20:01:22.434422 dv-cinder-828806-6-smb devstack@keystone.service[82025]: [pid: 82025|app: 0|req: 1032/2017] 10.222.0.33 () {58 vars in 1122 bytes} [Tue Sep 13 20:01:22 2022] GET /identity/v3/roles => generated 1420 bytes in 249 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 13 20:01:22.435364 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fd8fb23-6577-4edb-8f1c-bc0e30cd8915 admin admin] Authenticating user token {{(pid=82025) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 20:01:22.437392 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.fernet_utils [None req-6fd8fb23-6577-4edb-8f1c-bc0e30cd8915 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82025) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 20:01:22.439418 dv-cinder-828806-6-smb devstack@keystone.service[82026]: [pid: 82026|app: 0|req: 986/2018] 10.222.0.33 () {60 vars in 1483 bytes} [Tue Sep 13 20:01:22 2022] PUT /identity/v3/projects/342192aefb3f479db131502f3a72d6df/users/d92f7a1c19344327b9023f4230840172/roles/e5af7d5baa93469e9e486ef21c85474e => generated 0 bytes in 217 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 20:01:22.441228 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8de2d170-2e56-4309-aef6-ed03e6f3ba28 admin admin] Authenticating user token {{(pid=82026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 20:01:22.452304 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.common.fernet_utils [None req-8de2d170-2e56-4309-aef6-ed03e6f3ba28 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82026) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 20:01:22.461157 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fd8fb23-6577-4edb-8f1c-bc0e30cd8915 admin admin] Validating token access rules against request {{(pid=82025) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 20:01:22.530220 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ec9a598-757f-4ed9-84a3-4e5fc0f1f261 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57539b6a6f3b4d589f5f5e1d211cd6a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b454f707d20347ada3d82aa85495635e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82025) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 20:01:22.531378 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ec9a598-757f-4ed9-84a3-4e5fc0f1f261 admin admin] REQUEST_METHOD: `POST` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:01:22.531378 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ec9a598-757f-4ed9-84a3-4e5fc0f1f261 admin admin] SCRIPT_NAME: `/identity` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:01:22.531557 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ec9a598-757f-4ed9-84a3-4e5fc0f1f261 admin admin] PATH_INFO: `/v3/users` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:01:22.532432 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ec9a598-757f-4ed9-84a3-4e5fc0f1f261 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 20:01:22.534179 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ec9a598-757f-4ed9-84a3-4e5fc0f1f261 admin admin] RBAC: Authorization granted {{(pid=82025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 20:01:22.542688 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8de2d170-2e56-4309-aef6-ed03e6f3ba28 admin admin] Validating token access rules against request {{(pid=82026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 20:01:22.553165 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c410719e-2377-4558-a73a-679f25240de1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57539b6a6f3b4d589f5f5e1d211cd6a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b454f707d20347ada3d82aa85495635e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 20:01:22.553904 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c410719e-2377-4558-a73a-679f25240de1 admin admin] REQUEST_METHOD: `PUT` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:01:22.554136 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c410719e-2377-4558-a73a-679f25240de1 admin admin] SCRIPT_NAME: `/identity` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:01:22.554412 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c410719e-2377-4558-a73a-679f25240de1 admin admin] PATH_INFO: `/v3/projects/a1768fa099c14eb09404bf06d352a5fa/users/b0ba3d67e9f64d25937bf0cec35f304a/roles/e5af7d5baa93469e9e486ef21c85474e` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:01:22.570750 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c410719e-2377-4558-a73a-679f25240de1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a1768fa099c14eb09404bf06d352a5fa, user_id=b0ba3d67e9f64d25937bf0cec35f304a, role_id=e5af7d5baa93469e9e486ef21c85474e)` {{(pid=82026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 20:01:22.574379 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c410719e-2377-4558-a73a-679f25240de1 admin admin] RBAC: Authorization granted {{(pid=82026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 20:01:22.661438 dv-cinder-828806-6-smb devstack@keystone.service[82025]: [pid: 82025|app: 0|req: 1033/2019] 10.222.0.33 () {60 vars in 1144 bytes} [Tue Sep 13 20:01:22 2022] POST /identity/v3/users => generated 286 bytes in 226 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 13 20:01:22.662681 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb9e0321-4767-45ed-a6b6-6826ad913a47 None None] REQUEST_METHOD: `POST` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:01:22.662914 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb9e0321-4767-45ed-a6b6-6826ad913a47 None None] SCRIPT_NAME: `/identity` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:01:22.663215 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb9e0321-4767-45ed-a6b6-6826ad913a47 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:01:22.673030 dv-cinder-828806-6-smb devstack@keystone.service[82026]: [pid: 82026|app: 0|req: 987/2020] 10.222.0.33 () {60 vars in 1483 bytes} [Tue Sep 13 20:01:22 2022] PUT /identity/v3/projects/a1768fa099c14eb09404bf06d352a5fa/users/b0ba3d67e9f64d25937bf0cec35f304a/roles/e5af7d5baa93469e9e486ef21c85474e => generated 0 bytes in 233 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 20:01:22.674685 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c410719e-2377-4558-a73a-679f25240de1 admin admin] Authenticating user token {{(pid=82026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 20:01:22.699931 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.auth.core [None req-cb9e0321-4767-45ed-a6b6-6826ad913a47 None None] MFA Rules not processed for user `d92f7a1c19344327b9023f4230840172`. Rule list: `[]` (Enabled: `True`). {{(pid=82025) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 20:01:22.701173 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.fernet_utils [None req-cb9e0321-4767-45ed-a6b6-6826ad913a47 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82025) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 20:01:22.772300 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c410719e-2377-4558-a73a-679f25240de1 admin admin] Validating token access rules against request {{(pid=82026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 20:01:22.778200 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd098185-d03c-434e-aea0-cf6f4ff6f903 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57539b6a6f3b4d589f5f5e1d211cd6a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b454f707d20347ada3d82aa85495635e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 20:01:22.778914 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd098185-d03c-434e-aea0-cf6f4ff6f903 admin admin] REQUEST_METHOD: `GET` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:01:22.779137 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd098185-d03c-434e-aea0-cf6f4ff6f903 admin admin] SCRIPT_NAME: `/identity` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:01:22.779405 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd098185-d03c-434e-aea0-cf6f4ff6f903 admin admin] PATH_INFO: `/v3/roles` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:01:22.780650 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd098185-d03c-434e-aea0-cf6f4ff6f903 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 20:01:22.782191 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd098185-d03c-434e-aea0-cf6f4ff6f903 admin admin] RBAC: Authorization granted {{(pid=82026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 20:01:22.793451 dv-cinder-828806-6-smb devstack@keystone.service[82026]: [pid: 82026|app: 0|req: 988/2021] 10.222.0.33 () {58 vars in 1122 bytes} [Tue Sep 13 20:01:22 2022] GET /identity/v3/roles => generated 1420 bytes in 119 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 13 20:01:22.797661 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd098185-d03c-434e-aea0-cf6f4ff6f903 admin admin] Authenticating user token {{(pid=82026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 20:01:22.809627 dv-cinder-828806-6-smb devstack@keystone.service[82025]: [pid: 82025|app: 0|req: 1034/2022] 10.222.0.33 () {58 vars in 958 bytes} [Tue Sep 13 20:01:22 2022] POST /identity/v3/auth/tokens => generated 3337 bytes in 144 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 20:01:22.809627 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb9e0321-4767-45ed-a6b6-6826ad913a47 None None] Authenticating user token {{(pid=82025) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 20:01:22.816258 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd098185-d03c-434e-aea0-cf6f4ff6f903 admin admin] Validating token access rules against request {{(pid=82026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 20:01:22.823948 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0233731-49a9-4398-ba66-2222ae73236b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57539b6a6f3b4d589f5f5e1d211cd6a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b454f707d20347ada3d82aa85495635e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 20:01:22.824113 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb9e0321-4767-45ed-a6b6-6826ad913a47 None None] Validating token access rules against request {{(pid=82025) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 20:01:22.827580 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0233731-49a9-4398-ba66-2222ae73236b admin admin] REQUEST_METHOD: `GET` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:01:22.828059 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0233731-49a9-4398-ba66-2222ae73236b admin admin] SCRIPT_NAME: `/identity` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:01:22.828569 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0233731-49a9-4398-ba66-2222ae73236b admin admin] PATH_INFO: `/v3/roles` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:01:22.829508 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ac7008c-c197-46b4-9dd6-70fffc69f11d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57539b6a6f3b4d589f5f5e1d211cd6a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b454f707d20347ada3d82aa85495635e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82025) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 20:01:22.829723 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0233731-49a9-4398-ba66-2222ae73236b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 20:01:22.830382 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ac7008c-c197-46b4-9dd6-70fffc69f11d admin admin] REQUEST_METHOD: `GET` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:01:22.830740 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ac7008c-c197-46b4-9dd6-70fffc69f11d admin admin] SCRIPT_NAME: `/identity` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:01:22.831208 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ac7008c-c197-46b4-9dd6-70fffc69f11d admin admin] PATH_INFO: `/v3/roles` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:01:22.831942 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ac7008c-c197-46b4-9dd6-70fffc69f11d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 20:01:22.832194 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0233731-49a9-4398-ba66-2222ae73236b admin admin] RBAC: Authorization granted {{(pid=82026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 20:01:22.833963 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ac7008c-c197-46b4-9dd6-70fffc69f11d admin admin] RBAC: Authorization granted {{(pid=82025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 20:01:22.848977 dv-cinder-828806-6-smb devstack@keystone.service[82025]: [pid: 82025|app: 0|req: 1035/2023] 10.222.0.33 () {58 vars in 1122 bytes} [Tue Sep 13 20:01:22 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 13 20:01:22.848977 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ac7008c-c197-46b4-9dd6-70fffc69f11d admin admin] Authenticating user token {{(pid=82025) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 20:01:22.849784 dv-cinder-828806-6-smb devstack@keystone.service[82026]: [pid: 82026|app: 0|req: 989/2024] 10.222.0.33 () {58 vars in 1122 bytes} [Tue Sep 13 20:01:22 2022] GET /identity/v3/roles => generated 1420 bytes in 56 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 13 20:01:22.850672 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0233731-49a9-4398-ba66-2222ae73236b admin admin] Authenticating user token {{(pid=82026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 20:01:22.851015 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.fernet_utils [None req-3ac7008c-c197-46b4-9dd6-70fffc69f11d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82025) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 20:01:22.864930 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0233731-49a9-4398-ba66-2222ae73236b admin admin] Validating token access rules against request {{(pid=82026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 20:01:22.876955 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-664f50d9-d365-4016-b3fc-6dbeea23197a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57539b6a6f3b4d589f5f5e1d211cd6a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b454f707d20347ada3d82aa85495635e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 20:01:22.877652 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-664f50d9-d365-4016-b3fc-6dbeea23197a admin admin] REQUEST_METHOD: `PUT` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:01:22.877974 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-664f50d9-d365-4016-b3fc-6dbeea23197a admin admin] SCRIPT_NAME: `/identity` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:01:22.878238 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-664f50d9-d365-4016-b3fc-6dbeea23197a admin admin] PATH_INFO: `/v3/projects/b5f31b084b5249bcb15ec058f197a34d/users/f7fe350038004b5eab440484062948b6/roles/3618ab638a65401f82333da7596d1daf` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:01:22.898527 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-664f50d9-d365-4016-b3fc-6dbeea23197a admin admin] RBAC: Authorizing `identity:create_grant(project_id=b5f31b084b5249bcb15ec058f197a34d, user_id=f7fe350038004b5eab440484062948b6, role_id=3618ab638a65401f82333da7596d1daf)` {{(pid=82026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 20:01:22.902595 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-664f50d9-d365-4016-b3fc-6dbeea23197a admin admin] RBAC: Authorization granted {{(pid=82026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 20:01:22.932253 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ac7008c-c197-46b4-9dd6-70fffc69f11d admin admin] Validating token access rules against request {{(pid=82025) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 20:01:22.935995 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fd5a1f8-4754-4112-a447-3e000c9f96cc service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46024fc6167f4321818b1bed27a521a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8c6fba0f15b4d6a84ff601919b7b8e4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82025) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 20:01:22.936604 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fd5a1f8-4754-4112-a447-3e000c9f96cc service cinder] REQUEST_METHOD: `GET` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:01:22.936889 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fd5a1f8-4754-4112-a447-3e000c9f96cc service cinder] SCRIPT_NAME: `/identity` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:01:22.937166 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fd5a1f8-4754-4112-a447-3e000c9f96cc service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:01:22.946284 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fd5a1f8-4754-4112-a447-3e000c9f96cc service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=82025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 20:01:22.950500 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fd5a1f8-4754-4112-a447-3e000c9f96cc service cinder] RBAC: Authorization granted {{(pid=82025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 20:01:22.958073 dv-cinder-828806-6-smb devstack@keystone.service[82025]: [pid: 82025|app: 0|req: 1036/2025] 10.222.0.33 () {60 vars in 1365 bytes} [Tue Sep 13 20:01:22 2022] GET /identity/v3/auth/tokens => generated 3337 bytes in 112 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 20:01:22.958826 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fd5a1f8-4754-4112-a447-3e000c9f96cc service cinder] Authenticating user token {{(pid=82025) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 20:01:22.969587 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fd5a1f8-4754-4112-a447-3e000c9f96cc service cinder] Validating token access rules against request {{(pid=82025) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 20:01:22.975448 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abf08ea9-ad90-4963-a0e8-aba5ca86c28b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57539b6a6f3b4d589f5f5e1d211cd6a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b454f707d20347ada3d82aa85495635e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82025) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 20:01:22.976330 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abf08ea9-ad90-4963-a0e8-aba5ca86c28b admin admin] REQUEST_METHOD: `PUT` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:01:22.977183 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abf08ea9-ad90-4963-a0e8-aba5ca86c28b admin admin] SCRIPT_NAME: `/identity` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:01:22.977403 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abf08ea9-ad90-4963-a0e8-aba5ca86c28b admin admin] PATH_INFO: `/v3/projects/a1768fa099c14eb09404bf06d352a5fa/users/b0ba3d67e9f64d25937bf0cec35f304a/roles/e5af7d5baa93469e9e486ef21c85474e` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:01:22.979526 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abf08ea9-ad90-4963-a0e8-aba5ca86c28b admin admin] RBAC: Authorizing `identity:create_grant(project_id=a1768fa099c14eb09404bf06d352a5fa, user_id=b0ba3d67e9f64d25937bf0cec35f304a, role_id=e5af7d5baa93469e9e486ef21c85474e)` {{(pid=82025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 20:01:22.982187 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abf08ea9-ad90-4963-a0e8-aba5ca86c28b admin admin] RBAC: Authorization granted {{(pid=82025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 20:01:23.010589 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG dbcounter [-] [82025] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=82025) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 20:01:23.023751 dv-cinder-828806-6-smb devstack@keystone.service[82025]: [pid: 82025|app: 0|req: 1037/2027] 10.222.0.33 () {60 vars in 1483 bytes} [Tue Sep 13 20:01:22 2022] PUT /identity/v3/projects/a1768fa099c14eb09404bf06d352a5fa/users/b0ba3d67e9f64d25937bf0cec35f304a/roles/e5af7d5baa93469e9e486ef21c85474e => generated 0 bytes in 55 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 20:01:23.024707 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abf08ea9-ad90-4963-a0e8-aba5ca86c28b admin admin] Authenticating user token {{(pid=82025) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 20:01:23.027174 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.fernet_utils [None req-abf08ea9-ad90-4963-a0e8-aba5ca86c28b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82025) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 20:01:23.038639 dv-cinder-828806-6-smb devstack@keystone.service[82026]: [pid: 82026|app: 0|req: 990/2027] 10.222.0.33 () {60 vars in 1483 bytes} [Tue Sep 13 20:01:22 2022] PUT /identity/v3/projects/b5f31b084b5249bcb15ec058f197a34d/users/f7fe350038004b5eab440484062948b6/roles/3618ab638a65401f82333da7596d1daf => generated 0 bytes in 173 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 20:01:23.039716 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-664f50d9-d365-4016-b3fc-6dbeea23197a admin admin] Authenticating user token {{(pid=82026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 20:01:23.047406 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.common.fernet_utils [None req-664f50d9-d365-4016-b3fc-6dbeea23197a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82026) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 20:01:23.118824 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abf08ea9-ad90-4963-a0e8-aba5ca86c28b admin admin] Validating token access rules against request {{(pid=82025) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 20:01:23.133163 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-664f50d9-d365-4016-b3fc-6dbeea23197a admin admin] Validating token access rules against request {{(pid=82026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 20:01:23.139774 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b29e896-3796-48ad-aa56-0977a48c1a38 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46024fc6167f4321818b1bed27a521a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8c6fba0f15b4d6a84ff601919b7b8e4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 20:01:23.141010 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b29e896-3796-48ad-aa56-0977a48c1a38 service cinder] REQUEST_METHOD: `GET` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:01:23.141302 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b29e896-3796-48ad-aa56-0977a48c1a38 service cinder] SCRIPT_NAME: `/identity` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:01:23.141588 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b29e896-3796-48ad-aa56-0977a48c1a38 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:01:23.143471 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.common.fernet_utils [None req-3b29e896-3796-48ad-aa56-0977a48c1a38 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82026) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 20:01:23.195506 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12da6db5-e899-41ca-96f3-fe953e645f82 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57539b6a6f3b4d589f5f5e1d211cd6a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b454f707d20347ada3d82aa85495635e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82025) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 20:01:23.199411 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12da6db5-e899-41ca-96f3-fe953e645f82 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:01:23.199779 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12da6db5-e899-41ca-96f3-fe953e645f82 admin admin] SCRIPT_NAME: `/identity` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:01:23.200069 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12da6db5-e899-41ca-96f3-fe953e645f82 admin admin] PATH_INFO: `/v3/projects/63b88918c0784d36b08a0c58c5ac46eb` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:01:23.201331 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12da6db5-e899-41ca-96f3-fe953e645f82 admin admin] RBAC: Authorizing `identity:delete_project(project_id=63b88918c0784d36b08a0c58c5ac46eb)` {{(pid=82025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 20:01:23.207204 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12da6db5-e899-41ca-96f3-fe953e645f82 admin admin] RBAC: Authorization granted {{(pid=82025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 20:01:23.225888 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b29e896-3796-48ad-aa56-0977a48c1a38 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=82026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 20:01:23.227461 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b29e896-3796-48ad-aa56-0977a48c1a38 service cinder] RBAC: Authorization granted {{(pid=82026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 20:01:23.236648 dv-cinder-828806-6-smb devstack@keystone.service[82026]: [pid: 82026|app: 0|req: 991/2028] 10.222.0.33 () {60 vars in 1365 bytes} [Tue Sep 13 20:01:23 2022] GET /identity/v3/auth/tokens => generated 3270 bytes in 197 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 20:01:23.237981 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6822efed-e002-4628-82fe-2b60e8d6d01c None None] REQUEST_METHOD: `POST` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:01:23.238374 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6822efed-e002-4628-82fe-2b60e8d6d01c None None] SCRIPT_NAME: `/identity` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:01:23.238763 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6822efed-e002-4628-82fe-2b60e8d6d01c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:01:23.268907 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.auth.core [None req-6822efed-e002-4628-82fe-2b60e8d6d01c None None] MFA Rules not processed for user `b0ba3d67e9f64d25937bf0cec35f304a`. Rule list: `[]` (Enabled: `True`). {{(pid=82026) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 20:01:23.270399 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.common.fernet_utils [None req-6822efed-e002-4628-82fe-2b60e8d6d01c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82026) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 20:01:23.355774 dv-cinder-828806-6-smb devstack@keystone.service[82026]: [pid: 82026|app: 0|req: 992/2029] 10.222.0.33 () {58 vars in 958 bytes} [Tue Sep 13 20:01:23 2022] POST /identity/v3/auth/tokens => generated 3333 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 20:01:23.358240 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7c21763-ae00-47ab-afc1-0bc2ed154cfe None None] REQUEST_METHOD: `POST` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:01:23.358604 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7c21763-ae00-47ab-afc1-0bc2ed154cfe None None] SCRIPT_NAME: `/identity` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:01:23.359261 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7c21763-ae00-47ab-afc1-0bc2ed154cfe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:01:23.375611 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.notifications [None req-12da6db5-e899-41ca-96f3-fe953e645f82 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '63b88918c0784d36b08a0c58c5ac46eb', 'request_id': 'req-12da6db5-e899-41ca-96f3-fe953e645f82'} {{(pid=82025) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 20:01:23.379615 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.notifications [None req-12da6db5-e899-41ca-96f3-fe953e645f82 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '63b88918c0784d36b08a0c58c5ac46eb', 'request_id': 'req-12da6db5-e899-41ca-96f3-fe953e645f82'} {{(pid=82025) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 20:01:23.387116 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.notifications [None req-12da6db5-e899-41ca-96f3-fe953e645f82 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '63b88918c0784d36b08a0c58c5ac46eb', 'request_id': 'req-12da6db5-e899-41ca-96f3-fe953e645f82'} {{(pid=82025) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 20:01:23.399441 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.auth.core [None req-a7c21763-ae00-47ab-afc1-0bc2ed154cfe None None] MFA Rules not processed for user `f7fe350038004b5eab440484062948b6`. Rule list: `[]` (Enabled: `True`). {{(pid=82026) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 20:01:23.400945 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.common.fernet_utils [None req-a7c21763-ae00-47ab-afc1-0bc2ed154cfe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82026) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 20:01:23.504250 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.notifications [None req-12da6db5-e899-41ca-96f3-fe953e645f82 admin admin] The token cache is being invalidate because project 63b88918c0784d36b08a0c58c5ac46eb was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82025) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 13 20:01:23.504551 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.notifications [None req-12da6db5-e899-41ca-96f3-fe953e645f82 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82025) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 20:01:23.506539 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.notifications [None req-12da6db5-e899-41ca-96f3-fe953e645f82 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82025) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 20:01:23.512076 dv-cinder-828806-6-smb devstack@keystone.service[82026]: [pid: 82026|app: 0|req: 993/2031] 10.222.0.33 () {58 vars in 958 bytes} [Tue Sep 13 20:01:23 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 156 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 20:01:23.513259 dv-cinder-828806-6-smb devstack@keystone.service[82025]: [pid: 82025|app: 0|req: 1038/2031] 10.222.0.33 () {58 vars in 1233 bytes} [Tue Sep 13 20:01:23 2022] DELETE /identity/v3/projects/63b88918c0784d36b08a0c58c5ac46eb => generated 0 bytes in 485 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 20:01:23.515017 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7c21763-ae00-47ab-afc1-0bc2ed154cfe None None] Authenticating user token {{(pid=82026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 20:01:23.516142 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12da6db5-e899-41ca-96f3-fe953e645f82 admin admin] Authenticating user token {{(pid=82025) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 20:01:23.518432 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.fernet_utils [None req-12da6db5-e899-41ca-96f3-fe953e645f82 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82025) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 20:01:23.519371 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.common.fernet_utils [None req-a7c21763-ae00-47ab-afc1-0bc2ed154cfe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82026) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 20:01:23.664730 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12da6db5-e899-41ca-96f3-fe953e645f82 admin admin] Validating token access rules against request {{(pid=82025) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 20:01:23.674893 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efca73b0-9b32-45f4-aed8-7163106c2e8a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46024fc6167f4321818b1bed27a521a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8c6fba0f15b4d6a84ff601919b7b8e4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82025) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 20:01:23.676056 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efca73b0-9b32-45f4-aed8-7163106c2e8a service cinder] REQUEST_METHOD: `GET` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:01:23.676440 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efca73b0-9b32-45f4-aed8-7163106c2e8a service cinder] SCRIPT_NAME: `/identity` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:01:23.677013 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efca73b0-9b32-45f4-aed8-7163106c2e8a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:01:23.679550 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.fernet_utils [None req-efca73b0-9b32-45f4-aed8-7163106c2e8a service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82025) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 20:01:23.774934 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7c21763-ae00-47ab-afc1-0bc2ed154cfe None None] Validating token access rules against request {{(pid=82026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 20:01:23.792510 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bf3e1da-8303-4818-b37d-69d4636415d2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57539b6a6f3b4d589f5f5e1d211cd6a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b454f707d20347ada3d82aa85495635e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 20:01:23.798085 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bf3e1da-8303-4818-b37d-69d4636415d2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:01:23.798580 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bf3e1da-8303-4818-b37d-69d4636415d2 admin admin] SCRIPT_NAME: `/identity` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:01:23.800395 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bf3e1da-8303-4818-b37d-69d4636415d2 admin admin] PATH_INFO: `/v3/users/cb6ebb07a6e14b51bfe4a6d335cc67e8` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:01:23.802651 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bf3e1da-8303-4818-b37d-69d4636415d2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=cb6ebb07a6e14b51bfe4a6d335cc67e8)` {{(pid=82026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 20:01:23.806813 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efca73b0-9b32-45f4-aed8-7163106c2e8a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=82025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 20:01:23.807982 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bf3e1da-8303-4818-b37d-69d4636415d2 admin admin] RBAC: Authorization granted {{(pid=82026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 20:01:23.808921 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efca73b0-9b32-45f4-aed8-7163106c2e8a service cinder] RBAC: Authorization granted {{(pid=82025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 20:01:23.825135 dv-cinder-828806-6-smb devstack@keystone.service[82025]: [pid: 82025|app: 0|req: 1039/2032] 10.222.0.33 () {60 vars in 1365 bytes} [Tue Sep 13 20:01:23 2022] GET /identity/v3/auth/tokens => generated 3333 bytes in 311 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 20:01:23.827713 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7df0096-5b58-4624-816c-ce002cafd4b1 None None] REQUEST_METHOD: `POST` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:01:23.828010 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7df0096-5b58-4624-816c-ce002cafd4b1 None None] SCRIPT_NAME: `/identity` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:01:23.828293 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7df0096-5b58-4624-816c-ce002cafd4b1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:01:23.869905 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG dbcounter [-] [82026] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82026) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 20:01:23.871234 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.auth.core [None req-e7df0096-5b58-4624-816c-ce002cafd4b1 None None] MFA Rules not processed for user `57539b6a6f3b4d589f5f5e1d211cd6a0`. Rule list: `[]` (Enabled: `True`). {{(pid=82025) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 20:01:23.873016 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.fernet_utils [None req-e7df0096-5b58-4624-816c-ce002cafd4b1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82025) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 20:01:23.890332 dv-cinder-828806-6-smb devstack@keystone.service[82025]: [pid: 82025|app: 0|req: 1040/2033] 10.222.0.33 () {58 vars in 958 bytes} [Tue Sep 13 20:01:23 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 65 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 20:01:23.897205 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7df0096-5b58-4624-816c-ce002cafd4b1 None None] Authenticating user token {{(pid=82025) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 20:01:23.908931 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7df0096-5b58-4624-816c-ce002cafd4b1 None None] Validating token access rules against request {{(pid=82025) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 20:01:23.912986 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdc9301d-3fa5-4350-bf7c-808e98ed171f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46024fc6167f4321818b1bed27a521a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8c6fba0f15b4d6a84ff601919b7b8e4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82025) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 20:01:23.913724 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdc9301d-3fa5-4350-bf7c-808e98ed171f service cinder] REQUEST_METHOD: `GET` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:01:23.914108 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdc9301d-3fa5-4350-bf7c-808e98ed171f service cinder] SCRIPT_NAME: `/identity` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:01:23.914484 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdc9301d-3fa5-4350-bf7c-808e98ed171f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:01:23.916430 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.fernet_utils [None req-bdc9301d-3fa5-4350-bf7c-808e98ed171f service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82025) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 20:01:23.934066 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdc9301d-3fa5-4350-bf7c-808e98ed171f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=82025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 20:01:23.936262 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdc9301d-3fa5-4350-bf7c-808e98ed171f service cinder] RBAC: Authorization granted {{(pid=82025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 20:01:23.953402 dv-cinder-828806-6-smb devstack@keystone.service[82025]: [pid: 82025|app: 0|req: 1041/2034] 10.222.0.33 () {60 vars in 1365 bytes} [Tue Sep 13 20:01:23 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 57 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 20:01:23.956515 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3cc73f3-659e-44ed-95d9-5ff473683288 None None] REQUEST_METHOD: `POST` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:01:23.957019 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3cc73f3-659e-44ed-95d9-5ff473683288 None None] SCRIPT_NAME: `/identity` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:01:23.957449 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3cc73f3-659e-44ed-95d9-5ff473683288 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:01:24.039262 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.auth.core [None req-e3cc73f3-659e-44ed-95d9-5ff473683288 None None] MFA Rules not processed for user `57539b6a6f3b4d589f5f5e1d211cd6a0`. Rule list: `[]` (Enabled: `True`). {{(pid=82025) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 20:01:24.039262 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.fernet_utils [None req-e3cc73f3-659e-44ed-95d9-5ff473683288 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82025) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 20:01:24.045837 dv-cinder-828806-6-smb devstack@keystone.service[82025]: [pid: 82025|app: 0|req: 1042/2035] 10.222.0.33 () {58 vars in 958 bytes} [Tue Sep 13 20:01:23 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 20:01:24.057189 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3cc73f3-659e-44ed-95d9-5ff473683288 None None] Authenticating user token {{(pid=82025) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 20:01:24.057189 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.fernet_utils [None req-e3cc73f3-659e-44ed-95d9-5ff473683288 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82025) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 20:01:24.063521 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3cc73f3-659e-44ed-95d9-5ff473683288 None None] Validating token access rules against request {{(pid=82025) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 20:01:24.075124 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53888d39-e300-4a62-a6bb-019a3fe8bcd5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57539b6a6f3b4d589f5f5e1d211cd6a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b454f707d20347ada3d82aa85495635e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82025) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 20:01:24.077178 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53888d39-e300-4a62-a6bb-019a3fe8bcd5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:01:24.078209 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53888d39-e300-4a62-a6bb-019a3fe8bcd5 admin admin] SCRIPT_NAME: `/identity` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:01:24.078622 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53888d39-e300-4a62-a6bb-019a3fe8bcd5 admin admin] PATH_INFO: `/v3/users/f7fe350038004b5eab440484062948b6` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:01:24.081676 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53888d39-e300-4a62-a6bb-019a3fe8bcd5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f7fe350038004b5eab440484062948b6)` {{(pid=82025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 20:01:24.086270 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53888d39-e300-4a62-a6bb-019a3fe8bcd5 admin admin] RBAC: Authorization granted {{(pid=82025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 20:01:24.123576 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.notifications [None req-7bf3e1da-8303-4818-b37d-69d4636415d2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'cb6ebb07a6e14b51bfe4a6d335cc67e8'} {{(pid=82026) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 20:01:24.246706 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.notifications [None req-7bf3e1da-8303-4818-b37d-69d4636415d2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'cb6ebb07a6e14b51bfe4a6d335cc67e8'} {{(pid=82026) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 20:01:24.252522 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG dbcounter [-] [82025] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=82025) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 20:01:24.278446 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.notifications [None req-7bf3e1da-8303-4818-b37d-69d4636415d2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'cb6ebb07a6e14b51bfe4a6d335cc67e8'} {{(pid=82026) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 20:01:24.279412 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.notifications [None req-7bf3e1da-8303-4818-b37d-69d4636415d2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'cb6ebb07a6e14b51bfe4a6d335cc67e8'} {{(pid=82026) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 20:01:24.293827 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.notifications [None req-7bf3e1da-8303-4818-b37d-69d4636415d2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'cb6ebb07a6e14b51bfe4a6d335cc67e8'} {{(pid=82026) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 20:01:24.301790 dv-cinder-828806-6-smb devstack@keystone.service[82026]: [pid: 82026|app: 0|req: 994/2036] 10.222.0.33 () {58 vars in 1224 bytes} [Tue Sep 13 20:01:23 2022] DELETE /identity/v3/users/cb6ebb07a6e14b51bfe4a6d335cc67e8 => generated 0 bytes in 789 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 20:01:24.302933 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bf3e1da-8303-4818-b37d-69d4636415d2 admin admin] Authenticating user token {{(pid=82026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 20:01:24.304323 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.common.fernet_utils [None req-7bf3e1da-8303-4818-b37d-69d4636415d2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82026) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 20:01:24.344856 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.notifications [None req-53888d39-e300-4a62-a6bb-019a3fe8bcd5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f7fe350038004b5eab440484062948b6'} {{(pid=82025) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 20:01:24.377295 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bf3e1da-8303-4818-b37d-69d4636415d2 admin admin] Validating token access rules against request {{(pid=82026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 20:01:24.382205 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20b30809-7854-4814-99f0-a3bdc3fcec9a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57539b6a6f3b4d589f5f5e1d211cd6a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b454f707d20347ada3d82aa85495635e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 20:01:24.382821 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20b30809-7854-4814-99f0-a3bdc3fcec9a admin admin] REQUEST_METHOD: `GET` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:01:24.383218 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20b30809-7854-4814-99f0-a3bdc3fcec9a admin admin] SCRIPT_NAME: `/identity` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:01:24.383542 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20b30809-7854-4814-99f0-a3bdc3fcec9a admin admin] PATH_INFO: `/v3/domains` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:01:24.384205 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20b30809-7854-4814-99f0-a3bdc3fcec9a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82026) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 20:01:24.384651 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20b30809-7854-4814-99f0-a3bdc3fcec9a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 20:01:24.386981 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20b30809-7854-4814-99f0-a3bdc3fcec9a admin admin] RBAC: Authorization granted {{(pid=82026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 20:01:24.403976 dv-cinder-828806-6-smb devstack@keystone.service[82026]: [pid: 82026|app: 0|req: 995/2037] 10.222.0.33 () {58 vars in 1153 bytes} [Tue Sep 13 20:01:24 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 98 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 20:01:24.403976 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20b30809-7854-4814-99f0-a3bdc3fcec9a admin admin] Authenticating user token {{(pid=82026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 20:01:24.403976 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.common.fernet_utils [None req-20b30809-7854-4814-99f0-a3bdc3fcec9a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82026) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 20:01:24.416656 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20b30809-7854-4814-99f0-a3bdc3fcec9a admin admin] Validating token access rules against request {{(pid=82026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 20:01:24.422043 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f20646ad-52c8-48cc-83d4-412690b45276 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57539b6a6f3b4d589f5f5e1d211cd6a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b454f707d20347ada3d82aa85495635e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 20:01:24.422673 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f20646ad-52c8-48cc-83d4-412690b45276 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:01:24.422963 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f20646ad-52c8-48cc-83d4-412690b45276 admin admin] SCRIPT_NAME: `/identity` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:01:24.423294 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f20646ad-52c8-48cc-83d4-412690b45276 admin admin] PATH_INFO: `/v3/users/fb178ba38fea4064b5ef0b4c8bf92e2b` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:01:24.424439 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f20646ad-52c8-48cc-83d4-412690b45276 admin admin] RBAC: Authorizing `identity:delete_user(user_id=fb178ba38fea4064b5ef0b4c8bf92e2b)` {{(pid=82026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 20:01:24.427094 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f20646ad-52c8-48cc-83d4-412690b45276 admin admin] RBAC: Authorization granted {{(pid=82026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 20:01:24.427442 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.notifications [None req-53888d39-e300-4a62-a6bb-019a3fe8bcd5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f7fe350038004b5eab440484062948b6'} {{(pid=82025) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 20:01:24.429186 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.notifications [None req-53888d39-e300-4a62-a6bb-019a3fe8bcd5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f7fe350038004b5eab440484062948b6'} {{(pid=82025) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 20:01:24.441825 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.notifications [None req-53888d39-e300-4a62-a6bb-019a3fe8bcd5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f7fe350038004b5eab440484062948b6'} {{(pid=82025) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 20:01:24.449639 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.notifications [None req-53888d39-e300-4a62-a6bb-019a3fe8bcd5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f7fe350038004b5eab440484062948b6'} {{(pid=82025) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 20:01:24.462927 dv-cinder-828806-6-smb devstack@keystone.service[82025]: [pid: 82025|app: 0|req: 1043/2038] 10.222.0.33 () {58 vars in 1224 bytes} [Tue Sep 13 20:01:24 2022] DELETE /identity/v3/users/f7fe350038004b5eab440484062948b6 => generated 0 bytes in 416 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 20:01:24.465089 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9119befa-758f-4621-973d-d10c1fe337b6 None None] REQUEST_METHOD: `POST` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:01:24.465387 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9119befa-758f-4621-973d-d10c1fe337b6 None None] SCRIPT_NAME: `/identity` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:01:24.465667 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9119befa-758f-4621-973d-d10c1fe337b6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:01:24.488259 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.auth.core [None req-9119befa-758f-4621-973d-d10c1fe337b6 None None] MFA Rules not processed for user `57539b6a6f3b4d589f5f5e1d211cd6a0`. Rule list: `[]` (Enabled: `True`). {{(pid=82025) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 20:01:24.489484 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.fernet_utils [None req-9119befa-758f-4621-973d-d10c1fe337b6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82025) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 20:01:24.552410 dv-cinder-828806-6-smb devstack@keystone.service[82025]: [pid: 82025|app: 0|req: 1044/2039] 10.222.0.33 () {58 vars in 958 bytes} [Tue Sep 13 20:01:24 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 20:01:24.555810 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9119befa-758f-4621-973d-d10c1fe337b6 None None] Authenticating user token {{(pid=82025) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 20:01:24.555810 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.fernet_utils [None req-9119befa-758f-4621-973d-d10c1fe337b6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82025) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 20:01:24.573715 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9119befa-758f-4621-973d-d10c1fe337b6 None None] Validating token access rules against request {{(pid=82025) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 20:01:24.582279 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cabd3e9a-44f7-4899-9e91-d2075595f6da admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57539b6a6f3b4d589f5f5e1d211cd6a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b454f707d20347ada3d82aa85495635e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82025) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 20:01:24.582456 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cabd3e9a-44f7-4899-9e91-d2075595f6da admin admin] REQUEST_METHOD: `POST` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:01:24.582922 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cabd3e9a-44f7-4899-9e91-d2075595f6da admin admin] SCRIPT_NAME: `/identity` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:01:24.583558 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cabd3e9a-44f7-4899-9e91-d2075595f6da admin admin] PATH_INFO: `/v3/projects` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:01:24.584472 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cabd3e9a-44f7-4899-9e91-d2075595f6da admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 20:01:24.588871 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cabd3e9a-44f7-4899-9e91-d2075595f6da admin admin] RBAC: Authorization granted {{(pid=82025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 20:01:24.665971 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.notifications [None req-f20646ad-52c8-48cc-83d4-412690b45276 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'fb178ba38fea4064b5ef0b4c8bf92e2b'} {{(pid=82026) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 20:01:24.685175 dv-cinder-828806-6-smb devstack@keystone.service[82025]: [pid: 82025|app: 0|req: 1045/2040] 10.222.0.33 () {60 vars in 1153 bytes} [Tue Sep 13 20:01:24 2022] POST /identity/v3/projects => generated 363 bytes in 132 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 13 20:01:24.686435 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19b84a57-746b-493e-9cf4-e4603991af67 None None] REQUEST_METHOD: `POST` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:01:24.686722 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19b84a57-746b-493e-9cf4-e4603991af67 None None] SCRIPT_NAME: `/identity` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:01:24.687003 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19b84a57-746b-493e-9cf4-e4603991af67 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:01:24.710924 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.auth.core [None req-19b84a57-746b-493e-9cf4-e4603991af67 None None] MFA Rules not processed for user `57539b6a6f3b4d589f5f5e1d211cd6a0`. Rule list: `[]` (Enabled: `True`). {{(pid=82025) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 20:01:24.712254 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.fernet_utils [None req-19b84a57-746b-493e-9cf4-e4603991af67 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82025) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 20:01:24.765060 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.notifications [None req-f20646ad-52c8-48cc-83d4-412690b45276 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'fb178ba38fea4064b5ef0b4c8bf92e2b'} {{(pid=82026) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 20:01:24.788892 dv-cinder-828806-6-smb devstack@keystone.service[82025]: [pid: 82025|app: 0|req: 1046/2041] 10.222.0.33 () {58 vars in 958 bytes} [Tue Sep 13 20:01:24 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 20:01:24.788892 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19b84a57-746b-493e-9cf4-e4603991af67 None None] Authenticating user token {{(pid=82025) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 20:01:24.796318 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.fernet_utils [None req-19b84a57-746b-493e-9cf4-e4603991af67 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82025) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 20:01:24.800857 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.notifications [None req-f20646ad-52c8-48cc-83d4-412690b45276 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'fb178ba38fea4064b5ef0b4c8bf92e2b'} {{(pid=82026) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 20:01:24.801583 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.notifications [None req-f20646ad-52c8-48cc-83d4-412690b45276 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'fb178ba38fea4064b5ef0b4c8bf92e2b'} {{(pid=82026) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 20:01:24.810429 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.notifications [None req-f20646ad-52c8-48cc-83d4-412690b45276 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'fb178ba38fea4064b5ef0b4c8bf92e2b'} {{(pid=82026) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 20:01:24.817302 dv-cinder-828806-6-smb devstack@keystone.service[82026]: [pid: 82026|app: 0|req: 996/2042] 10.222.0.33 () {58 vars in 1224 bytes} [Tue Sep 13 20:01:24 2022] DELETE /identity/v3/users/fb178ba38fea4064b5ef0b4c8bf92e2b => generated 0 bytes in 416 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 20:01:24.819122 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d8d3217-b566-4757-8282-fcfb16cf7168 None None] REQUEST_METHOD: `GET` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:01:24.819441 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d8d3217-b566-4757-8282-fcfb16cf7168 None None] SCRIPT_NAME: `/identity` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:01:24.819724 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d8d3217-b566-4757-8282-fcfb16cf7168 None None] PATH_INFO: `/` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:01:24.825283 dv-cinder-828806-6-smb devstack@keystone.service[82026]: [pid: 82026|app: 0|req: 997/2043] 10.222.0.33 () {54 vars in 921 bytes} [Tue Sep 13 20:01:24 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 20:01:24.826136 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d8d3217-b566-4757-8282-fcfb16cf7168 None None] Authenticating user token {{(pid=82026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 20:01:24.827933 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.common.fernet_utils [None req-8d8d3217-b566-4757-8282-fcfb16cf7168 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82026) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 20:01:24.869372 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19b84a57-746b-493e-9cf4-e4603991af67 None None] Validating token access rules against request {{(pid=82025) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 20:01:24.907731 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d8d3217-b566-4757-8282-fcfb16cf7168 None None] Validating token access rules against request {{(pid=82026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 20:01:24.912542 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2b00619-b7c0-4a9f-ab8a-ee29c0f83e5f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57539b6a6f3b4d589f5f5e1d211cd6a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b454f707d20347ada3d82aa85495635e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 20:01:24.913170 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2b00619-b7c0-4a9f-ab8a-ee29c0f83e5f admin admin] REQUEST_METHOD: `POST` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:01:24.913459 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2b00619-b7c0-4a9f-ab8a-ee29c0f83e5f admin admin] SCRIPT_NAME: `/identity` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:01:24.913732 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2b00619-b7c0-4a9f-ab8a-ee29c0f83e5f admin admin] PATH_INFO: `/v3/users` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:01:24.914387 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2b00619-b7c0-4a9f-ab8a-ee29c0f83e5f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 20:01:24.917487 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2b00619-b7c0-4a9f-ab8a-ee29c0f83e5f admin admin] RBAC: Authorization granted {{(pid=82026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 20:01:24.936345 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5336942b-f35d-4bb0-8df6-adbc5f6c4313 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '023a2c79c2444611b3d431928e56685d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8c6fba0f15b4d6a84ff601919b7b8e4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82025) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 20:01:24.936978 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5336942b-f35d-4bb0-8df6-adbc5f6c4313 service neutron] REQUEST_METHOD: `GET` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:01:24.937261 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5336942b-f35d-4bb0-8df6-adbc5f6c4313 service neutron] SCRIPT_NAME: `/identity` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:01:24.937541 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5336942b-f35d-4bb0-8df6-adbc5f6c4313 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:01:24.941447 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.fernet_utils [None req-5336942b-f35d-4bb0-8df6-adbc5f6c4313 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82025) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 20:01:24.958521 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5336942b-f35d-4bb0-8df6-adbc5f6c4313 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 20:01:24.960014 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5336942b-f35d-4bb0-8df6-adbc5f6c4313 service neutron] RBAC: Authorization granted {{(pid=82025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 20:01:24.974907 dv-cinder-828806-6-smb devstack@keystone.service[82025]: [pid: 82025|app: 0|req: 1047/2044] 10.222.0.33 () {60 vars in 1365 bytes} [Tue Sep 13 20:01:24 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 189 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 20:01:24.975824 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5336942b-f35d-4bb0-8df6-adbc5f6c4313 service neutron] Authenticating user token {{(pid=82025) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 20:01:24.978057 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.fernet_utils [None req-5336942b-f35d-4bb0-8df6-adbc5f6c4313 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82025) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 20:01:24.992586 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5336942b-f35d-4bb0-8df6-adbc5f6c4313 service neutron] Validating token access rules against request {{(pid=82025) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 20:01:25.000615 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf2d58a0-5951-4da9-a5e3-a2cb2d12d689 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57539b6a6f3b4d589f5f5e1d211cd6a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b454f707d20347ada3d82aa85495635e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82025) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 20:01:25.001266 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf2d58a0-5951-4da9-a5e3-a2cb2d12d689 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:01:25.001551 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf2d58a0-5951-4da9-a5e3-a2cb2d12d689 admin admin] SCRIPT_NAME: `/identity` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:01:25.001867 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf2d58a0-5951-4da9-a5e3-a2cb2d12d689 admin admin] PATH_INFO: `/v3/users/c505119ab65747088a20a55280862330` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:01:25.003129 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf2d58a0-5951-4da9-a5e3-a2cb2d12d689 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c505119ab65747088a20a55280862330)` {{(pid=82025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 20:01:25.005881 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf2d58a0-5951-4da9-a5e3-a2cb2d12d689 admin admin] RBAC: Authorization granted {{(pid=82025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 20:01:25.012499 dv-cinder-828806-6-smb devstack@keystone.service[82026]: [pid: 82026|app: 0|req: 998/2045] 10.222.0.33 () {60 vars in 1144 bytes} [Tue Sep 13 20:01:24 2022] POST /identity/v3/users => generated 282 bytes in 184 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 13 20:01:25.012499 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2b00619-b7c0-4a9f-ab8a-ee29c0f83e5f admin admin] Authenticating user token {{(pid=82026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 20:01:25.015355 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.common.fernet_utils [None req-f2b00619-b7c0-4a9f-ab8a-ee29c0f83e5f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82026) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 20:01:25.034785 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2b00619-b7c0-4a9f-ab8a-ee29c0f83e5f admin admin] Validating token access rules against request {{(pid=82026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 20:01:25.039958 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b36e6ced-c721-4c31-89e0-baa8404095b4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '023a2c79c2444611b3d431928e56685d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8c6fba0f15b4d6a84ff601919b7b8e4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 20:01:25.040659 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b36e6ced-c721-4c31-89e0-baa8404095b4 service neutron] REQUEST_METHOD: `GET` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:01:25.043387 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b36e6ced-c721-4c31-89e0-baa8404095b4 service neutron] SCRIPT_NAME: `/identity` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:01:25.043753 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b36e6ced-c721-4c31-89e0-baa8404095b4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:01:25.046682 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.common.fernet_utils [None req-b36e6ced-c721-4c31-89e0-baa8404095b4 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82026) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 20:01:25.062924 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b36e6ced-c721-4c31-89e0-baa8404095b4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 20:01:25.064742 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b36e6ced-c721-4c31-89e0-baa8404095b4 service neutron] RBAC: Authorization granted {{(pid=82026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 20:01:25.077630 dv-cinder-828806-6-smb devstack@keystone.service[82026]: [pid: 82026|app: 0|req: 999/2046] 10.222.0.33 () {60 vars in 1365 bytes} [Tue Sep 13 20:01:25 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 67 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 20:01:25.078833 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67021b97-ca1f-4e85-ad24-75310eacd9f6 None None] REQUEST_METHOD: `POST` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:01:25.079601 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67021b97-ca1f-4e85-ad24-75310eacd9f6 None None] SCRIPT_NAME: `/identity` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:01:25.079893 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67021b97-ca1f-4e85-ad24-75310eacd9f6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:01:25.105395 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.auth.core [None req-67021b97-ca1f-4e85-ad24-75310eacd9f6 None None] MFA Rules not processed for user `57539b6a6f3b4d589f5f5e1d211cd6a0`. Rule list: `[]` (Enabled: `True`). {{(pid=82026) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 20:01:25.106744 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.common.fernet_utils [None req-67021b97-ca1f-4e85-ad24-75310eacd9f6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82026) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 20:01:25.116226 dv-cinder-828806-6-smb devstack@keystone.service[82026]: [pid: 82026|app: 0|req: 1000/2047] 10.222.0.33 () {58 vars in 958 bytes} [Tue Sep 13 20:01:25 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 20:01:25.117780 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3542b6fb-92b9-47b4-9b92-63d2e5072360 None None] REQUEST_METHOD: `POST` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:01:25.119173 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3542b6fb-92b9-47b4-9b92-63d2e5072360 None None] SCRIPT_NAME: `/identity` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:01:25.119173 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3542b6fb-92b9-47b4-9b92-63d2e5072360 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:01:25.147191 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.auth.core [None req-3542b6fb-92b9-47b4-9b92-63d2e5072360 None None] MFA Rules not processed for user `060ea3dea2134429967c164bd158b272`. Rule list: `[]` (Enabled: `True`). {{(pid=82026) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 20:01:25.148644 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.common.fernet_utils [None req-3542b6fb-92b9-47b4-9b92-63d2e5072360 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82026) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 20:01:25.252702 dv-cinder-828806-6-smb devstack@keystone.service[82026]: [pid: 82026|app: 0|req: 1001/2048] 10.222.0.33 () {58 vars in 1018 bytes} [Tue Sep 13 20:01:25 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 136 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 20:01:25.252834 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.notifications [None req-cf2d58a0-5951-4da9-a5e3-a2cb2d12d689 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c505119ab65747088a20a55280862330'} {{(pid=82025) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 20:01:25.254075 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3542b6fb-92b9-47b4-9b92-63d2e5072360 None None] Authenticating user token {{(pid=82026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 20:01:25.273854 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3542b6fb-92b9-47b4-9b92-63d2e5072360 None None] Validating token access rules against request {{(pid=82026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 20:01:25.281836 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ca74a34-a0a7-4e39-b964-9fbbf74a27d3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57539b6a6f3b4d589f5f5e1d211cd6a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b454f707d20347ada3d82aa85495635e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 20:01:25.283327 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ca74a34-a0a7-4e39-b964-9fbbf74a27d3 admin admin] REQUEST_METHOD: `GET` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:01:25.283678 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ca74a34-a0a7-4e39-b964-9fbbf74a27d3 admin admin] SCRIPT_NAME: `/identity` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:01:25.284056 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ca74a34-a0a7-4e39-b964-9fbbf74a27d3 admin admin] PATH_INFO: `/v3/roles` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:01:25.285164 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ca74a34-a0a7-4e39-b964-9fbbf74a27d3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 20:01:25.287962 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ca74a34-a0a7-4e39-b964-9fbbf74a27d3 admin admin] RBAC: Authorization granted {{(pid=82026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 20:01:25.335522 dv-cinder-828806-6-smb devstack@keystone.service[82026]: [pid: 82026|app: 0|req: 1002/2049] 10.222.0.33 () {58 vars in 1122 bytes} [Tue Sep 13 20:01:25 2022] GET /identity/v3/roles => generated 1420 bytes in 82 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 13 20:01:25.336593 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ca74a34-a0a7-4e39-b964-9fbbf74a27d3 admin admin] Authenticating user token {{(pid=82026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 20:01:25.352335 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ca74a34-a0a7-4e39-b964-9fbbf74a27d3 admin admin] Validating token access rules against request {{(pid=82026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 20:01:25.356947 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b60e374c-68af-4a0d-8b74-5f0964177234 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '023a2c79c2444611b3d431928e56685d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8c6fba0f15b4d6a84ff601919b7b8e4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 20:01:25.357570 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b60e374c-68af-4a0d-8b74-5f0964177234 service neutron] REQUEST_METHOD: `GET` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:01:25.357861 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b60e374c-68af-4a0d-8b74-5f0964177234 service neutron] SCRIPT_NAME: `/identity` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:01:25.358144 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b60e374c-68af-4a0d-8b74-5f0964177234 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:01:25.364530 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG dbcounter [-] [82025] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=82025) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 20:01:25.372010 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b60e374c-68af-4a0d-8b74-5f0964177234 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 20:01:25.373631 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b60e374c-68af-4a0d-8b74-5f0964177234 service neutron] RBAC: Authorization granted {{(pid=82026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 20:01:25.384391 dv-cinder-828806-6-smb devstack@keystone.service[82026]: [pid: 82026|app: 0|req: 1003/2050] 10.222.0.33 () {60 vars in 1365 bytes} [Tue Sep 13 20:01:25 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 48 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 20:01:25.386007 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b60e374c-68af-4a0d-8b74-5f0964177234 service neutron] Authenticating user token {{(pid=82026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 20:01:25.387617 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.common.fernet_utils [None req-b60e374c-68af-4a0d-8b74-5f0964177234 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82026) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 20:01:25.392959 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.notifications [None req-cf2d58a0-5951-4da9-a5e3-a2cb2d12d689 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c505119ab65747088a20a55280862330'} {{(pid=82025) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 20:01:25.393769 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.notifications [None req-cf2d58a0-5951-4da9-a5e3-a2cb2d12d689 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c505119ab65747088a20a55280862330'} {{(pid=82025) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 20:01:25.405787 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b60e374c-68af-4a0d-8b74-5f0964177234 service neutron] Validating token access rules against request {{(pid=82026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 20:01:25.411458 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.notifications [None req-cf2d58a0-5951-4da9-a5e3-a2cb2d12d689 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c505119ab65747088a20a55280862330'} {{(pid=82025) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 20:01:25.411938 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd890ada-70fe-4c14-b567-c74c991ef2cd service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '060ea3dea2134429967c164bd158b272', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8c6fba0f15b4d6a84ff601919b7b8e4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 20:01:25.412741 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd890ada-70fe-4c14-b567-c74c991ef2cd service placement] REQUEST_METHOD: `GET` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:01:25.412918 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd890ada-70fe-4c14-b567-c74c991ef2cd service placement] SCRIPT_NAME: `/identity` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:01:25.413191 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd890ada-70fe-4c14-b567-c74c991ef2cd service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:01:25.415819 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.common.fernet_utils [None req-dd890ada-70fe-4c14-b567-c74c991ef2cd service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82026) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 20:01:25.421657 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.notifications [None req-cf2d58a0-5951-4da9-a5e3-a2cb2d12d689 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c505119ab65747088a20a55280862330'} {{(pid=82025) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 20:01:25.428197 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd890ada-70fe-4c14-b567-c74c991ef2cd service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=82026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 20:01:25.429905 dv-cinder-828806-6-smb devstack@keystone.service[82025]: [pid: 82025|app: 0|req: 1048/2051] 10.222.0.33 () {58 vars in 1224 bytes} [Tue Sep 13 20:01:24 2022] DELETE /identity/v3/users/c505119ab65747088a20a55280862330 => generated 0 bytes in 454 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 20:01:25.430058 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd890ada-70fe-4c14-b567-c74c991ef2cd service placement] RBAC: Authorization granted {{(pid=82026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 20:01:25.430661 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf2d58a0-5951-4da9-a5e3-a2cb2d12d689 admin admin] Authenticating user token {{(pid=82025) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 20:01:25.436377 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.fernet_utils [None req-cf2d58a0-5951-4da9-a5e3-a2cb2d12d689 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82025) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 20:01:25.445917 dv-cinder-828806-6-smb devstack@keystone.service[82026]: [pid: 82026|app: 0|req: 1004/2052] 10.222.0.33 () {60 vars in 1365 bytes} [Tue Sep 13 20:01:25 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 61 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 20:01:25.551389 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf2d58a0-5951-4da9-a5e3-a2cb2d12d689 admin admin] Validating token access rules against request {{(pid=82025) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 20:01:25.557874 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47e7e9fc-f349-4a43-8782-02ba58e9ee24 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57539b6a6f3b4d589f5f5e1d211cd6a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b454f707d20347ada3d82aa85495635e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82025) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 20:01:25.558815 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47e7e9fc-f349-4a43-8782-02ba58e9ee24 admin admin] REQUEST_METHOD: `GET` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:01:25.559146 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47e7e9fc-f349-4a43-8782-02ba58e9ee24 admin admin] SCRIPT_NAME: `/identity` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:01:25.559432 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47e7e9fc-f349-4a43-8782-02ba58e9ee24 admin admin] PATH_INFO: `/v3/roles` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:01:25.560107 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47e7e9fc-f349-4a43-8782-02ba58e9ee24 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 20:01:25.563967 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47e7e9fc-f349-4a43-8782-02ba58e9ee24 admin admin] RBAC: Authorization granted {{(pid=82025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 20:01:25.581636 dv-cinder-828806-6-smb devstack@keystone.service[82025]: [pid: 82025|app: 0|req: 1049/2053] 10.222.0.33 () {58 vars in 1122 bytes} [Tue Sep 13 20:01:25 2022] GET /identity/v3/roles => generated 1420 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 13 20:01:25.584231 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd890ada-70fe-4c14-b567-c74c991ef2cd service placement] Authenticating user token {{(pid=82026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 20:01:25.596121 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG dbcounter [-] [82026] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=82026) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 20:01:25.607896 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd890ada-70fe-4c14-b567-c74c991ef2cd service placement] Validating token access rules against request {{(pid=82026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 20:01:25.625291 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8ef6708-de00-46de-bb54-70e02506284a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57539b6a6f3b4d589f5f5e1d211cd6a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b454f707d20347ada3d82aa85495635e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 20:01:25.625291 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8ef6708-de00-46de-bb54-70e02506284a admin admin] REQUEST_METHOD: `PUT` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:01:25.625291 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8ef6708-de00-46de-bb54-70e02506284a admin admin] SCRIPT_NAME: `/identity` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:01:25.625291 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8ef6708-de00-46de-bb54-70e02506284a admin admin] PATH_INFO: `/v3/projects/1e0c218944704151adce970691c31c9b/users/df1a58e747b64e43a5a031721358f33f/roles/3618ab638a65401f82333da7596d1daf` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:01:25.656645 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8ef6708-de00-46de-bb54-70e02506284a admin admin] RBAC: Authorizing `identity:create_grant(project_id=1e0c218944704151adce970691c31c9b, user_id=df1a58e747b64e43a5a031721358f33f, role_id=3618ab638a65401f82333da7596d1daf)` {{(pid=82026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 20:01:25.661618 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8ef6708-de00-46de-bb54-70e02506284a admin admin] RBAC: Authorization granted {{(pid=82026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 20:01:25.665090 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47e7e9fc-f349-4a43-8782-02ba58e9ee24 admin admin] Authenticating user token {{(pid=82025) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 20:01:25.671992 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.fernet_utils [None req-47e7e9fc-f349-4a43-8782-02ba58e9ee24 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82025) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 20:01:25.701405 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47e7e9fc-f349-4a43-8782-02ba58e9ee24 admin admin] Validating token access rules against request {{(pid=82025) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 20:01:25.708837 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bce88c4e-a525-485b-89d2-f3423ae0528f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57539b6a6f3b4d589f5f5e1d211cd6a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b454f707d20347ada3d82aa85495635e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82025) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 20:01:25.709613 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bce88c4e-a525-485b-89d2-f3423ae0528f admin admin] REQUEST_METHOD: `DELETE` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:01:25.710002 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bce88c4e-a525-485b-89d2-f3423ae0528f admin admin] SCRIPT_NAME: `/identity` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:01:25.711095 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bce88c4e-a525-485b-89d2-f3423ae0528f admin admin] PATH_INFO: `/v3/projects/d0b94037a611492f9daa0c5414ad25ca` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:01:25.727513 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bce88c4e-a525-485b-89d2-f3423ae0528f admin admin] RBAC: Authorizing `identity:delete_project(project_id=d0b94037a611492f9daa0c5414ad25ca)` {{(pid=82025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 20:01:25.732766 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bce88c4e-a525-485b-89d2-f3423ae0528f admin admin] RBAC: Authorization granted {{(pid=82025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 20:01:25.786238 dv-cinder-828806-6-smb devstack@keystone.service[82026]: [pid: 82026|app: 0|req: 1005/2054] 10.222.0.33 () {60 vars in 1483 bytes} [Tue Sep 13 20:01:25 2022] PUT /identity/v3/projects/1e0c218944704151adce970691c31c9b/users/df1a58e747b64e43a5a031721358f33f/roles/3618ab638a65401f82333da7596d1daf => generated 0 bytes in 203 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 20:01:25.796761 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-964200ed-2f29-4bd2-ac43-8ce97bb2f39e None None] REQUEST_METHOD: `POST` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:01:25.797047 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-964200ed-2f29-4bd2-ac43-8ce97bb2f39e None None] SCRIPT_NAME: `/identity` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:01:25.797331 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-964200ed-2f29-4bd2-ac43-8ce97bb2f39e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:01:25.825561 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.auth.core [None req-964200ed-2f29-4bd2-ac43-8ce97bb2f39e None None] MFA Rules not processed for user `df1a58e747b64e43a5a031721358f33f`. Rule list: `[]` (Enabled: `True`). {{(pid=82026) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 20:01:25.826779 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.common.fernet_utils [None req-964200ed-2f29-4bd2-ac43-8ce97bb2f39e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82026) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 20:01:25.880502 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.notifications [None req-bce88c4e-a525-485b-89d2-f3423ae0528f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd0b94037a611492f9daa0c5414ad25ca', 'request_id': 'req-bce88c4e-a525-485b-89d2-f3423ae0528f'} {{(pid=82025) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 20:01:25.888612 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.notifications [None req-bce88c4e-a525-485b-89d2-f3423ae0528f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd0b94037a611492f9daa0c5414ad25ca', 'request_id': 'req-bce88c4e-a525-485b-89d2-f3423ae0528f'} {{(pid=82025) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 20:01:25.896217 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.notifications [None req-bce88c4e-a525-485b-89d2-f3423ae0528f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd0b94037a611492f9daa0c5414ad25ca', 'request_id': 'req-bce88c4e-a525-485b-89d2-f3423ae0528f'} {{(pid=82025) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 20:01:25.924708 dv-cinder-828806-6-smb devstack@keystone.service[82026]: [pid: 82026|app: 0|req: 1006/2055] 10.222.0.33 () {58 vars in 958 bytes} [Tue Sep 13 20:01:25 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 13 20:01:25.924708 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-964200ed-2f29-4bd2-ac43-8ce97bb2f39e None None] Authenticating user token {{(pid=82026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 20:01:25.924708 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.common.fernet_utils [None req-964200ed-2f29-4bd2-ac43-8ce97bb2f39e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82026) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 20:01:25.982211 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.notifications [None req-bce88c4e-a525-485b-89d2-f3423ae0528f admin admin] The token cache is being invalidate because project d0b94037a611492f9daa0c5414ad25ca was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82025) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 13 20:01:25.982373 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.notifications [None req-bce88c4e-a525-485b-89d2-f3423ae0528f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82025) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 20:01:25.985190 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.notifications [None req-bce88c4e-a525-485b-89d2-f3423ae0528f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82025) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 20:01:25.987448 dv-cinder-828806-6-smb devstack@keystone.service[82025]: [pid: 82025|app: 0|req: 1050/2056] 10.222.0.33 () {58 vars in 1233 bytes} [Tue Sep 13 20:01:25 2022] DELETE /identity/v3/projects/d0b94037a611492f9daa0c5414ad25ca => generated 0 bytes in 323 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 13 20:01:25.988454 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bce88c4e-a525-485b-89d2-f3423ae0528f admin admin] Authenticating user token {{(pid=82025) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 20:01:25.989891 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.fernet_utils [None req-bce88c4e-a525-485b-89d2-f3423ae0528f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82025) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 20:01:26.022111 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-964200ed-2f29-4bd2-ac43-8ce97bb2f39e None None] Validating token access rules against request {{(pid=82026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 20:01:26.063282 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bce88c4e-a525-485b-89d2-f3423ae0528f admin admin] Validating token access rules against request {{(pid=82025) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 20:01:26.068158 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12f731e0-8b63-49e7-af99-ccbe5d63224e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57539b6a6f3b4d589f5f5e1d211cd6a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b454f707d20347ada3d82aa85495635e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82025) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 20:01:26.068803 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12f731e0-8b63-49e7-af99-ccbe5d63224e admin admin] REQUEST_METHOD: `DELETE` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:01:26.069092 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12f731e0-8b63-49e7-af99-ccbe5d63224e admin admin] SCRIPT_NAME: `/identity` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:01:26.069375 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12f731e0-8b63-49e7-af99-ccbe5d63224e admin admin] PATH_INFO: `/v3/projects/b5f31b084b5249bcb15ec058f197a34d` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:01:26.070519 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12f731e0-8b63-49e7-af99-ccbe5d63224e admin admin] RBAC: Authorizing `identity:delete_project(project_id=b5f31b084b5249bcb15ec058f197a34d)` {{(pid=82025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 20:01:26.075164 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12f731e0-8b63-49e7-af99-ccbe5d63224e admin admin] RBAC: Authorization granted {{(pid=82025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 20:01:26.087235 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11c4bb17-c645-4ba3-9903-cf41c9221e13 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57539b6a6f3b4d589f5f5e1d211cd6a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b454f707d20347ada3d82aa85495635e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 20:01:26.088696 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11c4bb17-c645-4ba3-9903-cf41c9221e13 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:01:26.089088 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11c4bb17-c645-4ba3-9903-cf41c9221e13 admin admin] SCRIPT_NAME: `/identity` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:01:26.089636 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11c4bb17-c645-4ba3-9903-cf41c9221e13 admin admin] PATH_INFO: `/v3/projects/33bc98571321445183fc3115859a7836` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:01:26.090854 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11c4bb17-c645-4ba3-9903-cf41c9221e13 admin admin] RBAC: Authorizing `identity:delete_project(project_id=33bc98571321445183fc3115859a7836)` {{(pid=82026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 20:01:26.092864 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11c4bb17-c645-4ba3-9903-cf41c9221e13 admin admin] RBAC: Authorization granted {{(pid=82026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 20:01:26.158547 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG dbcounter [-] [82025] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=82025) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 20:01:26.206462 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.notifications [None req-11c4bb17-c645-4ba3-9903-cf41c9221e13 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '33bc98571321445183fc3115859a7836', 'request_id': 'req-11c4bb17-c645-4ba3-9903-cf41c9221e13'} {{(pid=82026) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 20:01:26.213121 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.notifications [None req-12f731e0-8b63-49e7-af99-ccbe5d63224e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b5f31b084b5249bcb15ec058f197a34d', 'request_id': 'req-12f731e0-8b63-49e7-af99-ccbe5d63224e'} {{(pid=82025) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 20:01:26.223282 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.notifications [None req-12f731e0-8b63-49e7-af99-ccbe5d63224e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b5f31b084b5249bcb15ec058f197a34d', 'request_id': 'req-12f731e0-8b63-49e7-af99-ccbe5d63224e'} {{(pid=82025) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 20:01:26.230504 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.notifications [None req-12f731e0-8b63-49e7-af99-ccbe5d63224e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b5f31b084b5249bcb15ec058f197a34d', 'request_id': 'req-12f731e0-8b63-49e7-af99-ccbe5d63224e'} {{(pid=82025) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 20:01:26.307227 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.notifications [None req-11c4bb17-c645-4ba3-9903-cf41c9221e13 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '33bc98571321445183fc3115859a7836', 'request_id': 'req-11c4bb17-c645-4ba3-9903-cf41c9221e13'} {{(pid=82026) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 20:01:26.313758 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.notifications [None req-11c4bb17-c645-4ba3-9903-cf41c9221e13 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '33bc98571321445183fc3115859a7836', 'request_id': 'req-11c4bb17-c645-4ba3-9903-cf41c9221e13'} {{(pid=82026) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 20:01:26.326355 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.notifications [None req-11c4bb17-c645-4ba3-9903-cf41c9221e13 admin admin] The token cache is being invalidate because project 33bc98571321445183fc3115859a7836 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82026) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 13 20:01:26.326656 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.notifications [None req-11c4bb17-c645-4ba3-9903-cf41c9221e13 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82026) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 20:01:26.327356 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.notifications [None req-11c4bb17-c645-4ba3-9903-cf41c9221e13 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82026) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 20:01:26.328879 dv-cinder-828806-6-smb devstack@keystone.service[82026]: [pid: 82026|app: 0|req: 1007/2057] 10.222.0.33 () {58 vars in 1233 bytes} [Tue Sep 13 20:01:25 2022] DELETE /identity/v3/projects/33bc98571321445183fc3115859a7836 => generated 0 bytes in 409 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 20:01:26.329954 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11c4bb17-c645-4ba3-9903-cf41c9221e13 admin admin] Authenticating user token {{(pid=82026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 20:01:26.331319 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.common.fernet_utils [None req-11c4bb17-c645-4ba3-9903-cf41c9221e13 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82026) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 20:01:26.364701 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.notifications [None req-12f731e0-8b63-49e7-af99-ccbe5d63224e admin admin] The token cache is being invalidate because project b5f31b084b5249bcb15ec058f197a34d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82025) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 13 20:01:26.365177 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.notifications [None req-12f731e0-8b63-49e7-af99-ccbe5d63224e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82025) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 20:01:26.365765 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.notifications [None req-12f731e0-8b63-49e7-af99-ccbe5d63224e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82025) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 20:01:26.371462 dv-cinder-828806-6-smb devstack@keystone.service[82025]: [pid: 82025|app: 0|req: 1051/2058] 10.222.0.33 () {58 vars in 1233 bytes} [Tue Sep 13 20:01:25 2022] DELETE /identity/v3/projects/b5f31b084b5249bcb15ec058f197a34d => generated 0 bytes in 379 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 20:01:26.372530 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12f731e0-8b63-49e7-af99-ccbe5d63224e admin admin] Authenticating user token {{(pid=82025) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 20:01:26.374043 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.fernet_utils [None req-12f731e0-8b63-49e7-af99-ccbe5d63224e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82025) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 20:01:26.402553 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11c4bb17-c645-4ba3-9903-cf41c9221e13 admin admin] Validating token access rules against request {{(pid=82026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 20:01:26.458541 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12f731e0-8b63-49e7-af99-ccbe5d63224e admin admin] Validating token access rules against request {{(pid=82025) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 20:01:26.465331 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bafc5b89-7347-4c4e-aad6-5ca474a7a024 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57539b6a6f3b4d589f5f5e1d211cd6a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b454f707d20347ada3d82aa85495635e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82025) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 20:01:26.465986 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bafc5b89-7347-4c4e-aad6-5ca474a7a024 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:01:26.466274 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bafc5b89-7347-4c4e-aad6-5ca474a7a024 admin admin] SCRIPT_NAME: `/identity` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:01:26.466597 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bafc5b89-7347-4c4e-aad6-5ca474a7a024 admin admin] PATH_INFO: `/v3/users/fabb22bba75a4f60bf5d3f6b0462b2d7` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:01:26.468821 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bafc5b89-7347-4c4e-aad6-5ca474a7a024 admin admin] RBAC: Authorizing `identity:delete_user(user_id=fabb22bba75a4f60bf5d3f6b0462b2d7)` {{(pid=82025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 20:01:26.472603 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bafc5b89-7347-4c4e-aad6-5ca474a7a024 admin admin] RBAC: Authorization granted {{(pid=82025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 20:01:26.489577 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-610d2d32-5445-4317-8204-c05498cf897b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57539b6a6f3b4d589f5f5e1d211cd6a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b454f707d20347ada3d82aa85495635e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 20:01:26.490259 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-610d2d32-5445-4317-8204-c05498cf897b admin admin] REQUEST_METHOD: `POST` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:01:26.490548 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-610d2d32-5445-4317-8204-c05498cf897b admin admin] SCRIPT_NAME: `/identity` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:01:26.490823 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-610d2d32-5445-4317-8204-c05498cf897b admin admin] PATH_INFO: `/v3/projects` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:01:26.491518 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-610d2d32-5445-4317-8204-c05498cf897b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 20:01:26.493476 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-610d2d32-5445-4317-8204-c05498cf897b admin admin] RBAC: Authorization granted {{(pid=82026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 20:01:26.501728 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG dbcounter [-] [82026] Writing DB stats keystone:SELECT=86,keystone:DELETE=13,keystone:INSERT=1 {{(pid=82026) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 20:01:26.594659 dv-cinder-828806-6-smb devstack@keystone.service[82026]: [pid: 82026|app: 0|req: 1008/2059] 10.222.0.33 () {60 vars in 1153 bytes} [Tue Sep 13 20:01:26 2022] POST /identity/v3/projects => generated 361 bytes in 265 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 13 20:01:26.595699 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-610d2d32-5445-4317-8204-c05498cf897b admin admin] Authenticating user token {{(pid=82026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 20:01:26.597260 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.common.fernet_utils [None req-610d2d32-5445-4317-8204-c05498cf897b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82026) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 20:01:26.660443 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-610d2d32-5445-4317-8204-c05498cf897b admin admin] Validating token access rules against request {{(pid=82026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 20:01:26.665122 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3973c618-49f2-41bf-9508-e40d5c791a01 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57539b6a6f3b4d589f5f5e1d211cd6a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b454f707d20347ada3d82aa85495635e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 20:01:26.665857 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3973c618-49f2-41bf-9508-e40d5c791a01 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:01:26.666771 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3973c618-49f2-41bf-9508-e40d5c791a01 admin admin] SCRIPT_NAME: `/identity` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:01:26.666926 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3973c618-49f2-41bf-9508-e40d5c791a01 admin admin] PATH_INFO: `/v3/projects/5049bbcdf2d942a68baba660b2e37523` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:01:26.668083 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3973c618-49f2-41bf-9508-e40d5c791a01 admin admin] RBAC: Authorizing `identity:delete_project(project_id=5049bbcdf2d942a68baba660b2e37523)` {{(pid=82026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 20:01:26.668209 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG dbcounter [-] [82025] Writing DB stats keystone:SELECT=86,keystone:INSERT=4,keystone:DELETE=10 {{(pid=82025) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 20:01:26.669989 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3973c618-49f2-41bf-9508-e40d5c791a01 admin admin] RBAC: Authorization granted {{(pid=82026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 20:01:26.713369 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.notifications [None req-bafc5b89-7347-4c4e-aad6-5ca474a7a024 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'fabb22bba75a4f60bf5d3f6b0462b2d7'} {{(pid=82025) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 20:01:26.794197 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.notifications [None req-3973c618-49f2-41bf-9508-e40d5c791a01 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5049bbcdf2d942a68baba660b2e37523', 'request_id': 'req-3973c618-49f2-41bf-9508-e40d5c791a01'} {{(pid=82026) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 20:01:26.800533 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.notifications [None req-bafc5b89-7347-4c4e-aad6-5ca474a7a024 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'fabb22bba75a4f60bf5d3f6b0462b2d7'} {{(pid=82025) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 20:01:26.801245 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.notifications [None req-bafc5b89-7347-4c4e-aad6-5ca474a7a024 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'fabb22bba75a4f60bf5d3f6b0462b2d7'} {{(pid=82025) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 20:01:26.819158 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.notifications [None req-bafc5b89-7347-4c4e-aad6-5ca474a7a024 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'fabb22bba75a4f60bf5d3f6b0462b2d7'} {{(pid=82025) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 20:01:26.825189 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.notifications [None req-bafc5b89-7347-4c4e-aad6-5ca474a7a024 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'fabb22bba75a4f60bf5d3f6b0462b2d7'} {{(pid=82025) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 20:01:26.831576 dv-cinder-828806-6-smb devstack@keystone.service[82025]: [pid: 82025|app: 0|req: 1052/2060] 10.222.0.33 () {58 vars in 1224 bytes} [Tue Sep 13 20:01:26 2022] DELETE /identity/v3/users/fabb22bba75a4f60bf5d3f6b0462b2d7 => generated 0 bytes in 460 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 20:01:26.832765 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bc355ab-a9e0-413b-ba37-6f5b81f567ec None None] REQUEST_METHOD: `POST` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:01:26.833051 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bc355ab-a9e0-413b-ba37-6f5b81f567ec None None] SCRIPT_NAME: `/identity` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:01:26.833368 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bc355ab-a9e0-413b-ba37-6f5b81f567ec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:01:26.853183 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.auth.core [None req-8bc355ab-a9e0-413b-ba37-6f5b81f567ec None None] MFA Rules not processed for user `57539b6a6f3b4d589f5f5e1d211cd6a0`. Rule list: `[]` (Enabled: `True`). {{(pid=82025) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 20:01:26.855066 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.fernet_utils [None req-8bc355ab-a9e0-413b-ba37-6f5b81f567ec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82025) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 20:01:26.915548 dv-cinder-828806-6-smb devstack@keystone.service[82025]: [pid: 82025|app: 0|req: 1053/2061] 10.222.0.33 () {58 vars in 958 bytes} [Tue Sep 13 20:01:26 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 20:01:26.917182 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd868cbc-aded-4053-ab79-dda2166a7784 None None] REQUEST_METHOD: `POST` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:01:26.917479 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd868cbc-aded-4053-ab79-dda2166a7784 None None] SCRIPT_NAME: `/identity` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:01:26.917759 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd868cbc-aded-4053-ab79-dda2166a7784 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:01:26.938299 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.auth.core [None req-fd868cbc-aded-4053-ab79-dda2166a7784 None None] MFA Rules not processed for user `57539b6a6f3b4d589f5f5e1d211cd6a0`. Rule list: `[]` (Enabled: `True`). {{(pid=82025) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 20:01:26.939558 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.fernet_utils [None req-fd868cbc-aded-4053-ab79-dda2166a7784 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82025) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 20:01:26.946890 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.notifications [None req-3973c618-49f2-41bf-9508-e40d5c791a01 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5049bbcdf2d942a68baba660b2e37523', 'request_id': 'req-3973c618-49f2-41bf-9508-e40d5c791a01'} {{(pid=82026) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 20:01:26.965020 dv-cinder-828806-6-smb devstack@keystone.service[82025]: [pid: 82025|app: 0|req: 1054/2062] 10.222.0.33 () {58 vars in 958 bytes} [Tue Sep 13 20:01:26 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 20:01:26.965020 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd868cbc-aded-4053-ab79-dda2166a7784 None None] Authenticating user token {{(pid=82025) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 20:01:26.965020 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.fernet_utils [None req-fd868cbc-aded-4053-ab79-dda2166a7784 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82025) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 20:01:26.965579 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.notifications [None req-3973c618-49f2-41bf-9508-e40d5c791a01 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5049bbcdf2d942a68baba660b2e37523', 'request_id': 'req-3973c618-49f2-41bf-9508-e40d5c791a01'} {{(pid=82026) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 20:01:26.965691 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd868cbc-aded-4053-ab79-dda2166a7784 None None] Validating token access rules against request {{(pid=82025) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 20:01:26.969046 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7061d06-6df4-4cc3-9cee-a6d02e1b3817 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57539b6a6f3b4d589f5f5e1d211cd6a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b454f707d20347ada3d82aa85495635e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82025) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 20:01:26.969658 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7061d06-6df4-4cc3-9cee-a6d02e1b3817 admin admin] REQUEST_METHOD: `POST` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:01:26.969940 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7061d06-6df4-4cc3-9cee-a6d02e1b3817 admin admin] SCRIPT_NAME: `/identity` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:01:26.970247 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7061d06-6df4-4cc3-9cee-a6d02e1b3817 admin admin] PATH_INFO: `/v3/users` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:01:26.970846 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7061d06-6df4-4cc3-9cee-a6d02e1b3817 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 20:01:26.972439 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.notifications [None req-3973c618-49f2-41bf-9508-e40d5c791a01 admin admin] The token cache is being invalidate because project 5049bbcdf2d942a68baba660b2e37523 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82026) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 13 20:01:26.972714 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.notifications [None req-3973c618-49f2-41bf-9508-e40d5c791a01 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82026) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 20:01:26.972823 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7061d06-6df4-4cc3-9cee-a6d02e1b3817 admin admin] RBAC: Authorization granted {{(pid=82025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 20:01:26.973580 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.notifications [None req-3973c618-49f2-41bf-9508-e40d5c791a01 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82026) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 20:01:26.977086 dv-cinder-828806-6-smb devstack@keystone.service[82026]: [pid: 82026|app: 0|req: 1009/2063] 10.222.0.33 () {58 vars in 1233 bytes} [Tue Sep 13 20:01:26 2022] DELETE /identity/v3/projects/5049bbcdf2d942a68baba660b2e37523 => generated 0 bytes in 381 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 20:01:26.977289 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0ec93ef-fc13-4aab-b9b8-b29f16ecf974 None None] REQUEST_METHOD: `POST` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:01:26.977836 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0ec93ef-fc13-4aab-b9b8-b29f16ecf974 None None] SCRIPT_NAME: `/identity` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:01:26.978169 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0ec93ef-fc13-4aab-b9b8-b29f16ecf974 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:01:27.002226 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.auth.core [None req-e0ec93ef-fc13-4aab-b9b8-b29f16ecf974 None None] MFA Rules not processed for user `57539b6a6f3b4d589f5f5e1d211cd6a0`. Rule list: `[]` (Enabled: `True`). {{(pid=82026) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 20:01:27.003469 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.common.fernet_utils [None req-e0ec93ef-fc13-4aab-b9b8-b29f16ecf974 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82026) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 20:01:27.014196 dv-cinder-828806-6-smb devstack@keystone.service[82026]: [pid: 82026|app: 0|req: 1010/2064] 10.222.0.33 () {58 vars in 958 bytes} [Tue Sep 13 20:01:26 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 20:01:27.014196 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3fd7e0c-80ff-4297-9b7c-9a1a58c962fa None None] REQUEST_METHOD: `POST` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:01:27.014499 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3fd7e0c-80ff-4297-9b7c-9a1a58c962fa None None] SCRIPT_NAME: `/identity` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:01:27.014775 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3fd7e0c-80ff-4297-9b7c-9a1a58c962fa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:01:27.035294 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.auth.core [None req-d3fd7e0c-80ff-4297-9b7c-9a1a58c962fa None None] MFA Rules not processed for user `57539b6a6f3b4d589f5f5e1d211cd6a0`. Rule list: `[]` (Enabled: `True`). {{(pid=82026) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 20:01:27.036483 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.common.fernet_utils [None req-d3fd7e0c-80ff-4297-9b7c-9a1a58c962fa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82026) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 20:01:27.044983 dv-cinder-828806-6-smb devstack@keystone.service[82026]: [pid: 82026|app: 0|req: 1011/2065] 10.222.0.33 () {58 vars in 958 bytes} [Tue Sep 13 20:01:27 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 20:01:27.045899 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3fd7e0c-80ff-4297-9b7c-9a1a58c962fa None None] Authenticating user token {{(pid=82026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 20:01:27.047142 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.common.fernet_utils [None req-d3fd7e0c-80ff-4297-9b7c-9a1a58c962fa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82026) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 20:01:27.059290 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3fd7e0c-80ff-4297-9b7c-9a1a58c962fa None None] Validating token access rules against request {{(pid=82026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 20:01:27.063878 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdbd738a-3e84-4a5e-ba68-2c779748ff90 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57539b6a6f3b4d589f5f5e1d211cd6a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b454f707d20347ada3d82aa85495635e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 20:01:27.064482 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdbd738a-3e84-4a5e-ba68-2c779748ff90 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:01:27.064767 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdbd738a-3e84-4a5e-ba68-2c779748ff90 admin admin] SCRIPT_NAME: `/identity` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:01:27.065067 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdbd738a-3e84-4a5e-ba68-2c779748ff90 admin admin] PATH_INFO: `/v3/users/b0ba3d67e9f64d25937bf0cec35f304a` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:01:27.066157 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdbd738a-3e84-4a5e-ba68-2c779748ff90 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b0ba3d67e9f64d25937bf0cec35f304a)` {{(pid=82026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 20:01:27.068119 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdbd738a-3e84-4a5e-ba68-2c779748ff90 admin admin] RBAC: Authorization granted {{(pid=82026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 20:01:27.123236 dv-cinder-828806-6-smb devstack@keystone.service[82025]: [pid: 82025|app: 0|req: 1055/2066] 10.222.0.33 () {60 vars in 1144 bytes} [Tue Sep 13 20:01:26 2022] POST /identity/v3/users => generated 287 bytes in 174 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 13 20:01:27.124870 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7061d06-6df4-4cc3-9cee-a6d02e1b3817 admin admin] Authenticating user token {{(pid=82025) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 20:01:27.149452 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7061d06-6df4-4cc3-9cee-a6d02e1b3817 admin admin] Validating token access rules against request {{(pid=82025) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 20:01:27.155190 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56b837ef-4b0e-4f3e-a909-ede75ee55d67 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57539b6a6f3b4d589f5f5e1d211cd6a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b454f707d20347ada3d82aa85495635e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82025) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 20:01:27.155943 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56b837ef-4b0e-4f3e-a909-ede75ee55d67 admin admin] REQUEST_METHOD: `GET` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:01:27.163353 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56b837ef-4b0e-4f3e-a909-ede75ee55d67 admin admin] SCRIPT_NAME: `/identity` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:01:27.163353 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56b837ef-4b0e-4f3e-a909-ede75ee55d67 admin admin] PATH_INFO: `/v3/domains` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:01:27.163353 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56b837ef-4b0e-4f3e-a909-ede75ee55d67 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82025) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 20:01:27.163353 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56b837ef-4b0e-4f3e-a909-ede75ee55d67 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 20:01:27.163353 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56b837ef-4b0e-4f3e-a909-ede75ee55d67 admin admin] RBAC: Authorization granted {{(pid=82025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 20:01:27.171590 dv-cinder-828806-6-smb devstack@keystone.service[82025]: [pid: 82025|app: 0|req: 1056/2067] 10.222.0.33 () {58 vars in 1153 bytes} [Tue Sep 13 20:01:27 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 20:01:27.172496 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56b837ef-4b0e-4f3e-a909-ede75ee55d67 admin admin] Authenticating user token {{(pid=82025) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 20:01:27.183508 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56b837ef-4b0e-4f3e-a909-ede75ee55d67 admin admin] Validating token access rules against request {{(pid=82025) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 20:01:27.188566 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57034275-683d-453a-a832-e8e95e6ff6f4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57539b6a6f3b4d589f5f5e1d211cd6a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b454f707d20347ada3d82aa85495635e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82025) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 20:01:27.189231 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57034275-683d-453a-a832-e8e95e6ff6f4 admin admin] REQUEST_METHOD: `GET` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:01:27.189515 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57034275-683d-453a-a832-e8e95e6ff6f4 admin admin] SCRIPT_NAME: `/identity` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:01:27.189791 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57034275-683d-453a-a832-e8e95e6ff6f4 admin admin] PATH_INFO: `/v3/domains` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:01:27.190464 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57034275-683d-453a-a832-e8e95e6ff6f4 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82025) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 20:01:27.190856 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57034275-683d-453a-a832-e8e95e6ff6f4 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 20:01:27.192413 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57034275-683d-453a-a832-e8e95e6ff6f4 admin admin] RBAC: Authorization granted {{(pid=82025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 20:01:27.205611 dv-cinder-828806-6-smb devstack@keystone.service[82025]: [pid: 82025|app: 0|req: 1057/2068] 10.222.0.33 () {58 vars in 1153 bytes} [Tue Sep 13 20:01:27 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 20:01:27.206612 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57034275-683d-453a-a832-e8e95e6ff6f4 admin admin] Authenticating user token {{(pid=82025) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 20:01:27.209395 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.fernet_utils [None req-57034275-683d-453a-a832-e8e95e6ff6f4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82025) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 20:01:27.223868 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57034275-683d-453a-a832-e8e95e6ff6f4 admin admin] Validating token access rules against request {{(pid=82025) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 20:01:27.228824 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7962cda9-1204-4163-8bc3-fa73abe9a139 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57539b6a6f3b4d589f5f5e1d211cd6a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b454f707d20347ada3d82aa85495635e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82025) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 20:01:27.229466 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7962cda9-1204-4163-8bc3-fa73abe9a139 admin admin] REQUEST_METHOD: `GET` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:01:27.229758 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7962cda9-1204-4163-8bc3-fa73abe9a139 admin admin] SCRIPT_NAME: `/identity` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:01:27.230040 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7962cda9-1204-4163-8bc3-fa73abe9a139 admin admin] PATH_INFO: `/v3/roles` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:01:27.230693 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7962cda9-1204-4163-8bc3-fa73abe9a139 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 20:01:27.232326 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7962cda9-1204-4163-8bc3-fa73abe9a139 admin admin] RBAC: Authorization granted {{(pid=82025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 20:01:27.243274 dv-cinder-828806-6-smb devstack@keystone.service[82025]: [pid: 82025|app: 0|req: 1058/2069] 10.222.0.33 () {58 vars in 1122 bytes} [Tue Sep 13 20:01:27 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 13 20:01:27.244750 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7962cda9-1204-4163-8bc3-fa73abe9a139 admin admin] Authenticating user token {{(pid=82025) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 20:01:27.254993 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7962cda9-1204-4163-8bc3-fa73abe9a139 admin admin] Validating token access rules against request {{(pid=82025) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 20:01:27.259762 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55e91392-cf0b-4bd8-a401-086705f48746 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57539b6a6f3b4d589f5f5e1d211cd6a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b454f707d20347ada3d82aa85495635e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82025) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 20:01:27.261068 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55e91392-cf0b-4bd8-a401-086705f48746 admin admin] REQUEST_METHOD: `POST` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:01:27.261350 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55e91392-cf0b-4bd8-a401-086705f48746 admin admin] SCRIPT_NAME: `/identity` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:01:27.261623 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55e91392-cf0b-4bd8-a401-086705f48746 admin admin] PATH_INFO: `/v3/projects` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:01:27.262265 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55e91392-cf0b-4bd8-a401-086705f48746 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 20:01:27.264206 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55e91392-cf0b-4bd8-a401-086705f48746 admin admin] RBAC: Authorization granted {{(pid=82025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 20:01:27.270326 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.notifications [None req-fdbd738a-3e84-4a5e-ba68-2c779748ff90 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b0ba3d67e9f64d25937bf0cec35f304a'} {{(pid=82026) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 20:01:27.376085 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.notifications [None req-fdbd738a-3e84-4a5e-ba68-2c779748ff90 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b0ba3d67e9f64d25937bf0cec35f304a'} {{(pid=82026) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 20:01:27.387729 dv-cinder-828806-6-smb devstack@keystone.service[82025]: [pid: 82025|app: 0|req: 1059/2070] 10.222.0.33 () {60 vars in 1153 bytes} [Tue Sep 13 20:01:27 2022] POST /identity/v3/projects => generated 387 bytes in 144 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 13 20:01:27.389146 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55e91392-cf0b-4bd8-a401-086705f48746 admin admin] Authenticating user token {{(pid=82025) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 20:01:27.406868 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.notifications [None req-fdbd738a-3e84-4a5e-ba68-2c779748ff90 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b0ba3d67e9f64d25937bf0cec35f304a'} {{(pid=82026) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 20:01:27.410019 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.notifications [None req-fdbd738a-3e84-4a5e-ba68-2c779748ff90 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b0ba3d67e9f64d25937bf0cec35f304a'} {{(pid=82026) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 20:01:27.427716 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.notifications [None req-fdbd738a-3e84-4a5e-ba68-2c779748ff90 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b0ba3d67e9f64d25937bf0cec35f304a'} {{(pid=82026) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 20:01:27.427716 dv-cinder-828806-6-smb devstack@keystone.service[82026]: [pid: 82026|app: 0|req: 1012/2071] 10.222.0.33 () {58 vars in 1224 bytes} [Tue Sep 13 20:01:27 2022] DELETE /identity/v3/users/b0ba3d67e9f64d25937bf0cec35f304a => generated 0 bytes in 381 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 20:01:27.427716 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdbd738a-3e84-4a5e-ba68-2c779748ff90 admin admin] Authenticating user token {{(pid=82026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 20:01:27.428816 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.common.fernet_utils [None req-fdbd738a-3e84-4a5e-ba68-2c779748ff90 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82026) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 20:01:27.490538 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55e91392-cf0b-4bd8-a401-086705f48746 admin admin] Validating token access rules against request {{(pid=82025) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 20:01:27.508206 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdbd738a-3e84-4a5e-ba68-2c779748ff90 admin admin] Validating token access rules against request {{(pid=82026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 20:01:27.513604 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9e5545b-c2c9-4df2-845a-654158e12ea6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57539b6a6f3b4d589f5f5e1d211cd6a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b454f707d20347ada3d82aa85495635e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 20:01:27.514304 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9e5545b-c2c9-4df2-845a-654158e12ea6 admin admin] REQUEST_METHOD: `PUT` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:01:27.514595 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9e5545b-c2c9-4df2-845a-654158e12ea6 admin admin] SCRIPT_NAME: `/identity` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:01:27.514879 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9e5545b-c2c9-4df2-845a-654158e12ea6 admin admin] PATH_INFO: `/v3/projects/cdc4c0becf5b4293af9b7697d075fed3/users/d6faab30ee2b4bfdb23463bac89f6d85/roles/e5af7d5baa93469e9e486ef21c85474e` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:01:27.531570 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9e5545b-c2c9-4df2-845a-654158e12ea6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=cdc4c0becf5b4293af9b7697d075fed3, user_id=d6faab30ee2b4bfdb23463bac89f6d85, role_id=e5af7d5baa93469e9e486ef21c85474e)` {{(pid=82026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 20:01:27.534284 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9e5545b-c2c9-4df2-845a-654158e12ea6 admin admin] RBAC: Authorization granted {{(pid=82026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 20:01:27.559313 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87fe5616-3e3a-4e7b-bfc5-176452c050b7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57539b6a6f3b4d589f5f5e1d211cd6a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b454f707d20347ada3d82aa85495635e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82025) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 20:01:27.560020 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87fe5616-3e3a-4e7b-bfc5-176452c050b7 admin admin] REQUEST_METHOD: `POST` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:01:27.560308 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87fe5616-3e3a-4e7b-bfc5-176452c050b7 admin admin] SCRIPT_NAME: `/identity` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:01:27.560609 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87fe5616-3e3a-4e7b-bfc5-176452c050b7 admin admin] PATH_INFO: `/v3/projects` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:01:27.561268 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87fe5616-3e3a-4e7b-bfc5-176452c050b7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 20:01:27.563726 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87fe5616-3e3a-4e7b-bfc5-176452c050b7 admin admin] RBAC: Authorization granted {{(pid=82025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 20:01:27.593494 dv-cinder-828806-6-smb devstack@keystone.service[82026]: [pid: 82026|app: 0|req: 1013/2072] 10.222.0.33 () {60 vars in 1483 bytes} [Tue Sep 13 20:01:27 2022] PUT /identity/v3/projects/cdc4c0becf5b4293af9b7697d075fed3/users/d6faab30ee2b4bfdb23463bac89f6d85/roles/e5af7d5baa93469e9e486ef21c85474e => generated 0 bytes in 167 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 20:01:27.594768 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9e5545b-c2c9-4df2-845a-654158e12ea6 admin admin] Authenticating user token {{(pid=82026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 20:01:27.596567 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.common.fernet_utils [None req-b9e5545b-c2c9-4df2-845a-654158e12ea6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82026) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 20:01:27.649318 dv-cinder-828806-6-smb devstack@keystone.service[82025]: [pid: 82025|app: 0|req: 1060/2073] 10.222.0.33 () {60 vars in 1153 bytes} [Tue Sep 13 20:01:27 2022] POST /identity/v3/projects => generated 377 bytes in 261 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 13 20:01:27.650367 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87fe5616-3e3a-4e7b-bfc5-176452c050b7 admin admin] Authenticating user token {{(pid=82025) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 20:01:27.653589 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.fernet_utils [None req-87fe5616-3e3a-4e7b-bfc5-176452c050b7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82025) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 20:01:27.672936 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG dbcounter [-] [82026] Writing DB stats keystone:SELECT=87,keystone:DELETE=11,keystone:INSERT=2 {{(pid=82026) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 20:01:27.696693 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9e5545b-c2c9-4df2-845a-654158e12ea6 admin admin] Validating token access rules against request {{(pid=82026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 20:01:27.719473 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG dbcounter [-] [82025] Writing DB stats keystone:SELECT=100 {{(pid=82025) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 20:01:27.750776 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87fe5616-3e3a-4e7b-bfc5-176452c050b7 admin admin] Validating token access rules against request {{(pid=82025) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 20:01:27.759243 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d17943bb-dba6-465b-b7ce-dde5bbcd0c3e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57539b6a6f3b4d589f5f5e1d211cd6a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b454f707d20347ada3d82aa85495635e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82025) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 20:01:27.760574 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d17943bb-dba6-465b-b7ce-dde5bbcd0c3e admin admin] REQUEST_METHOD: `POST` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:01:27.761102 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d17943bb-dba6-465b-b7ce-dde5bbcd0c3e admin admin] SCRIPT_NAME: `/identity` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:01:27.762101 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d17943bb-dba6-465b-b7ce-dde5bbcd0c3e admin admin] PATH_INFO: `/v3/users` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:01:27.762962 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d17943bb-dba6-465b-b7ce-dde5bbcd0c3e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 20:01:27.764113 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23111e63-4a45-436d-a36c-d023712e96a1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57539b6a6f3b4d589f5f5e1d211cd6a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b454f707d20347ada3d82aa85495635e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 20:01:27.764825 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23111e63-4a45-436d-a36c-d023712e96a1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:01:27.765118 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23111e63-4a45-436d-a36c-d023712e96a1 admin admin] SCRIPT_NAME: `/identity` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:01:27.765402 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23111e63-4a45-436d-a36c-d023712e96a1 admin admin] PATH_INFO: `/v3/projects/6bc8066a789345b39e4d63a6aed3ea91` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:01:27.766372 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d17943bb-dba6-465b-b7ce-dde5bbcd0c3e admin admin] RBAC: Authorization granted {{(pid=82025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 20:01:27.766709 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23111e63-4a45-436d-a36c-d023712e96a1 admin admin] RBAC: Authorizing `identity:delete_project(project_id=6bc8066a789345b39e4d63a6aed3ea91)` {{(pid=82026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 20:01:27.768778 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23111e63-4a45-436d-a36c-d023712e96a1 admin admin] RBAC: Authorization granted {{(pid=82026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 20:01:27.878350 dv-cinder-828806-6-smb devstack@keystone.service[82025]: [pid: 82025|app: 0|req: 1061/2074] 10.222.0.33 () {60 vars in 1144 bytes} [Tue Sep 13 20:01:27 2022] POST /identity/v3/users => generated 294 bytes in 228 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 13 20:01:27.879228 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d17943bb-dba6-465b-b7ce-dde5bbcd0c3e admin admin] Authenticating user token {{(pid=82025) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 20:01:27.889107 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d17943bb-dba6-465b-b7ce-dde5bbcd0c3e admin admin] Validating token access rules against request {{(pid=82025) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 20:01:27.893795 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f619f9f4-eb3b-427d-92cf-24f963b92457 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57539b6a6f3b4d589f5f5e1d211cd6a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b454f707d20347ada3d82aa85495635e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82025) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 20:01:27.894425 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f619f9f4-eb3b-427d-92cf-24f963b92457 admin admin] REQUEST_METHOD: `GET` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:01:27.894728 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f619f9f4-eb3b-427d-92cf-24f963b92457 admin admin] SCRIPT_NAME: `/identity` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:01:27.894998 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f619f9f4-eb3b-427d-92cf-24f963b92457 admin admin] PATH_INFO: `/v3/roles` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:01:27.905598 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f619f9f4-eb3b-427d-92cf-24f963b92457 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 20:01:27.905598 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f619f9f4-eb3b-427d-92cf-24f963b92457 admin admin] RBAC: Authorization granted {{(pid=82025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 20:01:27.913535 dv-cinder-828806-6-smb devstack@keystone.service[82025]: [pid: 82025|app: 0|req: 1062/2075] 10.222.0.33 () {58 vars in 1122 bytes} [Tue Sep 13 20:01:27 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 13 20:01:27.913535 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f619f9f4-eb3b-427d-92cf-24f963b92457 admin admin] Authenticating user token {{(pid=82025) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 20:01:27.913535 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.fernet_utils [None req-f619f9f4-eb3b-427d-92cf-24f963b92457 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82025) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 20:01:27.928106 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f619f9f4-eb3b-427d-92cf-24f963b92457 admin admin] Validating token access rules against request {{(pid=82025) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 20:01:27.933476 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.notifications [None req-23111e63-4a45-436d-a36c-d023712e96a1 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6bc8066a789345b39e4d63a6aed3ea91', 'request_id': 'req-23111e63-4a45-436d-a36c-d023712e96a1'} {{(pid=82026) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 20:01:27.985753 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63f390e2-291c-45a3-afa1-45a6afb686fd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57539b6a6f3b4d589f5f5e1d211cd6a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b454f707d20347ada3d82aa85495635e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82025) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 20:01:27.986375 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63f390e2-291c-45a3-afa1-45a6afb686fd admin admin] REQUEST_METHOD: `POST` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:01:27.986670 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63f390e2-291c-45a3-afa1-45a6afb686fd admin admin] SCRIPT_NAME: `/identity` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:01:27.986954 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63f390e2-291c-45a3-afa1-45a6afb686fd admin admin] PATH_INFO: `/v3/users` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:01:27.987627 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63f390e2-291c-45a3-afa1-45a6afb686fd admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 20:01:27.989555 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63f390e2-291c-45a3-afa1-45a6afb686fd admin admin] RBAC: Authorization granted {{(pid=82025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 20:01:28.014718 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.notifications [None req-23111e63-4a45-436d-a36c-d023712e96a1 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6bc8066a789345b39e4d63a6aed3ea91', 'request_id': 'req-23111e63-4a45-436d-a36c-d023712e96a1'} {{(pid=82026) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 20:01:28.020713 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.notifications [None req-23111e63-4a45-436d-a36c-d023712e96a1 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6bc8066a789345b39e4d63a6aed3ea91', 'request_id': 'req-23111e63-4a45-436d-a36c-d023712e96a1'} {{(pid=82026) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 20:01:28.032863 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.notifications [None req-23111e63-4a45-436d-a36c-d023712e96a1 admin admin] The token cache is being invalidate because project 6bc8066a789345b39e4d63a6aed3ea91 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82026) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 13 20:01:28.033164 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.notifications [None req-23111e63-4a45-436d-a36c-d023712e96a1 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82026) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 20:01:28.033843 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.notifications [None req-23111e63-4a45-436d-a36c-d023712e96a1 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82026) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 20:01:28.035637 dv-cinder-828806-6-smb devstack@keystone.service[82026]: [pid: 82026|app: 0|req: 1014/2076] 10.222.0.33 () {58 vars in 1233 bytes} [Tue Sep 13 20:01:27 2022] DELETE /identity/v3/projects/6bc8066a789345b39e4d63a6aed3ea91 => generated 0 bytes in 441 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 20:01:28.036774 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23111e63-4a45-436d-a36c-d023712e96a1 admin admin] Authenticating user token {{(pid=82026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 20:01:28.038210 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.common.fernet_utils [None req-23111e63-4a45-436d-a36c-d023712e96a1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82026) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 20:01:28.045629 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG dbcounter [-] [82025] Writing DB stats keystone:SELECT=86,keystone:DELETE=10,keystone:INSERT=4 {{(pid=82025) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 20:01:28.054184 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23111e63-4a45-436d-a36c-d023712e96a1 admin admin] Validating token access rules against request {{(pid=82026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 20:01:28.059823 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a739e3bf-6d07-42fc-96dc-ae7fd8e57303 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57539b6a6f3b4d589f5f5e1d211cd6a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b454f707d20347ada3d82aa85495635e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 20:01:28.060493 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a739e3bf-6d07-42fc-96dc-ae7fd8e57303 admin admin] REQUEST_METHOD: `GET` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:01:28.060785 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a739e3bf-6d07-42fc-96dc-ae7fd8e57303 admin admin] SCRIPT_NAME: `/identity` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:01:28.061067 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a739e3bf-6d07-42fc-96dc-ae7fd8e57303 admin admin] PATH_INFO: `/v3/roles` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:01:28.061724 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a739e3bf-6d07-42fc-96dc-ae7fd8e57303 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 20:01:28.063364 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a739e3bf-6d07-42fc-96dc-ae7fd8e57303 admin admin] RBAC: Authorization granted {{(pid=82026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 20:01:28.074704 dv-cinder-828806-6-smb devstack@keystone.service[82026]: [pid: 82026|app: 0|req: 1015/2077] 10.222.0.33 () {58 vars in 1122 bytes} [Tue Sep 13 20:01:28 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 13 20:01:28.075630 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a739e3bf-6d07-42fc-96dc-ae7fd8e57303 admin admin] Authenticating user token {{(pid=82026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 20:01:28.077549 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.common.fernet_utils [None req-a739e3bf-6d07-42fc-96dc-ae7fd8e57303 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82026) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 20:01:28.092466 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a739e3bf-6d07-42fc-96dc-ae7fd8e57303 admin admin] Validating token access rules against request {{(pid=82026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 20:01:28.097347 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-885e3316-6246-48ff-85cd-2c285c285c7a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57539b6a6f3b4d589f5f5e1d211cd6a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b454f707d20347ada3d82aa85495635e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 20:01:28.097968 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-885e3316-6246-48ff-85cd-2c285c285c7a admin admin] REQUEST_METHOD: `DELETE` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:01:28.098255 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-885e3316-6246-48ff-85cd-2c285c285c7a admin admin] SCRIPT_NAME: `/identity` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:01:28.098533 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-885e3316-6246-48ff-85cd-2c285c285c7a admin admin] PATH_INFO: `/v3/projects/a1768fa099c14eb09404bf06d352a5fa` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:01:28.099744 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-885e3316-6246-48ff-85cd-2c285c285c7a admin admin] RBAC: Authorizing `identity:delete_project(project_id=a1768fa099c14eb09404bf06d352a5fa)` {{(pid=82026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 20:01:28.101659 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-885e3316-6246-48ff-85cd-2c285c285c7a admin admin] RBAC: Authorization granted {{(pid=82026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 20:01:28.201049 dv-cinder-828806-6-smb devstack@keystone.service[82025]: [pid: 82025|app: 0|req: 1063/2078] 10.222.0.33 () {60 vars in 1144 bytes} [Tue Sep 13 20:01:27 2022] POST /identity/v3/users => generated 289 bytes in 290 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 13 20:01:28.202274 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63f390e2-291c-45a3-afa1-45a6afb686fd admin admin] Authenticating user token {{(pid=82025) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 20:01:28.204257 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.fernet_utils [None req-63f390e2-291c-45a3-afa1-45a6afb686fd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82025) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 20:01:28.216862 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.notifications [None req-885e3316-6246-48ff-85cd-2c285c285c7a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a1768fa099c14eb09404bf06d352a5fa', 'request_id': 'req-885e3316-6246-48ff-85cd-2c285c285c7a'} {{(pid=82026) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 20:01:28.217090 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63f390e2-291c-45a3-afa1-45a6afb686fd admin admin] Validating token access rules against request {{(pid=82025) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 20:01:28.273196 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24d26eac-2ec8-4e9d-9362-651d557d45bf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57539b6a6f3b4d589f5f5e1d211cd6a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b454f707d20347ada3d82aa85495635e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82025) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 20:01:28.273785 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24d26eac-2ec8-4e9d-9362-651d557d45bf admin admin] REQUEST_METHOD: `PUT` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:01:28.274072 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24d26eac-2ec8-4e9d-9362-651d557d45bf admin admin] SCRIPT_NAME: `/identity` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:01:28.274354 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24d26eac-2ec8-4e9d-9362-651d557d45bf admin admin] PATH_INFO: `/v3/projects/cdc4c0becf5b4293af9b7697d075fed3/users/d6faab30ee2b4bfdb23463bac89f6d85/roles/e5af7d5baa93469e9e486ef21c85474e` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:01:28.276482 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24d26eac-2ec8-4e9d-9362-651d557d45bf admin admin] RBAC: Authorizing `identity:create_grant(project_id=cdc4c0becf5b4293af9b7697d075fed3, user_id=d6faab30ee2b4bfdb23463bac89f6d85, role_id=e5af7d5baa93469e9e486ef21c85474e)` {{(pid=82025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 20:01:28.279223 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24d26eac-2ec8-4e9d-9362-651d557d45bf admin admin] RBAC: Authorization granted {{(pid=82025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 20:01:28.284806 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.notifications [None req-885e3316-6246-48ff-85cd-2c285c285c7a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a1768fa099c14eb09404bf06d352a5fa', 'request_id': 'req-885e3316-6246-48ff-85cd-2c285c285c7a'} {{(pid=82026) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 20:01:28.300856 dv-cinder-828806-6-smb devstack@keystone.service[82025]: [pid: 82025|app: 0|req: 1064/2079] 10.222.0.33 () {60 vars in 1483 bytes} [Tue Sep 13 20:01:28 2022] PUT /identity/v3/projects/cdc4c0becf5b4293af9b7697d075fed3/users/d6faab30ee2b4bfdb23463bac89f6d85/roles/e5af7d5baa93469e9e486ef21c85474e => generated 0 bytes in 89 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 20:01:28.300856 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d67d5f4-e419-4f5c-b889-d5a82f35a381 None None] REQUEST_METHOD: `POST` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:01:28.300856 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d67d5f4-e419-4f5c-b889-d5a82f35a381 None None] SCRIPT_NAME: `/identity` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:01:28.300856 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d67d5f4-e419-4f5c-b889-d5a82f35a381 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:01:28.303265 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.notifications [None req-885e3316-6246-48ff-85cd-2c285c285c7a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a1768fa099c14eb09404bf06d352a5fa', 'request_id': 'req-885e3316-6246-48ff-85cd-2c285c285c7a'} {{(pid=82026) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 20:01:28.314997 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.auth.core [None req-8d67d5f4-e419-4f5c-b889-d5a82f35a381 None None] MFA Rules not processed for user `57539b6a6f3b4d589f5f5e1d211cd6a0`. Rule list: `[]` (Enabled: `True`). {{(pid=82025) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 20:01:28.316238 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.fernet_utils [None req-8d67d5f4-e419-4f5c-b889-d5a82f35a381 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82025) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 20:01:28.317377 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.notifications [None req-885e3316-6246-48ff-85cd-2c285c285c7a admin admin] The token cache is being invalidate because project a1768fa099c14eb09404bf06d352a5fa was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82026) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 13 20:01:28.317666 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.notifications [None req-885e3316-6246-48ff-85cd-2c285c285c7a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82026) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 20:01:28.318383 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.notifications [None req-885e3316-6246-48ff-85cd-2c285c285c7a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82026) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 20:01:28.319949 dv-cinder-828806-6-smb devstack@keystone.service[82026]: [pid: 82026|app: 0|req: 1016/2080] 10.222.0.33 () {58 vars in 1233 bytes} [Tue Sep 13 20:01:28 2022] DELETE /identity/v3/projects/a1768fa099c14eb09404bf06d352a5fa => generated 0 bytes in 245 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 20:01:28.323993 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-885e3316-6246-48ff-85cd-2c285c285c7a admin admin] Authenticating user token {{(pid=82026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 20:01:28.323993 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.common.fernet_utils [None req-885e3316-6246-48ff-85cd-2c285c285c7a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82026) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 20:01:28.336874 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-885e3316-6246-48ff-85cd-2c285c285c7a admin admin] Validating token access rules against request {{(pid=82026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 20:01:28.353035 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG dbcounter [-] [82026] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=82026) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 20:01:28.384868 dv-cinder-828806-6-smb devstack@keystone.service[82025]: [pid: 82025|app: 0|req: 1065/2081] 10.222.0.33 () {58 vars in 958 bytes} [Tue Sep 13 20:01:28 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 20:01:28.384868 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d67d5f4-e419-4f5c-b889-d5a82f35a381 None None] Authenticating user token {{(pid=82025) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 20:01:28.384868 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.fernet_utils [None req-8d67d5f4-e419-4f5c-b889-d5a82f35a381 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82025) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 20:01:28.392388 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d67d5f4-e419-4f5c-b889-d5a82f35a381 None None] Validating token access rules against request {{(pid=82025) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 20:01:28.397211 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b302df48-adca-4046-b845-7bc27136bd63 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57539b6a6f3b4d589f5f5e1d211cd6a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b454f707d20347ada3d82aa85495635e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82025) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 20:01:28.397806 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b302df48-adca-4046-b845-7bc27136bd63 admin admin] REQUEST_METHOD: `GET` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:01:28.398139 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b302df48-adca-4046-b845-7bc27136bd63 admin admin] SCRIPT_NAME: `/identity` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:01:28.398420 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b302df48-adca-4046-b845-7bc27136bd63 admin admin] PATH_INFO: `/v3/roles` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:01:28.399082 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b302df48-adca-4046-b845-7bc27136bd63 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 20:01:28.399967 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2851090-12b7-4f66-87aa-ee47ec5718d1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57539b6a6f3b4d589f5f5e1d211cd6a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b454f707d20347ada3d82aa85495635e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 20:01:28.400660 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2851090-12b7-4f66-87aa-ee47ec5718d1 admin admin] REQUEST_METHOD: `GET` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:01:28.401281 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b302df48-adca-4046-b845-7bc27136bd63 admin admin] RBAC: Authorization granted {{(pid=82025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 20:01:28.401636 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2851090-12b7-4f66-87aa-ee47ec5718d1 admin admin] SCRIPT_NAME: `/identity` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:01:28.402119 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2851090-12b7-4f66-87aa-ee47ec5718d1 admin admin] PATH_INFO: `/v3/roles` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:01:28.402818 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2851090-12b7-4f66-87aa-ee47ec5718d1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 20:01:28.404462 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2851090-12b7-4f66-87aa-ee47ec5718d1 admin admin] RBAC: Authorization granted {{(pid=82026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 20:01:28.411552 dv-cinder-828806-6-smb devstack@keystone.service[82025]: [pid: 82025|app: 0|req: 1066/2082] 10.222.0.33 () {58 vars in 1122 bytes} [Tue Sep 13 20:01:28 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 13 20:01:28.412738 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21ad15e7-2ed4-4b0c-aece-5486867e19f6 None None] REQUEST_METHOD: `POST` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:01:28.413305 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21ad15e7-2ed4-4b0c-aece-5486867e19f6 None None] SCRIPT_NAME: `/identity` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:01:28.413305 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21ad15e7-2ed4-4b0c-aece-5486867e19f6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:01:28.417737 dv-cinder-828806-6-smb devstack@keystone.service[82026]: [pid: 82026|app: 0|req: 1017/2083] 10.222.0.33 () {58 vars in 1122 bytes} [Tue Sep 13 20:01:28 2022] GET /identity/v3/roles => generated 1420 bytes in 94 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 13 20:01:28.417737 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83c9f1fe-e572-4c77-af70-066b19a80bc5 None None] REQUEST_METHOD: `POST` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:01:28.417737 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83c9f1fe-e572-4c77-af70-066b19a80bc5 None None] SCRIPT_NAME: `/identity` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:01:28.417737 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83c9f1fe-e572-4c77-af70-066b19a80bc5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:01:28.436436 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.auth.core [None req-83c9f1fe-e572-4c77-af70-066b19a80bc5 None None] MFA Rules not processed for user `57539b6a6f3b4d589f5f5e1d211cd6a0`. Rule list: `[]` (Enabled: `True`). {{(pid=82026) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 20:01:28.437851 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.common.fernet_utils [None req-83c9f1fe-e572-4c77-af70-066b19a80bc5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82026) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 20:01:28.451910 dv-cinder-828806-6-smb devstack@keystone.service[82026]: [pid: 82026|app: 0|req: 1018/2084] 10.222.0.33 () {58 vars in 958 bytes} [Tue Sep 13 20:01:28 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 20:01:28.451910 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2f8ab52-2512-4c47-98c3-8d4008ff8847 None None] REQUEST_METHOD: `POST` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:01:28.451910 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2f8ab52-2512-4c47-98c3-8d4008ff8847 None None] SCRIPT_NAME: `/identity` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:01:28.451910 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2f8ab52-2512-4c47-98c3-8d4008ff8847 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:01:28.454852 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.auth.core [None req-21ad15e7-2ed4-4b0c-aece-5486867e19f6 None None] MFA Rules not processed for user `d6faab30ee2b4bfdb23463bac89f6d85`. Rule list: `[]` (Enabled: `True`). {{(pid=82025) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 20:01:28.456207 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.fernet_utils [None req-21ad15e7-2ed4-4b0c-aece-5486867e19f6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82025) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 20:01:28.470940 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.auth.core [None req-e2f8ab52-2512-4c47-98c3-8d4008ff8847 None None] MFA Rules not processed for user `57539b6a6f3b4d589f5f5e1d211cd6a0`. Rule list: `[]` (Enabled: `True`). {{(pid=82026) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 20:01:28.473065 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.common.fernet_utils [None req-e2f8ab52-2512-4c47-98c3-8d4008ff8847 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82026) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 20:01:28.481531 dv-cinder-828806-6-smb devstack@keystone.service[82026]: [pid: 82026|app: 0|req: 1019/2085] 10.222.0.33 () {58 vars in 958 bytes} [Tue Sep 13 20:01:28 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 20:01:28.482311 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2f8ab52-2512-4c47-98c3-8d4008ff8847 None None] Authenticating user token {{(pid=82026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 20:01:28.492243 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2f8ab52-2512-4c47-98c3-8d4008ff8847 None None] Validating token access rules against request {{(pid=82026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 20:01:28.497577 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4af2f691-698b-49da-97cc-b6c4cd5af52f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57539b6a6f3b4d589f5f5e1d211cd6a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b454f707d20347ada3d82aa85495635e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 20:01:28.498381 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4af2f691-698b-49da-97cc-b6c4cd5af52f admin admin] REQUEST_METHOD: `GET` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:01:28.498670 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4af2f691-698b-49da-97cc-b6c4cd5af52f admin admin] SCRIPT_NAME: `/identity` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:01:28.498954 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4af2f691-698b-49da-97cc-b6c4cd5af52f admin admin] PATH_INFO: `/v3/roles` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:01:28.499854 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4af2f691-698b-49da-97cc-b6c4cd5af52f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 20:01:28.501465 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4af2f691-698b-49da-97cc-b6c4cd5af52f admin admin] RBAC: Authorization granted {{(pid=82026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 20:01:28.513021 dv-cinder-828806-6-smb devstack@keystone.service[82026]: [pid: 82026|app: 0|req: 1020/2086] 10.222.0.33 () {58 vars in 1122 bytes} [Tue Sep 13 20:01:28 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 13 20:01:28.513811 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4af2f691-698b-49da-97cc-b6c4cd5af52f admin admin] Authenticating user token {{(pid=82026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 20:01:28.526517 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4af2f691-698b-49da-97cc-b6c4cd5af52f admin admin] Validating token access rules against request {{(pid=82026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 20:01:28.531306 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b575304-3cb3-445e-995f-7810f8384cbe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57539b6a6f3b4d589f5f5e1d211cd6a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b454f707d20347ada3d82aa85495635e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 20:01:28.531952 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b575304-3cb3-445e-995f-7810f8384cbe admin admin] REQUEST_METHOD: `PUT` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:01:28.532240 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b575304-3cb3-445e-995f-7810f8384cbe admin admin] SCRIPT_NAME: `/identity` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:01:28.532521 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b575304-3cb3-445e-995f-7810f8384cbe admin admin] PATH_INFO: `/v3/projects/8f5c5a9abf6b4366a6ff90dba40edba3/users/1c2e721388804b1c8bed6ee356fce720/roles/3618ab638a65401f82333da7596d1daf` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:01:28.536685 dv-cinder-828806-6-smb devstack@keystone.service[82025]: [pid: 82025|app: 0|req: 1067/2087] 10.222.0.33 () {58 vars in 958 bytes} [Tue Sep 13 20:01:28 2022] POST /identity/v3/auth/tokens => generated 3305 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 20:01:28.536685 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d34d5c13-4aca-4380-a38f-e781bed79807 None None] REQUEST_METHOD: `POST` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:01:28.536685 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d34d5c13-4aca-4380-a38f-e781bed79807 None None] SCRIPT_NAME: `/identity` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:01:28.536685 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d34d5c13-4aca-4380-a38f-e781bed79807 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:01:28.547939 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b575304-3cb3-445e-995f-7810f8384cbe admin admin] RBAC: Authorizing `identity:create_grant(project_id=8f5c5a9abf6b4366a6ff90dba40edba3, user_id=1c2e721388804b1c8bed6ee356fce720, role_id=3618ab638a65401f82333da7596d1daf)` {{(pid=82026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 20:01:28.549928 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG dbcounter [-] [82025] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=82025) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 20:01:28.550474 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b575304-3cb3-445e-995f-7810f8384cbe admin admin] RBAC: Authorization granted {{(pid=82026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 20:01:28.560109 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.auth.core [None req-d34d5c13-4aca-4380-a38f-e781bed79807 None None] MFA Rules not processed for user `57539b6a6f3b4d589f5f5e1d211cd6a0`. Rule list: `[]` (Enabled: `True`). {{(pid=82025) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 20:01:28.560109 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.fernet_utils [None req-d34d5c13-4aca-4380-a38f-e781bed79807 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82025) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 20:01:28.566969 dv-cinder-828806-6-smb devstack@keystone.service[82025]: [pid: 82025|app: 0|req: 1068/2088] 10.222.0.33 () {58 vars in 958 bytes} [Tue Sep 13 20:01:28 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 20:01:28.567766 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d34d5c13-4aca-4380-a38f-e781bed79807 None None] Authenticating user token {{(pid=82025) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 20:01:28.578329 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d34d5c13-4aca-4380-a38f-e781bed79807 None None] Validating token access rules against request {{(pid=82025) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 20:01:28.583319 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09c21a50-1175-491d-9e07-39d981d5a014 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57539b6a6f3b4d589f5f5e1d211cd6a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b454f707d20347ada3d82aa85495635e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82025) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 20:01:28.583893 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09c21a50-1175-491d-9e07-39d981d5a014 admin admin] REQUEST_METHOD: `GET` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:01:28.584174 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09c21a50-1175-491d-9e07-39d981d5a014 admin admin] SCRIPT_NAME: `/identity` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:01:28.584448 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09c21a50-1175-491d-9e07-39d981d5a014 admin admin] PATH_INFO: `/v3/domains` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:01:28.585110 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09c21a50-1175-491d-9e07-39d981d5a014 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82025) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 20:01:28.585412 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09c21a50-1175-491d-9e07-39d981d5a014 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 20:01:28.586999 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09c21a50-1175-491d-9e07-39d981d5a014 admin admin] RBAC: Authorization granted {{(pid=82025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 20:01:28.598297 dv-cinder-828806-6-smb devstack@keystone.service[82025]: [pid: 82025|app: 0|req: 1069/2089] 10.222.0.33 () {58 vars in 1153 bytes} [Tue Sep 13 20:01:28 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 20:01:28.599042 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09c21a50-1175-491d-9e07-39d981d5a014 admin admin] Authenticating user token {{(pid=82025) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 20:01:28.608298 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09c21a50-1175-491d-9e07-39d981d5a014 admin admin] Validating token access rules against request {{(pid=82025) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 20:01:28.613272 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-695995cd-3f32-479b-9bd3-09fb8382eb1a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57539b6a6f3b4d589f5f5e1d211cd6a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b454f707d20347ada3d82aa85495635e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82025) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 20:01:28.613878 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-695995cd-3f32-479b-9bd3-09fb8382eb1a admin admin] REQUEST_METHOD: `PUT` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:01:28.614159 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-695995cd-3f32-479b-9bd3-09fb8382eb1a admin admin] SCRIPT_NAME: `/identity` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:01:28.614434 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-695995cd-3f32-479b-9bd3-09fb8382eb1a admin admin] PATH_INFO: `/v3/projects/6bd5d5a3fa254e7b9b520a6e9b1f7281/users/bc749e2c9e474a149a34560bb623b8ec/roles/3618ab638a65401f82333da7596d1daf` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:01:28.629777 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-695995cd-3f32-479b-9bd3-09fb8382eb1a admin admin] RBAC: Authorizing `identity:create_grant(project_id=6bd5d5a3fa254e7b9b520a6e9b1f7281, user_id=bc749e2c9e474a149a34560bb623b8ec, role_id=3618ab638a65401f82333da7596d1daf)` {{(pid=82025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 20:01:28.632669 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-695995cd-3f32-479b-9bd3-09fb8382eb1a admin admin] RBAC: Authorization granted {{(pid=82025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 20:01:28.885578 dv-cinder-828806-6-smb devstack@keystone.service[82026]: [pid: 82026|app: 0|req: 1021/2090] 10.222.0.33 () {60 vars in 1483 bytes} [Tue Sep 13 20:01:28 2022] PUT /identity/v3/projects/8f5c5a9abf6b4366a6ff90dba40edba3/users/1c2e721388804b1c8bed6ee356fce720/roles/3618ab638a65401f82333da7596d1daf => generated 0 bytes in 371 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 20:01:28.887050 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b575304-3cb3-445e-995f-7810f8384cbe admin admin] Authenticating user token {{(pid=82026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 20:01:28.889354 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.common.fernet_utils [None req-3b575304-3cb3-445e-995f-7810f8384cbe admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82026) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 20:01:28.894238 dv-cinder-828806-6-smb devstack@keystone.service[82025]: [pid: 82025|app: 0|req: 1070/2091] 10.222.0.33 () {60 vars in 1483 bytes} [Tue Sep 13 20:01:28 2022] PUT /identity/v3/projects/6bd5d5a3fa254e7b9b520a6e9b1f7281/users/bc749e2c9e474a149a34560bb623b8ec/roles/3618ab638a65401f82333da7596d1daf => generated 0 bytes in 295 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 20:01:28.895200 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-695995cd-3f32-479b-9bd3-09fb8382eb1a admin admin] Authenticating user token {{(pid=82025) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 20:01:28.956480 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b575304-3cb3-445e-995f-7810f8384cbe admin admin] Validating token access rules against request {{(pid=82026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 20:01:28.963533 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-695995cd-3f32-479b-9bd3-09fb8382eb1a admin admin] Validating token access rules against request {{(pid=82025) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 20:01:28.969140 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d118c035-9b3a-4fdf-9fea-bf5041974c0c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57539b6a6f3b4d589f5f5e1d211cd6a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b454f707d20347ada3d82aa85495635e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82025) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 20:01:28.969749 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d118c035-9b3a-4fdf-9fea-bf5041974c0c admin admin] REQUEST_METHOD: `GET` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:01:28.970031 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d118c035-9b3a-4fdf-9fea-bf5041974c0c admin admin] SCRIPT_NAME: `/identity` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:01:28.970308 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d118c035-9b3a-4fdf-9fea-bf5041974c0c admin admin] PATH_INFO: `/v3/domains` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:01:28.970952 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d118c035-9b3a-4fdf-9fea-bf5041974c0c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82025) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 20:01:28.971292 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d118c035-9b3a-4fdf-9fea-bf5041974c0c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 20:01:28.972890 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d118c035-9b3a-4fdf-9fea-bf5041974c0c admin admin] RBAC: Authorization granted {{(pid=82025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 20:01:28.988827 dv-cinder-828806-6-smb devstack@keystone.service[82025]: [pid: 82025|app: 0|req: 1071/2092] 10.222.0.33 () {58 vars in 1153 bytes} [Tue Sep 13 20:01:28 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 91 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 20:01:28.988827 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d118c035-9b3a-4fdf-9fea-bf5041974c0c admin admin] Authenticating user token {{(pid=82025) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 20:01:28.996539 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d118c035-9b3a-4fdf-9fea-bf5041974c0c admin admin] Validating token access rules against request {{(pid=82025) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 20:01:29.001331 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b5ccd20-125f-4870-8237-af3cd4691e21 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57539b6a6f3b4d589f5f5e1d211cd6a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b454f707d20347ada3d82aa85495635e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82025) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 20:01:29.001935 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b5ccd20-125f-4870-8237-af3cd4691e21 admin admin] REQUEST_METHOD: `POST` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:01:29.002420 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b5ccd20-125f-4870-8237-af3cd4691e21 admin admin] SCRIPT_NAME: `/identity` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:01:29.002536 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b5ccd20-125f-4870-8237-af3cd4691e21 admin admin] PATH_INFO: `/v3/projects` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:01:29.003157 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b5ccd20-125f-4870-8237-af3cd4691e21 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 20:01:29.008830 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b5ccd20-125f-4870-8237-af3cd4691e21 admin admin] RBAC: Authorization granted {{(pid=82025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 20:01:29.008938 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a718600-fd7a-4a98-986a-eac66dab18dc service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46024fc6167f4321818b1bed27a521a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8c6fba0f15b4d6a84ff601919b7b8e4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 20:01:29.008938 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a718600-fd7a-4a98-986a-eac66dab18dc service cinder] REQUEST_METHOD: `GET` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:01:29.008938 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a718600-fd7a-4a98-986a-eac66dab18dc service cinder] SCRIPT_NAME: `/identity` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:01:29.008938 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a718600-fd7a-4a98-986a-eac66dab18dc service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:01:29.028260 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG dbcounter [-] [82026] Writing DB stats keystone:SELECT=100 {{(pid=82026) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 20:01:29.068976 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a718600-fd7a-4a98-986a-eac66dab18dc service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=82026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 20:01:29.070435 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a718600-fd7a-4a98-986a-eac66dab18dc service cinder] RBAC: Authorization granted {{(pid=82026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 20:01:29.080916 dv-cinder-828806-6-smb devstack@keystone.service[82026]: [pid: 82026|app: 0|req: 1022/2093] 10.222.0.33 () {60 vars in 1365 bytes} [Tue Sep 13 20:01:28 2022] GET /identity/v3/auth/tokens => generated 3305 bytes in 194 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 20:01:29.081797 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a718600-fd7a-4a98-986a-eac66dab18dc service cinder] Authenticating user token {{(pid=82026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 20:01:29.083348 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.common.fernet_utils [None req-1a718600-fd7a-4a98-986a-eac66dab18dc service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82026) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 20:01:29.090193 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG dbcounter [-] [82025] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82025) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 20:01:29.097248 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a718600-fd7a-4a98-986a-eac66dab18dc service cinder] Validating token access rules against request {{(pid=82026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 20:01:29.102743 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d04f91a9-1d80-4610-9543-f84f88ba2103 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57539b6a6f3b4d589f5f5e1d211cd6a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b454f707d20347ada3d82aa85495635e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 20:01:29.103408 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d04f91a9-1d80-4610-9543-f84f88ba2103 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:01:29.103743 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d04f91a9-1d80-4610-9543-f84f88ba2103 admin admin] SCRIPT_NAME: `/identity` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:01:29.104221 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d04f91a9-1d80-4610-9543-f84f88ba2103 admin admin] PATH_INFO: `/v3/users/ab6531df40574bd1988649c6783e714f` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:01:29.105394 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d04f91a9-1d80-4610-9543-f84f88ba2103 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ab6531df40574bd1988649c6783e714f)` {{(pid=82026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 20:01:29.107391 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d04f91a9-1d80-4610-9543-f84f88ba2103 admin admin] RBAC: Authorization granted {{(pid=82026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 20:01:29.135514 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG dbcounter [-] [82026] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=82026) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 20:01:29.170770 dv-cinder-828806-6-smb devstack@keystone.service[82025]: [pid: 82025|app: 0|req: 1072/2094] 10.222.0.33 () {60 vars in 1153 bytes} [Tue Sep 13 20:01:28 2022] POST /identity/v3/projects => generated 383 bytes in 179 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 13 20:01:29.170770 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b1e069a-148e-4804-aa76-b438aae0df6e None None] REQUEST_METHOD: `POST` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:01:29.170770 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b1e069a-148e-4804-aa76-b438aae0df6e None None] SCRIPT_NAME: `/identity` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:01:29.170770 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b1e069a-148e-4804-aa76-b438aae0df6e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:01:29.189377 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.auth.core [None req-1b1e069a-148e-4804-aa76-b438aae0df6e None None] MFA Rules not processed for user `57539b6a6f3b4d589f5f5e1d211cd6a0`. Rule list: `[]` (Enabled: `True`). {{(pid=82025) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 20:01:29.190596 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.fernet_utils [None req-1b1e069a-148e-4804-aa76-b438aae0df6e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82025) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 20:01:29.250514 dv-cinder-828806-6-smb devstack@keystone.service[82025]: [pid: 82025|app: 0|req: 1073/2095] 10.222.0.33 () {58 vars in 958 bytes} [Tue Sep 13 20:01:29 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 20:01:29.251777 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50a05665-dca3-42ce-b415-32340efff891 None None] REQUEST_METHOD: `POST` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:01:29.252066 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50a05665-dca3-42ce-b415-32340efff891 None None] SCRIPT_NAME: `/identity` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:01:29.252342 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50a05665-dca3-42ce-b415-32340efff891 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:01:29.277652 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.notifications [None req-d04f91a9-1d80-4610-9543-f84f88ba2103 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ab6531df40574bd1988649c6783e714f'} {{(pid=82026) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 20:01:29.280279 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.auth.core [None req-50a05665-dca3-42ce-b415-32340efff891 None None] MFA Rules not processed for user `bc749e2c9e474a149a34560bb623b8ec`. Rule list: `[]` (Enabled: `True`). {{(pid=82025) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 20:01:29.281431 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.fernet_utils [None req-50a05665-dca3-42ce-b415-32340efff891 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82025) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 20:01:29.356800 dv-cinder-828806-6-smb devstack@keystone.service[82025]: [pid: 82025|app: 0|req: 1074/2096] 10.222.0.33 () {58 vars in 958 bytes} [Tue Sep 13 20:01:29 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 20:01:29.357610 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50a05665-dca3-42ce-b415-32340efff891 None None] Authenticating user token {{(pid=82025) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 20:01:29.367661 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50a05665-dca3-42ce-b415-32340efff891 None None] Validating token access rules against request {{(pid=82025) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 20:01:29.372795 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10e8a275-346b-4415-a7b1-739def868a85 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57539b6a6f3b4d589f5f5e1d211cd6a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b454f707d20347ada3d82aa85495635e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82025) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 20:01:29.373388 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10e8a275-346b-4415-a7b1-739def868a85 admin admin] REQUEST_METHOD: `POST` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:01:29.373669 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10e8a275-346b-4415-a7b1-739def868a85 admin admin] SCRIPT_NAME: `/identity` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:01:29.373969 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10e8a275-346b-4415-a7b1-739def868a85 admin admin] PATH_INFO: `/v3/projects` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:01:29.374608 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10e8a275-346b-4415-a7b1-739def868a85 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 20:01:29.375721 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.notifications [None req-d04f91a9-1d80-4610-9543-f84f88ba2103 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ab6531df40574bd1988649c6783e714f'} {{(pid=82026) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 20:01:29.376635 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10e8a275-346b-4415-a7b1-739def868a85 admin admin] RBAC: Authorization granted {{(pid=82025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 20:01:29.389095 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.notifications [None req-d04f91a9-1d80-4610-9543-f84f88ba2103 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ab6531df40574bd1988649c6783e714f'} {{(pid=82026) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 20:01:29.389875 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.notifications [None req-d04f91a9-1d80-4610-9543-f84f88ba2103 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ab6531df40574bd1988649c6783e714f'} {{(pid=82026) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 20:01:29.396804 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.notifications [None req-d04f91a9-1d80-4610-9543-f84f88ba2103 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ab6531df40574bd1988649c6783e714f'} {{(pid=82026) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 20:01:29.402822 dv-cinder-828806-6-smb devstack@keystone.service[82026]: [pid: 82026|app: 0|req: 1023/2097] 10.222.0.33 () {58 vars in 1224 bytes} [Tue Sep 13 20:01:29 2022] DELETE /identity/v3/users/ab6531df40574bd1988649c6783e714f => generated 0 bytes in 321 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 20:01:29.403708 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d04f91a9-1d80-4610-9543-f84f88ba2103 admin admin] Authenticating user token {{(pid=82026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 20:01:29.405043 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.common.fernet_utils [None req-d04f91a9-1d80-4610-9543-f84f88ba2103 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82026) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 20:01:29.435538 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG dbcounter [-] [82026] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=82026) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 20:01:29.472790 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d04f91a9-1d80-4610-9543-f84f88ba2103 admin admin] Validating token access rules against request {{(pid=82026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 20:01:29.473869 dv-cinder-828806-6-smb devstack@keystone.service[82025]: [pid: 82025|app: 0|req: 1075/2098] 10.222.0.33 () {60 vars in 1153 bytes} [Tue Sep 13 20:01:29 2022] POST /identity/v3/projects => generated 377 bytes in 116 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 13 20:01:29.474652 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10e8a275-346b-4415-a7b1-739def868a85 admin admin] Authenticating user token {{(pid=82025) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 20:01:29.476229 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.fernet_utils [None req-10e8a275-346b-4415-a7b1-739def868a85 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82025) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 20:01:29.484730 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG dbcounter [-] [82025] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=82025) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 20:01:29.530186 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-419f863c-39de-4e9b-9729-b34042e186bb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57539b6a6f3b4d589f5f5e1d211cd6a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b454f707d20347ada3d82aa85495635e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 20:01:29.530852 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-419f863c-39de-4e9b-9729-b34042e186bb admin admin] REQUEST_METHOD: `POST` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:01:29.531113 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-419f863c-39de-4e9b-9729-b34042e186bb admin admin] SCRIPT_NAME: `/identity` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:01:29.531397 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-419f863c-39de-4e9b-9729-b34042e186bb admin admin] PATH_INFO: `/v3/users` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:01:29.532037 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-419f863c-39de-4e9b-9729-b34042e186bb admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 20:01:29.534017 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-419f863c-39de-4e9b-9729-b34042e186bb admin admin] RBAC: Authorization granted {{(pid=82026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 20:01:29.537469 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10e8a275-346b-4415-a7b1-739def868a85 admin admin] Validating token access rules against request {{(pid=82025) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 20:01:29.542548 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cea3ca5-7911-4b74-a798-ad8eb88b3b45 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '023a2c79c2444611b3d431928e56685d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8c6fba0f15b4d6a84ff601919b7b8e4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82025) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 20:01:29.542836 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cea3ca5-7911-4b74-a798-ad8eb88b3b45 service neutron] REQUEST_METHOD: `GET` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:01:29.543164 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cea3ca5-7911-4b74-a798-ad8eb88b3b45 service neutron] SCRIPT_NAME: `/identity` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:01:29.543448 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cea3ca5-7911-4b74-a798-ad8eb88b3b45 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:01:29.546730 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.fernet_utils [None req-9cea3ca5-7911-4b74-a798-ad8eb88b3b45 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82025) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 20:01:29.560008 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cea3ca5-7911-4b74-a798-ad8eb88b3b45 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 20:01:29.561831 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cea3ca5-7911-4b74-a798-ad8eb88b3b45 service neutron] RBAC: Authorization granted {{(pid=82025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 20:01:29.571591 dv-cinder-828806-6-smb devstack@keystone.service[82025]: [pid: 82025|app: 0|req: 1076/2099] 10.222.0.33 () {60 vars in 1365 bytes} [Tue Sep 13 20:01:29 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 97 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 20:01:29.575237 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cea3ca5-7911-4b74-a798-ad8eb88b3b45 service neutron] Authenticating user token {{(pid=82025) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 20:01:29.575237 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.fernet_utils [None req-9cea3ca5-7911-4b74-a798-ad8eb88b3b45 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82025) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 20:01:29.632110 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cea3ca5-7911-4b74-a798-ad8eb88b3b45 service neutron] Validating token access rules against request {{(pid=82025) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 20:01:29.636426 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84ff12ef-b3b5-4d1f-a696-34d85dd7fca7 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46024fc6167f4321818b1bed27a521a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8c6fba0f15b4d6a84ff601919b7b8e4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82025) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 20:01:29.637026 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84ff12ef-b3b5-4d1f-a696-34d85dd7fca7 service cinder] REQUEST_METHOD: `GET` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:01:29.637307 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84ff12ef-b3b5-4d1f-a696-34d85dd7fca7 service cinder] SCRIPT_NAME: `/identity` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:01:29.637581 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84ff12ef-b3b5-4d1f-a696-34d85dd7fca7 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:01:29.639369 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.fernet_utils [None req-84ff12ef-b3b5-4d1f-a696-34d85dd7fca7 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82025) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 20:01:29.670665 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG dbcounter [-] [82026] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82026) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 20:01:29.671975 dv-cinder-828806-6-smb devstack@keystone.service[82026]: [pid: 82026|app: 0|req: 1024/2100] 10.222.0.33 () {60 vars in 1144 bytes} [Tue Sep 13 20:01:29 2022] POST /identity/v3/users => generated 292 bytes in 268 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 13 20:01:29.678236 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef593b9e-df91-48a1-8077-37bca3755814 None None] REQUEST_METHOD: `POST` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:01:29.678236 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef593b9e-df91-48a1-8077-37bca3755814 None None] SCRIPT_NAME: `/identity` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:01:29.678236 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef593b9e-df91-48a1-8077-37bca3755814 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:01:29.700024 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.auth.core [None req-ef593b9e-df91-48a1-8077-37bca3755814 None None] MFA Rules not processed for user `57539b6a6f3b4d589f5f5e1d211cd6a0`. Rule list: `[]` (Enabled: `True`). {{(pid=82026) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 20:01:29.706998 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.common.fernet_utils [None req-ef593b9e-df91-48a1-8077-37bca3755814 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82026) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 20:01:29.715889 dv-cinder-828806-6-smb devstack@keystone.service[82026]: [pid: 82026|app: 0|req: 1025/2101] 10.222.0.33 () {58 vars in 958 bytes} [Tue Sep 13 20:01:29 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 43 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 20:01:29.716803 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef593b9e-df91-48a1-8077-37bca3755814 None None] Authenticating user token {{(pid=82026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 20:01:29.718164 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.common.fernet_utils [None req-ef593b9e-df91-48a1-8077-37bca3755814 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82026) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 20:01:29.728236 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84ff12ef-b3b5-4d1f-a696-34d85dd7fca7 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=82025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 20:01:29.728236 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84ff12ef-b3b5-4d1f-a696-34d85dd7fca7 service cinder] RBAC: Authorization granted {{(pid=82025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 20:01:29.733634 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef593b9e-df91-48a1-8077-37bca3755814 None None] Validating token access rules against request {{(pid=82026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 20:01:29.740466 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3180d7f6-c4ce-436f-b28e-f95aa85bd0fe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57539b6a6f3b4d589f5f5e1d211cd6a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b454f707d20347ada3d82aa85495635e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 20:01:29.741094 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3180d7f6-c4ce-436f-b28e-f95aa85bd0fe admin admin] REQUEST_METHOD: `POST` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:01:29.741455 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3180d7f6-c4ce-436f-b28e-f95aa85bd0fe admin admin] SCRIPT_NAME: `/identity` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:01:29.741911 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3180d7f6-c4ce-436f-b28e-f95aa85bd0fe admin admin] PATH_INFO: `/v3/users` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:01:29.743330 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3180d7f6-c4ce-436f-b28e-f95aa85bd0fe admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 20:01:29.743971 dv-cinder-828806-6-smb devstack@keystone.service[82025]: [pid: 82025|app: 0|req: 1077/2102] 10.222.0.33 () {60 vars in 1365 bytes} [Tue Sep 13 20:01:29 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 172 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 20:01:29.745734 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84ff12ef-b3b5-4d1f-a696-34d85dd7fca7 service cinder] Authenticating user token {{(pid=82025) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 20:01:29.763281 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84ff12ef-b3b5-4d1f-a696-34d85dd7fca7 service cinder] Validating token access rules against request {{(pid=82025) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 20:01:29.764450 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3180d7f6-c4ce-436f-b28e-f95aa85bd0fe admin admin] RBAC: Authorization granted {{(pid=82026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 20:01:29.768479 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-016f6489-1da1-4675-a66c-5595cb6cf27f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57539b6a6f3b4d589f5f5e1d211cd6a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b454f707d20347ada3d82aa85495635e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82025) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 20:01:29.769364 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-016f6489-1da1-4675-a66c-5595cb6cf27f admin admin] REQUEST_METHOD: `GET` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:01:29.769892 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-016f6489-1da1-4675-a66c-5595cb6cf27f admin admin] SCRIPT_NAME: `/identity` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:01:29.770339 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-016f6489-1da1-4675-a66c-5595cb6cf27f admin admin] PATH_INFO: `/v3/roles` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:01:29.771253 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-016f6489-1da1-4675-a66c-5595cb6cf27f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 20:01:29.774227 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-016f6489-1da1-4675-a66c-5595cb6cf27f admin admin] RBAC: Authorization granted {{(pid=82025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 20:01:29.789476 dv-cinder-828806-6-smb devstack@keystone.service[82025]: [pid: 82025|app: 0|req: 1078/2103] 10.222.0.33 () {58 vars in 1122 bytes} [Tue Sep 13 20:01:29 2022] GET /identity/v3/roles => generated 1420 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 13 20:01:29.789476 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-016f6489-1da1-4675-a66c-5595cb6cf27f admin admin] Authenticating user token {{(pid=82025) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 20:01:29.795694 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.fernet_utils [None req-016f6489-1da1-4675-a66c-5595cb6cf27f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82025) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 20:01:29.815154 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-016f6489-1da1-4675-a66c-5595cb6cf27f admin admin] Validating token access rules against request {{(pid=82025) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 20:01:29.821050 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d832d1c7-ec3e-4220-b79f-4afaf24f8dfd service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '023a2c79c2444611b3d431928e56685d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8c6fba0f15b4d6a84ff601919b7b8e4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82025) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 20:01:29.821737 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d832d1c7-ec3e-4220-b79f-4afaf24f8dfd service neutron] REQUEST_METHOD: `GET` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:01:29.822021 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d832d1c7-ec3e-4220-b79f-4afaf24f8dfd service neutron] SCRIPT_NAME: `/identity` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:01:29.822742 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d832d1c7-ec3e-4220-b79f-4afaf24f8dfd service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:01:29.833195 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d832d1c7-ec3e-4220-b79f-4afaf24f8dfd service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 20:01:29.834625 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d832d1c7-ec3e-4220-b79f-4afaf24f8dfd service neutron] RBAC: Authorization granted {{(pid=82025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 20:01:29.845273 dv-cinder-828806-6-smb devstack@keystone.service[82025]: [pid: 82025|app: 0|req: 1079/2104] 10.222.0.33 () {60 vars in 1365 bytes} [Tue Sep 13 20:01:29 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 56 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 20:01:29.846198 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d832d1c7-ec3e-4220-b79f-4afaf24f8dfd service neutron] Authenticating user token {{(pid=82025) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 20:01:29.857756 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d832d1c7-ec3e-4220-b79f-4afaf24f8dfd service neutron] Validating token access rules against request {{(pid=82025) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 20:01:29.862630 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79a31430-ed20-4b75-894f-1a52b785d014 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57539b6a6f3b4d589f5f5e1d211cd6a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b454f707d20347ada3d82aa85495635e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82025) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 20:01:29.863280 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79a31430-ed20-4b75-894f-1a52b785d014 admin admin] REQUEST_METHOD: `GET` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:01:29.863718 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79a31430-ed20-4b75-894f-1a52b785d014 admin admin] SCRIPT_NAME: `/identity` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:01:29.864008 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79a31430-ed20-4b75-894f-1a52b785d014 admin admin] PATH_INFO: `/v3/roles` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:01:29.864665 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79a31430-ed20-4b75-894f-1a52b785d014 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 20:01:29.866278 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79a31430-ed20-4b75-894f-1a52b785d014 admin admin] RBAC: Authorization granted {{(pid=82025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 20:01:29.879080 dv-cinder-828806-6-smb devstack@keystone.service[82025]: [pid: 82025|app: 0|req: 1080/2105] 10.222.0.33 () {58 vars in 1122 bytes} [Tue Sep 13 20:01:29 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 13 20:01:29.881625 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79a31430-ed20-4b75-894f-1a52b785d014 admin admin] Authenticating user token {{(pid=82025) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 20:01:29.893435 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79a31430-ed20-4b75-894f-1a52b785d014 admin admin] Validating token access rules against request {{(pid=82025) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 20:01:29.899475 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a50d0be-baa3-4eca-a567-991cc0029f2b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57539b6a6f3b4d589f5f5e1d211cd6a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b454f707d20347ada3d82aa85495635e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82025) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 20:01:29.903980 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a50d0be-baa3-4eca-a567-991cc0029f2b admin admin] REQUEST_METHOD: `PUT` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:01:29.903980 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a50d0be-baa3-4eca-a567-991cc0029f2b admin admin] SCRIPT_NAME: `/identity` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:01:29.903980 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a50d0be-baa3-4eca-a567-991cc0029f2b admin admin] PATH_INFO: `/v3/projects/00483ce475d64baead77541f45b5035d/users/72c93daef49a4ae8a78671376bc573f8/roles/3618ab638a65401f82333da7596d1daf` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:01:29.920637 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a50d0be-baa3-4eca-a567-991cc0029f2b admin admin] RBAC: Authorizing `identity:create_grant(project_id=00483ce475d64baead77541f45b5035d, user_id=72c93daef49a4ae8a78671376bc573f8, role_id=3618ab638a65401f82333da7596d1daf)` {{(pid=82025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 20:01:29.926454 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a50d0be-baa3-4eca-a567-991cc0029f2b admin admin] RBAC: Authorization granted {{(pid=82025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 20:01:29.933707 dv-cinder-828806-6-smb devstack@keystone.service[82026]: [pid: 82026|app: 0|req: 1026/2106] 10.222.0.33 () {60 vars in 1144 bytes} [Tue Sep 13 20:01:29 2022] POST /identity/v3/users => generated 289 bytes in 217 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 13 20:01:29.938739 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3180d7f6-c4ce-436f-b28e-f95aa85bd0fe admin admin] Authenticating user token {{(pid=82026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 20:01:29.954856 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3180d7f6-c4ce-436f-b28e-f95aa85bd0fe admin admin] Validating token access rules against request {{(pid=82026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 20:01:29.961538 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebf214d8-a7f6-4207-acc5-09d453b72c5b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57539b6a6f3b4d589f5f5e1d211cd6a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b454f707d20347ada3d82aa85495635e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 20:01:29.962391 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebf214d8-a7f6-4207-acc5-09d453b72c5b admin admin] REQUEST_METHOD: `GET` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:01:29.962772 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebf214d8-a7f6-4207-acc5-09d453b72c5b admin admin] SCRIPT_NAME: `/identity` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:01:29.963730 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebf214d8-a7f6-4207-acc5-09d453b72c5b admin admin] PATH_INFO: `/v3/roles` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:01:29.964913 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebf214d8-a7f6-4207-acc5-09d453b72c5b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 20:01:29.966832 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebf214d8-a7f6-4207-acc5-09d453b72c5b admin admin] RBAC: Authorization granted {{(pid=82026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 20:01:29.980683 dv-cinder-828806-6-smb devstack@keystone.service[82026]: [pid: 82026|app: 0|req: 1027/2107] 10.222.0.33 () {58 vars in 1122 bytes} [Tue Sep 13 20:01:29 2022] GET /identity/v3/roles => generated 1420 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 13 20:01:29.989155 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebf214d8-a7f6-4207-acc5-09d453b72c5b admin admin] Authenticating user token {{(pid=82026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 20:01:29.998964 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebf214d8-a7f6-4207-acc5-09d453b72c5b admin admin] Validating token access rules against request {{(pid=82026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 20:01:30.005426 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-798cec05-8d60-469a-a90d-c96b2a4ba3fe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57539b6a6f3b4d589f5f5e1d211cd6a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b454f707d20347ada3d82aa85495635e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 20:01:30.006165 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-798cec05-8d60-469a-a90d-c96b2a4ba3fe admin admin] REQUEST_METHOD: `GET` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:01:30.006542 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-798cec05-8d60-469a-a90d-c96b2a4ba3fe admin admin] SCRIPT_NAME: `/identity` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:01:30.006915 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-798cec05-8d60-469a-a90d-c96b2a4ba3fe admin admin] PATH_INFO: `/v3/roles` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:01:30.007691 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-798cec05-8d60-469a-a90d-c96b2a4ba3fe admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 20:01:30.009444 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-798cec05-8d60-469a-a90d-c96b2a4ba3fe admin admin] RBAC: Authorization granted {{(pid=82026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 20:01:30.029932 dv-cinder-828806-6-smb devstack@keystone.service[82026]: [pid: 82026|app: 0|req: 1028/2108] 10.222.0.33 () {58 vars in 1122 bytes} [Tue Sep 13 20:01:29 2022] GET /identity/v3/roles => generated 1420 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 13 20:01:30.031601 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-798cec05-8d60-469a-a90d-c96b2a4ba3fe admin admin] Authenticating user token {{(pid=82026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 20:01:30.042653 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-798cec05-8d60-469a-a90d-c96b2a4ba3fe admin admin] Validating token access rules against request {{(pid=82026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 20:01:30.048404 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8934749-a360-4c64-b4ab-7f33eaccaa69 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57539b6a6f3b4d589f5f5e1d211cd6a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b454f707d20347ada3d82aa85495635e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 20:01:30.049134 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8934749-a360-4c64-b4ab-7f33eaccaa69 admin admin] REQUEST_METHOD: `PUT` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:01:30.049340 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8934749-a360-4c64-b4ab-7f33eaccaa69 admin admin] SCRIPT_NAME: `/identity` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:01:30.049618 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8934749-a360-4c64-b4ab-7f33eaccaa69 admin admin] PATH_INFO: `/v3/projects/5b85537b405549698df2cd715578978c/users/c724d416282c45f4889ed1dfdc66dc3c/roles/3618ab638a65401f82333da7596d1daf` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:01:30.068198 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8934749-a360-4c64-b4ab-7f33eaccaa69 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5b85537b405549698df2cd715578978c, user_id=c724d416282c45f4889ed1dfdc66dc3c, role_id=3618ab638a65401f82333da7596d1daf)` {{(pid=82026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 20:01:30.070890 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8934749-a360-4c64-b4ab-7f33eaccaa69 admin admin] RBAC: Authorization granted {{(pid=82026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 20:01:30.104187 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG dbcounter [-] [82025] Writing DB stats keystone:SELECT=82,keystone:DELETE=17,keystone:INSERT=1 {{(pid=82025) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 20:01:30.110486 dv-cinder-828806-6-smb devstack@keystone.service[82025]: [pid: 82025|app: 0|req: 1081/2109] 10.222.0.33 () {60 vars in 1483 bytes} [Tue Sep 13 20:01:29 2022] PUT /identity/v3/projects/00483ce475d64baead77541f45b5035d/users/72c93daef49a4ae8a78671376bc573f8/roles/3618ab638a65401f82333da7596d1daf => generated 0 bytes in 229 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 13 20:01:30.123692 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75b44237-4fe2-4edd-8418-0ff36f1de7d4 None None] REQUEST_METHOD: `POST` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:01:30.124111 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75b44237-4fe2-4edd-8418-0ff36f1de7d4 None None] SCRIPT_NAME: `/identity` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:01:30.124492 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75b44237-4fe2-4edd-8418-0ff36f1de7d4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:01:30.170949 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG dbcounter [-] [82026] Writing DB stats keystone:SELECT=96,keystone:INSERT=1,keystone:DELETE=3 {{(pid=82026) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 20:01:30.173034 dv-cinder-828806-6-smb devstack@keystone.service[82026]: [pid: 82026|app: 0|req: 1029/2110] 10.222.0.33 () {60 vars in 1483 bytes} [Tue Sep 13 20:01:30 2022] PUT /identity/v3/projects/5b85537b405549698df2cd715578978c/users/c724d416282c45f4889ed1dfdc66dc3c/roles/3618ab638a65401f82333da7596d1daf => generated 0 bytes in 142 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 13 20:01:30.175482 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8934749-a360-4c64-b4ab-7f33eaccaa69 admin admin] Authenticating user token {{(pid=82026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 20:01:30.184886 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.common.fernet_utils [None req-d8934749-a360-4c64-b4ab-7f33eaccaa69 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82026) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 20:01:30.206609 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.auth.core [None req-75b44237-4fe2-4edd-8418-0ff36f1de7d4 None None] MFA Rules not processed for user `72c93daef49a4ae8a78671376bc573f8`. Rule list: `[]` (Enabled: `True`). {{(pid=82025) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 20:01:30.206609 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.fernet_utils [None req-75b44237-4fe2-4edd-8418-0ff36f1de7d4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82025) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 20:01:30.309923 dv-cinder-828806-6-smb devstack@keystone.service[82025]: [pid: 82025|app: 0|req: 1082/2111] 10.222.0.33 () {58 vars in 958 bytes} [Tue Sep 13 20:01:30 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 187 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 13 20:01:30.311619 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30caead6-c674-4228-8f5a-33ee24085afb None None] REQUEST_METHOD: `POST` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:01:30.312007 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30caead6-c674-4228-8f5a-33ee24085afb None None] SCRIPT_NAME: `/identity` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:01:30.312347 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30caead6-c674-4228-8f5a-33ee24085afb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:01:30.312892 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8934749-a360-4c64-b4ab-7f33eaccaa69 admin admin] Validating token access rules against request {{(pid=82026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 20:01:30.326326 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14e49551-2cd0-4a7f-b458-eb8567e67e82 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57539b6a6f3b4d589f5f5e1d211cd6a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b454f707d20347ada3d82aa85495635e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 20:01:30.327834 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14e49551-2cd0-4a7f-b458-eb8567e67e82 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:01:30.328121 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14e49551-2cd0-4a7f-b458-eb8567e67e82 admin admin] SCRIPT_NAME: `/identity` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:01:30.329022 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14e49551-2cd0-4a7f-b458-eb8567e67e82 admin admin] PATH_INFO: `/v3/users/df1a58e747b64e43a5a031721358f33f` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:01:30.331214 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14e49551-2cd0-4a7f-b458-eb8567e67e82 admin admin] RBAC: Authorizing `identity:delete_user(user_id=df1a58e747b64e43a5a031721358f33f)` {{(pid=82026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 20:01:30.334239 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14e49551-2cd0-4a7f-b458-eb8567e67e82 admin admin] RBAC: Authorization granted {{(pid=82026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 20:01:30.362289 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.auth.core [None req-30caead6-c674-4228-8f5a-33ee24085afb None None] MFA Rules not processed for user `c724d416282c45f4889ed1dfdc66dc3c`. Rule list: `[]` (Enabled: `True`). {{(pid=82025) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 20:01:30.363843 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.fernet_utils [None req-30caead6-c674-4228-8f5a-33ee24085afb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82025) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 20:01:30.446273 dv-cinder-828806-6-smb devstack@keystone.service[82025]: [pid: 82025|app: 0|req: 1083/2112] 10.222.0.33 () {58 vars in 958 bytes} [Tue Sep 13 20:01:30 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 136 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 20:01:30.447211 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30caead6-c674-4228-8f5a-33ee24085afb None None] Authenticating user token {{(pid=82025) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 20:01:30.449466 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.fernet_utils [None req-30caead6-c674-4228-8f5a-33ee24085afb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82025) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 20:01:30.533817 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30caead6-c674-4228-8f5a-33ee24085afb None None] Validating token access rules against request {{(pid=82025) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 20:01:30.537635 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-787b1da1-c570-42a6-aea7-b83211d1ab44 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46024fc6167f4321818b1bed27a521a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8c6fba0f15b4d6a84ff601919b7b8e4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82025) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 20:01:30.538352 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-787b1da1-c570-42a6-aea7-b83211d1ab44 service cinder] REQUEST_METHOD: `GET` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:01:30.538695 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-787b1da1-c570-42a6-aea7-b83211d1ab44 service cinder] SCRIPT_NAME: `/identity` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:01:30.539092 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-787b1da1-c570-42a6-aea7-b83211d1ab44 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:01:30.551613 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-787b1da1-c570-42a6-aea7-b83211d1ab44 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=82025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 20:01:30.554224 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-787b1da1-c570-42a6-aea7-b83211d1ab44 service cinder] RBAC: Authorization granted {{(pid=82025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 20:01:30.573495 dv-cinder-828806-6-smb devstack@keystone.service[82025]: [pid: 82025|app: 0|req: 1084/2113] 10.222.0.33 () {60 vars in 1365 bytes} [Tue Sep 13 20:01:30 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 127 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 20:01:30.576035 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-787b1da1-c570-42a6-aea7-b83211d1ab44 service cinder] Authenticating user token {{(pid=82025) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 20:01:30.578073 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.fernet_utils [None req-787b1da1-c570-42a6-aea7-b83211d1ab44 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82025) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 20:01:30.593622 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-787b1da1-c570-42a6-aea7-b83211d1ab44 service cinder] Validating token access rules against request {{(pid=82025) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 20:01:30.600155 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dc5e23e-aeb0-4f13-b94b-a9a49973b195 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57539b6a6f3b4d589f5f5e1d211cd6a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b454f707d20347ada3d82aa85495635e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82025) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 20:01:30.600891 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dc5e23e-aeb0-4f13-b94b-a9a49973b195 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:01:30.601243 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dc5e23e-aeb0-4f13-b94b-a9a49973b195 admin admin] SCRIPT_NAME: `/identity` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:01:30.601572 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dc5e23e-aeb0-4f13-b94b-a9a49973b195 admin admin] PATH_INFO: `/v3/projects/48fc06140d7e46fbb505aa2c3dd0a13f` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:01:30.602841 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dc5e23e-aeb0-4f13-b94b-a9a49973b195 admin admin] RBAC: Authorizing `identity:delete_project(project_id=48fc06140d7e46fbb505aa2c3dd0a13f)` {{(pid=82025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 20:01:30.605195 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dc5e23e-aeb0-4f13-b94b-a9a49973b195 admin admin] RBAC: Authorization granted {{(pid=82025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 20:01:30.609910 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.notifications [None req-14e49551-2cd0-4a7f-b458-eb8567e67e82 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'df1a58e747b64e43a5a031721358f33f'} {{(pid=82026) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 20:01:30.689943 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.notifications [None req-14e49551-2cd0-4a7f-b458-eb8567e67e82 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'df1a58e747b64e43a5a031721358f33f'} {{(pid=82026) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 20:01:30.703609 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.notifications [None req-14e49551-2cd0-4a7f-b458-eb8567e67e82 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'df1a58e747b64e43a5a031721358f33f'} {{(pid=82026) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 20:01:30.704381 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.notifications [None req-14e49551-2cd0-4a7f-b458-eb8567e67e82 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'df1a58e747b64e43a5a031721358f33f'} {{(pid=82026) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 20:01:30.711749 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.notifications [None req-14e49551-2cd0-4a7f-b458-eb8567e67e82 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'df1a58e747b64e43a5a031721358f33f'} {{(pid=82026) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 20:01:30.718328 dv-cinder-828806-6-smb devstack@keystone.service[82026]: [pid: 82026|app: 0|req: 1030/2114] 10.222.0.33 () {58 vars in 1224 bytes} [Tue Sep 13 20:01:30 2022] DELETE /identity/v3/users/df1a58e747b64e43a5a031721358f33f => generated 0 bytes in 545 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 20:01:30.719166 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14e49551-2cd0-4a7f-b458-eb8567e67e82 admin admin] Authenticating user token {{(pid=82026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 20:01:30.720527 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.common.fernet_utils [None req-14e49551-2cd0-4a7f-b458-eb8567e67e82 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82026) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 20:01:30.766838 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.notifications [None req-7dc5e23e-aeb0-4f13-b94b-a9a49973b195 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '48fc06140d7e46fbb505aa2c3dd0a13f', 'request_id': 'req-7dc5e23e-aeb0-4f13-b94b-a9a49973b195'} {{(pid=82025) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 20:01:30.777847 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.notifications [None req-7dc5e23e-aeb0-4f13-b94b-a9a49973b195 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '48fc06140d7e46fbb505aa2c3dd0a13f', 'request_id': 'req-7dc5e23e-aeb0-4f13-b94b-a9a49973b195'} {{(pid=82025) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 20:01:30.786166 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.notifications [None req-7dc5e23e-aeb0-4f13-b94b-a9a49973b195 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '48fc06140d7e46fbb505aa2c3dd0a13f', 'request_id': 'req-7dc5e23e-aeb0-4f13-b94b-a9a49973b195'} {{(pid=82025) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 20:01:30.813712 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14e49551-2cd0-4a7f-b458-eb8567e67e82 admin admin] Validating token access rules against request {{(pid=82026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 20:01:30.859609 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e931fce-14d1-45cc-bef9-703c1acf8b51 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f7b2421bf1f84193a29f79709d1d5a19', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8c6fba0f15b4d6a84ff601919b7b8e4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 20:01:30.860214 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e931fce-14d1-45cc-bef9-703c1acf8b51 service glance] REQUEST_METHOD: `GET` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:01:30.860495 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e931fce-14d1-45cc-bef9-703c1acf8b51 service glance] SCRIPT_NAME: `/identity` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:01:30.860768 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e931fce-14d1-45cc-bef9-703c1acf8b51 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:01:30.862507 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.common.fernet_utils [None req-1e931fce-14d1-45cc-bef9-703c1acf8b51 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82026) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 20:01:30.873537 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.notifications [None req-7dc5e23e-aeb0-4f13-b94b-a9a49973b195 admin admin] The token cache is being invalidate because project 48fc06140d7e46fbb505aa2c3dd0a13f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82025) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 13 20:01:30.876206 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.notifications [None req-7dc5e23e-aeb0-4f13-b94b-a9a49973b195 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82025) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 20:01:30.876206 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.notifications [None req-7dc5e23e-aeb0-4f13-b94b-a9a49973b195 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82025) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 20:01:30.880251 dv-cinder-828806-6-smb devstack@keystone.service[82025]: [pid: 82025|app: 0|req: 1085/2115] 10.222.0.33 () {58 vars in 1233 bytes} [Tue Sep 13 20:01:30 2022] DELETE /identity/v3/projects/48fc06140d7e46fbb505aa2c3dd0a13f => generated 0 bytes in 301 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 20:01:30.880251 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dc5e23e-aeb0-4f13-b94b-a9a49973b195 admin admin] Authenticating user token {{(pid=82025) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 20:01:30.880251 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.fernet_utils [None req-7dc5e23e-aeb0-4f13-b94b-a9a49973b195 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82025) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 20:01:30.927424 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e931fce-14d1-45cc-bef9-703c1acf8b51 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=82026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 20:01:30.929121 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e931fce-14d1-45cc-bef9-703c1acf8b51 service glance] RBAC: Authorization granted {{(pid=82026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 20:01:30.938961 dv-cinder-828806-6-smb devstack@keystone.service[82026]: [pid: 82026|app: 0|req: 1031/2116] 10.222.0.33 () {60 vars in 1365 bytes} [Tue Sep 13 20:01:30 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 220 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 20:01:30.944997 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e41b6c41-b864-4902-a45d-3e478081fdd7 None None] REQUEST_METHOD: `POST` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:01:30.944997 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e41b6c41-b864-4902-a45d-3e478081fdd7 None None] SCRIPT_NAME: `/identity` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:01:30.944997 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e41b6c41-b864-4902-a45d-3e478081fdd7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:01:30.960433 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dc5e23e-aeb0-4f13-b94b-a9a49973b195 admin admin] Validating token access rules against request {{(pid=82025) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 20:01:30.968142 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.auth.core [None req-e41b6c41-b864-4902-a45d-3e478081fdd7 None None] MFA Rules not processed for user `57539b6a6f3b4d589f5f5e1d211cd6a0`. Rule list: `[]` (Enabled: `True`). {{(pid=82026) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 20:01:30.968142 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.common.fernet_utils [None req-e41b6c41-b864-4902-a45d-3e478081fdd7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82026) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 20:01:30.969332 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da5b55c2-b48f-40cb-ab37-b848215f3f14 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57539b6a6f3b4d589f5f5e1d211cd6a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b454f707d20347ada3d82aa85495635e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82025) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 20:01:30.970005 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da5b55c2-b48f-40cb-ab37-b848215f3f14 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:01:30.970286 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da5b55c2-b48f-40cb-ab37-b848215f3f14 admin admin] SCRIPT_NAME: `/identity` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:01:30.970624 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da5b55c2-b48f-40cb-ab37-b848215f3f14 admin admin] PATH_INFO: `/v3/users/72c93daef49a4ae8a78671376bc573f8` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:01:30.971878 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da5b55c2-b48f-40cb-ab37-b848215f3f14 admin admin] RBAC: Authorizing `identity:delete_user(user_id=72c93daef49a4ae8a78671376bc573f8)` {{(pid=82025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 20:01:30.973897 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da5b55c2-b48f-40cb-ab37-b848215f3f14 admin admin] RBAC: Authorization granted {{(pid=82025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 20:01:30.974579 dv-cinder-828806-6-smb devstack@keystone.service[82026]: [pid: 82026|app: 0|req: 1032/2117] 10.222.0.33 () {58 vars in 958 bytes} [Tue Sep 13 20:01:30 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 20:01:30.975643 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e41b6c41-b864-4902-a45d-3e478081fdd7 None None] Authenticating user token {{(pid=82026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 20:01:30.980440 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.common.fernet_utils [None req-e41b6c41-b864-4902-a45d-3e478081fdd7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82026) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 20:01:31.001363 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e41b6c41-b864-4902-a45d-3e478081fdd7 None None] Validating token access rules against request {{(pid=82026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 20:01:31.008002 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8e73199-3a18-4ddd-8efa-6b1c6c287c63 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57539b6a6f3b4d589f5f5e1d211cd6a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b454f707d20347ada3d82aa85495635e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 20:01:31.008803 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8e73199-3a18-4ddd-8efa-6b1c6c287c63 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:01:31.009182 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8e73199-3a18-4ddd-8efa-6b1c6c287c63 admin admin] SCRIPT_NAME: `/identity` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:01:31.009513 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8e73199-3a18-4ddd-8efa-6b1c6c287c63 admin admin] PATH_INFO: `/v3/users/d92f7a1c19344327b9023f4230840172` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:01:31.014069 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8e73199-3a18-4ddd-8efa-6b1c6c287c63 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d92f7a1c19344327b9023f4230840172)` {{(pid=82026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 20:01:31.014270 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8e73199-3a18-4ddd-8efa-6b1c6c287c63 admin admin] RBAC: Authorization granted {{(pid=82026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 20:01:31.266971 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.notifications [None req-da5b55c2-b48f-40cb-ab37-b848215f3f14 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '72c93daef49a4ae8a78671376bc573f8'} {{(pid=82025) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 20:01:31.271639 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.notifications [None req-a8e73199-3a18-4ddd-8efa-6b1c6c287c63 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd92f7a1c19344327b9023f4230840172'} {{(pid=82026) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 20:01:31.346982 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.notifications [None req-da5b55c2-b48f-40cb-ab37-b848215f3f14 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '72c93daef49a4ae8a78671376bc573f8'} {{(pid=82025) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 20:01:31.347818 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.notifications [None req-da5b55c2-b48f-40cb-ab37-b848215f3f14 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '72c93daef49a4ae8a78671376bc573f8'} {{(pid=82025) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 20:01:31.362246 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.notifications [None req-da5b55c2-b48f-40cb-ab37-b848215f3f14 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '72c93daef49a4ae8a78671376bc573f8'} {{(pid=82025) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 20:01:31.370037 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.notifications [None req-da5b55c2-b48f-40cb-ab37-b848215f3f14 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '72c93daef49a4ae8a78671376bc573f8'} {{(pid=82025) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 20:01:31.379239 dv-cinder-828806-6-smb devstack@keystone.service[82025]: [pid: 82025|app: 0|req: 1086/2118] 10.222.0.33 () {58 vars in 1224 bytes} [Tue Sep 13 20:01:30 2022] DELETE /identity/v3/users/72c93daef49a4ae8a78671376bc573f8 => generated 0 bytes in 499 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 20:01:31.379239 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da5b55c2-b48f-40cb-ab37-b848215f3f14 admin admin] Authenticating user token {{(pid=82025) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 20:01:31.379239 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.fernet_utils [None req-da5b55c2-b48f-40cb-ab37-b848215f3f14 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82025) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 20:01:31.422031 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.notifications [None req-a8e73199-3a18-4ddd-8efa-6b1c6c287c63 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd92f7a1c19344327b9023f4230840172'} {{(pid=82026) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 20:01:31.445872 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.notifications [None req-a8e73199-3a18-4ddd-8efa-6b1c6c287c63 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd92f7a1c19344327b9023f4230840172'} {{(pid=82026) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 20:01:31.446672 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.notifications [None req-a8e73199-3a18-4ddd-8efa-6b1c6c287c63 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd92f7a1c19344327b9023f4230840172'} {{(pid=82026) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 20:01:31.457533 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da5b55c2-b48f-40cb-ab37-b848215f3f14 admin admin] Validating token access rules against request {{(pid=82025) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 20:01:31.458790 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.notifications [None req-a8e73199-3a18-4ddd-8efa-6b1c6c287c63 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd92f7a1c19344327b9023f4230840172'} {{(pid=82026) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 20:01:31.463246 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32fc6455-d778-4379-b3e9-977f9c9cfd5c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '023a2c79c2444611b3d431928e56685d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8c6fba0f15b4d6a84ff601919b7b8e4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82025) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 20:01:31.464987 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32fc6455-d778-4379-b3e9-977f9c9cfd5c service neutron] REQUEST_METHOD: `GET` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:01:31.464987 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32fc6455-d778-4379-b3e9-977f9c9cfd5c service neutron] SCRIPT_NAME: `/identity` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:01:31.465481 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32fc6455-d778-4379-b3e9-977f9c9cfd5c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:01:31.467482 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.fernet_utils [None req-32fc6455-d778-4379-b3e9-977f9c9cfd5c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82025) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 20:01:31.470832 dv-cinder-828806-6-smb devstack@keystone.service[82026]: [pid: 82026|app: 0|req: 1033/2119] 10.222.0.33 () {58 vars in 1224 bytes} [Tue Sep 13 20:01:30 2022] DELETE /identity/v3/users/d92f7a1c19344327b9023f4230840172 => generated 0 bytes in 495 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 20:01:31.475147 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-870179dc-1262-44bd-83b7-5c813f6cb162 None None] REQUEST_METHOD: `POST` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:01:31.475354 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-870179dc-1262-44bd-83b7-5c813f6cb162 None None] SCRIPT_NAME: `/identity` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:01:31.475876 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-870179dc-1262-44bd-83b7-5c813f6cb162 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:01:31.498879 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.auth.core [None req-870179dc-1262-44bd-83b7-5c813f6cb162 None None] MFA Rules not processed for user `57539b6a6f3b4d589f5f5e1d211cd6a0`. Rule list: `[]` (Enabled: `True`). {{(pid=82026) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 20:01:31.505418 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.common.fernet_utils [None req-870179dc-1262-44bd-83b7-5c813f6cb162 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82026) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 20:01:31.596080 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32fc6455-d778-4379-b3e9-977f9c9cfd5c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 20:01:31.596615 dv-cinder-828806-6-smb devstack@keystone.service[82026]: [pid: 82026|app: 0|req: 1034/2120] 10.222.0.33 () {58 vars in 958 bytes} [Tue Sep 13 20:01:31 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 20:01:31.598491 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32fc6455-d778-4379-b3e9-977f9c9cfd5c service neutron] RBAC: Authorization granted {{(pid=82025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 20:01:31.610295 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-870179dc-1262-44bd-83b7-5c813f6cb162 None None] Authenticating user token {{(pid=82026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 20:01:31.613841 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.common.fernet_utils [None req-870179dc-1262-44bd-83b7-5c813f6cb162 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82026) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 20:01:31.622211 dv-cinder-828806-6-smb devstack@keystone.service[82025]: [pid: 82025|app: 0|req: 1087/2121] 10.222.0.33 () {60 vars in 1365 bytes} [Tue Sep 13 20:01:31 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 244 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 20:01:31.657075 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG dbcounter [-] [82025] Writing DB stats keystone:INSERT=3,keystone:DELETE=10,keystone:SELECT=87 {{(pid=82025) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 20:01:31.708804 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG dbcounter [-] [82026] Writing DB stats keystone:DELETE=11,keystone:SELECT=85,keystone:INSERT=4 {{(pid=82026) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 20:01:31.718609 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-870179dc-1262-44bd-83b7-5c813f6cb162 None None] Validating token access rules against request {{(pid=82026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 20:01:31.723423 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2746d25d-5192-491f-a59b-7d62993f030b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '023a2c79c2444611b3d431928e56685d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8c6fba0f15b4d6a84ff601919b7b8e4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 20:01:31.724234 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2746d25d-5192-491f-a59b-7d62993f030b service neutron] REQUEST_METHOD: `GET` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:01:31.724617 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2746d25d-5192-491f-a59b-7d62993f030b service neutron] SCRIPT_NAME: `/identity` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:01:31.725028 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2746d25d-5192-491f-a59b-7d62993f030b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:01:31.738064 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2746d25d-5192-491f-a59b-7d62993f030b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 20:01:31.740125 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2746d25d-5192-491f-a59b-7d62993f030b service neutron] RBAC: Authorization granted {{(pid=82026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 20:01:31.753372 dv-cinder-828806-6-smb devstack@keystone.service[82026]: [pid: 82026|app: 0|req: 1035/2122] 10.222.0.33 () {60 vars in 1365 bytes} [Tue Sep 13 20:01:31 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 143 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 20:01:32.269537 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32fc6455-d778-4379-b3e9-977f9c9cfd5c service neutron] Authenticating user token {{(pid=82025) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 20:01:32.271651 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.fernet_utils [None req-32fc6455-d778-4379-b3e9-977f9c9cfd5c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82025) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 20:01:32.311977 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32fc6455-d778-4379-b3e9-977f9c9cfd5c service neutron] Validating token access rules against request {{(pid=82025) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 20:01:32.320142 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2b52651-affb-4702-80ad-b76aa5d6ee8b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57539b6a6f3b4d589f5f5e1d211cd6a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b454f707d20347ada3d82aa85495635e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82025) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 20:01:32.321308 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2b52651-affb-4702-80ad-b76aa5d6ee8b admin admin] REQUEST_METHOD: `DELETE` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:01:32.321528 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2b52651-affb-4702-80ad-b76aa5d6ee8b admin admin] SCRIPT_NAME: `/identity` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:01:32.322286 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2b52651-affb-4702-80ad-b76aa5d6ee8b admin admin] PATH_INFO: `/v3/projects/342192aefb3f479db131502f3a72d6df` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:01:32.325704 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2b52651-affb-4702-80ad-b76aa5d6ee8b admin admin] RBAC: Authorizing `identity:delete_project(project_id=342192aefb3f479db131502f3a72d6df)` {{(pid=82025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 20:01:32.328023 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2b52651-affb-4702-80ad-b76aa5d6ee8b admin admin] RBAC: Authorization granted {{(pid=82025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 20:01:32.364708 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2746d25d-5192-491f-a59b-7d62993f030b service neutron] Authenticating user token {{(pid=82026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 20:01:32.366322 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.common.fernet_utils [None req-2746d25d-5192-491f-a59b-7d62993f030b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82026) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 20:01:32.398525 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2746d25d-5192-491f-a59b-7d62993f030b service neutron] Validating token access rules against request {{(pid=82026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 20:01:32.410475 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4afb7ae-6543-40e9-8edc-febb8433a6c4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57539b6a6f3b4d589f5f5e1d211cd6a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b454f707d20347ada3d82aa85495635e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 20:01:32.411191 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4afb7ae-6543-40e9-8edc-febb8433a6c4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:01:32.411528 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4afb7ae-6543-40e9-8edc-febb8433a6c4 admin admin] SCRIPT_NAME: `/identity` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:01:32.411811 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4afb7ae-6543-40e9-8edc-febb8433a6c4 admin admin] PATH_INFO: `/v3/projects/1e0c218944704151adce970691c31c9b` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:01:32.413652 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4afb7ae-6543-40e9-8edc-febb8433a6c4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=1e0c218944704151adce970691c31c9b)` {{(pid=82026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 20:01:32.427222 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4afb7ae-6543-40e9-8edc-febb8433a6c4 admin admin] RBAC: Authorization granted {{(pid=82026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 20:01:32.536581 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.notifications [None req-d2b52651-affb-4702-80ad-b76aa5d6ee8b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '342192aefb3f479db131502f3a72d6df', 'request_id': 'req-d2b52651-affb-4702-80ad-b76aa5d6ee8b'} {{(pid=82025) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 20:01:32.545108 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.notifications [None req-d2b52651-affb-4702-80ad-b76aa5d6ee8b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '342192aefb3f479db131502f3a72d6df', 'request_id': 'req-d2b52651-affb-4702-80ad-b76aa5d6ee8b'} {{(pid=82025) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 20:01:32.552300 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.notifications [None req-d2b52651-affb-4702-80ad-b76aa5d6ee8b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '342192aefb3f479db131502f3a72d6df', 'request_id': 'req-d2b52651-affb-4702-80ad-b76aa5d6ee8b'} {{(pid=82025) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 20:01:32.607099 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.notifications [None req-e4afb7ae-6543-40e9-8edc-febb8433a6c4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1e0c218944704151adce970691c31c9b', 'request_id': 'req-e4afb7ae-6543-40e9-8edc-febb8433a6c4'} {{(pid=82026) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 20:01:32.667735 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.notifications [None req-d2b52651-affb-4702-80ad-b76aa5d6ee8b admin admin] The token cache is being invalidate because project 342192aefb3f479db131502f3a72d6df was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82025) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 13 20:01:32.668607 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.notifications [None req-d2b52651-affb-4702-80ad-b76aa5d6ee8b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82025) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 20:01:32.669429 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.notifications [None req-d2b52651-affb-4702-80ad-b76aa5d6ee8b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82025) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 20:01:32.671998 dv-cinder-828806-6-smb devstack@keystone.service[82025]: [pid: 82025|app: 0|req: 1088/2123] 10.222.0.33 () {58 vars in 1233 bytes} [Tue Sep 13 20:01:32 2022] DELETE /identity/v3/projects/342192aefb3f479db131502f3a72d6df => generated 0 bytes in 403 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 20:01:32.673073 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2b52651-affb-4702-80ad-b76aa5d6ee8b admin admin] Authenticating user token {{(pid=82025) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 20:01:32.677408 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.fernet_utils [None req-d2b52651-affb-4702-80ad-b76aa5d6ee8b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82025) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 20:01:32.757127 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2b52651-affb-4702-80ad-b76aa5d6ee8b admin admin] Validating token access rules against request {{(pid=82025) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 20:01:32.776760 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.notifications [None req-e4afb7ae-6543-40e9-8edc-febb8433a6c4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1e0c218944704151adce970691c31c9b', 'request_id': 'req-e4afb7ae-6543-40e9-8edc-febb8433a6c4'} {{(pid=82026) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 20:01:32.783146 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.notifications [None req-e4afb7ae-6543-40e9-8edc-febb8433a6c4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1e0c218944704151adce970691c31c9b', 'request_id': 'req-e4afb7ae-6543-40e9-8edc-febb8433a6c4'} {{(pid=82026) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 20:01:32.795479 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.notifications [None req-e4afb7ae-6543-40e9-8edc-febb8433a6c4 admin admin] The token cache is being invalidate because project 1e0c218944704151adce970691c31c9b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82026) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 13 20:01:32.795784 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.notifications [None req-e4afb7ae-6543-40e9-8edc-febb8433a6c4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82026) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 20:01:32.796477 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.notifications [None req-e4afb7ae-6543-40e9-8edc-febb8433a6c4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82026) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 20:01:32.798029 dv-cinder-828806-6-smb devstack@keystone.service[82026]: [pid: 82026|app: 0|req: 1036/2124] 10.222.0.33 () {58 vars in 1233 bytes} [Tue Sep 13 20:01:32 2022] DELETE /identity/v3/projects/1e0c218944704151adce970691c31c9b => generated 0 bytes in 435 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 13 20:01:32.799315 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd45e93b-d63d-4e00-a4a8-9936671c0737 None None] REQUEST_METHOD: `POST` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:01:32.799611 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd45e93b-d63d-4e00-a4a8-9936671c0737 None None] SCRIPT_NAME: `/identity` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:01:32.799890 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd45e93b-d63d-4e00-a4a8-9936671c0737 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:01:32.818680 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f051b1b5-0b74-4d7b-b4d6-94433771e2d8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57539b6a6f3b4d589f5f5e1d211cd6a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b454f707d20347ada3d82aa85495635e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82025) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 20:01:32.819489 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f051b1b5-0b74-4d7b-b4d6-94433771e2d8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:01:32.823865 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f051b1b5-0b74-4d7b-b4d6-94433771e2d8 admin admin] SCRIPT_NAME: `/identity` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:01:32.823865 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f051b1b5-0b74-4d7b-b4d6-94433771e2d8 admin admin] PATH_INFO: `/v3/projects/00483ce475d64baead77541f45b5035d` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:01:32.824201 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.auth.core [None req-cd45e93b-d63d-4e00-a4a8-9936671c0737 None None] MFA Rules not processed for user `57539b6a6f3b4d589f5f5e1d211cd6a0`. Rule list: `[]` (Enabled: `True`). {{(pid=82026) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 20:01:32.824308 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f051b1b5-0b74-4d7b-b4d6-94433771e2d8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=00483ce475d64baead77541f45b5035d)` {{(pid=82025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 20:01:32.824396 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.common.fernet_utils [None req-cd45e93b-d63d-4e00-a4a8-9936671c0737 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82026) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 20:01:32.824885 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f051b1b5-0b74-4d7b-b4d6-94433771e2d8 admin admin] RBAC: Authorization granted {{(pid=82025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 20:01:32.839573 dv-cinder-828806-6-smb devstack@keystone.service[82026]: [pid: 82026|app: 0|req: 1037/2125] 10.222.0.33 () {58 vars in 958 bytes} [Tue Sep 13 20:01:32 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 20:01:32.839573 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd45e93b-d63d-4e00-a4a8-9936671c0737 None None] Authenticating user token {{(pid=82026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 20:01:32.840014 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.common.fernet_utils [None req-cd45e93b-d63d-4e00-a4a8-9936671c0737 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82026) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 20:01:32.853360 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd45e93b-d63d-4e00-a4a8-9936671c0737 None None] Validating token access rules against request {{(pid=82026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 20:01:32.866340 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-422f4ba1-98b6-4f23-88e0-ce927af15e5b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57539b6a6f3b4d589f5f5e1d211cd6a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b454f707d20347ada3d82aa85495635e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 20:01:32.866340 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-422f4ba1-98b6-4f23-88e0-ce927af15e5b admin admin] REQUEST_METHOD: `DELETE` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:01:32.866340 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-422f4ba1-98b6-4f23-88e0-ce927af15e5b admin admin] SCRIPT_NAME: `/identity` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:01:32.866340 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-422f4ba1-98b6-4f23-88e0-ce927af15e5b admin admin] PATH_INFO: `/v3/users/d6faab30ee2b4bfdb23463bac89f6d85` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:01:32.866900 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-422f4ba1-98b6-4f23-88e0-ce927af15e5b admin admin] RBAC: Authorizing `identity:delete_user(user_id=d6faab30ee2b4bfdb23463bac89f6d85)` {{(pid=82026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 20:01:32.866900 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-422f4ba1-98b6-4f23-88e0-ce927af15e5b admin admin] RBAC: Authorization granted {{(pid=82026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 20:01:32.962704 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.notifications [None req-f051b1b5-0b74-4d7b-b4d6-94433771e2d8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '00483ce475d64baead77541f45b5035d', 'request_id': 'req-f051b1b5-0b74-4d7b-b4d6-94433771e2d8'} {{(pid=82025) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 20:01:32.981257 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.notifications [None req-f051b1b5-0b74-4d7b-b4d6-94433771e2d8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '00483ce475d64baead77541f45b5035d', 'request_id': 'req-f051b1b5-0b74-4d7b-b4d6-94433771e2d8'} {{(pid=82025) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 20:01:32.989739 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.notifications [None req-f051b1b5-0b74-4d7b-b4d6-94433771e2d8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '00483ce475d64baead77541f45b5035d', 'request_id': 'req-f051b1b5-0b74-4d7b-b4d6-94433771e2d8'} {{(pid=82025) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 20:01:33.082251 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.notifications [None req-f051b1b5-0b74-4d7b-b4d6-94433771e2d8 admin admin] The token cache is being invalidate because project 00483ce475d64baead77541f45b5035d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82025) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 13 20:01:33.082609 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.notifications [None req-f051b1b5-0b74-4d7b-b4d6-94433771e2d8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82025) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 20:01:33.083385 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.notifications [None req-f051b1b5-0b74-4d7b-b4d6-94433771e2d8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82025) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 20:01:33.086667 dv-cinder-828806-6-smb devstack@keystone.service[82025]: [pid: 82025|app: 0|req: 1089/2126] 10.222.0.33 () {58 vars in 1233 bytes} [Tue Sep 13 20:01:32 2022] DELETE /identity/v3/projects/00483ce475d64baead77541f45b5035d => generated 0 bytes in 412 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 20:01:33.086667 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eb57a75-5a2d-4d9e-b307-6daec0b3bf3f None None] REQUEST_METHOD: `POST` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:01:33.087226 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eb57a75-5a2d-4d9e-b307-6daec0b3bf3f None None] SCRIPT_NAME: `/identity` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:01:33.087511 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eb57a75-5a2d-4d9e-b307-6daec0b3bf3f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:01:33.114332 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.auth.core [None req-6eb57a75-5a2d-4d9e-b307-6daec0b3bf3f None None] MFA Rules not processed for user `57539b6a6f3b4d589f5f5e1d211cd6a0`. Rule list: `[]` (Enabled: `True`). {{(pid=82025) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 20:01:33.115784 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.fernet_utils [None req-6eb57a75-5a2d-4d9e-b307-6daec0b3bf3f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82025) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 20:01:33.182366 dv-cinder-828806-6-smb devstack@keystone.service[82025]: [pid: 82025|app: 0|req: 1090/2127] 10.222.0.33 () {58 vars in 958 bytes} [Tue Sep 13 20:01:33 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 20:01:33.183682 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4cae00d-1d40-40b5-a64d-ed506bd38bee None None] REQUEST_METHOD: `POST` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:01:33.183975 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4cae00d-1d40-40b5-a64d-ed506bd38bee None None] SCRIPT_NAME: `/identity` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:01:33.184354 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4cae00d-1d40-40b5-a64d-ed506bd38bee None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:01:33.215126 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.auth.core [None req-a4cae00d-1d40-40b5-a64d-ed506bd38bee None None] MFA Rules not processed for user `57539b6a6f3b4d589f5f5e1d211cd6a0`. Rule list: `[]` (Enabled: `True`). {{(pid=82025) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 20:01:33.216438 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.fernet_utils [None req-a4cae00d-1d40-40b5-a64d-ed506bd38bee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82025) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 20:01:33.224961 dv-cinder-828806-6-smb devstack@keystone.service[82025]: [pid: 82025|app: 0|req: 1091/2128] 10.222.0.33 () {58 vars in 958 bytes} [Tue Sep 13 20:01:33 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 20:01:33.226151 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4cae00d-1d40-40b5-a64d-ed506bd38bee None None] Authenticating user token {{(pid=82025) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 20:01:33.226681 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.notifications [None req-422f4ba1-98b6-4f23-88e0-ce927af15e5b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd6faab30ee2b4bfdb23463bac89f6d85'} {{(pid=82026) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 20:01:33.237058 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4cae00d-1d40-40b5-a64d-ed506bd38bee None None] Validating token access rules against request {{(pid=82025) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 20:01:33.243701 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90424fb7-5531-46c2-8b16-c5482ce75fc2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57539b6a6f3b4d589f5f5e1d211cd6a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b454f707d20347ada3d82aa85495635e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82025) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 20:01:33.245140 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90424fb7-5531-46c2-8b16-c5482ce75fc2 admin admin] REQUEST_METHOD: `GET` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:01:33.245749 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90424fb7-5531-46c2-8b16-c5482ce75fc2 admin admin] SCRIPT_NAME: `/identity` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:01:33.246080 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90424fb7-5531-46c2-8b16-c5482ce75fc2 admin admin] PATH_INFO: `/v3/domains` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:01:33.246885 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90424fb7-5531-46c2-8b16-c5482ce75fc2 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82025) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 20:01:33.247410 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90424fb7-5531-46c2-8b16-c5482ce75fc2 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 20:01:33.249442 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90424fb7-5531-46c2-8b16-c5482ce75fc2 admin admin] RBAC: Authorization granted {{(pid=82025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 20:01:33.266194 dv-cinder-828806-6-smb devstack@keystone.service[82025]: [pid: 82025|app: 0|req: 1092/2129] 10.222.0.33 () {58 vars in 1153 bytes} [Tue Sep 13 20:01:33 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 20:01:33.267418 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a085bdfa-e4c5-46cb-92cd-d805770578bf None None] REQUEST_METHOD: `POST` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:01:33.267766 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a085bdfa-e4c5-46cb-92cd-d805770578bf None None] SCRIPT_NAME: `/identity` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:01:33.268039 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a085bdfa-e4c5-46cb-92cd-d805770578bf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:01:33.290367 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.auth.core [None req-a085bdfa-e4c5-46cb-92cd-d805770578bf None None] MFA Rules not processed for user `57539b6a6f3b4d589f5f5e1d211cd6a0`. Rule list: `[]` (Enabled: `True`). {{(pid=82025) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 20:01:33.292669 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.fernet_utils [None req-a085bdfa-e4c5-46cb-92cd-d805770578bf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82025) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 20:01:33.306845 dv-cinder-828806-6-smb devstack@keystone.service[82025]: [pid: 82025|app: 0|req: 1093/2130] 10.222.0.33 () {58 vars in 958 bytes} [Tue Sep 13 20:01:33 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 20:01:33.308168 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a085bdfa-e4c5-46cb-92cd-d805770578bf None None] Authenticating user token {{(pid=82025) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 20:01:33.319873 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a085bdfa-e4c5-46cb-92cd-d805770578bf None None] Validating token access rules against request {{(pid=82025) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 20:01:33.324392 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.notifications [None req-422f4ba1-98b6-4f23-88e0-ce927af15e5b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd6faab30ee2b4bfdb23463bac89f6d85'} {{(pid=82026) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 20:01:33.328624 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dacf7d91-d553-435e-bff1-9416b0916ce9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57539b6a6f3b4d589f5f5e1d211cd6a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b454f707d20347ada3d82aa85495635e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82025) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 20:01:33.329325 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dacf7d91-d553-435e-bff1-9416b0916ce9 admin admin] REQUEST_METHOD: `POST` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:01:33.329673 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dacf7d91-d553-435e-bff1-9416b0916ce9 admin admin] SCRIPT_NAME: `/identity` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:01:33.330348 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dacf7d91-d553-435e-bff1-9416b0916ce9 admin admin] PATH_INFO: `/v3/projects` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:01:33.330997 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dacf7d91-d553-435e-bff1-9416b0916ce9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 20:01:33.332993 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dacf7d91-d553-435e-bff1-9416b0916ce9 admin admin] RBAC: Authorization granted {{(pid=82025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 20:01:33.349274 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.notifications [None req-422f4ba1-98b6-4f23-88e0-ce927af15e5b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd6faab30ee2b4bfdb23463bac89f6d85'} {{(pid=82026) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 20:01:33.350263 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.notifications [None req-422f4ba1-98b6-4f23-88e0-ce927af15e5b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd6faab30ee2b4bfdb23463bac89f6d85'} {{(pid=82026) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 20:01:33.364097 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.notifications [None req-422f4ba1-98b6-4f23-88e0-ce927af15e5b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd6faab30ee2b4bfdb23463bac89f6d85'} {{(pid=82026) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 20:01:33.371087 dv-cinder-828806-6-smb devstack@keystone.service[82026]: [pid: 82026|app: 0|req: 1038/2131] 10.222.0.33 () {58 vars in 1224 bytes} [Tue Sep 13 20:01:32 2022] DELETE /identity/v3/users/d6faab30ee2b4bfdb23463bac89f6d85 => generated 0 bytes in 533 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 20:01:33.371909 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-422f4ba1-98b6-4f23-88e0-ce927af15e5b admin admin] Authenticating user token {{(pid=82026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 20:01:33.373518 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.common.fernet_utils [None req-422f4ba1-98b6-4f23-88e0-ce927af15e5b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82026) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 20:01:33.427765 dv-cinder-828806-6-smb devstack@keystone.service[82025]: [pid: 82025|app: 0|req: 1094/2132] 10.222.0.33 () {60 vars in 1153 bytes} [Tue Sep 13 20:01:33 2022] POST /identity/v3/projects => generated 377 bytes in 120 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 13 20:01:33.432509 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dacf7d91-d553-435e-bff1-9416b0916ce9 admin admin] Authenticating user token {{(pid=82025) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 20:01:33.437774 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.fernet_utils [None req-dacf7d91-d553-435e-bff1-9416b0916ce9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82025) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 20:01:33.505652 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-422f4ba1-98b6-4f23-88e0-ce927af15e5b admin admin] Validating token access rules against request {{(pid=82026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 20:01:33.583539 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dacf7d91-d553-435e-bff1-9416b0916ce9 admin admin] Validating token access rules against request {{(pid=82025) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 20:01:33.599101 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-470ef557-7c49-4697-afca-2f5e57db7277 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57539b6a6f3b4d589f5f5e1d211cd6a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b454f707d20347ada3d82aa85495635e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82025) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 20:01:33.600018 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-470ef557-7c49-4697-afca-2f5e57db7277 admin admin] REQUEST_METHOD: `POST` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:01:33.600451 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-470ef557-7c49-4697-afca-2f5e57db7277 admin admin] SCRIPT_NAME: `/identity` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:01:33.600900 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-470ef557-7c49-4697-afca-2f5e57db7277 admin admin] PATH_INFO: `/v3/users` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:01:33.615977 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-470ef557-7c49-4697-afca-2f5e57db7277 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 20:01:33.634946 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-470ef557-7c49-4697-afca-2f5e57db7277 admin admin] RBAC: Authorization granted {{(pid=82025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 20:01:33.670634 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6550ca56-c9b3-4c65-bce2-7c6dd6bac068 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57539b6a6f3b4d589f5f5e1d211cd6a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b454f707d20347ada3d82aa85495635e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 20:01:33.671717 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6550ca56-c9b3-4c65-bce2-7c6dd6bac068 admin admin] REQUEST_METHOD: `GET` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:01:33.672213 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6550ca56-c9b3-4c65-bce2-7c6dd6bac068 admin admin] SCRIPT_NAME: `/identity` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:01:33.672852 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6550ca56-c9b3-4c65-bce2-7c6dd6bac068 admin admin] PATH_INFO: `/v3/domains` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:01:33.673801 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6550ca56-c9b3-4c65-bce2-7c6dd6bac068 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82026) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 20:01:33.674931 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6550ca56-c9b3-4c65-bce2-7c6dd6bac068 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 20:01:33.679303 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6550ca56-c9b3-4c65-bce2-7c6dd6bac068 admin admin] RBAC: Authorization granted {{(pid=82026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 20:01:33.707582 dv-cinder-828806-6-smb devstack@keystone.service[82026]: [pid: 82026|app: 0|req: 1039/2133] 10.222.0.33 () {58 vars in 1153 bytes} [Tue Sep 13 20:01:33 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 336 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 20:01:33.712289 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6550ca56-c9b3-4c65-bce2-7c6dd6bac068 admin admin] Authenticating user token {{(pid=82026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 20:01:33.725297 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6550ca56-c9b3-4c65-bce2-7c6dd6bac068 admin admin] Validating token access rules against request {{(pid=82026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 20:01:33.748159 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddae130d-0922-4f77-9754-da7c0b15185e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57539b6a6f3b4d589f5f5e1d211cd6a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b454f707d20347ada3d82aa85495635e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 20:01:33.748810 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddae130d-0922-4f77-9754-da7c0b15185e admin admin] REQUEST_METHOD: `POST` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:01:33.749100 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddae130d-0922-4f77-9754-da7c0b15185e admin admin] SCRIPT_NAME: `/identity` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:01:33.749381 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddae130d-0922-4f77-9754-da7c0b15185e admin admin] PATH_INFO: `/v3/projects` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:01:33.750724 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddae130d-0922-4f77-9754-da7c0b15185e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 20:01:33.752870 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddae130d-0922-4f77-9754-da7c0b15185e admin admin] RBAC: Authorization granted {{(pid=82026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 20:01:33.788350 dv-cinder-828806-6-smb devstack@keystone.service[82025]: [pid: 82025|app: 0|req: 1095/2134] 10.222.0.33 () {60 vars in 1144 bytes} [Tue Sep 13 20:01:33 2022] POST /identity/v3/users => generated 289 bytes in 357 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 13 20:01:33.793382 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-470ef557-7c49-4697-afca-2f5e57db7277 admin admin] Authenticating user token {{(pid=82025) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 20:01:33.814542 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-470ef557-7c49-4697-afca-2f5e57db7277 admin admin] Validating token access rules against request {{(pid=82025) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 20:01:33.834516 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61373603-fead-4f76-9369-096ece0ed2ba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57539b6a6f3b4d589f5f5e1d211cd6a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b454f707d20347ada3d82aa85495635e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82025) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 20:01:33.835178 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61373603-fead-4f76-9369-096ece0ed2ba admin admin] REQUEST_METHOD: `GET` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:01:33.835464 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61373603-fead-4f76-9369-096ece0ed2ba admin admin] SCRIPT_NAME: `/identity` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:01:33.835740 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61373603-fead-4f76-9369-096ece0ed2ba admin admin] PATH_INFO: `/v3/roles` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:01:33.836425 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61373603-fead-4f76-9369-096ece0ed2ba admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 20:01:33.838041 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61373603-fead-4f76-9369-096ece0ed2ba admin admin] RBAC: Authorization granted {{(pid=82025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 20:01:33.865195 dv-cinder-828806-6-smb devstack@keystone.service[82025]: [pid: 82025|app: 0|req: 1096/2135] 10.222.0.33 () {58 vars in 1122 bytes} [Tue Sep 13 20:01:33 2022] GET /identity/v3/roles => generated 1420 bytes in 70 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 13 20:01:33.866297 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61373603-fead-4f76-9369-096ece0ed2ba admin admin] Authenticating user token {{(pid=82025) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 20:01:33.891846 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61373603-fead-4f76-9369-096ece0ed2ba admin admin] Validating token access rules against request {{(pid=82025) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 20:01:33.892106 dv-cinder-828806-6-smb devstack@keystone.service[82026]: [pid: 82026|app: 0|req: 1040/2136] 10.222.0.33 () {60 vars in 1153 bytes} [Tue Sep 13 20:01:33 2022] POST /identity/v3/projects => generated 373 bytes in 180 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 13 20:01:33.898252 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ca5ef64-148f-404b-bae4-3c7256e45f2a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57539b6a6f3b4d589f5f5e1d211cd6a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b454f707d20347ada3d82aa85495635e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82025) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 20:01:33.900058 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ca5ef64-148f-404b-bae4-3c7256e45f2a admin admin] REQUEST_METHOD: `GET` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:01:33.900695 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ca5ef64-148f-404b-bae4-3c7256e45f2a admin admin] SCRIPT_NAME: `/identity` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:01:33.901758 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddae130d-0922-4f77-9754-da7c0b15185e admin admin] Authenticating user token {{(pid=82026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 20:01:33.901872 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ca5ef64-148f-404b-bae4-3c7256e45f2a admin admin] PATH_INFO: `/v3/roles` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:01:33.902995 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ca5ef64-148f-404b-bae4-3c7256e45f2a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 20:01:33.908887 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ca5ef64-148f-404b-bae4-3c7256e45f2a admin admin] RBAC: Authorization granted {{(pid=82025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 20:01:33.944736 dv-cinder-828806-6-smb devstack@keystone.service[82025]: [pid: 82025|app: 0|req: 1097/2137] 10.222.0.33 () {58 vars in 1122 bytes} [Tue Sep 13 20:01:33 2022] GET /identity/v3/roles => generated 1420 bytes in 79 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 13 20:01:33.949812 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ca5ef64-148f-404b-bae4-3c7256e45f2a admin admin] Authenticating user token {{(pid=82025) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 20:01:33.983922 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ca5ef64-148f-404b-bae4-3c7256e45f2a admin admin] Validating token access rules against request {{(pid=82025) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 20:01:34.086521 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddae130d-0922-4f77-9754-da7c0b15185e admin admin] Validating token access rules against request {{(pid=82026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 20:01:34.093850 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42144cf7-37e5-40a1-804e-6a2fd917fa20 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57539b6a6f3b4d589f5f5e1d211cd6a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b454f707d20347ada3d82aa85495635e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 20:01:34.095605 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42144cf7-37e5-40a1-804e-6a2fd917fa20 admin admin] REQUEST_METHOD: `POST` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:01:34.096329 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42144cf7-37e5-40a1-804e-6a2fd917fa20 admin admin] SCRIPT_NAME: `/identity` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:01:34.096680 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42144cf7-37e5-40a1-804e-6a2fd917fa20 admin admin] PATH_INFO: `/v3/users` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:01:34.097406 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42144cf7-37e5-40a1-804e-6a2fd917fa20 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 20:01:34.104035 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42144cf7-37e5-40a1-804e-6a2fd917fa20 admin admin] RBAC: Authorization granted {{(pid=82026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 20:01:34.109919 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0d978ba-beb1-4f55-8a34-bbb099e06265 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57539b6a6f3b4d589f5f5e1d211cd6a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b454f707d20347ada3d82aa85495635e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82025) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 20:01:34.110609 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0d978ba-beb1-4f55-8a34-bbb099e06265 admin admin] REQUEST_METHOD: `PUT` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:01:34.110898 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0d978ba-beb1-4f55-8a34-bbb099e06265 admin admin] SCRIPT_NAME: `/identity` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:01:34.111302 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0d978ba-beb1-4f55-8a34-bbb099e06265 admin admin] PATH_INFO: `/v3/projects/3fb00974587b44c28c2e51dfc19ed93d/users/8c2240b30d9f45e8a4b018f009b36855/roles/3618ab638a65401f82333da7596d1daf` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:01:34.133377 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0d978ba-beb1-4f55-8a34-bbb099e06265 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3fb00974587b44c28c2e51dfc19ed93d, user_id=8c2240b30d9f45e8a4b018f009b36855, role_id=3618ab638a65401f82333da7596d1daf)` {{(pid=82025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 20:01:34.137515 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0d978ba-beb1-4f55-8a34-bbb099e06265 admin admin] RBAC: Authorization granted {{(pid=82025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 20:01:34.193970 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG dbcounter [-] [82025] Writing DB stats keystone:SELECT=86,keystone:INSERT=4,keystone:DELETE=10 {{(pid=82025) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 20:01:34.230187 dv-cinder-828806-6-smb devstack@keystone.service[82026]: [pid: 82026|app: 0|req: 1041/2138] 10.222.0.33 () {60 vars in 1144 bytes} [Tue Sep 13 20:01:33 2022] POST /identity/v3/users => generated 287 bytes in 329 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 13 20:01:34.243243 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42144cf7-37e5-40a1-804e-6a2fd917fa20 admin admin] Authenticating user token {{(pid=82026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 20:01:34.243517 dv-cinder-828806-6-smb devstack@keystone.service[82025]: [pid: 82025|app: 0|req: 1098/2139] 10.222.0.33 () {60 vars in 1483 bytes} [Tue Sep 13 20:01:33 2022] PUT /identity/v3/projects/3fb00974587b44c28c2e51dfc19ed93d/users/8c2240b30d9f45e8a4b018f009b36855/roles/3618ab638a65401f82333da7596d1daf => generated 0 bytes in 282 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 20:01:34.243623 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.common.fernet_utils [None req-42144cf7-37e5-40a1-804e-6a2fd917fa20 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82026) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 20:01:34.247081 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0d978ba-beb1-4f55-8a34-bbb099e06265 admin admin] Authenticating user token {{(pid=82025) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 20:01:34.264388 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42144cf7-37e5-40a1-804e-6a2fd917fa20 admin admin] Validating token access rules against request {{(pid=82026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 20:01:34.281820 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG dbcounter [-] [82026] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82026) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 20:01:34.333733 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0d978ba-beb1-4f55-8a34-bbb099e06265 admin admin] Validating token access rules against request {{(pid=82025) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 20:01:34.339779 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9070b32c-9982-4962-bfe6-884fba8621bd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57539b6a6f3b4d589f5f5e1d211cd6a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b454f707d20347ada3d82aa85495635e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82025) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 20:01:34.340479 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9070b32c-9982-4962-bfe6-884fba8621bd admin admin] REQUEST_METHOD: `GET` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:01:34.340769 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9070b32c-9982-4962-bfe6-884fba8621bd admin admin] SCRIPT_NAME: `/identity` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:01:34.341053 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9070b32c-9982-4962-bfe6-884fba8621bd admin admin] PATH_INFO: `/v3/roles` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:01:34.341738 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9070b32c-9982-4962-bfe6-884fba8621bd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 20:01:34.343528 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9070b32c-9982-4962-bfe6-884fba8621bd admin admin] RBAC: Authorization granted {{(pid=82025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 20:01:34.360886 dv-cinder-828806-6-smb devstack@keystone.service[82025]: [pid: 82025|app: 0|req: 1099/2140] 10.222.0.33 () {58 vars in 1122 bytes} [Tue Sep 13 20:01:34 2022] GET /identity/v3/roles => generated 1420 bytes in 118 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 13 20:01:34.362345 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afc4b77b-a664-49c7-a65c-04f7dcbd6872 None None] REQUEST_METHOD: `POST` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:01:34.362637 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afc4b77b-a664-49c7-a65c-04f7dcbd6872 None None] SCRIPT_NAME: `/identity` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:01:34.362928 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afc4b77b-a664-49c7-a65c-04f7dcbd6872 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:01:34.368319 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ad121f6-672f-44a2-820f-7bfcd33c0f8e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57539b6a6f3b4d589f5f5e1d211cd6a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b454f707d20347ada3d82aa85495635e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 20:01:34.369358 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ad121f6-672f-44a2-820f-7bfcd33c0f8e admin admin] REQUEST_METHOD: `DELETE` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:01:34.370315 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ad121f6-672f-44a2-820f-7bfcd33c0f8e admin admin] SCRIPT_NAME: `/identity` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:01:34.371485 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ad121f6-672f-44a2-820f-7bfcd33c0f8e admin admin] PATH_INFO: `/v3/projects/cdc4c0becf5b4293af9b7697d075fed3` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:01:34.380293 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ad121f6-672f-44a2-820f-7bfcd33c0f8e admin admin] RBAC: Authorizing `identity:delete_project(project_id=cdc4c0becf5b4293af9b7697d075fed3)` {{(pid=82026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 20:01:34.386221 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ad121f6-672f-44a2-820f-7bfcd33c0f8e admin admin] RBAC: Authorization granted {{(pid=82026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 20:01:34.403945 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.auth.core [None req-afc4b77b-a664-49c7-a65c-04f7dcbd6872 None None] MFA Rules not processed for user `8c2240b30d9f45e8a4b018f009b36855`. Rule list: `[]` (Enabled: `True`). {{(pid=82025) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 20:01:34.405604 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.fernet_utils [None req-afc4b77b-a664-49c7-a65c-04f7dcbd6872 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82025) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 20:01:34.481533 dv-cinder-828806-6-smb devstack@keystone.service[82025]: [pid: 82025|app: 0|req: 1100/2141] 10.222.0.33 () {58 vars in 958 bytes} [Tue Sep 13 20:01:34 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 20:01:34.482430 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afc4b77b-a664-49c7-a65c-04f7dcbd6872 None None] Authenticating user token {{(pid=82025) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 20:01:34.493194 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afc4b77b-a664-49c7-a65c-04f7dcbd6872 None None] Validating token access rules against request {{(pid=82025) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 20:01:34.498848 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e76f344d-0a11-472d-842c-b26cf07d09e2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57539b6a6f3b4d589f5f5e1d211cd6a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b454f707d20347ada3d82aa85495635e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82025) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 20:01:34.499535 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e76f344d-0a11-472d-842c-b26cf07d09e2 admin admin] REQUEST_METHOD: `GET` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:01:34.499819 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e76f344d-0a11-472d-842c-b26cf07d09e2 admin admin] SCRIPT_NAME: `/identity` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:01:34.500099 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e76f344d-0a11-472d-842c-b26cf07d09e2 admin admin] PATH_INFO: `/v3/roles` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:01:34.500975 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e76f344d-0a11-472d-842c-b26cf07d09e2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 20:01:34.502374 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e76f344d-0a11-472d-842c-b26cf07d09e2 admin admin] RBAC: Authorization granted {{(pid=82025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 20:01:34.513949 dv-cinder-828806-6-smb devstack@keystone.service[82025]: [pid: 82025|app: 0|req: 1101/2142] 10.222.0.33 () {58 vars in 1122 bytes} [Tue Sep 13 20:01:34 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 13 20:01:34.514918 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e76f344d-0a11-472d-842c-b26cf07d09e2 admin admin] Authenticating user token {{(pid=82025) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 20:01:34.525022 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e76f344d-0a11-472d-842c-b26cf07d09e2 admin admin] Validating token access rules against request {{(pid=82025) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 20:01:34.530879 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8a5189e-78bf-4c13-bd88-703df35d549e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57539b6a6f3b4d589f5f5e1d211cd6a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b454f707d20347ada3d82aa85495635e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82025) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 20:01:34.531641 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8a5189e-78bf-4c13-bd88-703df35d549e admin admin] REQUEST_METHOD: `POST` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:01:34.531933 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8a5189e-78bf-4c13-bd88-703df35d549e admin admin] SCRIPT_NAME: `/identity` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:01:34.532219 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8a5189e-78bf-4c13-bd88-703df35d549e admin admin] PATH_INFO: `/v3/projects` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:01:34.532899 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8a5189e-78bf-4c13-bd88-703df35d549e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 20:01:34.534844 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8a5189e-78bf-4c13-bd88-703df35d549e admin admin] RBAC: Authorization granted {{(pid=82025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 20:01:34.606105 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.notifications [None req-8ad121f6-672f-44a2-820f-7bfcd33c0f8e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'cdc4c0becf5b4293af9b7697d075fed3', 'request_id': 'req-8ad121f6-672f-44a2-820f-7bfcd33c0f8e'} {{(pid=82026) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 20:01:34.634870 dv-cinder-828806-6-smb devstack@keystone.service[82025]: [pid: 82025|app: 0|req: 1102/2143] 10.222.0.33 () {60 vars in 1153 bytes} [Tue Sep 13 20:01:34 2022] POST /identity/v3/projects => generated 377 bytes in 120 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 13 20:01:34.636583 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8a5189e-78bf-4c13-bd88-703df35d549e admin admin] Authenticating user token {{(pid=82025) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 20:01:34.701899 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.notifications [None req-8ad121f6-672f-44a2-820f-7bfcd33c0f8e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'cdc4c0becf5b4293af9b7697d075fed3', 'request_id': 'req-8ad121f6-672f-44a2-820f-7bfcd33c0f8e'} {{(pid=82026) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 20:01:34.710249 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.notifications [None req-8ad121f6-672f-44a2-820f-7bfcd33c0f8e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'cdc4c0becf5b4293af9b7697d075fed3', 'request_id': 'req-8ad121f6-672f-44a2-820f-7bfcd33c0f8e'} {{(pid=82026) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 20:01:34.720912 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8a5189e-78bf-4c13-bd88-703df35d549e admin admin] Validating token access rules against request {{(pid=82025) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 20:01:34.732357 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ec41f97-c352-47ba-a387-136577363b5c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57539b6a6f3b4d589f5f5e1d211cd6a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b454f707d20347ada3d82aa85495635e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82025) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 20:01:34.733762 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ec41f97-c352-47ba-a387-136577363b5c admin admin] REQUEST_METHOD: `PUT` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:01:34.734060 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ec41f97-c352-47ba-a387-136577363b5c admin admin] SCRIPT_NAME: `/identity` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:01:34.734239 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.notifications [None req-8ad121f6-672f-44a2-820f-7bfcd33c0f8e admin admin] The token cache is being invalidate because project cdc4c0becf5b4293af9b7697d075fed3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82026) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 13 20:01:34.738000 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ec41f97-c352-47ba-a387-136577363b5c admin admin] PATH_INFO: `/v3/projects/a0c968088f234a088146631faa107c32/users/81d4729b7b8b4f53b3381ab66c4c51f4/roles/3618ab638a65401f82333da7596d1daf` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:01:34.738130 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.notifications [None req-8ad121f6-672f-44a2-820f-7bfcd33c0f8e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82026) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 20:01:34.738130 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.notifications [None req-8ad121f6-672f-44a2-820f-7bfcd33c0f8e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82026) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 20:01:34.738572 dv-cinder-828806-6-smb devstack@keystone.service[82026]: [pid: 82026|app: 0|req: 1042/2144] 10.222.0.33 () {58 vars in 1233 bytes} [Tue Sep 13 20:01:34 2022] DELETE /identity/v3/projects/cdc4c0becf5b4293af9b7697d075fed3 => generated 0 bytes in 507 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 20:01:34.739784 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ad121f6-672f-44a2-820f-7bfcd33c0f8e admin admin] Authenticating user token {{(pid=82026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 20:01:34.742569 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.common.fernet_utils [None req-8ad121f6-672f-44a2-820f-7bfcd33c0f8e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82026) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 20:01:34.758481 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ec41f97-c352-47ba-a387-136577363b5c admin admin] RBAC: Authorizing `identity:create_grant(project_id=a0c968088f234a088146631faa107c32, user_id=81d4729b7b8b4f53b3381ab66c4c51f4, role_id=3618ab638a65401f82333da7596d1daf)` {{(pid=82025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 20:01:34.763933 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ec41f97-c352-47ba-a387-136577363b5c admin admin] RBAC: Authorization granted {{(pid=82025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 20:01:34.822272 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ad121f6-672f-44a2-820f-7bfcd33c0f8e admin admin] Validating token access rules against request {{(pid=82026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 20:01:34.827996 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-978e719b-8412-4a93-ab7d-9245dca2969f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57539b6a6f3b4d589f5f5e1d211cd6a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b454f707d20347ada3d82aa85495635e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 20:01:34.828701 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-978e719b-8412-4a93-ab7d-9245dca2969f admin admin] REQUEST_METHOD: `POST` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:01:34.829123 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-978e719b-8412-4a93-ab7d-9245dca2969f admin admin] SCRIPT_NAME: `/identity` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:01:34.829571 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-978e719b-8412-4a93-ab7d-9245dca2969f admin admin] PATH_INFO: `/v3/users` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:01:34.830566 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-978e719b-8412-4a93-ab7d-9245dca2969f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 20:01:34.832702 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-978e719b-8412-4a93-ab7d-9245dca2969f admin admin] RBAC: Authorization granted {{(pid=82026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 20:01:34.861629 dv-cinder-828806-6-smb devstack@keystone.service[82025]: [pid: 82025|app: 0|req: 1103/2145] 10.222.0.33 () {60 vars in 1483 bytes} [Tue Sep 13 20:01:34 2022] PUT /identity/v3/projects/a0c968088f234a088146631faa107c32/users/81d4729b7b8b4f53b3381ab66c4c51f4/roles/3618ab638a65401f82333da7596d1daf => generated 0 bytes in 216 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 20:01:34.863196 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d79d77ba-b1cc-4f08-8f8d-05c1996e9bef None None] REQUEST_METHOD: `POST` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:01:34.863566 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d79d77ba-b1cc-4f08-8f8d-05c1996e9bef None None] SCRIPT_NAME: `/identity` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:01:34.863917 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d79d77ba-b1cc-4f08-8f8d-05c1996e9bef None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:01:34.896705 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.auth.core [None req-d79d77ba-b1cc-4f08-8f8d-05c1996e9bef None None] MFA Rules not processed for user `57539b6a6f3b4d589f5f5e1d211cd6a0`. Rule list: `[]` (Enabled: `True`). {{(pid=82025) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 20:01:34.897877 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.fernet_utils [None req-d79d77ba-b1cc-4f08-8f8d-05c1996e9bef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82025) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 20:01:34.975464 dv-cinder-828806-6-smb devstack@keystone.service[82025]: [pid: 82025|app: 0|req: 1104/2146] 10.222.0.33 () {58 vars in 958 bytes} [Tue Sep 13 20:01:34 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 20:01:34.977312 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c331214-c228-4436-89ba-dfdaaab5d661 None None] REQUEST_METHOD: `POST` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:01:34.977751 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c331214-c228-4436-89ba-dfdaaab5d661 None None] SCRIPT_NAME: `/identity` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:01:34.978156 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c331214-c228-4436-89ba-dfdaaab5d661 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:01:35.016809 dv-cinder-828806-6-smb devstack@keystone.service[82026]: [pid: 82026|app: 0|req: 1043/2147] 10.222.0.33 () {60 vars in 1144 bytes} [Tue Sep 13 20:01:34 2022] POST /identity/v3/users => generated 289 bytes in 277 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 13 20:01:35.018626 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08dc9370-187e-48cb-9f39-20e4391b3528 None None] REQUEST_METHOD: `POST` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:01:35.020069 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08dc9370-187e-48cb-9f39-20e4391b3528 None None] SCRIPT_NAME: `/identity` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:01:35.020460 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08dc9370-187e-48cb-9f39-20e4391b3528 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:01:35.023582 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.auth.core [None req-1c331214-c228-4436-89ba-dfdaaab5d661 None None] MFA Rules not processed for user `81d4729b7b8b4f53b3381ab66c4c51f4`. Rule list: `[]` (Enabled: `True`). {{(pid=82025) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 20:01:35.025387 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.fernet_utils [None req-1c331214-c228-4436-89ba-dfdaaab5d661 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82025) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 20:01:35.050232 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.auth.core [None req-08dc9370-187e-48cb-9f39-20e4391b3528 None None] MFA Rules not processed for user `57539b6a6f3b4d589f5f5e1d211cd6a0`. Rule list: `[]` (Enabled: `True`). {{(pid=82026) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 20:01:35.051670 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.common.fernet_utils [None req-08dc9370-187e-48cb-9f39-20e4391b3528 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82026) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 20:01:35.064617 dv-cinder-828806-6-smb devstack@keystone.service[82026]: [pid: 82026|app: 0|req: 1044/2148] 10.222.0.33 () {58 vars in 958 bytes} [Tue Sep 13 20:01:35 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 47 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 20:01:35.065729 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08dc9370-187e-48cb-9f39-20e4391b3528 None None] Authenticating user token {{(pid=82026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 20:01:35.076789 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08dc9370-187e-48cb-9f39-20e4391b3528 None None] Validating token access rules against request {{(pid=82026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 20:01:35.086917 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b52b99e-12f2-4cd0-b58f-bea16480e8e4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57539b6a6f3b4d589f5f5e1d211cd6a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b454f707d20347ada3d82aa85495635e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 20:01:35.087737 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b52b99e-12f2-4cd0-b58f-bea16480e8e4 admin admin] REQUEST_METHOD: `GET` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:01:35.088116 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b52b99e-12f2-4cd0-b58f-bea16480e8e4 admin admin] SCRIPT_NAME: `/identity` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:01:35.088820 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b52b99e-12f2-4cd0-b58f-bea16480e8e4 admin admin] PATH_INFO: `/v3/roles` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:01:35.089839 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b52b99e-12f2-4cd0-b58f-bea16480e8e4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 20:01:35.091726 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b52b99e-12f2-4cd0-b58f-bea16480e8e4 admin admin] RBAC: Authorization granted {{(pid=82026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 20:01:35.106968 dv-cinder-828806-6-smb devstack@keystone.service[82026]: [pid: 82026|app: 0|req: 1045/2149] 10.222.0.33 () {58 vars in 1122 bytes} [Tue Sep 13 20:01:35 2022] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 13 20:01:35.108227 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b52b99e-12f2-4cd0-b58f-bea16480e8e4 admin admin] Authenticating user token {{(pid=82026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 20:01:35.118586 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b52b99e-12f2-4cd0-b58f-bea16480e8e4 admin admin] Validating token access rules against request {{(pid=82026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 20:01:35.126297 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddb860ec-1964-4b98-8bd4-9866ad8855f7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57539b6a6f3b4d589f5f5e1d211cd6a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b454f707d20347ada3d82aa85495635e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 20:01:35.127660 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddb860ec-1964-4b98-8bd4-9866ad8855f7 admin admin] REQUEST_METHOD: `GET` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:01:35.128158 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddb860ec-1964-4b98-8bd4-9866ad8855f7 admin admin] SCRIPT_NAME: `/identity` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:01:35.128636 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddb860ec-1964-4b98-8bd4-9866ad8855f7 admin admin] PATH_INFO: `/v3/domains` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:01:35.136201 dv-cinder-828806-6-smb devstack@keystone.service[82025]: [pid: 82025|app: 0|req: 1105/2150] 10.222.0.33 () {58 vars in 958 bytes} [Tue Sep 13 20:01:34 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 156 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 20:01:35.136391 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddb860ec-1964-4b98-8bd4-9866ad8855f7 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82026) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 20:01:35.136391 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddb860ec-1964-4b98-8bd4-9866ad8855f7 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 20:01:35.136598 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c331214-c228-4436-89ba-dfdaaab5d661 None None] Authenticating user token {{(pid=82025) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 20:01:35.136719 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddb860ec-1964-4b98-8bd4-9866ad8855f7 admin admin] RBAC: Authorization granted {{(pid=82026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 20:01:35.149535 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c331214-c228-4436-89ba-dfdaaab5d661 None None] Validating token access rules against request {{(pid=82025) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 20:01:35.158177 dv-cinder-828806-6-smb devstack@keystone.service[82026]: [pid: 82026|app: 0|req: 1046/2151] 10.222.0.33 () {58 vars in 1153 bytes} [Tue Sep 13 20:01:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 20:01:35.158385 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a15518c-6e2f-40a3-b0c1-d97ac7e30c9e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57539b6a6f3b4d589f5f5e1d211cd6a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b454f707d20347ada3d82aa85495635e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82025) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 20:01:35.158499 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddb860ec-1964-4b98-8bd4-9866ad8855f7 admin admin] Authenticating user token {{(pid=82026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 20:01:35.158590 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a15518c-6e2f-40a3-b0c1-d97ac7e30c9e admin admin] REQUEST_METHOD: `GET` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:01:35.158590 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a15518c-6e2f-40a3-b0c1-d97ac7e30c9e admin admin] SCRIPT_NAME: `/identity` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:01:35.158590 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a15518c-6e2f-40a3-b0c1-d97ac7e30c9e admin admin] PATH_INFO: `/v3/roles` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:01:35.158590 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a15518c-6e2f-40a3-b0c1-d97ac7e30c9e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 20:01:35.160300 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a15518c-6e2f-40a3-b0c1-d97ac7e30c9e admin admin] RBAC: Authorization granted {{(pid=82025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 20:01:35.163582 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.common.fernet_utils [None req-ddb860ec-1964-4b98-8bd4-9866ad8855f7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82026) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 20:01:35.172670 dv-cinder-828806-6-smb devstack@keystone.service[82025]: [pid: 82025|app: 0|req: 1106/2152] 10.222.0.33 () {58 vars in 1122 bytes} [Tue Sep 13 20:01:35 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 13 20:01:35.173665 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a15518c-6e2f-40a3-b0c1-d97ac7e30c9e admin admin] Authenticating user token {{(pid=82025) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 20:01:35.184896 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddb860ec-1964-4b98-8bd4-9866ad8855f7 admin admin] Validating token access rules against request {{(pid=82026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 20:01:35.185752 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a15518c-6e2f-40a3-b0c1-d97ac7e30c9e admin admin] Validating token access rules against request {{(pid=82025) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 20:01:35.191750 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a66ad63-5b98-41d6-8e15-c45033a4befe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57539b6a6f3b4d589f5f5e1d211cd6a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b454f707d20347ada3d82aa85495635e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 20:01:35.195560 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a66ad63-5b98-41d6-8e15-c45033a4befe admin admin] REQUEST_METHOD: `POST` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:01:35.195910 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a66ad63-5b98-41d6-8e15-c45033a4befe admin admin] SCRIPT_NAME: `/identity` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:01:35.202565 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f87c2b0-f2f5-46b1-8d8e-e85a1f57fa31 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57539b6a6f3b4d589f5f5e1d211cd6a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b454f707d20347ada3d82aa85495635e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82025) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 20:01:35.203009 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a66ad63-5b98-41d6-8e15-c45033a4befe admin admin] PATH_INFO: `/v3/projects` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:01:35.203150 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f87c2b0-f2f5-46b1-8d8e-e85a1f57fa31 admin admin] REQUEST_METHOD: `POST` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:01:35.203239 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a66ad63-5b98-41d6-8e15-c45033a4befe admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 20:01:35.203351 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f87c2b0-f2f5-46b1-8d8e-e85a1f57fa31 admin admin] SCRIPT_NAME: `/identity` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:01:35.203351 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f87c2b0-f2f5-46b1-8d8e-e85a1f57fa31 admin admin] PATH_INFO: `/v3/projects` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:01:35.203351 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f87c2b0-f2f5-46b1-8d8e-e85a1f57fa31 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 20:01:35.203576 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a66ad63-5b98-41d6-8e15-c45033a4befe admin admin] RBAC: Authorization granted {{(pid=82026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 20:01:35.203660 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f87c2b0-f2f5-46b1-8d8e-e85a1f57fa31 admin admin] RBAC: Authorization granted {{(pid=82025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 20:01:35.304695 dv-cinder-828806-6-smb devstack@keystone.service[82025]: [pid: 82025|app: 0|req: 1107/2153] 10.222.0.33 () {60 vars in 1153 bytes} [Tue Sep 13 20:01:35 2022] POST /identity/v3/projects => generated 383 bytes in 131 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 13 20:01:35.305671 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f87c2b0-f2f5-46b1-8d8e-e85a1f57fa31 admin admin] Authenticating user token {{(pid=82025) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 20:01:35.320754 dv-cinder-828806-6-smb devstack@keystone.service[82026]: [pid: 82026|app: 0|req: 1047/2154] 10.222.0.33 () {60 vars in 1153 bytes} [Tue Sep 13 20:01:35 2022] POST /identity/v3/projects => generated 373 bytes in 165 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 13 20:01:35.321932 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a66ad63-5b98-41d6-8e15-c45033a4befe admin admin] Authenticating user token {{(pid=82026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 20:01:35.433054 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a66ad63-5b98-41d6-8e15-c45033a4befe admin admin] Validating token access rules against request {{(pid=82026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 20:01:35.439582 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f87c2b0-f2f5-46b1-8d8e-e85a1f57fa31 admin admin] Validating token access rules against request {{(pid=82025) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 20:01:35.442295 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fb9752f-ff9d-481f-b8de-fcbc5ed9807e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57539b6a6f3b4d589f5f5e1d211cd6a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b454f707d20347ada3d82aa85495635e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 20:01:35.443199 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fb9752f-ff9d-481f-b8de-fcbc5ed9807e admin admin] REQUEST_METHOD: `POST` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:01:35.445119 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fb9752f-ff9d-481f-b8de-fcbc5ed9807e admin admin] SCRIPT_NAME: `/identity` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:01:35.445509 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fb9752f-ff9d-481f-b8de-fcbc5ed9807e admin admin] PATH_INFO: `/v3/users` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:01:35.446277 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fb9752f-ff9d-481f-b8de-fcbc5ed9807e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 20:01:35.447545 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c91732e-7361-4fb4-80d9-98e08a2e90e2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57539b6a6f3b4d589f5f5e1d211cd6a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b454f707d20347ada3d82aa85495635e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82025) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 20:01:35.447883 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c91732e-7361-4fb4-80d9-98e08a2e90e2 admin admin] REQUEST_METHOD: `PUT` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:01:35.448512 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c91732e-7361-4fb4-80d9-98e08a2e90e2 admin admin] SCRIPT_NAME: `/identity` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:01:35.448767 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c91732e-7361-4fb4-80d9-98e08a2e90e2 admin admin] PATH_INFO: `/v3/projects/d633825f92d645078ce7092c8ef10bb9/users/e8816b89df534f679fde4fc03f0539c6/roles/3618ab638a65401f82333da7596d1daf` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:01:35.450182 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fb9752f-ff9d-481f-b8de-fcbc5ed9807e admin admin] RBAC: Authorization granted {{(pid=82026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 20:01:35.474815 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c91732e-7361-4fb4-80d9-98e08a2e90e2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d633825f92d645078ce7092c8ef10bb9, user_id=e8816b89df534f679fde4fc03f0539c6, role_id=3618ab638a65401f82333da7596d1daf)` {{(pid=82025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 20:01:35.482745 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c91732e-7361-4fb4-80d9-98e08a2e90e2 admin admin] RBAC: Authorization granted {{(pid=82025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 20:01:35.595590 dv-cinder-828806-6-smb devstack@keystone.service[82025]: [pid: 82025|app: 0|req: 1108/2155] 10.222.0.33 () {60 vars in 1483 bytes} [Tue Sep 13 20:01:35 2022] PUT /identity/v3/projects/d633825f92d645078ce7092c8ef10bb9/users/e8816b89df534f679fde4fc03f0539c6/roles/3618ab638a65401f82333da7596d1daf => generated 0 bytes in 290 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 20:01:35.599494 dv-cinder-828806-6-smb devstack@keystone.service[82026]: [pid: 82026|app: 0|req: 1048/2156] 10.222.0.33 () {60 vars in 1144 bytes} [Tue Sep 13 20:01:35 2022] POST /identity/v3/users => generated 292 bytes in 276 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 13 20:01:35.604312 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fb9752f-ff9d-481f-b8de-fcbc5ed9807e admin admin] Authenticating user token {{(pid=82026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 20:01:35.608422 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c91732e-7361-4fb4-80d9-98e08a2e90e2 admin admin] Authenticating user token {{(pid=82025) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 20:01:35.618733 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fb9752f-ff9d-481f-b8de-fcbc5ed9807e admin admin] Validating token access rules against request {{(pid=82026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 20:01:35.684161 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG dbcounter [-] [82026] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82026) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 20:01:35.722997 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f3bd9cc-676c-4175-8f97-1aea04299afe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57539b6a6f3b4d589f5f5e1d211cd6a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b454f707d20347ada3d82aa85495635e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 20:01:35.723612 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f3bd9cc-676c-4175-8f97-1aea04299afe admin admin] REQUEST_METHOD: `GET` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:01:35.723900 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f3bd9cc-676c-4175-8f97-1aea04299afe admin admin] SCRIPT_NAME: `/identity` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:01:35.725225 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f3bd9cc-676c-4175-8f97-1aea04299afe admin admin] PATH_INFO: `/v3/roles` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:01:35.725474 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c91732e-7361-4fb4-80d9-98e08a2e90e2 admin admin] Validating token access rules against request {{(pid=82025) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 20:01:35.725906 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f3bd9cc-676c-4175-8f97-1aea04299afe admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 20:01:35.732128 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f3bd9cc-676c-4175-8f97-1aea04299afe admin admin] RBAC: Authorization granted {{(pid=82026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 20:01:35.733864 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd9b470b-e0f9-41a6-88d2-6a1248161ef0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57539b6a6f3b4d589f5f5e1d211cd6a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b454f707d20347ada3d82aa85495635e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82025) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 20:01:35.733864 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd9b470b-e0f9-41a6-88d2-6a1248161ef0 admin admin] REQUEST_METHOD: `POST` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:01:35.734076 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd9b470b-e0f9-41a6-88d2-6a1248161ef0 admin admin] SCRIPT_NAME: `/identity` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:01:35.734355 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd9b470b-e0f9-41a6-88d2-6a1248161ef0 admin admin] PATH_INFO: `/v3/users` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:01:35.734976 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd9b470b-e0f9-41a6-88d2-6a1248161ef0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 20:01:35.736972 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd9b470b-e0f9-41a6-88d2-6a1248161ef0 admin admin] RBAC: Authorization granted {{(pid=82025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 20:01:35.750609 dv-cinder-828806-6-smb devstack@keystone.service[82026]: [pid: 82026|app: 0|req: 1049/2157] 10.222.0.33 () {58 vars in 1122 bytes} [Tue Sep 13 20:01:35 2022] GET /identity/v3/roles => generated 1420 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 13 20:01:35.752509 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d82e4059-f60c-4d3d-9641-2bf2593e4cf3 None None] REQUEST_METHOD: `POST` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:01:35.752899 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d82e4059-f60c-4d3d-9641-2bf2593e4cf3 None None] SCRIPT_NAME: `/identity` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:01:35.754000 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d82e4059-f60c-4d3d-9641-2bf2593e4cf3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:01:35.795692 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.auth.core [None req-d82e4059-f60c-4d3d-9641-2bf2593e4cf3 None None] MFA Rules not processed for user `e8816b89df534f679fde4fc03f0539c6`. Rule list: `[]` (Enabled: `True`). {{(pid=82026) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 20:01:35.797027 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.common.fernet_utils [None req-d82e4059-f60c-4d3d-9641-2bf2593e4cf3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82026) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 20:01:35.833983 dv-cinder-828806-6-smb devstack@keystone.service[82025]: [pid: 82025|app: 0|req: 1109/2158] 10.222.0.33 () {60 vars in 1144 bytes} [Tue Sep 13 20:01:35 2022] POST /identity/v3/users => generated 293 bytes in 235 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 13 20:01:35.833983 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd9b470b-e0f9-41a6-88d2-6a1248161ef0 admin admin] Authenticating user token {{(pid=82025) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 20:01:35.849775 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd9b470b-e0f9-41a6-88d2-6a1248161ef0 admin admin] Validating token access rules against request {{(pid=82025) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 20:01:35.854926 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-939ff4de-def3-4509-9407-e5cea1dc31ad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57539b6a6f3b4d589f5f5e1d211cd6a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b454f707d20347ada3d82aa85495635e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82025) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 20:01:35.855776 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-939ff4de-def3-4509-9407-e5cea1dc31ad admin admin] REQUEST_METHOD: `GET` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:01:35.856092 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-939ff4de-def3-4509-9407-e5cea1dc31ad admin admin] SCRIPT_NAME: `/identity` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:01:35.856471 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-939ff4de-def3-4509-9407-e5cea1dc31ad admin admin] PATH_INFO: `/v3/roles` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:01:35.857270 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-939ff4de-def3-4509-9407-e5cea1dc31ad admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 20:01:35.858986 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-939ff4de-def3-4509-9407-e5cea1dc31ad admin admin] RBAC: Authorization granted {{(pid=82025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 20:01:35.869808 dv-cinder-828806-6-smb devstack@keystone.service[82025]: [pid: 82025|app: 0|req: 1110/2159] 10.222.0.33 () {58 vars in 1122 bytes} [Tue Sep 13 20:01:35 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 13 20:01:35.870791 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-939ff4de-def3-4509-9407-e5cea1dc31ad admin admin] Authenticating user token {{(pid=82025) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 20:01:35.872988 dv-cinder-828806-6-smb devstack@keystone.service[82026]: [pid: 82026|app: 0|req: 1050/2160] 10.222.0.33 () {58 vars in 958 bytes} [Tue Sep 13 20:01:35 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 20:01:35.873838 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d82e4059-f60c-4d3d-9641-2bf2593e4cf3 None None] Authenticating user token {{(pid=82026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 20:01:35.883429 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-939ff4de-def3-4509-9407-e5cea1dc31ad admin admin] Validating token access rules against request {{(pid=82025) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 20:01:35.893200 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d988115c-decb-4322-884c-f142ff6b1d56 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57539b6a6f3b4d589f5f5e1d211cd6a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b454f707d20347ada3d82aa85495635e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82025) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 20:01:35.893200 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d988115c-decb-4322-884c-f142ff6b1d56 admin admin] REQUEST_METHOD: `GET` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:01:35.893200 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d988115c-decb-4322-884c-f142ff6b1d56 admin admin] SCRIPT_NAME: `/identity` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:01:35.893200 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d988115c-decb-4322-884c-f142ff6b1d56 admin admin] PATH_INFO: `/v3/roles` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:01:35.893953 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d988115c-decb-4322-884c-f142ff6b1d56 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 20:01:35.895729 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d988115c-decb-4322-884c-f142ff6b1d56 admin admin] RBAC: Authorization granted {{(pid=82025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 20:01:35.909003 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d82e4059-f60c-4d3d-9641-2bf2593e4cf3 None None] Validating token access rules against request {{(pid=82026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 20:01:35.915025 dv-cinder-828806-6-smb devstack@keystone.service[82025]: [pid: 82025|app: 0|req: 1111/2161] 10.222.0.33 () {58 vars in 1122 bytes} [Tue Sep 13 20:01:35 2022] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 13 20:01:35.915025 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d988115c-decb-4322-884c-f142ff6b1d56 admin admin] Authenticating user token {{(pid=82025) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 20:01:35.919092 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bfd5f9f-c626-48e9-8a3a-290985c44492 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57539b6a6f3b4d589f5f5e1d211cd6a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b454f707d20347ada3d82aa85495635e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 20:01:35.919092 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bfd5f9f-c626-48e9-8a3a-290985c44492 admin admin] REQUEST_METHOD: `PUT` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:01:35.919092 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bfd5f9f-c626-48e9-8a3a-290985c44492 admin admin] SCRIPT_NAME: `/identity` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:01:35.919092 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bfd5f9f-c626-48e9-8a3a-290985c44492 admin admin] PATH_INFO: `/v3/projects/52cd0497e33349f1b50b49791f5a0f63/users/77a7a63634904f22ab948abba67d8d94/roles/3618ab638a65401f82333da7596d1daf` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:01:35.925652 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d988115c-decb-4322-884c-f142ff6b1d56 admin admin] Validating token access rules against request {{(pid=82025) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 20:01:35.932421 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a86d7923-f82a-4f94-9b36-975b2154126c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57539b6a6f3b4d589f5f5e1d211cd6a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b454f707d20347ada3d82aa85495635e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82025) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 20:01:35.934342 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a86d7923-f82a-4f94-9b36-975b2154126c admin admin] REQUEST_METHOD: `POST` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:01:35.934732 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a86d7923-f82a-4f94-9b36-975b2154126c admin admin] SCRIPT_NAME: `/identity` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:01:35.935314 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a86d7923-f82a-4f94-9b36-975b2154126c admin admin] PATH_INFO: `/v3/projects` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:01:35.936143 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a86d7923-f82a-4f94-9b36-975b2154126c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 20:01:35.939013 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a86d7923-f82a-4f94-9b36-975b2154126c admin admin] RBAC: Authorization granted {{(pid=82025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 20:01:35.953596 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bfd5f9f-c626-48e9-8a3a-290985c44492 admin admin] RBAC: Authorizing `identity:create_grant(project_id=52cd0497e33349f1b50b49791f5a0f63, user_id=77a7a63634904f22ab948abba67d8d94, role_id=3618ab638a65401f82333da7596d1daf)` {{(pid=82026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 20:01:35.960206 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bfd5f9f-c626-48e9-8a3a-290985c44492 admin admin] RBAC: Authorization granted {{(pid=82026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 20:01:36.064383 dv-cinder-828806-6-smb devstack@keystone.service[82025]: [pid: 82025|app: 0|req: 1112/2162] 10.222.0.33 () {60 vars in 1153 bytes} [Tue Sep 13 20:01:35 2022] POST /identity/v3/projects => generated 379 bytes in 152 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 13 20:01:36.066191 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a86d7923-f82a-4f94-9b36-975b2154126c admin admin] Authenticating user token {{(pid=82025) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 20:01:36.081102 dv-cinder-828806-6-smb devstack@keystone.service[82026]: [pid: 82026|app: 0|req: 1051/2163] 10.222.0.33 () {60 vars in 1483 bytes} [Tue Sep 13 20:01:35 2022] PUT /identity/v3/projects/52cd0497e33349f1b50b49791f5a0f63/users/77a7a63634904f22ab948abba67d8d94/roles/3618ab638a65401f82333da7596d1daf => generated 0 bytes in 207 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 20:01:36.082008 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bfd5f9f-c626-48e9-8a3a-290985c44492 admin admin] Authenticating user token {{(pid=82026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 20:01:36.171278 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a86d7923-f82a-4f94-9b36-975b2154126c admin admin] Validating token access rules against request {{(pid=82025) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 20:01:36.186137 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bfd5f9f-c626-48e9-8a3a-290985c44492 admin admin] Validating token access rules against request {{(pid=82026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 20:01:36.194021 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b9d878c-8ef3-48ee-93f4-82efb17f8b2d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57539b6a6f3b4d589f5f5e1d211cd6a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b454f707d20347ada3d82aa85495635e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 20:01:36.194647 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b9d878c-8ef3-48ee-93f4-82efb17f8b2d admin admin] REQUEST_METHOD: `POST` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:01:36.194989 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b9d878c-8ef3-48ee-93f4-82efb17f8b2d admin admin] SCRIPT_NAME: `/identity` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:01:36.195685 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b9d878c-8ef3-48ee-93f4-82efb17f8b2d admin admin] PATH_INFO: `/v3/users` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:01:36.196744 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b9d878c-8ef3-48ee-93f4-82efb17f8b2d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 20:01:36.200054 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b9d878c-8ef3-48ee-93f4-82efb17f8b2d admin admin] RBAC: Authorization granted {{(pid=82026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 20:01:36.262082 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15756989-674f-4244-b3d6-b9db13200071 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57539b6a6f3b4d589f5f5e1d211cd6a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b454f707d20347ada3d82aa85495635e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82025) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 20:01:36.262766 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15756989-674f-4244-b3d6-b9db13200071 admin admin] REQUEST_METHOD: `PUT` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:01:36.263091 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15756989-674f-4244-b3d6-b9db13200071 admin admin] SCRIPT_NAME: `/identity` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:01:36.263386 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15756989-674f-4244-b3d6-b9db13200071 admin admin] PATH_INFO: `/v3/projects/c48f34baf47e496395a8f155ad1fb58d/users/319297bab2cc49e9a05426a9a715764a/roles/e5af7d5baa93469e9e486ef21c85474e` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:01:36.301336 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15756989-674f-4244-b3d6-b9db13200071 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c48f34baf47e496395a8f155ad1fb58d, user_id=319297bab2cc49e9a05426a9a715764a, role_id=e5af7d5baa93469e9e486ef21c85474e)` {{(pid=82025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 20:01:36.304882 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15756989-674f-4244-b3d6-b9db13200071 admin admin] RBAC: Authorization granted {{(pid=82025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 20:01:36.322257 dv-cinder-828806-6-smb devstack@keystone.service[82026]: [pid: 82026|app: 0|req: 1052/2164] 10.222.0.33 () {60 vars in 1144 bytes} [Tue Sep 13 20:01:36 2022] POST /identity/v3/users => generated 296 bytes in 240 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 13 20:01:36.323815 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f3db7ce-c9f8-4a79-a135-6a8ae616ada1 None None] REQUEST_METHOD: `POST` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:01:36.324109 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f3db7ce-c9f8-4a79-a135-6a8ae616ada1 None None] SCRIPT_NAME: `/identity` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:01:36.324394 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f3db7ce-c9f8-4a79-a135-6a8ae616ada1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:01:36.352700 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG dbcounter [-] [82025] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=82025) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 20:01:36.361154 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.auth.core [None req-9f3db7ce-c9f8-4a79-a135-6a8ae616ada1 None None] MFA Rules not processed for user `77a7a63634904f22ab948abba67d8d94`. Rule list: `[]` (Enabled: `True`). {{(pid=82026) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 20:01:36.362525 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.common.fernet_utils [None req-9f3db7ce-c9f8-4a79-a135-6a8ae616ada1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82026) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 20:01:36.403573 dv-cinder-828806-6-smb devstack@keystone.service[82025]: [pid: 82025|app: 0|req: 1113/2165] 10.222.0.33 () {60 vars in 1483 bytes} [Tue Sep 13 20:01:36 2022] PUT /identity/v3/projects/c48f34baf47e496395a8f155ad1fb58d/users/319297bab2cc49e9a05426a9a715764a/roles/e5af7d5baa93469e9e486ef21c85474e => generated 0 bytes in 339 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 20:01:36.406740 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15756989-674f-4244-b3d6-b9db13200071 admin admin] Authenticating user token {{(pid=82025) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 20:01:36.441225 dv-cinder-828806-6-smb devstack@keystone.service[82026]: [pid: 82026|app: 0|req: 1053/2166] 10.222.0.33 () {58 vars in 958 bytes} [Tue Sep 13 20:01:36 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 20:01:36.442347 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f3db7ce-c9f8-4a79-a135-6a8ae616ada1 None None] Authenticating user token {{(pid=82026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 20:01:36.458536 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f3db7ce-c9f8-4a79-a135-6a8ae616ada1 None None] Validating token access rules against request {{(pid=82026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 20:01:36.491077 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15756989-674f-4244-b3d6-b9db13200071 admin admin] Validating token access rules against request {{(pid=82025) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 20:01:36.494555 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a68c0555-6402-46aa-87f4-9c8a61861bab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57539b6a6f3b4d589f5f5e1d211cd6a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b454f707d20347ada3d82aa85495635e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82025) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 20:01:36.495495 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a68c0555-6402-46aa-87f4-9c8a61861bab admin admin] REQUEST_METHOD: `GET` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:01:36.495850 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a68c0555-6402-46aa-87f4-9c8a61861bab admin admin] SCRIPT_NAME: `/identity` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:01:36.496200 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a68c0555-6402-46aa-87f4-9c8a61861bab admin admin] PATH_INFO: `/v3/roles` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:01:36.496924 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a68c0555-6402-46aa-87f4-9c8a61861bab admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 20:01:36.498683 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a68c0555-6402-46aa-87f4-9c8a61861bab admin admin] RBAC: Authorization granted {{(pid=82025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 20:01:36.512974 dv-cinder-828806-6-smb devstack@keystone.service[82025]: [pid: 82025|app: 0|req: 1114/2167] 10.222.0.33 () {58 vars in 1122 bytes} [Tue Sep 13 20:01:36 2022] GET /identity/v3/roles => generated 1420 bytes in 105 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 13 20:01:36.512974 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a68c0555-6402-46aa-87f4-9c8a61861bab admin admin] Authenticating user token {{(pid=82025) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 20:01:36.527364 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a68c0555-6402-46aa-87f4-9c8a61861bab admin admin] Validating token access rules against request {{(pid=82025) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 20:01:36.531564 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8569a6ad-0168-4969-b07b-de5d2eb19469 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57539b6a6f3b4d589f5f5e1d211cd6a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b454f707d20347ada3d82aa85495635e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 20:01:36.532116 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8569a6ad-0168-4969-b07b-de5d2eb19469 admin admin] REQUEST_METHOD: `GET` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:01:36.533954 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8569a6ad-0168-4969-b07b-de5d2eb19469 admin admin] SCRIPT_NAME: `/identity` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:01:36.533954 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8569a6ad-0168-4969-b07b-de5d2eb19469 admin admin] PATH_INFO: `/v3/roles` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:01:36.533954 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8569a6ad-0168-4969-b07b-de5d2eb19469 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 20:01:36.534715 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10c5db90-a330-4c2b-a29a-fb3ab18d256a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57539b6a6f3b4d589f5f5e1d211cd6a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b454f707d20347ada3d82aa85495635e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82025) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 20:01:36.535511 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10c5db90-a330-4c2b-a29a-fb3ab18d256a admin admin] REQUEST_METHOD: `POST` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:01:36.535802 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10c5db90-a330-4c2b-a29a-fb3ab18d256a admin admin] SCRIPT_NAME: `/identity` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:01:36.536161 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10c5db90-a330-4c2b-a29a-fb3ab18d256a admin admin] PATH_INFO: `/v3/projects` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:01:36.536899 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10c5db90-a330-4c2b-a29a-fb3ab18d256a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 20:01:36.543923 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10c5db90-a330-4c2b-a29a-fb3ab18d256a admin admin] RBAC: Authorization granted {{(pid=82025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 20:01:36.545455 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8569a6ad-0168-4969-b07b-de5d2eb19469 admin admin] RBAC: Authorization granted {{(pid=82026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 20:01:36.570781 dv-cinder-828806-6-smb devstack@keystone.service[82026]: [pid: 82026|app: 0|req: 1054/2168] 10.222.0.33 () {58 vars in 1122 bytes} [Tue Sep 13 20:01:36 2022] GET /identity/v3/roles => generated 1420 bytes in 126 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 13 20:01:36.570781 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8569a6ad-0168-4969-b07b-de5d2eb19469 admin admin] Authenticating user token {{(pid=82026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 20:01:36.593993 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8569a6ad-0168-4969-b07b-de5d2eb19469 admin admin] Validating token access rules against request {{(pid=82026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 20:01:36.611712 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02ec4e5a-fe06-4d91-afd5-497b04f4c1a2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57539b6a6f3b4d589f5f5e1d211cd6a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b454f707d20347ada3d82aa85495635e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 20:01:36.613765 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02ec4e5a-fe06-4d91-afd5-497b04f4c1a2 admin admin] REQUEST_METHOD: `PUT` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:01:36.614123 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02ec4e5a-fe06-4d91-afd5-497b04f4c1a2 admin admin] SCRIPT_NAME: `/identity` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:01:36.614463 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02ec4e5a-fe06-4d91-afd5-497b04f4c1a2 admin admin] PATH_INFO: `/v3/projects/f080a0989f2d4eb4a236975c6391c3b7/users/fb20cea4f6c54227987773aa173b6b03/roles/e5af7d5baa93469e9e486ef21c85474e` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:01:36.642755 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02ec4e5a-fe06-4d91-afd5-497b04f4c1a2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f080a0989f2d4eb4a236975c6391c3b7, user_id=fb20cea4f6c54227987773aa173b6b03, role_id=e5af7d5baa93469e9e486ef21c85474e)` {{(pid=82026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 20:01:36.652973 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02ec4e5a-fe06-4d91-afd5-497b04f4c1a2 admin admin] RBAC: Authorization granted {{(pid=82026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 20:01:36.666146 dv-cinder-828806-6-smb devstack@keystone.service[82025]: [pid: 82025|app: 0|req: 1115/2169] 10.222.0.33 () {60 vars in 1153 bytes} [Tue Sep 13 20:01:36 2022] POST /identity/v3/projects => generated 383 bytes in 153 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 13 20:01:36.666146 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10c5db90-a330-4c2b-a29a-fb3ab18d256a admin admin] Authenticating user token {{(pid=82025) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 20:01:36.757701 dv-cinder-828806-6-smb devstack@keystone.service[82026]: [pid: 82026|app: 0|req: 1055/2170] 10.222.0.33 () {60 vars in 1483 bytes} [Tue Sep 13 20:01:36 2022] PUT /identity/v3/projects/f080a0989f2d4eb4a236975c6391c3b7/users/fb20cea4f6c54227987773aa173b6b03/roles/e5af7d5baa93469e9e486ef21c85474e => generated 0 bytes in 186 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 20:01:36.757701 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02ec4e5a-fe06-4d91-afd5-497b04f4c1a2 admin admin] Authenticating user token {{(pid=82026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 20:01:36.784841 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10c5db90-a330-4c2b-a29a-fb3ab18d256a admin admin] Validating token access rules against request {{(pid=82025) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 20:01:36.911019 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02ec4e5a-fe06-4d91-afd5-497b04f4c1a2 admin admin] Validating token access rules against request {{(pid=82026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 20:01:36.926680 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9f24ed8-572d-436e-bafd-20e1cfd3e618 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57539b6a6f3b4d589f5f5e1d211cd6a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b454f707d20347ada3d82aa85495635e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 20:01:36.927340 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9f24ed8-572d-436e-bafd-20e1cfd3e618 admin admin] REQUEST_METHOD: `POST` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:01:36.931282 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9f24ed8-572d-436e-bafd-20e1cfd3e618 admin admin] SCRIPT_NAME: `/identity` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:01:36.931282 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9f24ed8-572d-436e-bafd-20e1cfd3e618 admin admin] PATH_INFO: `/v3/users` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:01:36.931282 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9f24ed8-572d-436e-bafd-20e1cfd3e618 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 20:01:36.931282 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9f24ed8-572d-436e-bafd-20e1cfd3e618 admin admin] RBAC: Authorization granted {{(pid=82026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 20:01:36.944500 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-290f3337-2379-43af-a890-3a4c4dfbf79f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57539b6a6f3b4d589f5f5e1d211cd6a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b454f707d20347ada3d82aa85495635e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82025) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 20:01:36.946252 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-290f3337-2379-43af-a890-3a4c4dfbf79f admin admin] REQUEST_METHOD: `PUT` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:01:36.946986 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-290f3337-2379-43af-a890-3a4c4dfbf79f admin admin] SCRIPT_NAME: `/identity` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:01:36.947531 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-290f3337-2379-43af-a890-3a4c4dfbf79f admin admin] PATH_INFO: `/v3/projects/c48f34baf47e496395a8f155ad1fb58d/users/319297bab2cc49e9a05426a9a715764a/roles/e5af7d5baa93469e9e486ef21c85474e` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:01:36.951315 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-290f3337-2379-43af-a890-3a4c4dfbf79f admin admin] RBAC: Authorizing `identity:create_grant(project_id=c48f34baf47e496395a8f155ad1fb58d, user_id=319297bab2cc49e9a05426a9a715764a, role_id=e5af7d5baa93469e9e486ef21c85474e)` {{(pid=82025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 20:01:36.955253 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-290f3337-2379-43af-a890-3a4c4dfbf79f admin admin] RBAC: Authorization granted {{(pid=82025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 20:01:36.985560 dv-cinder-828806-6-smb devstack@keystone.service[82025]: [pid: 82025|app: 0|req: 1116/2171] 10.222.0.33 () {60 vars in 1483 bytes} [Tue Sep 13 20:01:36 2022] PUT /identity/v3/projects/c48f34baf47e496395a8f155ad1fb58d/users/319297bab2cc49e9a05426a9a715764a/roles/e5af7d5baa93469e9e486ef21c85474e => generated 0 bytes in 309 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 20:01:36.986662 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-290f3337-2379-43af-a890-3a4c4dfbf79f admin admin] Authenticating user token {{(pid=82025) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 20:01:37.022265 dv-cinder-828806-6-smb devstack@keystone.service[82026]: [pid: 82026|app: 0|req: 1056/2172] 10.222.0.33 () {60 vars in 1144 bytes} [Tue Sep 13 20:01:36 2022] POST /identity/v3/users => generated 298 bytes in 264 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 13 20:01:37.022265 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90ec331d-24cb-4972-86a1-f8251d1ca359 None None] REQUEST_METHOD: `POST` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:01:37.022265 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90ec331d-24cb-4972-86a1-f8251d1ca359 None None] SCRIPT_NAME: `/identity` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:01:37.022265 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90ec331d-24cb-4972-86a1-f8251d1ca359 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:01:37.067315 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.auth.core [None req-90ec331d-24cb-4972-86a1-f8251d1ca359 None None] MFA Rules not processed for user `319297bab2cc49e9a05426a9a715764a`. Rule list: `[]` (Enabled: `True`). {{(pid=82026) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 20:01:37.068833 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.common.fernet_utils [None req-90ec331d-24cb-4972-86a1-f8251d1ca359 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82026) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 20:01:37.109153 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-290f3337-2379-43af-a890-3a4c4dfbf79f admin admin] Validating token access rules against request {{(pid=82025) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 20:01:37.118851 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7729408f-905a-45db-99aa-f222221645c3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57539b6a6f3b4d589f5f5e1d211cd6a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b454f707d20347ada3d82aa85495635e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82025) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 20:01:37.120944 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7729408f-905a-45db-99aa-f222221645c3 admin admin] REQUEST_METHOD: `GET` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:01:37.121435 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7729408f-905a-45db-99aa-f222221645c3 admin admin] SCRIPT_NAME: `/identity` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:01:37.122007 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7729408f-905a-45db-99aa-f222221645c3 admin admin] PATH_INFO: `/v3/roles` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:01:37.122746 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7729408f-905a-45db-99aa-f222221645c3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 20:01:37.126524 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7729408f-905a-45db-99aa-f222221645c3 admin admin] RBAC: Authorization granted {{(pid=82025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 20:01:37.153012 dv-cinder-828806-6-smb devstack@keystone.service[82025]: [pid: 82025|app: 0|req: 1117/2173] 10.222.0.33 () {58 vars in 1122 bytes} [Tue Sep 13 20:01:36 2022] GET /identity/v3/roles => generated 1420 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 13 20:01:37.153945 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7729408f-905a-45db-99aa-f222221645c3 admin admin] Authenticating user token {{(pid=82025) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 20:01:37.170629 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7729408f-905a-45db-99aa-f222221645c3 admin admin] Validating token access rules against request {{(pid=82025) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 20:01:37.176714 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19fc1186-88b8-4aa4-a570-69e47d29372c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57539b6a6f3b4d589f5f5e1d211cd6a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b454f707d20347ada3d82aa85495635e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82025) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 20:01:37.177345 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19fc1186-88b8-4aa4-a570-69e47d29372c admin admin] REQUEST_METHOD: `GET` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:01:37.177630 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19fc1186-88b8-4aa4-a570-69e47d29372c admin admin] SCRIPT_NAME: `/identity` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:01:37.177911 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19fc1186-88b8-4aa4-a570-69e47d29372c admin admin] PATH_INFO: `/v3/roles` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:01:37.178596 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19fc1186-88b8-4aa4-a570-69e47d29372c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 20:01:37.179225 dv-cinder-828806-6-smb devstack@keystone.service[82026]: [pid: 82026|app: 0|req: 1057/2174] 10.222.0.33 () {58 vars in 958 bytes} [Tue Sep 13 20:01:37 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 159 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 20:01:37.181052 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-178a0ac3-e51b-451d-af84-1e188fceadfc None None] REQUEST_METHOD: `POST` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:01:37.181605 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-178a0ac3-e51b-451d-af84-1e188fceadfc None None] SCRIPT_NAME: `/identity` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:01:37.181978 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-178a0ac3-e51b-451d-af84-1e188fceadfc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:01:37.185068 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19fc1186-88b8-4aa4-a570-69e47d29372c admin admin] RBAC: Authorization granted {{(pid=82025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 20:01:37.198877 dv-cinder-828806-6-smb devstack@keystone.service[82025]: [pid: 82025|app: 0|req: 1118/2175] 10.222.0.33 () {58 vars in 1122 bytes} [Tue Sep 13 20:01:37 2022] GET /identity/v3/roles => generated 1420 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 13 20:01:37.200056 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19fc1186-88b8-4aa4-a570-69e47d29372c admin admin] Authenticating user token {{(pid=82025) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 20:01:37.212729 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19fc1186-88b8-4aa4-a570-69e47d29372c admin admin] Validating token access rules against request {{(pid=82025) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 20:01:37.218473 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-421db5f9-1f02-449f-9074-c558d87fb949 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57539b6a6f3b4d589f5f5e1d211cd6a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b454f707d20347ada3d82aa85495635e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82025) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 20:01:37.218794 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.auth.core [None req-178a0ac3-e51b-451d-af84-1e188fceadfc None None] MFA Rules not processed for user `1c2e721388804b1c8bed6ee356fce720`. Rule list: `[]` (Enabled: `True`). {{(pid=82026) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 20:01:37.219471 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-421db5f9-1f02-449f-9074-c558d87fb949 admin admin] REQUEST_METHOD: `PUT` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:01:37.219601 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-421db5f9-1f02-449f-9074-c558d87fb949 admin admin] SCRIPT_NAME: `/identity` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:01:37.219949 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-421db5f9-1f02-449f-9074-c558d87fb949 admin admin] PATH_INFO: `/v3/projects/f080a0989f2d4eb4a236975c6391c3b7/users/fb20cea4f6c54227987773aa173b6b03/roles/e5af7d5baa93469e9e486ef21c85474e` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:01:37.220382 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.common.fernet_utils [None req-178a0ac3-e51b-451d-af84-1e188fceadfc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82026) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 20:01:37.222139 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-421db5f9-1f02-449f-9074-c558d87fb949 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f080a0989f2d4eb4a236975c6391c3b7, user_id=fb20cea4f6c54227987773aa173b6b03, role_id=e5af7d5baa93469e9e486ef21c85474e)` {{(pid=82025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 20:01:37.225071 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-421db5f9-1f02-449f-9074-c558d87fb949 admin admin] RBAC: Authorization granted {{(pid=82025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 20:01:37.240454 dv-cinder-828806-6-smb devstack@keystone.service[82025]: [pid: 82025|app: 0|req: 1119/2176] 10.222.0.33 () {60 vars in 1483 bytes} [Tue Sep 13 20:01:37 2022] PUT /identity/v3/projects/f080a0989f2d4eb4a236975c6391c3b7/users/fb20cea4f6c54227987773aa173b6b03/roles/e5af7d5baa93469e9e486ef21c85474e => generated 0 bytes in 41 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 20:01:37.241213 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-421db5f9-1f02-449f-9074-c558d87fb949 admin admin] Authenticating user token {{(pid=82025) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 20:01:37.243912 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.fernet_utils [None req-421db5f9-1f02-449f-9074-c558d87fb949 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82025) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 20:01:37.305769 dv-cinder-828806-6-smb devstack@keystone.service[82026]: [pid: 82026|app: 0|req: 1058/2177] 10.222.0.33 () {58 vars in 958 bytes} [Tue Sep 13 20:01:37 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 20:01:37.306778 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-178a0ac3-e51b-451d-af84-1e188fceadfc None None] Authenticating user token {{(pid=82026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 20:01:37.315964 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-421db5f9-1f02-449f-9074-c558d87fb949 admin admin] Validating token access rules against request {{(pid=82025) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 20:01:37.320020 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-178a0ac3-e51b-451d-af84-1e188fceadfc None None] Validating token access rules against request {{(pid=82026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 20:01:37.320231 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c201f81b-61cd-4cc3-9bf7-d853467f75a0 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46024fc6167f4321818b1bed27a521a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8c6fba0f15b4d6a84ff601919b7b8e4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82025) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 20:01:37.320986 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c201f81b-61cd-4cc3-9bf7-d853467f75a0 service cinder] REQUEST_METHOD: `GET` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:01:37.321336 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c201f81b-61cd-4cc3-9bf7-d853467f75a0 service cinder] SCRIPT_NAME: `/identity` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:01:37.321715 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c201f81b-61cd-4cc3-9bf7-d853467f75a0 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:01:37.344949 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG dbcounter [-] [82025] Writing DB stats keystone:SELECT=89,keystone:DELETE=7,keystone:INSERT=4 {{(pid=82025) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 20:01:37.380750 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG dbcounter [-] [82026] Writing DB stats keystone:SELECT=100 {{(pid=82026) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 20:01:37.403306 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c201f81b-61cd-4cc3-9bf7-d853467f75a0 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=82025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 20:01:37.405038 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c201f81b-61cd-4cc3-9bf7-d853467f75a0 service cinder] RBAC: Authorization granted {{(pid=82025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 20:01:37.419671 dv-cinder-828806-6-smb devstack@keystone.service[82025]: [pid: 82025|app: 0|req: 1120/2178] 10.222.0.33 () {60 vars in 1365 bytes} [Tue Sep 13 20:01:37 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 179 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 20:01:37.420812 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a79001c-0aa8-483f-baa3-fd4a3631d659 None None] REQUEST_METHOD: `POST` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:01:37.421104 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a79001c-0aa8-483f-baa3-fd4a3631d659 None None] SCRIPT_NAME: `/identity` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:01:37.421505 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f3e3636-0b62-467b-a36b-026552010edc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57539b6a6f3b4d589f5f5e1d211cd6a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b454f707d20347ada3d82aa85495635e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 20:01:37.421801 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a79001c-0aa8-483f-baa3-fd4a3631d659 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:01:37.422683 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f3e3636-0b62-467b-a36b-026552010edc admin admin] REQUEST_METHOD: `PUT` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:01:37.423244 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f3e3636-0b62-467b-a36b-026552010edc admin admin] SCRIPT_NAME: `/identity` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:01:37.423791 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f3e3636-0b62-467b-a36b-026552010edc admin admin] PATH_INFO: `/v3/projects/64afebad8e74468ba67eaed530864977/users/da98974ef3424af7845ff7fb7b3ffa20/roles/e5af7d5baa93469e9e486ef21c85474e` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:01:37.446859 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f3e3636-0b62-467b-a36b-026552010edc admin admin] RBAC: Authorizing `identity:create_grant(project_id=64afebad8e74468ba67eaed530864977, user_id=da98974ef3424af7845ff7fb7b3ffa20, role_id=e5af7d5baa93469e9e486ef21c85474e)` {{(pid=82026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 20:01:37.456718 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f3e3636-0b62-467b-a36b-026552010edc admin admin] RBAC: Authorization granted {{(pid=82026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 20:01:37.463306 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.auth.core [None req-9a79001c-0aa8-483f-baa3-fd4a3631d659 None None] MFA Rules not processed for user `fb20cea4f6c54227987773aa173b6b03`. Rule list: `[]` (Enabled: `True`). {{(pid=82025) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 20:01:37.465342 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.fernet_utils [None req-9a79001c-0aa8-483f-baa3-fd4a3631d659 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82025) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 20:01:37.564466 dv-cinder-828806-6-smb devstack@keystone.service[82026]: [pid: 82026|app: 0|req: 1059/2179] 10.222.0.33 () {60 vars in 1483 bytes} [Tue Sep 13 20:01:37 2022] PUT /identity/v3/projects/64afebad8e74468ba67eaed530864977/users/da98974ef3424af7845ff7fb7b3ffa20/roles/e5af7d5baa93469e9e486ef21c85474e => generated 0 bytes in 254 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 20:01:37.565557 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f3e3636-0b62-467b-a36b-026552010edc admin admin] Authenticating user token {{(pid=82026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 20:01:37.570657 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.common.fernet_utils [None req-1f3e3636-0b62-467b-a36b-026552010edc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82026) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 20:01:37.572321 dv-cinder-828806-6-smb devstack@keystone.service[82025]: [pid: 82025|app: 0|req: 1121/2180] 10.222.0.33 () {58 vars in 958 bytes} [Tue Sep 13 20:01:37 2022] POST /identity/v3/auth/tokens => generated 3323 bytes in 152 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 20:01:37.574019 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a79001c-0aa8-483f-baa3-fd4a3631d659 None None] Authenticating user token {{(pid=82025) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 20:01:37.589455 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a79001c-0aa8-483f-baa3-fd4a3631d659 None None] Validating token access rules against request {{(pid=82025) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 20:01:37.676387 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5358e142-17ab-4789-aff8-6a4f676241ba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57539b6a6f3b4d589f5f5e1d211cd6a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b454f707d20347ada3d82aa85495635e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82025) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 20:01:37.679015 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5358e142-17ab-4789-aff8-6a4f676241ba admin admin] REQUEST_METHOD: `GET` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:01:37.679015 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5358e142-17ab-4789-aff8-6a4f676241ba admin admin] SCRIPT_NAME: `/identity` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:01:37.679015 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5358e142-17ab-4789-aff8-6a4f676241ba admin admin] PATH_INFO: `/v3/roles` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:01:37.679015 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5358e142-17ab-4789-aff8-6a4f676241ba admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 20:01:37.680324 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5358e142-17ab-4789-aff8-6a4f676241ba admin admin] RBAC: Authorization granted {{(pid=82025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 20:01:37.692573 dv-cinder-828806-6-smb devstack@keystone.service[82025]: [pid: 82025|app: 0|req: 1122/2181] 10.222.0.33 () {58 vars in 1122 bytes} [Tue Sep 13 20:01:37 2022] GET /identity/v3/roles => generated 1420 bytes in 120 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 13 20:01:37.693538 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5358e142-17ab-4789-aff8-6a4f676241ba admin admin] Authenticating user token {{(pid=82025) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 20:01:37.697480 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.fernet_utils [None req-5358e142-17ab-4789-aff8-6a4f676241ba admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82025) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 20:01:37.705459 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f3e3636-0b62-467b-a36b-026552010edc admin admin] Validating token access rules against request {{(pid=82026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 20:01:37.712303 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11696f26-25a8-4f75-bea4-25a6ea0b2eec service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e66e7034abed4e0bad1f4137520c1e70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8c6fba0f15b4d6a84ff601919b7b8e4', 'project_domain_id': 'default', 'roles': ['service', 'member', 'reader', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 20:01:37.712981 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11696f26-25a8-4f75-bea4-25a6ea0b2eec service nova] REQUEST_METHOD: `GET` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:01:37.713283 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11696f26-25a8-4f75-bea4-25a6ea0b2eec service nova] SCRIPT_NAME: `/identity` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:01:37.714089 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11696f26-25a8-4f75-bea4-25a6ea0b2eec service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:01:37.788499 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11696f26-25a8-4f75-bea4-25a6ea0b2eec service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 20:01:37.792598 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11696f26-25a8-4f75-bea4-25a6ea0b2eec service nova] RBAC: Authorization granted {{(pid=82026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 20:01:37.792760 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5358e142-17ab-4789-aff8-6a4f676241ba admin admin] Validating token access rules against request {{(pid=82025) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 20:01:37.797543 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d8d6e19-c08d-4773-a2bb-347609db31dc service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46024fc6167f4321818b1bed27a521a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8c6fba0f15b4d6a84ff601919b7b8e4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82025) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 20:01:37.805631 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d8d6e19-c08d-4773-a2bb-347609db31dc service cinder] REQUEST_METHOD: `GET` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:01:37.805631 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d8d6e19-c08d-4773-a2bb-347609db31dc service cinder] SCRIPT_NAME: `/identity` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:01:37.805631 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d8d6e19-c08d-4773-a2bb-347609db31dc service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:01:37.806950 dv-cinder-828806-6-smb devstack@keystone.service[82026]: [pid: 82026|app: 0|req: 1060/2182] 10.222.0.33 () {60 vars in 1365 bytes} [Tue Sep 13 20:01:37 2022] GET /identity/v3/auth/tokens => generated 3264 bytes in 242 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 20:01:37.812036 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11696f26-25a8-4f75-bea4-25a6ea0b2eec service nova] Authenticating user token {{(pid=82026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 20:01:37.823514 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11696f26-25a8-4f75-bea4-25a6ea0b2eec service nova] Validating token access rules against request {{(pid=82026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 20:01:37.840280 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG dbcounter [-] [82026] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=82026) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 20:01:37.845730 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3669458f-b5c8-470b-b2db-ad23fb860edf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57539b6a6f3b4d589f5f5e1d211cd6a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b454f707d20347ada3d82aa85495635e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 20:01:37.845730 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3669458f-b5c8-470b-b2db-ad23fb860edf admin admin] REQUEST_METHOD: `PUT` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:01:37.845730 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3669458f-b5c8-470b-b2db-ad23fb860edf admin admin] SCRIPT_NAME: `/identity` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:01:37.845730 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3669458f-b5c8-470b-b2db-ad23fb860edf admin admin] PATH_INFO: `/v3/projects/64afebad8e74468ba67eaed530864977/users/da98974ef3424af7845ff7fb7b3ffa20/roles/e5af7d5baa93469e9e486ef21c85474e` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:01:37.846172 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3669458f-b5c8-470b-b2db-ad23fb860edf admin admin] RBAC: Authorizing `identity:create_grant(project_id=64afebad8e74468ba67eaed530864977, user_id=da98974ef3424af7845ff7fb7b3ffa20, role_id=e5af7d5baa93469e9e486ef21c85474e)` {{(pid=82026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 20:01:37.850241 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3669458f-b5c8-470b-b2db-ad23fb860edf admin admin] RBAC: Authorization granted {{(pid=82026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 20:01:37.880507 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d8d6e19-c08d-4773-a2bb-347609db31dc service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=82025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 20:01:37.882456 dv-cinder-828806-6-smb devstack@keystone.service[82026]: [pid: 82026|app: 0|req: 1061/2183] 10.222.0.33 () {60 vars in 1483 bytes} [Tue Sep 13 20:01:37 2022] PUT /identity/v3/projects/64afebad8e74468ba67eaed530864977/users/da98974ef3424af7845ff7fb7b3ffa20/roles/e5af7d5baa93469e9e486ef21c85474e => generated 0 bytes in 71 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 20:01:37.883963 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d8d6e19-c08d-4773-a2bb-347609db31dc service cinder] RBAC: Authorization granted {{(pid=82025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 20:01:37.896661 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2f6685b-919e-456a-98ac-669e9705b660 None None] REQUEST_METHOD: `POST` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:01:37.896956 dv-cinder-828806-6-smb devstack@keystone.service[82025]: [pid: 82025|app: 0|req: 1123/2184] 10.222.0.33 () {60 vars in 1365 bytes} [Tue Sep 13 20:01:37 2022] GET /identity/v3/auth/tokens => generated 3323 bytes in 204 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 20:01:37.897066 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2f6685b-919e-456a-98ac-669e9705b660 None None] SCRIPT_NAME: `/identity` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:01:37.897258 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2f6685b-919e-456a-98ac-669e9705b660 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:01:37.975974 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.auth.core [None req-d2f6685b-919e-456a-98ac-669e9705b660 None None] MFA Rules not processed for user `da98974ef3424af7845ff7fb7b3ffa20`. Rule list: `[]` (Enabled: `True`). {{(pid=82026) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 20:01:37.977532 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.common.fernet_utils [None req-d2f6685b-919e-456a-98ac-669e9705b660 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82026) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 20:01:38.082550 dv-cinder-828806-6-smb devstack@keystone.service[82026]: [pid: 82026|app: 0|req: 1062/2185] 10.222.0.33 () {58 vars in 958 bytes} [Tue Sep 13 20:01:37 2022] POST /identity/v3/auth/tokens => generated 3327 bytes in 187 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 20:01:38.085067 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d8d6e19-c08d-4773-a2bb-347609db31dc service cinder] Authenticating user token {{(pid=82025) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 20:01:38.094782 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d8d6e19-c08d-4773-a2bb-347609db31dc service cinder] Validating token access rules against request {{(pid=82025) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 20:01:38.154189 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2570251-0d49-4de6-8e71-c65a7f2377cc service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46024fc6167f4321818b1bed27a521a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8c6fba0f15b4d6a84ff601919b7b8e4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82025) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 20:01:38.154820 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2570251-0d49-4de6-8e71-c65a7f2377cc service cinder] REQUEST_METHOD: `GET` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:01:38.155130 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2570251-0d49-4de6-8e71-c65a7f2377cc service cinder] SCRIPT_NAME: `/identity` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:01:38.155410 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2570251-0d49-4de6-8e71-c65a7f2377cc service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:01:38.157282 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.fernet_utils [None req-e2570251-0d49-4de6-8e71-c65a7f2377cc service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82025) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 20:01:38.239809 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2570251-0d49-4de6-8e71-c65a7f2377cc service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=82025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 20:01:38.241962 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2570251-0d49-4de6-8e71-c65a7f2377cc service cinder] RBAC: Authorization granted {{(pid=82025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 20:01:38.255924 dv-cinder-828806-6-smb devstack@keystone.service[82025]: [pid: 82025|app: 0|req: 1124/2186] 10.222.0.33 () {60 vars in 1365 bytes} [Tue Sep 13 20:01:38 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 171 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 20:01:38.293057 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2f6685b-919e-456a-98ac-669e9705b660 None None] Authenticating user token {{(pid=82026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 20:01:38.303848 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2f6685b-919e-456a-98ac-669e9705b660 None None] Validating token access rules against request {{(pid=82026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 20:01:38.309802 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a89ffb49-d55e-4971-87e2-f9355542c865 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46024fc6167f4321818b1bed27a521a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8c6fba0f15b4d6a84ff601919b7b8e4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 20:01:38.309802 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a89ffb49-d55e-4971-87e2-f9355542c865 service cinder] REQUEST_METHOD: `GET` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:01:38.309802 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a89ffb49-d55e-4971-87e2-f9355542c865 service cinder] SCRIPT_NAME: `/identity` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:01:38.309802 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a89ffb49-d55e-4971-87e2-f9355542c865 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:01:38.325193 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a89ffb49-d55e-4971-87e2-f9355542c865 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=82026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 20:01:38.326889 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a89ffb49-d55e-4971-87e2-f9355542c865 service cinder] RBAC: Authorization granted {{(pid=82026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 20:01:38.341118 dv-cinder-828806-6-smb devstack@keystone.service[82026]: [pid: 82026|app: 0|req: 1063/2187] 10.222.0.33 () {60 vars in 1365 bytes} [Tue Sep 13 20:01:38 2022] GET /identity/v3/auth/tokens => generated 3327 bytes in 50 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 20:01:39.056824 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG dbcounter [-] [82025] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=82025) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 20:01:39.249220 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2570251-0d49-4de6-8e71-c65a7f2377cc service cinder] Authenticating user token {{(pid=82025) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 20:01:39.270216 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2570251-0d49-4de6-8e71-c65a7f2377cc service cinder] Validating token access rules against request {{(pid=82025) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 20:01:39.276147 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57f74aa1-599e-46be-b280-f5fe2512e80f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46024fc6167f4321818b1bed27a521a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8c6fba0f15b4d6a84ff601919b7b8e4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82025) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 20:01:39.276847 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57f74aa1-599e-46be-b280-f5fe2512e80f service cinder] REQUEST_METHOD: `GET` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:01:39.277193 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57f74aa1-599e-46be-b280-f5fe2512e80f service cinder] SCRIPT_NAME: `/identity` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:01:39.277479 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57f74aa1-599e-46be-b280-f5fe2512e80f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:01:39.408705 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57f74aa1-599e-46be-b280-f5fe2512e80f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=82025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 20:01:39.410236 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57f74aa1-599e-46be-b280-f5fe2512e80f service cinder] RBAC: Authorization granted {{(pid=82025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 20:01:39.421998 dv-cinder-828806-6-smb devstack@keystone.service[82025]: [pid: 82025|app: 0|req: 1125/2188] 10.222.0.33 () {60 vars in 1365 bytes} [Tue Sep 13 20:01:39 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 173 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 20:01:39.624722 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG dbcounter [-] [82026] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=82026) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 20:01:40.113919 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG dbcounter [-] [82025] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=82025) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 20:01:40.790560 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fdad244-f111-421c-a0c3-e81d0a704dbf None None] REQUEST_METHOD: `POST` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:01:40.791087 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fdad244-f111-421c-a0c3-e81d0a704dbf None None] SCRIPT_NAME: `/identity` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:01:40.791171 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fdad244-f111-421c-a0c3-e81d0a704dbf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:01:40.813919 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.auth.core [None req-5fdad244-f111-421c-a0c3-e81d0a704dbf None None] MFA Rules not processed for user `1c2e721388804b1c8bed6ee356fce720`. Rule list: `[]` (Enabled: `True`). {{(pid=82026) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 20:01:40.815624 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.common.fernet_utils [None req-5fdad244-f111-421c-a0c3-e81d0a704dbf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82026) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 20:01:40.897002 dv-cinder-828806-6-smb devstack@keystone.service[82026]: [pid: 82026|app: 0|req: 1064/2189] 10.222.0.33 () {58 vars in 958 bytes} [Tue Sep 13 20:01:40 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 20:01:41.115294 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57f74aa1-599e-46be-b280-f5fe2512e80f service cinder] Authenticating user token {{(pid=82025) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 20:01:41.195882 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57f74aa1-599e-46be-b280-f5fe2512e80f service cinder] Validating token access rules against request {{(pid=82025) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 20:01:41.201638 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ef72a98-75f0-4bb1-a432-4caf1269d2ff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57539b6a6f3b4d589f5f5e1d211cd6a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b454f707d20347ada3d82aa85495635e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82025) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 20:01:41.202356 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ef72a98-75f0-4bb1-a432-4caf1269d2ff admin admin] REQUEST_METHOD: `DELETE` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:01:41.202649 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ef72a98-75f0-4bb1-a432-4caf1269d2ff admin admin] SCRIPT_NAME: `/identity` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:01:41.202930 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ef72a98-75f0-4bb1-a432-4caf1269d2ff admin admin] PATH_INFO: `/v3/users/81d4729b7b8b4f53b3381ab66c4c51f4` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:01:41.204122 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ef72a98-75f0-4bb1-a432-4caf1269d2ff admin admin] RBAC: Authorizing `identity:delete_user(user_id=81d4729b7b8b4f53b3381ab66c4c51f4)` {{(pid=82025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 20:01:41.206432 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ef72a98-75f0-4bb1-a432-4caf1269d2ff admin admin] RBAC: Authorization granted {{(pid=82025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 20:01:41.310402 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG dbcounter [-] [82025] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82025) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 20:01:41.441314 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.notifications [None req-6ef72a98-75f0-4bb1-a432-4caf1269d2ff admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '81d4729b7b8b4f53b3381ab66c4c51f4'} {{(pid=82025) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 20:01:41.462311 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG dbcounter [-] [82026] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=82026) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 20:01:41.530689 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.notifications [None req-6ef72a98-75f0-4bb1-a432-4caf1269d2ff admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '81d4729b7b8b4f53b3381ab66c4c51f4'} {{(pid=82025) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 20:01:41.530689 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.notifications [None req-6ef72a98-75f0-4bb1-a432-4caf1269d2ff admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '81d4729b7b8b4f53b3381ab66c4c51f4'} {{(pid=82025) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 20:01:41.549580 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.notifications [None req-6ef72a98-75f0-4bb1-a432-4caf1269d2ff admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '81d4729b7b8b4f53b3381ab66c4c51f4'} {{(pid=82025) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 20:01:41.560957 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.notifications [None req-6ef72a98-75f0-4bb1-a432-4caf1269d2ff admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '81d4729b7b8b4f53b3381ab66c4c51f4'} {{(pid=82025) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 20:01:41.581744 dv-cinder-828806-6-smb devstack@keystone.service[82025]: [pid: 82025|app: 0|req: 1126/2190] 10.222.0.33 () {58 vars in 1224 bytes} [Tue Sep 13 20:01:41 2022] DELETE /identity/v3/users/81d4729b7b8b4f53b3381ab66c4c51f4 => generated 0 bytes in 455 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 20:01:41.581847 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1797487f-a7e2-4626-8c5c-c0854fd8ae22 None None] REQUEST_METHOD: `POST` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:01:41.581847 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1797487f-a7e2-4626-8c5c-c0854fd8ae22 None None] SCRIPT_NAME: `/identity` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:01:41.581847 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1797487f-a7e2-4626-8c5c-c0854fd8ae22 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:01:41.621136 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.auth.core [None req-1797487f-a7e2-4626-8c5c-c0854fd8ae22 None None] MFA Rules not processed for user `57539b6a6f3b4d589f5f5e1d211cd6a0`. Rule list: `[]` (Enabled: `True`). {{(pid=82026) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 20:01:41.624375 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.common.fernet_utils [None req-1797487f-a7e2-4626-8c5c-c0854fd8ae22 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82026) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 20:01:41.720481 dv-cinder-828806-6-smb devstack@keystone.service[82026]: [pid: 82026|app: 0|req: 1065/2191] 10.222.0.33 () {58 vars in 958 bytes} [Tue Sep 13 20:01:41 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 147 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 20:01:41.732148 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ef72a98-75f0-4bb1-a432-4caf1269d2ff admin admin] Authenticating user token {{(pid=82025) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 20:01:41.739950 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.fernet_utils [None req-6ef72a98-75f0-4bb1-a432-4caf1269d2ff admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82025) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 20:01:41.844904 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ef72a98-75f0-4bb1-a432-4caf1269d2ff admin admin] Validating token access rules against request {{(pid=82025) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 20:01:41.878297 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa8d2a02-2c8f-48cd-8871-7df2f288a3c5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '023a2c79c2444611b3d431928e56685d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8c6fba0f15b4d6a84ff601919b7b8e4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82025) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 20:01:41.878297 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa8d2a02-2c8f-48cd-8871-7df2f288a3c5 service neutron] REQUEST_METHOD: `GET` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:01:41.878297 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa8d2a02-2c8f-48cd-8871-7df2f288a3c5 service neutron] SCRIPT_NAME: `/identity` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:01:41.878297 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa8d2a02-2c8f-48cd-8871-7df2f288a3c5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:01:41.917443 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa8d2a02-2c8f-48cd-8871-7df2f288a3c5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 20:01:41.922328 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa8d2a02-2c8f-48cd-8871-7df2f288a3c5 service neutron] RBAC: Authorization granted {{(pid=82025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 20:01:41.952172 dv-cinder-828806-6-smb devstack@keystone.service[82025]: [pid: 82025|app: 0|req: 1127/2192] 10.222.0.33 () {60 vars in 1365 bytes} [Tue Sep 13 20:01:41 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 220 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 20:01:42.533177 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1797487f-a7e2-4626-8c5c-c0854fd8ae22 None None] Authenticating user token {{(pid=82026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 20:01:42.535364 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.common.fernet_utils [None req-1797487f-a7e2-4626-8c5c-c0854fd8ae22 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82026) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 20:01:42.548808 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG dbcounter [-] [82025] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=82025) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 20:01:42.549794 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1797487f-a7e2-4626-8c5c-c0854fd8ae22 None None] Validating token access rules against request {{(pid=82026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 20:01:42.555224 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfc87779-b93f-4015-8eca-023dd3e6bd23 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57539b6a6f3b4d589f5f5e1d211cd6a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b454f707d20347ada3d82aa85495635e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 20:01:42.556930 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfc87779-b93f-4015-8eca-023dd3e6bd23 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:01:42.556930 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfc87779-b93f-4015-8eca-023dd3e6bd23 admin admin] SCRIPT_NAME: `/identity` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:01:42.556930 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfc87779-b93f-4015-8eca-023dd3e6bd23 admin admin] PATH_INFO: `/v3/projects/a0c968088f234a088146631faa107c32` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:01:42.557879 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfc87779-b93f-4015-8eca-023dd3e6bd23 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a0c968088f234a088146631faa107c32)` {{(pid=82026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 20:01:42.559825 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfc87779-b93f-4015-8eca-023dd3e6bd23 admin admin] RBAC: Authorization granted {{(pid=82026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 20:01:42.691250 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.notifications [None req-bfc87779-b93f-4015-8eca-023dd3e6bd23 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a0c968088f234a088146631faa107c32', 'request_id': 'req-bfc87779-b93f-4015-8eca-023dd3e6bd23'} {{(pid=82026) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 20:01:42.782329 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.notifications [None req-bfc87779-b93f-4015-8eca-023dd3e6bd23 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a0c968088f234a088146631faa107c32', 'request_id': 'req-bfc87779-b93f-4015-8eca-023dd3e6bd23'} {{(pid=82026) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 20:01:42.791301 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.notifications [None req-bfc87779-b93f-4015-8eca-023dd3e6bd23 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a0c968088f234a088146631faa107c32', 'request_id': 'req-bfc87779-b93f-4015-8eca-023dd3e6bd23'} {{(pid=82026) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 20:01:42.804896 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.notifications [None req-bfc87779-b93f-4015-8eca-023dd3e6bd23 admin admin] The token cache is being invalidate because project a0c968088f234a088146631faa107c32 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82026) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 13 20:01:42.805318 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.notifications [None req-bfc87779-b93f-4015-8eca-023dd3e6bd23 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82026) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 20:01:42.806278 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.notifications [None req-bfc87779-b93f-4015-8eca-023dd3e6bd23 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82026) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 20:01:42.808552 dv-cinder-828806-6-smb devstack@keystone.service[82026]: [pid: 82026|app: 0|req: 1066/2193] 10.222.0.33 () {58 vars in 1233 bytes} [Tue Sep 13 20:01:42 2022] DELETE /identity/v3/projects/a0c968088f234a088146631faa107c32 => generated 0 bytes in 276 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 20:01:42.813037 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa8d2a02-2c8f-48cd-8871-7df2f288a3c5 service neutron] Authenticating user token {{(pid=82025) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 20:01:42.822732 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa8d2a02-2c8f-48cd-8871-7df2f288a3c5 service neutron] Validating token access rules against request {{(pid=82025) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 20:01:42.927579 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01181fae-685a-4ce4-88fe-53c8be1fba7b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57539b6a6f3b4d589f5f5e1d211cd6a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b454f707d20347ada3d82aa85495635e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82025) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 20:01:42.928323 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01181fae-685a-4ce4-88fe-53c8be1fba7b admin admin] REQUEST_METHOD: `DELETE` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:01:42.928588 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01181fae-685a-4ce4-88fe-53c8be1fba7b admin admin] SCRIPT_NAME: `/identity` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:01:42.929018 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01181fae-685a-4ce4-88fe-53c8be1fba7b admin admin] PATH_INFO: `/v3/users/319297bab2cc49e9a05426a9a715764a` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:01:42.930395 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01181fae-685a-4ce4-88fe-53c8be1fba7b admin admin] RBAC: Authorizing `identity:delete_user(user_id=319297bab2cc49e9a05426a9a715764a)` {{(pid=82025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 20:01:42.933310 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01181fae-685a-4ce4-88fe-53c8be1fba7b admin admin] RBAC: Authorization granted {{(pid=82025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 20:01:43.144383 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.notifications [None req-01181fae-685a-4ce4-88fe-53c8be1fba7b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '319297bab2cc49e9a05426a9a715764a'} {{(pid=82025) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 20:01:43.148120 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG dbcounter [-] [82026] Writing DB stats keystone:SELECT=88,keystone:DELETE=10,keystone:INSERT=2 {{(pid=82026) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 20:01:43.239236 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.notifications [None req-01181fae-685a-4ce4-88fe-53c8be1fba7b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '319297bab2cc49e9a05426a9a715764a'} {{(pid=82025) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 20:01:43.240552 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.notifications [None req-01181fae-685a-4ce4-88fe-53c8be1fba7b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '319297bab2cc49e9a05426a9a715764a'} {{(pid=82025) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 20:01:43.256498 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.notifications [None req-01181fae-685a-4ce4-88fe-53c8be1fba7b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '319297bab2cc49e9a05426a9a715764a'} {{(pid=82025) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 20:01:43.265984 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.notifications [None req-01181fae-685a-4ce4-88fe-53c8be1fba7b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '319297bab2cc49e9a05426a9a715764a'} {{(pid=82025) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 20:01:43.277634 dv-cinder-828806-6-smb devstack@keystone.service[82025]: [pid: 82025|app: 0|req: 1128/2194] 10.222.0.33 () {58 vars in 1224 bytes} [Tue Sep 13 20:01:42 2022] DELETE /identity/v3/users/319297bab2cc49e9a05426a9a715764a => generated 0 bytes in 461 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 20:01:43.278478 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfc87779-b93f-4015-8eca-023dd3e6bd23 admin admin] Authenticating user token {{(pid=82026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 20:01:43.279825 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.common.fernet_utils [None req-bfc87779-b93f-4015-8eca-023dd3e6bd23 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82026) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 20:01:43.298146 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfc87779-b93f-4015-8eca-023dd3e6bd23 admin admin] Validating token access rules against request {{(pid=82026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 20:01:43.373503 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-153e1113-2fb2-47a4-8769-30fe7f304b72 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57539b6a6f3b4d589f5f5e1d211cd6a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b454f707d20347ada3d82aa85495635e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 20:01:43.374441 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-153e1113-2fb2-47a4-8769-30fe7f304b72 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:01:43.375147 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-153e1113-2fb2-47a4-8769-30fe7f304b72 admin admin] SCRIPT_NAME: `/identity` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:01:43.375629 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-153e1113-2fb2-47a4-8769-30fe7f304b72 admin admin] PATH_INFO: `/v3/users/77a7a63634904f22ab948abba67d8d94` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:01:43.377410 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-153e1113-2fb2-47a4-8769-30fe7f304b72 admin admin] RBAC: Authorizing `identity:delete_user(user_id=77a7a63634904f22ab948abba67d8d94)` {{(pid=82026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 20:01:43.380818 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-153e1113-2fb2-47a4-8769-30fe7f304b72 admin admin] RBAC: Authorization granted {{(pid=82026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 20:01:43.640089 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.notifications [None req-153e1113-2fb2-47a4-8769-30fe7f304b72 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '77a7a63634904f22ab948abba67d8d94'} {{(pid=82026) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 20:01:43.708125 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.notifications [None req-153e1113-2fb2-47a4-8769-30fe7f304b72 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '77a7a63634904f22ab948abba67d8d94'} {{(pid=82026) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 20:01:43.726859 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.notifications [None req-153e1113-2fb2-47a4-8769-30fe7f304b72 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '77a7a63634904f22ab948abba67d8d94'} {{(pid=82026) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 20:01:43.731747 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.notifications [None req-153e1113-2fb2-47a4-8769-30fe7f304b72 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '77a7a63634904f22ab948abba67d8d94'} {{(pid=82026) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 20:01:43.735904 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.notifications [None req-153e1113-2fb2-47a4-8769-30fe7f304b72 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '77a7a63634904f22ab948abba67d8d94'} {{(pid=82026) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 20:01:43.741854 dv-cinder-828806-6-smb devstack@keystone.service[82026]: [pid: 82026|app: 0|req: 1067/2195] 10.222.0.33 () {58 vars in 1224 bytes} [Tue Sep 13 20:01:43 2022] DELETE /identity/v3/users/77a7a63634904f22ab948abba67d8d94 => generated 0 bytes in 465 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 20:01:43.748580 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea221070-815b-4b2f-8a0e-db6e9944c17f None None] REQUEST_METHOD: `POST` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:01:43.748580 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea221070-815b-4b2f-8a0e-db6e9944c17f None None] SCRIPT_NAME: `/identity` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:01:43.748580 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea221070-815b-4b2f-8a0e-db6e9944c17f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:01:43.751028 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-153e1113-2fb2-47a4-8769-30fe7f304b72 admin admin] Authenticating user token {{(pid=82026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 20:01:43.753223 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.common.fernet_utils [None req-153e1113-2fb2-47a4-8769-30fe7f304b72 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82026) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 20:01:43.770505 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.auth.core [None req-ea221070-815b-4b2f-8a0e-db6e9944c17f None None] MFA Rules not processed for user `57539b6a6f3b4d589f5f5e1d211cd6a0`. Rule list: `[]` (Enabled: `True`). {{(pid=82025) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 20:01:43.770940 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.fernet_utils [None req-ea221070-815b-4b2f-8a0e-db6e9944c17f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82025) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 20:01:43.816636 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG dbcounter [-] [82025] Writing DB stats keystone:SELECT=88,keystone:DELETE=10,keystone:INSERT=2 {{(pid=82025) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 20:01:43.836348 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-153e1113-2fb2-47a4-8769-30fe7f304b72 admin admin] Validating token access rules against request {{(pid=82026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 20:01:43.842210 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b2274ac-1a5d-48b1-bc20-99b487846242 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57539b6a6f3b4d589f5f5e1d211cd6a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b454f707d20347ada3d82aa85495635e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 20:01:43.843605 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b2274ac-1a5d-48b1-bc20-99b487846242 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:01:43.843605 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b2274ac-1a5d-48b1-bc20-99b487846242 admin admin] SCRIPT_NAME: `/identity` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:01:43.843781 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b2274ac-1a5d-48b1-bc20-99b487846242 admin admin] PATH_INFO: `/v3/projects/c48f34baf47e496395a8f155ad1fb58d` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:01:43.845024 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b2274ac-1a5d-48b1-bc20-99b487846242 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c48f34baf47e496395a8f155ad1fb58d)` {{(pid=82026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 20:01:43.847639 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b2274ac-1a5d-48b1-bc20-99b487846242 admin admin] RBAC: Authorization granted {{(pid=82026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 20:01:43.855275 dv-cinder-828806-6-smb devstack@keystone.service[82025]: [pid: 82025|app: 0|req: 1129/2196] 10.222.0.33 () {58 vars in 958 bytes} [Tue Sep 13 20:01:43 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 13 20:01:43.865058 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea221070-815b-4b2f-8a0e-db6e9944c17f None None] Authenticating user token {{(pid=82025) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 20:01:43.866732 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.fernet_utils [None req-ea221070-815b-4b2f-8a0e-db6e9944c17f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82025) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 20:01:43.940703 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea221070-815b-4b2f-8a0e-db6e9944c17f None None] Validating token access rules against request {{(pid=82025) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 20:01:43.944335 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b549e183-e77d-445c-9343-145159ee4690 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '023a2c79c2444611b3d431928e56685d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8c6fba0f15b4d6a84ff601919b7b8e4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82025) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 20:01:43.944945 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b549e183-e77d-445c-9343-145159ee4690 service neutron] REQUEST_METHOD: `GET` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:01:43.945233 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b549e183-e77d-445c-9343-145159ee4690 service neutron] SCRIPT_NAME: `/identity` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:01:43.945518 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b549e183-e77d-445c-9343-145159ee4690 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:01:43.958981 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b549e183-e77d-445c-9343-145159ee4690 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 20:01:43.958981 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b549e183-e77d-445c-9343-145159ee4690 service neutron] RBAC: Authorization granted {{(pid=82025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 20:01:43.968848 dv-cinder-828806-6-smb devstack@keystone.service[82025]: [pid: 82025|app: 0|req: 1130/2197] 10.222.0.33 () {60 vars in 1365 bytes} [Tue Sep 13 20:01:43 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 104 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 13 20:01:44.013403 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.notifications [None req-2b2274ac-1a5d-48b1-bc20-99b487846242 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c48f34baf47e496395a8f155ad1fb58d', 'request_id': 'req-2b2274ac-1a5d-48b1-bc20-99b487846242'} {{(pid=82026) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 20:01:44.131276 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.notifications [None req-2b2274ac-1a5d-48b1-bc20-99b487846242 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c48f34baf47e496395a8f155ad1fb58d', 'request_id': 'req-2b2274ac-1a5d-48b1-bc20-99b487846242'} {{(pid=82026) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 20:01:44.142734 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.notifications [None req-2b2274ac-1a5d-48b1-bc20-99b487846242 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c48f34baf47e496395a8f155ad1fb58d', 'request_id': 'req-2b2274ac-1a5d-48b1-bc20-99b487846242'} {{(pid=82026) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 20:01:44.156254 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.notifications [None req-2b2274ac-1a5d-48b1-bc20-99b487846242 admin admin] The token cache is being invalidate because project c48f34baf47e496395a8f155ad1fb58d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82026) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 13 20:01:44.156558 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.notifications [None req-2b2274ac-1a5d-48b1-bc20-99b487846242 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82026) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 20:01:44.157762 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.notifications [None req-2b2274ac-1a5d-48b1-bc20-99b487846242 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82026) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 20:01:44.159856 dv-cinder-828806-6-smb devstack@keystone.service[82026]: [pid: 82026|app: 0|req: 1068/2198] 10.222.0.33 () {58 vars in 1233 bytes} [Tue Sep 13 20:01:43 2022] DELETE /identity/v3/projects/c48f34baf47e496395a8f155ad1fb58d => generated 0 bytes in 409 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 13 20:01:44.165089 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71110600-d242-461a-9a77-b03af62a28ad None None] REQUEST_METHOD: `POST` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:01:44.165448 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71110600-d242-461a-9a77-b03af62a28ad None None] SCRIPT_NAME: `/identity` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:01:44.169252 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71110600-d242-461a-9a77-b03af62a28ad None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:01:44.187362 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.auth.core [None req-71110600-d242-461a-9a77-b03af62a28ad None None] MFA Rules not processed for user `57539b6a6f3b4d589f5f5e1d211cd6a0`. Rule list: `[]` (Enabled: `True`). {{(pid=82025) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 20:01:44.188745 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.fernet_utils [None req-71110600-d242-461a-9a77-b03af62a28ad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82025) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 20:01:44.261564 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b2274ac-1a5d-48b1-bc20-99b487846242 admin admin] Authenticating user token {{(pid=82026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 20:01:44.266924 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.common.fernet_utils [None req-2b2274ac-1a5d-48b1-bc20-99b487846242 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82026) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 20:01:44.331861 dv-cinder-828806-6-smb devstack@keystone.service[82025]: [pid: 82025|app: 0|req: 1131/2199] 10.222.0.33 () {58 vars in 958 bytes} [Tue Sep 13 20:01:44 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 168 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 20:01:44.340108 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe8d25bf-4bb9-4e0d-aa4c-97382500f34e None None] REQUEST_METHOD: `POST` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:01:44.350924 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe8d25bf-4bb9-4e0d-aa4c-97382500f34e None None] SCRIPT_NAME: `/identity` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:01:44.350924 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe8d25bf-4bb9-4e0d-aa4c-97382500f34e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:01:44.364505 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.auth.core [None req-fe8d25bf-4bb9-4e0d-aa4c-97382500f34e None None] MFA Rules not processed for user `57539b6a6f3b4d589f5f5e1d211cd6a0`. Rule list: `[]` (Enabled: `True`). {{(pid=82025) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 20:01:44.365802 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.fernet_utils [None req-fe8d25bf-4bb9-4e0d-aa4c-97382500f34e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82025) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 20:01:44.376251 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b2274ac-1a5d-48b1-bc20-99b487846242 admin admin] Validating token access rules against request {{(pid=82026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 20:01:44.379460 dv-cinder-828806-6-smb devstack@keystone.service[82025]: [pid: 82025|app: 0|req: 1132/2200] 10.222.0.33 () {58 vars in 958 bytes} [Tue Sep 13 20:01:44 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 20:01:44.388392 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7e4be58-3bbd-4bee-9e25-69e22bde864f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57539b6a6f3b4d589f5f5e1d211cd6a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b454f707d20347ada3d82aa85495635e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 20:01:44.388392 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7e4be58-3bbd-4bee-9e25-69e22bde864f admin admin] REQUEST_METHOD: `DELETE` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:01:44.388392 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7e4be58-3bbd-4bee-9e25-69e22bde864f admin admin] SCRIPT_NAME: `/identity` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:01:44.388392 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7e4be58-3bbd-4bee-9e25-69e22bde864f admin admin] PATH_INFO: `/v3/users/8c2240b30d9f45e8a4b018f009b36855` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:01:44.388763 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7e4be58-3bbd-4bee-9e25-69e22bde864f admin admin] RBAC: Authorizing `identity:delete_user(user_id=8c2240b30d9f45e8a4b018f009b36855)` {{(pid=82026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 20:01:44.388763 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7e4be58-3bbd-4bee-9e25-69e22bde864f admin admin] RBAC: Authorization granted {{(pid=82026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 20:01:44.390054 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe8d25bf-4bb9-4e0d-aa4c-97382500f34e None None] Authenticating user token {{(pid=82025) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 20:01:44.399555 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe8d25bf-4bb9-4e0d-aa4c-97382500f34e None None] Validating token access rules against request {{(pid=82025) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 20:01:44.405043 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92ba370b-f90e-4606-89c4-fb45dd2d1772 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57539b6a6f3b4d589f5f5e1d211cd6a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b454f707d20347ada3d82aa85495635e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82025) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 20:01:44.405691 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92ba370b-f90e-4606-89c4-fb45dd2d1772 admin admin] REQUEST_METHOD: `GET` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:01:44.405977 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92ba370b-f90e-4606-89c4-fb45dd2d1772 admin admin] SCRIPT_NAME: `/identity` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:01:44.406257 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92ba370b-f90e-4606-89c4-fb45dd2d1772 admin admin] PATH_INFO: `/v3/domains` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:01:44.406913 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92ba370b-f90e-4606-89c4-fb45dd2d1772 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82025) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 20:01:44.407263 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92ba370b-f90e-4606-89c4-fb45dd2d1772 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 20:01:44.409006 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92ba370b-f90e-4606-89c4-fb45dd2d1772 admin admin] RBAC: Authorization granted {{(pid=82025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 20:01:44.421643 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG dbcounter [-] [82026] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82026) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 20:01:44.423079 dv-cinder-828806-6-smb devstack@keystone.service[82025]: [pid: 82025|app: 0|req: 1133/2201] 10.222.0.33 () {58 vars in 1153 bytes} [Tue Sep 13 20:01:44 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 13 20:01:44.429668 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92ba370b-f90e-4606-89c4-fb45dd2d1772 admin admin] Authenticating user token {{(pid=82025) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 20:01:44.440489 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92ba370b-f90e-4606-89c4-fb45dd2d1772 admin admin] Validating token access rules against request {{(pid=82025) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 20:01:44.445750 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fd1dfb8-7549-4c32-98c8-f3032282b57c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57539b6a6f3b4d589f5f5e1d211cd6a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b454f707d20347ada3d82aa85495635e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82025) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 20:01:44.446353 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fd1dfb8-7549-4c32-98c8-f3032282b57c admin admin] REQUEST_METHOD: `POST` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:01:44.446643 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fd1dfb8-7549-4c32-98c8-f3032282b57c admin admin] SCRIPT_NAME: `/identity` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:01:44.446922 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fd1dfb8-7549-4c32-98c8-f3032282b57c admin admin] PATH_INFO: `/v3/projects` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:01:44.447602 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fd1dfb8-7549-4c32-98c8-f3032282b57c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 20:01:44.450445 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fd1dfb8-7549-4c32-98c8-f3032282b57c admin admin] RBAC: Authorization granted {{(pid=82025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 20:01:44.520277 dv-cinder-828806-6-smb devstack@keystone.service[82025]: [pid: 82025|app: 0|req: 1134/2202] 10.222.0.33 () {60 vars in 1153 bytes} [Tue Sep 13 20:01:44 2022] POST /identity/v3/projects => generated 375 bytes in 91 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 13 20:01:44.521327 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fd1dfb8-7549-4c32-98c8-f3032282b57c admin admin] Authenticating user token {{(pid=82025) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 20:01:44.522979 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.fernet_utils [None req-7fd1dfb8-7549-4c32-98c8-f3032282b57c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82025) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 20:01:44.585359 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.notifications [None req-b7e4be58-3bbd-4bee-9e25-69e22bde864f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8c2240b30d9f45e8a4b018f009b36855'} {{(pid=82026) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 20:01:44.609209 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fd1dfb8-7549-4c32-98c8-f3032282b57c admin admin] Validating token access rules against request {{(pid=82025) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 20:01:44.614130 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f04a8ed-197b-46c9-943f-65d8d9678413 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57539b6a6f3b4d589f5f5e1d211cd6a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b454f707d20347ada3d82aa85495635e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82025) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 20:01:44.614766 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f04a8ed-197b-46c9-943f-65d8d9678413 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:01:44.615081 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f04a8ed-197b-46c9-943f-65d8d9678413 admin admin] SCRIPT_NAME: `/identity` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:01:44.615367 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f04a8ed-197b-46c9-943f-65d8d9678413 admin admin] PATH_INFO: `/v3/projects/52cd0497e33349f1b50b49791f5a0f63` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:01:44.616546 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f04a8ed-197b-46c9-943f-65d8d9678413 admin admin] RBAC: Authorizing `identity:delete_project(project_id=52cd0497e33349f1b50b49791f5a0f63)` {{(pid=82025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 20:01:44.618449 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f04a8ed-197b-46c9-943f-65d8d9678413 admin admin] RBAC: Authorization granted {{(pid=82025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 20:01:44.656208 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.notifications [None req-b7e4be58-3bbd-4bee-9e25-69e22bde864f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8c2240b30d9f45e8a4b018f009b36855'} {{(pid=82026) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 20:01:44.671322 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.notifications [None req-b7e4be58-3bbd-4bee-9e25-69e22bde864f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8c2240b30d9f45e8a4b018f009b36855'} {{(pid=82026) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 20:01:44.671968 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.notifications [None req-b7e4be58-3bbd-4bee-9e25-69e22bde864f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8c2240b30d9f45e8a4b018f009b36855'} {{(pid=82026) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 20:01:44.679648 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.notifications [None req-b7e4be58-3bbd-4bee-9e25-69e22bde864f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8c2240b30d9f45e8a4b018f009b36855'} {{(pid=82026) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 20:01:44.686617 dv-cinder-828806-6-smb devstack@keystone.service[82026]: [pid: 82026|app: 0|req: 1069/2203] 10.222.0.33 () {58 vars in 1224 bytes} [Tue Sep 13 20:01:44 2022] DELETE /identity/v3/users/8c2240b30d9f45e8a4b018f009b36855 => generated 0 bytes in 426 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 20:01:44.689949 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7e4be58-3bbd-4bee-9e25-69e22bde864f admin admin] Authenticating user token {{(pid=82026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 20:01:44.689949 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.common.fernet_utils [None req-b7e4be58-3bbd-4bee-9e25-69e22bde864f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82026) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 20:01:44.747975 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.notifications [None req-9f04a8ed-197b-46c9-943f-65d8d9678413 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '52cd0497e33349f1b50b49791f5a0f63', 'request_id': 'req-9f04a8ed-197b-46c9-943f-65d8d9678413'} {{(pid=82025) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 20:01:44.753749 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.notifications [None req-9f04a8ed-197b-46c9-943f-65d8d9678413 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '52cd0497e33349f1b50b49791f5a0f63', 'request_id': 'req-9f04a8ed-197b-46c9-943f-65d8d9678413'} {{(pid=82025) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 20:01:44.760186 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7e4be58-3bbd-4bee-9e25-69e22bde864f admin admin] Validating token access rules against request {{(pid=82026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 20:01:44.761300 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.notifications [None req-9f04a8ed-197b-46c9-943f-65d8d9678413 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '52cd0497e33349f1b50b49791f5a0f63', 'request_id': 'req-9f04a8ed-197b-46c9-943f-65d8d9678413'} {{(pid=82025) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 20:01:44.827784 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62b7e1e3-440d-43ff-9e37-41384aa0023d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57539b6a6f3b4d589f5f5e1d211cd6a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b454f707d20347ada3d82aa85495635e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 20:01:44.828496 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62b7e1e3-440d-43ff-9e37-41384aa0023d admin admin] REQUEST_METHOD: `POST` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:01:44.828915 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62b7e1e3-440d-43ff-9e37-41384aa0023d admin admin] SCRIPT_NAME: `/identity` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:01:44.829198 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62b7e1e3-440d-43ff-9e37-41384aa0023d admin admin] PATH_INFO: `/v3/users` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:01:44.829840 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62b7e1e3-440d-43ff-9e37-41384aa0023d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 20:01:44.832441 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62b7e1e3-440d-43ff-9e37-41384aa0023d admin admin] RBAC: Authorization granted {{(pid=82026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 20:01:44.855840 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.notifications [None req-9f04a8ed-197b-46c9-943f-65d8d9678413 admin admin] The token cache is being invalidate because project 52cd0497e33349f1b50b49791f5a0f63 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82025) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 13 20:01:44.855840 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.notifications [None req-9f04a8ed-197b-46c9-943f-65d8d9678413 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82025) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 20:01:44.855840 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.notifications [None req-9f04a8ed-197b-46c9-943f-65d8d9678413 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82025) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 20:01:44.855840 dv-cinder-828806-6-smb devstack@keystone.service[82025]: [pid: 82025|app: 0|req: 1135/2204] 10.222.0.33 () {58 vars in 1233 bytes} [Tue Sep 13 20:01:44 2022] DELETE /identity/v3/projects/52cd0497e33349f1b50b49791f5a0f63 => generated 0 bytes in 333 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 20:01:44.855840 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ebbde59-f3b5-4dea-a35b-a7ad03fc58d4 None None] REQUEST_METHOD: `POST` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:01:44.856301 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ebbde59-f3b5-4dea-a35b-a7ad03fc58d4 None None] SCRIPT_NAME: `/identity` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:01:44.856559 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ebbde59-f3b5-4dea-a35b-a7ad03fc58d4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:01:44.878202 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.auth.core [None req-4ebbde59-f3b5-4dea-a35b-a7ad03fc58d4 None None] MFA Rules not processed for user `57539b6a6f3b4d589f5f5e1d211cd6a0`. Rule list: `[]` (Enabled: `True`). {{(pid=82025) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 20:01:44.879592 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.fernet_utils [None req-4ebbde59-f3b5-4dea-a35b-a7ad03fc58d4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82025) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 20:01:44.888229 dv-cinder-828806-6-smb devstack@keystone.service[82025]: [pid: 82025|app: 0|req: 1136/2205] 10.222.0.33 () {58 vars in 958 bytes} [Tue Sep 13 20:01:44 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 20:01:44.889451 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ebbde59-f3b5-4dea-a35b-a7ad03fc58d4 None None] Authenticating user token {{(pid=82025) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 20:01:44.890904 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.fernet_utils [None req-4ebbde59-f3b5-4dea-a35b-a7ad03fc58d4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82025) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 20:01:44.908153 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ebbde59-f3b5-4dea-a35b-a7ad03fc58d4 None None] Validating token access rules against request {{(pid=82025) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 20:01:44.917669 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4772f1bd-1312-4e98-adb6-c7a7fb25ecc0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57539b6a6f3b4d589f5f5e1d211cd6a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b454f707d20347ada3d82aa85495635e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82025) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 20:01:44.919202 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4772f1bd-1312-4e98-adb6-c7a7fb25ecc0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:01:44.919202 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4772f1bd-1312-4e98-adb6-c7a7fb25ecc0 admin admin] SCRIPT_NAME: `/identity` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:01:44.919202 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4772f1bd-1312-4e98-adb6-c7a7fb25ecc0 admin admin] PATH_INFO: `/v3/users/da98974ef3424af7845ff7fb7b3ffa20` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:01:44.920279 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4772f1bd-1312-4e98-adb6-c7a7fb25ecc0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=da98974ef3424af7845ff7fb7b3ffa20)` {{(pid=82025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 20:01:44.922213 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4772f1bd-1312-4e98-adb6-c7a7fb25ecc0 admin admin] RBAC: Authorization granted {{(pid=82025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 20:01:44.968050 dv-cinder-828806-6-smb devstack@keystone.service[82026]: [pid: 82026|app: 0|req: 1070/2206] 10.222.0.33 () {60 vars in 1144 bytes} [Tue Sep 13 20:01:44 2022] POST /identity/v3/users => generated 288 bytes in 281 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 13 20:01:44.969131 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62b7e1e3-440d-43ff-9e37-41384aa0023d admin admin] Authenticating user token {{(pid=82026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 20:01:44.970936 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.common.fernet_utils [None req-62b7e1e3-440d-43ff-9e37-41384aa0023d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82026) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 20:01:45.048492 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62b7e1e3-440d-43ff-9e37-41384aa0023d admin admin] Validating token access rules against request {{(pid=82026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 20:01:45.053374 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd2323c8-62b4-4c71-9781-ad6a0bc6ef94 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '023a2c79c2444611b3d431928e56685d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8c6fba0f15b4d6a84ff601919b7b8e4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 20:01:45.053374 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd2323c8-62b4-4c71-9781-ad6a0bc6ef94 service neutron] REQUEST_METHOD: `GET` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:01:45.053374 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd2323c8-62b4-4c71-9781-ad6a0bc6ef94 service neutron] SCRIPT_NAME: `/identity` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:01:45.055279 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd2323c8-62b4-4c71-9781-ad6a0bc6ef94 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:01:45.074711 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd2323c8-62b4-4c71-9781-ad6a0bc6ef94 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 20:01:45.077140 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd2323c8-62b4-4c71-9781-ad6a0bc6ef94 service neutron] RBAC: Authorization granted {{(pid=82026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 20:01:45.090318 dv-cinder-828806-6-smb devstack@keystone.service[82026]: [pid: 82026|app: 0|req: 1071/2207] 10.222.0.33 () {60 vars in 1365 bytes} [Tue Sep 13 20:01:44 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 121 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 20:01:45.091166 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd2323c8-62b4-4c71-9781-ad6a0bc6ef94 service neutron] Authenticating user token {{(pid=82026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 20:01:45.092801 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.common.fernet_utils [None req-cd2323c8-62b4-4c71-9781-ad6a0bc6ef94 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82026) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 20:01:45.111450 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd2323c8-62b4-4c71-9781-ad6a0bc6ef94 service neutron] Validating token access rules against request {{(pid=82026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 20:01:45.116486 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae6c09d0-2238-4db3-80d5-db7629e14ca1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57539b6a6f3b4d589f5f5e1d211cd6a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b454f707d20347ada3d82aa85495635e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 20:01:45.117142 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae6c09d0-2238-4db3-80d5-db7629e14ca1 admin admin] REQUEST_METHOD: `GET` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:01:45.117595 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae6c09d0-2238-4db3-80d5-db7629e14ca1 admin admin] SCRIPT_NAME: `/identity` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:01:45.117775 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae6c09d0-2238-4db3-80d5-db7629e14ca1 admin admin] PATH_INFO: `/v3/roles` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:01:45.118726 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae6c09d0-2238-4db3-80d5-db7629e14ca1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 20:01:45.120904 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae6c09d0-2238-4db3-80d5-db7629e14ca1 admin admin] RBAC: Authorization granted {{(pid=82026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 20:01:45.133528 dv-cinder-828806-6-smb devstack@keystone.service[82026]: [pid: 82026|app: 0|req: 1072/2208] 10.222.0.33 () {58 vars in 1122 bytes} [Tue Sep 13 20:01:45 2022] GET /identity/v3/roles => generated 1420 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 13 20:01:45.137674 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.notifications [None req-4772f1bd-1312-4e98-adb6-c7a7fb25ecc0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'da98974ef3424af7845ff7fb7b3ffa20'} {{(pid=82025) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 20:01:45.140129 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae6c09d0-2238-4db3-80d5-db7629e14ca1 admin admin] Authenticating user token {{(pid=82026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 20:01:45.159660 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae6c09d0-2238-4db3-80d5-db7629e14ca1 admin admin] Validating token access rules against request {{(pid=82026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 20:01:45.164552 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f338b5a-bcbd-4a94-b9a0-dd516f7a9178 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57539b6a6f3b4d589f5f5e1d211cd6a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b454f707d20347ada3d82aa85495635e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 20:01:45.165197 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f338b5a-bcbd-4a94-b9a0-dd516f7a9178 admin admin] REQUEST_METHOD: `GET` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:01:45.165489 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f338b5a-bcbd-4a94-b9a0-dd516f7a9178 admin admin] SCRIPT_NAME: `/identity` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:01:45.165771 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f338b5a-bcbd-4a94-b9a0-dd516f7a9178 admin admin] PATH_INFO: `/v3/roles` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:01:45.166432 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f338b5a-bcbd-4a94-b9a0-dd516f7a9178 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 20:01:45.168156 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f338b5a-bcbd-4a94-b9a0-dd516f7a9178 admin admin] RBAC: Authorization granted {{(pid=82026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 20:01:45.183014 dv-cinder-828806-6-smb devstack@keystone.service[82026]: [pid: 82026|app: 0|req: 1073/2209] 10.222.0.33 () {58 vars in 1122 bytes} [Tue Sep 13 20:01:45 2022] GET /identity/v3/roles => generated 1420 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 13 20:01:45.187499 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f338b5a-bcbd-4a94-b9a0-dd516f7a9178 admin admin] Authenticating user token {{(pid=82026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 20:01:45.197931 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f338b5a-bcbd-4a94-b9a0-dd516f7a9178 admin admin] Validating token access rules against request {{(pid=82026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 20:01:45.205162 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48ade660-878d-4bea-a43f-e2ec733456d7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57539b6a6f3b4d589f5f5e1d211cd6a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b454f707d20347ada3d82aa85495635e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 20:01:45.206178 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48ade660-878d-4bea-a43f-e2ec733456d7 admin admin] REQUEST_METHOD: `PUT` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:01:45.206476 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48ade660-878d-4bea-a43f-e2ec733456d7 admin admin] SCRIPT_NAME: `/identity` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:01:45.206795 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48ade660-878d-4bea-a43f-e2ec733456d7 admin admin] PATH_INFO: `/v3/projects/0f365c17eaf1412fac434d619c0eac87/users/de100dd326424ccc8d1c833ce3158e79/roles/3618ab638a65401f82333da7596d1daf` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:01:45.223166 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48ade660-878d-4bea-a43f-e2ec733456d7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0f365c17eaf1412fac434d619c0eac87, user_id=de100dd326424ccc8d1c833ce3158e79, role_id=3618ab638a65401f82333da7596d1daf)` {{(pid=82026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 20:01:45.225870 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48ade660-878d-4bea-a43f-e2ec733456d7 admin admin] RBAC: Authorization granted {{(pid=82026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 20:01:45.227944 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.notifications [None req-4772f1bd-1312-4e98-adb6-c7a7fb25ecc0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'da98974ef3424af7845ff7fb7b3ffa20'} {{(pid=82025) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 20:01:45.228870 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.notifications [None req-4772f1bd-1312-4e98-adb6-c7a7fb25ecc0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'da98974ef3424af7845ff7fb7b3ffa20'} {{(pid=82025) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 20:01:45.241855 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.notifications [None req-4772f1bd-1312-4e98-adb6-c7a7fb25ecc0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'da98974ef3424af7845ff7fb7b3ffa20'} {{(pid=82025) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 20:01:45.250541 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.notifications [None req-4772f1bd-1312-4e98-adb6-c7a7fb25ecc0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'da98974ef3424af7845ff7fb7b3ffa20'} {{(pid=82025) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 20:01:45.257174 dv-cinder-828806-6-smb devstack@keystone.service[82025]: [pid: 82025|app: 0|req: 1137/2210] 10.222.0.33 () {58 vars in 1224 bytes} [Tue Sep 13 20:01:44 2022] DELETE /identity/v3/users/da98974ef3424af7845ff7fb7b3ffa20 => generated 0 bytes in 368 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 20:01:45.308974 dv-cinder-828806-6-smb devstack@keystone.service[82026]: [pid: 82026|app: 0|req: 1074/2211] 10.222.0.33 () {60 vars in 1483 bytes} [Tue Sep 13 20:01:45 2022] PUT /identity/v3/projects/0f365c17eaf1412fac434d619c0eac87/users/de100dd326424ccc8d1c833ce3158e79/roles/3618ab638a65401f82333da7596d1daf => generated 0 bytes in 122 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 13 20:01:45.320275 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34ed16fc-95c8-4c67-a043-8d602c21e9be None None] REQUEST_METHOD: `POST` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:01:45.320713 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34ed16fc-95c8-4c67-a043-8d602c21e9be None None] SCRIPT_NAME: `/identity` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:01:45.321005 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34ed16fc-95c8-4c67-a043-8d602c21e9be None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:01:45.361542 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.auth.core [None req-34ed16fc-95c8-4c67-a043-8d602c21e9be None None] MFA Rules not processed for user `de100dd326424ccc8d1c833ce3158e79`. Rule list: `[]` (Enabled: `True`). {{(pid=82025) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 20:01:45.362711 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.fernet_utils [None req-34ed16fc-95c8-4c67-a043-8d602c21e9be None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82025) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 20:01:45.474885 dv-cinder-828806-6-smb devstack@keystone.service[82025]: [pid: 82025|app: 0|req: 1138/2212] 10.222.0.33 () {58 vars in 958 bytes} [Tue Sep 13 20:01:45 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 156 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 20:01:45.496512 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48ade660-878d-4bea-a43f-e2ec733456d7 admin admin] Authenticating user token {{(pid=82026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 20:01:45.496512 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.common.fernet_utils [None req-48ade660-878d-4bea-a43f-e2ec733456d7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82026) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 20:01:45.513611 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG dbcounter [-] [82025] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82025) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 20:01:45.591821 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48ade660-878d-4bea-a43f-e2ec733456d7 admin admin] Validating token access rules against request {{(pid=82026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 20:01:45.598134 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb4e8a1e-36b4-4b73-9e7a-46fe5dee555b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46024fc6167f4321818b1bed27a521a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8c6fba0f15b4d6a84ff601919b7b8e4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 20:01:45.598730 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb4e8a1e-36b4-4b73-9e7a-46fe5dee555b service cinder] REQUEST_METHOD: `GET` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:01:45.599021 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb4e8a1e-36b4-4b73-9e7a-46fe5dee555b service cinder] SCRIPT_NAME: `/identity` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:01:45.599335 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb4e8a1e-36b4-4b73-9e7a-46fe5dee555b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:01:45.609675 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb4e8a1e-36b4-4b73-9e7a-46fe5dee555b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=82026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 20:01:45.611379 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb4e8a1e-36b4-4b73-9e7a-46fe5dee555b service cinder] RBAC: Authorization granted {{(pid=82026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 20:01:45.619567 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG dbcounter [-] [82026] Writing DB stats keystone:SELECT=90,keystone:INSERT=3,keystone:DELETE=7 {{(pid=82026) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 20:01:45.625698 dv-cinder-828806-6-smb devstack@keystone.service[82026]: [pid: 82026|app: 0|req: 1075/2213] 10.222.0.33 () {60 vars in 1365 bytes} [Tue Sep 13 20:01:45 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 138 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 20:01:45.649797 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34ed16fc-95c8-4c67-a043-8d602c21e9be None None] Authenticating user token {{(pid=82025) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 20:01:45.651587 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.fernet_utils [None req-34ed16fc-95c8-4c67-a043-8d602c21e9be None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82025) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 20:01:45.798109 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34ed16fc-95c8-4c67-a043-8d602c21e9be None None] Validating token access rules against request {{(pid=82025) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 20:01:45.809331 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51144758-795f-4ba6-ae75-f0328428d0dd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57539b6a6f3b4d589f5f5e1d211cd6a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b454f707d20347ada3d82aa85495635e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82025) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 20:01:45.810416 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51144758-795f-4ba6-ae75-f0328428d0dd admin admin] REQUEST_METHOD: `DELETE` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:01:45.812170 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51144758-795f-4ba6-ae75-f0328428d0dd admin admin] SCRIPT_NAME: `/identity` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:01:45.812678 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51144758-795f-4ba6-ae75-f0328428d0dd admin admin] PATH_INFO: `/v3/projects/3fb00974587b44c28c2e51dfc19ed93d` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:01:45.819273 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51144758-795f-4ba6-ae75-f0328428d0dd admin admin] RBAC: Authorizing `identity:delete_project(project_id=3fb00974587b44c28c2e51dfc19ed93d)` {{(pid=82025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 20:01:45.823433 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51144758-795f-4ba6-ae75-f0328428d0dd admin admin] RBAC: Authorization granted {{(pid=82025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 20:01:45.959819 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb4e8a1e-36b4-4b73-9e7a-46fe5dee555b service cinder] Authenticating user token {{(pid=82026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 20:01:45.961382 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.common.fernet_utils [None req-cb4e8a1e-36b4-4b73-9e7a-46fe5dee555b service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82026) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 20:01:45.985493 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb4e8a1e-36b4-4b73-9e7a-46fe5dee555b service cinder] Validating token access rules against request {{(pid=82026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 20:01:46.001550 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.notifications [None req-51144758-795f-4ba6-ae75-f0328428d0dd admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3fb00974587b44c28c2e51dfc19ed93d', 'request_id': 'req-51144758-795f-4ba6-ae75-f0328428d0dd'} {{(pid=82025) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 20:01:46.012038 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.notifications [None req-51144758-795f-4ba6-ae75-f0328428d0dd admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3fb00974587b44c28c2e51dfc19ed93d', 'request_id': 'req-51144758-795f-4ba6-ae75-f0328428d0dd'} {{(pid=82025) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 20:01:46.032988 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.notifications [None req-51144758-795f-4ba6-ae75-f0328428d0dd admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3fb00974587b44c28c2e51dfc19ed93d', 'request_id': 'req-51144758-795f-4ba6-ae75-f0328428d0dd'} {{(pid=82025) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 20:01:46.101467 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-831ff327-9cd3-4377-b5fe-3a05d75eefda admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57539b6a6f3b4d589f5f5e1d211cd6a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b454f707d20347ada3d82aa85495635e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 20:01:46.102270 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-831ff327-9cd3-4377-b5fe-3a05d75eefda admin admin] REQUEST_METHOD: `DELETE` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:01:46.102439 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-831ff327-9cd3-4377-b5fe-3a05d75eefda admin admin] SCRIPT_NAME: `/identity` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:01:46.102730 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-831ff327-9cd3-4377-b5fe-3a05d75eefda admin admin] PATH_INFO: `/v3/projects/64afebad8e74468ba67eaed530864977` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:01:46.103920 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-831ff327-9cd3-4377-b5fe-3a05d75eefda admin admin] RBAC: Authorizing `identity:delete_project(project_id=64afebad8e74468ba67eaed530864977)` {{(pid=82026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 20:01:46.106825 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-831ff327-9cd3-4377-b5fe-3a05d75eefda admin admin] RBAC: Authorization granted {{(pid=82026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 20:01:46.216113 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.notifications [None req-51144758-795f-4ba6-ae75-f0328428d0dd admin admin] The token cache is being invalidate because project 3fb00974587b44c28c2e51dfc19ed93d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82025) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 13 20:01:46.216429 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.notifications [None req-51144758-795f-4ba6-ae75-f0328428d0dd admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82025) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 20:01:46.217043 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.notifications [None req-51144758-795f-4ba6-ae75-f0328428d0dd admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82025) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 20:01:46.218541 dv-cinder-828806-6-smb devstack@keystone.service[82025]: [pid: 82025|app: 0|req: 1139/2214] 10.222.0.33 () {58 vars in 1233 bytes} [Tue Sep 13 20:01:45 2022] DELETE /identity/v3/projects/3fb00974587b44c28c2e51dfc19ed93d => generated 0 bytes in 570 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 20:01:46.223169 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51144758-795f-4ba6-ae75-f0328428d0dd admin admin] Authenticating user token {{(pid=82025) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 20:01:46.224495 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.fernet_utils [None req-51144758-795f-4ba6-ae75-f0328428d0dd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82025) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 20:01:46.237186 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51144758-795f-4ba6-ae75-f0328428d0dd admin admin] Validating token access rules against request {{(pid=82025) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 20:01:46.268129 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.notifications [None req-831ff327-9cd3-4377-b5fe-3a05d75eefda admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '64afebad8e74468ba67eaed530864977', 'request_id': 'req-831ff327-9cd3-4377-b5fe-3a05d75eefda'} {{(pid=82026) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 20:01:46.315194 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55bb0211-197d-43d3-9f3d-8d86d9f7abc5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57539b6a6f3b4d589f5f5e1d211cd6a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b454f707d20347ada3d82aa85495635e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82025) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 20:01:46.315834 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55bb0211-197d-43d3-9f3d-8d86d9f7abc5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:01:46.316115 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55bb0211-197d-43d3-9f3d-8d86d9f7abc5 admin admin] SCRIPT_NAME: `/identity` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:01:46.316391 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55bb0211-197d-43d3-9f3d-8d86d9f7abc5 admin admin] PATH_INFO: `/v3/users/e8816b89df534f679fde4fc03f0539c6` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:01:46.317619 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55bb0211-197d-43d3-9f3d-8d86d9f7abc5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e8816b89df534f679fde4fc03f0539c6)` {{(pid=82025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 20:01:46.319898 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55bb0211-197d-43d3-9f3d-8d86d9f7abc5 admin admin] RBAC: Authorization granted {{(pid=82025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 20:01:46.376241 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.notifications [None req-831ff327-9cd3-4377-b5fe-3a05d75eefda admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '64afebad8e74468ba67eaed530864977', 'request_id': 'req-831ff327-9cd3-4377-b5fe-3a05d75eefda'} {{(pid=82026) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 20:01:46.384471 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.notifications [None req-831ff327-9cd3-4377-b5fe-3a05d75eefda admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '64afebad8e74468ba67eaed530864977', 'request_id': 'req-831ff327-9cd3-4377-b5fe-3a05d75eefda'} {{(pid=82026) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 20:01:46.397696 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.notifications [None req-831ff327-9cd3-4377-b5fe-3a05d75eefda admin admin] The token cache is being invalidate because project 64afebad8e74468ba67eaed530864977 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82026) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 13 20:01:46.397921 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.notifications [None req-831ff327-9cd3-4377-b5fe-3a05d75eefda admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82026) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 20:01:46.399187 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.notifications [None req-831ff327-9cd3-4377-b5fe-3a05d75eefda admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82026) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 20:01:46.400528 dv-cinder-828806-6-smb devstack@keystone.service[82026]: [pid: 82026|app: 0|req: 1076/2215] 10.222.0.33 () {58 vars in 1233 bytes} [Tue Sep 13 20:01:45 2022] DELETE /identity/v3/projects/64afebad8e74468ba67eaed530864977 => generated 0 bytes in 441 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 13 20:01:46.405650 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb4c8a93-a233-4f57-ad79-a6e5f24f3312 None None] REQUEST_METHOD: `POST` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:01:46.405958 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb4c8a93-a233-4f57-ad79-a6e5f24f3312 None None] SCRIPT_NAME: `/identity` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:01:46.406237 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb4c8a93-a233-4f57-ad79-a6e5f24f3312 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:01:46.426665 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.auth.core [None req-bb4c8a93-a233-4f57-ad79-a6e5f24f3312 None None] MFA Rules not processed for user `57539b6a6f3b4d589f5f5e1d211cd6a0`. Rule list: `[]` (Enabled: `True`). {{(pid=82026) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 20:01:46.428366 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.common.fernet_utils [None req-bb4c8a93-a233-4f57-ad79-a6e5f24f3312 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82026) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 20:01:46.443716 dv-cinder-828806-6-smb devstack@keystone.service[82026]: [pid: 82026|app: 0|req: 1077/2216] 10.222.0.33 () {58 vars in 958 bytes} [Tue Sep 13 20:01:46 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 13 20:01:46.451666 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74a5ef79-526c-4855-a25d-98099f4d2e55 None None] REQUEST_METHOD: `POST` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:01:46.452016 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74a5ef79-526c-4855-a25d-98099f4d2e55 None None] SCRIPT_NAME: `/identity` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:01:46.452359 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74a5ef79-526c-4855-a25d-98099f4d2e55 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:01:46.474734 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.auth.core [None req-74a5ef79-526c-4855-a25d-98099f4d2e55 None None] MFA Rules not processed for user `57539b6a6f3b4d589f5f5e1d211cd6a0`. Rule list: `[]` (Enabled: `True`). {{(pid=82026) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 20:01:46.475989 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.common.fernet_utils [None req-74a5ef79-526c-4855-a25d-98099f4d2e55 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82026) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 20:01:46.486788 dv-cinder-828806-6-smb devstack@keystone.service[82026]: [pid: 82026|app: 0|req: 1078/2217] 10.222.0.33 () {58 vars in 958 bytes} [Tue Sep 13 20:01:46 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 13 20:01:46.491429 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74a5ef79-526c-4855-a25d-98099f4d2e55 None None] Authenticating user token {{(pid=82026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 20:01:46.502782 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74a5ef79-526c-4855-a25d-98099f4d2e55 None None] Validating token access rules against request {{(pid=82026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 20:01:46.508933 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6980c613-cb13-4525-8690-bb3650a189f1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57539b6a6f3b4d589f5f5e1d211cd6a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b454f707d20347ada3d82aa85495635e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 20:01:46.509741 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6980c613-cb13-4525-8690-bb3650a189f1 admin admin] REQUEST_METHOD: `GET` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:01:46.510023 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6980c613-cb13-4525-8690-bb3650a189f1 admin admin] SCRIPT_NAME: `/identity` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:01:46.510858 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6980c613-cb13-4525-8690-bb3650a189f1 admin admin] PATH_INFO: `/v3/domains` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:01:46.512350 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6980c613-cb13-4525-8690-bb3650a189f1 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82026) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 20:01:46.512539 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6980c613-cb13-4525-8690-bb3650a189f1 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 20:01:46.516401 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6980c613-cb13-4525-8690-bb3650a189f1 admin admin] RBAC: Authorization granted {{(pid=82026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 20:01:46.529615 dv-cinder-828806-6-smb devstack@keystone.service[82026]: [pid: 82026|app: 0|req: 1079/2218] 10.222.0.33 () {58 vars in 1153 bytes} [Tue Sep 13 20:01:46 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 20:01:46.534837 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6980c613-cb13-4525-8690-bb3650a189f1 admin admin] Authenticating user token {{(pid=82026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 20:01:46.553033 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6980c613-cb13-4525-8690-bb3650a189f1 admin admin] Validating token access rules against request {{(pid=82026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 20:01:46.560108 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dc6cead-0d5b-48ba-a063-a5eaabaa3846 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57539b6a6f3b4d589f5f5e1d211cd6a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b454f707d20347ada3d82aa85495635e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 20:01:46.560727 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dc6cead-0d5b-48ba-a063-a5eaabaa3846 admin admin] REQUEST_METHOD: `POST` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:01:46.561013 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dc6cead-0d5b-48ba-a063-a5eaabaa3846 admin admin] SCRIPT_NAME: `/identity` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:01:46.561287 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dc6cead-0d5b-48ba-a063-a5eaabaa3846 admin admin] PATH_INFO: `/v3/projects` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:01:46.561933 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dc6cead-0d5b-48ba-a063-a5eaabaa3846 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 20:01:46.564978 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dc6cead-0d5b-48ba-a063-a5eaabaa3846 admin admin] RBAC: Authorization granted {{(pid=82026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 20:01:46.580348 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.notifications [None req-55bb0211-197d-43d3-9f3d-8d86d9f7abc5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e8816b89df534f679fde4fc03f0539c6'} {{(pid=82025) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 20:01:46.747999 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.notifications [None req-55bb0211-197d-43d3-9f3d-8d86d9f7abc5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e8816b89df534f679fde4fc03f0539c6'} {{(pid=82025) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 20:01:46.748894 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.notifications [None req-55bb0211-197d-43d3-9f3d-8d86d9f7abc5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e8816b89df534f679fde4fc03f0539c6'} {{(pid=82025) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 20:01:46.756600 dv-cinder-828806-6-smb devstack@keystone.service[82026]: [pid: 82026|app: 0|req: 1080/2219] 10.222.0.33 () {60 vars in 1153 bytes} [Tue Sep 13 20:01:46 2022] POST /identity/v3/projects => generated 383 bytes in 223 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 13 20:01:46.760515 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dc6cead-0d5b-48ba-a063-a5eaabaa3846 admin admin] Authenticating user token {{(pid=82026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 20:01:46.763635 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.common.fernet_utils [None req-9dc6cead-0d5b-48ba-a063-a5eaabaa3846 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82026) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 20:01:46.768171 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.notifications [None req-55bb0211-197d-43d3-9f3d-8d86d9f7abc5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e8816b89df534f679fde4fc03f0539c6'} {{(pid=82025) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 20:01:46.778362 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.notifications [None req-55bb0211-197d-43d3-9f3d-8d86d9f7abc5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e8816b89df534f679fde4fc03f0539c6'} {{(pid=82025) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 20:01:46.785294 dv-cinder-828806-6-smb devstack@keystone.service[82025]: [pid: 82025|app: 0|req: 1140/2220] 10.222.0.33 () {58 vars in 1224 bytes} [Tue Sep 13 20:01:46 2022] DELETE /identity/v3/users/e8816b89df534f679fde4fc03f0539c6 => generated 0 bytes in 562 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 13 20:01:46.824353 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG dbcounter [-] [82025] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=82025) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 20:01:46.885415 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dc6cead-0d5b-48ba-a063-a5eaabaa3846 admin admin] Validating token access rules against request {{(pid=82026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 20:01:46.960219 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG dbcounter [-] [82026] Writing DB stats keystone:SELECT=88,keystone:DELETE=10,keystone:INSERT=2 {{(pid=82026) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 20:01:46.971088 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21418079-ac2f-474d-8a3e-db4a8765ef8d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57539b6a6f3b4d589f5f5e1d211cd6a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b454f707d20347ada3d82aa85495635e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 20:01:46.971715 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21418079-ac2f-474d-8a3e-db4a8765ef8d admin admin] REQUEST_METHOD: `POST` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:01:46.972006 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21418079-ac2f-474d-8a3e-db4a8765ef8d admin admin] SCRIPT_NAME: `/identity` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:01:46.972288 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21418079-ac2f-474d-8a3e-db4a8765ef8d admin admin] PATH_INFO: `/v3/users` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:01:46.972942 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21418079-ac2f-474d-8a3e-db4a8765ef8d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 20:01:46.975069 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21418079-ac2f-474d-8a3e-db4a8765ef8d admin admin] RBAC: Authorization granted {{(pid=82026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 20:01:47.121611 dv-cinder-828806-6-smb devstack@keystone.service[82026]: [pid: 82026|app: 0|req: 1081/2221] 10.222.0.33 () {60 vars in 1144 bytes} [Tue Sep 13 20:01:46 2022] POST /identity/v3/users => generated 292 bytes in 362 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 13 20:01:47.126619 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55bb0211-197d-43d3-9f3d-8d86d9f7abc5 admin admin] Authenticating user token {{(pid=82025) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 20:01:47.137248 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55bb0211-197d-43d3-9f3d-8d86d9f7abc5 admin admin] Validating token access rules against request {{(pid=82025) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 20:01:47.143376 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c97ca199-d66b-4da5-944b-313b30355c70 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57539b6a6f3b4d589f5f5e1d211cd6a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b454f707d20347ada3d82aa85495635e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82025) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 20:01:47.144062 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c97ca199-d66b-4da5-944b-313b30355c70 admin admin] REQUEST_METHOD: `GET` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:01:47.144349 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c97ca199-d66b-4da5-944b-313b30355c70 admin admin] SCRIPT_NAME: `/identity` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:01:47.144636 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c97ca199-d66b-4da5-944b-313b30355c70 admin admin] PATH_INFO: `/v3/roles` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:01:47.145305 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c97ca199-d66b-4da5-944b-313b30355c70 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 20:01:47.147139 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c97ca199-d66b-4da5-944b-313b30355c70 admin admin] RBAC: Authorization granted {{(pid=82025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 20:01:47.166378 dv-cinder-828806-6-smb devstack@keystone.service[82025]: [pid: 82025|app: 0|req: 1141/2222] 10.222.0.33 () {58 vars in 1122 bytes} [Tue Sep 13 20:01:47 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 13 20:01:47.167792 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21418079-ac2f-474d-8a3e-db4a8765ef8d admin admin] Authenticating user token {{(pid=82026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 20:01:47.179909 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21418079-ac2f-474d-8a3e-db4a8765ef8d admin admin] Validating token access rules against request {{(pid=82026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 20:01:47.187273 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8cfd733-f319-4658-8243-dfc5fcbcd31e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57539b6a6f3b4d589f5f5e1d211cd6a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b454f707d20347ada3d82aa85495635e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 20:01:47.187907 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8cfd733-f319-4658-8243-dfc5fcbcd31e admin admin] REQUEST_METHOD: `GET` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:01:47.188194 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8cfd733-f319-4658-8243-dfc5fcbcd31e admin admin] SCRIPT_NAME: `/identity` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:01:47.188476 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8cfd733-f319-4658-8243-dfc5fcbcd31e admin admin] PATH_INFO: `/v3/roles` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:01:47.189147 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8cfd733-f319-4658-8243-dfc5fcbcd31e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 20:01:47.190869 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8cfd733-f319-4658-8243-dfc5fcbcd31e admin admin] RBAC: Authorization granted {{(pid=82026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 20:01:47.209839 dv-cinder-828806-6-smb devstack@keystone.service[82026]: [pid: 82026|app: 0|req: 1082/2223] 10.222.0.33 () {58 vars in 1122 bytes} [Tue Sep 13 20:01:47 2022] GET /identity/v3/roles => generated 1420 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 13 20:01:47.213656 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c97ca199-d66b-4da5-944b-313b30355c70 admin admin] Authenticating user token {{(pid=82025) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 20:01:47.224866 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c97ca199-d66b-4da5-944b-313b30355c70 admin admin] Validating token access rules against request {{(pid=82025) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 20:01:47.233086 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00f3bd6b-7bbf-479c-a900-6b3af908df64 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57539b6a6f3b4d589f5f5e1d211cd6a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b454f707d20347ada3d82aa85495635e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82025) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 20:01:47.233780 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00f3bd6b-7bbf-479c-a900-6b3af908df64 admin admin] REQUEST_METHOD: `PUT` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:01:47.234070 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00f3bd6b-7bbf-479c-a900-6b3af908df64 admin admin] SCRIPT_NAME: `/identity` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:01:47.236909 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00f3bd6b-7bbf-479c-a900-6b3af908df64 admin admin] PATH_INFO: `/v3/projects/96b9a4fdecbd40fcbe3ccfd13db6dd1b/users/aa4710c924d2408da2c26b13306814fe/roles/3618ab638a65401f82333da7596d1daf` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:01:47.252354 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00f3bd6b-7bbf-479c-a900-6b3af908df64 admin admin] RBAC: Authorizing `identity:create_grant(project_id=96b9a4fdecbd40fcbe3ccfd13db6dd1b, user_id=aa4710c924d2408da2c26b13306814fe, role_id=3618ab638a65401f82333da7596d1daf)` {{(pid=82025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 20:01:47.255332 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00f3bd6b-7bbf-479c-a900-6b3af908df64 admin admin] RBAC: Authorization granted {{(pid=82025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 20:01:47.320281 dv-cinder-828806-6-smb devstack@keystone.service[82025]: [pid: 82025|app: 0|req: 1142/2224] 10.222.0.33 () {60 vars in 1483 bytes} [Tue Sep 13 20:01:47 2022] PUT /identity/v3/projects/96b9a4fdecbd40fcbe3ccfd13db6dd1b/users/aa4710c924d2408da2c26b13306814fe/roles/3618ab638a65401f82333da7596d1daf => generated 0 bytes in 107 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 20:01:47.330449 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3592f1d2-481c-460e-8b17-fefa93a7a292 None None] REQUEST_METHOD: `POST` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:01:47.331009 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3592f1d2-481c-460e-8b17-fefa93a7a292 None None] SCRIPT_NAME: `/identity` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:01:47.331322 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3592f1d2-481c-460e-8b17-fefa93a7a292 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:01:47.361316 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.auth.core [None req-3592f1d2-481c-460e-8b17-fefa93a7a292 None None] MFA Rules not processed for user `aa4710c924d2408da2c26b13306814fe`. Rule list: `[]` (Enabled: `True`). {{(pid=82026) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 20:01:47.362593 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.common.fernet_utils [None req-3592f1d2-481c-460e-8b17-fefa93a7a292 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82026) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 20:01:47.379505 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00f3bd6b-7bbf-479c-a900-6b3af908df64 admin admin] Authenticating user token {{(pid=82025) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 20:01:47.382711 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.fernet_utils [None req-00f3bd6b-7bbf-479c-a900-6b3af908df64 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82025) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 20:01:47.460318 dv-cinder-828806-6-smb devstack@keystone.service[82026]: [pid: 82026|app: 0|req: 1083/2225] 10.222.0.33 () {58 vars in 958 bytes} [Tue Sep 13 20:01:47 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 20:01:47.465788 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3592f1d2-481c-460e-8b17-fefa93a7a292 None None] Authenticating user token {{(pid=82026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 20:01:47.507591 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00f3bd6b-7bbf-479c-a900-6b3af908df64 admin admin] Validating token access rules against request {{(pid=82025) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 20:01:47.512824 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ba5da2e-fe48-4611-b02e-1e2c41ce9b25 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57539b6a6f3b4d589f5f5e1d211cd6a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b454f707d20347ada3d82aa85495635e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82025) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 20:01:47.514487 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ba5da2e-fe48-4611-b02e-1e2c41ce9b25 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:01:47.514487 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ba5da2e-fe48-4611-b02e-1e2c41ce9b25 admin admin] SCRIPT_NAME: `/identity` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:01:47.514487 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ba5da2e-fe48-4611-b02e-1e2c41ce9b25 admin admin] PATH_INFO: `/v3/projects/d633825f92d645078ce7092c8ef10bb9` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:01:47.515245 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ba5da2e-fe48-4611-b02e-1e2c41ce9b25 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d633825f92d645078ce7092c8ef10bb9)` {{(pid=82025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 20:01:47.517543 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ba5da2e-fe48-4611-b02e-1e2c41ce9b25 admin admin] RBAC: Authorization granted {{(pid=82025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 20:01:47.552977 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3592f1d2-481c-460e-8b17-fefa93a7a292 None None] Validating token access rules against request {{(pid=82026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 20:01:47.559088 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-164071b8-32db-45ee-8815-aaa9906ee02e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57539b6a6f3b4d589f5f5e1d211cd6a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b454f707d20347ada3d82aa85495635e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 20:01:47.559733 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-164071b8-32db-45ee-8815-aaa9906ee02e admin admin] REQUEST_METHOD: `POST` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:01:47.560015 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-164071b8-32db-45ee-8815-aaa9906ee02e admin admin] SCRIPT_NAME: `/identity` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:01:47.560292 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-164071b8-32db-45ee-8815-aaa9906ee02e admin admin] PATH_INFO: `/v3/projects` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:01:47.561078 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-164071b8-32db-45ee-8815-aaa9906ee02e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 20:01:47.563312 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-164071b8-32db-45ee-8815-aaa9906ee02e admin admin] RBAC: Authorization granted {{(pid=82026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 20:01:47.749144 dv-cinder-828806-6-smb devstack@keystone.service[82026]: [pid: 82026|app: 0|req: 1084/2226] 10.222.0.33 () {60 vars in 1153 bytes} [Tue Sep 13 20:01:47 2022] POST /identity/v3/projects => generated 383 bytes in 284 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 13 20:01:47.753277 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-164071b8-32db-45ee-8815-aaa9906ee02e admin admin] Authenticating user token {{(pid=82026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 20:01:47.773273 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.notifications [None req-9ba5da2e-fe48-4611-b02e-1e2c41ce9b25 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd633825f92d645078ce7092c8ef10bb9', 'request_id': 'req-9ba5da2e-fe48-4611-b02e-1e2c41ce9b25'} {{(pid=82025) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 20:01:47.783846 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.notifications [None req-9ba5da2e-fe48-4611-b02e-1e2c41ce9b25 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd633825f92d645078ce7092c8ef10bb9', 'request_id': 'req-9ba5da2e-fe48-4611-b02e-1e2c41ce9b25'} {{(pid=82025) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 20:01:47.793474 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.notifications [None req-9ba5da2e-fe48-4611-b02e-1e2c41ce9b25 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd633825f92d645078ce7092c8ef10bb9', 'request_id': 'req-9ba5da2e-fe48-4611-b02e-1e2c41ce9b25'} {{(pid=82025) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 20:01:47.854159 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-164071b8-32db-45ee-8815-aaa9906ee02e admin admin] Validating token access rules against request {{(pid=82026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 20:01:47.880622 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.notifications [None req-9ba5da2e-fe48-4611-b02e-1e2c41ce9b25 admin admin] The token cache is being invalidate because project d633825f92d645078ce7092c8ef10bb9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82025) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 13 20:01:47.880622 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.notifications [None req-9ba5da2e-fe48-4611-b02e-1e2c41ce9b25 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82025) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 20:01:47.881186 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.notifications [None req-9ba5da2e-fe48-4611-b02e-1e2c41ce9b25 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82025) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 20:01:47.883446 dv-cinder-828806-6-smb devstack@keystone.service[82025]: [pid: 82025|app: 0|req: 1143/2227] 10.222.0.33 () {58 vars in 1233 bytes} [Tue Sep 13 20:01:47 2022] DELETE /identity/v3/projects/d633825f92d645078ce7092c8ef10bb9 => generated 0 bytes in 505 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 20:01:47.888258 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ba5da2e-fe48-4611-b02e-1e2c41ce9b25 admin admin] Authenticating user token {{(pid=82025) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 20:01:47.892055 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.fernet_utils [None req-9ba5da2e-fe48-4611-b02e-1e2c41ce9b25 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82025) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 20:01:47.962076 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f5405a3-e9bf-4c5b-baa7-f67b5dbc97d3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57539b6a6f3b4d589f5f5e1d211cd6a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b454f707d20347ada3d82aa85495635e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 20:01:47.962631 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f5405a3-e9bf-4c5b-baa7-f67b5dbc97d3 admin admin] REQUEST_METHOD: `POST` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:01:47.962962 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f5405a3-e9bf-4c5b-baa7-f67b5dbc97d3 admin admin] SCRIPT_NAME: `/identity` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:01:47.963299 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f5405a3-e9bf-4c5b-baa7-f67b5dbc97d3 admin admin] PATH_INFO: `/v3/users` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:01:47.964768 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f5405a3-e9bf-4c5b-baa7-f67b5dbc97d3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 20:01:47.967194 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f5405a3-e9bf-4c5b-baa7-f67b5dbc97d3 admin admin] RBAC: Authorization granted {{(pid=82026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 20:01:47.988480 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ba5da2e-fe48-4611-b02e-1e2c41ce9b25 admin admin] Validating token access rules against request {{(pid=82025) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 20:01:47.994165 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87cd034b-f355-4c61-8213-0780c2619916 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57539b6a6f3b4d589f5f5e1d211cd6a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b454f707d20347ada3d82aa85495635e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82025) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 20:01:47.994831 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87cd034b-f355-4c61-8213-0780c2619916 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:01:47.995676 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87cd034b-f355-4c61-8213-0780c2619916 admin admin] SCRIPT_NAME: `/identity` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:01:47.996007 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87cd034b-f355-4c61-8213-0780c2619916 admin admin] PATH_INFO: `/v3/users/fb20cea4f6c54227987773aa173b6b03` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:01:47.997397 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87cd034b-f355-4c61-8213-0780c2619916 admin admin] RBAC: Authorizing `identity:delete_user(user_id=fb20cea4f6c54227987773aa173b6b03)` {{(pid=82025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 20:01:47.999570 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87cd034b-f355-4c61-8213-0780c2619916 admin admin] RBAC: Authorization granted {{(pid=82025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 20:01:48.141926 dv-cinder-828806-6-smb devstack@keystone.service[82026]: [pid: 82026|app: 0|req: 1085/2228] 10.222.0.33 () {60 vars in 1144 bytes} [Tue Sep 13 20:01:47 2022] POST /identity/v3/users => generated 298 bytes in 388 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 13 20:01:48.145456 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f5405a3-e9bf-4c5b-baa7-f67b5dbc97d3 admin admin] Authenticating user token {{(pid=82026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 20:01:48.147514 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.common.fernet_utils [None req-2f5405a3-e9bf-4c5b-baa7-f67b5dbc97d3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82026) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 20:01:48.162664 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f5405a3-e9bf-4c5b-baa7-f67b5dbc97d3 admin admin] Validating token access rules against request {{(pid=82026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 20:01:48.173773 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3215069f-b6c4-4748-a4e2-da95e8952c6b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57539b6a6f3b4d589f5f5e1d211cd6a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b454f707d20347ada3d82aa85495635e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 20:01:48.174410 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3215069f-b6c4-4748-a4e2-da95e8952c6b admin admin] REQUEST_METHOD: `GET` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:01:48.175218 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3215069f-b6c4-4748-a4e2-da95e8952c6b admin admin] SCRIPT_NAME: `/identity` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:01:48.175218 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3215069f-b6c4-4748-a4e2-da95e8952c6b admin admin] PATH_INFO: `/v3/roles` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:01:48.175786 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3215069f-b6c4-4748-a4e2-da95e8952c6b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 20:01:48.177451 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3215069f-b6c4-4748-a4e2-da95e8952c6b admin admin] RBAC: Authorization granted {{(pid=82026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 20:01:48.190263 dv-cinder-828806-6-smb devstack@keystone.service[82026]: [pid: 82026|app: 0|req: 1086/2229] 10.222.0.33 () {58 vars in 1122 bytes} [Tue Sep 13 20:01:48 2022] GET /identity/v3/roles => generated 1420 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 13 20:01:48.197640 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3215069f-b6c4-4748-a4e2-da95e8952c6b admin admin] Authenticating user token {{(pid=82026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 20:01:48.215714 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3215069f-b6c4-4748-a4e2-da95e8952c6b admin admin] Validating token access rules against request {{(pid=82026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 20:01:48.217153 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd86dca7-9d5b-4a55-a112-dd4c8ad1d4bc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57539b6a6f3b4d589f5f5e1d211cd6a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b454f707d20347ada3d82aa85495635e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 20:01:48.217507 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd86dca7-9d5b-4a55-a112-dd4c8ad1d4bc admin admin] REQUEST_METHOD: `PUT` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:01:48.217897 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd86dca7-9d5b-4a55-a112-dd4c8ad1d4bc admin admin] SCRIPT_NAME: `/identity` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:01:48.218284 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd86dca7-9d5b-4a55-a112-dd4c8ad1d4bc admin admin] PATH_INFO: `/v3/projects/fb86dbe53e9a4756be27139ef041265b/users/693a9bf3857b45e8a15fe1026cf3f13a/roles/e5af7d5baa93469e9e486ef21c85474e` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:01:48.253347 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd86dca7-9d5b-4a55-a112-dd4c8ad1d4bc admin admin] RBAC: Authorizing `identity:create_grant(project_id=fb86dbe53e9a4756be27139ef041265b, user_id=693a9bf3857b45e8a15fe1026cf3f13a, role_id=e5af7d5baa93469e9e486ef21c85474e)` {{(pid=82026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 20:01:48.256492 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd86dca7-9d5b-4a55-a112-dd4c8ad1d4bc admin admin] RBAC: Authorization granted {{(pid=82026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 20:01:48.257006 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.notifications [None req-87cd034b-f355-4c61-8213-0780c2619916 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'fb20cea4f6c54227987773aa173b6b03'} {{(pid=82025) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 20:01:48.330420 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.notifications [None req-87cd034b-f355-4c61-8213-0780c2619916 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'fb20cea4f6c54227987773aa173b6b03'} {{(pid=82025) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 20:01:48.331700 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.notifications [None req-87cd034b-f355-4c61-8213-0780c2619916 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'fb20cea4f6c54227987773aa173b6b03'} {{(pid=82025) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 20:01:48.340413 dv-cinder-828806-6-smb devstack@keystone.service[82026]: [pid: 82026|app: 0|req: 1087/2230] 10.222.0.33 () {60 vars in 1483 bytes} [Tue Sep 13 20:01:48 2022] PUT /identity/v3/projects/fb86dbe53e9a4756be27139ef041265b/users/693a9bf3857b45e8a15fe1026cf3f13a/roles/e5af7d5baa93469e9e486ef21c85474e => generated 0 bytes in 144 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 20:01:48.344310 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd86dca7-9d5b-4a55-a112-dd4c8ad1d4bc admin admin] Authenticating user token {{(pid=82026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 20:01:48.346213 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.common.fernet_utils [None req-fd86dca7-9d5b-4a55-a112-dd4c8ad1d4bc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82026) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 20:01:48.350362 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.notifications [None req-87cd034b-f355-4c61-8213-0780c2619916 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'fb20cea4f6c54227987773aa173b6b03'} {{(pid=82025) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 20:01:48.360398 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.notifications [None req-87cd034b-f355-4c61-8213-0780c2619916 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'fb20cea4f6c54227987773aa173b6b03'} {{(pid=82025) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 20:01:48.370914 dv-cinder-828806-6-smb devstack@keystone.service[82025]: [pid: 82025|app: 0|req: 1144/2231] 10.222.0.33 () {58 vars in 1224 bytes} [Tue Sep 13 20:01:47 2022] DELETE /identity/v3/users/fb20cea4f6c54227987773aa173b6b03 => generated 0 bytes in 480 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 13 20:01:48.444224 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd86dca7-9d5b-4a55-a112-dd4c8ad1d4bc admin admin] Validating token access rules against request {{(pid=82026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 20:01:48.506498 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dd357b2-4d86-459b-9326-52fa73916983 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57539b6a6f3b4d589f5f5e1d211cd6a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b454f707d20347ada3d82aa85495635e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 20:01:48.507261 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dd357b2-4d86-459b-9326-52fa73916983 admin admin] REQUEST_METHOD: `GET` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:01:48.507648 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dd357b2-4d86-459b-9326-52fa73916983 admin admin] SCRIPT_NAME: `/identity` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:01:48.508078 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dd357b2-4d86-459b-9326-52fa73916983 admin admin] PATH_INFO: `/v3/roles` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:01:48.508811 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dd357b2-4d86-459b-9326-52fa73916983 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 20:01:48.510506 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dd357b2-4d86-459b-9326-52fa73916983 admin admin] RBAC: Authorization granted {{(pid=82026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 20:01:48.521280 dv-cinder-828806-6-smb devstack@keystone.service[82026]: [pid: 82026|app: 0|req: 1088/2232] 10.222.0.33 () {58 vars in 1122 bytes} [Tue Sep 13 20:01:48 2022] GET /identity/v3/roles => generated 1420 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 13 20:01:48.525672 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87cd034b-f355-4c61-8213-0780c2619916 admin admin] Authenticating user token {{(pid=82025) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 20:01:48.536806 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87cd034b-f355-4c61-8213-0780c2619916 admin admin] Validating token access rules against request {{(pid=82025) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 20:01:48.544000 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33c3a966-1b58-4bf8-b252-a6f921af4fd0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57539b6a6f3b4d589f5f5e1d211cd6a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b454f707d20347ada3d82aa85495635e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82025) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 20:01:48.545191 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33c3a966-1b58-4bf8-b252-a6f921af4fd0 admin admin] REQUEST_METHOD: `PUT` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:01:48.545677 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33c3a966-1b58-4bf8-b252-a6f921af4fd0 admin admin] SCRIPT_NAME: `/identity` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:01:48.546040 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33c3a966-1b58-4bf8-b252-a6f921af4fd0 admin admin] PATH_INFO: `/v3/projects/fb86dbe53e9a4756be27139ef041265b/users/693a9bf3857b45e8a15fe1026cf3f13a/roles/e5af7d5baa93469e9e486ef21c85474e` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:01:48.548632 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33c3a966-1b58-4bf8-b252-a6f921af4fd0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=fb86dbe53e9a4756be27139ef041265b, user_id=693a9bf3857b45e8a15fe1026cf3f13a, role_id=e5af7d5baa93469e9e486ef21c85474e)` {{(pid=82025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 20:01:48.551590 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33c3a966-1b58-4bf8-b252-a6f921af4fd0 admin admin] RBAC: Authorization granted {{(pid=82025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 20:01:48.569400 dv-cinder-828806-6-smb devstack@keystone.service[82025]: [pid: 82025|app: 0|req: 1145/2233] 10.222.0.33 () {60 vars in 1483 bytes} [Tue Sep 13 20:01:48 2022] PUT /identity/v3/projects/fb86dbe53e9a4756be27139ef041265b/users/693a9bf3857b45e8a15fe1026cf3f13a/roles/e5af7d5baa93469e9e486ef21c85474e => generated 0 bytes in 44 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 20:01:48.584047 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb57a634-eca1-40bd-aadc-643973876495 None None] REQUEST_METHOD: `POST` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:01:48.584341 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb57a634-eca1-40bd-aadc-643973876495 None None] SCRIPT_NAME: `/identity` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:01:48.584619 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb57a634-eca1-40bd-aadc-643973876495 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:01:48.616966 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.auth.core [None req-fb57a634-eca1-40bd-aadc-643973876495 None None] MFA Rules not processed for user `693a9bf3857b45e8a15fe1026cf3f13a`. Rule list: `[]` (Enabled: `True`). {{(pid=82026) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 20:01:48.618210 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.common.fernet_utils [None req-fb57a634-eca1-40bd-aadc-643973876495 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82026) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 20:01:48.695326 dv-cinder-828806-6-smb devstack@keystone.service[82026]: [pid: 82026|app: 0|req: 1089/2234] 10.222.0.33 () {58 vars in 958 bytes} [Tue Sep 13 20:01:48 2022] POST /identity/v3/auth/tokens => generated 3327 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 20:01:48.748673 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33c3a966-1b58-4bf8-b252-a6f921af4fd0 admin admin] Authenticating user token {{(pid=82025) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 20:01:48.752675 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.fernet_utils [None req-33c3a966-1b58-4bf8-b252-a6f921af4fd0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82025) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 20:01:48.780030 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG dbcounter [-] [82025] Writing DB stats keystone:SELECT=83,keystone:DELETE=15,keystone:INSERT=2 {{(pid=82025) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 20:01:48.856241 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33c3a966-1b58-4bf8-b252-a6f921af4fd0 admin admin] Validating token access rules against request {{(pid=82025) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 20:01:48.860058 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-accbd825-fba3-495f-b77f-dca7fed94924 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46024fc6167f4321818b1bed27a521a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8c6fba0f15b4d6a84ff601919b7b8e4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82025) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 20:01:48.860665 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-accbd825-fba3-495f-b77f-dca7fed94924 service cinder] REQUEST_METHOD: `GET` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:01:48.860940 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-accbd825-fba3-495f-b77f-dca7fed94924 service cinder] SCRIPT_NAME: `/identity` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:01:48.861215 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-accbd825-fba3-495f-b77f-dca7fed94924 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:01:48.872992 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-accbd825-fba3-495f-b77f-dca7fed94924 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=82025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 20:01:48.874361 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-accbd825-fba3-495f-b77f-dca7fed94924 service cinder] RBAC: Authorization granted {{(pid=82025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 20:01:48.884357 dv-cinder-828806-6-smb devstack@keystone.service[82025]: [pid: 82025|app: 0|req: 1146/2235] 10.222.0.33 () {60 vars in 1365 bytes} [Tue Sep 13 20:01:48 2022] GET /identity/v3/auth/tokens => generated 3327 bytes in 136 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 20:01:48.971629 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG dbcounter [-] [82026] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=82026) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 20:01:48.985803 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb57a634-eca1-40bd-aadc-643973876495 None None] Authenticating user token {{(pid=82026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 20:01:48.987705 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.common.fernet_utils [None req-fb57a634-eca1-40bd-aadc-643973876495 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82026) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 20:01:49.084170 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-accbd825-fba3-495f-b77f-dca7fed94924 service cinder] Authenticating user token {{(pid=82025) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 20:01:49.103179 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb57a634-eca1-40bd-aadc-643973876495 None None] Validating token access rules against request {{(pid=82026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 20:01:49.104532 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-accbd825-fba3-495f-b77f-dca7fed94924 service cinder] Validating token access rules against request {{(pid=82025) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 20:01:49.109606 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3f5ada5-3555-4fb7-b47a-6d52e2d84e21 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46024fc6167f4321818b1bed27a521a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8c6fba0f15b4d6a84ff601919b7b8e4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82025) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 20:01:49.110936 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3f5ada5-3555-4fb7-b47a-6d52e2d84e21 service cinder] REQUEST_METHOD: `GET` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:01:49.111371 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3f5ada5-3555-4fb7-b47a-6d52e2d84e21 service cinder] SCRIPT_NAME: `/identity` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:01:49.111490 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-555155c2-dae1-490d-aef4-0824a1b266ca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57539b6a6f3b4d589f5f5e1d211cd6a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b454f707d20347ada3d82aa85495635e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 20:01:49.112051 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3f5ada5-3555-4fb7-b47a-6d52e2d84e21 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:01:49.112171 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-555155c2-dae1-490d-aef4-0824a1b266ca admin admin] REQUEST_METHOD: `DELETE` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:01:49.112357 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-555155c2-dae1-490d-aef4-0824a1b266ca admin admin] SCRIPT_NAME: `/identity` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:01:49.112636 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-555155c2-dae1-490d-aef4-0824a1b266ca admin admin] PATH_INFO: `/v3/projects/f080a0989f2d4eb4a236975c6391c3b7` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:01:49.114198 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-555155c2-dae1-490d-aef4-0824a1b266ca admin admin] RBAC: Authorizing `identity:delete_project(project_id=f080a0989f2d4eb4a236975c6391c3b7)` {{(pid=82026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 20:01:49.114615 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.fernet_utils [None req-f3f5ada5-3555-4fb7-b47a-6d52e2d84e21 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82025) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 20:01:49.116210 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-555155c2-dae1-490d-aef4-0824a1b266ca admin admin] RBAC: Authorization granted {{(pid=82026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 20:01:49.186817 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3f5ada5-3555-4fb7-b47a-6d52e2d84e21 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=82025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 20:01:49.188489 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3f5ada5-3555-4fb7-b47a-6d52e2d84e21 service cinder] RBAC: Authorization granted {{(pid=82025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 20:01:49.198233 dv-cinder-828806-6-smb devstack@keystone.service[82025]: [pid: 82025|app: 0|req: 1147/2236] 10.222.0.33 () {60 vars in 1365 bytes} [Tue Sep 13 20:01:49 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 114 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 20:01:49.274679 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.notifications [None req-555155c2-dae1-490d-aef4-0824a1b266ca admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f080a0989f2d4eb4a236975c6391c3b7', 'request_id': 'req-555155c2-dae1-490d-aef4-0824a1b266ca'} {{(pid=82026) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 20:01:49.347780 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.notifications [None req-555155c2-dae1-490d-aef4-0824a1b266ca admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f080a0989f2d4eb4a236975c6391c3b7', 'request_id': 'req-555155c2-dae1-490d-aef4-0824a1b266ca'} {{(pid=82026) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 20:01:49.353971 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.notifications [None req-555155c2-dae1-490d-aef4-0824a1b266ca admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f080a0989f2d4eb4a236975c6391c3b7', 'request_id': 'req-555155c2-dae1-490d-aef4-0824a1b266ca'} {{(pid=82026) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 20:01:49.365857 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.notifications [None req-555155c2-dae1-490d-aef4-0824a1b266ca admin admin] The token cache is being invalidate because project f080a0989f2d4eb4a236975c6391c3b7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82026) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 13 20:01:49.366154 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.notifications [None req-555155c2-dae1-490d-aef4-0824a1b266ca admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82026) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 20:01:49.366797 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.notifications [None req-555155c2-dae1-490d-aef4-0824a1b266ca admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82026) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 20:01:49.368297 dv-cinder-828806-6-smb devstack@keystone.service[82026]: [pid: 82026|app: 0|req: 1090/2237] 10.222.0.33 () {58 vars in 1233 bytes} [Tue Sep 13 20:01:48 2022] DELETE /identity/v3/projects/f080a0989f2d4eb4a236975c6391c3b7 => generated 0 bytes in 383 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 13 20:01:49.822345 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG dbcounter [-] [82026] Writing DB stats keystone:SELECT=100 {{(pid=82026) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 20:01:49.920545 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3f5ada5-3555-4fb7-b47a-6d52e2d84e21 service cinder] Authenticating user token {{(pid=82025) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 20:01:49.931809 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3f5ada5-3555-4fb7-b47a-6d52e2d84e21 service cinder] Validating token access rules against request {{(pid=82025) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 20:01:50.002922 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9cf955c-6b24-4e8d-88fd-d3841e97dd81 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57539b6a6f3b4d589f5f5e1d211cd6a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b454f707d20347ada3d82aa85495635e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82025) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 20:01:50.003602 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9cf955c-6b24-4e8d-88fd-d3841e97dd81 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:01:50.003882 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9cf955c-6b24-4e8d-88fd-d3841e97dd81 admin admin] SCRIPT_NAME: `/identity` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:01:50.004162 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9cf955c-6b24-4e8d-88fd-d3841e97dd81 admin admin] PATH_INFO: `/v3/users/aa4710c924d2408da2c26b13306814fe` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:01:50.005318 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9cf955c-6b24-4e8d-88fd-d3841e97dd81 admin admin] RBAC: Authorizing `identity:delete_user(user_id=aa4710c924d2408da2c26b13306814fe)` {{(pid=82025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 20:01:50.007350 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9cf955c-6b24-4e8d-88fd-d3841e97dd81 admin admin] RBAC: Authorization granted {{(pid=82025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 20:01:50.165733 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG dbcounter [-] [82025] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=82025) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 20:01:50.173637 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.notifications [None req-e9cf955c-6b24-4e8d-88fd-d3841e97dd81 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'aa4710c924d2408da2c26b13306814fe'} {{(pid=82025) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 20:01:50.227964 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.notifications [None req-e9cf955c-6b24-4e8d-88fd-d3841e97dd81 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'aa4710c924d2408da2c26b13306814fe'} {{(pid=82025) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 20:01:50.228944 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.notifications [None req-e9cf955c-6b24-4e8d-88fd-d3841e97dd81 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'aa4710c924d2408da2c26b13306814fe'} {{(pid=82025) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 20:01:50.243566 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.notifications [None req-e9cf955c-6b24-4e8d-88fd-d3841e97dd81 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'aa4710c924d2408da2c26b13306814fe'} {{(pid=82025) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 20:01:50.251569 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.notifications [None req-e9cf955c-6b24-4e8d-88fd-d3841e97dd81 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'aa4710c924d2408da2c26b13306814fe'} {{(pid=82025) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 20:01:50.256988 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG dbcounter [-] [82026] Writing DB stats keystone:SELECT=79,keystone:DELETE=19,keystone:INSERT=2 {{(pid=82026) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 20:01:50.262435 dv-cinder-828806-6-smb devstack@keystone.service[82025]: [pid: 82025|app: 0|req: 1148/2238] 10.222.0.33 () {58 vars in 1224 bytes} [Tue Sep 13 20:01:49 2022] DELETE /identity/v3/users/aa4710c924d2408da2c26b13306814fe => generated 0 bytes in 342 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 20:01:50.267385 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2c409c6-86fe-431d-a64b-ae7ae22d86fa None None] REQUEST_METHOD: `POST` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:01:50.267607 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2c409c6-86fe-431d-a64b-ae7ae22d86fa None None] SCRIPT_NAME: `/identity` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:01:50.267887 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2c409c6-86fe-431d-a64b-ae7ae22d86fa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:01:50.310209 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.auth.core [None req-d2c409c6-86fe-431d-a64b-ae7ae22d86fa None None] MFA Rules not processed for user `57539b6a6f3b4d589f5f5e1d211cd6a0`. Rule list: `[]` (Enabled: `True`). {{(pid=82026) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 20:01:50.312232 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.common.fernet_utils [None req-d2c409c6-86fe-431d-a64b-ae7ae22d86fa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82026) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 20:01:50.381095 dv-cinder-828806-6-smb devstack@keystone.service[82026]: [pid: 82026|app: 0|req: 1091/2239] 10.222.0.33 () {58 vars in 958 bytes} [Tue Sep 13 20:01:50 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 20:01:50.392147 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9cf955c-6b24-4e8d-88fd-d3841e97dd81 admin admin] Authenticating user token {{(pid=82025) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 20:01:50.393699 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.fernet_utils [None req-e9cf955c-6b24-4e8d-88fd-d3841e97dd81 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82025) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 20:01:50.451977 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9cf955c-6b24-4e8d-88fd-d3841e97dd81 admin admin] Validating token access rules against request {{(pid=82025) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 20:01:50.455740 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f697cf7d-fe1a-4e04-aab2-9bd897524cfe service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '023a2c79c2444611b3d431928e56685d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8c6fba0f15b4d6a84ff601919b7b8e4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82025) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 20:01:50.456619 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f697cf7d-fe1a-4e04-aab2-9bd897524cfe service neutron] REQUEST_METHOD: `GET` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:01:50.456907 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f697cf7d-fe1a-4e04-aab2-9bd897524cfe service neutron] SCRIPT_NAME: `/identity` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:01:50.457184 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f697cf7d-fe1a-4e04-aab2-9bd897524cfe service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:01:50.467783 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f697cf7d-fe1a-4e04-aab2-9bd897524cfe service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 20:01:50.473842 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f697cf7d-fe1a-4e04-aab2-9bd897524cfe service neutron] RBAC: Authorization granted {{(pid=82025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 20:01:50.479456 dv-cinder-828806-6-smb devstack@keystone.service[82025]: [pid: 82025|app: 0|req: 1149/2240] 10.222.0.33 () {60 vars in 1365 bytes} [Tue Sep 13 20:01:50 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 20:01:50.743421 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2c409c6-86fe-431d-a64b-ae7ae22d86fa None None] Authenticating user token {{(pid=82026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 20:01:50.744870 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.common.fernet_utils [None req-d2c409c6-86fe-431d-a64b-ae7ae22d86fa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82026) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 20:01:50.758002 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2c409c6-86fe-431d-a64b-ae7ae22d86fa None None] Validating token access rules against request {{(pid=82026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 20:01:50.763285 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c00ab5fa-3d37-4e7b-9456-c7f536bb1281 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57539b6a6f3b4d589f5f5e1d211cd6a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b454f707d20347ada3d82aa85495635e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 20:01:50.763977 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c00ab5fa-3d37-4e7b-9456-c7f536bb1281 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:01:50.764266 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c00ab5fa-3d37-4e7b-9456-c7f536bb1281 admin admin] SCRIPT_NAME: `/identity` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:01:50.764542 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c00ab5fa-3d37-4e7b-9456-c7f536bb1281 admin admin] PATH_INFO: `/v3/users/bc749e2c9e474a149a34560bb623b8ec` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:01:50.765676 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c00ab5fa-3d37-4e7b-9456-c7f536bb1281 admin admin] RBAC: Authorizing `identity:delete_user(user_id=bc749e2c9e474a149a34560bb623b8ec)` {{(pid=82026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 20:01:50.767645 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c00ab5fa-3d37-4e7b-9456-c7f536bb1281 admin admin] RBAC: Authorization granted {{(pid=82026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 20:01:50.931162 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG dbcounter [-] [82025] Writing DB stats keystone:SELECT=93,keystone:INSERT=7 {{(pid=82025) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 20:01:51.007627 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f697cf7d-fe1a-4e04-aab2-9bd897524cfe service neutron] Authenticating user token {{(pid=82025) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 20:01:51.009183 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.fernet_utils [None req-f697cf7d-fe1a-4e04-aab2-9bd897524cfe service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82025) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 20:01:51.021258 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.notifications [None req-c00ab5fa-3d37-4e7b-9456-c7f536bb1281 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'bc749e2c9e474a149a34560bb623b8ec'} {{(pid=82026) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 20:01:51.024642 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f697cf7d-fe1a-4e04-aab2-9bd897524cfe service neutron] Validating token access rules against request {{(pid=82025) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 20:01:51.030137 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7cf4c25-f826-4725-85f7-f7c930ec4263 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57539b6a6f3b4d589f5f5e1d211cd6a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b454f707d20347ada3d82aa85495635e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82025) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 20:01:51.033346 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7cf4c25-f826-4725-85f7-f7c930ec4263 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:01:51.033346 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7cf4c25-f826-4725-85f7-f7c930ec4263 admin admin] SCRIPT_NAME: `/identity` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:01:51.033346 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7cf4c25-f826-4725-85f7-f7c930ec4263 admin admin] PATH_INFO: `/v3/projects/96b9a4fdecbd40fcbe3ccfd13db6dd1b` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:01:51.033346 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7cf4c25-f826-4725-85f7-f7c930ec4263 admin admin] RBAC: Authorizing `identity:delete_project(project_id=96b9a4fdecbd40fcbe3ccfd13db6dd1b)` {{(pid=82025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 20:01:51.034429 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7cf4c25-f826-4725-85f7-f7c930ec4263 admin admin] RBAC: Authorization granted {{(pid=82025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 20:01:51.137949 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.notifications [None req-c00ab5fa-3d37-4e7b-9456-c7f536bb1281 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'bc749e2c9e474a149a34560bb623b8ec'} {{(pid=82026) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 20:01:51.150927 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.notifications [None req-c00ab5fa-3d37-4e7b-9456-c7f536bb1281 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'bc749e2c9e474a149a34560bb623b8ec'} {{(pid=82026) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 20:01:51.151681 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.notifications [None req-c00ab5fa-3d37-4e7b-9456-c7f536bb1281 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'bc749e2c9e474a149a34560bb623b8ec'} {{(pid=82026) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 20:01:51.155730 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.notifications [None req-c7cf4c25-f826-4725-85f7-f7c930ec4263 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '96b9a4fdecbd40fcbe3ccfd13db6dd1b', 'request_id': 'req-c7cf4c25-f826-4725-85f7-f7c930ec4263'} {{(pid=82025) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 20:01:51.158752 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.notifications [None req-c00ab5fa-3d37-4e7b-9456-c7f536bb1281 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'bc749e2c9e474a149a34560bb623b8ec'} {{(pid=82026) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 20:01:51.161630 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.notifications [None req-c7cf4c25-f826-4725-85f7-f7c930ec4263 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '96b9a4fdecbd40fcbe3ccfd13db6dd1b', 'request_id': 'req-c7cf4c25-f826-4725-85f7-f7c930ec4263'} {{(pid=82025) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 20:01:51.164637 dv-cinder-828806-6-smb devstack@keystone.service[82026]: [pid: 82026|app: 0|req: 1092/2241] 10.222.0.33 () {58 vars in 1224 bytes} [Tue Sep 13 20:01:50 2022] DELETE /identity/v3/users/bc749e2c9e474a149a34560bb623b8ec => generated 0 bytes in 422 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 20:01:51.168806 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.notifications [None req-c7cf4c25-f826-4725-85f7-f7c930ec4263 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '96b9a4fdecbd40fcbe3ccfd13db6dd1b', 'request_id': 'req-c7cf4c25-f826-4725-85f7-f7c930ec4263'} {{(pid=82025) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 20:01:51.169096 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a85ce92f-892b-4815-a7e2-10dc49b4a524 None None] REQUEST_METHOD: `POST` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:01:51.169388 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a85ce92f-892b-4815-a7e2-10dc49b4a524 None None] SCRIPT_NAME: `/identity` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:01:51.169669 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a85ce92f-892b-4815-a7e2-10dc49b4a524 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:01:51.188726 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.auth.core [None req-a85ce92f-892b-4815-a7e2-10dc49b4a524 None None] MFA Rules not processed for user `57539b6a6f3b4d589f5f5e1d211cd6a0`. Rule list: `[]` (Enabled: `True`). {{(pid=82026) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 20:01:51.195323 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.common.fernet_utils [None req-a85ce92f-892b-4815-a7e2-10dc49b4a524 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82026) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 20:01:51.239554 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.notifications [None req-c7cf4c25-f826-4725-85f7-f7c930ec4263 admin admin] The token cache is being invalidate because project 96b9a4fdecbd40fcbe3ccfd13db6dd1b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82025) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 13 20:01:51.239863 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.notifications [None req-c7cf4c25-f826-4725-85f7-f7c930ec4263 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82025) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 20:01:51.240777 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.notifications [None req-c7cf4c25-f826-4725-85f7-f7c930ec4263 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82025) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 20:01:51.242680 dv-cinder-828806-6-smb devstack@keystone.service[82025]: [pid: 82025|app: 0|req: 1150/2242] 10.222.0.33 () {58 vars in 1233 bytes} [Tue Sep 13 20:01:51 2022] DELETE /identity/v3/projects/96b9a4fdecbd40fcbe3ccfd13db6dd1b => generated 0 bytes in 235 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 20:01:51.247284 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7cf4c25-f826-4725-85f7-f7c930ec4263 admin admin] Authenticating user token {{(pid=82025) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 20:01:51.248737 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.fernet_utils [None req-c7cf4c25-f826-4725-85f7-f7c930ec4263 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82025) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 20:01:51.252049 dv-cinder-828806-6-smb devstack@keystone.service[82026]: [pid: 82026|app: 0|req: 1093/2243] 10.222.0.33 () {58 vars in 958 bytes} [Tue Sep 13 20:01:51 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 13 20:01:51.264525 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a85ce92f-892b-4815-a7e2-10dc49b4a524 None None] Authenticating user token {{(pid=82026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 20:01:51.268288 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.common.fernet_utils [None req-a85ce92f-892b-4815-a7e2-10dc49b4a524 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82026) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 20:01:51.333700 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7cf4c25-f826-4725-85f7-f7c930ec4263 admin admin] Validating token access rules against request {{(pid=82025) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 20:01:51.335747 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a85ce92f-892b-4815-a7e2-10dc49b4a524 None None] Validating token access rules against request {{(pid=82026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 20:01:51.339729 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-733850e0-aade-4026-bc3a-23338137e4df service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '023a2c79c2444611b3d431928e56685d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8c6fba0f15b4d6a84ff601919b7b8e4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 20:01:51.339902 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5db6595-19ad-443b-a933-4f6bec71abc5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57539b6a6f3b4d589f5f5e1d211cd6a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b454f707d20347ada3d82aa85495635e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82025) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 20:01:51.340468 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5db6595-19ad-443b-a933-4f6bec71abc5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:01:51.340624 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-733850e0-aade-4026-bc3a-23338137e4df service neutron] REQUEST_METHOD: `GET` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:01:51.340869 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5db6595-19ad-443b-a933-4f6bec71abc5 admin admin] SCRIPT_NAME: `/identity` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:01:51.340984 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-733850e0-aade-4026-bc3a-23338137e4df service neutron] SCRIPT_NAME: `/identity` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:01:51.341154 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5db6595-19ad-443b-a933-4f6bec71abc5 admin admin] PATH_INFO: `/v3/users/693a9bf3857b45e8a15fe1026cf3f13a` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:01:51.341284 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-733850e0-aade-4026-bc3a-23338137e4df service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:01:51.342352 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5db6595-19ad-443b-a933-4f6bec71abc5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=693a9bf3857b45e8a15fe1026cf3f13a)` {{(pid=82025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 20:01:51.344321 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5db6595-19ad-443b-a933-4f6bec71abc5 admin admin] RBAC: Authorization granted {{(pid=82025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 20:01:51.351753 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-733850e0-aade-4026-bc3a-23338137e4df service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 20:01:51.353204 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-733850e0-aade-4026-bc3a-23338137e4df service neutron] RBAC: Authorization granted {{(pid=82026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 20:01:51.364122 dv-cinder-828806-6-smb devstack@keystone.service[82026]: [pid: 82026|app: 0|req: 1094/2244] 10.222.0.33 () {60 vars in 1365 bytes} [Tue Sep 13 20:01:51 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 100 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 13 20:01:51.521581 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.notifications [None req-f5db6595-19ad-443b-a933-4f6bec71abc5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '693a9bf3857b45e8a15fe1026cf3f13a'} {{(pid=82025) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 20:01:51.536666 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG dbcounter [-] [82026] Writing DB stats keystone:SELECT=96,keystone:DELETE=1,keystone:INSERT=3 {{(pid=82026) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 20:01:51.559338 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-733850e0-aade-4026-bc3a-23338137e4df service neutron] Authenticating user token {{(pid=82026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 20:01:51.560842 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.common.fernet_utils [None req-733850e0-aade-4026-bc3a-23338137e4df service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82026) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 20:01:51.581389 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-733850e0-aade-4026-bc3a-23338137e4df service neutron] Validating token access rules against request {{(pid=82026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 20:01:51.590457 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-851102a5-62e9-46b8-8b6f-76074907b425 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57539b6a6f3b4d589f5f5e1d211cd6a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b454f707d20347ada3d82aa85495635e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 20:01:51.591318 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-851102a5-62e9-46b8-8b6f-76074907b425 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:01:51.591920 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-851102a5-62e9-46b8-8b6f-76074907b425 admin admin] SCRIPT_NAME: `/identity` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:01:51.592352 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-851102a5-62e9-46b8-8b6f-76074907b425 admin admin] PATH_INFO: `/v3/users/de100dd326424ccc8d1c833ce3158e79` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:01:51.593547 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.notifications [None req-f5db6595-19ad-443b-a933-4f6bec71abc5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '693a9bf3857b45e8a15fe1026cf3f13a'} {{(pid=82025) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 20:01:51.599193 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.notifications [None req-f5db6595-19ad-443b-a933-4f6bec71abc5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '693a9bf3857b45e8a15fe1026cf3f13a'} {{(pid=82025) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 20:01:51.604351 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-851102a5-62e9-46b8-8b6f-76074907b425 admin admin] RBAC: Authorizing `identity:delete_user(user_id=de100dd326424ccc8d1c833ce3158e79)` {{(pid=82026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 20:01:51.608877 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-851102a5-62e9-46b8-8b6f-76074907b425 admin admin] RBAC: Authorization granted {{(pid=82026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 20:01:51.611413 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.notifications [None req-f5db6595-19ad-443b-a933-4f6bec71abc5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '693a9bf3857b45e8a15fe1026cf3f13a'} {{(pid=82025) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 20:01:51.619639 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.notifications [None req-f5db6595-19ad-443b-a933-4f6bec71abc5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '693a9bf3857b45e8a15fe1026cf3f13a'} {{(pid=82025) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 20:01:51.631393 dv-cinder-828806-6-smb devstack@keystone.service[82025]: [pid: 82025|app: 0|req: 1151/2245] 10.222.0.33 () {58 vars in 1224 bytes} [Tue Sep 13 20:01:51 2022] DELETE /identity/v3/users/693a9bf3857b45e8a15fe1026cf3f13a => generated 0 bytes in 382 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 20:01:51.697764 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG dbcounter [-] [82025] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=82025) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 20:01:51.859822 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.notifications [None req-851102a5-62e9-46b8-8b6f-76074907b425 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'de100dd326424ccc8d1c833ce3158e79'} {{(pid=82026) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 20:01:51.915210 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5db6595-19ad-443b-a933-4f6bec71abc5 admin admin] Authenticating user token {{(pid=82025) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 20:01:51.916906 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.fernet_utils [None req-f5db6595-19ad-443b-a933-4f6bec71abc5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82025) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 20:01:51.931213 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.notifications [None req-851102a5-62e9-46b8-8b6f-76074907b425 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'de100dd326424ccc8d1c833ce3158e79'} {{(pid=82026) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 20:01:51.946929 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.notifications [None req-851102a5-62e9-46b8-8b6f-76074907b425 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'de100dd326424ccc8d1c833ce3158e79'} {{(pid=82026) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 20:01:51.948419 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.notifications [None req-851102a5-62e9-46b8-8b6f-76074907b425 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'de100dd326424ccc8d1c833ce3158e79'} {{(pid=82026) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 20:01:51.959867 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.notifications [None req-851102a5-62e9-46b8-8b6f-76074907b425 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'de100dd326424ccc8d1c833ce3158e79'} {{(pid=82026) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 20:01:51.970861 dv-cinder-828806-6-smb devstack@keystone.service[82026]: [pid: 82026|app: 0|req: 1095/2246] 10.222.0.33 () {58 vars in 1224 bytes} [Tue Sep 13 20:01:51 2022] DELETE /identity/v3/users/de100dd326424ccc8d1c833ce3158e79 => generated 0 bytes in 413 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 13 20:01:51.976533 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa70ac22-951c-4d51-ba93-3756eee00b70 None None] REQUEST_METHOD: `POST` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:01:51.976818 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa70ac22-951c-4d51-ba93-3756eee00b70 None None] SCRIPT_NAME: `/identity` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:01:51.977103 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa70ac22-951c-4d51-ba93-3756eee00b70 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:01:52.001647 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.auth.core [None req-aa70ac22-951c-4d51-ba93-3756eee00b70 None None] MFA Rules not processed for user `57539b6a6f3b4d589f5f5e1d211cd6a0`. Rule list: `[]` (Enabled: `True`). {{(pid=82026) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 20:01:52.002880 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.common.fernet_utils [None req-aa70ac22-951c-4d51-ba93-3756eee00b70 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82026) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 20:01:52.013830 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5db6595-19ad-443b-a933-4f6bec71abc5 admin admin] Validating token access rules against request {{(pid=82025) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 20:01:52.065317 dv-cinder-828806-6-smb devstack@keystone.service[82026]: [pid: 82026|app: 0|req: 1096/2247] 10.222.0.33 () {58 vars in 958 bytes} [Tue Sep 13 20:01:51 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 20:01:52.072156 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c02d888-2bd4-4879-832d-7ab764e9af49 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57539b6a6f3b4d589f5f5e1d211cd6a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b454f707d20347ada3d82aa85495635e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82025) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 20:01:52.073074 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c02d888-2bd4-4879-832d-7ab764e9af49 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:01:52.073423 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c02d888-2bd4-4879-832d-7ab764e9af49 admin admin] SCRIPT_NAME: `/identity` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:01:52.074410 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c02d888-2bd4-4879-832d-7ab764e9af49 admin admin] PATH_INFO: `/v3/projects/6bd5d5a3fa254e7b9b520a6e9b1f7281` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:01:52.076049 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c02d888-2bd4-4879-832d-7ab764e9af49 admin admin] RBAC: Authorizing `identity:delete_project(project_id=6bd5d5a3fa254e7b9b520a6e9b1f7281)` {{(pid=82025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 20:01:52.076433 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa70ac22-951c-4d51-ba93-3756eee00b70 None None] Authenticating user token {{(pid=82026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 20:01:52.077853 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.common.fernet_utils [None req-aa70ac22-951c-4d51-ba93-3756eee00b70 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82026) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 20:01:52.078498 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c02d888-2bd4-4879-832d-7ab764e9af49 admin admin] RBAC: Authorization granted {{(pid=82025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 20:01:52.094486 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa70ac22-951c-4d51-ba93-3756eee00b70 None None] Validating token access rules against request {{(pid=82026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 20:01:52.099573 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bc7ed8e-d28e-425b-936e-bda89ba82112 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57539b6a6f3b4d589f5f5e1d211cd6a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b454f707d20347ada3d82aa85495635e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 20:01:52.100220 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bc7ed8e-d28e-425b-936e-bda89ba82112 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:01:52.100512 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bc7ed8e-d28e-425b-936e-bda89ba82112 admin admin] SCRIPT_NAME: `/identity` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:01:52.100790 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bc7ed8e-d28e-425b-936e-bda89ba82112 admin admin] PATH_INFO: `/v3/projects/fb86dbe53e9a4756be27139ef041265b` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:01:52.102993 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bc7ed8e-d28e-425b-936e-bda89ba82112 admin admin] RBAC: Authorizing `identity:delete_project(project_id=fb86dbe53e9a4756be27139ef041265b)` {{(pid=82026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 20:01:52.107532 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bc7ed8e-d28e-425b-936e-bda89ba82112 admin admin] RBAC: Authorization granted {{(pid=82026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 20:01:52.188721 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.notifications [None req-3c02d888-2bd4-4879-832d-7ab764e9af49 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6bd5d5a3fa254e7b9b520a6e9b1f7281', 'request_id': 'req-3c02d888-2bd4-4879-832d-7ab764e9af49'} {{(pid=82025) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 20:01:52.194523 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.notifications [None req-3c02d888-2bd4-4879-832d-7ab764e9af49 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6bd5d5a3fa254e7b9b520a6e9b1f7281', 'request_id': 'req-3c02d888-2bd4-4879-832d-7ab764e9af49'} {{(pid=82025) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 20:01:52.201874 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.notifications [None req-3c02d888-2bd4-4879-832d-7ab764e9af49 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6bd5d5a3fa254e7b9b520a6e9b1f7281', 'request_id': 'req-3c02d888-2bd4-4879-832d-7ab764e9af49'} {{(pid=82025) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 20:01:52.211886 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.notifications [None req-6bc7ed8e-d28e-425b-936e-bda89ba82112 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'fb86dbe53e9a4756be27139ef041265b', 'request_id': 'req-6bc7ed8e-d28e-425b-936e-bda89ba82112'} {{(pid=82026) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 20:01:52.239740 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG dbcounter [-] [82025] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=82025) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 20:01:52.296269 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.notifications [None req-3c02d888-2bd4-4879-832d-7ab764e9af49 admin admin] The token cache is being invalidate because project 6bd5d5a3fa254e7b9b520a6e9b1f7281 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82025) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 13 20:01:52.296573 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.notifications [None req-3c02d888-2bd4-4879-832d-7ab764e9af49 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82025) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 20:01:52.297219 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.notifications [None req-3c02d888-2bd4-4879-832d-7ab764e9af49 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82025) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 20:01:52.298764 dv-cinder-828806-6-smb devstack@keystone.service[82025]: [pid: 82025|app: 0|req: 1152/2248] 10.222.0.33 () {58 vars in 1233 bytes} [Tue Sep 13 20:01:51 2022] DELETE /identity/v3/projects/6bd5d5a3fa254e7b9b520a6e9b1f7281 => generated 0 bytes in 384 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 13 20:01:52.299577 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c02d888-2bd4-4879-832d-7ab764e9af49 admin admin] Authenticating user token {{(pid=82025) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 20:01:52.300865 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.fernet_utils [None req-3c02d888-2bd4-4879-832d-7ab764e9af49 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82025) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 20:01:52.314071 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG dbcounter [-] [82026] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82026) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 20:01:52.336348 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.notifications [None req-6bc7ed8e-d28e-425b-936e-bda89ba82112 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'fb86dbe53e9a4756be27139ef041265b', 'request_id': 'req-6bc7ed8e-d28e-425b-936e-bda89ba82112'} {{(pid=82026) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 20:01:52.343295 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.notifications [None req-6bc7ed8e-d28e-425b-936e-bda89ba82112 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'fb86dbe53e9a4756be27139ef041265b', 'request_id': 'req-6bc7ed8e-d28e-425b-936e-bda89ba82112'} {{(pid=82026) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 20:01:52.355026 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.notifications [None req-6bc7ed8e-d28e-425b-936e-bda89ba82112 admin admin] The token cache is being invalidate because project fb86dbe53e9a4756be27139ef041265b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82026) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 13 20:01:52.356093 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.notifications [None req-6bc7ed8e-d28e-425b-936e-bda89ba82112 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82026) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 20:01:52.356767 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.notifications [None req-6bc7ed8e-d28e-425b-936e-bda89ba82112 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82026) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 20:01:52.359948 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c02d888-2bd4-4879-832d-7ab764e9af49 admin admin] Validating token access rules against request {{(pid=82025) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 20:01:52.360251 dv-cinder-828806-6-smb devstack@keystone.service[82026]: [pid: 82026|app: 0|req: 1097/2249] 10.222.0.33 () {58 vars in 1233 bytes} [Tue Sep 13 20:01:52 2022] DELETE /identity/v3/projects/fb86dbe53e9a4756be27139ef041265b => generated 0 bytes in 285 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 20:01:52.361559 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32795492-e40f-434a-a368-c25cf4d8993b None None] REQUEST_METHOD: `POST` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:01:52.361845 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32795492-e40f-434a-a368-c25cf4d8993b None None] SCRIPT_NAME: `/identity` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:01:52.362118 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32795492-e40f-434a-a368-c25cf4d8993b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:01:52.381650 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.auth.core [None req-32795492-e40f-434a-a368-c25cf4d8993b None None] MFA Rules not processed for user `57539b6a6f3b4d589f5f5e1d211cd6a0`. Rule list: `[]` (Enabled: `True`). {{(pid=82026) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 20:01:52.382852 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.common.fernet_utils [None req-32795492-e40f-434a-a368-c25cf4d8993b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82026) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 20:01:52.414640 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c93810d-5891-4970-aaba-bb4f62fdf4da service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '023a2c79c2444611b3d431928e56685d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8c6fba0f15b4d6a84ff601919b7b8e4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82025) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 20:01:52.415292 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c93810d-5891-4970-aaba-bb4f62fdf4da service neutron] REQUEST_METHOD: `GET` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:01:52.415575 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c93810d-5891-4970-aaba-bb4f62fdf4da service neutron] SCRIPT_NAME: `/identity` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:01:52.415851 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c93810d-5891-4970-aaba-bb4f62fdf4da service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:01:52.417632 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.fernet_utils [None req-6c93810d-5891-4970-aaba-bb4f62fdf4da service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82025) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 20:01:52.444053 dv-cinder-828806-6-smb devstack@keystone.service[82026]: [pid: 82026|app: 0|req: 1098/2250] 10.222.0.33 () {58 vars in 958 bytes} [Tue Sep 13 20:01:52 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 20:01:52.445387 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3634d57-93d0-4556-92b5-71ea1834ad75 None None] REQUEST_METHOD: `POST` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:01:52.445680 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3634d57-93d0-4556-92b5-71ea1834ad75 None None] SCRIPT_NAME: `/identity` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:01:52.446061 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3634d57-93d0-4556-92b5-71ea1834ad75 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:01:52.466640 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.auth.core [None req-c3634d57-93d0-4556-92b5-71ea1834ad75 None None] MFA Rules not processed for user `57539b6a6f3b4d589f5f5e1d211cd6a0`. Rule list: `[]` (Enabled: `True`). {{(pid=82026) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 20:01:52.467897 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.common.fernet_utils [None req-c3634d57-93d0-4556-92b5-71ea1834ad75 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82026) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 20:01:52.475836 dv-cinder-828806-6-smb devstack@keystone.service[82026]: [pid: 82026|app: 0|req: 1099/2251] 10.222.0.33 () {58 vars in 958 bytes} [Tue Sep 13 20:01:52 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 20:01:52.477083 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b327a0fe-5bba-4bf7-97f2-93a6fc2a0d03 None None] REQUEST_METHOD: `POST` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:01:52.477432 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b327a0fe-5bba-4bf7-97f2-93a6fc2a0d03 None None] SCRIPT_NAME: `/identity` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:01:52.477817 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b327a0fe-5bba-4bf7-97f2-93a6fc2a0d03 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:01:52.484997 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c93810d-5891-4970-aaba-bb4f62fdf4da service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 20:01:52.486661 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c93810d-5891-4970-aaba-bb4f62fdf4da service neutron] RBAC: Authorization granted {{(pid=82025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 20:01:52.497072 dv-cinder-828806-6-smb devstack@keystone.service[82025]: [pid: 82025|app: 0|req: 1153/2252] 10.222.0.33 () {60 vars in 1365 bytes} [Tue Sep 13 20:01:52 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 198 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 20:01:52.498436 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bef1b26-c5ce-41ec-aaae-4b3dd7dae9bd None None] REQUEST_METHOD: `POST` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:01:52.498733 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bef1b26-c5ce-41ec-aaae-4b3dd7dae9bd None None] SCRIPT_NAME: `/identity` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:01:52.499062 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bef1b26-c5ce-41ec-aaae-4b3dd7dae9bd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:01:52.499649 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.auth.core [None req-b327a0fe-5bba-4bf7-97f2-93a6fc2a0d03 None None] MFA Rules not processed for user `57539b6a6f3b4d589f5f5e1d211cd6a0`. Rule list: `[]` (Enabled: `True`). {{(pid=82026) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 20:01:52.500844 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.common.fernet_utils [None req-b327a0fe-5bba-4bf7-97f2-93a6fc2a0d03 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82026) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 20:01:52.513347 dv-cinder-828806-6-smb devstack@keystone.service[82026]: [pid: 82026|app: 0|req: 1100/2253] 10.222.0.33 () {58 vars in 958 bytes} [Tue Sep 13 20:01:52 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 20:01:52.517437 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b327a0fe-5bba-4bf7-97f2-93a6fc2a0d03 None None] Authenticating user token {{(pid=82026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 20:01:52.519470 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.auth.core [None req-6bef1b26-c5ce-41ec-aaae-4b3dd7dae9bd None None] MFA Rules not processed for user `57539b6a6f3b4d589f5f5e1d211cd6a0`. Rule list: `[]` (Enabled: `True`). {{(pid=82025) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 20:01:52.520787 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.fernet_utils [None req-6bef1b26-c5ce-41ec-aaae-4b3dd7dae9bd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82025) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 20:01:52.527746 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b327a0fe-5bba-4bf7-97f2-93a6fc2a0d03 None None] Validating token access rules against request {{(pid=82026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 20:01:52.530232 dv-cinder-828806-6-smb devstack@keystone.service[82025]: [pid: 82025|app: 0|req: 1154/2254] 10.222.0.33 () {58 vars in 958 bytes} [Tue Sep 13 20:01:52 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 20:01:52.533512 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ea4053f-2ad5-464e-8e0a-8090d9ab4d1b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57539b6a6f3b4d589f5f5e1d211cd6a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b454f707d20347ada3d82aa85495635e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 20:01:52.534322 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bef1b26-c5ce-41ec-aaae-4b3dd7dae9bd None None] Authenticating user token {{(pid=82025) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 20:01:52.534484 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ea4053f-2ad5-464e-8e0a-8090d9ab4d1b admin admin] REQUEST_METHOD: `GET` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:01:52.534784 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ea4053f-2ad5-464e-8e0a-8090d9ab4d1b admin admin] SCRIPT_NAME: `/identity` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:01:52.535009 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ea4053f-2ad5-464e-8e0a-8090d9ab4d1b admin admin] PATH_INFO: `/v3/domains` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:01:52.535717 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ea4053f-2ad5-464e-8e0a-8090d9ab4d1b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82026) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 20:01:52.536018 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ea4053f-2ad5-464e-8e0a-8090d9ab4d1b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 20:01:52.537642 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ea4053f-2ad5-464e-8e0a-8090d9ab4d1b admin admin] RBAC: Authorization granted {{(pid=82026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 20:01:52.545063 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bef1b26-c5ce-41ec-aaae-4b3dd7dae9bd None None] Validating token access rules against request {{(pid=82025) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 20:01:52.551858 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d00d4356-74ca-443b-b085-7b7b67c2a057 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57539b6a6f3b4d589f5f5e1d211cd6a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b454f707d20347ada3d82aa85495635e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82025) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 20:01:52.552762 dv-cinder-828806-6-smb devstack@keystone.service[82026]: [pid: 82026|app: 0|req: 1101/2255] 10.222.0.33 () {58 vars in 1153 bytes} [Tue Sep 13 20:01:52 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 13 20:01:52.552889 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d00d4356-74ca-443b-b085-7b7b67c2a057 admin admin] REQUEST_METHOD: `GET` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:01:52.553768 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d00d4356-74ca-443b-b085-7b7b67c2a057 admin admin] SCRIPT_NAME: `/identity` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:01:52.553768 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d00d4356-74ca-443b-b085-7b7b67c2a057 admin admin] PATH_INFO: `/v3/domains` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:01:52.554272 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d00d4356-74ca-443b-b085-7b7b67c2a057 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82025) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 20:01:52.554947 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d00d4356-74ca-443b-b085-7b7b67c2a057 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 20:01:52.556386 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d00d4356-74ca-443b-b085-7b7b67c2a057 admin admin] RBAC: Authorization granted {{(pid=82025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 20:01:52.557085 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ea4053f-2ad5-464e-8e0a-8090d9ab4d1b admin admin] Authenticating user token {{(pid=82026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 20:01:52.567744 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ea4053f-2ad5-464e-8e0a-8090d9ab4d1b admin admin] Validating token access rules against request {{(pid=82026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 20:01:52.571147 dv-cinder-828806-6-smb devstack@keystone.service[82025]: [pid: 82025|app: 0|req: 1155/2256] 10.222.0.33 () {58 vars in 1153 bytes} [Tue Sep 13 20:01:52 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 13 20:01:52.573085 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2e3f678-b30b-4ae8-b8a1-282e7a866634 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57539b6a6f3b4d589f5f5e1d211cd6a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b454f707d20347ada3d82aa85495635e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 20:01:52.574423 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2e3f678-b30b-4ae8-b8a1-282e7a866634 admin admin] REQUEST_METHOD: `POST` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:01:52.574916 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2e3f678-b30b-4ae8-b8a1-282e7a866634 admin admin] SCRIPT_NAME: `/identity` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:01:52.575456 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2e3f678-b30b-4ae8-b8a1-282e7a866634 admin admin] PATH_INFO: `/v3/projects` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:01:52.576311 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2e3f678-b30b-4ae8-b8a1-282e7a866634 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 20:01:52.576894 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d00d4356-74ca-443b-b085-7b7b67c2a057 admin admin] Authenticating user token {{(pid=82025) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 20:01:52.578911 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2e3f678-b30b-4ae8-b8a1-282e7a866634 admin admin] RBAC: Authorization granted {{(pid=82026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 20:01:52.589187 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d00d4356-74ca-443b-b085-7b7b67c2a057 admin admin] Validating token access rules against request {{(pid=82025) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 20:01:52.596007 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2ffd25c-a7c6-476e-96a3-d3468279e3ab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57539b6a6f3b4d589f5f5e1d211cd6a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b454f707d20347ada3d82aa85495635e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82025) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 20:01:52.597291 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2ffd25c-a7c6-476e-96a3-d3468279e3ab admin admin] REQUEST_METHOD: `POST` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:01:52.597580 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2ffd25c-a7c6-476e-96a3-d3468279e3ab admin admin] SCRIPT_NAME: `/identity` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:01:52.597977 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2ffd25c-a7c6-476e-96a3-d3468279e3ab admin admin] PATH_INFO: `/v3/projects` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:01:52.598606 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2ffd25c-a7c6-476e-96a3-d3468279e3ab admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 20:01:52.600552 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2ffd25c-a7c6-476e-96a3-d3468279e3ab admin admin] RBAC: Authorization granted {{(pid=82025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 20:01:52.652399 dv-cinder-828806-6-smb devstack@keystone.service[82026]: [pid: 82026|app: 0|req: 1102/2257] 10.222.0.33 () {60 vars in 1153 bytes} [Tue Sep 13 20:01:52 2022] POST /identity/v3/projects => generated 369 bytes in 96 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 13 20:01:52.656801 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2e3f678-b30b-4ae8-b8a1-282e7a866634 admin admin] Authenticating user token {{(pid=82026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 20:01:52.668898 dv-cinder-828806-6-smb devstack@keystone.service[82025]: [pid: 82025|app: 0|req: 1156/2258] 10.222.0.33 () {60 vars in 1153 bytes} [Tue Sep 13 20:01:52 2022] POST /identity/v3/projects => generated 383 bytes in 93 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 13 20:01:52.670077 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2ffd25c-a7c6-476e-96a3-d3468279e3ab admin admin] Authenticating user token {{(pid=82025) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 20:01:52.740705 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG dbcounter [-] [82025] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82025) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 20:01:52.757795 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2e3f678-b30b-4ae8-b8a1-282e7a866634 admin admin] Validating token access rules against request {{(pid=82026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 20:01:52.789869 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2ffd25c-a7c6-476e-96a3-d3468279e3ab admin admin] Validating token access rules against request {{(pid=82025) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 20:01:52.795720 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df5fc4fb-e393-48c8-8ed0-86b017415041 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57539b6a6f3b4d589f5f5e1d211cd6a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b454f707d20347ada3d82aa85495635e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82025) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 20:01:52.796374 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df5fc4fb-e393-48c8-8ed0-86b017415041 admin admin] REQUEST_METHOD: `POST` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:01:52.796579 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df5fc4fb-e393-48c8-8ed0-86b017415041 admin admin] SCRIPT_NAME: `/identity` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:01:52.796848 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df5fc4fb-e393-48c8-8ed0-86b017415041 admin admin] PATH_INFO: `/v3/users` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:01:52.797497 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df5fc4fb-e393-48c8-8ed0-86b017415041 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 20:01:52.799829 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df5fc4fb-e393-48c8-8ed0-86b017415041 admin admin] RBAC: Authorization granted {{(pid=82025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 20:01:52.831837 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-715314b1-b05f-4c91-b38a-f3194401c7ed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57539b6a6f3b4d589f5f5e1d211cd6a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b454f707d20347ada3d82aa85495635e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 20:01:52.832595 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-715314b1-b05f-4c91-b38a-f3194401c7ed admin admin] REQUEST_METHOD: `POST` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:01:52.832986 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-715314b1-b05f-4c91-b38a-f3194401c7ed admin admin] SCRIPT_NAME: `/identity` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:01:52.833340 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-715314b1-b05f-4c91-b38a-f3194401c7ed admin admin] PATH_INFO: `/v3/users` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:01:52.834056 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-715314b1-b05f-4c91-b38a-f3194401c7ed admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 20:01:52.836098 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-715314b1-b05f-4c91-b38a-f3194401c7ed admin admin] RBAC: Authorization granted {{(pid=82026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 20:01:52.901028 dv-cinder-828806-6-smb devstack@keystone.service[82025]: [pid: 82025|app: 0|req: 1157/2259] 10.222.0.33 () {60 vars in 1144 bytes} [Tue Sep 13 20:01:52 2022] POST /identity/v3/users => generated 292 bytes in 228 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 13 20:01:52.901028 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df5fc4fb-e393-48c8-8ed0-86b017415041 admin admin] Authenticating user token {{(pid=82025) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 20:01:52.901028 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.fernet_utils [None req-df5fc4fb-e393-48c8-8ed0-86b017415041 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82025) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 20:01:52.913493 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df5fc4fb-e393-48c8-8ed0-86b017415041 admin admin] Validating token access rules against request {{(pid=82025) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 20:01:52.919730 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3afb1f43-5618-4550-a638-47bddc48835c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57539b6a6f3b4d589f5f5e1d211cd6a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b454f707d20347ada3d82aa85495635e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82025) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 20:01:52.920491 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3afb1f43-5618-4550-a638-47bddc48835c admin admin] REQUEST_METHOD: `DELETE` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:01:52.920791 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3afb1f43-5618-4550-a638-47bddc48835c admin admin] SCRIPT_NAME: `/identity` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:01:52.921091 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3afb1f43-5618-4550-a638-47bddc48835c admin admin] PATH_INFO: `/v3/users/c724d416282c45f4889ed1dfdc66dc3c` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:01:52.922281 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3afb1f43-5618-4550-a638-47bddc48835c admin admin] RBAC: Authorizing `identity:delete_user(user_id=c724d416282c45f4889ed1dfdc66dc3c)` {{(pid=82025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 20:01:52.924490 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3afb1f43-5618-4550-a638-47bddc48835c admin admin] RBAC: Authorization granted {{(pid=82025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 20:01:52.932215 dv-cinder-828806-6-smb devstack@keystone.service[82026]: [pid: 82026|app: 0|req: 1103/2260] 10.222.0.33 () {60 vars in 1144 bytes} [Tue Sep 13 20:01:52 2022] POST /identity/v3/users => generated 285 bytes in 276 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 13 20:01:52.933412 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-715314b1-b05f-4c91-b38a-f3194401c7ed admin admin] Authenticating user token {{(pid=82026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 20:01:52.945657 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-715314b1-b05f-4c91-b38a-f3194401c7ed admin admin] Validating token access rules against request {{(pid=82026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 20:01:52.952020 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36d0c0e8-3dc8-4e06-9cfd-e1d59f4f2056 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57539b6a6f3b4d589f5f5e1d211cd6a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b454f707d20347ada3d82aa85495635e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 20:01:52.952762 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36d0c0e8-3dc8-4e06-9cfd-e1d59f4f2056 admin admin] REQUEST_METHOD: `GET` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:01:52.953384 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36d0c0e8-3dc8-4e06-9cfd-e1d59f4f2056 admin admin] SCRIPT_NAME: `/identity` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:01:52.954226 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36d0c0e8-3dc8-4e06-9cfd-e1d59f4f2056 admin admin] PATH_INFO: `/v3/roles` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:01:52.954359 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36d0c0e8-3dc8-4e06-9cfd-e1d59f4f2056 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 20:01:52.956018 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36d0c0e8-3dc8-4e06-9cfd-e1d59f4f2056 admin admin] RBAC: Authorization granted {{(pid=82026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 20:01:52.967865 dv-cinder-828806-6-smb devstack@keystone.service[82026]: [pid: 82026|app: 0|req: 1104/2261] 10.222.0.33 () {58 vars in 1122 bytes} [Tue Sep 13 20:01:52 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 13 20:01:52.968691 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36d0c0e8-3dc8-4e06-9cfd-e1d59f4f2056 admin admin] Authenticating user token {{(pid=82026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 20:01:52.978344 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36d0c0e8-3dc8-4e06-9cfd-e1d59f4f2056 admin admin] Validating token access rules against request {{(pid=82026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 20:01:52.983447 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcd5fc6b-076b-4cb4-8d8c-c88161263d8f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57539b6a6f3b4d589f5f5e1d211cd6a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b454f707d20347ada3d82aa85495635e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 20:01:52.984051 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcd5fc6b-076b-4cb4-8d8c-c88161263d8f admin admin] REQUEST_METHOD: `GET` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:01:52.984335 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcd5fc6b-076b-4cb4-8d8c-c88161263d8f admin admin] SCRIPT_NAME: `/identity` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:01:52.984611 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcd5fc6b-076b-4cb4-8d8c-c88161263d8f admin admin] PATH_INFO: `/v3/roles` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:01:52.986738 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcd5fc6b-076b-4cb4-8d8c-c88161263d8f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 20:01:52.986929 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcd5fc6b-076b-4cb4-8d8c-c88161263d8f admin admin] RBAC: Authorization granted {{(pid=82026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 20:01:52.999685 dv-cinder-828806-6-smb devstack@keystone.service[82026]: [pid: 82026|app: 0|req: 1105/2262] 10.222.0.33 () {58 vars in 1122 bytes} [Tue Sep 13 20:01:52 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 13 20:01:53.000927 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcd5fc6b-076b-4cb4-8d8c-c88161263d8f admin admin] Authenticating user token {{(pid=82026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 20:01:53.017553 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcd5fc6b-076b-4cb4-8d8c-c88161263d8f admin admin] Validating token access rules against request {{(pid=82026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 20:01:53.019660 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG dbcounter [-] [82026] Writing DB stats keystone:DELETE=7,keystone:SELECT=91,keystone:INSERT=2 {{(pid=82026) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 20:01:53.034219 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c7660f4-0014-4807-9173-9b16c60d19b5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57539b6a6f3b4d589f5f5e1d211cd6a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b454f707d20347ada3d82aa85495635e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 20:01:53.034851 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c7660f4-0014-4807-9173-9b16c60d19b5 admin admin] REQUEST_METHOD: `GET` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:01:53.035165 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c7660f4-0014-4807-9173-9b16c60d19b5 admin admin] SCRIPT_NAME: `/identity` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:01:53.038534 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c7660f4-0014-4807-9173-9b16c60d19b5 admin admin] PATH_INFO: `/v3/roles` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:01:53.038534 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c7660f4-0014-4807-9173-9b16c60d19b5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 20:01:53.038534 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c7660f4-0014-4807-9173-9b16c60d19b5 admin admin] RBAC: Authorization granted {{(pid=82026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 20:01:53.049672 dv-cinder-828806-6-smb devstack@keystone.service[82026]: [pid: 82026|app: 0|req: 1106/2263] 10.222.0.33 () {58 vars in 1122 bytes} [Tue Sep 13 20:01:52 2022] GET /identity/v3/roles => generated 1420 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 13 20:01:53.050534 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c7660f4-0014-4807-9173-9b16c60d19b5 admin admin] Authenticating user token {{(pid=82026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 20:01:53.053322 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.common.fernet_utils [None req-5c7660f4-0014-4807-9173-9b16c60d19b5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82026) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 20:01:53.066398 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c7660f4-0014-4807-9173-9b16c60d19b5 admin admin] Validating token access rules against request {{(pid=82026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 20:01:53.071235 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c1efc1d-fcbb-41ca-9704-f858bf81594d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57539b6a6f3b4d589f5f5e1d211cd6a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b454f707d20347ada3d82aa85495635e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 20:01:53.071943 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c1efc1d-fcbb-41ca-9704-f858bf81594d admin admin] REQUEST_METHOD: `DELETE` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:01:53.072155 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c1efc1d-fcbb-41ca-9704-f858bf81594d admin admin] SCRIPT_NAME: `/identity` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:01:53.072432 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c1efc1d-fcbb-41ca-9704-f858bf81594d admin admin] PATH_INFO: `/v3/projects/0f365c17eaf1412fac434d619c0eac87` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:01:53.073535 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c1efc1d-fcbb-41ca-9704-f858bf81594d admin admin] RBAC: Authorizing `identity:delete_project(project_id=0f365c17eaf1412fac434d619c0eac87)` {{(pid=82026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 20:01:53.075722 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c1efc1d-fcbb-41ca-9704-f858bf81594d admin admin] RBAC: Authorization granted {{(pid=82026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 20:01:53.162444 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.notifications [None req-3afb1f43-5618-4550-a638-47bddc48835c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c724d416282c45f4889ed1dfdc66dc3c'} {{(pid=82025) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 20:01:53.228121 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.notifications [None req-9c1efc1d-fcbb-41ca-9704-f858bf81594d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0f365c17eaf1412fac434d619c0eac87', 'request_id': 'req-9c1efc1d-fcbb-41ca-9704-f858bf81594d'} {{(pid=82026) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 20:01:53.262187 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.notifications [None req-3afb1f43-5618-4550-a638-47bddc48835c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c724d416282c45f4889ed1dfdc66dc3c'} {{(pid=82025) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 20:01:53.263344 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.notifications [None req-3afb1f43-5618-4550-a638-47bddc48835c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c724d416282c45f4889ed1dfdc66dc3c'} {{(pid=82025) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 20:01:53.276370 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.notifications [None req-3afb1f43-5618-4550-a638-47bddc48835c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c724d416282c45f4889ed1dfdc66dc3c'} {{(pid=82025) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 20:01:53.284726 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.notifications [None req-3afb1f43-5618-4550-a638-47bddc48835c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c724d416282c45f4889ed1dfdc66dc3c'} {{(pid=82025) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 20:01:53.291315 dv-cinder-828806-6-smb devstack@keystone.service[82025]: [pid: 82025|app: 0|req: 1158/2264] 10.222.0.33 () {58 vars in 1224 bytes} [Tue Sep 13 20:01:52 2022] DELETE /identity/v3/users/c724d416282c45f4889ed1dfdc66dc3c => generated 0 bytes in 393 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 20:01:53.292215 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3afb1f43-5618-4550-a638-47bddc48835c admin admin] Authenticating user token {{(pid=82025) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 20:01:53.298547 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.fernet_utils [None req-3afb1f43-5618-4550-a638-47bddc48835c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82025) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 20:01:53.347281 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.notifications [None req-9c1efc1d-fcbb-41ca-9704-f858bf81594d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0f365c17eaf1412fac434d619c0eac87', 'request_id': 'req-9c1efc1d-fcbb-41ca-9704-f858bf81594d'} {{(pid=82026) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 20:01:53.353912 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.notifications [None req-9c1efc1d-fcbb-41ca-9704-f858bf81594d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0f365c17eaf1412fac434d619c0eac87', 'request_id': 'req-9c1efc1d-fcbb-41ca-9704-f858bf81594d'} {{(pid=82026) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 20:01:53.361174 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3afb1f43-5618-4550-a638-47bddc48835c admin admin] Validating token access rules against request {{(pid=82025) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 20:01:53.366207 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4685375f-8147-4092-8f5f-863928b0118b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57539b6a6f3b4d589f5f5e1d211cd6a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b454f707d20347ada3d82aa85495635e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82025) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 20:01:53.366881 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.notifications [None req-9c1efc1d-fcbb-41ca-9704-f858bf81594d admin admin] The token cache is being invalidate because project 0f365c17eaf1412fac434d619c0eac87 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82026) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 13 20:01:53.367005 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4685375f-8147-4092-8f5f-863928b0118b admin admin] REQUEST_METHOD: `GET` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:01:53.367214 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.notifications [None req-9c1efc1d-fcbb-41ca-9704-f858bf81594d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82026) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 20:01:53.367311 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4685375f-8147-4092-8f5f-863928b0118b admin admin] SCRIPT_NAME: `/identity` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:01:53.367568 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4685375f-8147-4092-8f5f-863928b0118b admin admin] PATH_INFO: `/v3/roles` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:01:53.367939 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.notifications [None req-9c1efc1d-fcbb-41ca-9704-f858bf81594d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82026) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 20:01:53.368389 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4685375f-8147-4092-8f5f-863928b0118b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 20:01:53.369568 dv-cinder-828806-6-smb devstack@keystone.service[82026]: [pid: 82026|app: 0|req: 1107/2265] 10.222.0.33 () {58 vars in 1233 bytes} [Tue Sep 13 20:01:53 2022] DELETE /identity/v3/projects/0f365c17eaf1412fac434d619c0eac87 => generated 0 bytes in 319 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 20:01:53.370002 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4685375f-8147-4092-8f5f-863928b0118b admin admin] RBAC: Authorization granted {{(pid=82025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 20:01:53.370312 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c1efc1d-fcbb-41ca-9704-f858bf81594d admin admin] Authenticating user token {{(pid=82026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 20:01:53.371761 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.common.fernet_utils [None req-9c1efc1d-fcbb-41ca-9704-f858bf81594d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82026) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 20:01:53.382137 dv-cinder-828806-6-smb devstack@keystone.service[82025]: [pid: 82025|app: 0|req: 1159/2266] 10.222.0.33 () {58 vars in 1122 bytes} [Tue Sep 13 20:01:53 2022] GET /identity/v3/roles => generated 1420 bytes in 89 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 13 20:01:53.382302 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc95c95a-abd1-4bda-a879-209a3eaad458 None None] REQUEST_METHOD: `POST` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:01:53.382563 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc95c95a-abd1-4bda-a879-209a3eaad458 None None] SCRIPT_NAME: `/identity` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:01:53.382852 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc95c95a-abd1-4bda-a879-209a3eaad458 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:01:53.404630 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.auth.core [None req-fc95c95a-abd1-4bda-a879-209a3eaad458 None None] MFA Rules not processed for user `57539b6a6f3b4d589f5f5e1d211cd6a0`. Rule list: `[]` (Enabled: `True`). {{(pid=82025) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 20:01:53.405867 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.fernet_utils [None req-fc95c95a-abd1-4bda-a879-209a3eaad458 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82025) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 20:01:53.413850 dv-cinder-828806-6-smb devstack@keystone.service[82025]: [pid: 82025|app: 0|req: 1160/2267] 10.222.0.33 () {58 vars in 958 bytes} [Tue Sep 13 20:01:53 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 20:01:53.418903 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffd25513-c581-429c-86b2-912b3c09f930 None None] REQUEST_METHOD: `POST` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:01:53.419220 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffd25513-c581-429c-86b2-912b3c09f930 None None] SCRIPT_NAME: `/identity` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:01:53.419727 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffd25513-c581-429c-86b2-912b3c09f930 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:01:53.440394 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.auth.core [None req-ffd25513-c581-429c-86b2-912b3c09f930 None None] MFA Rules not processed for user `57539b6a6f3b4d589f5f5e1d211cd6a0`. Rule list: `[]` (Enabled: `True`). {{(pid=82025) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 20:01:53.441603 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.fernet_utils [None req-ffd25513-c581-429c-86b2-912b3c09f930 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82025) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 20:01:53.446325 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c1efc1d-fcbb-41ca-9704-f858bf81594d admin admin] Validating token access rules against request {{(pid=82026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 20:01:53.450231 dv-cinder-828806-6-smb devstack@keystone.service[82025]: [pid: 82025|app: 0|req: 1161/2268] 10.222.0.33 () {58 vars in 958 bytes} [Tue Sep 13 20:01:53 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 20:01:53.451020 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffd25513-c581-429c-86b2-912b3c09f930 None None] Authenticating user token {{(pid=82025) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 20:01:53.452333 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.fernet_utils [None req-ffd25513-c581-429c-86b2-912b3c09f930 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82025) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 20:01:53.459206 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2f5655a-ba26-4437-96c3-34151e774d90 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57539b6a6f3b4d589f5f5e1d211cd6a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b454f707d20347ada3d82aa85495635e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 20:01:53.459891 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2f5655a-ba26-4437-96c3-34151e774d90 admin admin] REQUEST_METHOD: `PUT` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:01:53.460177 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2f5655a-ba26-4437-96c3-34151e774d90 admin admin] SCRIPT_NAME: `/identity` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:01:53.460455 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2f5655a-ba26-4437-96c3-34151e774d90 admin admin] PATH_INFO: `/v3/projects/91b44b5d6f2c42b48b70bbd1852bc475/users/8ad255b47e1242fe8c21d1a552487a92/roles/3618ab638a65401f82333da7596d1daf` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:01:53.465048 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffd25513-c581-429c-86b2-912b3c09f930 None None] Validating token access rules against request {{(pid=82025) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 20:01:53.470152 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa4d1504-1585-40a2-93ca-bf480ebba827 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57539b6a6f3b4d589f5f5e1d211cd6a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b454f707d20347ada3d82aa85495635e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82025) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 20:01:53.470823 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa4d1504-1585-40a2-93ca-bf480ebba827 admin admin] REQUEST_METHOD: `PUT` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:01:53.471299 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa4d1504-1585-40a2-93ca-bf480ebba827 admin admin] SCRIPT_NAME: `/identity` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:01:53.471585 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa4d1504-1585-40a2-93ca-bf480ebba827 admin admin] PATH_INFO: `/v3/projects/2b45b30a85ea4456a54e5239bbb3eb0a/users/80c6474d00964c6a8e886ae0c5f091d0/roles/3618ab638a65401f82333da7596d1daf` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:01:53.479677 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2f5655a-ba26-4437-96c3-34151e774d90 admin admin] RBAC: Authorizing `identity:create_grant(project_id=91b44b5d6f2c42b48b70bbd1852bc475, user_id=8ad255b47e1242fe8c21d1a552487a92, role_id=3618ab638a65401f82333da7596d1daf)` {{(pid=82026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 20:01:53.483745 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2f5655a-ba26-4437-96c3-34151e774d90 admin admin] RBAC: Authorization granted {{(pid=82026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 20:01:53.489500 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa4d1504-1585-40a2-93ca-bf480ebba827 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2b45b30a85ea4456a54e5239bbb3eb0a, user_id=80c6474d00964c6a8e886ae0c5f091d0, role_id=3618ab638a65401f82333da7596d1daf)` {{(pid=82025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 20:01:53.492387 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa4d1504-1585-40a2-93ca-bf480ebba827 admin admin] RBAC: Authorization granted {{(pid=82025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 20:01:53.543234 dv-cinder-828806-6-smb devstack@keystone.service[82026]: [pid: 82026|app: 0|req: 1108/2269] 10.222.0.33 () {60 vars in 1483 bytes} [Tue Sep 13 20:01:53 2022] PUT /identity/v3/projects/91b44b5d6f2c42b48b70bbd1852bc475/users/8ad255b47e1242fe8c21d1a552487a92/roles/3618ab638a65401f82333da7596d1daf => generated 0 bytes in 173 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 20:01:53.544567 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2f5655a-ba26-4437-96c3-34151e774d90 admin admin] Authenticating user token {{(pid=82026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 20:01:53.554686 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.common.fernet_utils [None req-e2f5655a-ba26-4437-96c3-34151e774d90 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82026) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 20:01:53.555506 dv-cinder-828806-6-smb devstack@keystone.service[82025]: [pid: 82025|app: 0|req: 1162/2270] 10.222.0.33 () {60 vars in 1483 bytes} [Tue Sep 13 20:01:53 2022] PUT /identity/v3/projects/2b45b30a85ea4456a54e5239bbb3eb0a/users/80c6474d00964c6a8e886ae0c5f091d0/roles/3618ab638a65401f82333da7596d1daf => generated 0 bytes in 105 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 20:01:53.557042 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9a3dded-4e6e-4ddf-acad-09a144ac4584 None None] REQUEST_METHOD: `POST` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:01:53.557398 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9a3dded-4e6e-4ddf-acad-09a144ac4584 None None] SCRIPT_NAME: `/identity` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:01:53.558119 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9a3dded-4e6e-4ddf-acad-09a144ac4584 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:01:53.580456 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.auth.core [None req-b9a3dded-4e6e-4ddf-acad-09a144ac4584 None None] MFA Rules not processed for user `57539b6a6f3b4d589f5f5e1d211cd6a0`. Rule list: `[]` (Enabled: `True`). {{(pid=82025) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 20:01:53.582496 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.fernet_utils [None req-b9a3dded-4e6e-4ddf-acad-09a144ac4584 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82025) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 20:01:53.623748 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2f5655a-ba26-4437-96c3-34151e774d90 admin admin] Validating token access rules against request {{(pid=82026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 20:01:53.646663 dv-cinder-828806-6-smb devstack@keystone.service[82025]: [pid: 82025|app: 0|req: 1163/2271] 10.222.0.33 () {58 vars in 958 bytes} [Tue Sep 13 20:01:53 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 20:01:53.651376 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58a9b4ca-9038-43ce-82a7-e0d28dd359ec None None] REQUEST_METHOD: `POST` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:01:53.651673 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58a9b4ca-9038-43ce-82a7-e0d28dd359ec None None] SCRIPT_NAME: `/identity` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:01:53.652543 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58a9b4ca-9038-43ce-82a7-e0d28dd359ec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:01:53.673624 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cef31dd6-7404-4487-b1d2-d18c04dcffd1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '023a2c79c2444611b3d431928e56685d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8c6fba0f15b4d6a84ff601919b7b8e4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 20:01:53.674444 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cef31dd6-7404-4487-b1d2-d18c04dcffd1 service neutron] REQUEST_METHOD: `GET` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:01:53.684235 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cef31dd6-7404-4487-b1d2-d18c04dcffd1 service neutron] SCRIPT_NAME: `/identity` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:01:53.684235 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cef31dd6-7404-4487-b1d2-d18c04dcffd1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:01:53.684448 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.auth.core [None req-58a9b4ca-9038-43ce-82a7-e0d28dd359ec None None] MFA Rules not processed for user `8ad255b47e1242fe8c21d1a552487a92`. Rule list: `[]` (Enabled: `True`). {{(pid=82025) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 20:01:53.684448 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.fernet_utils [None req-58a9b4ca-9038-43ce-82a7-e0d28dd359ec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82025) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 20:01:53.684637 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cef31dd6-7404-4487-b1d2-d18c04dcffd1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 20:01:53.686083 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cef31dd6-7404-4487-b1d2-d18c04dcffd1 service neutron] RBAC: Authorization granted {{(pid=82026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 20:01:53.696402 dv-cinder-828806-6-smb devstack@keystone.service[82026]: [pid: 82026|app: 0|req: 1109/2272] 10.222.0.33 () {60 vars in 1365 bytes} [Tue Sep 13 20:01:53 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 152 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 20:01:53.697714 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0054528c-3bed-474b-972d-34a8719198ec None None] REQUEST_METHOD: `POST` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:01:53.697954 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0054528c-3bed-474b-972d-34a8719198ec None None] SCRIPT_NAME: `/identity` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:01:53.698238 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0054528c-3bed-474b-972d-34a8719198ec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:01:53.709585 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG dbcounter [-] [82025] Writing DB stats keystone:SELECT=100 {{(pid=82025) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 20:01:53.734321 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.auth.core [None req-0054528c-3bed-474b-972d-34a8719198ec None None] MFA Rules not processed for user `80c6474d00964c6a8e886ae0c5f091d0`. Rule list: `[]` (Enabled: `True`). {{(pid=82026) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 20:01:53.736328 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.common.fernet_utils [None req-0054528c-3bed-474b-972d-34a8719198ec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82026) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 20:01:53.764912 dv-cinder-828806-6-smb devstack@keystone.service[82025]: [pid: 82025|app: 0|req: 1164/2273] 10.222.0.33 () {58 vars in 958 bytes} [Tue Sep 13 20:01:53 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 20:01:53.766444 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58a9b4ca-9038-43ce-82a7-e0d28dd359ec None None] Authenticating user token {{(pid=82025) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 20:01:53.780553 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58a9b4ca-9038-43ce-82a7-e0d28dd359ec None None] Validating token access rules against request {{(pid=82025) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 20:01:53.785332 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e0674c6-d8af-4ee0-86d7-358dfea54092 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57539b6a6f3b4d589f5f5e1d211cd6a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b454f707d20347ada3d82aa85495635e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82025) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 20:01:53.786028 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e0674c6-d8af-4ee0-86d7-358dfea54092 admin admin] REQUEST_METHOD: `GET` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:01:53.786218 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e0674c6-d8af-4ee0-86d7-358dfea54092 admin admin] SCRIPT_NAME: `/identity` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:01:53.787151 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e0674c6-d8af-4ee0-86d7-358dfea54092 admin admin] PATH_INFO: `/v3/domains` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:01:53.788132 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e0674c6-d8af-4ee0-86d7-358dfea54092 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82025) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 20:01:53.788652 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e0674c6-d8af-4ee0-86d7-358dfea54092 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 20:01:53.791483 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e0674c6-d8af-4ee0-86d7-358dfea54092 admin admin] RBAC: Authorization granted {{(pid=82025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 20:01:53.811196 dv-cinder-828806-6-smb devstack@keystone.service[82025]: [pid: 82025|app: 0|req: 1165/2274] 10.222.0.33 () {58 vars in 1153 bytes} [Tue Sep 13 20:01:53 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 20:01:53.811196 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e0674c6-d8af-4ee0-86d7-358dfea54092 admin admin] Authenticating user token {{(pid=82025) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 20:01:53.829615 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e0674c6-d8af-4ee0-86d7-358dfea54092 admin admin] Validating token access rules against request {{(pid=82025) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 20:01:53.834556 dv-cinder-828806-6-smb devstack@keystone.service[82026]: [pid: 82026|app: 0|req: 1110/2275] 10.222.0.33 () {58 vars in 958 bytes} [Tue Sep 13 20:01:53 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 137 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 20:01:53.836597 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a07de4f7-6f96-4c64-876f-f8bbd3ef78d1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57539b6a6f3b4d589f5f5e1d211cd6a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b454f707d20347ada3d82aa85495635e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82025) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 20:01:53.837419 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a07de4f7-6f96-4c64-876f-f8bbd3ef78d1 admin admin] REQUEST_METHOD: `POST` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:01:53.837730 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a07de4f7-6f96-4c64-876f-f8bbd3ef78d1 admin admin] SCRIPT_NAME: `/identity` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:01:53.837993 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a07de4f7-6f96-4c64-876f-f8bbd3ef78d1 admin admin] PATH_INFO: `/v3/projects` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:01:53.841383 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0054528c-3bed-474b-972d-34a8719198ec None None] Authenticating user token {{(pid=82026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 20:01:53.841483 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a07de4f7-6f96-4c64-876f-f8bbd3ef78d1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 20:01:53.848755 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a07de4f7-6f96-4c64-876f-f8bbd3ef78d1 admin admin] RBAC: Authorization granted {{(pid=82025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 20:01:53.856510 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0054528c-3bed-474b-972d-34a8719198ec None None] Validating token access rules against request {{(pid=82026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 20:01:53.865624 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b8797f2-66b7-4718-a137-af32aba0ee72 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57539b6a6f3b4d589f5f5e1d211cd6a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b454f707d20347ada3d82aa85495635e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 20:01:53.866246 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b8797f2-66b7-4718-a137-af32aba0ee72 admin admin] REQUEST_METHOD: `POST` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:01:53.866533 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b8797f2-66b7-4718-a137-af32aba0ee72 admin admin] SCRIPT_NAME: `/identity` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:01:53.866812 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b8797f2-66b7-4718-a137-af32aba0ee72 admin admin] PATH_INFO: `/v3/projects` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:01:53.867818 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b8797f2-66b7-4718-a137-af32aba0ee72 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 20:01:53.870178 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b8797f2-66b7-4718-a137-af32aba0ee72 admin admin] RBAC: Authorization granted {{(pid=82026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 20:01:53.990707 dv-cinder-828806-6-smb devstack@keystone.service[82025]: [pid: 82025|app: 0|req: 1166/2276] 10.222.0.33 () {60 vars in 1153 bytes} [Tue Sep 13 20:01:53 2022] POST /identity/v3/projects => generated 383 bytes in 182 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 13 20:01:53.995063 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a07de4f7-6f96-4c64-876f-f8bbd3ef78d1 admin admin] Authenticating user token {{(pid=82025) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 20:01:53.999369 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.fernet_utils [None req-a07de4f7-6f96-4c64-876f-f8bbd3ef78d1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82025) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 20:01:54.001043 dv-cinder-828806-6-smb devstack@keystone.service[82026]: [pid: 82026|app: 0|req: 1111/2277] 10.222.0.33 () {60 vars in 1153 bytes} [Tue Sep 13 20:01:53 2022] POST /identity/v3/projects => generated 383 bytes in 166 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 13 20:01:54.002128 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b8797f2-66b7-4718-a137-af32aba0ee72 admin admin] Authenticating user token {{(pid=82026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 20:01:54.102629 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a07de4f7-6f96-4c64-876f-f8bbd3ef78d1 admin admin] Validating token access rules against request {{(pid=82025) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 20:01:54.105733 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG dbcounter [-] [82025] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=82025) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 20:01:54.156762 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b8797f2-66b7-4718-a137-af32aba0ee72 admin admin] Validating token access rules against request {{(pid=82026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 20:01:54.170096 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d293ce2d-959a-487b-a042-8cd1e598377f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57539b6a6f3b4d589f5f5e1d211cd6a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b454f707d20347ada3d82aa85495635e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 20:01:54.171135 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d293ce2d-959a-487b-a042-8cd1e598377f admin admin] REQUEST_METHOD: `POST` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:01:54.171249 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d293ce2d-959a-487b-a042-8cd1e598377f admin admin] SCRIPT_NAME: `/identity` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:01:54.171609 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d293ce2d-959a-487b-a042-8cd1e598377f admin admin] PATH_INFO: `/v3/users` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:01:54.172338 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d293ce2d-959a-487b-a042-8cd1e598377f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 20:01:54.174408 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d293ce2d-959a-487b-a042-8cd1e598377f admin admin] RBAC: Authorization granted {{(pid=82026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 20:01:54.182410 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8890279-3adb-483e-9bf5-699d64fb1ade service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f7b2421bf1f84193a29f79709d1d5a19', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8c6fba0f15b4d6a84ff601919b7b8e4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82025) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 20:01:54.182932 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8890279-3adb-483e-9bf5-699d64fb1ade service glance] REQUEST_METHOD: `GET` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:01:54.183387 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8890279-3adb-483e-9bf5-699d64fb1ade service glance] SCRIPT_NAME: `/identity` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:01:54.183997 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8890279-3adb-483e-9bf5-699d64fb1ade service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:01:54.258147 dv-cinder-828806-6-smb devstack@keystone.service[82026]: [pid: 82026|app: 0|req: 1112/2278] 10.222.0.33 () {60 vars in 1144 bytes} [Tue Sep 13 20:01:54 2022] POST /identity/v3/users => generated 292 bytes in 256 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 13 20:01:54.263451 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d293ce2d-959a-487b-a042-8cd1e598377f admin admin] Authenticating user token {{(pid=82026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 20:01:54.304382 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d293ce2d-959a-487b-a042-8cd1e598377f admin admin] Validating token access rules against request {{(pid=82026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 20:01:54.304382 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfd8fcff-bdc1-4cf5-b586-74e430f0ab17 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57539b6a6f3b4d589f5f5e1d211cd6a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b454f707d20347ada3d82aa85495635e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 20:01:54.304382 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfd8fcff-bdc1-4cf5-b586-74e430f0ab17 admin admin] REQUEST_METHOD: `POST` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:01:54.304382 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfd8fcff-bdc1-4cf5-b586-74e430f0ab17 admin admin] SCRIPT_NAME: `/identity` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:01:54.305147 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfd8fcff-bdc1-4cf5-b586-74e430f0ab17 admin admin] PATH_INFO: `/v3/users` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:01:54.305147 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfd8fcff-bdc1-4cf5-b586-74e430f0ab17 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 20:01:54.305147 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfd8fcff-bdc1-4cf5-b586-74e430f0ab17 admin admin] RBAC: Authorization granted {{(pid=82026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 20:01:54.305348 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8890279-3adb-483e-9bf5-699d64fb1ade service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=82025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 20:01:54.305348 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8890279-3adb-483e-9bf5-699d64fb1ade service glance] RBAC: Authorization granted {{(pid=82025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 20:01:54.311615 dv-cinder-828806-6-smb devstack@keystone.service[82025]: [pid: 82025|app: 0|req: 1167/2279] 10.222.0.33 () {60 vars in 1365 bytes} [Tue Sep 13 20:01:53 2022] GET /identity/v3/auth/tokens => generated 3246 bytes in 317 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 20:01:54.312514 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8890279-3adb-483e-9bf5-699d64fb1ade service glance] Authenticating user token {{(pid=82025) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 20:01:54.314659 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.fernet_utils [None req-e8890279-3adb-483e-9bf5-699d64fb1ade service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82025) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 20:01:54.328145 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8890279-3adb-483e-9bf5-699d64fb1ade service glance] Validating token access rules against request {{(pid=82025) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 20:01:54.332283 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG dbcounter [-] [82026] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=82026) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 20:01:54.335052 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ff01b50-abcd-45f1-b6b2-b7208b9d978f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57539b6a6f3b4d589f5f5e1d211cd6a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b454f707d20347ada3d82aa85495635e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82025) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 20:01:54.335721 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ff01b50-abcd-45f1-b6b2-b7208b9d978f admin admin] REQUEST_METHOD: `DELETE` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:01:54.336033 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ff01b50-abcd-45f1-b6b2-b7208b9d978f admin admin] SCRIPT_NAME: `/identity` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:01:54.336366 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ff01b50-abcd-45f1-b6b2-b7208b9d978f admin admin] PATH_INFO: `/v3/projects/5b85537b405549698df2cd715578978c` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:01:54.337635 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ff01b50-abcd-45f1-b6b2-b7208b9d978f admin admin] RBAC: Authorizing `identity:delete_project(project_id=5b85537b405549698df2cd715578978c)` {{(pid=82025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 20:01:54.340234 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ff01b50-abcd-45f1-b6b2-b7208b9d978f admin admin] RBAC: Authorization granted {{(pid=82025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 20:01:54.365917 dv-cinder-828806-6-smb devstack@keystone.service[82026]: [pid: 82026|app: 0|req: 1113/2280] 10.222.0.33 () {60 vars in 1144 bytes} [Tue Sep 13 20:01:54 2022] POST /identity/v3/users => generated 292 bytes in 103 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 13 20:01:54.366763 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfd8fcff-bdc1-4cf5-b586-74e430f0ab17 admin admin] Authenticating user token {{(pid=82026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 20:01:54.377802 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfd8fcff-bdc1-4cf5-b586-74e430f0ab17 admin admin] Validating token access rules against request {{(pid=82026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 20:01:54.383102 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2bac797-40bc-4e1f-8287-6cbbbea808bd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57539b6a6f3b4d589f5f5e1d211cd6a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b454f707d20347ada3d82aa85495635e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 20:01:54.383773 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2bac797-40bc-4e1f-8287-6cbbbea808bd admin admin] REQUEST_METHOD: `GET` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:01:54.384059 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2bac797-40bc-4e1f-8287-6cbbbea808bd admin admin] SCRIPT_NAME: `/identity` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:01:54.384338 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2bac797-40bc-4e1f-8287-6cbbbea808bd admin admin] PATH_INFO: `/v3/roles` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:01:54.387885 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2bac797-40bc-4e1f-8287-6cbbbea808bd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 20:01:54.389567 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2bac797-40bc-4e1f-8287-6cbbbea808bd admin admin] RBAC: Authorization granted {{(pid=82026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 20:01:54.401062 dv-cinder-828806-6-smb devstack@keystone.service[82026]: [pid: 82026|app: 0|req: 1114/2281] 10.222.0.33 () {58 vars in 1122 bytes} [Tue Sep 13 20:01:54 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 13 20:01:54.401819 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2bac797-40bc-4e1f-8287-6cbbbea808bd admin admin] Authenticating user token {{(pid=82026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 20:01:54.412899 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2bac797-40bc-4e1f-8287-6cbbbea808bd admin admin] Validating token access rules against request {{(pid=82026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 20:01:54.418571 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07b1202d-cdd9-4be0-ad41-1087da803cd2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57539b6a6f3b4d589f5f5e1d211cd6a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b454f707d20347ada3d82aa85495635e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 20:01:54.419417 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07b1202d-cdd9-4be0-ad41-1087da803cd2 admin admin] REQUEST_METHOD: `GET` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:01:54.419708 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07b1202d-cdd9-4be0-ad41-1087da803cd2 admin admin] SCRIPT_NAME: `/identity` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:01:54.419993 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07b1202d-cdd9-4be0-ad41-1087da803cd2 admin admin] PATH_INFO: `/v3/roles` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:01:54.420798 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07b1202d-cdd9-4be0-ad41-1087da803cd2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 20:01:54.422463 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07b1202d-cdd9-4be0-ad41-1087da803cd2 admin admin] RBAC: Authorization granted {{(pid=82026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 20:01:54.433587 dv-cinder-828806-6-smb devstack@keystone.service[82026]: [pid: 82026|app: 0|req: 1115/2282] 10.222.0.33 () {58 vars in 1122 bytes} [Tue Sep 13 20:01:54 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 13 20:01:54.434724 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07b1202d-cdd9-4be0-ad41-1087da803cd2 admin admin] Authenticating user token {{(pid=82026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 20:01:54.446855 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07b1202d-cdd9-4be0-ad41-1087da803cd2 admin admin] Validating token access rules against request {{(pid=82026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 20:01:54.453011 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dfda219-81a0-4239-b114-449c75e55c68 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57539b6a6f3b4d589f5f5e1d211cd6a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b454f707d20347ada3d82aa85495635e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 20:01:54.453605 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dfda219-81a0-4239-b114-449c75e55c68 admin admin] REQUEST_METHOD: `GET` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:01:54.453939 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dfda219-81a0-4239-b114-449c75e55c68 admin admin] SCRIPT_NAME: `/identity` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:01:54.455343 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dfda219-81a0-4239-b114-449c75e55c68 admin admin] PATH_INFO: `/v3/roles` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:01:54.455343 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dfda219-81a0-4239-b114-449c75e55c68 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 20:01:54.456882 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dfda219-81a0-4239-b114-449c75e55c68 admin admin] RBAC: Authorization granted {{(pid=82026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 20:01:54.473982 dv-cinder-828806-6-smb devstack@keystone.service[82026]: [pid: 82026|app: 0|req: 1116/2283] 10.222.0.33 () {58 vars in 1122 bytes} [Tue Sep 13 20:01:54 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 13 20:01:54.475177 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dfda219-81a0-4239-b114-449c75e55c68 admin admin] Authenticating user token {{(pid=82026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 20:01:54.492547 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dfda219-81a0-4239-b114-449c75e55c68 admin admin] Validating token access rules against request {{(pid=82026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 20:01:54.497854 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.notifications [None req-3ff01b50-abcd-45f1-b6b2-b7208b9d978f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5b85537b405549698df2cd715578978c', 'request_id': 'req-3ff01b50-abcd-45f1-b6b2-b7208b9d978f'} {{(pid=82025) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 20:01:54.503997 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.notifications [None req-3ff01b50-abcd-45f1-b6b2-b7208b9d978f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5b85537b405549698df2cd715578978c', 'request_id': 'req-3ff01b50-abcd-45f1-b6b2-b7208b9d978f'} {{(pid=82025) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 20:01:54.511124 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.notifications [None req-3ff01b50-abcd-45f1-b6b2-b7208b9d978f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5b85537b405549698df2cd715578978c', 'request_id': 'req-3ff01b50-abcd-45f1-b6b2-b7208b9d978f'} {{(pid=82025) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 20:01:54.570171 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7a02494-2cb5-440e-92a8-05c1c84f4d8c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57539b6a6f3b4d589f5f5e1d211cd6a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b454f707d20347ada3d82aa85495635e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 20:01:54.570806 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7a02494-2cb5-440e-92a8-05c1c84f4d8c admin admin] REQUEST_METHOD: `GET` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:01:54.571107 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7a02494-2cb5-440e-92a8-05c1c84f4d8c admin admin] SCRIPT_NAME: `/identity` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:01:54.571386 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7a02494-2cb5-440e-92a8-05c1c84f4d8c admin admin] PATH_INFO: `/v3/roles` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:01:54.572095 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7a02494-2cb5-440e-92a8-05c1c84f4d8c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 20:01:54.573628 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7a02494-2cb5-440e-92a8-05c1c84f4d8c admin admin] RBAC: Authorization granted {{(pid=82026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 20:01:54.587096 dv-cinder-828806-6-smb devstack@keystone.service[82026]: [pid: 82026|app: 0|req: 1117/2284] 10.222.0.33 () {58 vars in 1122 bytes} [Tue Sep 13 20:01:54 2022] GET /identity/v3/roles => generated 1420 bytes in 112 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 13 20:01:54.592344 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7a02494-2cb5-440e-92a8-05c1c84f4d8c admin admin] Authenticating user token {{(pid=82026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 20:01:54.596556 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.notifications [None req-3ff01b50-abcd-45f1-b6b2-b7208b9d978f admin admin] The token cache is being invalidate because project 5b85537b405549698df2cd715578978c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82025) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 13 20:01:54.597135 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.notifications [None req-3ff01b50-abcd-45f1-b6b2-b7208b9d978f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82025) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 20:01:54.599896 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.notifications [None req-3ff01b50-abcd-45f1-b6b2-b7208b9d978f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82025) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 20:01:54.603190 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7a02494-2cb5-440e-92a8-05c1c84f4d8c admin admin] Validating token access rules against request {{(pid=82026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 20:01:54.610631 dv-cinder-828806-6-smb devstack@keystone.service[82025]: [pid: 82025|app: 0|req: 1168/2285] 10.222.0.33 () {58 vars in 1233 bytes} [Tue Sep 13 20:01:54 2022] DELETE /identity/v3/projects/5b85537b405549698df2cd715578978c => generated 0 bytes in 295 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 20:01:54.610631 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ff01b50-abcd-45f1-b6b2-b7208b9d978f admin admin] Authenticating user token {{(pid=82025) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 20:01:54.611494 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.fernet_utils [None req-3ff01b50-abcd-45f1-b6b2-b7208b9d978f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82025) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 20:01:54.613078 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a23b947-67a4-4982-bd84-df097be10674 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57539b6a6f3b4d589f5f5e1d211cd6a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b454f707d20347ada3d82aa85495635e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 20:01:54.613665 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a23b947-67a4-4982-bd84-df097be10674 admin admin] REQUEST_METHOD: `PUT` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:01:54.613951 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a23b947-67a4-4982-bd84-df097be10674 admin admin] SCRIPT_NAME: `/identity` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:01:54.614912 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a23b947-67a4-4982-bd84-df097be10674 admin admin] PATH_INFO: `/v3/projects/bcb403ec029841078a350dccadde86ca/users/09032e49f9884e9ba4aeb26d1d9ffd5a/roles/3618ab638a65401f82333da7596d1daf` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:01:54.637104 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a23b947-67a4-4982-bd84-df097be10674 admin admin] RBAC: Authorizing `identity:create_grant(project_id=bcb403ec029841078a350dccadde86ca, user_id=09032e49f9884e9ba4aeb26d1d9ffd5a, role_id=3618ab638a65401f82333da7596d1daf)` {{(pid=82026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 20:01:54.639150 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a23b947-67a4-4982-bd84-df097be10674 admin admin] RBAC: Authorization granted {{(pid=82026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 20:01:54.645515 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ff01b50-abcd-45f1-b6b2-b7208b9d978f admin admin] Validating token access rules against request {{(pid=82025) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 20:01:54.650348 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a3f8546-a44a-4a72-909c-1b643f133df9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57539b6a6f3b4d589f5f5e1d211cd6a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b454f707d20347ada3d82aa85495635e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82025) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 20:01:54.651020 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a3f8546-a44a-4a72-909c-1b643f133df9 admin admin] REQUEST_METHOD: `PUT` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:01:54.651338 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a3f8546-a44a-4a72-909c-1b643f133df9 admin admin] SCRIPT_NAME: `/identity` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:01:54.651616 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a3f8546-a44a-4a72-909c-1b643f133df9 admin admin] PATH_INFO: `/v3/projects/e91595e4ccb64d1daa810bfa8015cc95/users/fd0c42df4806461a87cddbd3df54312a/roles/3618ab638a65401f82333da7596d1daf` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:01:54.668587 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a3f8546-a44a-4a72-909c-1b643f133df9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e91595e4ccb64d1daa810bfa8015cc95, user_id=fd0c42df4806461a87cddbd3df54312a, role_id=3618ab638a65401f82333da7596d1daf)` {{(pid=82025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 20:01:54.671245 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a3f8546-a44a-4a72-909c-1b643f133df9 admin admin] RBAC: Authorization granted {{(pid=82025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 20:01:54.743385 dv-cinder-828806-6-smb devstack@keystone.service[82025]: [pid: 82025|app: 0|req: 1169/2286] 10.222.0.33 () {60 vars in 1483 bytes} [Tue Sep 13 20:01:54 2022] PUT /identity/v3/projects/e91595e4ccb64d1daa810bfa8015cc95/users/fd0c42df4806461a87cddbd3df54312a/roles/3618ab638a65401f82333da7596d1daf => generated 0 bytes in 135 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 20:01:54.744780 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d11598c-78a2-4451-9fd2-a1d7d92d924f None None] REQUEST_METHOD: `POST` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:01:54.745015 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d11598c-78a2-4451-9fd2-a1d7d92d924f None None] SCRIPT_NAME: `/identity` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:01:54.745298 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d11598c-78a2-4451-9fd2-a1d7d92d924f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:01:54.752497 dv-cinder-828806-6-smb devstack@keystone.service[82026]: [pid: 82026|app: 0|req: 1118/2287] 10.222.0.33 () {60 vars in 1483 bytes} [Tue Sep 13 20:01:54 2022] PUT /identity/v3/projects/bcb403ec029841078a350dccadde86ca/users/09032e49f9884e9ba4aeb26d1d9ffd5a/roles/3618ab638a65401f82333da7596d1daf => generated 0 bytes in 161 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 20:01:54.754045 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-344f7f22-932b-4109-bd14-d900281d3bba None None] REQUEST_METHOD: `POST` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:01:54.754401 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-344f7f22-932b-4109-bd14-d900281d3bba None None] SCRIPT_NAME: `/identity` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:01:54.754752 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-344f7f22-932b-4109-bd14-d900281d3bba None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:01:54.766738 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.auth.core [None req-6d11598c-78a2-4451-9fd2-a1d7d92d924f None None] MFA Rules not processed for user `57539b6a6f3b4d589f5f5e1d211cd6a0`. Rule list: `[]` (Enabled: `True`). {{(pid=82025) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 20:01:54.768121 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.fernet_utils [None req-6d11598c-78a2-4451-9fd2-a1d7d92d924f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82025) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 20:01:54.785012 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.auth.core [None req-344f7f22-932b-4109-bd14-d900281d3bba None None] MFA Rules not processed for user `fd0c42df4806461a87cddbd3df54312a`. Rule list: `[]` (Enabled: `True`). {{(pid=82026) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 20:01:54.786231 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.common.fernet_utils [None req-344f7f22-932b-4109-bd14-d900281d3bba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82026) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 20:01:54.834416 dv-cinder-828806-6-smb devstack@keystone.service[82025]: [pid: 82025|app: 0|req: 1170/2288] 10.222.0.33 () {58 vars in 958 bytes} [Tue Sep 13 20:01:54 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 20:01:54.836030 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a67406fd-2eb0-4bb8-88e1-4eec8b3b3051 None None] REQUEST_METHOD: `POST` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:01:54.836479 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a67406fd-2eb0-4bb8-88e1-4eec8b3b3051 None None] SCRIPT_NAME: `/identity` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:01:54.836869 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a67406fd-2eb0-4bb8-88e1-4eec8b3b3051 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:01:54.861199 dv-cinder-828806-6-smb devstack@keystone.service[82026]: [pid: 82026|app: 0|req: 1119/2289] 10.222.0.33 () {58 vars in 958 bytes} [Tue Sep 13 20:01:54 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 20:01:54.862604 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09557e33-1be8-4f89-b188-deaa506877ed None None] REQUEST_METHOD: `POST` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:01:54.863016 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09557e33-1be8-4f89-b188-deaa506877ed None None] SCRIPT_NAME: `/identity` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:01:54.863433 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09557e33-1be8-4f89-b188-deaa506877ed None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:01:54.867951 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.auth.core [None req-a67406fd-2eb0-4bb8-88e1-4eec8b3b3051 None None] MFA Rules not processed for user `09032e49f9884e9ba4aeb26d1d9ffd5a`. Rule list: `[]` (Enabled: `True`). {{(pid=82025) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 20:01:54.869154 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.fernet_utils [None req-a67406fd-2eb0-4bb8-88e1-4eec8b3b3051 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82025) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 20:01:54.886150 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.auth.core [None req-09557e33-1be8-4f89-b188-deaa506877ed None None] MFA Rules not processed for user `57539b6a6f3b4d589f5f5e1d211cd6a0`. Rule list: `[]` (Enabled: `True`). {{(pid=82026) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 20:01:54.888035 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.common.fernet_utils [None req-09557e33-1be8-4f89-b188-deaa506877ed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82026) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 20:01:54.897044 dv-cinder-828806-6-smb devstack@keystone.service[82026]: [pid: 82026|app: 0|req: 1120/2290] 10.222.0.33 () {58 vars in 958 bytes} [Tue Sep 13 20:01:54 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 20:01:54.897821 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09557e33-1be8-4f89-b188-deaa506877ed None None] Authenticating user token {{(pid=82026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 20:01:54.908238 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09557e33-1be8-4f89-b188-deaa506877ed None None] Validating token access rules against request {{(pid=82026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 20:01:54.913050 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d4876c8-f981-4acc-9e01-c94cdc07fc80 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57539b6a6f3b4d589f5f5e1d211cd6a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b454f707d20347ada3d82aa85495635e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 20:01:54.913653 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d4876c8-f981-4acc-9e01-c94cdc07fc80 admin admin] REQUEST_METHOD: `POST` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:01:54.913943 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d4876c8-f981-4acc-9e01-c94cdc07fc80 admin admin] SCRIPT_NAME: `/identity` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:01:54.914224 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d4876c8-f981-4acc-9e01-c94cdc07fc80 admin admin] PATH_INFO: `/v3/projects` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:01:54.914871 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d4876c8-f981-4acc-9e01-c94cdc07fc80 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 20:01:54.916816 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d4876c8-f981-4acc-9e01-c94cdc07fc80 admin admin] RBAC: Authorization granted {{(pid=82026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 20:01:54.938772 dv-cinder-828806-6-smb devstack@keystone.service[82025]: [pid: 82025|app: 0|req: 1171/2291] 10.222.0.33 () {58 vars in 958 bytes} [Tue Sep 13 20:01:54 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 20:01:54.939769 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a67406fd-2eb0-4bb8-88e1-4eec8b3b3051 None None] Authenticating user token {{(pid=82025) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 20:01:54.952046 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a67406fd-2eb0-4bb8-88e1-4eec8b3b3051 None None] Validating token access rules against request {{(pid=82025) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 20:01:54.957194 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-268e4ad1-165b-4cae-9d2b-feec768d9205 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57539b6a6f3b4d589f5f5e1d211cd6a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b454f707d20347ada3d82aa85495635e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82025) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 20:01:54.957835 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-268e4ad1-165b-4cae-9d2b-feec768d9205 admin admin] REQUEST_METHOD: `GET` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:01:54.958116 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-268e4ad1-165b-4cae-9d2b-feec768d9205 admin admin] SCRIPT_NAME: `/identity` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:01:54.958390 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-268e4ad1-165b-4cae-9d2b-feec768d9205 admin admin] PATH_INFO: `/v3/domains` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:01:54.959061 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-268e4ad1-165b-4cae-9d2b-feec768d9205 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82025) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 20:01:54.959376 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-268e4ad1-165b-4cae-9d2b-feec768d9205 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 20:01:54.961001 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-268e4ad1-165b-4cae-9d2b-feec768d9205 admin admin] RBAC: Authorization granted {{(pid=82025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 20:01:54.972990 dv-cinder-828806-6-smb devstack@keystone.service[82025]: [pid: 82025|app: 0|req: 1172/2292] 10.222.0.33 () {58 vars in 1153 bytes} [Tue Sep 13 20:01:54 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 20:01:54.973790 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-268e4ad1-165b-4cae-9d2b-feec768d9205 admin admin] Authenticating user token {{(pid=82025) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 20:01:54.975492 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.fernet_utils [None req-268e4ad1-165b-4cae-9d2b-feec768d9205 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82025) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 20:01:54.988658 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-268e4ad1-165b-4cae-9d2b-feec768d9205 admin admin] Validating token access rules against request {{(pid=82025) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 20:01:54.993434 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24f00252-e037-43e9-a7a4-e35e817eeb98 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57539b6a6f3b4d589f5f5e1d211cd6a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b454f707d20347ada3d82aa85495635e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82025) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 20:01:54.994072 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24f00252-e037-43e9-a7a4-e35e817eeb98 admin admin] REQUEST_METHOD: `POST` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:01:54.994341 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24f00252-e037-43e9-a7a4-e35e817eeb98 admin admin] SCRIPT_NAME: `/identity` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:01:54.994621 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24f00252-e037-43e9-a7a4-e35e817eeb98 admin admin] PATH_INFO: `/v3/projects` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:01:54.995288 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24f00252-e037-43e9-a7a4-e35e817eeb98 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 20:01:54.997446 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24f00252-e037-43e9-a7a4-e35e817eeb98 admin admin] RBAC: Authorization granted {{(pid=82025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 20:01:55.023367 dv-cinder-828806-6-smb devstack@keystone.service[82026]: [pid: 82026|app: 0|req: 1121/2293] 10.222.0.33 () {60 vars in 1153 bytes} [Tue Sep 13 20:01:54 2022] POST /identity/v3/projects => generated 385 bytes in 126 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 13 20:01:55.024092 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d4876c8-f981-4acc-9e01-c94cdc07fc80 admin admin] Authenticating user token {{(pid=82026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 20:01:55.087427 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d4876c8-f981-4acc-9e01-c94cdc07fc80 admin admin] Validating token access rules against request {{(pid=82026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 20:01:55.093071 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-710e34a0-08e8-4ff1-bb6c-bd466a3ddd4f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57539b6a6f3b4d589f5f5e1d211cd6a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b454f707d20347ada3d82aa85495635e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 20:01:55.093716 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-710e34a0-08e8-4ff1-bb6c-bd466a3ddd4f admin admin] REQUEST_METHOD: `POST` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:01:55.094001 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-710e34a0-08e8-4ff1-bb6c-bd466a3ddd4f admin admin] SCRIPT_NAME: `/identity` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:01:55.094278 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-710e34a0-08e8-4ff1-bb6c-bd466a3ddd4f admin admin] PATH_INFO: `/v3/projects` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:01:55.094911 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-710e34a0-08e8-4ff1-bb6c-bd466a3ddd4f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 20:01:55.096875 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-710e34a0-08e8-4ff1-bb6c-bd466a3ddd4f admin admin] RBAC: Authorization granted {{(pid=82026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 20:01:55.098976 dv-cinder-828806-6-smb devstack@keystone.service[82025]: [pid: 82025|app: 0|req: 1173/2294] 10.222.0.33 () {60 vars in 1153 bytes} [Tue Sep 13 20:01:54 2022] POST /identity/v3/projects => generated 383 bytes in 125 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 13 20:01:55.099734 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24f00252-e037-43e9-a7a4-e35e817eeb98 admin admin] Authenticating user token {{(pid=82025) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 20:01:55.174022 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24f00252-e037-43e9-a7a4-e35e817eeb98 admin admin] Validating token access rules against request {{(pid=82025) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 20:01:55.179619 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b3e6a01-afe2-451b-851f-8ae0d7dfdcc4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57539b6a6f3b4d589f5f5e1d211cd6a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b454f707d20347ada3d82aa85495635e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82025) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 20:01:55.180575 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b3e6a01-afe2-451b-851f-8ae0d7dfdcc4 admin admin] REQUEST_METHOD: `POST` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:01:55.181006 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b3e6a01-afe2-451b-851f-8ae0d7dfdcc4 admin admin] SCRIPT_NAME: `/identity` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:01:55.181438 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b3e6a01-afe2-451b-851f-8ae0d7dfdcc4 admin admin] PATH_INFO: `/v3/users` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:01:55.182076 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b3e6a01-afe2-451b-851f-8ae0d7dfdcc4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 20:01:55.184828 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b3e6a01-afe2-451b-851f-8ae0d7dfdcc4 admin admin] RBAC: Authorization granted {{(pid=82025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 20:01:55.222808 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG dbcounter [-] [82025] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=82025) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 20:01:55.234360 dv-cinder-828806-6-smb devstack@keystone.service[82026]: [pid: 82026|app: 0|req: 1122/2295] 10.222.0.33 () {60 vars in 1153 bytes} [Tue Sep 13 20:01:55 2022] POST /identity/v3/projects => generated 385 bytes in 210 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 13 20:01:55.235286 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-710e34a0-08e8-4ff1-bb6c-bd466a3ddd4f admin admin] Authenticating user token {{(pid=82026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 20:01:55.301209 dv-cinder-828806-6-smb devstack@keystone.service[82025]: [pid: 82025|app: 0|req: 1174/2296] 10.222.0.33 () {60 vars in 1144 bytes} [Tue Sep 13 20:01:55 2022] POST /identity/v3/users => generated 293 bytes in 202 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 13 20:01:55.302190 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b3e6a01-afe2-451b-851f-8ae0d7dfdcc4 admin admin] Authenticating user token {{(pid=82025) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 20:01:55.317224 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b3e6a01-afe2-451b-851f-8ae0d7dfdcc4 admin admin] Validating token access rules against request {{(pid=82025) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 20:01:55.330920 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-710e34a0-08e8-4ff1-bb6c-bd466a3ddd4f admin admin] Validating token access rules against request {{(pid=82026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 20:01:55.337176 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ff81df0-33a3-4c4b-9f6c-1174b496bbbd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57539b6a6f3b4d589f5f5e1d211cd6a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b454f707d20347ada3d82aa85495635e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 20:01:55.338168 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ff81df0-33a3-4c4b-9f6c-1174b496bbbd admin admin] REQUEST_METHOD: `POST` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:01:55.338280 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ff81df0-33a3-4c4b-9f6c-1174b496bbbd admin admin] SCRIPT_NAME: `/identity` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:01:55.338586 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ff81df0-33a3-4c4b-9f6c-1174b496bbbd admin admin] PATH_INFO: `/v3/users` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:01:55.339477 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ff81df0-33a3-4c4b-9f6c-1174b496bbbd admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 20:01:55.342713 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ff81df0-33a3-4c4b-9f6c-1174b496bbbd admin admin] RBAC: Authorization granted {{(pid=82026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 20:01:55.391734 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b63fc9ee-df26-4c5b-af96-9e7154a2fcbd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57539b6a6f3b4d589f5f5e1d211cd6a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b454f707d20347ada3d82aa85495635e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82025) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 20:01:55.392380 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b63fc9ee-df26-4c5b-af96-9e7154a2fcbd admin admin] REQUEST_METHOD: `POST` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:01:55.392672 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b63fc9ee-df26-4c5b-af96-9e7154a2fcbd admin admin] SCRIPT_NAME: `/identity` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:01:55.392951 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b63fc9ee-df26-4c5b-af96-9e7154a2fcbd admin admin] PATH_INFO: `/v3/users` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:01:55.393593 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b63fc9ee-df26-4c5b-af96-9e7154a2fcbd admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 20:01:55.395661 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b63fc9ee-df26-4c5b-af96-9e7154a2fcbd admin admin] RBAC: Authorization granted {{(pid=82025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 20:01:55.445079 dv-cinder-828806-6-smb devstack@keystone.service[82026]: [pid: 82026|app: 0|req: 1123/2297] 10.222.0.33 () {60 vars in 1144 bytes} [Tue Sep 13 20:01:55 2022] POST /identity/v3/users => generated 298 bytes in 207 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 13 20:01:55.445079 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ff81df0-33a3-4c4b-9f6c-1174b496bbbd admin admin] Authenticating user token {{(pid=82026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 20:01:55.456059 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ff81df0-33a3-4c4b-9f6c-1174b496bbbd admin admin] Validating token access rules against request {{(pid=82026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 20:01:55.461537 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31db18ab-8041-4094-905a-8bd19b0ad7aa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57539b6a6f3b4d589f5f5e1d211cd6a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b454f707d20347ada3d82aa85495635e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 20:01:55.462241 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31db18ab-8041-4094-905a-8bd19b0ad7aa admin admin] REQUEST_METHOD: `GET` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:01:55.462632 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31db18ab-8041-4094-905a-8bd19b0ad7aa admin admin] SCRIPT_NAME: `/identity` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:01:55.462973 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31db18ab-8041-4094-905a-8bd19b0ad7aa admin admin] PATH_INFO: `/v3/roles` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:01:55.464148 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31db18ab-8041-4094-905a-8bd19b0ad7aa admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 20:01:55.466416 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31db18ab-8041-4094-905a-8bd19b0ad7aa admin admin] RBAC: Authorization granted {{(pid=82026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 20:01:55.483171 dv-cinder-828806-6-smb devstack@keystone.service[82026]: [pid: 82026|app: 0|req: 1124/2298] 10.222.0.33 () {58 vars in 1122 bytes} [Tue Sep 13 20:01:55 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 13 20:01:55.483171 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31db18ab-8041-4094-905a-8bd19b0ad7aa admin admin] Authenticating user token {{(pid=82026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 20:01:55.490865 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31db18ab-8041-4094-905a-8bd19b0ad7aa admin admin] Validating token access rules against request {{(pid=82026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 20:01:55.496717 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-106adec1-04d0-4149-b37b-229982e4c410 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57539b6a6f3b4d589f5f5e1d211cd6a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b454f707d20347ada3d82aa85495635e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 20:01:55.497643 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-106adec1-04d0-4149-b37b-229982e4c410 admin admin] REQUEST_METHOD: `GET` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:01:55.497997 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-106adec1-04d0-4149-b37b-229982e4c410 admin admin] SCRIPT_NAME: `/identity` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:01:55.498368 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-106adec1-04d0-4149-b37b-229982e4c410 admin admin] PATH_INFO: `/v3/roles` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:01:55.499127 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-106adec1-04d0-4149-b37b-229982e4c410 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 20:01:55.502535 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-106adec1-04d0-4149-b37b-229982e4c410 admin admin] RBAC: Authorization granted {{(pid=82026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 20:01:55.508899 dv-cinder-828806-6-smb devstack@keystone.service[82025]: [pid: 82025|app: 0|req: 1175/2299] 10.222.0.33 () {60 vars in 1144 bytes} [Tue Sep 13 20:01:55 2022] POST /identity/v3/users => generated 293 bytes in 207 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 13 20:01:55.510020 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b63fc9ee-df26-4c5b-af96-9e7154a2fcbd admin admin] Authenticating user token {{(pid=82025) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 20:01:55.515989 dv-cinder-828806-6-smb devstack@keystone.service[82026]: [pid: 82026|app: 0|req: 1125/2300] 10.222.0.33 () {58 vars in 1122 bytes} [Tue Sep 13 20:01:55 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 13 20:01:55.517098 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-106adec1-04d0-4149-b37b-229982e4c410 admin admin] Authenticating user token {{(pid=82026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 20:01:55.523275 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b63fc9ee-df26-4c5b-af96-9e7154a2fcbd admin admin] Validating token access rules against request {{(pid=82025) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 20:01:55.527441 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-106adec1-04d0-4149-b37b-229982e4c410 admin admin] Validating token access rules against request {{(pid=82026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 20:01:55.528845 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51119d8b-b1ef-4b1c-98fb-92cacbc8448f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57539b6a6f3b4d589f5f5e1d211cd6a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b454f707d20347ada3d82aa85495635e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82025) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 20:01:55.529511 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51119d8b-b1ef-4b1c-98fb-92cacbc8448f admin admin] REQUEST_METHOD: `GET` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:01:55.529786 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51119d8b-b1ef-4b1c-98fb-92cacbc8448f admin admin] SCRIPT_NAME: `/identity` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:01:55.530115 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51119d8b-b1ef-4b1c-98fb-92cacbc8448f admin admin] PATH_INFO: `/v3/roles` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:01:55.530744 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51119d8b-b1ef-4b1c-98fb-92cacbc8448f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 20:01:55.531810 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG dbcounter [-] [82026] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=82026) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 20:01:55.532388 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51119d8b-b1ef-4b1c-98fb-92cacbc8448f admin admin] RBAC: Authorization granted {{(pid=82025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 20:01:55.534686 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5618d74e-4cd3-445e-8b24-c2ee2e24a45c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57539b6a6f3b4d589f5f5e1d211cd6a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b454f707d20347ada3d82aa85495635e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 20:01:55.535306 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5618d74e-4cd3-445e-8b24-c2ee2e24a45c admin admin] REQUEST_METHOD: `GET` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:01:55.535597 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5618d74e-4cd3-445e-8b24-c2ee2e24a45c admin admin] SCRIPT_NAME: `/identity` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:01:55.535878 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5618d74e-4cd3-445e-8b24-c2ee2e24a45c admin admin] PATH_INFO: `/v3/roles` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:01:55.536527 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5618d74e-4cd3-445e-8b24-c2ee2e24a45c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 20:01:55.538112 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5618d74e-4cd3-445e-8b24-c2ee2e24a45c admin admin] RBAC: Authorization granted {{(pid=82026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 20:01:55.544653 dv-cinder-828806-6-smb devstack@keystone.service[82025]: [pid: 82025|app: 0|req: 1176/2301] 10.222.0.33 () {58 vars in 1122 bytes} [Tue Sep 13 20:01:55 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 13 20:01:55.545539 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51119d8b-b1ef-4b1c-98fb-92cacbc8448f admin admin] Authenticating user token {{(pid=82025) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 20:01:55.549867 dv-cinder-828806-6-smb devstack@keystone.service[82026]: [pid: 82026|app: 0|req: 1126/2302] 10.222.0.33 () {58 vars in 1122 bytes} [Tue Sep 13 20:01:55 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 13 20:01:55.550680 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5618d74e-4cd3-445e-8b24-c2ee2e24a45c admin admin] Authenticating user token {{(pid=82026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 20:01:55.557030 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51119d8b-b1ef-4b1c-98fb-92cacbc8448f admin admin] Validating token access rules against request {{(pid=82025) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 20:01:55.562089 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5618d74e-4cd3-445e-8b24-c2ee2e24a45c admin admin] Validating token access rules against request {{(pid=82026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 20:01:55.562297 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44d71a14-55d4-4f66-b319-1cd2698c94d7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57539b6a6f3b4d589f5f5e1d211cd6a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b454f707d20347ada3d82aa85495635e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82025) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 20:01:55.563010 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44d71a14-55d4-4f66-b319-1cd2698c94d7 admin admin] REQUEST_METHOD: `PUT` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:01:55.563333 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44d71a14-55d4-4f66-b319-1cd2698c94d7 admin admin] SCRIPT_NAME: `/identity` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:01:55.563609 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44d71a14-55d4-4f66-b319-1cd2698c94d7 admin admin] PATH_INFO: `/v3/projects/96a1866e31c641c5ba2422c22c967760/users/33bf635fd2e2494fa89213879f576c80/roles/e5af7d5baa93469e9e486ef21c85474e` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:01:55.567688 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e395c5e-e4cf-4597-9755-153e577dbf61 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57539b6a6f3b4d589f5f5e1d211cd6a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b454f707d20347ada3d82aa85495635e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 20:01:55.570535 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e395c5e-e4cf-4597-9755-153e577dbf61 admin admin] REQUEST_METHOD: `PUT` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:01:55.570535 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e395c5e-e4cf-4597-9755-153e577dbf61 admin admin] SCRIPT_NAME: `/identity` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:01:55.570535 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e395c5e-e4cf-4597-9755-153e577dbf61 admin admin] PATH_INFO: `/v3/projects/8497245b0f0c43cf8bcfe13925de6589/users/2949c26afa6d4b83b7f2ca472959b675/roles/3618ab638a65401f82333da7596d1daf` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:01:55.580474 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44d71a14-55d4-4f66-b319-1cd2698c94d7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=96a1866e31c641c5ba2422c22c967760, user_id=33bf635fd2e2494fa89213879f576c80, role_id=e5af7d5baa93469e9e486ef21c85474e)` {{(pid=82025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 20:01:55.583574 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44d71a14-55d4-4f66-b319-1cd2698c94d7 admin admin] RBAC: Authorization granted {{(pid=82025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 20:01:55.585342 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e395c5e-e4cf-4597-9755-153e577dbf61 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8497245b0f0c43cf8bcfe13925de6589, user_id=2949c26afa6d4b83b7f2ca472959b675, role_id=3618ab638a65401f82333da7596d1daf)` {{(pid=82026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 20:01:55.588268 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e395c5e-e4cf-4597-9755-153e577dbf61 admin admin] RBAC: Authorization granted {{(pid=82026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 20:01:55.660151 dv-cinder-828806-6-smb devstack@keystone.service[82025]: [pid: 82025|app: 0|req: 1177/2303] 10.222.0.33 () {60 vars in 1483 bytes} [Tue Sep 13 20:01:55 2022] PUT /identity/v3/projects/96a1866e31c641c5ba2422c22c967760/users/33bf635fd2e2494fa89213879f576c80/roles/e5af7d5baa93469e9e486ef21c85474e => generated 0 bytes in 114 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 20:01:55.660562 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44d71a14-55d4-4f66-b319-1cd2698c94d7 admin admin] Authenticating user token {{(pid=82025) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 20:01:55.683710 dv-cinder-828806-6-smb devstack@keystone.service[82026]: [pid: 82026|app: 0|req: 1127/2304] 10.222.0.33 () {60 vars in 1483 bytes} [Tue Sep 13 20:01:55 2022] PUT /identity/v3/projects/8497245b0f0c43cf8bcfe13925de6589/users/2949c26afa6d4b83b7f2ca472959b675/roles/3618ab638a65401f82333da7596d1daf => generated 0 bytes in 128 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 20:01:55.684925 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e395c5e-e4cf-4597-9755-153e577dbf61 admin admin] Authenticating user token {{(pid=82026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 20:01:55.783453 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44d71a14-55d4-4f66-b319-1cd2698c94d7 admin admin] Validating token access rules against request {{(pid=82025) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 20:01:55.800544 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e395c5e-e4cf-4597-9755-153e577dbf61 admin admin] Validating token access rules against request {{(pid=82026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 20:01:55.807095 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe046248-efba-4ab2-a6ae-5272d4bf52a5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57539b6a6f3b4d589f5f5e1d211cd6a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b454f707d20347ada3d82aa85495635e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 20:01:55.807400 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe046248-efba-4ab2-a6ae-5272d4bf52a5 admin admin] REQUEST_METHOD: `GET` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:01:55.807669 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe046248-efba-4ab2-a6ae-5272d4bf52a5 admin admin] SCRIPT_NAME: `/identity` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:01:55.809451 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe046248-efba-4ab2-a6ae-5272d4bf52a5 admin admin] PATH_INFO: `/v3/roles` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:01:55.809451 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe046248-efba-4ab2-a6ae-5272d4bf52a5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 20:01:55.810460 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe046248-efba-4ab2-a6ae-5272d4bf52a5 admin admin] RBAC: Authorization granted {{(pid=82026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 20:01:55.825475 dv-cinder-828806-6-smb devstack@keystone.service[82026]: [pid: 82026|app: 0|req: 1128/2305] 10.222.0.33 () {58 vars in 1122 bytes} [Tue Sep 13 20:01:55 2022] GET /identity/v3/roles => generated 1420 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 13 20:01:55.825475 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-660109f4-d1f5-4914-a680-a058fa56553b None None] REQUEST_METHOD: `POST` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:01:55.825475 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-660109f4-d1f5-4914-a680-a058fa56553b None None] SCRIPT_NAME: `/identity` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:01:55.825475 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-660109f4-d1f5-4914-a680-a058fa56553b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:01:55.856383 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3f265b8-c4da-451d-bc9a-a59250e86ee6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57539b6a6f3b4d589f5f5e1d211cd6a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b454f707d20347ada3d82aa85495635e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82025) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 20:01:55.861762 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3f265b8-c4da-451d-bc9a-a59250e86ee6 admin admin] REQUEST_METHOD: `GET` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:01:55.861762 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3f265b8-c4da-451d-bc9a-a59250e86ee6 admin admin] SCRIPT_NAME: `/identity` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:01:55.861762 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3f265b8-c4da-451d-bc9a-a59250e86ee6 admin admin] PATH_INFO: `/v3/roles` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:01:55.861762 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3f265b8-c4da-451d-bc9a-a59250e86ee6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 20:01:55.863977 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3f265b8-c4da-451d-bc9a-a59250e86ee6 admin admin] RBAC: Authorization granted {{(pid=82025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 20:01:55.870246 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.auth.core [None req-660109f4-d1f5-4914-a680-a058fa56553b None None] MFA Rules not processed for user `2949c26afa6d4b83b7f2ca472959b675`. Rule list: `[]` (Enabled: `True`). {{(pid=82026) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 20:01:55.871706 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.common.fernet_utils [None req-660109f4-d1f5-4914-a680-a058fa56553b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82026) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 20:01:55.877049 dv-cinder-828806-6-smb devstack@keystone.service[82025]: [pid: 82025|app: 0|req: 1178/2306] 10.222.0.33 () {58 vars in 1122 bytes} [Tue Sep 13 20:01:55 2022] GET /identity/v3/roles => generated 1420 bytes in 217 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 13 20:01:55.877829 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3f265b8-c4da-451d-bc9a-a59250e86ee6 admin admin] Authenticating user token {{(pid=82025) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 20:01:55.889873 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3f265b8-c4da-451d-bc9a-a59250e86ee6 admin admin] Validating token access rules against request {{(pid=82025) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 20:01:55.896716 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ca3e181-db33-45a9-a698-c5cb6940ccfb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57539b6a6f3b4d589f5f5e1d211cd6a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b454f707d20347ada3d82aa85495635e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82025) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 20:01:55.897544 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ca3e181-db33-45a9-a698-c5cb6940ccfb admin admin] REQUEST_METHOD: `PUT` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:01:55.897840 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ca3e181-db33-45a9-a698-c5cb6940ccfb admin admin] SCRIPT_NAME: `/identity` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:01:55.898186 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ca3e181-db33-45a9-a698-c5cb6940ccfb admin admin] PATH_INFO: `/v3/projects/96a1866e31c641c5ba2422c22c967760/users/33bf635fd2e2494fa89213879f576c80/roles/e5af7d5baa93469e9e486ef21c85474e` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:01:55.900310 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ca3e181-db33-45a9-a698-c5cb6940ccfb admin admin] RBAC: Authorizing `identity:create_grant(project_id=96a1866e31c641c5ba2422c22c967760, user_id=33bf635fd2e2494fa89213879f576c80, role_id=e5af7d5baa93469e9e486ef21c85474e)` {{(pid=82025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 20:01:55.904075 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ca3e181-db33-45a9-a698-c5cb6940ccfb admin admin] RBAC: Authorization granted {{(pid=82025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 20:01:55.918842 dv-cinder-828806-6-smb devstack@keystone.service[82025]: [pid: 82025|app: 0|req: 1179/2307] 10.222.0.33 () {60 vars in 1483 bytes} [Tue Sep 13 20:01:55 2022] PUT /identity/v3/projects/96a1866e31c641c5ba2422c22c967760/users/33bf635fd2e2494fa89213879f576c80/roles/e5af7d5baa93469e9e486ef21c85474e => generated 0 bytes in 41 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 20:01:55.919790 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ca3e181-db33-45a9-a698-c5cb6940ccfb admin admin] Authenticating user token {{(pid=82025) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 20:01:55.988179 dv-cinder-828806-6-smb devstack@keystone.service[82026]: [pid: 82026|app: 0|req: 1129/2308] 10.222.0.33 () {58 vars in 958 bytes} [Tue Sep 13 20:01:55 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 161 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 20:01:55.988179 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66f2e56f-4b25-453f-9ea7-f1a6220a11cb None None] REQUEST_METHOD: `POST` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:01:55.988179 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66f2e56f-4b25-453f-9ea7-f1a6220a11cb None None] SCRIPT_NAME: `/identity` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:01:55.988179 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66f2e56f-4b25-453f-9ea7-f1a6220a11cb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:01:56.010086 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ca3e181-db33-45a9-a698-c5cb6940ccfb admin admin] Validating token access rules against request {{(pid=82025) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 20:01:56.029082 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-213d85d4-0f63-4538-ae11-d19bc276fbb2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57539b6a6f3b4d589f5f5e1d211cd6a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b454f707d20347ada3d82aa85495635e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82025) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 20:01:56.029809 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-213d85d4-0f63-4538-ae11-d19bc276fbb2 admin admin] REQUEST_METHOD: `PUT` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:01:56.030184 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-213d85d4-0f63-4538-ae11-d19bc276fbb2 admin admin] SCRIPT_NAME: `/identity` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:01:56.030434 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-213d85d4-0f63-4538-ae11-d19bc276fbb2 admin admin] PATH_INFO: `/v3/projects/f03ae76a36b24973867015b7dc50964f/users/6e7526dd1e314e959e618b794ac92cf8/roles/3618ab638a65401f82333da7596d1daf` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:01:56.030567 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.auth.core [None req-66f2e56f-4b25-453f-9ea7-f1a6220a11cb None None] MFA Rules not processed for user `33bf635fd2e2494fa89213879f576c80`. Rule list: `[]` (Enabled: `True`). {{(pid=82026) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 20:01:56.032029 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.common.fernet_utils [None req-66f2e56f-4b25-453f-9ea7-f1a6220a11cb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82026) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 20:01:56.047636 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-213d85d4-0f63-4538-ae11-d19bc276fbb2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f03ae76a36b24973867015b7dc50964f, user_id=6e7526dd1e314e959e618b794ac92cf8, role_id=3618ab638a65401f82333da7596d1daf)` {{(pid=82025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 20:01:56.051490 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-213d85d4-0f63-4538-ae11-d19bc276fbb2 admin admin] RBAC: Authorization granted {{(pid=82025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 20:01:56.117706 dv-cinder-828806-6-smb devstack@keystone.service[82026]: [pid: 82026|app: 0|req: 1130/2309] 10.222.0.33 () {58 vars in 958 bytes} [Tue Sep 13 20:01:55 2022] POST /identity/v3/auth/tokens => generated 3327 bytes in 133 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 20:01:56.118575 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66f2e56f-4b25-453f-9ea7-f1a6220a11cb None None] Authenticating user token {{(pid=82026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 20:01:56.131001 dv-cinder-828806-6-smb devstack@keystone.service[82025]: [pid: 82025|app: 0|req: 1180/2310] 10.222.0.33 () {60 vars in 1483 bytes} [Tue Sep 13 20:01:55 2022] PUT /identity/v3/projects/f03ae76a36b24973867015b7dc50964f/users/6e7526dd1e314e959e618b794ac92cf8/roles/3618ab638a65401f82333da7596d1daf => generated 0 bytes in 201 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 20:01:56.132280 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-213d85d4-0f63-4538-ae11-d19bc276fbb2 admin admin] Authenticating user token {{(pid=82025) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 20:01:56.134274 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.fernet_utils [None req-213d85d4-0f63-4538-ae11-d19bc276fbb2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82025) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 20:01:56.138926 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66f2e56f-4b25-453f-9ea7-f1a6220a11cb None None] Validating token access rules against request {{(pid=82026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 20:01:56.196762 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-213d85d4-0f63-4538-ae11-d19bc276fbb2 admin admin] Validating token access rules against request {{(pid=82025) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 20:01:56.201691 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e68b79bc-5f73-4101-bde2-4b3bc23fd7c8 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46024fc6167f4321818b1bed27a521a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8c6fba0f15b4d6a84ff601919b7b8e4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82025) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 20:01:56.202386 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e68b79bc-5f73-4101-bde2-4b3bc23fd7c8 service cinder] REQUEST_METHOD: `GET` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:01:56.202674 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e68b79bc-5f73-4101-bde2-4b3bc23fd7c8 service cinder] SCRIPT_NAME: `/identity` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:01:56.203017 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e68b79bc-5f73-4101-bde2-4b3bc23fd7c8 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:01:56.203151 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea2a9ead-8a6c-45ea-a275-f0619d14d7fc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57539b6a6f3b4d589f5f5e1d211cd6a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b454f707d20347ada3d82aa85495635e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 20:01:56.206955 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea2a9ead-8a6c-45ea-a275-f0619d14d7fc admin admin] REQUEST_METHOD: `POST` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:01:56.206955 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea2a9ead-8a6c-45ea-a275-f0619d14d7fc admin admin] SCRIPT_NAME: `/identity` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:01:56.206955 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea2a9ead-8a6c-45ea-a275-f0619d14d7fc admin admin] PATH_INFO: `/v3/projects` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:01:56.206955 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea2a9ead-8a6c-45ea-a275-f0619d14d7fc admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 20:01:56.207477 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.fernet_utils [None req-e68b79bc-5f73-4101-bde2-4b3bc23fd7c8 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82025) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 20:01:56.207570 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea2a9ead-8a6c-45ea-a275-f0619d14d7fc admin admin] RBAC: Authorization granted {{(pid=82026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 20:01:56.285189 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e68b79bc-5f73-4101-bde2-4b3bc23fd7c8 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=82025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 20:01:56.286648 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e68b79bc-5f73-4101-bde2-4b3bc23fd7c8 service cinder] RBAC: Authorization granted {{(pid=82025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 20:01:56.298033 dv-cinder-828806-6-smb devstack@keystone.service[82025]: [pid: 82025|app: 0|req: 1181/2311] 10.222.0.33 () {60 vars in 1365 bytes} [Tue Sep 13 20:01:56 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 168 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 13 20:01:56.299446 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9dbad0a-01b6-4705-b3cf-603f123456e1 None None] REQUEST_METHOD: `POST` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:01:56.304920 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9dbad0a-01b6-4705-b3cf-603f123456e1 None None] SCRIPT_NAME: `/identity` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:01:56.304920 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9dbad0a-01b6-4705-b3cf-603f123456e1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:01:56.307507 dv-cinder-828806-6-smb devstack@keystone.service[82026]: [pid: 82026|app: 0|req: 1131/2312] 10.222.0.33 () {60 vars in 1153 bytes} [Tue Sep 13 20:01:56 2022] POST /identity/v3/projects => generated 385 bytes in 187 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 13 20:01:56.310138 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea2a9ead-8a6c-45ea-a275-f0619d14d7fc admin admin] Authenticating user token {{(pid=82026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 20:01:56.322716 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG dbcounter [-] [82025] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=82025) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 20:01:56.359151 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.auth.core [None req-e9dbad0a-01b6-4705-b3cf-603f123456e1 None None] MFA Rules not processed for user `6e7526dd1e314e959e618b794ac92cf8`. Rule list: `[]` (Enabled: `True`). {{(pid=82025) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 20:01:56.359686 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.fernet_utils [None req-e9dbad0a-01b6-4705-b3cf-603f123456e1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82025) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 20:01:56.407672 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea2a9ead-8a6c-45ea-a275-f0619d14d7fc admin admin] Validating token access rules against request {{(pid=82026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 20:01:56.412825 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcb73d1c-5d2d-4951-a369-e7de370cd7cc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57539b6a6f3b4d589f5f5e1d211cd6a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b454f707d20347ada3d82aa85495635e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 20:01:56.413449 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcb73d1c-5d2d-4951-a369-e7de370cd7cc admin admin] REQUEST_METHOD: `POST` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:01:56.413735 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcb73d1c-5d2d-4951-a369-e7de370cd7cc admin admin] SCRIPT_NAME: `/identity` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:01:56.414016 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcb73d1c-5d2d-4951-a369-e7de370cd7cc admin admin] PATH_INFO: `/v3/users` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:01:56.414697 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcb73d1c-5d2d-4951-a369-e7de370cd7cc admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 20:01:56.416696 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcb73d1c-5d2d-4951-a369-e7de370cd7cc admin admin] RBAC: Authorization granted {{(pid=82026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 20:01:56.476342 dv-cinder-828806-6-smb devstack@keystone.service[82025]: [pid: 82025|app: 0|req: 1182/2313] 10.222.0.33 () {58 vars in 958 bytes} [Tue Sep 13 20:01:56 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 174 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 20:01:56.484098 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9dbad0a-01b6-4705-b3cf-603f123456e1 None None] Authenticating user token {{(pid=82025) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 20:01:56.485455 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.fernet_utils [None req-e9dbad0a-01b6-4705-b3cf-603f123456e1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82025) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 20:01:56.546692 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9dbad0a-01b6-4705-b3cf-603f123456e1 None None] Validating token access rules against request {{(pid=82025) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 20:01:56.549808 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-304cc8d7-6fb2-4307-8f30-891cd772afe0 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46024fc6167f4321818b1bed27a521a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8c6fba0f15b4d6a84ff601919b7b8e4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82025) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 20:01:56.550874 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-304cc8d7-6fb2-4307-8f30-891cd772afe0 service cinder] REQUEST_METHOD: `GET` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:01:56.550874 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-304cc8d7-6fb2-4307-8f30-891cd772afe0 service cinder] SCRIPT_NAME: `/identity` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:01:56.551229 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-304cc8d7-6fb2-4307-8f30-891cd772afe0 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:01:56.561446 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-304cc8d7-6fb2-4307-8f30-891cd772afe0 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=82025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 20:01:56.563077 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-304cc8d7-6fb2-4307-8f30-891cd772afe0 service cinder] RBAC: Authorization granted {{(pid=82025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 20:01:56.579086 dv-cinder-828806-6-smb devstack@keystone.service[82026]: [pid: 82026|app: 0|req: 1132/2314] 10.222.0.33 () {60 vars in 1144 bytes} [Tue Sep 13 20:01:56 2022] POST /identity/v3/users => generated 299 bytes in 269 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 13 20:01:56.583296 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcb73d1c-5d2d-4951-a369-e7de370cd7cc admin admin] Authenticating user token {{(pid=82026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 20:01:56.584622 dv-cinder-828806-6-smb devstack@keystone.service[82025]: [pid: 82025|app: 0|req: 1183/2315] 10.222.0.33 () {60 vars in 1365 bytes} [Tue Sep 13 20:01:56 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 101 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 13 20:01:56.594574 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcb73d1c-5d2d-4951-a369-e7de370cd7cc admin admin] Validating token access rules against request {{(pid=82026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 20:01:56.599842 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a89a6de-33c8-4788-a7b2-dec4e9945ebd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57539b6a6f3b4d589f5f5e1d211cd6a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b454f707d20347ada3d82aa85495635e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 20:01:56.604743 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a89a6de-33c8-4788-a7b2-dec4e9945ebd admin admin] REQUEST_METHOD: `GET` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:01:56.604743 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a89a6de-33c8-4788-a7b2-dec4e9945ebd admin admin] SCRIPT_NAME: `/identity` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:01:56.604743 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a89a6de-33c8-4788-a7b2-dec4e9945ebd admin admin] PATH_INFO: `/v3/roles` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:01:56.604743 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a89a6de-33c8-4788-a7b2-dec4e9945ebd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 20:01:56.604743 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a89a6de-33c8-4788-a7b2-dec4e9945ebd admin admin] RBAC: Authorization granted {{(pid=82026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 20:01:56.618930 dv-cinder-828806-6-smb devstack@keystone.service[82026]: [pid: 82026|app: 0|req: 1133/2316] 10.222.0.33 () {58 vars in 1122 bytes} [Tue Sep 13 20:01:56 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 13 20:01:56.620102 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-304cc8d7-6fb2-4307-8f30-891cd772afe0 service cinder] Authenticating user token {{(pid=82025) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 20:01:56.632583 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-304cc8d7-6fb2-4307-8f30-891cd772afe0 service cinder] Validating token access rules against request {{(pid=82025) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 20:01:56.638132 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d2b599d-039f-4bad-8074-43d178497854 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57539b6a6f3b4d589f5f5e1d211cd6a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b454f707d20347ada3d82aa85495635e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82025) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 20:01:56.638738 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d2b599d-039f-4bad-8074-43d178497854 admin admin] REQUEST_METHOD: `PUT` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:01:56.639065 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d2b599d-039f-4bad-8074-43d178497854 admin admin] SCRIPT_NAME: `/identity` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:01:56.639342 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d2b599d-039f-4bad-8074-43d178497854 admin admin] PATH_INFO: `/v3/projects/c3b9517cf1734fcf8014864c584e9659/users/eff1679387dc41e5853d141873787be4/roles/e5af7d5baa93469e9e486ef21c85474e` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:01:56.652847 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG dbcounter [-] [82026] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=82026) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 20:01:56.657231 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d2b599d-039f-4bad-8074-43d178497854 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c3b9517cf1734fcf8014864c584e9659, user_id=eff1679387dc41e5853d141873787be4, role_id=e5af7d5baa93469e9e486ef21c85474e)` {{(pid=82025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 20:01:56.660000 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d2b599d-039f-4bad-8074-43d178497854 admin admin] RBAC: Authorization granted {{(pid=82025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 20:01:56.767948 dv-cinder-828806-6-smb devstack@keystone.service[82025]: [pid: 82025|app: 0|req: 1184/2317] 10.222.0.33 () {60 vars in 1483 bytes} [Tue Sep 13 20:01:56 2022] PUT /identity/v3/projects/c3b9517cf1734fcf8014864c584e9659/users/eff1679387dc41e5853d141873787be4/roles/e5af7d5baa93469e9e486ef21c85474e => generated 0 bytes in 148 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 20:01:56.771998 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a89a6de-33c8-4788-a7b2-dec4e9945ebd admin admin] Authenticating user token {{(pid=82026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 20:01:56.783761 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a89a6de-33c8-4788-a7b2-dec4e9945ebd admin admin] Validating token access rules against request {{(pid=82026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 20:01:56.844284 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccdc589c-cabc-4b0c-92e5-36900832bbd1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57539b6a6f3b4d589f5f5e1d211cd6a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b454f707d20347ada3d82aa85495635e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 20:01:56.844902 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccdc589c-cabc-4b0c-92e5-36900832bbd1 admin admin] REQUEST_METHOD: `GET` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:01:56.845189 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccdc589c-cabc-4b0c-92e5-36900832bbd1 admin admin] SCRIPT_NAME: `/identity` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:01:56.845476 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccdc589c-cabc-4b0c-92e5-36900832bbd1 admin admin] PATH_INFO: `/v3/roles` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:01:56.846125 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccdc589c-cabc-4b0c-92e5-36900832bbd1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 20:01:56.847779 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccdc589c-cabc-4b0c-92e5-36900832bbd1 admin admin] RBAC: Authorization granted {{(pid=82026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 20:01:56.858433 dv-cinder-828806-6-smb devstack@keystone.service[82026]: [pid: 82026|app: 0|req: 1134/2318] 10.222.0.33 () {58 vars in 1122 bytes} [Tue Sep 13 20:01:56 2022] GET /identity/v3/roles => generated 1420 bytes in 87 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 13 20:01:56.862966 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d2b599d-039f-4bad-8074-43d178497854 admin admin] Authenticating user token {{(pid=82025) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 20:01:56.873907 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d2b599d-039f-4bad-8074-43d178497854 admin admin] Validating token access rules against request {{(pid=82025) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 20:01:56.881843 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4a190a6-5989-4db2-813a-e8d6f3b2d921 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57539b6a6f3b4d589f5f5e1d211cd6a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b454f707d20347ada3d82aa85495635e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82025) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 20:01:56.881843 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4a190a6-5989-4db2-813a-e8d6f3b2d921 admin admin] REQUEST_METHOD: `PUT` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:01:56.881843 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4a190a6-5989-4db2-813a-e8d6f3b2d921 admin admin] SCRIPT_NAME: `/identity` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:01:56.881843 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4a190a6-5989-4db2-813a-e8d6f3b2d921 admin admin] PATH_INFO: `/v3/projects/c3b9517cf1734fcf8014864c584e9659/users/eff1679387dc41e5853d141873787be4/roles/e5af7d5baa93469e9e486ef21c85474e` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:01:56.882944 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4a190a6-5989-4db2-813a-e8d6f3b2d921 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c3b9517cf1734fcf8014864c584e9659, user_id=eff1679387dc41e5853d141873787be4, role_id=e5af7d5baa93469e9e486ef21c85474e)` {{(pid=82025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 20:01:56.885797 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4a190a6-5989-4db2-813a-e8d6f3b2d921 admin admin] RBAC: Authorization granted {{(pid=82025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 20:01:56.897191 dv-cinder-828806-6-smb devstack@keystone.service[82025]: [pid: 82025|app: 0|req: 1185/2319] 10.222.0.33 () {60 vars in 1483 bytes} [Tue Sep 13 20:01:56 2022] PUT /identity/v3/projects/c3b9517cf1734fcf8014864c584e9659/users/eff1679387dc41e5853d141873787be4/roles/e5af7d5baa93469e9e486ef21c85474e => generated 0 bytes in 35 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 13 20:01:56.909198 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48a56624-441f-4b7b-b7b4-0d7e31915635 None None] REQUEST_METHOD: `POST` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:01:56.909536 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48a56624-441f-4b7b-b7b4-0d7e31915635 None None] SCRIPT_NAME: `/identity` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:01:56.909915 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48a56624-441f-4b7b-b7b4-0d7e31915635 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:01:56.938428 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.auth.core [None req-48a56624-441f-4b7b-b7b4-0d7e31915635 None None] MFA Rules not processed for user `eff1679387dc41e5853d141873787be4`. Rule list: `[]` (Enabled: `True`). {{(pid=82026) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 20:01:56.939702 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.common.fernet_utils [None req-48a56624-441f-4b7b-b7b4-0d7e31915635 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82026) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 20:01:57.009965 dv-cinder-828806-6-smb devstack@keystone.service[82026]: [pid: 82026|app: 0|req: 1135/2320] 10.222.0.33 () {58 vars in 958 bytes} [Tue Sep 13 20:01:56 2022] POST /identity/v3/auth/tokens => generated 3329 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 20:01:57.070555 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4a190a6-5989-4db2-813a-e8d6f3b2d921 admin admin] Authenticating user token {{(pid=82025) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 20:01:57.127086 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4a190a6-5989-4db2-813a-e8d6f3b2d921 admin admin] Validating token access rules against request {{(pid=82025) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 20:01:57.130725 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cec3ab77-581f-41d8-8a8f-5f0e2e592bc0 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46024fc6167f4321818b1bed27a521a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8c6fba0f15b4d6a84ff601919b7b8e4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82025) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 20:01:57.131359 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cec3ab77-581f-41d8-8a8f-5f0e2e592bc0 service cinder] REQUEST_METHOD: `GET` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:01:57.131645 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cec3ab77-581f-41d8-8a8f-5f0e2e592bc0 service cinder] SCRIPT_NAME: `/identity` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:01:57.131924 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cec3ab77-581f-41d8-8a8f-5f0e2e592bc0 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:01:57.213771 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cec3ab77-581f-41d8-8a8f-5f0e2e592bc0 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=82025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 20:01:57.215574 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cec3ab77-581f-41d8-8a8f-5f0e2e592bc0 service cinder] RBAC: Authorization granted {{(pid=82025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 20:01:57.225315 dv-cinder-828806-6-smb devstack@keystone.service[82025]: [pid: 82025|app: 0|req: 1186/2321] 10.222.0.33 () {60 vars in 1365 bytes} [Tue Sep 13 20:01:57 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 155 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 20:01:57.371335 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG dbcounter [-] [82025] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=82025) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 20:01:57.530943 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG dbcounter [-] [82026] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82026) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 20:01:58.103338 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG dbcounter [-] [82025] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=82025) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 20:01:58.633906 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG dbcounter [-] [82026] Writing DB stats keystone:SELECT=93,keystone:INSERT=7 {{(pid=82026) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 20:01:58.725613 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG dbcounter [-] [82025] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82025) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 20:01:58.887962 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48a56624-441f-4b7b-b7b4-0d7e31915635 None None] Authenticating user token {{(pid=82026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 20:01:58.897890 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48a56624-441f-4b7b-b7b4-0d7e31915635 None None] Validating token access rules against request {{(pid=82026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 20:01:58.901698 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e458a7a1-3bff-4970-9268-341376e1fa9d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46024fc6167f4321818b1bed27a521a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8c6fba0f15b4d6a84ff601919b7b8e4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 20:01:58.902898 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e458a7a1-3bff-4970-9268-341376e1fa9d service cinder] REQUEST_METHOD: `GET` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:01:58.903263 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e458a7a1-3bff-4970-9268-341376e1fa9d service cinder] SCRIPT_NAME: `/identity` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:01:58.903561 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e458a7a1-3bff-4970-9268-341376e1fa9d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:01:58.968925 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e458a7a1-3bff-4970-9268-341376e1fa9d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=82026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 20:01:58.970615 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e458a7a1-3bff-4970-9268-341376e1fa9d service cinder] RBAC: Authorization granted {{(pid=82026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 20:01:58.979984 dv-cinder-828806-6-smb devstack@keystone.service[82026]: [pid: 82026|app: 0|req: 1136/2322] 10.222.0.33 () {60 vars in 1365 bytes} [Tue Sep 13 20:01:58 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 20:01:59.329449 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG dbcounter [-] [82026] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82026) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 20:01:59.607618 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cec3ab77-581f-41d8-8a8f-5f0e2e592bc0 service cinder] Authenticating user token {{(pid=82025) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 20:01:59.690823 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cec3ab77-581f-41d8-8a8f-5f0e2e592bc0 service cinder] Validating token access rules against request {{(pid=82025) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 20:01:59.690823 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0e5c9ec-8cd8-4024-83d0-2a210b45d661 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46024fc6167f4321818b1bed27a521a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8c6fba0f15b4d6a84ff601919b7b8e4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82025) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 20:01:59.690823 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0e5c9ec-8cd8-4024-83d0-2a210b45d661 service cinder] REQUEST_METHOD: `GET` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:01:59.690823 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0e5c9ec-8cd8-4024-83d0-2a210b45d661 service cinder] SCRIPT_NAME: `/identity` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:01:59.691426 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0e5c9ec-8cd8-4024-83d0-2a210b45d661 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:01:59.691426 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0e5c9ec-8cd8-4024-83d0-2a210b45d661 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=82025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 20:01:59.691426 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0e5c9ec-8cd8-4024-83d0-2a210b45d661 service cinder] RBAC: Authorization granted {{(pid=82025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 20:01:59.698611 dv-cinder-828806-6-smb devstack@keystone.service[82025]: [pid: 82025|app: 0|req: 1187/2323] 10.222.0.33 () {60 vars in 1365 bytes} [Tue Sep 13 20:01:59 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 13 20:01:59.931270 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG dbcounter [-] [82025] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=82025) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 20:02:00.936826 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG dbcounter [-] [82025] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=82025) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 20:02:01.154474 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG dbcounter [-] [82026] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82026) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 20:02:01.351855 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e458a7a1-3bff-4970-9268-341376e1fa9d service cinder] Authenticating user token {{(pid=82026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 20:02:01.362078 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e458a7a1-3bff-4970-9268-341376e1fa9d service cinder] Validating token access rules against request {{(pid=82026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 20:02:01.367272 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca104928-ae60-4e1d-9048-4c7f507ce616 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46024fc6167f4321818b1bed27a521a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8c6fba0f15b4d6a84ff601919b7b8e4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 20:02:01.367900 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca104928-ae60-4e1d-9048-4c7f507ce616 service cinder] REQUEST_METHOD: `GET` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:02:01.368235 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca104928-ae60-4e1d-9048-4c7f507ce616 service cinder] SCRIPT_NAME: `/identity` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:02:01.368513 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca104928-ae60-4e1d-9048-4c7f507ce616 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:02:01.436253 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca104928-ae60-4e1d-9048-4c7f507ce616 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=82026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 20:02:01.437863 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca104928-ae60-4e1d-9048-4c7f507ce616 service cinder] RBAC: Authorization granted {{(pid=82026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 20:02:01.448548 dv-cinder-828806-6-smb devstack@keystone.service[82026]: [pid: 82026|app: 0|req: 1137/2324] 10.222.0.33 () {60 vars in 1365 bytes} [Tue Sep 13 20:02:01 2022] GET /identity/v3/auth/tokens => generated 3327 bytes in 97 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 20:02:01.674416 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG dbcounter [-] [82025] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=82025) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 20:02:01.744423 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0e5c9ec-8cd8-4024-83d0-2a210b45d661 service cinder] Authenticating user token {{(pid=82025) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 20:02:01.755261 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0e5c9ec-8cd8-4024-83d0-2a210b45d661 service cinder] Validating token access rules against request {{(pid=82025) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 20:02:01.758993 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9116ab34-48f9-4cae-8bf1-c12168f4cf82 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46024fc6167f4321818b1bed27a521a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8c6fba0f15b4d6a84ff601919b7b8e4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82025) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 20:02:01.759625 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9116ab34-48f9-4cae-8bf1-c12168f4cf82 service cinder] REQUEST_METHOD: `GET` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:02:01.759914 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9116ab34-48f9-4cae-8bf1-c12168f4cf82 service cinder] SCRIPT_NAME: `/identity` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:02:01.760193 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9116ab34-48f9-4cae-8bf1-c12168f4cf82 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:02:01.772818 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9116ab34-48f9-4cae-8bf1-c12168f4cf82 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=82025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 20:02:01.774269 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9116ab34-48f9-4cae-8bf1-c12168f4cf82 service cinder] RBAC: Authorization granted {{(pid=82025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 20:02:01.784844 dv-cinder-828806-6-smb devstack@keystone.service[82025]: [pid: 82025|app: 0|req: 1188/2325] 10.222.0.33 () {60 vars in 1365 bytes} [Tue Sep 13 20:02:01 2022] GET /identity/v3/auth/tokens => generated 3329 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 20:02:02.171351 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG dbcounter [-] [82026] Writing DB stats keystone:SELECT=82,keystone:DELETE=16,keystone:INSERT=2 {{(pid=82026) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 20:02:02.325399 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG dbcounter [-] [82025] Writing DB stats keystone:SELECT=100 {{(pid=82025) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 20:02:02.571767 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG dbcounter [-] [82025] Writing DB stats keystone:SELECT=100 {{(pid=82025) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 20:02:03.000181 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG dbcounter [-] [82025] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82025) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 20:02:03.166203 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG dbcounter [-] [82026] Writing DB stats keystone:SELECT=97,keystone:DELETE=1,keystone:INSERT=2 {{(pid=82026) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 20:02:03.960289 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG dbcounter [-] [82025] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82025) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 20:02:04.086109 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG dbcounter [-] [82026] Writing DB stats keystone:INSERT=6,keystone:SELECT=87,keystone:DELETE=7 {{(pid=82026) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 20:02:04.468642 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG dbcounter [-] [82025] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=82025) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 20:02:04.519664 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG dbcounter [-] [82026] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=82026) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 20:02:04.978223 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG dbcounter [-] [82026] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=82026) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 20:02:05.057740 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG dbcounter [-] [82025] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82025) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 20:02:05.091728 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca104928-ae60-4e1d-9048-4c7f507ce616 service cinder] Authenticating user token {{(pid=82026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 20:02:05.172336 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca104928-ae60-4e1d-9048-4c7f507ce616 service cinder] Validating token access rules against request {{(pid=82026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 20:02:05.177079 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-159a677c-8514-43f6-9a43-543428324d46 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57539b6a6f3b4d589f5f5e1d211cd6a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b454f707d20347ada3d82aa85495635e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 20:02:05.177737 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-159a677c-8514-43f6-9a43-543428324d46 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:02:05.178023 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-159a677c-8514-43f6-9a43-543428324d46 admin admin] SCRIPT_NAME: `/identity` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:02:05.178302 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-159a677c-8514-43f6-9a43-543428324d46 admin admin] PATH_INFO: `/v3/users/6e7526dd1e314e959e618b794ac92cf8` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:02:05.179456 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-159a677c-8514-43f6-9a43-543428324d46 admin admin] RBAC: Authorizing `identity:delete_user(user_id=6e7526dd1e314e959e618b794ac92cf8)` {{(pid=82026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 20:02:05.181377 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-159a677c-8514-43f6-9a43-543428324d46 admin admin] RBAC: Authorization granted {{(pid=82026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 20:02:05.376397 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.notifications [None req-159a677c-8514-43f6-9a43-543428324d46 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6e7526dd1e314e959e618b794ac92cf8'} {{(pid=82026) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 20:02:05.470638 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.notifications [None req-159a677c-8514-43f6-9a43-543428324d46 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6e7526dd1e314e959e618b794ac92cf8'} {{(pid=82026) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 20:02:05.493769 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.notifications [None req-159a677c-8514-43f6-9a43-543428324d46 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6e7526dd1e314e959e618b794ac92cf8'} {{(pid=82026) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 20:02:05.495434 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.notifications [None req-159a677c-8514-43f6-9a43-543428324d46 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6e7526dd1e314e959e618b794ac92cf8'} {{(pid=82026) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 20:02:05.503101 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.notifications [None req-159a677c-8514-43f6-9a43-543428324d46 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6e7526dd1e314e959e618b794ac92cf8'} {{(pid=82026) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 20:02:05.509125 dv-cinder-828806-6-smb devstack@keystone.service[82026]: [pid: 82026|app: 0|req: 1138/2326] 10.222.0.33 () {58 vars in 1224 bytes} [Tue Sep 13 20:02:05 2022] DELETE /identity/v3/users/6e7526dd1e314e959e618b794ac92cf8 => generated 0 bytes in 418 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 13 20:02:05.513765 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a93d42e0-f8e6-45a5-bc38-d4531649b546 None None] REQUEST_METHOD: `POST` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:02:05.514139 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a93d42e0-f8e6-45a5-bc38-d4531649b546 None None] SCRIPT_NAME: `/identity` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:02:05.517091 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a93d42e0-f8e6-45a5-bc38-d4531649b546 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:02:05.534569 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.auth.core [None req-a93d42e0-f8e6-45a5-bc38-d4531649b546 None None] MFA Rules not processed for user `57539b6a6f3b4d589f5f5e1d211cd6a0`. Rule list: `[]` (Enabled: `True`). {{(pid=82025) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 20:02:05.535858 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.fernet_utils [None req-a93d42e0-f8e6-45a5-bc38-d4531649b546 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82025) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 20:02:05.537203 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG dbcounter [-] [82026] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=82026) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 20:02:05.596949 dv-cinder-828806-6-smb devstack@keystone.service[82025]: [pid: 82025|app: 0|req: 1189/2327] 10.222.0.33 () {58 vars in 958 bytes} [Tue Sep 13 20:02:05 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 20:02:05.607661 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-159a677c-8514-43f6-9a43-543428324d46 admin admin] Authenticating user token {{(pid=82026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 20:02:05.609193 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.common.fernet_utils [None req-159a677c-8514-43f6-9a43-543428324d46 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82026) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 20:02:05.667846 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-159a677c-8514-43f6-9a43-543428324d46 admin admin] Validating token access rules against request {{(pid=82026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 20:02:05.672440 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94526b98-286e-4e6f-89a4-5240e3d445db service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '023a2c79c2444611b3d431928e56685d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8c6fba0f15b4d6a84ff601919b7b8e4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 20:02:05.673049 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94526b98-286e-4e6f-89a4-5240e3d445db service neutron] REQUEST_METHOD: `GET` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:02:05.673336 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94526b98-286e-4e6f-89a4-5240e3d445db service neutron] SCRIPT_NAME: `/identity` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:02:05.673617 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94526b98-286e-4e6f-89a4-5240e3d445db service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:02:05.682579 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94526b98-286e-4e6f-89a4-5240e3d445db service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 20:02:05.684357 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94526b98-286e-4e6f-89a4-5240e3d445db service neutron] RBAC: Authorization granted {{(pid=82026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 20:02:05.693664 dv-cinder-828806-6-smb devstack@keystone.service[82026]: [pid: 82026|app: 0|req: 1139/2328] 10.222.0.33 () {60 vars in 1365 bytes} [Tue Sep 13 20:02:05 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 20:02:05.887655 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG dbcounter [-] [82025] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=82025) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 20:02:05.995232 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG dbcounter [-] [82026] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82026) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 20:02:06.164471 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a93d42e0-f8e6-45a5-bc38-d4531649b546 None None] Authenticating user token {{(pid=82025) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 20:02:06.165932 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.fernet_utils [None req-a93d42e0-f8e6-45a5-bc38-d4531649b546 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82025) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 20:02:06.179744 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a93d42e0-f8e6-45a5-bc38-d4531649b546 None None] Validating token access rules against request {{(pid=82025) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 20:02:06.186818 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05e37cac-f9f5-4eb7-b1fc-364742be905d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57539b6a6f3b4d589f5f5e1d211cd6a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b454f707d20347ada3d82aa85495635e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82025) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 20:02:06.187686 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05e37cac-f9f5-4eb7-b1fc-364742be905d admin admin] REQUEST_METHOD: `DELETE` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:02:06.187879 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05e37cac-f9f5-4eb7-b1fc-364742be905d admin admin] SCRIPT_NAME: `/identity` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:02:06.188167 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05e37cac-f9f5-4eb7-b1fc-364742be905d admin admin] PATH_INFO: `/v3/projects/f03ae76a36b24973867015b7dc50964f` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:02:06.189431 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05e37cac-f9f5-4eb7-b1fc-364742be905d admin admin] RBAC: Authorizing `identity:delete_project(project_id=f03ae76a36b24973867015b7dc50964f)` {{(pid=82025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 20:02:06.192682 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05e37cac-f9f5-4eb7-b1fc-364742be905d admin admin] RBAC: Authorization granted {{(pid=82025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 20:02:06.313820 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.notifications [None req-05e37cac-f9f5-4eb7-b1fc-364742be905d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f03ae76a36b24973867015b7dc50964f', 'request_id': 'req-05e37cac-f9f5-4eb7-b1fc-364742be905d'} {{(pid=82025) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 20:02:06.319679 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.notifications [None req-05e37cac-f9f5-4eb7-b1fc-364742be905d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f03ae76a36b24973867015b7dc50964f', 'request_id': 'req-05e37cac-f9f5-4eb7-b1fc-364742be905d'} {{(pid=82025) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 20:02:06.326079 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.notifications [None req-05e37cac-f9f5-4eb7-b1fc-364742be905d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f03ae76a36b24973867015b7dc50964f', 'request_id': 'req-05e37cac-f9f5-4eb7-b1fc-364742be905d'} {{(pid=82025) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 20:02:06.423373 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.notifications [None req-05e37cac-f9f5-4eb7-b1fc-364742be905d admin admin] The token cache is being invalidate because project f03ae76a36b24973867015b7dc50964f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82025) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 13 20:02:06.423669 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.notifications [None req-05e37cac-f9f5-4eb7-b1fc-364742be905d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82025) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 20:02:06.424314 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.notifications [None req-05e37cac-f9f5-4eb7-b1fc-364742be905d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82025) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 20:02:06.425902 dv-cinder-828806-6-smb devstack@keystone.service[82025]: [pid: 82025|app: 0|req: 1190/2329] 10.222.0.33 () {58 vars in 1233 bytes} [Tue Sep 13 20:02:06 2022] DELETE /identity/v3/projects/f03ae76a36b24973867015b7dc50964f => generated 0 bytes in 262 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 20:02:06.430730 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0716d76d-dc02-479f-9cf1-4dfa1145a441 None None] REQUEST_METHOD: `POST` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:02:06.431237 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0716d76d-dc02-479f-9cf1-4dfa1145a441 None None] SCRIPT_NAME: `/identity` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:02:06.431464 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0716d76d-dc02-479f-9cf1-4dfa1145a441 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:02:06.453246 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.auth.core [None req-0716d76d-dc02-479f-9cf1-4dfa1145a441 None None] MFA Rules not processed for user `57539b6a6f3b4d589f5f5e1d211cd6a0`. Rule list: `[]` (Enabled: `True`). {{(pid=82026) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 20:02:06.454785 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.common.fernet_utils [None req-0716d76d-dc02-479f-9cf1-4dfa1145a441 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82026) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 20:02:06.502579 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05e37cac-f9f5-4eb7-b1fc-364742be905d admin admin] Authenticating user token {{(pid=82025) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 20:02:06.504053 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.fernet_utils [None req-05e37cac-f9f5-4eb7-b1fc-364742be905d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82025) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 20:02:06.529534 dv-cinder-828806-6-smb devstack@keystone.service[82026]: [pid: 82026|app: 0|req: 1140/2330] 10.222.0.33 () {58 vars in 958 bytes} [Tue Sep 13 20:02:06 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 20:02:06.537914 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-314ed2ed-314c-428c-91ab-cfb4ce1a4f61 None None] REQUEST_METHOD: `POST` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:02:06.539186 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-314ed2ed-314c-428c-91ab-cfb4ce1a4f61 None None] SCRIPT_NAME: `/identity` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:02:06.539492 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-314ed2ed-314c-428c-91ab-cfb4ce1a4f61 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:02:06.549783 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG dbcounter [-] [82026] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82026) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 20:02:06.562208 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.auth.core [None req-314ed2ed-314c-428c-91ab-cfb4ce1a4f61 None None] MFA Rules not processed for user `57539b6a6f3b4d589f5f5e1d211cd6a0`. Rule list: `[]` (Enabled: `True`). {{(pid=82026) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 20:02:06.563514 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.common.fernet_utils [None req-314ed2ed-314c-428c-91ab-cfb4ce1a4f61 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82026) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 20:02:06.572776 dv-cinder-828806-6-smb devstack@keystone.service[82026]: [pid: 82026|app: 0|req: 1141/2331] 10.222.0.33 () {58 vars in 958 bytes} [Tue Sep 13 20:02:06 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 20:02:06.577247 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-314ed2ed-314c-428c-91ab-cfb4ce1a4f61 None None] Authenticating user token {{(pid=82026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 20:02:06.585920 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05e37cac-f9f5-4eb7-b1fc-364742be905d admin admin] Validating token access rules against request {{(pid=82025) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 20:02:06.586961 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-314ed2ed-314c-428c-91ab-cfb4ce1a4f61 None None] Validating token access rules against request {{(pid=82026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 20:02:06.589399 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG dbcounter [-] [82025] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=82025) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 20:02:06.592446 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-933c0dc8-6035-4899-8ebe-33333fb7a14b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57539b6a6f3b4d589f5f5e1d211cd6a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b454f707d20347ada3d82aa85495635e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 20:02:06.593055 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-933c0dc8-6035-4899-8ebe-33333fb7a14b admin admin] REQUEST_METHOD: `GET` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:02:06.596989 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-933c0dc8-6035-4899-8ebe-33333fb7a14b admin admin] SCRIPT_NAME: `/identity` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:02:06.596989 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-933c0dc8-6035-4899-8ebe-33333fb7a14b admin admin] PATH_INFO: `/v3/domains` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:02:06.597244 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f0725d9-0a1e-4ddd-8a39-51151b1676cd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57539b6a6f3b4d589f5f5e1d211cd6a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b454f707d20347ada3d82aa85495635e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82025) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 20:02:06.597396 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-933c0dc8-6035-4899-8ebe-33333fb7a14b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82026) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 20:02:06.597396 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-933c0dc8-6035-4899-8ebe-33333fb7a14b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 20:02:06.597564 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f0725d9-0a1e-4ddd-8a39-51151b1676cd admin admin] REQUEST_METHOD: `DELETE` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:02:06.597564 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f0725d9-0a1e-4ddd-8a39-51151b1676cd admin admin] SCRIPT_NAME: `/identity` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:02:06.597564 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f0725d9-0a1e-4ddd-8a39-51151b1676cd admin admin] PATH_INFO: `/v3/users/8ad255b47e1242fe8c21d1a552487a92` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:02:06.597789 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-933c0dc8-6035-4899-8ebe-33333fb7a14b admin admin] RBAC: Authorization granted {{(pid=82026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 20:02:06.597880 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f0725d9-0a1e-4ddd-8a39-51151b1676cd admin admin] RBAC: Authorizing `identity:delete_user(user_id=8ad255b47e1242fe8c21d1a552487a92)` {{(pid=82025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 20:02:06.598487 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f0725d9-0a1e-4ddd-8a39-51151b1676cd admin admin] RBAC: Authorization granted {{(pid=82025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 20:02:06.608748 dv-cinder-828806-6-smb devstack@keystone.service[82026]: [pid: 82026|app: 0|req: 1142/2332] 10.222.0.33 () {58 vars in 1153 bytes} [Tue Sep 13 20:02:06 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 13 20:02:06.613464 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-933c0dc8-6035-4899-8ebe-33333fb7a14b admin admin] Authenticating user token {{(pid=82026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 20:02:06.623402 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-933c0dc8-6035-4899-8ebe-33333fb7a14b admin admin] Validating token access rules against request {{(pid=82026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 20:02:06.628834 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13710bd6-598a-4d43-81ec-519bbbd31604 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57539b6a6f3b4d589f5f5e1d211cd6a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b454f707d20347ada3d82aa85495635e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 20:02:06.629490 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13710bd6-598a-4d43-81ec-519bbbd31604 admin admin] REQUEST_METHOD: `POST` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:02:06.629778 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13710bd6-598a-4d43-81ec-519bbbd31604 admin admin] SCRIPT_NAME: `/identity` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:02:06.630080 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13710bd6-598a-4d43-81ec-519bbbd31604 admin admin] PATH_INFO: `/v3/projects` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:02:06.630721 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13710bd6-598a-4d43-81ec-519bbbd31604 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 20:02:06.632699 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13710bd6-598a-4d43-81ec-519bbbd31604 admin admin] RBAC: Authorization granted {{(pid=82026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 20:02:06.733152 dv-cinder-828806-6-smb devstack@keystone.service[82026]: [pid: 82026|app: 0|req: 1143/2333] 10.222.0.33 () {60 vars in 1153 bytes} [Tue Sep 13 20:02:06 2022] POST /identity/v3/projects => generated 377 bytes in 120 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 13 20:02:06.737443 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13710bd6-598a-4d43-81ec-519bbbd31604 admin admin] Authenticating user token {{(pid=82026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 20:02:06.803885 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13710bd6-598a-4d43-81ec-519bbbd31604 admin admin] Validating token access rules against request {{(pid=82026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 20:02:06.810878 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0bb67a3-acc2-48b3-ae2b-9f65389c3975 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57539b6a6f3b4d589f5f5e1d211cd6a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b454f707d20347ada3d82aa85495635e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 20:02:06.811527 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0bb67a3-acc2-48b3-ae2b-9f65389c3975 admin admin] REQUEST_METHOD: `POST` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:02:06.812072 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0bb67a3-acc2-48b3-ae2b-9f65389c3975 admin admin] SCRIPT_NAME: `/identity` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:02:06.812072 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0bb67a3-acc2-48b3-ae2b-9f65389c3975 admin admin] PATH_INFO: `/v3/users` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:02:06.813325 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0bb67a3-acc2-48b3-ae2b-9f65389c3975 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 20:02:06.814753 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0bb67a3-acc2-48b3-ae2b-9f65389c3975 admin admin] RBAC: Authorization granted {{(pid=82026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 20:02:06.821626 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.notifications [None req-9f0725d9-0a1e-4ddd-8a39-51151b1676cd admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8ad255b47e1242fe8c21d1a552487a92'} {{(pid=82025) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 20:02:06.829672 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG dbcounter [-] [82026] Writing DB stats keystone:SELECT=83,keystone:DELETE=15,keystone:INSERT=2 {{(pid=82026) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 20:02:06.914854 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.notifications [None req-9f0725d9-0a1e-4ddd-8a39-51151b1676cd admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8ad255b47e1242fe8c21d1a552487a92'} {{(pid=82025) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 20:02:06.915945 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.notifications [None req-9f0725d9-0a1e-4ddd-8a39-51151b1676cd admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8ad255b47e1242fe8c21d1a552487a92'} {{(pid=82025) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 20:02:06.921363 dv-cinder-828806-6-smb devstack@keystone.service[82026]: [pid: 82026|app: 0|req: 1144/2334] 10.222.0.33 () {60 vars in 1144 bytes} [Tue Sep 13 20:02:06 2022] POST /identity/v3/users => generated 289 bytes in 184 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 13 20:02:06.922193 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0bb67a3-acc2-48b3-ae2b-9f65389c3975 admin admin] Authenticating user token {{(pid=82026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 20:02:06.923900 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.common.fernet_utils [None req-d0bb67a3-acc2-48b3-ae2b-9f65389c3975 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82026) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 20:02:06.930072 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.notifications [None req-9f0725d9-0a1e-4ddd-8a39-51151b1676cd admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8ad255b47e1242fe8c21d1a552487a92'} {{(pid=82025) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 20:02:06.935916 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0bb67a3-acc2-48b3-ae2b-9f65389c3975 admin admin] Validating token access rules against request {{(pid=82026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 20:02:06.937585 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.notifications [None req-9f0725d9-0a1e-4ddd-8a39-51151b1676cd admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8ad255b47e1242fe8c21d1a552487a92'} {{(pid=82025) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 20:02:06.940752 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7eb1d493-2274-4871-adf9-045b24d3dc00 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57539b6a6f3b4d589f5f5e1d211cd6a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b454f707d20347ada3d82aa85495635e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 20:02:06.941527 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eb1d493-2274-4871-adf9-045b24d3dc00 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:02:06.941964 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eb1d493-2274-4871-adf9-045b24d3dc00 admin admin] SCRIPT_NAME: `/identity` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:02:06.942233 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eb1d493-2274-4871-adf9-045b24d3dc00 admin admin] PATH_INFO: `/v3/users/fd0c42df4806461a87cddbd3df54312a` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:02:06.943615 dv-cinder-828806-6-smb devstack@keystone.service[82025]: [pid: 82025|app: 0|req: 1191/2335] 10.222.0.33 () {58 vars in 1224 bytes} [Tue Sep 13 20:02:06 2022] DELETE /identity/v3/users/8ad255b47e1242fe8c21d1a552487a92 => generated 0 bytes in 441 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 13 20:02:06.944680 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f0725d9-0a1e-4ddd-8a39-51151b1676cd admin admin] Authenticating user token {{(pid=82025) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 20:02:06.945912 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.fernet_utils [None req-9f0725d9-0a1e-4ddd-8a39-51151b1676cd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82025) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 20:02:06.946991 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7eb1d493-2274-4871-adf9-045b24d3dc00 admin admin] RBAC: Authorizing `identity:delete_user(user_id=fd0c42df4806461a87cddbd3df54312a)` {{(pid=82026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 20:02:06.949592 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7eb1d493-2274-4871-adf9-045b24d3dc00 admin admin] RBAC: Authorization granted {{(pid=82026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 20:02:07.026326 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f0725d9-0a1e-4ddd-8a39-51151b1676cd admin admin] Validating token access rules against request {{(pid=82025) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 20:02:07.031578 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-067e2714-4764-4d57-96e5-52412f9c1010 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57539b6a6f3b4d589f5f5e1d211cd6a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b454f707d20347ada3d82aa85495635e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82025) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 20:02:07.032187 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-067e2714-4764-4d57-96e5-52412f9c1010 admin admin] REQUEST_METHOD: `GET` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:02:07.032520 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-067e2714-4764-4d57-96e5-52412f9c1010 admin admin] SCRIPT_NAME: `/identity` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:02:07.032800 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-067e2714-4764-4d57-96e5-52412f9c1010 admin admin] PATH_INFO: `/v3/roles` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:02:07.033445 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-067e2714-4764-4d57-96e5-52412f9c1010 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 20:02:07.035175 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-067e2714-4764-4d57-96e5-52412f9c1010 admin admin] RBAC: Authorization granted {{(pid=82025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 20:02:07.046087 dv-cinder-828806-6-smb devstack@keystone.service[82025]: [pid: 82025|app: 0|req: 1192/2336] 10.222.0.33 () {58 vars in 1122 bytes} [Tue Sep 13 20:02:06 2022] GET /identity/v3/roles => generated 1420 bytes in 102 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 13 20:02:07.047481 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c24b778e-c5ec-431a-856f-312c42d3dce1 None None] REQUEST_METHOD: `POST` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:02:07.047769 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c24b778e-c5ec-431a-856f-312c42d3dce1 None None] SCRIPT_NAME: `/identity` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:02:07.048060 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c24b778e-c5ec-431a-856f-312c42d3dce1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:02:07.066633 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.auth.core [None req-c24b778e-c5ec-431a-856f-312c42d3dce1 None None] MFA Rules not processed for user `57539b6a6f3b4d589f5f5e1d211cd6a0`. Rule list: `[]` (Enabled: `True`). {{(pid=82025) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 20:02:07.067880 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.fernet_utils [None req-c24b778e-c5ec-431a-856f-312c42d3dce1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82025) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 20:02:07.076116 dv-cinder-828806-6-smb devstack@keystone.service[82025]: [pid: 82025|app: 0|req: 1193/2337] 10.222.0.33 () {58 vars in 958 bytes} [Tue Sep 13 20:02:07 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 20:02:07.076918 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c24b778e-c5ec-431a-856f-312c42d3dce1 None None] Authenticating user token {{(pid=82025) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 20:02:07.087247 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c24b778e-c5ec-431a-856f-312c42d3dce1 None None] Validating token access rules against request {{(pid=82025) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 20:02:07.092477 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57fbbbcb-1bc4-467a-862c-517cdecd9303 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57539b6a6f3b4d589f5f5e1d211cd6a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b454f707d20347ada3d82aa85495635e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82025) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 20:02:07.093111 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57fbbbcb-1bc4-467a-862c-517cdecd9303 admin admin] REQUEST_METHOD: `GET` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:02:07.093395 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57fbbbcb-1bc4-467a-862c-517cdecd9303 admin admin] SCRIPT_NAME: `/identity` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:02:07.093672 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57fbbbcb-1bc4-467a-862c-517cdecd9303 admin admin] PATH_INFO: `/v3/roles` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:02:07.094313 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57fbbbcb-1bc4-467a-862c-517cdecd9303 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 20:02:07.095936 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57fbbbcb-1bc4-467a-862c-517cdecd9303 admin admin] RBAC: Authorization granted {{(pid=82025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 20:02:07.107232 dv-cinder-828806-6-smb devstack@keystone.service[82025]: [pid: 82025|app: 0|req: 1194/2338] 10.222.0.33 () {58 vars in 1122 bytes} [Tue Sep 13 20:02:07 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 13 20:02:07.111203 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57fbbbcb-1bc4-467a-862c-517cdecd9303 admin admin] Authenticating user token {{(pid=82025) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 20:02:07.112902 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.fernet_utils [None req-57fbbbcb-1bc4-467a-862c-517cdecd9303 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82025) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 20:02:07.143689 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG dbcounter [-] [82025] Writing DB stats keystone:SELECT=88,keystone:DELETE=10,keystone:INSERT=2 {{(pid=82025) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 20:02:07.172394 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.notifications [None req-7eb1d493-2274-4871-adf9-045b24d3dc00 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'fd0c42df4806461a87cddbd3df54312a'} {{(pid=82026) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 20:02:07.196080 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57fbbbcb-1bc4-467a-862c-517cdecd9303 admin admin] Validating token access rules against request {{(pid=82025) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 20:02:07.202767 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-370e40a7-8fcd-40e5-849a-983e7a435eaa service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '023a2c79c2444611b3d431928e56685d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8c6fba0f15b4d6a84ff601919b7b8e4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82025) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 20:02:07.203686 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-370e40a7-8fcd-40e5-849a-983e7a435eaa service neutron] REQUEST_METHOD: `GET` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:02:07.204263 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-370e40a7-8fcd-40e5-849a-983e7a435eaa service neutron] SCRIPT_NAME: `/identity` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:02:07.204649 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-370e40a7-8fcd-40e5-849a-983e7a435eaa service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:02:07.221482 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-370e40a7-8fcd-40e5-849a-983e7a435eaa service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 20:02:07.222924 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-370e40a7-8fcd-40e5-849a-983e7a435eaa service neutron] RBAC: Authorization granted {{(pid=82025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 20:02:07.233519 dv-cinder-828806-6-smb devstack@keystone.service[82025]: [pid: 82025|app: 0|req: 1195/2339] 10.222.0.33 () {60 vars in 1365 bytes} [Tue Sep 13 20:02:07 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 123 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 20:02:07.234293 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-370e40a7-8fcd-40e5-849a-983e7a435eaa service neutron] Authenticating user token {{(pid=82025) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 20:02:07.262890 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-370e40a7-8fcd-40e5-849a-983e7a435eaa service neutron] Validating token access rules against request {{(pid=82025) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 20:02:07.268794 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7700b2f-36e2-4efa-aded-90a290cac425 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57539b6a6f3b4d589f5f5e1d211cd6a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b454f707d20347ada3d82aa85495635e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82025) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 20:02:07.269723 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7700b2f-36e2-4efa-aded-90a290cac425 admin admin] REQUEST_METHOD: `PUT` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:02:07.270216 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7700b2f-36e2-4efa-aded-90a290cac425 admin admin] SCRIPT_NAME: `/identity` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:02:07.270718 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7700b2f-36e2-4efa-aded-90a290cac425 admin admin] PATH_INFO: `/v3/projects/ea9fabf6b61c4f0a8368c9a04af89fef/users/94e675328e1a4b01a947f3ad8e071f4e/roles/3618ab638a65401f82333da7596d1daf` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:02:07.287615 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.notifications [None req-7eb1d493-2274-4871-adf9-045b24d3dc00 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'fd0c42df4806461a87cddbd3df54312a'} {{(pid=82026) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 20:02:07.293290 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7700b2f-36e2-4efa-aded-90a290cac425 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ea9fabf6b61c4f0a8368c9a04af89fef, user_id=94e675328e1a4b01a947f3ad8e071f4e, role_id=3618ab638a65401f82333da7596d1daf)` {{(pid=82025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 20:02:07.302705 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7700b2f-36e2-4efa-aded-90a290cac425 admin admin] RBAC: Authorization granted {{(pid=82025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 20:02:07.320064 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.notifications [None req-7eb1d493-2274-4871-adf9-045b24d3dc00 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'fd0c42df4806461a87cddbd3df54312a'} {{(pid=82026) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 20:02:07.321682 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.notifications [None req-7eb1d493-2274-4871-adf9-045b24d3dc00 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'fd0c42df4806461a87cddbd3df54312a'} {{(pid=82026) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 20:02:07.335496 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.notifications [None req-7eb1d493-2274-4871-adf9-045b24d3dc00 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'fd0c42df4806461a87cddbd3df54312a'} {{(pid=82026) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 20:02:07.343460 dv-cinder-828806-6-smb devstack@keystone.service[82026]: [pid: 82026|app: 0|req: 1145/2340] 10.222.0.33 () {58 vars in 1224 bytes} [Tue Sep 13 20:02:06 2022] DELETE /identity/v3/users/fd0c42df4806461a87cddbd3df54312a => generated 0 bytes in 422 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 20:02:07.350331 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29e71b1b-8dc5-45c3-bfbb-d8e958725029 None None] REQUEST_METHOD: `POST` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:02:07.350625 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29e71b1b-8dc5-45c3-bfbb-d8e958725029 None None] SCRIPT_NAME: `/identity` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:02:07.351074 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29e71b1b-8dc5-45c3-bfbb-d8e958725029 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:02:07.370663 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.auth.core [None req-29e71b1b-8dc5-45c3-bfbb-d8e958725029 None None] MFA Rules not processed for user `57539b6a6f3b4d589f5f5e1d211cd6a0`. Rule list: `[]` (Enabled: `True`). {{(pid=82026) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 20:02:07.371985 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.common.fernet_utils [None req-29e71b1b-8dc5-45c3-bfbb-d8e958725029 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82026) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 20:02:07.446695 dv-cinder-828806-6-smb devstack@keystone.service[82025]: [pid: 82025|app: 0|req: 1196/2341] 10.222.0.33 () {60 vars in 1483 bytes} [Tue Sep 13 20:02:07 2022] PUT /identity/v3/projects/ea9fabf6b61c4f0a8368c9a04af89fef/users/94e675328e1a4b01a947f3ad8e071f4e/roles/3618ab638a65401f82333da7596d1daf => generated 0 bytes in 204 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 20:02:07.453632 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58253ef6-8568-4edd-af22-4475049eaa61 None None] REQUEST_METHOD: `POST` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:02:07.454119 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58253ef6-8568-4edd-af22-4475049eaa61 None None] SCRIPT_NAME: `/identity` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:02:07.454559 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58253ef6-8568-4edd-af22-4475049eaa61 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:02:07.463876 dv-cinder-828806-6-smb devstack@keystone.service[82026]: [pid: 82026|app: 0|req: 1146/2342] 10.222.0.33 () {58 vars in 958 bytes} [Tue Sep 13 20:02:07 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 20:02:07.474679 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29e71b1b-8dc5-45c3-bfbb-d8e958725029 None None] Authenticating user token {{(pid=82026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 20:02:07.476237 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.common.fernet_utils [None req-29e71b1b-8dc5-45c3-bfbb-d8e958725029 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82026) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 20:02:07.489892 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG dbcounter [-] [82026] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=82026) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 20:02:07.490868 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.auth.core [None req-58253ef6-8568-4edd-af22-4475049eaa61 None None] MFA Rules not processed for user `94e675328e1a4b01a947f3ad8e071f4e`. Rule list: `[]` (Enabled: `True`). {{(pid=82025) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 20:02:07.492183 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.fernet_utils [None req-58253ef6-8568-4edd-af22-4475049eaa61 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82025) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 20:02:07.559445 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29e71b1b-8dc5-45c3-bfbb-d8e958725029 None None] Validating token access rules against request {{(pid=82026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 20:02:07.569882 dv-cinder-828806-6-smb devstack@keystone.service[82025]: [pid: 82025|app: 0|req: 1197/2343] 10.222.0.33 () {58 vars in 958 bytes} [Tue Sep 13 20:02:07 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 20:02:07.574114 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58253ef6-8568-4edd-af22-4475049eaa61 None None] Authenticating user token {{(pid=82025) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 20:02:07.575992 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.fernet_utils [None req-58253ef6-8568-4edd-af22-4475049eaa61 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82025) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 20:02:07.618666 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51676dd5-f981-42d4-9262-fcfe0f3142e4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '023a2c79c2444611b3d431928e56685d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8c6fba0f15b4d6a84ff601919b7b8e4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 20:02:07.619354 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51676dd5-f981-42d4-9262-fcfe0f3142e4 service neutron] REQUEST_METHOD: `GET` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:02:07.619643 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51676dd5-f981-42d4-9262-fcfe0f3142e4 service neutron] SCRIPT_NAME: `/identity` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:02:07.619981 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51676dd5-f981-42d4-9262-fcfe0f3142e4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:02:07.645961 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58253ef6-8568-4edd-af22-4475049eaa61 None None] Validating token access rules against request {{(pid=82025) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 20:02:07.650879 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d90355d-3c01-4753-92bb-8d4d2e5d9c2d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57539b6a6f3b4d589f5f5e1d211cd6a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b454f707d20347ada3d82aa85495635e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82025) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 20:02:07.651628 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d90355d-3c01-4753-92bb-8d4d2e5d9c2d admin admin] REQUEST_METHOD: `POST` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:02:07.651914 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d90355d-3c01-4753-92bb-8d4d2e5d9c2d admin admin] SCRIPT_NAME: `/identity` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:02:07.652194 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d90355d-3c01-4753-92bb-8d4d2e5d9c2d admin admin] PATH_INFO: `/v3/projects` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:02:07.653410 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d90355d-3c01-4753-92bb-8d4d2e5d9c2d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 20:02:07.655669 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d90355d-3c01-4753-92bb-8d4d2e5d9c2d admin admin] RBAC: Authorization granted {{(pid=82025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 20:02:07.674418 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG dbcounter [-] [82025] Writing DB stats keystone:SELECT=87,keystone:DELETE=12,keystone:INSERT=1 {{(pid=82025) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 20:02:07.682277 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51676dd5-f981-42d4-9262-fcfe0f3142e4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 20:02:07.683958 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51676dd5-f981-42d4-9262-fcfe0f3142e4 service neutron] RBAC: Authorization granted {{(pid=82026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 20:02:07.694121 dv-cinder-828806-6-smb devstack@keystone.service[82026]: [pid: 82026|app: 0|req: 1147/2344] 10.222.0.33 () {60 vars in 1365 bytes} [Tue Sep 13 20:02:07 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 220 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 13 20:02:07.698840 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51676dd5-f981-42d4-9262-fcfe0f3142e4 service neutron] Authenticating user token {{(pid=82026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 20:02:07.700222 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.common.fernet_utils [None req-51676dd5-f981-42d4-9262-fcfe0f3142e4 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82026) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 20:02:07.713200 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51676dd5-f981-42d4-9262-fcfe0f3142e4 service neutron] Validating token access rules against request {{(pid=82026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 20:02:07.718616 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a6400e3-5957-4f8a-8ce8-b9fd5f096878 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57539b6a6f3b4d589f5f5e1d211cd6a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b454f707d20347ada3d82aa85495635e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 20:02:07.719286 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a6400e3-5957-4f8a-8ce8-b9fd5f096878 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:02:07.720380 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a6400e3-5957-4f8a-8ce8-b9fd5f096878 admin admin] SCRIPT_NAME: `/identity` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:02:07.720380 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a6400e3-5957-4f8a-8ce8-b9fd5f096878 admin admin] PATH_INFO: `/v3/projects/91b44b5d6f2c42b48b70bbd1852bc475` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:02:07.721032 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a6400e3-5957-4f8a-8ce8-b9fd5f096878 admin admin] RBAC: Authorizing `identity:delete_project(project_id=91b44b5d6f2c42b48b70bbd1852bc475)` {{(pid=82026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 20:02:07.722986 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a6400e3-5957-4f8a-8ce8-b9fd5f096878 admin admin] RBAC: Authorization granted {{(pid=82026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 20:02:07.734207 dv-cinder-828806-6-smb devstack@keystone.service[82025]: [pid: 82025|app: 0|req: 1198/2345] 10.222.0.33 () {60 vars in 1153 bytes} [Tue Sep 13 20:02:07 2022] POST /identity/v3/projects => generated 375 bytes in 160 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 13 20:02:07.737439 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d90355d-3c01-4753-92bb-8d4d2e5d9c2d admin admin] Authenticating user token {{(pid=82025) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 20:02:07.809821 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d90355d-3c01-4753-92bb-8d4d2e5d9c2d admin admin] Validating token access rules against request {{(pid=82025) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 20:02:07.814650 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e2fbd57-40f7-49f2-b14e-a5261716bd0d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57539b6a6f3b4d589f5f5e1d211cd6a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b454f707d20347ada3d82aa85495635e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82025) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 20:02:07.815299 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e2fbd57-40f7-49f2-b14e-a5261716bd0d admin admin] REQUEST_METHOD: `POST` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:02:07.815683 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e2fbd57-40f7-49f2-b14e-a5261716bd0d admin admin] SCRIPT_NAME: `/identity` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:02:07.815974 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e2fbd57-40f7-49f2-b14e-a5261716bd0d admin admin] PATH_INFO: `/v3/users` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:02:07.816613 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e2fbd57-40f7-49f2-b14e-a5261716bd0d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 20:02:07.818555 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e2fbd57-40f7-49f2-b14e-a5261716bd0d admin admin] RBAC: Authorization granted {{(pid=82025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 20:02:07.863197 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.notifications [None req-0a6400e3-5957-4f8a-8ce8-b9fd5f096878 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '91b44b5d6f2c42b48b70bbd1852bc475', 'request_id': 'req-0a6400e3-5957-4f8a-8ce8-b9fd5f096878'} {{(pid=82026) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 20:02:07.998329 dv-cinder-828806-6-smb devstack@keystone.service[82025]: [pid: 82025|app: 0|req: 1199/2346] 10.222.0.33 () {60 vars in 1144 bytes} [Tue Sep 13 20:02:07 2022] POST /identity/v3/users => generated 288 bytes in 259 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 13 20:02:08.000282 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e2fbd57-40f7-49f2-b14e-a5261716bd0d admin admin] Authenticating user token {{(pid=82025) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 20:02:08.011537 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e2fbd57-40f7-49f2-b14e-a5261716bd0d admin admin] Validating token access rules against request {{(pid=82025) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 20:02:08.029598 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.notifications [None req-0a6400e3-5957-4f8a-8ce8-b9fd5f096878 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '91b44b5d6f2c42b48b70bbd1852bc475', 'request_id': 'req-0a6400e3-5957-4f8a-8ce8-b9fd5f096878'} {{(pid=82026) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 20:02:08.036668 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.notifications [None req-0a6400e3-5957-4f8a-8ce8-b9fd5f096878 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '91b44b5d6f2c42b48b70bbd1852bc475', 'request_id': 'req-0a6400e3-5957-4f8a-8ce8-b9fd5f096878'} {{(pid=82026) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 20:02:08.050789 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.notifications [None req-0a6400e3-5957-4f8a-8ce8-b9fd5f096878 admin admin] The token cache is being invalidate because project 91b44b5d6f2c42b48b70bbd1852bc475 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82026) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 13 20:02:08.051132 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.notifications [None req-0a6400e3-5957-4f8a-8ce8-b9fd5f096878 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82026) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 20:02:08.051813 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.notifications [None req-0a6400e3-5957-4f8a-8ce8-b9fd5f096878 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82026) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 20:02:08.053331 dv-cinder-828806-6-smb devstack@keystone.service[82026]: [pid: 82026|app: 0|req: 1148/2347] 10.222.0.33 () {58 vars in 1233 bytes} [Tue Sep 13 20:02:07 2022] DELETE /identity/v3/projects/91b44b5d6f2c42b48b70bbd1852bc475 => generated 0 bytes in 355 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 13 20:02:08.057237 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a6400e3-5957-4f8a-8ce8-b9fd5f096878 admin admin] Authenticating user token {{(pid=82026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 20:02:08.058626 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.common.fernet_utils [None req-0a6400e3-5957-4f8a-8ce8-b9fd5f096878 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82026) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 20:02:08.076653 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ce8af60-2718-47d5-a897-22c2e9a7db6f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57539b6a6f3b4d589f5f5e1d211cd6a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b454f707d20347ada3d82aa85495635e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82025) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 20:02:08.077369 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ce8af60-2718-47d5-a897-22c2e9a7db6f admin admin] REQUEST_METHOD: `GET` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:02:08.077661 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ce8af60-2718-47d5-a897-22c2e9a7db6f admin admin] SCRIPT_NAME: `/identity` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:02:08.077962 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ce8af60-2718-47d5-a897-22c2e9a7db6f admin admin] PATH_INFO: `/v3/roles` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:02:08.078646 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ce8af60-2718-47d5-a897-22c2e9a7db6f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 20:02:08.080379 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ce8af60-2718-47d5-a897-22c2e9a7db6f admin admin] RBAC: Authorization granted {{(pid=82025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 20:02:08.093962 dv-cinder-828806-6-smb devstack@keystone.service[82025]: [pid: 82025|app: 0|req: 1200/2348] 10.222.0.33 () {58 vars in 1122 bytes} [Tue Sep 13 20:02:07 2022] GET /identity/v3/roles => generated 1420 bytes in 91 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 13 20:02:08.095019 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ce8af60-2718-47d5-a897-22c2e9a7db6f admin admin] Authenticating user token {{(pid=82025) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 20:02:08.096818 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.fernet_utils [None req-9ce8af60-2718-47d5-a897-22c2e9a7db6f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82025) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 20:02:08.109708 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ce8af60-2718-47d5-a897-22c2e9a7db6f admin admin] Validating token access rules against request {{(pid=82025) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 20:02:08.114872 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c3d5e93-82e8-4ae9-bbf0-a434d8751c39 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57539b6a6f3b4d589f5f5e1d211cd6a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b454f707d20347ada3d82aa85495635e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82025) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 20:02:08.115534 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c3d5e93-82e8-4ae9-bbf0-a434d8751c39 admin admin] REQUEST_METHOD: `GET` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:02:08.115898 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c3d5e93-82e8-4ae9-bbf0-a434d8751c39 admin admin] SCRIPT_NAME: `/identity` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:02:08.116253 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c3d5e93-82e8-4ae9-bbf0-a434d8751c39 admin admin] PATH_INFO: `/v3/roles` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:02:08.117063 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c3d5e93-82e8-4ae9-bbf0-a434d8751c39 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 20:02:08.118736 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c3d5e93-82e8-4ae9-bbf0-a434d8751c39 admin admin] RBAC: Authorization granted {{(pid=82025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 20:02:08.119814 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG dbcounter [-] [82026] Writing DB stats keystone:SELECT=86,keystone:DELETE=10,keystone:INSERT=4 {{(pid=82026) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 20:02:08.125547 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a6400e3-5957-4f8a-8ce8-b9fd5f096878 admin admin] Validating token access rules against request {{(pid=82026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 20:02:08.129795 dv-cinder-828806-6-smb devstack@keystone.service[82025]: [pid: 82025|app: 0|req: 1201/2349] 10.222.0.33 () {58 vars in 1122 bytes} [Tue Sep 13 20:02:08 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 13 20:02:08.130564 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e376e4c4-7f70-42d4-be6e-db881cb7603b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57539b6a6f3b4d589f5f5e1d211cd6a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b454f707d20347ada3d82aa85495635e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 20:02:08.131322 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e376e4c4-7f70-42d4-be6e-db881cb7603b admin admin] REQUEST_METHOD: `DELETE` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:02:08.131688 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e376e4c4-7f70-42d4-be6e-db881cb7603b admin admin] SCRIPT_NAME: `/identity` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:02:08.132044 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e376e4c4-7f70-42d4-be6e-db881cb7603b admin admin] PATH_INFO: `/v3/users/09032e49f9884e9ba4aeb26d1d9ffd5a` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:02:08.133749 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e376e4c4-7f70-42d4-be6e-db881cb7603b admin admin] RBAC: Authorizing `identity:delete_user(user_id=09032e49f9884e9ba4aeb26d1d9ffd5a)` {{(pid=82026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 20:02:08.133867 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c3d5e93-82e8-4ae9-bbf0-a434d8751c39 admin admin] Authenticating user token {{(pid=82025) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 20:02:08.135861 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e376e4c4-7f70-42d4-be6e-db881cb7603b admin admin] RBAC: Authorization granted {{(pid=82026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 20:02:08.153199 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c3d5e93-82e8-4ae9-bbf0-a434d8751c39 admin admin] Validating token access rules against request {{(pid=82025) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 20:02:08.157927 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87cede7a-75a2-4f39-b25f-bd3e5bddf293 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57539b6a6f3b4d589f5f5e1d211cd6a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b454f707d20347ada3d82aa85495635e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82025) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 20:02:08.158909 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87cede7a-75a2-4f39-b25f-bd3e5bddf293 admin admin] REQUEST_METHOD: `PUT` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:02:08.159327 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87cede7a-75a2-4f39-b25f-bd3e5bddf293 admin admin] SCRIPT_NAME: `/identity` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:02:08.159708 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87cede7a-75a2-4f39-b25f-bd3e5bddf293 admin admin] PATH_INFO: `/v3/projects/2a14dbe8e33743b6a0b6582f737f6721/users/1dc9998117c44d1f8ea673c68bca9ef3/roles/3618ab638a65401f82333da7596d1daf` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:02:08.180936 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87cede7a-75a2-4f39-b25f-bd3e5bddf293 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2a14dbe8e33743b6a0b6582f737f6721, user_id=1dc9998117c44d1f8ea673c68bca9ef3, role_id=3618ab638a65401f82333da7596d1daf)` {{(pid=82025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 20:02:08.185528 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87cede7a-75a2-4f39-b25f-bd3e5bddf293 admin admin] RBAC: Authorization granted {{(pid=82025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 20:02:08.295413 dv-cinder-828806-6-smb devstack@keystone.service[82025]: [pid: 82025|app: 0|req: 1202/2350] 10.222.0.33 () {60 vars in 1483 bytes} [Tue Sep 13 20:02:08 2022] PUT /identity/v3/projects/2a14dbe8e33743b6a0b6582f737f6721/users/1dc9998117c44d1f8ea673c68bca9ef3/roles/3618ab638a65401f82333da7596d1daf => generated 0 bytes in 152 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 13 20:02:08.295413 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87cede7a-75a2-4f39-b25f-bd3e5bddf293 admin admin] Authenticating user token {{(pid=82025) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 20:02:08.295413 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.fernet_utils [None req-87cede7a-75a2-4f39-b25f-bd3e5bddf293 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82025) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 20:02:08.364687 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87cede7a-75a2-4f39-b25f-bd3e5bddf293 admin admin] Validating token access rules against request {{(pid=82025) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 20:02:08.369664 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab77c738-f9f4-4d6e-904c-98c9231c9b2b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57539b6a6f3b4d589f5f5e1d211cd6a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b454f707d20347ada3d82aa85495635e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82025) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 20:02:08.371723 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab77c738-f9f4-4d6e-904c-98c9231c9b2b admin admin] REQUEST_METHOD: `DELETE` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:02:08.372397 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab77c738-f9f4-4d6e-904c-98c9231c9b2b admin admin] SCRIPT_NAME: `/identity` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:02:08.372989 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab77c738-f9f4-4d6e-904c-98c9231c9b2b admin admin] PATH_INFO: `/v3/projects/e91595e4ccb64d1daa810bfa8015cc95` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:02:08.374084 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab77c738-f9f4-4d6e-904c-98c9231c9b2b admin admin] RBAC: Authorizing `identity:delete_project(project_id=e91595e4ccb64d1daa810bfa8015cc95)` {{(pid=82025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 20:02:08.377118 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab77c738-f9f4-4d6e-904c-98c9231c9b2b admin admin] RBAC: Authorization granted {{(pid=82025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 20:02:08.397114 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.notifications [None req-e376e4c4-7f70-42d4-be6e-db881cb7603b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '09032e49f9884e9ba4aeb26d1d9ffd5a'} {{(pid=82026) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 20:02:08.405932 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG dbcounter [-] [82025] Writing DB stats keystone:SELECT=83,keystone:DELETE=15,keystone:INSERT=2 {{(pid=82025) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 20:02:08.502776 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.notifications [None req-e376e4c4-7f70-42d4-be6e-db881cb7603b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '09032e49f9884e9ba4aeb26d1d9ffd5a'} {{(pid=82026) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 20:02:08.512737 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.notifications [None req-ab77c738-f9f4-4d6e-904c-98c9231c9b2b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e91595e4ccb64d1daa810bfa8015cc95', 'request_id': 'req-ab77c738-f9f4-4d6e-904c-98c9231c9b2b'} {{(pid=82025) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 20:02:08.516551 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.notifications [None req-e376e4c4-7f70-42d4-be6e-db881cb7603b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '09032e49f9884e9ba4aeb26d1d9ffd5a'} {{(pid=82026) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 20:02:08.517924 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.notifications [None req-e376e4c4-7f70-42d4-be6e-db881cb7603b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '09032e49f9884e9ba4aeb26d1d9ffd5a'} {{(pid=82026) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 20:02:08.519190 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.notifications [None req-ab77c738-f9f4-4d6e-904c-98c9231c9b2b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e91595e4ccb64d1daa810bfa8015cc95', 'request_id': 'req-ab77c738-f9f4-4d6e-904c-98c9231c9b2b'} {{(pid=82025) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 20:02:08.526071 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.notifications [None req-ab77c738-f9f4-4d6e-904c-98c9231c9b2b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e91595e4ccb64d1daa810bfa8015cc95', 'request_id': 'req-ab77c738-f9f4-4d6e-904c-98c9231c9b2b'} {{(pid=82025) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 20:02:08.533634 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.notifications [None req-e376e4c4-7f70-42d4-be6e-db881cb7603b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '09032e49f9884e9ba4aeb26d1d9ffd5a'} {{(pid=82026) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 20:02:08.552341 dv-cinder-828806-6-smb devstack@keystone.service[82026]: [pid: 82026|app: 0|req: 1149/2351] 10.222.0.33 () {58 vars in 1224 bytes} [Tue Sep 13 20:02:08 2022] DELETE /identity/v3/users/09032e49f9884e9ba4aeb26d1d9ffd5a => generated 0 bytes in 493 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 13 20:02:08.552341 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32ecc4e6-0809-46fb-85b4-32b4675d8798 None None] REQUEST_METHOD: `POST` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:02:08.552753 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32ecc4e6-0809-46fb-85b4-32b4675d8798 None None] SCRIPT_NAME: `/identity` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:02:08.553321 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32ecc4e6-0809-46fb-85b4-32b4675d8798 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:02:08.588871 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.auth.core [None req-32ecc4e6-0809-46fb-85b4-32b4675d8798 None None] MFA Rules not processed for user `1dc9998117c44d1f8ea673c68bca9ef3`. Rule list: `[]` (Enabled: `True`). {{(pid=82026) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 20:02:08.591071 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.common.fernet_utils [None req-32ecc4e6-0809-46fb-85b4-32b4675d8798 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82026) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 20:02:08.633911 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.notifications [None req-ab77c738-f9f4-4d6e-904c-98c9231c9b2b admin admin] The token cache is being invalidate because project e91595e4ccb64d1daa810bfa8015cc95 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82025) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 13 20:02:08.634124 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.notifications [None req-ab77c738-f9f4-4d6e-904c-98c9231c9b2b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82025) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 20:02:08.634943 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.notifications [None req-ab77c738-f9f4-4d6e-904c-98c9231c9b2b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82025) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 20:02:08.639624 dv-cinder-828806-6-smb devstack@keystone.service[82025]: [pid: 82025|app: 0|req: 1203/2352] 10.222.0.33 () {58 vars in 1233 bytes} [Tue Sep 13 20:02:08 2022] DELETE /identity/v3/projects/e91595e4ccb64d1daa810bfa8015cc95 => generated 0 bytes in 350 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 20:02:08.641043 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab77c738-f9f4-4d6e-904c-98c9231c9b2b admin admin] Authenticating user token {{(pid=82025) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 20:02:08.642784 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.fernet_utils [None req-ab77c738-f9f4-4d6e-904c-98c9231c9b2b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82025) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 20:02:08.670260 dv-cinder-828806-6-smb devstack@keystone.service[82026]: [pid: 82026|app: 0|req: 1150/2353] 10.222.0.33 () {58 vars in 958 bytes} [Tue Sep 13 20:02:08 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 20:02:08.680020 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32ecc4e6-0809-46fb-85b4-32b4675d8798 None None] Authenticating user token {{(pid=82026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 20:02:08.681543 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.common.fernet_utils [None req-32ecc4e6-0809-46fb-85b4-32b4675d8798 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82026) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 20:02:08.734206 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab77c738-f9f4-4d6e-904c-98c9231c9b2b admin admin] Validating token access rules against request {{(pid=82025) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 20:02:08.756724 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32ecc4e6-0809-46fb-85b4-32b4675d8798 None None] Validating token access rules against request {{(pid=82026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 20:02:08.761623 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-301a52ad-864e-464b-8b00-3d5d73ce56eb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57539b6a6f3b4d589f5f5e1d211cd6a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b454f707d20347ada3d82aa85495635e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 20:02:08.762752 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-301a52ad-864e-464b-8b00-3d5d73ce56eb admin admin] REQUEST_METHOD: `POST` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:02:08.763076 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-301a52ad-864e-464b-8b00-3d5d73ce56eb admin admin] SCRIPT_NAME: `/identity` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:02:08.763331 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-301a52ad-864e-464b-8b00-3d5d73ce56eb admin admin] PATH_INFO: `/v3/projects` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:02:08.763963 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-301a52ad-864e-464b-8b00-3d5d73ce56eb admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 20:02:08.765887 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-301a52ad-864e-464b-8b00-3d5d73ce56eb admin admin] RBAC: Authorization granted {{(pid=82026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 20:02:08.807168 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff8d88f1-8af8-4a40-8b03-c4a8bd5e5252 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57539b6a6f3b4d589f5f5e1d211cd6a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b454f707d20347ada3d82aa85495635e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82025) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 20:02:08.807972 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff8d88f1-8af8-4a40-8b03-c4a8bd5e5252 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:02:08.808422 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff8d88f1-8af8-4a40-8b03-c4a8bd5e5252 admin admin] SCRIPT_NAME: `/identity` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:02:08.808831 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff8d88f1-8af8-4a40-8b03-c4a8bd5e5252 admin admin] PATH_INFO: `/v3/users/2949c26afa6d4b83b7f2ca472959b675` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:02:08.810197 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff8d88f1-8af8-4a40-8b03-c4a8bd5e5252 admin admin] RBAC: Authorizing `identity:delete_user(user_id=2949c26afa6d4b83b7f2ca472959b675)` {{(pid=82025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 20:02:08.812275 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff8d88f1-8af8-4a40-8b03-c4a8bd5e5252 admin admin] RBAC: Authorization granted {{(pid=82025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 20:02:08.893571 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG dbcounter [-] [82026] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82026) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 20:02:08.901074 dv-cinder-828806-6-smb devstack@keystone.service[82026]: [pid: 82026|app: 0|req: 1151/2354] 10.222.0.33 () {60 vars in 1153 bytes} [Tue Sep 13 20:02:08 2022] POST /identity/v3/projects => generated 377 bytes in 221 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 13 20:02:08.905592 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-301a52ad-864e-464b-8b00-3d5d73ce56eb admin admin] Authenticating user token {{(pid=82026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 20:02:08.973543 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-301a52ad-864e-464b-8b00-3d5d73ce56eb admin admin] Validating token access rules against request {{(pid=82026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 20:02:08.978625 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05d40cef-dbb8-4e42-97e4-59dca048da76 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57539b6a6f3b4d589f5f5e1d211cd6a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b454f707d20347ada3d82aa85495635e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 20:02:08.979271 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05d40cef-dbb8-4e42-97e4-59dca048da76 admin admin] REQUEST_METHOD: `POST` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:02:08.979567 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05d40cef-dbb8-4e42-97e4-59dca048da76 admin admin] SCRIPT_NAME: `/identity` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:02:08.979848 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05d40cef-dbb8-4e42-97e4-59dca048da76 admin admin] PATH_INFO: `/v3/users` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:02:08.980755 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05d40cef-dbb8-4e42-97e4-59dca048da76 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 20:02:08.982559 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05d40cef-dbb8-4e42-97e4-59dca048da76 admin admin] RBAC: Authorization granted {{(pid=82026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 20:02:09.014148 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.notifications [None req-ff8d88f1-8af8-4a40-8b03-c4a8bd5e5252 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2949c26afa6d4b83b7f2ca472959b675'} {{(pid=82025) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 20:02:09.131784 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.notifications [None req-ff8d88f1-8af8-4a40-8b03-c4a8bd5e5252 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2949c26afa6d4b83b7f2ca472959b675'} {{(pid=82025) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 20:02:09.132648 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.notifications [None req-ff8d88f1-8af8-4a40-8b03-c4a8bd5e5252 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2949c26afa6d4b83b7f2ca472959b675'} {{(pid=82025) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 20:02:09.155280 dv-cinder-828806-6-smb devstack@keystone.service[82026]: [pid: 82026|app: 0|req: 1152/2355] 10.222.0.33 () {60 vars in 1144 bytes} [Tue Sep 13 20:02:08 2022] POST /identity/v3/users => generated 295 bytes in 234 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 13 20:02:09.155280 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05d40cef-dbb8-4e42-97e4-59dca048da76 admin admin] Authenticating user token {{(pid=82026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 20:02:09.155280 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.common.fernet_utils [None req-05d40cef-dbb8-4e42-97e4-59dca048da76 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82026) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 20:02:09.155944 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.notifications [None req-ff8d88f1-8af8-4a40-8b03-c4a8bd5e5252 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2949c26afa6d4b83b7f2ca472959b675'} {{(pid=82025) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 20:02:09.159509 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.notifications [None req-ff8d88f1-8af8-4a40-8b03-c4a8bd5e5252 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2949c26afa6d4b83b7f2ca472959b675'} {{(pid=82025) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 20:02:09.161621 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05d40cef-dbb8-4e42-97e4-59dca048da76 admin admin] Validating token access rules against request {{(pid=82026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 20:02:09.166076 dv-cinder-828806-6-smb devstack@keystone.service[82025]: [pid: 82025|app: 0|req: 1204/2356] 10.222.0.33 () {58 vars in 1224 bytes} [Tue Sep 13 20:02:08 2022] DELETE /identity/v3/users/2949c26afa6d4b83b7f2ca472959b675 => generated 0 bytes in 525 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 20:02:09.169715 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88ba9314-5627-4cb1-a5ab-1ea05d818829 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57539b6a6f3b4d589f5f5e1d211cd6a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b454f707d20347ada3d82aa85495635e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 20:02:09.171089 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff8d88f1-8af8-4a40-8b03-c4a8bd5e5252 admin admin] Authenticating user token {{(pid=82025) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 20:02:09.172502 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.fernet_utils [None req-ff8d88f1-8af8-4a40-8b03-c4a8bd5e5252 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82025) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 20:02:09.179691 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88ba9314-5627-4cb1-a5ab-1ea05d818829 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:02:09.179691 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88ba9314-5627-4cb1-a5ab-1ea05d818829 admin admin] SCRIPT_NAME: `/identity` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:02:09.179691 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88ba9314-5627-4cb1-a5ab-1ea05d818829 admin admin] PATH_INFO: `/v3/projects/bcb403ec029841078a350dccadde86ca` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:02:09.180704 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88ba9314-5627-4cb1-a5ab-1ea05d818829 admin admin] RBAC: Authorizing `identity:delete_project(project_id=bcb403ec029841078a350dccadde86ca)` {{(pid=82026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 20:02:09.182579 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88ba9314-5627-4cb1-a5ab-1ea05d818829 admin admin] RBAC: Authorization granted {{(pid=82026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 20:02:09.248107 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff8d88f1-8af8-4a40-8b03-c4a8bd5e5252 admin admin] Validating token access rules against request {{(pid=82025) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 20:02:09.254039 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ada11a87-245d-40cc-a0a6-d026f341c6d7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57539b6a6f3b4d589f5f5e1d211cd6a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b454f707d20347ada3d82aa85495635e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82025) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 20:02:09.254726 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ada11a87-245d-40cc-a0a6-d026f341c6d7 admin admin] REQUEST_METHOD: `GET` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:02:09.255018 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ada11a87-245d-40cc-a0a6-d026f341c6d7 admin admin] SCRIPT_NAME: `/identity` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:02:09.255452 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ada11a87-245d-40cc-a0a6-d026f341c6d7 admin admin] PATH_INFO: `/v3/roles` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:02:09.257070 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ada11a87-245d-40cc-a0a6-d026f341c6d7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 20:02:09.259269 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ada11a87-245d-40cc-a0a6-d026f341c6d7 admin admin] RBAC: Authorization granted {{(pid=82025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 20:02:09.272760 dv-cinder-828806-6-smb devstack@keystone.service[82025]: [pid: 82025|app: 0|req: 1205/2357] 10.222.0.33 () {58 vars in 1122 bytes} [Tue Sep 13 20:02:09 2022] GET /identity/v3/roles => generated 1420 bytes in 102 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 13 20:02:09.276695 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ada11a87-245d-40cc-a0a6-d026f341c6d7 admin admin] Authenticating user token {{(pid=82025) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 20:02:09.287825 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ada11a87-245d-40cc-a0a6-d026f341c6d7 admin admin] Validating token access rules against request {{(pid=82025) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 20:02:09.292638 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-333d02cc-e088-47f9-97f2-510e562f2d8e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57539b6a6f3b4d589f5f5e1d211cd6a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b454f707d20347ada3d82aa85495635e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82025) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 20:02:09.293596 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-333d02cc-e088-47f9-97f2-510e562f2d8e admin admin] REQUEST_METHOD: `PUT` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:02:09.293708 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-333d02cc-e088-47f9-97f2-510e562f2d8e admin admin] SCRIPT_NAME: `/identity` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:02:09.293971 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-333d02cc-e088-47f9-97f2-510e562f2d8e admin admin] PATH_INFO: `/v3/projects/75e7e63fc816498d94bbf8a2ba54f046/users/a885d68f98e24e9d88d30709f08097a0/roles/e5af7d5baa93469e9e486ef21c85474e` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:02:09.310234 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-333d02cc-e088-47f9-97f2-510e562f2d8e admin admin] RBAC: Authorizing `identity:create_grant(project_id=75e7e63fc816498d94bbf8a2ba54f046, user_id=a885d68f98e24e9d88d30709f08097a0, role_id=e5af7d5baa93469e9e486ef21c85474e)` {{(pid=82025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 20:02:09.313153 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-333d02cc-e088-47f9-97f2-510e562f2d8e admin admin] RBAC: Authorization granted {{(pid=82025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 20:02:09.408448 dv-cinder-828806-6-smb devstack@keystone.service[82025]: [pid: 82025|app: 0|req: 1206/2358] 10.222.0.33 () {60 vars in 1483 bytes} [Tue Sep 13 20:02:09 2022] PUT /identity/v3/projects/75e7e63fc816498d94bbf8a2ba54f046/users/a885d68f98e24e9d88d30709f08097a0/roles/e5af7d5baa93469e9e486ef21c85474e => generated 0 bytes in 132 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 13 20:02:09.412023 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-333d02cc-e088-47f9-97f2-510e562f2d8e admin admin] Authenticating user token {{(pid=82025) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 20:02:09.419879 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.notifications [None req-88ba9314-5627-4cb1-a5ab-1ea05d818829 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'bcb403ec029841078a350dccadde86ca', 'request_id': 'req-88ba9314-5627-4cb1-a5ab-1ea05d818829'} {{(pid=82026) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 20:02:09.477956 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-333d02cc-e088-47f9-97f2-510e562f2d8e admin admin] Validating token access rules against request {{(pid=82025) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 20:02:09.515979 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.notifications [None req-88ba9314-5627-4cb1-a5ab-1ea05d818829 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'bcb403ec029841078a350dccadde86ca', 'request_id': 'req-88ba9314-5627-4cb1-a5ab-1ea05d818829'} {{(pid=82026) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 20:02:09.516516 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG dbcounter [-] [82025] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=82025) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 20:02:09.529172 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.notifications [None req-88ba9314-5627-4cb1-a5ab-1ea05d818829 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'bcb403ec029841078a350dccadde86ca', 'request_id': 'req-88ba9314-5627-4cb1-a5ab-1ea05d818829'} {{(pid=82026) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 20:02:09.546403 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd6ded95-c2bd-4ad9-b54a-e76d75ff07ba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57539b6a6f3b4d589f5f5e1d211cd6a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b454f707d20347ada3d82aa85495635e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82025) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 20:02:09.547073 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd6ded95-c2bd-4ad9-b54a-e76d75ff07ba admin admin] REQUEST_METHOD: `GET` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:02:09.547556 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd6ded95-c2bd-4ad9-b54a-e76d75ff07ba admin admin] SCRIPT_NAME: `/identity` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:02:09.547785 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd6ded95-c2bd-4ad9-b54a-e76d75ff07ba admin admin] PATH_INFO: `/v3/roles` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:02:09.548449 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd6ded95-c2bd-4ad9-b54a-e76d75ff07ba admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 20:02:09.549433 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.notifications [None req-88ba9314-5627-4cb1-a5ab-1ea05d818829 admin admin] The token cache is being invalidate because project bcb403ec029841078a350dccadde86ca was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82026) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 13 20:02:09.550125 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.notifications [None req-88ba9314-5627-4cb1-a5ab-1ea05d818829 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82026) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 20:02:09.550246 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd6ded95-c2bd-4ad9-b54a-e76d75ff07ba admin admin] RBAC: Authorization granted {{(pid=82025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 20:02:09.550790 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.notifications [None req-88ba9314-5627-4cb1-a5ab-1ea05d818829 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82026) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 20:02:09.552561 dv-cinder-828806-6-smb devstack@keystone.service[82026]: [pid: 82026|app: 0|req: 1153/2359] 10.222.0.33 () {58 vars in 1233 bytes} [Tue Sep 13 20:02:09 2022] DELETE /identity/v3/projects/bcb403ec029841078a350dccadde86ca => generated 0 bytes in 410 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 13 20:02:09.556372 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88ba9314-5627-4cb1-a5ab-1ea05d818829 admin admin] Authenticating user token {{(pid=82026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 20:02:09.557851 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.common.fernet_utils [None req-88ba9314-5627-4cb1-a5ab-1ea05d818829 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82026) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 20:02:09.562039 dv-cinder-828806-6-smb devstack@keystone.service[82025]: [pid: 82025|app: 0|req: 1207/2360] 10.222.0.33 () {58 vars in 1122 bytes} [Tue Sep 13 20:02:09 2022] GET /identity/v3/roles => generated 1420 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 13 20:02:09.565725 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd6ded95-c2bd-4ad9-b54a-e76d75ff07ba admin admin] Authenticating user token {{(pid=82025) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 20:02:09.568129 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.fernet_utils [None req-fd6ded95-c2bd-4ad9-b54a-e76d75ff07ba admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82025) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 20:02:09.571487 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88ba9314-5627-4cb1-a5ab-1ea05d818829 admin admin] Validating token access rules against request {{(pid=82026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 20:02:09.576159 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae839b05-fd55-42e2-b256-2ae4090a7d90 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57539b6a6f3b4d589f5f5e1d211cd6a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b454f707d20347ada3d82aa85495635e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 20:02:09.576787 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae839b05-fd55-42e2-b256-2ae4090a7d90 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:02:09.580654 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae839b05-fd55-42e2-b256-2ae4090a7d90 admin admin] SCRIPT_NAME: `/identity` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:02:09.580654 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae839b05-fd55-42e2-b256-2ae4090a7d90 admin admin] PATH_INFO: `/v3/users/33bf635fd2e2494fa89213879f576c80` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:02:09.580654 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae839b05-fd55-42e2-b256-2ae4090a7d90 admin admin] RBAC: Authorizing `identity:delete_user(user_id=33bf635fd2e2494fa89213879f576c80)` {{(pid=82026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 20:02:09.580654 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae839b05-fd55-42e2-b256-2ae4090a7d90 admin admin] RBAC: Authorization granted {{(pid=82026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 20:02:09.581007 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd6ded95-c2bd-4ad9-b54a-e76d75ff07ba admin admin] Validating token access rules against request {{(pid=82025) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 20:02:09.590518 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59066c84-cdf8-4dbd-b299-5165e4e7f906 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57539b6a6f3b4d589f5f5e1d211cd6a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b454f707d20347ada3d82aa85495635e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82025) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 20:02:09.591608 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59066c84-cdf8-4dbd-b299-5165e4e7f906 admin admin] REQUEST_METHOD: `PUT` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:02:09.592134 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59066c84-cdf8-4dbd-b299-5165e4e7f906 admin admin] SCRIPT_NAME: `/identity` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:02:09.592419 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59066c84-cdf8-4dbd-b299-5165e4e7f906 admin admin] PATH_INFO: `/v3/projects/75e7e63fc816498d94bbf8a2ba54f046/users/a885d68f98e24e9d88d30709f08097a0/roles/e5af7d5baa93469e9e486ef21c85474e` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:02:09.594608 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59066c84-cdf8-4dbd-b299-5165e4e7f906 admin admin] RBAC: Authorizing `identity:create_grant(project_id=75e7e63fc816498d94bbf8a2ba54f046, user_id=a885d68f98e24e9d88d30709f08097a0, role_id=e5af7d5baa93469e9e486ef21c85474e)` {{(pid=82025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 20:02:09.597506 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59066c84-cdf8-4dbd-b299-5165e4e7f906 admin admin] RBAC: Authorization granted {{(pid=82025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 20:02:09.610960 dv-cinder-828806-6-smb devstack@keystone.service[82025]: [pid: 82025|app: 0|req: 1208/2361] 10.222.0.33 () {60 vars in 1483 bytes} [Tue Sep 13 20:02:09 2022] PUT /identity/v3/projects/75e7e63fc816498d94bbf8a2ba54f046/users/a885d68f98e24e9d88d30709f08097a0/roles/e5af7d5baa93469e9e486ef21c85474e => generated 0 bytes in 46 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 13 20:02:09.621893 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aed90399-652c-4c96-8b3f-39430105181f None None] REQUEST_METHOD: `POST` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:02:09.622253 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aed90399-652c-4c96-8b3f-39430105181f None None] SCRIPT_NAME: `/identity` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:02:09.622563 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aed90399-652c-4c96-8b3f-39430105181f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:02:09.657915 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.auth.core [None req-aed90399-652c-4c96-8b3f-39430105181f None None] MFA Rules not processed for user `a885d68f98e24e9d88d30709f08097a0`. Rule list: `[]` (Enabled: `True`). {{(pid=82025) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 20:02:09.659249 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.fernet_utils [None req-aed90399-652c-4c96-8b3f-39430105181f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82025) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 20:02:09.663004 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG dbcounter [-] [82026] Writing DB stats keystone:SELECT=88,keystone:DELETE=7,keystone:INSERT=5 {{(pid=82026) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 20:02:09.733455 dv-cinder-828806-6-smb devstack@keystone.service[82025]: [pid: 82025|app: 0|req: 1209/2362] 10.222.0.33 () {58 vars in 958 bytes} [Tue Sep 13 20:02:09 2022] POST /identity/v3/auth/tokens => generated 3321 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 13 20:02:09.734490 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aed90399-652c-4c96-8b3f-39430105181f None None] Authenticating user token {{(pid=82025) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 20:02:09.736002 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.fernet_utils [None req-aed90399-652c-4c96-8b3f-39430105181f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82025) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 20:02:09.809923 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aed90399-652c-4c96-8b3f-39430105181f None None] Validating token access rules against request {{(pid=82025) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 20:02:09.814661 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93f94c21-4d3c-409a-867e-8ee392f729e7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57539b6a6f3b4d589f5f5e1d211cd6a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b454f707d20347ada3d82aa85495635e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82025) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 20:02:09.815365 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93f94c21-4d3c-409a-867e-8ee392f729e7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:02:09.815642 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93f94c21-4d3c-409a-867e-8ee392f729e7 admin admin] SCRIPT_NAME: `/identity` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:02:09.815917 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93f94c21-4d3c-409a-867e-8ee392f729e7 admin admin] PATH_INFO: `/v3/projects/8497245b0f0c43cf8bcfe13925de6589` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:02:09.817075 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93f94c21-4d3c-409a-867e-8ee392f729e7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=8497245b0f0c43cf8bcfe13925de6589)` {{(pid=82025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 20:02:09.818989 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93f94c21-4d3c-409a-867e-8ee392f729e7 admin admin] RBAC: Authorization granted {{(pid=82025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 20:02:09.852693 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.notifications [None req-ae839b05-fd55-42e2-b256-2ae4090a7d90 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '33bf635fd2e2494fa89213879f576c80'} {{(pid=82026) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 20:02:09.988817 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.notifications [None req-ae839b05-fd55-42e2-b256-2ae4090a7d90 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '33bf635fd2e2494fa89213879f576c80'} {{(pid=82026) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 20:02:10.002428 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.notifications [None req-ae839b05-fd55-42e2-b256-2ae4090a7d90 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '33bf635fd2e2494fa89213879f576c80'} {{(pid=82026) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 20:02:10.003180 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.notifications [None req-ae839b05-fd55-42e2-b256-2ae4090a7d90 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '33bf635fd2e2494fa89213879f576c80'} {{(pid=82026) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 20:02:10.009320 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.notifications [None req-93f94c21-4d3c-409a-867e-8ee392f729e7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8497245b0f0c43cf8bcfe13925de6589', 'request_id': 'req-93f94c21-4d3c-409a-867e-8ee392f729e7'} {{(pid=82025) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 20:02:10.010929 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.notifications [None req-ae839b05-fd55-42e2-b256-2ae4090a7d90 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '33bf635fd2e2494fa89213879f576c80'} {{(pid=82026) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 20:02:10.015596 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.notifications [None req-93f94c21-4d3c-409a-867e-8ee392f729e7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8497245b0f0c43cf8bcfe13925de6589', 'request_id': 'req-93f94c21-4d3c-409a-867e-8ee392f729e7'} {{(pid=82025) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 20:02:10.017801 dv-cinder-828806-6-smb devstack@keystone.service[82026]: [pid: 82026|app: 0|req: 1154/2363] 10.222.0.33 () {58 vars in 1224 bytes} [Tue Sep 13 20:02:09 2022] DELETE /identity/v3/users/33bf635fd2e2494fa89213879f576c80 => generated 0 bytes in 462 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 13 20:02:10.018863 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae839b05-fd55-42e2-b256-2ae4090a7d90 admin admin] Authenticating user token {{(pid=82026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 20:02:10.020519 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.common.fernet_utils [None req-ae839b05-fd55-42e2-b256-2ae4090a7d90 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82026) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 20:02:10.023655 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.notifications [None req-93f94c21-4d3c-409a-867e-8ee392f729e7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8497245b0f0c43cf8bcfe13925de6589', 'request_id': 'req-93f94c21-4d3c-409a-867e-8ee392f729e7'} {{(pid=82025) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 20:02:10.085949 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae839b05-fd55-42e2-b256-2ae4090a7d90 admin admin] Validating token access rules against request {{(pid=82026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 20:02:10.090999 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a5310aa-0c4d-4177-bf4b-b4ace4911634 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46024fc6167f4321818b1bed27a521a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8c6fba0f15b4d6a84ff601919b7b8e4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 20:02:10.091816 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a5310aa-0c4d-4177-bf4b-b4ace4911634 service cinder] REQUEST_METHOD: `GET` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:02:10.092105 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a5310aa-0c4d-4177-bf4b-b4ace4911634 service cinder] SCRIPT_NAME: `/identity` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:02:10.092383 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a5310aa-0c4d-4177-bf4b-b4ace4911634 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:02:10.094418 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.common.fernet_utils [None req-2a5310aa-0c4d-4177-bf4b-b4ace4911634 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82026) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 20:02:10.164240 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a5310aa-0c4d-4177-bf4b-b4ace4911634 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=82026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 20:02:10.166007 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a5310aa-0c4d-4177-bf4b-b4ace4911634 service cinder] RBAC: Authorization granted {{(pid=82026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 20:02:10.181349 dv-cinder-828806-6-smb devstack@keystone.service[82026]: [pid: 82026|app: 0|req: 1155/2364] 10.222.0.33 () {60 vars in 1365 bytes} [Tue Sep 13 20:02:10 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 163 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 20:02:10.185206 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.notifications [None req-93f94c21-4d3c-409a-867e-8ee392f729e7 admin admin] The token cache is being invalidate because project 8497245b0f0c43cf8bcfe13925de6589 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82025) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 13 20:02:10.185863 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.notifications [None req-93f94c21-4d3c-409a-867e-8ee392f729e7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82025) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 20:02:10.187069 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.notifications [None req-93f94c21-4d3c-409a-867e-8ee392f729e7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82025) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 20:02:10.189061 dv-cinder-828806-6-smb devstack@keystone.service[82025]: [pid: 82025|app: 0|req: 1210/2365] 10.222.0.33 () {58 vars in 1233 bytes} [Tue Sep 13 20:02:09 2022] DELETE /identity/v3/projects/8497245b0f0c43cf8bcfe13925de6589 => generated 0 bytes in 455 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 20:02:10.194881 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a5310aa-0c4d-4177-bf4b-b4ace4911634 service cinder] Authenticating user token {{(pid=82026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 20:02:10.199199 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.common.fernet_utils [None req-2a5310aa-0c4d-4177-bf4b-b4ace4911634 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82026) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 20:02:10.278588 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a5310aa-0c4d-4177-bf4b-b4ace4911634 service cinder] Validating token access rules against request {{(pid=82026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 20:02:10.283981 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c01591ad-9594-4916-b6f4-86eaf6298197 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57539b6a6f3b4d589f5f5e1d211cd6a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b454f707d20347ada3d82aa85495635e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 20:02:10.284714 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c01591ad-9594-4916-b6f4-86eaf6298197 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:02:10.285205 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c01591ad-9594-4916-b6f4-86eaf6298197 admin admin] SCRIPT_NAME: `/identity` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:02:10.285494 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c01591ad-9594-4916-b6f4-86eaf6298197 admin admin] PATH_INFO: `/v3/users/eff1679387dc41e5853d141873787be4` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:02:10.287609 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c01591ad-9594-4916-b6f4-86eaf6298197 admin admin] RBAC: Authorizing `identity:delete_user(user_id=eff1679387dc41e5853d141873787be4)` {{(pid=82026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 20:02:10.290172 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c01591ad-9594-4916-b6f4-86eaf6298197 admin admin] RBAC: Authorization granted {{(pid=82026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 20:02:10.539635 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93f94c21-4d3c-409a-867e-8ee392f729e7 admin admin] Authenticating user token {{(pid=82025) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 20:02:10.541131 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.fernet_utils [None req-93f94c21-4d3c-409a-867e-8ee392f729e7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82025) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 20:02:10.551680 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.notifications [None req-c01591ad-9594-4916-b6f4-86eaf6298197 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'eff1679387dc41e5853d141873787be4'} {{(pid=82026) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 20:02:10.630944 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93f94c21-4d3c-409a-867e-8ee392f729e7 admin admin] Validating token access rules against request {{(pid=82025) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 20:02:10.634266 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.notifications [None req-c01591ad-9594-4916-b6f4-86eaf6298197 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'eff1679387dc41e5853d141873787be4'} {{(pid=82026) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 20:02:10.636535 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a251fe5-2e52-48c6-b5ec-549d0cbb023f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57539b6a6f3b4d589f5f5e1d211cd6a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b454f707d20347ada3d82aa85495635e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82025) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 20:02:10.637763 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a251fe5-2e52-48c6-b5ec-549d0cbb023f admin admin] REQUEST_METHOD: `DELETE` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:02:10.638075 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a251fe5-2e52-48c6-b5ec-549d0cbb023f admin admin] SCRIPT_NAME: `/identity` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:02:10.638528 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a251fe5-2e52-48c6-b5ec-549d0cbb023f admin admin] PATH_INFO: `/v3/projects/96a1866e31c641c5ba2422c22c967760` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:02:10.639708 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a251fe5-2e52-48c6-b5ec-549d0cbb023f admin admin] RBAC: Authorizing `identity:delete_project(project_id=96a1866e31c641c5ba2422c22c967760)` {{(pid=82025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 20:02:10.641608 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a251fe5-2e52-48c6-b5ec-549d0cbb023f admin admin] RBAC: Authorization granted {{(pid=82025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 20:02:10.647658 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.notifications [None req-c01591ad-9594-4916-b6f4-86eaf6298197 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'eff1679387dc41e5853d141873787be4'} {{(pid=82026) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 20:02:10.648361 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.notifications [None req-c01591ad-9594-4916-b6f4-86eaf6298197 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'eff1679387dc41e5853d141873787be4'} {{(pid=82026) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 20:02:10.655735 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.notifications [None req-c01591ad-9594-4916-b6f4-86eaf6298197 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'eff1679387dc41e5853d141873787be4'} {{(pid=82026) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 20:02:10.664921 dv-cinder-828806-6-smb devstack@keystone.service[82026]: [pid: 82026|app: 0|req: 1156/2366] 10.222.0.33 () {58 vars in 1224 bytes} [Tue Sep 13 20:02:10 2022] DELETE /identity/v3/users/eff1679387dc41e5853d141873787be4 => generated 0 bytes in 468 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 20:02:10.774583 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.notifications [None req-5a251fe5-2e52-48c6-b5ec-549d0cbb023f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '96a1866e31c641c5ba2422c22c967760', 'request_id': 'req-5a251fe5-2e52-48c6-b5ec-549d0cbb023f'} {{(pid=82025) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 20:02:10.781725 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.notifications [None req-5a251fe5-2e52-48c6-b5ec-549d0cbb023f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '96a1866e31c641c5ba2422c22c967760', 'request_id': 'req-5a251fe5-2e52-48c6-b5ec-549d0cbb023f'} {{(pid=82025) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 20:02:10.789051 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.notifications [None req-5a251fe5-2e52-48c6-b5ec-549d0cbb023f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '96a1866e31c641c5ba2422c22c967760', 'request_id': 'req-5a251fe5-2e52-48c6-b5ec-549d0cbb023f'} {{(pid=82025) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 20:02:10.868291 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.notifications [None req-5a251fe5-2e52-48c6-b5ec-549d0cbb023f admin admin] The token cache is being invalidate because project 96a1866e31c641c5ba2422c22c967760 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82025) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 13 20:02:10.868603 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.notifications [None req-5a251fe5-2e52-48c6-b5ec-549d0cbb023f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82025) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 20:02:10.869298 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.notifications [None req-5a251fe5-2e52-48c6-b5ec-549d0cbb023f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82025) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 20:02:10.872780 dv-cinder-828806-6-smb devstack@keystone.service[82025]: [pid: 82025|app: 0|req: 1211/2367] 10.222.0.33 () {58 vars in 1233 bytes} [Tue Sep 13 20:02:10 2022] DELETE /identity/v3/projects/96a1866e31c641c5ba2422c22c967760 => generated 0 bytes in 334 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 13 20:02:10.877765 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0242b02-1046-4d03-9c1e-dd2beedb086e None None] REQUEST_METHOD: `POST` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:02:10.878229 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0242b02-1046-4d03-9c1e-dd2beedb086e None None] SCRIPT_NAME: `/identity` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:02:10.878753 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0242b02-1046-4d03-9c1e-dd2beedb086e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:02:10.904061 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.auth.core [None req-d0242b02-1046-4d03-9c1e-dd2beedb086e None None] MFA Rules not processed for user `57539b6a6f3b4d589f5f5e1d211cd6a0`. Rule list: `[]` (Enabled: `True`). {{(pid=82026) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 20:02:10.905537 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.common.fernet_utils [None req-d0242b02-1046-4d03-9c1e-dd2beedb086e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82026) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 20:02:10.992889 dv-cinder-828806-6-smb devstack@keystone.service[82026]: [pid: 82026|app: 0|req: 1157/2368] 10.222.0.33 () {58 vars in 958 bytes} [Tue Sep 13 20:02:10 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 13 20:02:11.001745 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ff9feeb-0d36-46c4-9f2d-d27a10ebf473 None None] REQUEST_METHOD: `POST` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:02:11.004125 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ff9feeb-0d36-46c4-9f2d-d27a10ebf473 None None] SCRIPT_NAME: `/identity` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:02:11.004428 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ff9feeb-0d36-46c4-9f2d-d27a10ebf473 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:02:11.031977 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.auth.core [None req-4ff9feeb-0d36-46c4-9f2d-d27a10ebf473 None None] MFA Rules not processed for user `57539b6a6f3b4d589f5f5e1d211cd6a0`. Rule list: `[]` (Enabled: `True`). {{(pid=82025) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 20:02:11.034711 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.fernet_utils [None req-4ff9feeb-0d36-46c4-9f2d-d27a10ebf473 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82025) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 20:02:11.056273 dv-cinder-828806-6-smb devstack@keystone.service[82025]: [pid: 82025|app: 0|req: 1212/2369] 10.222.0.33 () {58 vars in 958 bytes} [Tue Sep 13 20:02:11 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 56 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 20:02:11.062632 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0242b02-1046-4d03-9c1e-dd2beedb086e None None] Authenticating user token {{(pid=82026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 20:02:11.079959 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0242b02-1046-4d03-9c1e-dd2beedb086e None None] Validating token access rules against request {{(pid=82026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 20:02:11.101159 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a35bdd99-c990-46ac-a522-4c722541cdaa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57539b6a6f3b4d589f5f5e1d211cd6a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b454f707d20347ada3d82aa85495635e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 20:02:11.101797 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a35bdd99-c990-46ac-a522-4c722541cdaa admin admin] REQUEST_METHOD: `GET` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:02:11.102133 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a35bdd99-c990-46ac-a522-4c722541cdaa admin admin] SCRIPT_NAME: `/identity` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:02:11.102415 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a35bdd99-c990-46ac-a522-4c722541cdaa admin admin] PATH_INFO: `/v3/domains` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:02:11.103304 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a35bdd99-c990-46ac-a522-4c722541cdaa admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82026) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 20:02:11.103831 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a35bdd99-c990-46ac-a522-4c722541cdaa admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 20:02:11.105534 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a35bdd99-c990-46ac-a522-4c722541cdaa admin admin] RBAC: Authorization granted {{(pid=82026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 20:02:11.125998 dv-cinder-828806-6-smb devstack@keystone.service[82026]: [pid: 82026|app: 0|req: 1158/2370] 10.222.0.33 () {58 vars in 1153 bytes} [Tue Sep 13 20:02:11 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 65 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 20:02:11.127079 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ff9feeb-0d36-46c4-9f2d-d27a10ebf473 None None] Authenticating user token {{(pid=82025) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 20:02:11.143408 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ff9feeb-0d36-46c4-9f2d-d27a10ebf473 None None] Validating token access rules against request {{(pid=82025) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 20:02:11.159017 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0132f33-084c-4ae6-a3af-7b1c3a20fd50 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57539b6a6f3b4d589f5f5e1d211cd6a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b454f707d20347ada3d82aa85495635e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82025) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 20:02:11.161853 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0132f33-084c-4ae6-a3af-7b1c3a20fd50 admin admin] REQUEST_METHOD: `POST` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:02:11.162394 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0132f33-084c-4ae6-a3af-7b1c3a20fd50 admin admin] SCRIPT_NAME: `/identity` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:02:11.162822 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0132f33-084c-4ae6-a3af-7b1c3a20fd50 admin admin] PATH_INFO: `/v3/projects` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:02:11.175212 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0132f33-084c-4ae6-a3af-7b1c3a20fd50 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 20:02:11.177511 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0132f33-084c-4ae6-a3af-7b1c3a20fd50 admin admin] RBAC: Authorization granted {{(pid=82025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 20:02:11.202117 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG dbcounter [-] [82025] Writing DB stats keystone:SELECT=93,keystone:INSERT=4,keystone:DELETE=3 {{(pid=82025) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 20:02:11.253143 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a35bdd99-c990-46ac-a522-4c722541cdaa admin admin] Authenticating user token {{(pid=82026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 20:02:11.256277 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.common.fernet_utils [None req-a35bdd99-c990-46ac-a522-4c722541cdaa admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82026) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 20:02:11.280976 dv-cinder-828806-6-smb devstack@keystone.service[82025]: [pid: 82025|app: 0|req: 1213/2371] 10.222.0.33 () {60 vars in 1153 bytes} [Tue Sep 13 20:02:11 2022] POST /identity/v3/projects => generated 383 bytes in 154 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 13 20:02:11.287852 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0132f33-084c-4ae6-a3af-7b1c3a20fd50 admin admin] Authenticating user token {{(pid=82025) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 20:02:11.288814 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a35bdd99-c990-46ac-a522-4c722541cdaa admin admin] Validating token access rules against request {{(pid=82026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 20:02:11.343726 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG dbcounter [-] [82026] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82026) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 20:02:11.371499 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0132f33-084c-4ae6-a3af-7b1c3a20fd50 admin admin] Validating token access rules against request {{(pid=82025) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 20:02:11.374815 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8af72eb-606e-437d-a714-2bbea595c6b3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57539b6a6f3b4d589f5f5e1d211cd6a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b454f707d20347ada3d82aa85495635e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 20:02:11.375609 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8af72eb-606e-437d-a714-2bbea595c6b3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:02:11.376582 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8af72eb-606e-437d-a714-2bbea595c6b3 admin admin] SCRIPT_NAME: `/identity` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:02:11.377203 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8af72eb-606e-437d-a714-2bbea595c6b3 admin admin] PATH_INFO: `/v3/projects/c3b9517cf1734fcf8014864c584e9659` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:02:11.378375 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8af72eb-606e-437d-a714-2bbea595c6b3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c3b9517cf1734fcf8014864c584e9659)` {{(pid=82026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 20:02:11.380617 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8af72eb-606e-437d-a714-2bbea595c6b3 admin admin] RBAC: Authorization granted {{(pid=82026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 20:02:11.380707 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7181460c-0154-420b-b981-9e709e817eb1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57539b6a6f3b4d589f5f5e1d211cd6a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b454f707d20347ada3d82aa85495635e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82025) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 20:02:11.381261 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7181460c-0154-420b-b981-9e709e817eb1 admin admin] REQUEST_METHOD: `POST` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:02:11.381571 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7181460c-0154-420b-b981-9e709e817eb1 admin admin] SCRIPT_NAME: `/identity` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:02:11.381822 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7181460c-0154-420b-b981-9e709e817eb1 admin admin] PATH_INFO: `/v3/users` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:02:11.382655 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7181460c-0154-420b-b981-9e709e817eb1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 20:02:11.384694 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7181460c-0154-420b-b981-9e709e817eb1 admin admin] RBAC: Authorization granted {{(pid=82025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 20:02:11.487206 dv-cinder-828806-6-smb devstack@keystone.service[82025]: [pid: 82025|app: 0|req: 1214/2372] 10.222.0.33 () {60 vars in 1144 bytes} [Tue Sep 13 20:02:11 2022] POST /identity/v3/users => generated 292 bytes in 200 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 13 20:02:11.488620 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e9dc683-db15-498d-aaec-89e1dca58da6 None None] REQUEST_METHOD: `POST` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:02:11.488917 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e9dc683-db15-498d-aaec-89e1dca58da6 None None] SCRIPT_NAME: `/identity` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:02:11.489199 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e9dc683-db15-498d-aaec-89e1dca58da6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:02:11.510946 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.auth.core [None req-4e9dc683-db15-498d-aaec-89e1dca58da6 None None] MFA Rules not processed for user `8853527498a24a6c80c169929f9f48bc`. Rule list: `[]` (Enabled: `True`). {{(pid=82025) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 20:02:11.512357 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.fernet_utils [None req-4e9dc683-db15-498d-aaec-89e1dca58da6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82025) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 20:02:11.529708 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.notifications [None req-a8af72eb-606e-437d-a714-2bbea595c6b3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c3b9517cf1734fcf8014864c584e9659', 'request_id': 'req-a8af72eb-606e-437d-a714-2bbea595c6b3'} {{(pid=82026) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 20:02:11.568523 dv-cinder-828806-6-smb devstack@keystone.service[82025]: [pid: 82025|app: 0|req: 1215/2373] 10.222.0.33 () {58 vars in 958 bytes} [Tue Sep 13 20:02:11 2022] POST /identity/v3/auth/tokens => generated 3268 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 20:02:11.569394 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e9dc683-db15-498d-aaec-89e1dca58da6 None None] Authenticating user token {{(pid=82025) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 20:02:11.579535 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e9dc683-db15-498d-aaec-89e1dca58da6 None None] Validating token access rules against request {{(pid=82025) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 20:02:11.624010 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.notifications [None req-a8af72eb-606e-437d-a714-2bbea595c6b3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c3b9517cf1734fcf8014864c584e9659', 'request_id': 'req-a8af72eb-606e-437d-a714-2bbea595c6b3'} {{(pid=82026) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 20:02:11.632618 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.notifications [None req-a8af72eb-606e-437d-a714-2bbea595c6b3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c3b9517cf1734fcf8014864c584e9659', 'request_id': 'req-a8af72eb-606e-437d-a714-2bbea595c6b3'} {{(pid=82026) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 20:02:11.639176 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b778581-a14e-4a9b-a0c0-4a3400b210e8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57539b6a6f3b4d589f5f5e1d211cd6a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b454f707d20347ada3d82aa85495635e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82025) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 20:02:11.639797 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b778581-a14e-4a9b-a0c0-4a3400b210e8 admin admin] REQUEST_METHOD: `GET` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:02:11.640082 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b778581-a14e-4a9b-a0c0-4a3400b210e8 admin admin] SCRIPT_NAME: `/identity` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:02:11.640429 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b778581-a14e-4a9b-a0c0-4a3400b210e8 admin admin] PATH_INFO: `/v3/roles` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:02:11.641091 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b778581-a14e-4a9b-a0c0-4a3400b210e8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 20:02:11.642701 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b778581-a14e-4a9b-a0c0-4a3400b210e8 admin admin] RBAC: Authorization granted {{(pid=82025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 20:02:11.646098 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.notifications [None req-a8af72eb-606e-437d-a714-2bbea595c6b3 admin admin] The token cache is being invalidate because project c3b9517cf1734fcf8014864c584e9659 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82026) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 13 20:02:11.646462 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.notifications [None req-a8af72eb-606e-437d-a714-2bbea595c6b3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82026) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 20:02:11.647297 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.notifications [None req-a8af72eb-606e-437d-a714-2bbea595c6b3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82026) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 20:02:11.648872 dv-cinder-828806-6-smb devstack@keystone.service[82026]: [pid: 82026|app: 0|req: 1159/2374] 10.222.0.33 () {58 vars in 1233 bytes} [Tue Sep 13 20:02:11 2022] DELETE /identity/v3/projects/c3b9517cf1734fcf8014864c584e9659 => generated 0 bytes in 396 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 13 20:02:11.654519 dv-cinder-828806-6-smb devstack@keystone.service[82025]: [pid: 82025|app: 0|req: 1216/2375] 10.222.0.33 () {58 vars in 1122 bytes} [Tue Sep 13 20:02:11 2022] GET /identity/v3/roles => generated 1420 bytes in 85 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 13 20:02:11.656044 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6d64890-2111-4aa4-98ba-462c69698ba3 None None] REQUEST_METHOD: `POST` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:02:11.656044 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6d64890-2111-4aa4-98ba-462c69698ba3 None None] SCRIPT_NAME: `/identity` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:02:11.656044 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6d64890-2111-4aa4-98ba-462c69698ba3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:02:11.659363 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b778581-a14e-4a9b-a0c0-4a3400b210e8 admin admin] Authenticating user token {{(pid=82025) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 20:02:11.661718 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.fernet_utils [None req-8b778581-a14e-4a9b-a0c0-4a3400b210e8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82025) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 20:02:11.675810 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b778581-a14e-4a9b-a0c0-4a3400b210e8 admin admin] Validating token access rules against request {{(pid=82025) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 20:02:11.680184 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.auth.core [None req-a6d64890-2111-4aa4-98ba-462c69698ba3 None None] MFA Rules not processed for user `57539b6a6f3b4d589f5f5e1d211cd6a0`. Rule list: `[]` (Enabled: `True`). {{(pid=82026) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 20:02:11.680587 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3da1dfdf-a6b7-4127-ac68-0df0cdbe6f2f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57539b6a6f3b4d589f5f5e1d211cd6a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b454f707d20347ada3d82aa85495635e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82025) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 20:02:11.681581 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3da1dfdf-a6b7-4127-ac68-0df0cdbe6f2f admin admin] REQUEST_METHOD: `GET` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:02:11.681581 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3da1dfdf-a6b7-4127-ac68-0df0cdbe6f2f admin admin] SCRIPT_NAME: `/identity` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:02:11.688577 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.common.fernet_utils [None req-a6d64890-2111-4aa4-98ba-462c69698ba3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82026) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 20:02:11.688786 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3da1dfdf-a6b7-4127-ac68-0df0cdbe6f2f admin admin] PATH_INFO: `/v3/roles` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:02:11.688786 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3da1dfdf-a6b7-4127-ac68-0df0cdbe6f2f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 20:02:11.688786 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3da1dfdf-a6b7-4127-ac68-0df0cdbe6f2f admin admin] RBAC: Authorization granted {{(pid=82025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 20:02:11.693038 dv-cinder-828806-6-smb devstack@keystone.service[82026]: [pid: 82026|app: 0|req: 1160/2376] 10.222.0.33 () {58 vars in 958 bytes} [Tue Sep 13 20:02:11 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 20:02:11.698981 dv-cinder-828806-6-smb devstack@keystone.service[82025]: [pid: 82025|app: 0|req: 1217/2377] 10.222.0.33 () {58 vars in 1122 bytes} [Tue Sep 13 20:02:11 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 13 20:02:11.701699 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3da1dfdf-a6b7-4127-ac68-0df0cdbe6f2f admin admin] Authenticating user token {{(pid=82025) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 20:02:11.701835 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a509f96d-7307-45dc-9074-3ea684b78ce0 None None] REQUEST_METHOD: `POST` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:02:11.701835 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a509f96d-7307-45dc-9074-3ea684b78ce0 None None] SCRIPT_NAME: `/identity` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:02:11.702109 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a509f96d-7307-45dc-9074-3ea684b78ce0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:02:11.715302 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3da1dfdf-a6b7-4127-ac68-0df0cdbe6f2f admin admin] Validating token access rules against request {{(pid=82025) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 20:02:11.720440 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-842a04f0-41a0-42f7-99cd-c905d105d76e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57539b6a6f3b4d589f5f5e1d211cd6a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b454f707d20347ada3d82aa85495635e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82025) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 20:02:11.721115 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-842a04f0-41a0-42f7-99cd-c905d105d76e admin admin] REQUEST_METHOD: `PUT` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:02:11.721375 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-842a04f0-41a0-42f7-99cd-c905d105d76e admin admin] SCRIPT_NAME: `/identity` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:02:11.721654 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-842a04f0-41a0-42f7-99cd-c905d105d76e admin admin] PATH_INFO: `/v3/projects/b7f7d4d580f143c0a9174ab977cc2eac/users/0afb3d4de8cc4a518f4e63f5d28e50ef/roles/3618ab638a65401f82333da7596d1daf` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:02:11.732340 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.auth.core [None req-a509f96d-7307-45dc-9074-3ea684b78ce0 None None] MFA Rules not processed for user `57539b6a6f3b4d589f5f5e1d211cd6a0`. Rule list: `[]` (Enabled: `True`). {{(pid=82026) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 20:02:11.733587 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.common.fernet_utils [None req-a509f96d-7307-45dc-9074-3ea684b78ce0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82026) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 20:02:11.741408 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-842a04f0-41a0-42f7-99cd-c905d105d76e admin admin] RBAC: Authorizing `identity:create_grant(project_id=b7f7d4d580f143c0a9174ab977cc2eac, user_id=0afb3d4de8cc4a518f4e63f5d28e50ef, role_id=3618ab638a65401f82333da7596d1daf)` {{(pid=82025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 20:02:11.744725 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-842a04f0-41a0-42f7-99cd-c905d105d76e admin admin] RBAC: Authorization granted {{(pid=82025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 20:02:11.745908 dv-cinder-828806-6-smb devstack@keystone.service[82026]: [pid: 82026|app: 0|req: 1161/2378] 10.222.0.33 () {58 vars in 958 bytes} [Tue Sep 13 20:02:11 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 46 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 20:02:11.750383 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a509f96d-7307-45dc-9074-3ea684b78ce0 None None] Authenticating user token {{(pid=82026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 20:02:11.760264 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a509f96d-7307-45dc-9074-3ea684b78ce0 None None] Validating token access rules against request {{(pid=82026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 20:02:11.765946 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99d6f7b8-4e5e-4e34-b554-a232cac3d28a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57539b6a6f3b4d589f5f5e1d211cd6a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b454f707d20347ada3d82aa85495635e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 20:02:11.766585 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99d6f7b8-4e5e-4e34-b554-a232cac3d28a admin admin] REQUEST_METHOD: `GET` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:02:11.766870 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99d6f7b8-4e5e-4e34-b554-a232cac3d28a admin admin] SCRIPT_NAME: `/identity` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:02:11.767184 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99d6f7b8-4e5e-4e34-b554-a232cac3d28a admin admin] PATH_INFO: `/v3/domains` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:02:11.767846 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99d6f7b8-4e5e-4e34-b554-a232cac3d28a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82026) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 20:02:11.768156 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99d6f7b8-4e5e-4e34-b554-a232cac3d28a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 20:02:11.769761 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99d6f7b8-4e5e-4e34-b554-a232cac3d28a admin admin] RBAC: Authorization granted {{(pid=82026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 20:02:11.781626 dv-cinder-828806-6-smb devstack@keystone.service[82026]: [pid: 82026|app: 0|req: 1162/2379] 10.222.0.33 () {58 vars in 1153 bytes} [Tue Sep 13 20:02:11 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 13 20:02:11.786125 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99d6f7b8-4e5e-4e34-b554-a232cac3d28a admin admin] Authenticating user token {{(pid=82026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 20:02:11.797570 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99d6f7b8-4e5e-4e34-b554-a232cac3d28a admin admin] Validating token access rules against request {{(pid=82026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 20:02:11.802445 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0e4e89f-9c8f-4622-b04c-fe0cd1e0ccf1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57539b6a6f3b4d589f5f5e1d211cd6a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b454f707d20347ada3d82aa85495635e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 20:02:11.803077 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0e4e89f-9c8f-4622-b04c-fe0cd1e0ccf1 admin admin] REQUEST_METHOD: `POST` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:02:11.803371 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0e4e89f-9c8f-4622-b04c-fe0cd1e0ccf1 admin admin] SCRIPT_NAME: `/identity` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:02:11.803653 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0e4e89f-9c8f-4622-b04c-fe0cd1e0ccf1 admin admin] PATH_INFO: `/v3/projects` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:02:11.804300 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0e4e89f-9c8f-4622-b04c-fe0cd1e0ccf1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 20:02:11.806281 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0e4e89f-9c8f-4622-b04c-fe0cd1e0ccf1 admin admin] RBAC: Authorization granted {{(pid=82026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 20:02:11.868895 dv-cinder-828806-6-smb devstack@keystone.service[82025]: [pid: 82025|app: 0|req: 1218/2380] 10.222.0.33 () {60 vars in 1483 bytes} [Tue Sep 13 20:02:11 2022] PUT /identity/v3/projects/b7f7d4d580f143c0a9174ab977cc2eac/users/0afb3d4de8cc4a518f4e63f5d28e50ef/roles/3618ab638a65401f82333da7596d1daf => generated 0 bytes in 169 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 20:02:11.874799 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42234338-18b8-46d0-b077-d60218a61e6b None None] REQUEST_METHOD: `POST` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:02:11.875167 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42234338-18b8-46d0-b077-d60218a61e6b None None] SCRIPT_NAME: `/identity` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:02:11.875411 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42234338-18b8-46d0-b077-d60218a61e6b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:02:11.897081 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.auth.core [None req-42234338-18b8-46d0-b077-d60218a61e6b None None] MFA Rules not processed for user `57539b6a6f3b4d589f5f5e1d211cd6a0`. Rule list: `[]` (Enabled: `True`). {{(pid=82025) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 20:02:11.898364 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.fernet_utils [None req-42234338-18b8-46d0-b077-d60218a61e6b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82025) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 20:02:11.924284 dv-cinder-828806-6-smb devstack@keystone.service[82026]: [pid: 82026|app: 0|req: 1163/2381] 10.222.0.33 () {60 vars in 1153 bytes} [Tue Sep 13 20:02:11 2022] POST /identity/v3/projects => generated 399 bytes in 139 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 13 20:02:11.928371 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0e4e89f-9c8f-4622-b04c-fe0cd1e0ccf1 admin admin] Authenticating user token {{(pid=82026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 20:02:11.966253 dv-cinder-828806-6-smb devstack@keystone.service[82025]: [pid: 82025|app: 0|req: 1219/2382] 10.222.0.33 () {58 vars in 958 bytes} [Tue Sep 13 20:02:11 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 13 20:02:11.978331 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42234338-18b8-46d0-b077-d60218a61e6b None None] Authenticating user token {{(pid=82025) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 20:02:11.979752 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.fernet_utils [None req-42234338-18b8-46d0-b077-d60218a61e6b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82025) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 20:02:12.001819 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0e4e89f-9c8f-4622-b04c-fe0cd1e0ccf1 admin admin] Validating token access rules against request {{(pid=82026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 20:02:12.007076 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a32e0cbc-ab14-4224-a812-403f7c976409 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57539b6a6f3b4d589f5f5e1d211cd6a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b454f707d20347ada3d82aa85495635e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 20:02:12.010129 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a32e0cbc-ab14-4224-a812-403f7c976409 admin admin] REQUEST_METHOD: `POST` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:02:12.010129 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a32e0cbc-ab14-4224-a812-403f7c976409 admin admin] SCRIPT_NAME: `/identity` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:02:12.010129 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a32e0cbc-ab14-4224-a812-403f7c976409 admin admin] PATH_INFO: `/v3/users` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:02:12.010129 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a32e0cbc-ab14-4224-a812-403f7c976409 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 20:02:12.011719 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a32e0cbc-ab14-4224-a812-403f7c976409 admin admin] RBAC: Authorization granted {{(pid=82026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 20:02:12.045008 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42234338-18b8-46d0-b077-d60218a61e6b None None] Validating token access rules against request {{(pid=82025) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 20:02:12.101934 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cb9633a-f160-4016-a340-3649be9bc2f1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '023a2c79c2444611b3d431928e56685d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8c6fba0f15b4d6a84ff601919b7b8e4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82025) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 20:02:12.102083 dv-cinder-828806-6-smb devstack@keystone.service[82026]: [pid: 82026|app: 0|req: 1164/2383] 10.222.0.33 () {60 vars in 1144 bytes} [Tue Sep 13 20:02:11 2022] POST /identity/v3/users => generated 300 bytes in 172 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 13 20:02:12.102174 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cb9633a-f160-4016-a340-3649be9bc2f1 service neutron] REQUEST_METHOD: `GET` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:02:12.102174 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cb9633a-f160-4016-a340-3649be9bc2f1 service neutron] SCRIPT_NAME: `/identity` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:02:12.102174 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cb9633a-f160-4016-a340-3649be9bc2f1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:02:12.104607 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a32e0cbc-ab14-4224-a812-403f7c976409 admin admin] Authenticating user token {{(pid=82026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 20:02:12.113814 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cb9633a-f160-4016-a340-3649be9bc2f1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 20:02:12.115290 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cb9633a-f160-4016-a340-3649be9bc2f1 service neutron] RBAC: Authorization granted {{(pid=82025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 20:02:12.115404 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a32e0cbc-ab14-4224-a812-403f7c976409 admin admin] Validating token access rules against request {{(pid=82026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 20:02:12.121825 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25cb44a1-3b8a-4987-91f7-9e1b5491e156 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57539b6a6f3b4d589f5f5e1d211cd6a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b454f707d20347ada3d82aa85495635e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 20:02:12.122626 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25cb44a1-3b8a-4987-91f7-9e1b5491e156 admin admin] REQUEST_METHOD: `GET` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:02:12.123549 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25cb44a1-3b8a-4987-91f7-9e1b5491e156 admin admin] SCRIPT_NAME: `/identity` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:02:12.124033 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25cb44a1-3b8a-4987-91f7-9e1b5491e156 admin admin] PATH_INFO: `/v3/roles` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:02:12.124608 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25cb44a1-3b8a-4987-91f7-9e1b5491e156 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 20:02:12.126270 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25cb44a1-3b8a-4987-91f7-9e1b5491e156 admin admin] RBAC: Authorization granted {{(pid=82026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 20:02:12.131220 dv-cinder-828806-6-smb devstack@keystone.service[82025]: [pid: 82025|app: 0|req: 1220/2384] 10.222.0.33 () {60 vars in 1365 bytes} [Tue Sep 13 20:02:11 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 153 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 13 20:02:12.138927 dv-cinder-828806-6-smb devstack@keystone.service[82026]: [pid: 82026|app: 0|req: 1165/2385] 10.222.0.33 () {58 vars in 1122 bytes} [Tue Sep 13 20:02:12 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 13 20:02:12.143410 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cb9633a-f160-4016-a340-3649be9bc2f1 service neutron] Authenticating user token {{(pid=82025) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 20:02:12.149077 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG dbcounter [-] [82026] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=82026) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 20:02:12.163769 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cb9633a-f160-4016-a340-3649be9bc2f1 service neutron] Validating token access rules against request {{(pid=82025) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 20:02:12.177132 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a40fc545-3109-44de-96f6-1f9a4b934ecf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57539b6a6f3b4d589f5f5e1d211cd6a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b454f707d20347ada3d82aa85495635e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82025) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 20:02:12.178074 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a40fc545-3109-44de-96f6-1f9a4b934ecf admin admin] REQUEST_METHOD: `GET` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:02:12.178489 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a40fc545-3109-44de-96f6-1f9a4b934ecf admin admin] SCRIPT_NAME: `/identity` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:02:12.179060 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a40fc545-3109-44de-96f6-1f9a4b934ecf admin admin] PATH_INFO: `/v3/roles` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:02:12.179951 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a40fc545-3109-44de-96f6-1f9a4b934ecf admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 20:02:12.181970 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a40fc545-3109-44de-96f6-1f9a4b934ecf admin admin] RBAC: Authorization granted {{(pid=82025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 20:02:12.194347 dv-cinder-828806-6-smb devstack@keystone.service[82025]: [pid: 82025|app: 0|req: 1221/2386] 10.222.0.33 () {58 vars in 1122 bytes} [Tue Sep 13 20:02:12 2022] GET /identity/v3/roles => generated 1420 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 13 20:02:12.198535 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25cb44a1-3b8a-4987-91f7-9e1b5491e156 admin admin] Authenticating user token {{(pid=82026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 20:02:12.214512 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25cb44a1-3b8a-4987-91f7-9e1b5491e156 admin admin] Validating token access rules against request {{(pid=82026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 20:02:12.220117 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b81cd5e-da4d-4154-a7ff-b66f88626ec3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57539b6a6f3b4d589f5f5e1d211cd6a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b454f707d20347ada3d82aa85495635e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 20:02:12.221208 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b81cd5e-da4d-4154-a7ff-b66f88626ec3 admin admin] REQUEST_METHOD: `PUT` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:02:12.221208 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b81cd5e-da4d-4154-a7ff-b66f88626ec3 admin admin] SCRIPT_NAME: `/identity` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:02:12.221386 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b81cd5e-da4d-4154-a7ff-b66f88626ec3 admin admin] PATH_INFO: `/v3/projects/6a699517e0674dd59d237787911e9340/users/d13ad7faaf234091b7427ca1b2e968be/roles/3618ab638a65401f82333da7596d1daf` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:02:12.236872 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b81cd5e-da4d-4154-a7ff-b66f88626ec3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6a699517e0674dd59d237787911e9340, user_id=d13ad7faaf234091b7427ca1b2e968be, role_id=3618ab638a65401f82333da7596d1daf)` {{(pid=82026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 20:02:12.239625 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b81cd5e-da4d-4154-a7ff-b66f88626ec3 admin admin] RBAC: Authorization granted {{(pid=82026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 20:02:12.390632 dv-cinder-828806-6-smb devstack@keystone.service[82026]: [pid: 82026|app: 0|req: 1166/2387] 10.222.0.33 () {60 vars in 1483 bytes} [Tue Sep 13 20:02:12 2022] PUT /identity/v3/projects/6a699517e0674dd59d237787911e9340/users/d13ad7faaf234091b7427ca1b2e968be/roles/3618ab638a65401f82333da7596d1daf => generated 0 bytes in 193 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 20:02:12.401893 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0e84843-e190-459e-a031-af7224484ebf None None] REQUEST_METHOD: `POST` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:02:12.402179 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0e84843-e190-459e-a031-af7224484ebf None None] SCRIPT_NAME: `/identity` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:02:12.402459 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0e84843-e190-459e-a031-af7224484ebf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:02:12.414202 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG dbcounter [-] [82025] Writing DB stats keystone:DELETE=7,keystone:SELECT=91,keystone:INSERT=2 {{(pid=82025) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 20:02:12.440030 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.auth.core [None req-f0e84843-e190-459e-a031-af7224484ebf None None] MFA Rules not processed for user `d13ad7faaf234091b7427ca1b2e968be`. Rule list: `[]` (Enabled: `True`). {{(pid=82025) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 20:02:12.441599 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.fernet_utils [None req-f0e84843-e190-459e-a031-af7224484ebf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82025) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 20:02:12.585413 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b81cd5e-da4d-4154-a7ff-b66f88626ec3 admin admin] Authenticating user token {{(pid=82026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 20:02:12.587285 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.common.fernet_utils [None req-9b81cd5e-da4d-4154-a7ff-b66f88626ec3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82026) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 20:02:12.590396 dv-cinder-828806-6-smb devstack@keystone.service[82025]: [pid: 82025|app: 0|req: 1222/2388] 10.222.0.33 () {58 vars in 958 bytes} [Tue Sep 13 20:02:12 2022] POST /identity/v3/auth/tokens => generated 3276 bytes in 189 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 20:02:12.602920 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0e84843-e190-459e-a031-af7224484ebf None None] Authenticating user token {{(pid=82025) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 20:02:12.604506 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.fernet_utils [None req-f0e84843-e190-459e-a031-af7224484ebf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82025) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 20:02:12.678389 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b81cd5e-da4d-4154-a7ff-b66f88626ec3 admin admin] Validating token access rules against request {{(pid=82026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 20:02:12.678959 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0e84843-e190-459e-a031-af7224484ebf None None] Validating token access rules against request {{(pid=82025) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 20:02:12.682264 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d349b53d-ed5f-4b77-93e0-26465c1e1b7c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46024fc6167f4321818b1bed27a521a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8c6fba0f15b4d6a84ff601919b7b8e4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 20:02:12.682679 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de7ef65b-e342-4a62-ac28-f7a9ac3f5550 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46024fc6167f4321818b1bed27a521a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8c6fba0f15b4d6a84ff601919b7b8e4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82025) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 20:02:12.689138 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d349b53d-ed5f-4b77-93e0-26465c1e1b7c service cinder] REQUEST_METHOD: `GET` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:02:12.689138 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d349b53d-ed5f-4b77-93e0-26465c1e1b7c service cinder] SCRIPT_NAME: `/identity` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:02:12.689340 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de7ef65b-e342-4a62-ac28-f7a9ac3f5550 service cinder] REQUEST_METHOD: `GET` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:02:12.689434 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d349b53d-ed5f-4b77-93e0-26465c1e1b7c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:02:12.689540 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de7ef65b-e342-4a62-ac28-f7a9ac3f5550 service cinder] SCRIPT_NAME: `/identity` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:02:12.689540 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de7ef65b-e342-4a62-ac28-f7a9ac3f5550 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:02:12.689712 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.common.fernet_utils [None req-d349b53d-ed5f-4b77-93e0-26465c1e1b7c service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82026) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 20:02:12.693449 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de7ef65b-e342-4a62-ac28-f7a9ac3f5550 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=82025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 20:02:12.694883 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de7ef65b-e342-4a62-ac28-f7a9ac3f5550 service cinder] RBAC: Authorization granted {{(pid=82025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 20:02:12.704849 dv-cinder-828806-6-smb devstack@keystone.service[82025]: [pid: 82025|app: 0|req: 1223/2389] 10.222.0.33 () {60 vars in 1365 bytes} [Tue Sep 13 20:02:12 2022] GET /identity/v3/auth/tokens => generated 3276 bytes in 102 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 20:02:12.758794 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d349b53d-ed5f-4b77-93e0-26465c1e1b7c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=82026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 20:02:12.760480 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d349b53d-ed5f-4b77-93e0-26465c1e1b7c service cinder] RBAC: Authorization granted {{(pid=82026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 20:02:12.771240 dv-cinder-828806-6-smb devstack@keystone.service[82026]: [pid: 82026|app: 0|req: 1167/2390] 10.222.0.33 () {60 vars in 1365 bytes} [Tue Sep 13 20:02:12 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 186 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 13 20:02:12.864485 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG dbcounter [-] [82026] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=82026) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 20:02:13.938496 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG dbcounter [-] [82025] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82025) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 20:02:14.864665 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de7ef65b-e342-4a62-ac28-f7a9ac3f5550 service cinder] Authenticating user token {{(pid=82025) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 20:02:14.874853 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG dbcounter [-] [82026] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82026) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 20:02:14.879506 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de7ef65b-e342-4a62-ac28-f7a9ac3f5550 service cinder] Validating token access rules against request {{(pid=82025) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 20:02:14.883874 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cd8d4cd-6b05-457e-8897-0e316627b9fb service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46024fc6167f4321818b1bed27a521a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8c6fba0f15b4d6a84ff601919b7b8e4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82025) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 20:02:14.884823 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cd8d4cd-6b05-457e-8897-0e316627b9fb service cinder] REQUEST_METHOD: `GET` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:02:14.885491 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cd8d4cd-6b05-457e-8897-0e316627b9fb service cinder] SCRIPT_NAME: `/identity` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:02:14.885949 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cd8d4cd-6b05-457e-8897-0e316627b9fb service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:02:14.891121 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.fernet_utils [None req-8cd8d4cd-6b05-457e-8897-0e316627b9fb service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82025) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 20:02:14.972443 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cd8d4cd-6b05-457e-8897-0e316627b9fb service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=82025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 20:02:14.973950 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cd8d4cd-6b05-457e-8897-0e316627b9fb service cinder] RBAC: Authorization granted {{(pid=82025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 20:02:14.985571 dv-cinder-828806-6-smb devstack@keystone.service[82025]: [pid: 82025|app: 0|req: 1224/2391] 10.222.0.33 () {60 vars in 1365 bytes} [Tue Sep 13 20:02:14 2022] GET /identity/v3/auth/tokens => generated 3321 bytes in 122 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 20:02:15.260646 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG dbcounter [-] [82025] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=82025) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 20:02:17.097631 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG dbcounter [-] [82026] Writing DB stats keystone:SELECT=86,keystone:DELETE=13,keystone:INSERT=1 {{(pid=82026) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 20:02:17.544548 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG dbcounter [-] [82025] Writing DB stats keystone:SELECT=93,keystone:INSERT=7 {{(pid=82025) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 20:02:18.816806 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1a3176f-7c7b-40c2-a2f5-1abab5331b81 None None] REQUEST_METHOD: `POST` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:02:18.817358 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1a3176f-7c7b-40c2-a2f5-1abab5331b81 None None] SCRIPT_NAME: `/identity` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:02:18.817358 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1a3176f-7c7b-40c2-a2f5-1abab5331b81 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:02:18.870584 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.auth.core [None req-d1a3176f-7c7b-40c2-a2f5-1abab5331b81 None None] MFA Rules not processed for user `0afb3d4de8cc4a518f4e63f5d28e50ef`. Rule list: `[]` (Enabled: `True`). {{(pid=82026) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 20:02:18.875117 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.common.fernet_utils [None req-d1a3176f-7c7b-40c2-a2f5-1abab5331b81 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82026) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 20:02:19.011610 dv-cinder-828806-6-smb devstack@keystone.service[82026]: [pid: 82026|app: 0|req: 1168/2392] 10.222.0.33 () {58 vars in 958 bytes} [Tue Sep 13 20:02:18 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 196 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 20:02:19.017179 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cd8d4cd-6b05-457e-8897-0e316627b9fb service cinder] Authenticating user token {{(pid=82025) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 20:02:19.112122 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cd8d4cd-6b05-457e-8897-0e316627b9fb service cinder] Validating token access rules against request {{(pid=82025) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 20:02:19.117207 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07227e5a-9d31-4bef-a70f-af00c4a15313 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57539b6a6f3b4d589f5f5e1d211cd6a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b454f707d20347ada3d82aa85495635e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82025) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 20:02:19.118085 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07227e5a-9d31-4bef-a70f-af00c4a15313 admin admin] REQUEST_METHOD: `POST` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:02:19.118749 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07227e5a-9d31-4bef-a70f-af00c4a15313 admin admin] SCRIPT_NAME: `/identity` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:02:19.119227 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07227e5a-9d31-4bef-a70f-af00c4a15313 admin admin] PATH_INFO: `/v3/projects` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:02:19.125037 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07227e5a-9d31-4bef-a70f-af00c4a15313 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 20:02:19.125037 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07227e5a-9d31-4bef-a70f-af00c4a15313 admin admin] RBAC: Authorization granted {{(pid=82025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 20:02:19.180355 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1a3176f-7c7b-40c2-a2f5-1abab5331b81 None None] Authenticating user token {{(pid=82026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 20:02:19.195141 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1a3176f-7c7b-40c2-a2f5-1abab5331b81 None None] Validating token access rules against request {{(pid=82026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 20:02:19.207226 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9d8db4b-fa9a-46a2-9c36-0c1e1ef5e60f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57539b6a6f3b4d589f5f5e1d211cd6a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b454f707d20347ada3d82aa85495635e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 20:02:19.208550 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9d8db4b-fa9a-46a2-9c36-0c1e1ef5e60f admin admin] REQUEST_METHOD: `DELETE` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:02:19.208833 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9d8db4b-fa9a-46a2-9c36-0c1e1ef5e60f admin admin] SCRIPT_NAME: `/identity` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:02:19.209108 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9d8db4b-fa9a-46a2-9c36-0c1e1ef5e60f admin admin] PATH_INFO: `/v3/users/d13ad7faaf234091b7427ca1b2e968be` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:02:19.210636 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9d8db4b-fa9a-46a2-9c36-0c1e1ef5e60f admin admin] RBAC: Authorizing `identity:delete_user(user_id=d13ad7faaf234091b7427ca1b2e968be)` {{(pid=82026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 20:02:19.213079 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9d8db4b-fa9a-46a2-9c36-0c1e1ef5e60f admin admin] RBAC: Authorization granted {{(pid=82026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 20:02:19.232965 dv-cinder-828806-6-smb devstack@keystone.service[82025]: [pid: 82025|app: 0|req: 1225/2393] 10.222.0.33 () {60 vars in 1153 bytes} [Tue Sep 13 20:02:19 2022] POST /identity/v3/projects => generated 385 bytes in 216 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 13 20:02:19.236094 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG dbcounter [-] [82025] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=82025) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 20:02:19.252046 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07227e5a-9d31-4bef-a70f-af00c4a15313 admin admin] Authenticating user token {{(pid=82025) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 20:02:19.332411 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG dbcounter [-] [82026] Writing DB stats keystone:SELECT=94,keystone:DELETE=4,keystone:INSERT=2 {{(pid=82026) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 20:02:19.366331 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07227e5a-9d31-4bef-a70f-af00c4a15313 admin admin] Validating token access rules against request {{(pid=82025) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 20:02:19.380039 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd1b62ae-278d-4c52-b3a4-5e53aba7d6eb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57539b6a6f3b4d589f5f5e1d211cd6a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b454f707d20347ada3d82aa85495635e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82025) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 20:02:19.380905 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd1b62ae-278d-4c52-b3a4-5e53aba7d6eb admin admin] REQUEST_METHOD: `POST` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:02:19.381373 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd1b62ae-278d-4c52-b3a4-5e53aba7d6eb admin admin] SCRIPT_NAME: `/identity` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:02:19.381804 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd1b62ae-278d-4c52-b3a4-5e53aba7d6eb admin admin] PATH_INFO: `/v3/users` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:02:19.383533 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd1b62ae-278d-4c52-b3a4-5e53aba7d6eb admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 20:02:19.385998 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd1b62ae-278d-4c52-b3a4-5e53aba7d6eb admin admin] RBAC: Authorization granted {{(pid=82025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 20:02:19.446794 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.notifications [None req-c9d8db4b-fa9a-46a2-9c36-0c1e1ef5e60f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd13ad7faaf234091b7427ca1b2e968be'} {{(pid=82026) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 20:02:19.520864 dv-cinder-828806-6-smb devstack@keystone.service[82025]: [pid: 82025|app: 0|req: 1226/2394] 10.222.0.33 () {60 vars in 1144 bytes} [Tue Sep 13 20:02:19 2022] POST /identity/v3/users => generated 299 bytes in 282 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 13 20:02:19.522342 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd1b62ae-278d-4c52-b3a4-5e53aba7d6eb admin admin] Authenticating user token {{(pid=82025) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 20:02:19.538695 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd1b62ae-278d-4c52-b3a4-5e53aba7d6eb admin admin] Validating token access rules against request {{(pid=82025) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 20:02:19.555387 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bd9231d-e27e-4053-a397-43c5bb63d585 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57539b6a6f3b4d589f5f5e1d211cd6a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b454f707d20347ada3d82aa85495635e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82025) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 20:02:19.556089 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bd9231d-e27e-4053-a397-43c5bb63d585 admin admin] REQUEST_METHOD: `GET` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:02:19.563520 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bd9231d-e27e-4053-a397-43c5bb63d585 admin admin] SCRIPT_NAME: `/identity` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:02:19.563815 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bd9231d-e27e-4053-a397-43c5bb63d585 admin admin] PATH_INFO: `/v3/roles` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:02:19.564996 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bd9231d-e27e-4053-a397-43c5bb63d585 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 20:02:19.566152 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.notifications [None req-c9d8db4b-fa9a-46a2-9c36-0c1e1ef5e60f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd13ad7faaf234091b7427ca1b2e968be'} {{(pid=82026) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 20:02:19.570197 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bd9231d-e27e-4053-a397-43c5bb63d585 admin admin] RBAC: Authorization granted {{(pid=82025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 20:02:19.606984 dv-cinder-828806-6-smb devstack@keystone.service[82025]: [pid: 82025|app: 0|req: 1227/2395] 10.222.0.33 () {58 vars in 1122 bytes} [Tue Sep 13 20:02:19 2022] GET /identity/v3/roles => generated 1420 bytes in 82 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 13 20:02:19.612434 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bd9231d-e27e-4053-a397-43c5bb63d585 admin admin] Authenticating user token {{(pid=82025) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 20:02:19.618620 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.notifications [None req-c9d8db4b-fa9a-46a2-9c36-0c1e1ef5e60f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd13ad7faaf234091b7427ca1b2e968be'} {{(pid=82026) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 20:02:19.619456 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.notifications [None req-c9d8db4b-fa9a-46a2-9c36-0c1e1ef5e60f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd13ad7faaf234091b7427ca1b2e968be'} {{(pid=82026) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 20:02:19.640023 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bd9231d-e27e-4053-a397-43c5bb63d585 admin admin] Validating token access rules against request {{(pid=82025) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 20:02:19.647542 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.notifications [None req-c9d8db4b-fa9a-46a2-9c36-0c1e1ef5e60f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd13ad7faaf234091b7427ca1b2e968be'} {{(pid=82026) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 20:02:19.671339 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e778e485-4782-4624-a5b0-2941f61470ad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57539b6a6f3b4d589f5f5e1d211cd6a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b454f707d20347ada3d82aa85495635e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82025) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 20:02:19.671339 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e778e485-4782-4624-a5b0-2941f61470ad admin admin] REQUEST_METHOD: `PUT` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:02:19.671339 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e778e485-4782-4624-a5b0-2941f61470ad admin admin] SCRIPT_NAME: `/identity` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:02:19.671339 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e778e485-4782-4624-a5b0-2941f61470ad admin admin] PATH_INFO: `/v3/projects/f9f0530566f84755bee31b7df800846a/users/2a9d99bb42e44fd1ae3eceb8f5fa0910/roles/e5af7d5baa93469e9e486ef21c85474e` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:02:19.688067 dv-cinder-828806-6-smb devstack@keystone.service[82026]: [pid: 82026|app: 0|req: 1169/2396] 10.222.0.33 () {58 vars in 1224 bytes} [Tue Sep 13 20:02:19 2022] DELETE /identity/v3/users/d13ad7faaf234091b7427ca1b2e968be => generated 0 bytes in 508 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 20:02:19.695118 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-938b2f80-c885-44d3-bf2d-7a34ce3408b3 None None] REQUEST_METHOD: `POST` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:02:19.695647 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-938b2f80-c885-44d3-bf2d-7a34ce3408b3 None None] SCRIPT_NAME: `/identity` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:02:19.696079 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-938b2f80-c885-44d3-bf2d-7a34ce3408b3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:02:19.716278 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e778e485-4782-4624-a5b0-2941f61470ad admin admin] RBAC: Authorizing `identity:create_grant(project_id=f9f0530566f84755bee31b7df800846a, user_id=2a9d99bb42e44fd1ae3eceb8f5fa0910, role_id=e5af7d5baa93469e9e486ef21c85474e)` {{(pid=82025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 20:02:19.722042 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e778e485-4782-4624-a5b0-2941f61470ad admin admin] RBAC: Authorization granted {{(pid=82025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 20:02:19.733145 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.auth.core [None req-938b2f80-c885-44d3-bf2d-7a34ce3408b3 None None] MFA Rules not processed for user `57539b6a6f3b4d589f5f5e1d211cd6a0`. Rule list: `[]` (Enabled: `True`). {{(pid=82026) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 20:02:19.734818 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.common.fernet_utils [None req-938b2f80-c885-44d3-bf2d-7a34ce3408b3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82026) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 20:02:19.843833 dv-cinder-828806-6-smb devstack@keystone.service[82025]: [pid: 82025|app: 0|req: 1228/2397] 10.222.0.33 () {60 vars in 1483 bytes} [Tue Sep 13 20:02:19 2022] PUT /identity/v3/projects/f9f0530566f84755bee31b7df800846a/users/2a9d99bb42e44fd1ae3eceb8f5fa0910/roles/e5af7d5baa93469e9e486ef21c85474e => generated 0 bytes in 236 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 13 20:02:19.847942 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e778e485-4782-4624-a5b0-2941f61470ad admin admin] Authenticating user token {{(pid=82025) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 20:02:19.849971 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.fernet_utils [None req-e778e485-4782-4624-a5b0-2941f61470ad admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82025) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 20:02:19.858268 dv-cinder-828806-6-smb devstack@keystone.service[82026]: [pid: 82026|app: 0|req: 1170/2398] 10.222.0.33 () {58 vars in 958 bytes} [Tue Sep 13 20:02:19 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 20:02:19.869251 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-938b2f80-c885-44d3-bf2d-7a34ce3408b3 None None] Authenticating user token {{(pid=82026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 20:02:19.877345 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.common.fernet_utils [None req-938b2f80-c885-44d3-bf2d-7a34ce3408b3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82026) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 20:02:19.970480 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-938b2f80-c885-44d3-bf2d-7a34ce3408b3 None None] Validating token access rules against request {{(pid=82026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 20:02:20.018523 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e778e485-4782-4624-a5b0-2941f61470ad admin admin] Validating token access rules against request {{(pid=82025) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 20:02:20.024438 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-877a40c9-6cec-4805-ac4d-68313575689f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57539b6a6f3b4d589f5f5e1d211cd6a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b454f707d20347ada3d82aa85495635e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82025) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 20:02:20.025233 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-877a40c9-6cec-4805-ac4d-68313575689f admin admin] REQUEST_METHOD: `GET` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:02:20.025671 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-877a40c9-6cec-4805-ac4d-68313575689f admin admin] SCRIPT_NAME: `/identity` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:02:20.026250 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-877a40c9-6cec-4805-ac4d-68313575689f admin admin] PATH_INFO: `/v3/roles` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:02:20.027076 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-877a40c9-6cec-4805-ac4d-68313575689f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 20:02:20.030229 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-877a40c9-6cec-4805-ac4d-68313575689f admin admin] RBAC: Authorization granted {{(pid=82025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 20:02:20.047442 dv-cinder-828806-6-smb devstack@keystone.service[82025]: [pid: 82025|app: 0|req: 1229/2399] 10.222.0.33 () {58 vars in 1122 bytes} [Tue Sep 13 20:02:19 2022] GET /identity/v3/roles => generated 1420 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 13 20:02:20.049762 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5167e9cd-8c76-4e8f-ae0d-baf37e90ca4e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '023a2c79c2444611b3d431928e56685d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8c6fba0f15b4d6a84ff601919b7b8e4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 20:02:20.050241 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-877a40c9-6cec-4805-ac4d-68313575689f admin admin] Authenticating user token {{(pid=82025) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 20:02:20.050903 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5167e9cd-8c76-4e8f-ae0d-baf37e90ca4e service neutron] REQUEST_METHOD: `GET` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:02:20.051974 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5167e9cd-8c76-4e8f-ae0d-baf37e90ca4e service neutron] SCRIPT_NAME: `/identity` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:02:20.052443 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5167e9cd-8c76-4e8f-ae0d-baf37e90ca4e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:02:20.061259 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-877a40c9-6cec-4805-ac4d-68313575689f admin admin] Validating token access rules against request {{(pid=82025) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 20:02:20.066501 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ebb55f3-c696-4dbd-b43d-1ac5ea838a5c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57539b6a6f3b4d589f5f5e1d211cd6a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b454f707d20347ada3d82aa85495635e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82025) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 20:02:20.066904 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5167e9cd-8c76-4e8f-ae0d-baf37e90ca4e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 20:02:20.067318 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ebb55f3-c696-4dbd-b43d-1ac5ea838a5c admin admin] REQUEST_METHOD: `PUT` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:02:20.067625 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ebb55f3-c696-4dbd-b43d-1ac5ea838a5c admin admin] SCRIPT_NAME: `/identity` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:02:20.067905 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ebb55f3-c696-4dbd-b43d-1ac5ea838a5c admin admin] PATH_INFO: `/v3/projects/f9f0530566f84755bee31b7df800846a/users/2a9d99bb42e44fd1ae3eceb8f5fa0910/roles/e5af7d5baa93469e9e486ef21c85474e` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:02:20.069964 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5167e9cd-8c76-4e8f-ae0d-baf37e90ca4e service neutron] RBAC: Authorization granted {{(pid=82026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 20:02:20.070074 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ebb55f3-c696-4dbd-b43d-1ac5ea838a5c admin admin] RBAC: Authorizing `identity:create_grant(project_id=f9f0530566f84755bee31b7df800846a, user_id=2a9d99bb42e44fd1ae3eceb8f5fa0910, role_id=e5af7d5baa93469e9e486ef21c85474e)` {{(pid=82025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 20:02:20.072938 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ebb55f3-c696-4dbd-b43d-1ac5ea838a5c admin admin] RBAC: Authorization granted {{(pid=82025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 20:02:20.091388 dv-cinder-828806-6-smb devstack@keystone.service[82025]: [pid: 82025|app: 0|req: 1230/2400] 10.222.0.33 () {60 vars in 1483 bytes} [Tue Sep 13 20:02:20 2022] PUT /identity/v3/projects/f9f0530566f84755bee31b7df800846a/users/2a9d99bb42e44fd1ae3eceb8f5fa0910/roles/e5af7d5baa93469e9e486ef21c85474e => generated 0 bytes in 37 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 13 20:02:20.095019 dv-cinder-828806-6-smb devstack@keystone.service[82026]: [pid: 82026|app: 0|req: 1171/2401] 10.222.0.33 () {60 vars in 1365 bytes} [Tue Sep 13 20:02:19 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 226 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 20:02:20.175340 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ebb55f3-c696-4dbd-b43d-1ac5ea838a5c admin admin] Authenticating user token {{(pid=82025) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 20:02:20.177350 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.fernet_utils [None req-5ebb55f3-c696-4dbd-b43d-1ac5ea838a5c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82025) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 20:02:20.275363 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ebb55f3-c696-4dbd-b43d-1ac5ea838a5c admin admin] Validating token access rules against request {{(pid=82025) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 20:02:20.298093 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-051acdc3-f7a4-4012-b9c5-307319b6c014 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57539b6a6f3b4d589f5f5e1d211cd6a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b454f707d20347ada3d82aa85495635e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82025) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 20:02:20.298093 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-051acdc3-f7a4-4012-b9c5-307319b6c014 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:02:20.298938 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-051acdc3-f7a4-4012-b9c5-307319b6c014 admin admin] SCRIPT_NAME: `/identity` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:02:20.298938 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-051acdc3-f7a4-4012-b9c5-307319b6c014 admin admin] PATH_INFO: `/v3/users/94e675328e1a4b01a947f3ad8e071f4e` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:02:20.300898 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-051acdc3-f7a4-4012-b9c5-307319b6c014 admin admin] RBAC: Authorizing `identity:delete_user(user_id=94e675328e1a4b01a947f3ad8e071f4e)` {{(pid=82025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 20:02:20.315357 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-051acdc3-f7a4-4012-b9c5-307319b6c014 admin admin] RBAC: Authorization granted {{(pid=82025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 20:02:20.523794 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.notifications [None req-051acdc3-f7a4-4012-b9c5-307319b6c014 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '94e675328e1a4b01a947f3ad8e071f4e'} {{(pid=82025) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 20:02:20.629172 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.notifications [None req-051acdc3-f7a4-4012-b9c5-307319b6c014 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '94e675328e1a4b01a947f3ad8e071f4e'} {{(pid=82025) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 20:02:20.629724 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.notifications [None req-051acdc3-f7a4-4012-b9c5-307319b6c014 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '94e675328e1a4b01a947f3ad8e071f4e'} {{(pid=82025) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 20:02:20.645850 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.notifications [None req-051acdc3-f7a4-4012-b9c5-307319b6c014 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '94e675328e1a4b01a947f3ad8e071f4e'} {{(pid=82025) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 20:02:20.652738 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.notifications [None req-051acdc3-f7a4-4012-b9c5-307319b6c014 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '94e675328e1a4b01a947f3ad8e071f4e'} {{(pid=82025) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 20:02:20.659590 dv-cinder-828806-6-smb devstack@keystone.service[82025]: [pid: 82025|app: 0|req: 1231/2402] 10.222.0.33 () {58 vars in 1224 bytes} [Tue Sep 13 20:02:20 2022] DELETE /identity/v3/users/94e675328e1a4b01a947f3ad8e071f4e => generated 0 bytes in 485 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 20:02:20.664212 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1644abfb-5d42-48dd-88d3-74ca8786d7b8 None None] REQUEST_METHOD: `POST` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:02:20.664498 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1644abfb-5d42-48dd-88d3-74ca8786d7b8 None None] SCRIPT_NAME: `/identity` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:02:20.664771 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1644abfb-5d42-48dd-88d3-74ca8786d7b8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:02:20.684724 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.auth.core [None req-1644abfb-5d42-48dd-88d3-74ca8786d7b8 None None] MFA Rules not processed for user `57539b6a6f3b4d589f5f5e1d211cd6a0`. Rule list: `[]` (Enabled: `True`). {{(pid=82026) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 20:02:20.686064 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.common.fernet_utils [None req-1644abfb-5d42-48dd-88d3-74ca8786d7b8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82026) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 20:02:20.710972 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-051acdc3-f7a4-4012-b9c5-307319b6c014 admin admin] Authenticating user token {{(pid=82025) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 20:02:20.716831 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.fernet_utils [None req-051acdc3-f7a4-4012-b9c5-307319b6c014 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82025) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 20:02:20.777077 dv-cinder-828806-6-smb devstack@keystone.service[82026]: [pid: 82026|app: 0|req: 1172/2403] 10.222.0.33 () {58 vars in 958 bytes} [Tue Sep 13 20:02:20 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 20:02:20.784018 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1644abfb-5d42-48dd-88d3-74ca8786d7b8 None None] Authenticating user token {{(pid=82026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 20:02:20.786305 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.common.fernet_utils [None req-1644abfb-5d42-48dd-88d3-74ca8786d7b8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82026) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 20:02:20.820038 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-051acdc3-f7a4-4012-b9c5-307319b6c014 admin admin] Validating token access rules against request {{(pid=82025) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 20:02:20.825899 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63e414c6-5e65-4ff6-be77-29a976fbce31 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57539b6a6f3b4d589f5f5e1d211cd6a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b454f707d20347ada3d82aa85495635e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82025) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 20:02:20.826818 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63e414c6-5e65-4ff6-be77-29a976fbce31 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:02:20.827165 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63e414c6-5e65-4ff6-be77-29a976fbce31 admin admin] SCRIPT_NAME: `/identity` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:02:20.827456 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63e414c6-5e65-4ff6-be77-29a976fbce31 admin admin] PATH_INFO: `/v3/projects/6a699517e0674dd59d237787911e9340` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:02:20.828645 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63e414c6-5e65-4ff6-be77-29a976fbce31 admin admin] RBAC: Authorizing `identity:delete_project(project_id=6a699517e0674dd59d237787911e9340)` {{(pid=82025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 20:02:20.830573 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63e414c6-5e65-4ff6-be77-29a976fbce31 admin admin] RBAC: Authorization granted {{(pid=82025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 20:02:20.862989 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1644abfb-5d42-48dd-88d3-74ca8786d7b8 None None] Validating token access rules against request {{(pid=82026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 20:02:20.867783 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcf1bdfe-9fd2-42ac-8e88-500ef6744458 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '023a2c79c2444611b3d431928e56685d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8c6fba0f15b4d6a84ff601919b7b8e4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 20:02:20.868342 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcf1bdfe-9fd2-42ac-8e88-500ef6744458 service neutron] REQUEST_METHOD: `GET` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:02:20.868804 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcf1bdfe-9fd2-42ac-8e88-500ef6744458 service neutron] SCRIPT_NAME: `/identity` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:02:20.870331 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcf1bdfe-9fd2-42ac-8e88-500ef6744458 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:02:20.881593 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcf1bdfe-9fd2-42ac-8e88-500ef6744458 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 20:02:20.883071 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcf1bdfe-9fd2-42ac-8e88-500ef6744458 service neutron] RBAC: Authorization granted {{(pid=82026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 20:02:20.894704 dv-cinder-828806-6-smb devstack@keystone.service[82026]: [pid: 82026|app: 0|req: 1173/2404] 10.222.0.33 () {60 vars in 1365 bytes} [Tue Sep 13 20:02:20 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 111 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 13 20:02:20.971486 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.notifications [None req-63e414c6-5e65-4ff6-be77-29a976fbce31 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6a699517e0674dd59d237787911e9340', 'request_id': 'req-63e414c6-5e65-4ff6-be77-29a976fbce31'} {{(pid=82025) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 20:02:20.979437 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG dbcounter [-] [82025] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82025) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 20:02:20.986238 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.notifications [None req-63e414c6-5e65-4ff6-be77-29a976fbce31 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6a699517e0674dd59d237787911e9340', 'request_id': 'req-63e414c6-5e65-4ff6-be77-29a976fbce31'} {{(pid=82025) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 20:02:20.997997 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.notifications [None req-63e414c6-5e65-4ff6-be77-29a976fbce31 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6a699517e0674dd59d237787911e9340', 'request_id': 'req-63e414c6-5e65-4ff6-be77-29a976fbce31'} {{(pid=82025) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 20:02:21.112092 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.notifications [None req-63e414c6-5e65-4ff6-be77-29a976fbce31 admin admin] The token cache is being invalidate because project 6a699517e0674dd59d237787911e9340 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82025) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 13 20:02:21.112645 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.notifications [None req-63e414c6-5e65-4ff6-be77-29a976fbce31 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82025) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 20:02:21.113589 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.notifications [None req-63e414c6-5e65-4ff6-be77-29a976fbce31 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82025) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 20:02:21.115739 dv-cinder-828806-6-smb devstack@keystone.service[82025]: [pid: 82025|app: 0|req: 1232/2405] 10.222.0.33 () {58 vars in 1233 bytes} [Tue Sep 13 20:02:20 2022] DELETE /identity/v3/projects/6a699517e0674dd59d237787911e9340 => generated 0 bytes in 405 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 13 20:02:21.579359 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcf1bdfe-9fd2-42ac-8e88-500ef6744458 service neutron] Authenticating user token {{(pid=82026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 20:02:21.583919 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.common.fernet_utils [None req-bcf1bdfe-9fd2-42ac-8e88-500ef6744458 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82026) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 20:02:21.608623 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcf1bdfe-9fd2-42ac-8e88-500ef6744458 service neutron] Validating token access rules against request {{(pid=82026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 20:02:21.726191 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43153181-585d-49f5-871e-75679f48e7ce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57539b6a6f3b4d589f5f5e1d211cd6a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b454f707d20347ada3d82aa85495635e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 20:02:21.728342 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43153181-585d-49f5-871e-75679f48e7ce admin admin] REQUEST_METHOD: `DELETE` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:02:21.729805 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43153181-585d-49f5-871e-75679f48e7ce admin admin] SCRIPT_NAME: `/identity` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:02:21.730485 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43153181-585d-49f5-871e-75679f48e7ce admin admin] PATH_INFO: `/v3/projects/ea9fabf6b61c4f0a8368c9a04af89fef` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:02:21.734266 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43153181-585d-49f5-871e-75679f48e7ce admin admin] RBAC: Authorizing `identity:delete_project(project_id=ea9fabf6b61c4f0a8368c9a04af89fef)` {{(pid=82026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 20:02:21.739264 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43153181-585d-49f5-871e-75679f48e7ce admin admin] RBAC: Authorization granted {{(pid=82026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 20:02:21.744693 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG dbcounter [-] [82026] Writing DB stats keystone:SELECT=89,keystone:INSERT=4,keystone:DELETE=7 {{(pid=82026) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 20:02:21.908097 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.notifications [None req-43153181-585d-49f5-871e-75679f48e7ce admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ea9fabf6b61c4f0a8368c9a04af89fef', 'request_id': 'req-43153181-585d-49f5-871e-75679f48e7ce'} {{(pid=82026) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 20:02:21.986450 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.notifications [None req-43153181-585d-49f5-871e-75679f48e7ce admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ea9fabf6b61c4f0a8368c9a04af89fef', 'request_id': 'req-43153181-585d-49f5-871e-75679f48e7ce'} {{(pid=82026) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 20:02:21.995927 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.notifications [None req-43153181-585d-49f5-871e-75679f48e7ce admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ea9fabf6b61c4f0a8368c9a04af89fef', 'request_id': 'req-43153181-585d-49f5-871e-75679f48e7ce'} {{(pid=82026) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 20:02:22.019201 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.notifications [None req-43153181-585d-49f5-871e-75679f48e7ce admin admin] The token cache is being invalidate because project ea9fabf6b61c4f0a8368c9a04af89fef was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82026) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 13 20:02:22.019729 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.notifications [None req-43153181-585d-49f5-871e-75679f48e7ce admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82026) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 20:02:22.020587 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.notifications [None req-43153181-585d-49f5-871e-75679f48e7ce admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82026) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 20:02:22.024964 dv-cinder-828806-6-smb devstack@keystone.service[82026]: [pid: 82026|app: 0|req: 1174/2406] 10.222.0.33 () {58 vars in 1233 bytes} [Tue Sep 13 20:02:21 2022] DELETE /identity/v3/projects/ea9fabf6b61c4f0a8368c9a04af89fef => generated 0 bytes in 446 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 20:02:22.028602 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63e414c6-5e65-4ff6-be77-29a976fbce31 admin admin] Authenticating user token {{(pid=82025) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 20:02:22.030149 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.fernet_utils [None req-63e414c6-5e65-4ff6-be77-29a976fbce31 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82025) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 20:02:22.052995 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63e414c6-5e65-4ff6-be77-29a976fbce31 admin admin] Validating token access rules against request {{(pid=82025) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 20:02:22.118957 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG dbcounter [-] [82025] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=82025) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 20:02:22.161924 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13c3476d-b94d-440a-9274-6743a36abd57 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57539b6a6f3b4d589f5f5e1d211cd6a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b454f707d20347ada3d82aa85495635e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82025) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 20:02:22.162696 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13c3476d-b94d-440a-9274-6743a36abd57 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:02:22.164595 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13c3476d-b94d-440a-9274-6743a36abd57 admin admin] SCRIPT_NAME: `/identity` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:02:22.165002 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13c3476d-b94d-440a-9274-6743a36abd57 admin admin] PATH_INFO: `/v3/users/1dc9998117c44d1f8ea673c68bca9ef3` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:02:22.166879 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13c3476d-b94d-440a-9274-6743a36abd57 admin admin] RBAC: Authorizing `identity:delete_user(user_id=1dc9998117c44d1f8ea673c68bca9ef3)` {{(pid=82025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 20:02:22.169385 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13c3476d-b94d-440a-9274-6743a36abd57 admin admin] RBAC: Authorization granted {{(pid=82025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 20:02:22.346615 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.notifications [None req-13c3476d-b94d-440a-9274-6743a36abd57 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1dc9998117c44d1f8ea673c68bca9ef3'} {{(pid=82025) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 20:02:22.395252 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.notifications [None req-13c3476d-b94d-440a-9274-6743a36abd57 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1dc9998117c44d1f8ea673c68bca9ef3'} {{(pid=82025) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 20:02:22.395909 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.notifications [None req-13c3476d-b94d-440a-9274-6743a36abd57 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1dc9998117c44d1f8ea673c68bca9ef3'} {{(pid=82025) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 20:02:22.419458 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.notifications [None req-13c3476d-b94d-440a-9274-6743a36abd57 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1dc9998117c44d1f8ea673c68bca9ef3'} {{(pid=82025) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 20:02:22.427822 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.notifications [None req-13c3476d-b94d-440a-9274-6743a36abd57 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1dc9998117c44d1f8ea673c68bca9ef3'} {{(pid=82025) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 20:02:22.439789 dv-cinder-828806-6-smb devstack@keystone.service[82025]: [pid: 82025|app: 0|req: 1233/2407] 10.222.0.33 () {58 vars in 1224 bytes} [Tue Sep 13 20:02:22 2022] DELETE /identity/v3/users/1dc9998117c44d1f8ea673c68bca9ef3 => generated 0 bytes in 412 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 20:02:23.076240 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43153181-585d-49f5-871e-75679f48e7ce admin admin] Authenticating user token {{(pid=82026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 20:02:23.078544 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.common.fernet_utils [None req-43153181-585d-49f5-871e-75679f48e7ce admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82026) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 20:02:23.117074 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43153181-585d-49f5-871e-75679f48e7ce admin admin] Validating token access rules against request {{(pid=82026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 20:02:23.156081 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG dbcounter [-] [82025] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=82025) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 20:02:23.183020 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG dbcounter [-] [82026] Writing DB stats keystone:INSERT=2,keystone:SELECT=98 {{(pid=82026) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 20:02:23.275767 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6e32408-aeea-429a-9778-16ffca97d694 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57539b6a6f3b4d589f5f5e1d211cd6a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b454f707d20347ada3d82aa85495635e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 20:02:23.275767 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6e32408-aeea-429a-9778-16ffca97d694 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:02:23.275767 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6e32408-aeea-429a-9778-16ffca97d694 admin admin] SCRIPT_NAME: `/identity` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:02:23.275767 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6e32408-aeea-429a-9778-16ffca97d694 admin admin] PATH_INFO: `/v3/projects/2a14dbe8e33743b6a0b6582f737f6721` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:02:23.276882 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6e32408-aeea-429a-9778-16ffca97d694 admin admin] RBAC: Authorizing `identity:delete_project(project_id=2a14dbe8e33743b6a0b6582f737f6721)` {{(pid=82026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 20:02:23.280485 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6e32408-aeea-429a-9778-16ffca97d694 admin admin] RBAC: Authorization granted {{(pid=82026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 20:02:23.428672 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.notifications [None req-a6e32408-aeea-429a-9778-16ffca97d694 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2a14dbe8e33743b6a0b6582f737f6721', 'request_id': 'req-a6e32408-aeea-429a-9778-16ffca97d694'} {{(pid=82026) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 20:02:23.474889 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.notifications [None req-a6e32408-aeea-429a-9778-16ffca97d694 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2a14dbe8e33743b6a0b6582f737f6721', 'request_id': 'req-a6e32408-aeea-429a-9778-16ffca97d694'} {{(pid=82026) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 20:02:23.483179 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.notifications [None req-a6e32408-aeea-429a-9778-16ffca97d694 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2a14dbe8e33743b6a0b6582f737f6721', 'request_id': 'req-a6e32408-aeea-429a-9778-16ffca97d694'} {{(pid=82026) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 20:02:23.497177 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.notifications [None req-a6e32408-aeea-429a-9778-16ffca97d694 admin admin] The token cache is being invalidate because project 2a14dbe8e33743b6a0b6582f737f6721 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82026) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 13 20:02:23.497562 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.notifications [None req-a6e32408-aeea-429a-9778-16ffca97d694 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82026) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 20:02:23.498464 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.notifications [None req-a6e32408-aeea-429a-9778-16ffca97d694 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82026) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 20:02:23.500821 dv-cinder-828806-6-smb devstack@keystone.service[82026]: [pid: 82026|app: 0|req: 1175/2408] 10.222.0.33 () {58 vars in 1233 bytes} [Tue Sep 13 20:02:23 2022] DELETE /identity/v3/projects/2a14dbe8e33743b6a0b6582f737f6721 => generated 0 bytes in 426 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 20:02:23.504673 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13c3476d-b94d-440a-9274-6743a36abd57 admin admin] Authenticating user token {{(pid=82025) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 20:02:23.506206 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.fernet_utils [None req-13c3476d-b94d-440a-9274-6743a36abd57 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82025) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 20:02:23.522105 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13c3476d-b94d-440a-9274-6743a36abd57 admin admin] Validating token access rules against request {{(pid=82025) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 20:02:23.647363 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-564b9fb0-9864-4c31-ac3e-30fd96216ae8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57539b6a6f3b4d589f5f5e1d211cd6a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b454f707d20347ada3d82aa85495635e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82025) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 20:02:23.649877 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-564b9fb0-9864-4c31-ac3e-30fd96216ae8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:02:23.650594 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-564b9fb0-9864-4c31-ac3e-30fd96216ae8 admin admin] SCRIPT_NAME: `/identity` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:02:23.651325 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-564b9fb0-9864-4c31-ac3e-30fd96216ae8 admin admin] PATH_INFO: `/v3/users/a885d68f98e24e9d88d30709f08097a0` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:02:23.655883 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-564b9fb0-9864-4c31-ac3e-30fd96216ae8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a885d68f98e24e9d88d30709f08097a0)` {{(pid=82025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 20:02:23.659166 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-564b9fb0-9864-4c31-ac3e-30fd96216ae8 admin admin] RBAC: Authorization granted {{(pid=82025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 20:02:23.935649 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.notifications [None req-564b9fb0-9864-4c31-ac3e-30fd96216ae8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a885d68f98e24e9d88d30709f08097a0'} {{(pid=82025) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 20:02:24.049187 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.notifications [None req-564b9fb0-9864-4c31-ac3e-30fd96216ae8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a885d68f98e24e9d88d30709f08097a0'} {{(pid=82025) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 20:02:24.049187 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.notifications [None req-564b9fb0-9864-4c31-ac3e-30fd96216ae8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a885d68f98e24e9d88d30709f08097a0'} {{(pid=82025) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 20:02:24.067553 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.notifications [None req-564b9fb0-9864-4c31-ac3e-30fd96216ae8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a885d68f98e24e9d88d30709f08097a0'} {{(pid=82025) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 20:02:24.083071 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.notifications [None req-564b9fb0-9864-4c31-ac3e-30fd96216ae8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a885d68f98e24e9d88d30709f08097a0'} {{(pid=82025) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 20:02:24.092062 dv-cinder-828806-6-smb devstack@keystone.service[82025]: [pid: 82025|app: 0|req: 1234/2409] 10.222.0.33 () {58 vars in 1224 bytes} [Tue Sep 13 20:02:23 2022] DELETE /identity/v3/users/a885d68f98e24e9d88d30709f08097a0 => generated 0 bytes in 588 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 20:02:24.656054 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG dbcounter [-] [82026] Writing DB stats keystone:SELECT=93,keystone:INSERT=7 {{(pid=82026) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 20:02:24.828037 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6e32408-aeea-429a-9778-16ffca97d694 admin admin] Authenticating user token {{(pid=82026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 20:02:24.829748 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.common.fernet_utils [None req-a6e32408-aeea-429a-9778-16ffca97d694 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82026) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 20:02:24.858100 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6e32408-aeea-429a-9778-16ffca97d694 admin admin] Validating token access rules against request {{(pid=82026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 20:02:24.952851 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-217b9b74-433b-4688-9179-12836ee0093c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57539b6a6f3b4d589f5f5e1d211cd6a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b454f707d20347ada3d82aa85495635e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 20:02:24.953687 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-217b9b74-433b-4688-9179-12836ee0093c admin admin] REQUEST_METHOD: `DELETE` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:02:24.954177 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-217b9b74-433b-4688-9179-12836ee0093c admin admin] SCRIPT_NAME: `/identity` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:02:24.954518 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-217b9b74-433b-4688-9179-12836ee0093c admin admin] PATH_INFO: `/v3/projects/75e7e63fc816498d94bbf8a2ba54f046` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:02:24.955758 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-217b9b74-433b-4688-9179-12836ee0093c admin admin] RBAC: Authorizing `identity:delete_project(project_id=75e7e63fc816498d94bbf8a2ba54f046)` {{(pid=82026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 20:02:24.958226 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-217b9b74-433b-4688-9179-12836ee0093c admin admin] RBAC: Authorization granted {{(pid=82026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 20:02:25.091128 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.notifications [None req-217b9b74-433b-4688-9179-12836ee0093c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '75e7e63fc816498d94bbf8a2ba54f046', 'request_id': 'req-217b9b74-433b-4688-9179-12836ee0093c'} {{(pid=82026) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 20:02:25.187491 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.notifications [None req-217b9b74-433b-4688-9179-12836ee0093c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '75e7e63fc816498d94bbf8a2ba54f046', 'request_id': 'req-217b9b74-433b-4688-9179-12836ee0093c'} {{(pid=82026) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 20:02:25.215319 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.notifications [None req-217b9b74-433b-4688-9179-12836ee0093c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '75e7e63fc816498d94bbf8a2ba54f046', 'request_id': 'req-217b9b74-433b-4688-9179-12836ee0093c'} {{(pid=82026) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 20:02:25.238827 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.notifications [None req-217b9b74-433b-4688-9179-12836ee0093c admin admin] The token cache is being invalidate because project 75e7e63fc816498d94bbf8a2ba54f046 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82026) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 13 20:02:25.239204 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.notifications [None req-217b9b74-433b-4688-9179-12836ee0093c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82026) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 20:02:25.239889 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.notifications [None req-217b9b74-433b-4688-9179-12836ee0093c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82026) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 20:02:25.241871 dv-cinder-828806-6-smb devstack@keystone.service[82026]: [pid: 82026|app: 0|req: 1176/2410] 10.222.0.33 () {58 vars in 1233 bytes} [Tue Sep 13 20:02:24 2022] DELETE /identity/v3/projects/75e7e63fc816498d94bbf8a2ba54f046 => generated 0 bytes in 414 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 20:02:25.247871 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eed82fa-89d9-4f5e-bf2b-212d4a030366 None None] REQUEST_METHOD: `POST` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:02:25.249219 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eed82fa-89d9-4f5e-bf2b-212d4a030366 None None] SCRIPT_NAME: `/identity` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:02:25.249504 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eed82fa-89d9-4f5e-bf2b-212d4a030366 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:02:25.255115 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG dbcounter [-] [82025] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82025) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 20:02:25.280913 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.auth.core [None req-8eed82fa-89d9-4f5e-bf2b-212d4a030366 None None] MFA Rules not processed for user `57539b6a6f3b4d589f5f5e1d211cd6a0`. Rule list: `[]` (Enabled: `True`). {{(pid=82025) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 20:02:25.285513 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.fernet_utils [None req-8eed82fa-89d9-4f5e-bf2b-212d4a030366 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82025) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 20:02:25.375978 dv-cinder-828806-6-smb devstack@keystone.service[82025]: [pid: 82025|app: 0|req: 1235/2411] 10.222.0.33 () {58 vars in 958 bytes} [Tue Sep 13 20:02:25 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 20:02:25.384077 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9fdaf45-7a15-44bd-8c09-751be9b09581 None None] REQUEST_METHOD: `POST` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:02:25.384367 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9fdaf45-7a15-44bd-8c09-751be9b09581 None None] SCRIPT_NAME: `/identity` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:02:25.384648 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9fdaf45-7a15-44bd-8c09-751be9b09581 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:02:25.413234 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.auth.core [None req-a9fdaf45-7a15-44bd-8c09-751be9b09581 None None] MFA Rules not processed for user `57539b6a6f3b4d589f5f5e1d211cd6a0`. Rule list: `[]` (Enabled: `True`). {{(pid=82026) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 20:02:25.414553 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.common.fernet_utils [None req-a9fdaf45-7a15-44bd-8c09-751be9b09581 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82026) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 20:02:25.430033 dv-cinder-828806-6-smb devstack@keystone.service[82026]: [pid: 82026|app: 0|req: 1177/2412] 10.222.0.33 () {58 vars in 958 bytes} [Tue Sep 13 20:02:25 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 46 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 20:02:25.433055 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eed82fa-89d9-4f5e-bf2b-212d4a030366 None None] Authenticating user token {{(pid=82025) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 20:02:25.448825 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eed82fa-89d9-4f5e-bf2b-212d4a030366 None None] Validating token access rules against request {{(pid=82025) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 20:02:25.457362 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bae8962f-f45b-4d5d-99aa-cacd8c84fee7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57539b6a6f3b4d589f5f5e1d211cd6a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b454f707d20347ada3d82aa85495635e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82025) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 20:02:25.458212 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bae8962f-f45b-4d5d-99aa-cacd8c84fee7 admin admin] REQUEST_METHOD: `GET` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:02:25.459027 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bae8962f-f45b-4d5d-99aa-cacd8c84fee7 admin admin] SCRIPT_NAME: `/identity` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:02:25.459541 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bae8962f-f45b-4d5d-99aa-cacd8c84fee7 admin admin] PATH_INFO: `/v3/domains` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:02:25.460613 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bae8962f-f45b-4d5d-99aa-cacd8c84fee7 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82025) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 20:02:25.461208 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bae8962f-f45b-4d5d-99aa-cacd8c84fee7 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 20:02:25.463609 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bae8962f-f45b-4d5d-99aa-cacd8c84fee7 admin admin] RBAC: Authorization granted {{(pid=82025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 20:02:25.479658 dv-cinder-828806-6-smb devstack@keystone.service[82025]: [pid: 82025|app: 0|req: 1236/2413] 10.222.0.33 () {58 vars in 1153 bytes} [Tue Sep 13 20:02:25 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 20:02:25.485981 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9fdaf45-7a15-44bd-8c09-751be9b09581 None None] Authenticating user token {{(pid=82026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 20:02:25.500198 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9fdaf45-7a15-44bd-8c09-751be9b09581 None None] Validating token access rules against request {{(pid=82026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 20:02:25.505130 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a05aa02-b894-4980-843b-ce58fa56f726 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57539b6a6f3b4d589f5f5e1d211cd6a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b454f707d20347ada3d82aa85495635e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 20:02:25.505857 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a05aa02-b894-4980-843b-ce58fa56f726 admin admin] REQUEST_METHOD: `POST` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:02:25.506064 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a05aa02-b894-4980-843b-ce58fa56f726 admin admin] SCRIPT_NAME: `/identity` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:02:25.506282 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a05aa02-b894-4980-843b-ce58fa56f726 admin admin] PATH_INFO: `/v3/projects` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:02:25.506951 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a05aa02-b894-4980-843b-ce58fa56f726 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 20:02:25.508889 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a05aa02-b894-4980-843b-ce58fa56f726 admin admin] RBAC: Authorization granted {{(pid=82026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 20:02:25.615628 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG dbcounter [-] [82026] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=82026) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 20:02:25.632512 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bae8962f-f45b-4d5d-99aa-cacd8c84fee7 admin admin] Authenticating user token {{(pid=82025) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 20:02:25.632673 dv-cinder-828806-6-smb devstack@keystone.service[82026]: [pid: 82026|app: 0|req: 1178/2414] 10.222.0.33 () {60 vars in 1153 bytes} [Tue Sep 13 20:02:25 2022] POST /identity/v3/projects => generated 373 bytes in 146 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 13 20:02:25.651775 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bae8962f-f45b-4d5d-99aa-cacd8c84fee7 admin admin] Validating token access rules against request {{(pid=82025) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 20:02:25.763515 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc0d956c-6cda-4a21-b59a-98d949ece23d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57539b6a6f3b4d589f5f5e1d211cd6a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b454f707d20347ada3d82aa85495635e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82025) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 20:02:25.764146 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc0d956c-6cda-4a21-b59a-98d949ece23d admin admin] REQUEST_METHOD: `POST` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:02:25.764613 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc0d956c-6cda-4a21-b59a-98d949ece23d admin admin] SCRIPT_NAME: `/identity` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:02:25.768017 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc0d956c-6cda-4a21-b59a-98d949ece23d admin admin] PATH_INFO: `/v3/users` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:02:25.769497 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc0d956c-6cda-4a21-b59a-98d949ece23d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 20:02:25.773599 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc0d956c-6cda-4a21-b59a-98d949ece23d admin admin] RBAC: Authorization granted {{(pid=82025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 20:02:25.896748 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a05aa02-b894-4980-843b-ce58fa56f726 admin admin] Authenticating user token {{(pid=82026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 20:02:25.897296 dv-cinder-828806-6-smb devstack@keystone.service[82025]: [pid: 82025|app: 0|req: 1237/2415] 10.222.0.33 () {60 vars in 1144 bytes} [Tue Sep 13 20:02:25 2022] POST /identity/v3/users => generated 287 bytes in 265 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 13 20:02:25.913194 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a05aa02-b894-4980-843b-ce58fa56f726 admin admin] Validating token access rules against request {{(pid=82026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 20:02:25.920265 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82db767c-cf71-431c-a09d-be8013e1c573 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57539b6a6f3b4d589f5f5e1d211cd6a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b454f707d20347ada3d82aa85495635e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 20:02:25.921294 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82db767c-cf71-431c-a09d-be8013e1c573 admin admin] REQUEST_METHOD: `GET` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:02:25.921784 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82db767c-cf71-431c-a09d-be8013e1c573 admin admin] SCRIPT_NAME: `/identity` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:02:25.922276 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82db767c-cf71-431c-a09d-be8013e1c573 admin admin] PATH_INFO: `/v3/roles` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:02:25.924086 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82db767c-cf71-431c-a09d-be8013e1c573 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 20:02:25.926302 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82db767c-cf71-431c-a09d-be8013e1c573 admin admin] RBAC: Authorization granted {{(pid=82026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 20:02:25.952068 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc0d956c-6cda-4a21-b59a-98d949ece23d admin admin] Authenticating user token {{(pid=82025) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 20:02:25.954230 dv-cinder-828806-6-smb devstack@keystone.service[82026]: [pid: 82026|app: 0|req: 1179/2416] 10.222.0.33 () {58 vars in 1122 bytes} [Tue Sep 13 20:02:25 2022] GET /identity/v3/roles => generated 1420 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 13 20:02:25.965173 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc0d956c-6cda-4a21-b59a-98d949ece23d admin admin] Validating token access rules against request {{(pid=82025) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 20:02:25.976655 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7bce5ff-6705-45ae-b023-5f74f947a082 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57539b6a6f3b4d589f5f5e1d211cd6a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b454f707d20347ada3d82aa85495635e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82025) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 20:02:25.977812 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7bce5ff-6705-45ae-b023-5f74f947a082 admin admin] REQUEST_METHOD: `GET` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:02:25.978091 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7bce5ff-6705-45ae-b023-5f74f947a082 admin admin] SCRIPT_NAME: `/identity` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:02:25.978569 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7bce5ff-6705-45ae-b023-5f74f947a082 admin admin] PATH_INFO: `/v3/roles` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:02:25.979376 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7bce5ff-6705-45ae-b023-5f74f947a082 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 20:02:25.982695 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7bce5ff-6705-45ae-b023-5f74f947a082 admin admin] RBAC: Authorization granted {{(pid=82025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 20:02:26.002133 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82db767c-cf71-431c-a09d-be8013e1c573 admin admin] Authenticating user token {{(pid=82026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 20:02:26.002883 dv-cinder-828806-6-smb devstack@keystone.service[82025]: [pid: 82025|app: 0|req: 1238/2417] 10.222.0.33 () {58 vars in 1122 bytes} [Tue Sep 13 20:02:25 2022] GET /identity/v3/roles => generated 1420 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 13 20:02:26.022521 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82db767c-cf71-431c-a09d-be8013e1c573 admin admin] Validating token access rules against request {{(pid=82026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 20:02:26.029812 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a18c6e34-c3ef-4557-82d7-bfd2d6b0c86c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57539b6a6f3b4d589f5f5e1d211cd6a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b454f707d20347ada3d82aa85495635e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 20:02:26.030509 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a18c6e34-c3ef-4557-82d7-bfd2d6b0c86c admin admin] REQUEST_METHOD: `PUT` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:02:26.030800 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a18c6e34-c3ef-4557-82d7-bfd2d6b0c86c admin admin] SCRIPT_NAME: `/identity` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:02:26.031108 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a18c6e34-c3ef-4557-82d7-bfd2d6b0c86c admin admin] PATH_INFO: `/v3/projects/0354450ac9004c409954bfe0fb9763db/users/ef0a2541af9748cf82a3c69fdb530af1/roles/3618ab638a65401f82333da7596d1daf` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:02:26.059904 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a18c6e34-c3ef-4557-82d7-bfd2d6b0c86c admin admin] RBAC: Authorizing `identity:create_grant(project_id=0354450ac9004c409954bfe0fb9763db, user_id=ef0a2541af9748cf82a3c69fdb530af1, role_id=3618ab638a65401f82333da7596d1daf)` {{(pid=82026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 20:02:26.064349 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a18c6e34-c3ef-4557-82d7-bfd2d6b0c86c admin admin] RBAC: Authorization granted {{(pid=82026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 20:02:26.163799 dv-cinder-828806-6-smb devstack@keystone.service[82026]: [pid: 82026|app: 0|req: 1180/2418] 10.222.0.33 () {60 vars in 1483 bytes} [Tue Sep 13 20:02:26 2022] PUT /identity/v3/projects/0354450ac9004c409954bfe0fb9763db/users/ef0a2541af9748cf82a3c69fdb530af1/roles/3618ab638a65401f82333da7596d1daf => generated 0 bytes in 162 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 20:02:26.178382 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c007e894-fc30-4315-b38c-b34a084e3b61 None None] REQUEST_METHOD: `POST` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:02:26.180979 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c007e894-fc30-4315-b38c-b34a084e3b61 None None] SCRIPT_NAME: `/identity` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:02:26.180979 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c007e894-fc30-4315-b38c-b34a084e3b61 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:02:26.219930 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.auth.core [None req-c007e894-fc30-4315-b38c-b34a084e3b61 None None] MFA Rules not processed for user `ef0a2541af9748cf82a3c69fdb530af1`. Rule list: `[]` (Enabled: `True`). {{(pid=82025) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 20:02:26.221291 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.fernet_utils [None req-c007e894-fc30-4315-b38c-b34a084e3b61 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82025) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 20:02:26.327610 dv-cinder-828806-6-smb devstack@keystone.service[82025]: [pid: 82025|app: 0|req: 1239/2419] 10.222.0.33 () {58 vars in 958 bytes} [Tue Sep 13 20:02:26 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 150 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 20:02:26.345046 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a18c6e34-c3ef-4557-82d7-bfd2d6b0c86c admin admin] Authenticating user token {{(pid=82026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 20:02:26.347124 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.common.fernet_utils [None req-a18c6e34-c3ef-4557-82d7-bfd2d6b0c86c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82026) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 20:02:26.430369 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a18c6e34-c3ef-4557-82d7-bfd2d6b0c86c admin admin] Validating token access rules against request {{(pid=82026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 20:02:26.435502 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c287fe94-c742-4f1f-90e7-ad0fba7e1aae service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46024fc6167f4321818b1bed27a521a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8c6fba0f15b4d6a84ff601919b7b8e4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 20:02:26.436474 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c287fe94-c742-4f1f-90e7-ad0fba7e1aae service cinder] REQUEST_METHOD: `GET` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:02:26.436767 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c287fe94-c742-4f1f-90e7-ad0fba7e1aae service cinder] SCRIPT_NAME: `/identity` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:02:26.437053 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c287fe94-c742-4f1f-90e7-ad0fba7e1aae service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:02:26.446620 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c287fe94-c742-4f1f-90e7-ad0fba7e1aae service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=82026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 20:02:26.448126 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c287fe94-c742-4f1f-90e7-ad0fba7e1aae service cinder] RBAC: Authorization granted {{(pid=82026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 20:02:26.470003 dv-cinder-828806-6-smb devstack@keystone.service[82026]: [pid: 82026|app: 0|req: 1181/2420] 10.222.0.33 () {60 vars in 1365 bytes} [Tue Sep 13 20:02:26 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 125 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 20:02:26.506519 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c007e894-fc30-4315-b38c-b34a084e3b61 None None] Authenticating user token {{(pid=82025) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 20:02:26.598037 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c007e894-fc30-4315-b38c-b34a084e3b61 None None] Validating token access rules against request {{(pid=82025) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 20:02:26.603746 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0cf3a7f-e79a-49e8-9222-e4c276a02c32 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57539b6a6f3b4d589f5f5e1d211cd6a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b454f707d20347ada3d82aa85495635e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82025) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 20:02:26.604917 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0cf3a7f-e79a-49e8-9222-e4c276a02c32 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:02:26.605434 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0cf3a7f-e79a-49e8-9222-e4c276a02c32 admin admin] SCRIPT_NAME: `/identity` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:02:26.605886 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0cf3a7f-e79a-49e8-9222-e4c276a02c32 admin admin] PATH_INFO: `/v3/users/ef0a2541af9748cf82a3c69fdb530af1` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:02:26.607821 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0cf3a7f-e79a-49e8-9222-e4c276a02c32 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ef0a2541af9748cf82a3c69fdb530af1)` {{(pid=82025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 20:02:26.609844 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0cf3a7f-e79a-49e8-9222-e4c276a02c32 admin admin] RBAC: Authorization granted {{(pid=82025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 20:02:26.853499 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG dbcounter [-] [82025] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=82025) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 20:02:26.877130 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-342a3a03-1283-48c9-986f-a97d44b2d63b None None] REQUEST_METHOD: `POST` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:02:26.877428 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-342a3a03-1283-48c9-986f-a97d44b2d63b None None] SCRIPT_NAME: `/identity` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:02:26.877712 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-342a3a03-1283-48c9-986f-a97d44b2d63b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:02:26.894194 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.notifications [None req-a0cf3a7f-e79a-49e8-9222-e4c276a02c32 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ef0a2541af9748cf82a3c69fdb530af1'} {{(pid=82025) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 20:02:26.911417 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.auth.core [None req-342a3a03-1283-48c9-986f-a97d44b2d63b None None] MFA Rules not processed for user `2a9d99bb42e44fd1ae3eceb8f5fa0910`. Rule list: `[]` (Enabled: `True`). {{(pid=82026) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 20:02:26.912704 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.common.fernet_utils [None req-342a3a03-1283-48c9-986f-a97d44b2d63b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82026) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 20:02:26.949754 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG dbcounter [-] [82026] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82026) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 20:02:26.994418 dv-cinder-828806-6-smb devstack@keystone.service[82026]: [pid: 82026|app: 0|req: 1182/2421] 10.222.0.33 () {58 vars in 958 bytes} [Tue Sep 13 20:02:26 2022] POST /identity/v3/auth/tokens => generated 3329 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 13 20:02:27.007055 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-342a3a03-1283-48c9-986f-a97d44b2d63b None None] Authenticating user token {{(pid=82026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 20:02:27.008483 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.common.fernet_utils [None req-342a3a03-1283-48c9-986f-a97d44b2d63b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82026) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 20:02:27.014559 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.notifications [None req-a0cf3a7f-e79a-49e8-9222-e4c276a02c32 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ef0a2541af9748cf82a3c69fdb530af1'} {{(pid=82025) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 20:02:27.016535 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.notifications [None req-a0cf3a7f-e79a-49e8-9222-e4c276a02c32 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ef0a2541af9748cf82a3c69fdb530af1'} {{(pid=82025) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 20:02:27.035372 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.notifications [None req-a0cf3a7f-e79a-49e8-9222-e4c276a02c32 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ef0a2541af9748cf82a3c69fdb530af1'} {{(pid=82025) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 20:02:27.046497 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.notifications [None req-a0cf3a7f-e79a-49e8-9222-e4c276a02c32 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ef0a2541af9748cf82a3c69fdb530af1'} {{(pid=82025) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 20:02:27.058854 dv-cinder-828806-6-smb devstack@keystone.service[82025]: [pid: 82025|app: 0|req: 1240/2422] 10.222.0.33 () {58 vars in 1224 bytes} [Tue Sep 13 20:02:26 2022] DELETE /identity/v3/users/ef0a2541af9748cf82a3c69fdb530af1 => generated 0 bytes in 550 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 13 20:02:27.061211 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d140d52-3e0e-46c7-ac24-a8e54e7625e3 None None] REQUEST_METHOD: `POST` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:02:27.061507 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d140d52-3e0e-46c7-ac24-a8e54e7625e3 None None] SCRIPT_NAME: `/identity` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:02:27.061792 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d140d52-3e0e-46c7-ac24-a8e54e7625e3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:02:27.084104 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-342a3a03-1283-48c9-986f-a97d44b2d63b None None] Validating token access rules against request {{(pid=82026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 20:02:27.084354 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.auth.core [None req-6d140d52-3e0e-46c7-ac24-a8e54e7625e3 None None] MFA Rules not processed for user `57539b6a6f3b4d589f5f5e1d211cd6a0`. Rule list: `[]` (Enabled: `True`). {{(pid=82025) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 20:02:27.085723 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.fernet_utils [None req-6d140d52-3e0e-46c7-ac24-a8e54e7625e3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82025) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 20:02:27.162512 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3398e3c-8c07-4d61-b435-fcb2c7367f40 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f7b2421bf1f84193a29f79709d1d5a19', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8c6fba0f15b4d6a84ff601919b7b8e4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 20:02:27.163166 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3398e3c-8c07-4d61-b435-fcb2c7367f40 service glance] REQUEST_METHOD: `GET` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:02:27.163763 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3398e3c-8c07-4d61-b435-fcb2c7367f40 service glance] SCRIPT_NAME: `/identity` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:02:27.164594 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3398e3c-8c07-4d61-b435-fcb2c7367f40 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:02:27.169504 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.common.fernet_utils [None req-a3398e3c-8c07-4d61-b435-fcb2c7367f40 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82026) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 20:02:27.178697 dv-cinder-828806-6-smb devstack@keystone.service[82025]: [pid: 82025|app: 0|req: 1241/2423] 10.222.0.33 () {58 vars in 958 bytes} [Tue Sep 13 20:02:27 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 20:02:27.179399 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d140d52-3e0e-46c7-ac24-a8e54e7625e3 None None] Authenticating user token {{(pid=82025) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 20:02:27.183528 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.fernet_utils [None req-6d140d52-3e0e-46c7-ac24-a8e54e7625e3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82025) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 20:02:27.200247 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d140d52-3e0e-46c7-ac24-a8e54e7625e3 None None] Validating token access rules against request {{(pid=82025) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 20:02:27.205605 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-178543df-85a8-489d-a230-c7fca911569f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57539b6a6f3b4d589f5f5e1d211cd6a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b454f707d20347ada3d82aa85495635e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82025) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 20:02:27.206244 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-178543df-85a8-489d-a230-c7fca911569f admin admin] REQUEST_METHOD: `DELETE` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:02:27.206566 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-178543df-85a8-489d-a230-c7fca911569f admin admin] SCRIPT_NAME: `/identity` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:02:27.206849 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-178543df-85a8-489d-a230-c7fca911569f admin admin] PATH_INFO: `/v3/users/80c6474d00964c6a8e886ae0c5f091d0` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:02:27.208057 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-178543df-85a8-489d-a230-c7fca911569f admin admin] RBAC: Authorizing `identity:delete_user(user_id=80c6474d00964c6a8e886ae0c5f091d0)` {{(pid=82025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 20:02:27.210278 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-178543df-85a8-489d-a230-c7fca911569f admin admin] RBAC: Authorization granted {{(pid=82025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 20:02:27.247475 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3398e3c-8c07-4d61-b435-fcb2c7367f40 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=82026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 20:02:27.249197 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3398e3c-8c07-4d61-b435-fcb2c7367f40 service glance] RBAC: Authorization granted {{(pid=82026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 20:02:27.259391 dv-cinder-828806-6-smb devstack@keystone.service[82026]: [pid: 82026|app: 0|req: 1183/2424] 10.222.0.33 () {60 vars in 1365 bytes} [Tue Sep 13 20:02:27 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 253 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 13 20:02:27.263049 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3398e3c-8c07-4d61-b435-fcb2c7367f40 service glance] Authenticating user token {{(pid=82026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 20:02:27.265093 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.common.fernet_utils [None req-a3398e3c-8c07-4d61-b435-fcb2c7367f40 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82026) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 20:02:27.365375 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3398e3c-8c07-4d61-b435-fcb2c7367f40 service glance] Validating token access rules against request {{(pid=82026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 20:02:27.370913 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54d2cb03-4982-4669-b574-e8a7befc9501 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '023a2c79c2444611b3d431928e56685d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8c6fba0f15b4d6a84ff601919b7b8e4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 20:02:27.371771 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54d2cb03-4982-4669-b574-e8a7befc9501 service neutron] REQUEST_METHOD: `GET` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:02:27.372169 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54d2cb03-4982-4669-b574-e8a7befc9501 service neutron] SCRIPT_NAME: `/identity` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:02:27.372670 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54d2cb03-4982-4669-b574-e8a7befc9501 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:02:27.385510 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54d2cb03-4982-4669-b574-e8a7befc9501 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 20:02:27.386973 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54d2cb03-4982-4669-b574-e8a7befc9501 service neutron] RBAC: Authorization granted {{(pid=82026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 20:02:27.399712 dv-cinder-828806-6-smb devstack@keystone.service[82026]: [pid: 82026|app: 0|req: 1184/2425] 10.222.0.33 () {60 vars in 1365 bytes} [Tue Sep 13 20:02:27 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 138 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 20:02:27.406793 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.notifications [None req-178543df-85a8-489d-a230-c7fca911569f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '80c6474d00964c6a8e886ae0c5f091d0'} {{(pid=82025) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 20:02:27.486436 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.notifications [None req-178543df-85a8-489d-a230-c7fca911569f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '80c6474d00964c6a8e886ae0c5f091d0'} {{(pid=82025) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 20:02:27.487326 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.notifications [None req-178543df-85a8-489d-a230-c7fca911569f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '80c6474d00964c6a8e886ae0c5f091d0'} {{(pid=82025) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 20:02:27.518314 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.notifications [None req-178543df-85a8-489d-a230-c7fca911569f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '80c6474d00964c6a8e886ae0c5f091d0'} {{(pid=82025) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 20:02:27.528902 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.notifications [None req-178543df-85a8-489d-a230-c7fca911569f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '80c6474d00964c6a8e886ae0c5f091d0'} {{(pid=82025) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 20:02:27.536103 dv-cinder-828806-6-smb devstack@keystone.service[82025]: [pid: 82025|app: 0|req: 1242/2426] 10.222.0.33 () {58 vars in 1224 bytes} [Tue Sep 13 20:02:27 2022] DELETE /identity/v3/users/80c6474d00964c6a8e886ae0c5f091d0 => generated 0 bytes in 357 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 20:02:27.543060 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8faee79b-c082-4786-a49e-efdc48fcbdd8 None None] REQUEST_METHOD: `POST` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:02:27.543404 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8faee79b-c082-4786-a49e-efdc48fcbdd8 None None] SCRIPT_NAME: `/identity` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:02:27.544270 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8faee79b-c082-4786-a49e-efdc48fcbdd8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:02:27.591804 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.auth.core [None req-8faee79b-c082-4786-a49e-efdc48fcbdd8 None None] MFA Rules not processed for user `57539b6a6f3b4d589f5f5e1d211cd6a0`. Rule list: `[]` (Enabled: `True`). {{(pid=82026) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 20:02:27.593113 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.common.fernet_utils [None req-8faee79b-c082-4786-a49e-efdc48fcbdd8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82026) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 20:02:27.653971 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5eb96af-fce5-4a66-b8c8-b2caad2947cb None None] REQUEST_METHOD: `POST` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:02:27.654263 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5eb96af-fce5-4a66-b8c8-b2caad2947cb None None] SCRIPT_NAME: `/identity` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:02:27.654577 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5eb96af-fce5-4a66-b8c8-b2caad2947cb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:02:27.679395 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.auth.core [None req-b5eb96af-fce5-4a66-b8c8-b2caad2947cb None None] MFA Rules not processed for user `a28e738b894442e2bc9880eeb64fc0c8`. Rule list: `[]` (Enabled: `True`). {{(pid=82025) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 20:02:27.680666 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.fernet_utils [None req-b5eb96af-fce5-4a66-b8c8-b2caad2947cb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82025) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 20:02:27.694389 dv-cinder-828806-6-smb devstack@keystone.service[82026]: [pid: 82026|app: 0|req: 1185/2427] 10.222.0.33 () {58 vars in 958 bytes} [Tue Sep 13 20:02:27 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 150 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 20:02:27.702117 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8faee79b-c082-4786-a49e-efdc48fcbdd8 None None] Authenticating user token {{(pid=82026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 20:02:27.703638 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.common.fernet_utils [None req-8faee79b-c082-4786-a49e-efdc48fcbdd8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82026) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 20:02:27.801086 dv-cinder-828806-6-smb devstack@keystone.service[82025]: [pid: 82025|app: 0|req: 1243/2428] 10.222.0.33 () {58 vars in 1009 bytes} [Tue Sep 13 20:02:27 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 148 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 13 20:02:27.824924 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8faee79b-c082-4786-a49e-efdc48fcbdd8 None None] Validating token access rules against request {{(pid=82026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 20:02:27.833093 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-490f8781-03b4-4fa0-aea8-5a23de448b28 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '023a2c79c2444611b3d431928e56685d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8c6fba0f15b4d6a84ff601919b7b8e4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 20:02:27.836388 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-490f8781-03b4-4fa0-aea8-5a23de448b28 service neutron] REQUEST_METHOD: `GET` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:02:27.836814 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-490f8781-03b4-4fa0-aea8-5a23de448b28 service neutron] SCRIPT_NAME: `/identity` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:02:27.837167 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-490f8781-03b4-4fa0-aea8-5a23de448b28 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:02:27.861120 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-490f8781-03b4-4fa0-aea8-5a23de448b28 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 20:02:27.862814 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-490f8781-03b4-4fa0-aea8-5a23de448b28 service neutron] RBAC: Authorization granted {{(pid=82026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 20:02:27.865573 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5eb96af-fce5-4a66-b8c8-b2caad2947cb None None] Authenticating user token {{(pid=82025) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 20:02:27.867617 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.fernet_utils [None req-b5eb96af-fce5-4a66-b8c8-b2caad2947cb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82025) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 20:02:27.889072 dv-cinder-828806-6-smb devstack@keystone.service[82026]: [pid: 82026|app: 0|req: 1186/2429] 10.222.0.33 () {60 vars in 1365 bytes} [Tue Sep 13 20:02:27 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 188 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 13 20:02:27.938800 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG dbcounter [-] [82025] Writing DB stats keystone:SELECT=94,keystone:INSERT=4,keystone:DELETE=2 {{(pid=82025) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 20:02:27.963411 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG dbcounter [-] [82026] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=82026) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 20:02:27.969983 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5eb96af-fce5-4a66-b8c8-b2caad2947cb None None] Validating token access rules against request {{(pid=82025) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 20:02:27.978480 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3727ae2d-d32a-4698-a667-a65986765395 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa5a83574f7f424c805e130c462d5969', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8c6fba0f15b4d6a84ff601919b7b8e4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82025) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 20:02:27.981544 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3727ae2d-d32a-4698-a667-a65986765395 service swift] REQUEST_METHOD: `GET` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:02:27.981544 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3727ae2d-d32a-4698-a667-a65986765395 service swift] SCRIPT_NAME: `/identity` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:02:27.981544 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3727ae2d-d32a-4698-a667-a65986765395 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:02:27.993313 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3727ae2d-d32a-4698-a667-a65986765395 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=82025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 20:02:27.993543 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3727ae2d-d32a-4698-a667-a65986765395 service swift] RBAC: Authorization granted {{(pid=82025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 20:02:28.005287 dv-cinder-828806-6-smb devstack@keystone.service[82025]: [pid: 82025|app: 0|req: 1244/2430] 10.222.0.33 () {60 vars in 1384 bytes} [Tue Sep 13 20:02:27 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 140 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Sep 13 20:02:28.155969 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-490f8781-03b4-4fa0-aea8-5a23de448b28 service neutron] Authenticating user token {{(pid=82026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 20:02:28.158807 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.common.fernet_utils [None req-490f8781-03b4-4fa0-aea8-5a23de448b28 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82026) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 20:02:28.182618 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-490f8781-03b4-4fa0-aea8-5a23de448b28 service neutron] Validating token access rules against request {{(pid=82026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 20:02:28.206143 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60a176c8-d825-4ef9-968a-bbf0a992188a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57539b6a6f3b4d589f5f5e1d211cd6a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b454f707d20347ada3d82aa85495635e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 20:02:28.208131 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60a176c8-d825-4ef9-968a-bbf0a992188a admin admin] REQUEST_METHOD: `DELETE` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:02:28.210866 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60a176c8-d825-4ef9-968a-bbf0a992188a admin admin] SCRIPT_NAME: `/identity` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:02:28.213786 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60a176c8-d825-4ef9-968a-bbf0a992188a admin admin] PATH_INFO: `/v3/projects/0354450ac9004c409954bfe0fb9763db` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:02:28.222844 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60a176c8-d825-4ef9-968a-bbf0a992188a admin admin] RBAC: Authorizing `identity:delete_project(project_id=0354450ac9004c409954bfe0fb9763db)` {{(pid=82026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 20:02:28.229388 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60a176c8-d825-4ef9-968a-bbf0a992188a admin admin] RBAC: Authorization granted {{(pid=82026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 20:02:28.490265 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.notifications [None req-60a176c8-d825-4ef9-968a-bbf0a992188a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0354450ac9004c409954bfe0fb9763db', 'request_id': 'req-60a176c8-d825-4ef9-968a-bbf0a992188a'} {{(pid=82026) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 20:02:28.567643 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.notifications [None req-60a176c8-d825-4ef9-968a-bbf0a992188a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0354450ac9004c409954bfe0fb9763db', 'request_id': 'req-60a176c8-d825-4ef9-968a-bbf0a992188a'} {{(pid=82026) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 20:02:28.579378 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3727ae2d-d32a-4698-a667-a65986765395 service swift] Authenticating user token {{(pid=82025) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 20:02:28.581778 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.fernet_utils [None req-3727ae2d-d32a-4698-a667-a65986765395 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82025) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 20:02:28.594601 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.notifications [None req-60a176c8-d825-4ef9-968a-bbf0a992188a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0354450ac9004c409954bfe0fb9763db', 'request_id': 'req-60a176c8-d825-4ef9-968a-bbf0a992188a'} {{(pid=82026) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 20:02:28.634215 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.notifications [None req-60a176c8-d825-4ef9-968a-bbf0a992188a admin admin] The token cache is being invalidate because project 0354450ac9004c409954bfe0fb9763db was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82026) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 13 20:02:28.634215 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.notifications [None req-60a176c8-d825-4ef9-968a-bbf0a992188a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82026) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 20:02:28.635616 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3727ae2d-d32a-4698-a667-a65986765395 service swift] Validating token access rules against request {{(pid=82025) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 20:02:28.638228 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.notifications [None req-60a176c8-d825-4ef9-968a-bbf0a992188a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82026) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 20:02:28.655763 dv-cinder-828806-6-smb devstack@keystone.service[82026]: [pid: 82026|app: 0|req: 1187/2431] 10.222.0.33 () {58 vars in 1233 bytes} [Tue Sep 13 20:02:28 2022] DELETE /identity/v3/projects/0354450ac9004c409954bfe0fb9763db => generated 0 bytes in 488 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 20:02:28.798609 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a6ec613-e0ef-4174-b9b7-0a27e2c51dde admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57539b6a6f3b4d589f5f5e1d211cd6a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b454f707d20347ada3d82aa85495635e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82025) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 20:02:28.799309 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a6ec613-e0ef-4174-b9b7-0a27e2c51dde admin admin] REQUEST_METHOD: `DELETE` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:02:28.799599 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a6ec613-e0ef-4174-b9b7-0a27e2c51dde admin admin] SCRIPT_NAME: `/identity` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:02:28.799933 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a6ec613-e0ef-4174-b9b7-0a27e2c51dde admin admin] PATH_INFO: `/v3/projects/2b45b30a85ea4456a54e5239bbb3eb0a` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:02:28.801181 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a6ec613-e0ef-4174-b9b7-0a27e2c51dde admin admin] RBAC: Authorizing `identity:delete_project(project_id=2b45b30a85ea4456a54e5239bbb3eb0a)` {{(pid=82025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 20:02:28.804022 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a6ec613-e0ef-4174-b9b7-0a27e2c51dde admin admin] RBAC: Authorization granted {{(pid=82025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 20:02:28.829932 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG dbcounter [-] [82026] Writing DB stats keystone:SELECT=100 {{(pid=82026) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 20:02:28.942782 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.notifications [None req-8a6ec613-e0ef-4174-b9b7-0a27e2c51dde admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2b45b30a85ea4456a54e5239bbb3eb0a', 'request_id': 'req-8a6ec613-e0ef-4174-b9b7-0a27e2c51dde'} {{(pid=82025) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 20:02:28.950298 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.notifications [None req-8a6ec613-e0ef-4174-b9b7-0a27e2c51dde admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2b45b30a85ea4456a54e5239bbb3eb0a', 'request_id': 'req-8a6ec613-e0ef-4174-b9b7-0a27e2c51dde'} {{(pid=82025) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 20:02:28.957454 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.notifications [None req-8a6ec613-e0ef-4174-b9b7-0a27e2c51dde admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2b45b30a85ea4456a54e5239bbb3eb0a', 'request_id': 'req-8a6ec613-e0ef-4174-b9b7-0a27e2c51dde'} {{(pid=82025) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 20:02:29.042015 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.notifications [None req-8a6ec613-e0ef-4174-b9b7-0a27e2c51dde admin admin] The token cache is being invalidate because project 2b45b30a85ea4456a54e5239bbb3eb0a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82025) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 13 20:02:29.042245 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.notifications [None req-8a6ec613-e0ef-4174-b9b7-0a27e2c51dde admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82025) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 20:02:29.043006 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.notifications [None req-8a6ec613-e0ef-4174-b9b7-0a27e2c51dde admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82025) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 20:02:29.045626 dv-cinder-828806-6-smb devstack@keystone.service[82025]: [pid: 82025|app: 0|req: 1245/2432] 10.222.0.33 () {58 vars in 1233 bytes} [Tue Sep 13 20:02:28 2022] DELETE /identity/v3/projects/2b45b30a85ea4456a54e5239bbb3eb0a => generated 0 bytes in 472 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 20:02:29.050341 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1570e465-9ff2-4a42-bf14-22f785a8761e None None] REQUEST_METHOD: `POST` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:02:29.050845 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1570e465-9ff2-4a42-bf14-22f785a8761e None None] SCRIPT_NAME: `/identity` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:02:29.050959 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1570e465-9ff2-4a42-bf14-22f785a8761e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:02:29.069702 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG dbcounter [-] [82025] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=82025) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 20:02:29.076221 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.auth.core [None req-1570e465-9ff2-4a42-bf14-22f785a8761e None None] MFA Rules not processed for user `57539b6a6f3b4d589f5f5e1d211cd6a0`. Rule list: `[]` (Enabled: `True`). {{(pid=82026) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 20:02:29.077508 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.common.fernet_utils [None req-1570e465-9ff2-4a42-bf14-22f785a8761e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82026) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 20:02:29.139869 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG dbcounter [-] [82026] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82026) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 20:02:29.156669 dv-cinder-828806-6-smb devstack@keystone.service[82026]: [pid: 82026|app: 0|req: 1188/2433] 10.222.0.33 () {58 vars in 958 bytes} [Tue Sep 13 20:02:29 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 20:02:29.164675 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d78d5c3f-9909-49b3-8e23-5bf191feffce None None] REQUEST_METHOD: `POST` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:02:29.165074 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d78d5c3f-9909-49b3-8e23-5bf191feffce None None] SCRIPT_NAME: `/identity` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:02:29.165383 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d78d5c3f-9909-49b3-8e23-5bf191feffce None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:02:29.197062 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.auth.core [None req-d78d5c3f-9909-49b3-8e23-5bf191feffce None None] MFA Rules not processed for user `57539b6a6f3b4d589f5f5e1d211cd6a0`. Rule list: `[]` (Enabled: `True`). {{(pid=82025) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 20:02:29.198968 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.fernet_utils [None req-d78d5c3f-9909-49b3-8e23-5bf191feffce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82025) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 20:02:29.210351 dv-cinder-828806-6-smb devstack@keystone.service[82025]: [pid: 82025|app: 0|req: 1246/2434] 10.222.0.33 () {58 vars in 958 bytes} [Tue Sep 13 20:02:29 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 47 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 20:02:29.215678 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1570e465-9ff2-4a42-bf14-22f785a8761e None None] Authenticating user token {{(pid=82026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 20:02:29.231838 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1570e465-9ff2-4a42-bf14-22f785a8761e None None] Validating token access rules against request {{(pid=82026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 20:02:29.239228 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d08c355a-ee6c-478a-8997-d1494c1fb109 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57539b6a6f3b4d589f5f5e1d211cd6a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b454f707d20347ada3d82aa85495635e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 20:02:29.240143 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d08c355a-ee6c-478a-8997-d1494c1fb109 admin admin] REQUEST_METHOD: `GET` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:02:29.240612 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d08c355a-ee6c-478a-8997-d1494c1fb109 admin admin] SCRIPT_NAME: `/identity` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:02:29.241071 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d08c355a-ee6c-478a-8997-d1494c1fb109 admin admin] PATH_INFO: `/v3/domains` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:02:29.243890 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d08c355a-ee6c-478a-8997-d1494c1fb109 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82026) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 20:02:29.244427 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d08c355a-ee6c-478a-8997-d1494c1fb109 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 20:02:29.246342 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d08c355a-ee6c-478a-8997-d1494c1fb109 admin admin] RBAC: Authorization granted {{(pid=82026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 20:02:29.265646 dv-cinder-828806-6-smb devstack@keystone.service[82026]: [pid: 82026|app: 0|req: 1189/2435] 10.222.0.33 () {58 vars in 1153 bytes} [Tue Sep 13 20:02:29 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 13 20:02:29.266845 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d78d5c3f-9909-49b3-8e23-5bf191feffce None None] Authenticating user token {{(pid=82025) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 20:02:29.277211 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d78d5c3f-9909-49b3-8e23-5bf191feffce None None] Validating token access rules against request {{(pid=82025) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 20:02:29.287120 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92921bdb-188b-42d6-b42b-ca0cd9fce8c8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57539b6a6f3b4d589f5f5e1d211cd6a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b454f707d20347ada3d82aa85495635e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82025) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 20:02:29.287120 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92921bdb-188b-42d6-b42b-ca0cd9fce8c8 admin admin] REQUEST_METHOD: `POST` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:02:29.287120 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92921bdb-188b-42d6-b42b-ca0cd9fce8c8 admin admin] SCRIPT_NAME: `/identity` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:02:29.287120 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92921bdb-188b-42d6-b42b-ca0cd9fce8c8 admin admin] PATH_INFO: `/v3/projects` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:02:29.292351 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92921bdb-188b-42d6-b42b-ca0cd9fce8c8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 20:02:29.292351 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92921bdb-188b-42d6-b42b-ca0cd9fce8c8 admin admin] RBAC: Authorization granted {{(pid=82025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 20:02:29.391672 dv-cinder-828806-6-smb devstack@keystone.service[82025]: [pid: 82025|app: 0|req: 1247/2436] 10.222.0.33 () {60 vars in 1153 bytes} [Tue Sep 13 20:02:29 2022] POST /identity/v3/projects => generated 373 bytes in 125 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 13 20:02:29.395818 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d08c355a-ee6c-478a-8997-d1494c1fb109 admin admin] Authenticating user token {{(pid=82026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 20:02:29.406984 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d08c355a-ee6c-478a-8997-d1494c1fb109 admin admin] Validating token access rules against request {{(pid=82026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 20:02:29.473239 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f39db56b-96e7-45de-a698-79312b16e453 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57539b6a6f3b4d589f5f5e1d211cd6a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b454f707d20347ada3d82aa85495635e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 20:02:29.473898 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f39db56b-96e7-45de-a698-79312b16e453 admin admin] REQUEST_METHOD: `POST` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:02:29.474184 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f39db56b-96e7-45de-a698-79312b16e453 admin admin] SCRIPT_NAME: `/identity` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:02:29.474464 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f39db56b-96e7-45de-a698-79312b16e453 admin admin] PATH_INFO: `/v3/users` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:02:29.475276 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f39db56b-96e7-45de-a698-79312b16e453 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 20:02:29.477148 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f39db56b-96e7-45de-a698-79312b16e453 admin admin] RBAC: Authorization granted {{(pid=82026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 20:02:29.574429 dv-cinder-828806-6-smb devstack@keystone.service[82026]: [pid: 82026|app: 0|req: 1190/2437] 10.222.0.33 () {60 vars in 1144 bytes} [Tue Sep 13 20:02:29 2022] POST /identity/v3/users => generated 287 bytes in 179 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 13 20:02:29.578646 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92921bdb-188b-42d6-b42b-ca0cd9fce8c8 admin admin] Authenticating user token {{(pid=82025) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 20:02:29.593676 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92921bdb-188b-42d6-b42b-ca0cd9fce8c8 admin admin] Validating token access rules against request {{(pid=82025) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 20:02:29.605013 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4979364b-c8fa-4f2a-849d-58662d26913a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57539b6a6f3b4d589f5f5e1d211cd6a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b454f707d20347ada3d82aa85495635e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82025) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 20:02:29.605684 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4979364b-c8fa-4f2a-849d-58662d26913a admin admin] REQUEST_METHOD: `GET` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:02:29.605972 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4979364b-c8fa-4f2a-849d-58662d26913a admin admin] SCRIPT_NAME: `/identity` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:02:29.606309 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4979364b-c8fa-4f2a-849d-58662d26913a admin admin] PATH_INFO: `/v3/roles` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:02:29.606982 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4979364b-c8fa-4f2a-849d-58662d26913a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 20:02:29.608639 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4979364b-c8fa-4f2a-849d-58662d26913a admin admin] RBAC: Authorization granted {{(pid=82025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 20:02:29.623756 dv-cinder-828806-6-smb devstack@keystone.service[82025]: [pid: 82025|app: 0|req: 1248/2438] 10.222.0.33 () {58 vars in 1122 bytes} [Tue Sep 13 20:02:29 2022] GET /identity/v3/roles => generated 1420 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 13 20:02:29.627782 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f39db56b-96e7-45de-a698-79312b16e453 admin admin] Authenticating user token {{(pid=82026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 20:02:29.641731 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f39db56b-96e7-45de-a698-79312b16e453 admin admin] Validating token access rules against request {{(pid=82026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 20:02:29.653586 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cb126f6-515b-4638-92be-41e85fbdd2a5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57539b6a6f3b4d589f5f5e1d211cd6a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b454f707d20347ada3d82aa85495635e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 20:02:29.655722 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cb126f6-515b-4638-92be-41e85fbdd2a5 admin admin] REQUEST_METHOD: `GET` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:02:29.659072 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cb126f6-515b-4638-92be-41e85fbdd2a5 admin admin] SCRIPT_NAME: `/identity` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:02:29.659072 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cb126f6-515b-4638-92be-41e85fbdd2a5 admin admin] PATH_INFO: `/v3/roles` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:02:29.659072 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cb126f6-515b-4638-92be-41e85fbdd2a5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 20:02:29.680655 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cb126f6-515b-4638-92be-41e85fbdd2a5 admin admin] RBAC: Authorization granted {{(pid=82026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 20:02:29.693379 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG dbcounter [-] [82025] Writing DB stats keystone:DELETE=1,keystone:SELECT=98,keystone:INSERT=1 {{(pid=82025) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 20:02:29.698610 dv-cinder-828806-6-smb devstack@keystone.service[82026]: [pid: 82026|app: 0|req: 1191/2439] 10.222.0.33 () {58 vars in 1122 bytes} [Tue Sep 13 20:02:29 2022] GET /identity/v3/roles => generated 1420 bytes in 68 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 13 20:02:29.700298 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4979364b-c8fa-4f2a-849d-58662d26913a admin admin] Authenticating user token {{(pid=82025) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 20:02:29.712847 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4979364b-c8fa-4f2a-849d-58662d26913a admin admin] Validating token access rules against request {{(pid=82025) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 20:02:29.716901 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG dbcounter [-] [82026] Writing DB stats keystone:SELECT=90,keystone:INSERT=4,keystone:DELETE=6 {{(pid=82026) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 20:02:29.719850 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2fb04d5-9782-4e7d-a08b-5b4477cb10d1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57539b6a6f3b4d589f5f5e1d211cd6a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b454f707d20347ada3d82aa85495635e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82025) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 20:02:29.720994 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2fb04d5-9782-4e7d-a08b-5b4477cb10d1 admin admin] REQUEST_METHOD: `PUT` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:02:29.720994 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2fb04d5-9782-4e7d-a08b-5b4477cb10d1 admin admin] SCRIPT_NAME: `/identity` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:02:29.721255 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2fb04d5-9782-4e7d-a08b-5b4477cb10d1 admin admin] PATH_INFO: `/v3/projects/5cf7ba62614c4b3eac9090cfc0850a43/users/81d86689d020477ca14bf81ba89972a0/roles/3618ab638a65401f82333da7596d1daf` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:02:29.740740 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2fb04d5-9782-4e7d-a08b-5b4477cb10d1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5cf7ba62614c4b3eac9090cfc0850a43, user_id=81d86689d020477ca14bf81ba89972a0, role_id=3618ab638a65401f82333da7596d1daf)` {{(pid=82025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 20:02:29.744511 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2fb04d5-9782-4e7d-a08b-5b4477cb10d1 admin admin] RBAC: Authorization granted {{(pid=82025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 20:02:29.836705 dv-cinder-828806-6-smb devstack@keystone.service[82025]: [pid: 82025|app: 0|req: 1249/2440] 10.222.0.33 () {60 vars in 1483 bytes} [Tue Sep 13 20:02:29 2022] PUT /identity/v3/projects/5cf7ba62614c4b3eac9090cfc0850a43/users/81d86689d020477ca14bf81ba89972a0/roles/3618ab638a65401f82333da7596d1daf => generated 0 bytes in 137 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 20:02:29.855059 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ee4550b-bbc1-43f5-b9c7-605737889ab7 None None] REQUEST_METHOD: `POST` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:02:29.855979 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ee4550b-bbc1-43f5-b9c7-605737889ab7 None None] SCRIPT_NAME: `/identity` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:02:29.857475 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ee4550b-bbc1-43f5-b9c7-605737889ab7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:02:29.904286 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.auth.core [None req-6ee4550b-bbc1-43f5-b9c7-605737889ab7 None None] MFA Rules not processed for user `81d86689d020477ca14bf81ba89972a0`. Rule list: `[]` (Enabled: `True`). {{(pid=82026) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 20:02:29.905444 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.common.fernet_utils [None req-6ee4550b-bbc1-43f5-b9c7-605737889ab7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82026) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 20:02:30.010225 dv-cinder-828806-6-smb devstack@keystone.service[82026]: [pid: 82026|app: 0|req: 1192/2441] 10.222.0.33 () {58 vars in 958 bytes} [Tue Sep 13 20:02:29 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 159 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 20:02:30.018198 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2fb04d5-9782-4e7d-a08b-5b4477cb10d1 admin admin] Authenticating user token {{(pid=82025) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 20:02:30.020137 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.fernet_utils [None req-c2fb04d5-9782-4e7d-a08b-5b4477cb10d1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82025) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 20:02:30.059169 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG dbcounter [-] [82025] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=82025) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 20:02:30.087500 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG dbcounter [-] [82026] Writing DB stats keystone:DELETE=4,keystone:SELECT=95,keystone:INSERT=1 {{(pid=82026) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 20:02:30.125964 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2fb04d5-9782-4e7d-a08b-5b4477cb10d1 admin admin] Validating token access rules against request {{(pid=82025) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 20:02:30.131403 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fd79020-f2f8-41ba-8a14-6c6da8f192b4 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46024fc6167f4321818b1bed27a521a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8c6fba0f15b4d6a84ff601919b7b8e4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82025) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 20:02:30.132353 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fd79020-f2f8-41ba-8a14-6c6da8f192b4 service cinder] REQUEST_METHOD: `GET` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:02:30.133279 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fd79020-f2f8-41ba-8a14-6c6da8f192b4 service cinder] SCRIPT_NAME: `/identity` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:02:30.133767 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fd79020-f2f8-41ba-8a14-6c6da8f192b4 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:02:30.147002 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fd79020-f2f8-41ba-8a14-6c6da8f192b4 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=82025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 20:02:30.149224 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fd79020-f2f8-41ba-8a14-6c6da8f192b4 service cinder] RBAC: Authorization granted {{(pid=82025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 20:02:30.163351 dv-cinder-828806-6-smb devstack@keystone.service[82025]: [pid: 82025|app: 0|req: 1250/2442] 10.222.0.33 () {60 vars in 1365 bytes} [Tue Sep 13 20:02:30 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 146 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 20:02:30.281767 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG dbcounter [-] [82025] Writing DB stats keystone:SELECT=89,keystone:DELETE=7,keystone:INSERT=4 {{(pid=82025) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 20:02:30.298673 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG dbcounter [-] [82026] Writing DB stats keystone:SELECT=83,keystone:DELETE=15,keystone:INSERT=2 {{(pid=82026) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 20:02:30.469933 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG dbcounter [-] [82025] Writing DB stats keystone:INSERT=2,keystone:SELECT=98 {{(pid=82025) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 20:02:30.738599 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG dbcounter [-] [82026] Writing DB stats keystone:SELECT=97,keystone:DELETE=2,keystone:INSERT=1 {{(pid=82026) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 20:02:31.549430 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG dbcounter [-] [82025] Writing DB stats keystone:SELECT=100 {{(pid=82025) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 20:02:32.110694 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG dbcounter [-] [82025] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82025) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 20:02:32.275749 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG dbcounter [-] [82026] Writing DB stats keystone:SELECT=78,keystone:INSERT=5,keystone:DELETE=17 {{(pid=82026) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 20:02:32.540178 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG dbcounter [-] [82025] Writing DB stats keystone:INSERT=5,keystone:SELECT=90,keystone:DELETE=5 {{(pid=82025) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 20:02:32.762373 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG dbcounter [-] [82026] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82026) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 20:02:32.984641 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG dbcounter [-] [82025] Writing DB stats keystone:DELETE=12,keystone:SELECT=86,keystone:INSERT=2 {{(pid=82025) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 20:02:33.190329 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG dbcounter [-] [82026] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=82026) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 20:02:33.290841 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG dbcounter [-] [82025] Writing DB stats keystone:SELECT=79,keystone:DELETE=19,keystone:INSERT=2 {{(pid=82025) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 20:02:33.384293 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG dbcounter [-] [82026] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=82026) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 20:02:33.609680 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG dbcounter [-] [82025] Writing DB stats keystone:DELETE=1,keystone:SELECT=96,keystone:INSERT=3 {{(pid=82025) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 20:02:33.681495 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG dbcounter [-] [82026] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82026) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 20:02:33.796351 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG dbcounter [-] [82025] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82025) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 20:02:33.853835 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG dbcounter [-] [82026] Writing DB stats keystone:SELECT=100 {{(pid=82026) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 20:02:33.911639 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG dbcounter [-] [82026] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=82026) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 20:02:33.913314 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95207f8a-ea36-4e80-bbeb-450dd28ee38e None None] REQUEST_METHOD: `POST` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:02:33.913618 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95207f8a-ea36-4e80-bbeb-450dd28ee38e None None] SCRIPT_NAME: `/identity` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:02:33.913902 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95207f8a-ea36-4e80-bbeb-450dd28ee38e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:02:33.937562 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.auth.core [None req-95207f8a-ea36-4e80-bbeb-450dd28ee38e None None] MFA Rules not processed for user `81d86689d020477ca14bf81ba89972a0`. Rule list: `[]` (Enabled: `True`). {{(pid=82026) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 20:02:33.939742 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.common.fernet_utils [None req-95207f8a-ea36-4e80-bbeb-450dd28ee38e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82026) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 20:02:33.952252 dv-cinder-828806-6-smb devstack@keystone.service[82026]: [pid: 82026|app: 0|req: 1193/2443] 10.222.0.33 () {58 vars in 958 bytes} [Tue Sep 13 20:02:33 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 20:02:34.037910 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG dbcounter [-] [82025] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82025) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 20:02:34.193055 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG dbcounter [-] [82026] Writing DB stats keystone:SELECT=83,keystone:DELETE=14,keystone:INSERT=3 {{(pid=82026) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 20:02:34.252600 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG dbcounter [-] [82025] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=82025) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 20:02:34.337034 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG dbcounter [-] [82026] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82026) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 20:02:34.464017 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG dbcounter [-] [82026] Writing DB stats keystone:SELECT=100 {{(pid=82026) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 20:02:34.498728 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG dbcounter [-] [82026] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=82026) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 20:02:40.872050 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e7913c0-eb25-43d8-b51c-093ce0cf23e9 None None] REQUEST_METHOD: `POST` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:02:40.872767 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e7913c0-eb25-43d8-b51c-093ce0cf23e9 None None] SCRIPT_NAME: `/identity` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:02:40.872767 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e7913c0-eb25-43d8-b51c-093ce0cf23e9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:02:40.893694 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.auth.core [None req-1e7913c0-eb25-43d8-b51c-093ce0cf23e9 None None] MFA Rules not processed for user `0afb3d4de8cc4a518f4e63f5d28e50ef`. Rule list: `[]` (Enabled: `True`). {{(pid=82025) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 20:02:40.894993 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.fernet_utils [None req-1e7913c0-eb25-43d8-b51c-093ce0cf23e9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82025) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 20:02:40.952627 dv-cinder-828806-6-smb devstack@keystone.service[82025]: [pid: 82025|app: 0|req: 1251/2444] 10.222.0.33 () {58 vars in 958 bytes} [Tue Sep 13 20:02:40 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 20:02:44.636075 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG dbcounter [-] [82026] Writing DB stats keystone:SELECT=57,keystone:INSERT=3 {{(pid=82026) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 20:02:45.190236 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a027aea2-3a7a-4573-abae-d3ca5a146050 None None] REQUEST_METHOD: `POST` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:02:45.190757 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a027aea2-3a7a-4573-abae-d3ca5a146050 None None] SCRIPT_NAME: `/identity` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:02:45.192466 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a027aea2-3a7a-4573-abae-d3ca5a146050 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:02:45.214808 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.auth.core [None req-a027aea2-3a7a-4573-abae-d3ca5a146050 None None] MFA Rules not processed for user `a28e738b894442e2bc9880eeb64fc0c8`. Rule list: `[]` (Enabled: `True`). {{(pid=82026) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 20:02:45.216290 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.common.fernet_utils [None req-a027aea2-3a7a-4573-abae-d3ca5a146050 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82026) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 20:02:45.274746 dv-cinder-828806-6-smb devstack@keystone.service[82026]: [pid: 82026|app: 0|req: 1194/2445] 10.222.0.33 () {58 vars in 1009 bytes} [Tue Sep 13 20:02:45 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 20:02:45.288320 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e7913c0-eb25-43d8-b51c-093ce0cf23e9 None None] Authenticating user token {{(pid=82025) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 20:02:45.289808 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.fernet_utils [None req-1e7913c0-eb25-43d8-b51c-093ce0cf23e9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82025) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 20:02:45.379422 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e7913c0-eb25-43d8-b51c-093ce0cf23e9 None None] Validating token access rules against request {{(pid=82025) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 20:02:45.384545 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d99efd08-5fb7-429a-a3c0-f12ae317ab82 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa5a83574f7f424c805e130c462d5969', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8c6fba0f15b4d6a84ff601919b7b8e4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82025) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 20:02:45.385171 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d99efd08-5fb7-429a-a3c0-f12ae317ab82 service swift] REQUEST_METHOD: `GET` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:02:45.385462 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d99efd08-5fb7-429a-a3c0-f12ae317ab82 service swift] SCRIPT_NAME: `/identity` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:02:45.385741 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d99efd08-5fb7-429a-a3c0-f12ae317ab82 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:02:45.395371 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d99efd08-5fb7-429a-a3c0-f12ae317ab82 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=82025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 20:02:45.397142 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d99efd08-5fb7-429a-a3c0-f12ae317ab82 service swift] RBAC: Authorization granted {{(pid=82025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 20:02:45.406346 dv-cinder-828806-6-smb devstack@keystone.service[82025]: [pid: 82025|app: 0|req: 1252/2446] 10.222.0.33 () {60 vars in 1384 bytes} [Tue Sep 13 20:02:45 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 119 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Sep 13 20:02:55.267752 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG dbcounter [-] [82026] Writing DB stats keystone:SELECT=25 {{(pid=82026) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 20:02:55.402240 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG dbcounter [-] [82025] Writing DB stats keystone:SELECT=68 {{(pid=82025) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 20:03:03.854792 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ded3c883-53dd-471a-a45d-cca040cc81f8 None None] REQUEST_METHOD: `POST` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:03:03.855307 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ded3c883-53dd-471a-a45d-cca040cc81f8 None None] SCRIPT_NAME: `/identity` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:03:03.855409 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ded3c883-53dd-471a-a45d-cca040cc81f8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:03:03.875723 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.auth.core [None req-ded3c883-53dd-471a-a45d-cca040cc81f8 None None] MFA Rules not processed for user `a28e738b894442e2bc9880eeb64fc0c8`. Rule list: `[]` (Enabled: `True`). {{(pid=82026) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 20:03:03.877033 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.common.fernet_utils [None req-ded3c883-53dd-471a-a45d-cca040cc81f8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82026) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 20:03:03.885272 dv-cinder-828806-6-smb devstack@keystone.service[82026]: [pid: 82026|app: 0|req: 1195/2447] 10.222.0.33 () {58 vars in 1009 bytes} [Tue Sep 13 20:03:03 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 20:03:03.897385 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d99efd08-5fb7-429a-a3c0-f12ae317ab82 service swift] Authenticating user token {{(pid=82025) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 20:03:03.909749 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d99efd08-5fb7-429a-a3c0-f12ae317ab82 service swift] Validating token access rules against request {{(pid=82025) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 20:03:03.915075 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37c2e333-a051-4bce-8bd8-61153ecef48c service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa5a83574f7f424c805e130c462d5969', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8c6fba0f15b4d6a84ff601919b7b8e4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82025) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 20:03:03.915689 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37c2e333-a051-4bce-8bd8-61153ecef48c service swift] REQUEST_METHOD: `GET` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:03:03.915978 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37c2e333-a051-4bce-8bd8-61153ecef48c service swift] SCRIPT_NAME: `/identity` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:03:03.916258 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37c2e333-a051-4bce-8bd8-61153ecef48c service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:03:03.925562 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37c2e333-a051-4bce-8bd8-61153ecef48c service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=82025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 20:03:03.927279 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37c2e333-a051-4bce-8bd8-61153ecef48c service swift] RBAC: Authorization granted {{(pid=82025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 20:03:03.936117 dv-cinder-828806-6-smb devstack@keystone.service[82025]: [pid: 82025|app: 0|req: 1253/2448] 10.222.0.33 () {60 vars in 1384 bytes} [Tue Sep 13 20:03:03 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Sep 13 20:03:04.785813 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-068c4a5a-83a4-4dcb-bfa1-7b0dc1b032a8 None None] REQUEST_METHOD: `POST` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:03:04.786170 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-068c4a5a-83a4-4dcb-bfa1-7b0dc1b032a8 None None] SCRIPT_NAME: `/identity` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:03:04.787601 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-068c4a5a-83a4-4dcb-bfa1-7b0dc1b032a8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:03:04.807822 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.auth.core [None req-068c4a5a-83a4-4dcb-bfa1-7b0dc1b032a8 None None] MFA Rules not processed for user `a28e738b894442e2bc9880eeb64fc0c8`. Rule list: `[]` (Enabled: `True`). {{(pid=82026) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 20:03:04.809048 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.common.fernet_utils [None req-068c4a5a-83a4-4dcb-bfa1-7b0dc1b032a8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82026) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 20:03:04.816850 dv-cinder-828806-6-smb devstack@keystone.service[82026]: [pid: 82026|app: 0|req: 1196/2449] 10.222.0.33 () {58 vars in 967 bytes} [Tue Sep 13 20:03:04 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 20:03:04.830127 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37c2e333-a051-4bce-8bd8-61153ecef48c service swift] Authenticating user token {{(pid=82025) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 20:03:04.847623 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37c2e333-a051-4bce-8bd8-61153ecef48c service swift] Validating token access rules against request {{(pid=82025) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 20:03:04.852726 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-262054ec-8938-4235-bd44-e3321a70cb4d service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa5a83574f7f424c805e130c462d5969', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8c6fba0f15b4d6a84ff601919b7b8e4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82025) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 20:03:04.853300 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-262054ec-8938-4235-bd44-e3321a70cb4d service swift] REQUEST_METHOD: `GET` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:03:04.853581 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-262054ec-8938-4235-bd44-e3321a70cb4d service swift] SCRIPT_NAME: `/identity` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:03:04.853856 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-262054ec-8938-4235-bd44-e3321a70cb4d service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:03:04.862742 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-262054ec-8938-4235-bd44-e3321a70cb4d service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=82025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 20:03:04.864479 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-262054ec-8938-4235-bd44-e3321a70cb4d service swift] RBAC: Authorization granted {{(pid=82025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 20:03:04.872513 dv-cinder-828806-6-smb devstack@keystone.service[82025]: [pid: 82025|app: 0|req: 1254/2450] 10.222.0.33 () {60 vars in 1384 bytes} [Tue Sep 13 20:03:04 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Sep 13 20:03:05.658706 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfcc47dd-0d5a-41bc-8c2f-ebdbbc08ec52 None None] REQUEST_METHOD: `POST` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:03:05.659213 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfcc47dd-0d5a-41bc-8c2f-ebdbbc08ec52 None None] SCRIPT_NAME: `/identity` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:03:05.659329 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfcc47dd-0d5a-41bc-8c2f-ebdbbc08ec52 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:03:05.678869 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.auth.core [None req-cfcc47dd-0d5a-41bc-8c2f-ebdbbc08ec52 None None] MFA Rules not processed for user `a28e738b894442e2bc9880eeb64fc0c8`. Rule list: `[]` (Enabled: `True`). {{(pid=82026) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 20:03:05.680016 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.common.fernet_utils [None req-cfcc47dd-0d5a-41bc-8c2f-ebdbbc08ec52 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82026) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 20:03:05.687220 dv-cinder-828806-6-smb devstack@keystone.service[82026]: [pid: 82026|app: 0|req: 1197/2451] 10.222.0.33 () {58 vars in 1009 bytes} [Tue Sep 13 20:03:05 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 20:03:05.699391 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-262054ec-8938-4235-bd44-e3321a70cb4d service swift] Authenticating user token {{(pid=82025) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 20:03:05.710637 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-262054ec-8938-4235-bd44-e3321a70cb4d service swift] Validating token access rules against request {{(pid=82025) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 20:03:05.715965 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4642ba2-287c-4dc7-8a2c-8c243997266a service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa5a83574f7f424c805e130c462d5969', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8c6fba0f15b4d6a84ff601919b7b8e4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82025) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 20:03:05.716565 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4642ba2-287c-4dc7-8a2c-8c243997266a service swift] REQUEST_METHOD: `GET` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:03:05.716877 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4642ba2-287c-4dc7-8a2c-8c243997266a service swift] SCRIPT_NAME: `/identity` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:03:05.717822 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4642ba2-287c-4dc7-8a2c-8c243997266a service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:03:05.725822 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4642ba2-287c-4dc7-8a2c-8c243997266a service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=82025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 20:03:05.727475 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4642ba2-287c-4dc7-8a2c-8c243997266a service swift] RBAC: Authorization granted {{(pid=82025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 20:03:05.735755 dv-cinder-828806-6-smb devstack@keystone.service[82025]: [pid: 82025|app: 0|req: 1255/2452] 10.222.0.33 () {60 vars in 1384 bytes} [Tue Sep 13 20:03:05 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Sep 13 20:03:06.503061 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0727ffdb-24ba-48be-8d37-6d22bd7d6b3d None None] REQUEST_METHOD: `POST` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:03:06.503419 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0727ffdb-24ba-48be-8d37-6d22bd7d6b3d None None] SCRIPT_NAME: `/identity` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:03:06.503696 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0727ffdb-24ba-48be-8d37-6d22bd7d6b3d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:03:06.527368 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.auth.core [None req-0727ffdb-24ba-48be-8d37-6d22bd7d6b3d None None] MFA Rules not processed for user `a28e738b894442e2bc9880eeb64fc0c8`. Rule list: `[]` (Enabled: `True`). {{(pid=82026) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 20:03:06.528611 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.common.fernet_utils [None req-0727ffdb-24ba-48be-8d37-6d22bd7d6b3d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82026) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 20:03:06.537274 dv-cinder-828806-6-smb devstack@keystone.service[82026]: [pid: 82026|app: 0|req: 1198/2453] 10.222.0.33 () {58 vars in 967 bytes} [Tue Sep 13 20:03:06 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 20:03:06.549937 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4642ba2-287c-4dc7-8a2c-8c243997266a service swift] Authenticating user token {{(pid=82025) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 20:03:06.560370 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4642ba2-287c-4dc7-8a2c-8c243997266a service swift] Validating token access rules against request {{(pid=82025) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 20:03:06.565951 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3c19191-bea4-47df-bdaa-62a0bc7c8601 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa5a83574f7f424c805e130c462d5969', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8c6fba0f15b4d6a84ff601919b7b8e4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82025) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 20:03:06.566610 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3c19191-bea4-47df-bdaa-62a0bc7c8601 service swift] REQUEST_METHOD: `GET` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:03:06.566921 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3c19191-bea4-47df-bdaa-62a0bc7c8601 service swift] SCRIPT_NAME: `/identity` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:03:06.567238 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3c19191-bea4-47df-bdaa-62a0bc7c8601 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:03:06.576031 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3c19191-bea4-47df-bdaa-62a0bc7c8601 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=82025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 20:03:06.578651 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3c19191-bea4-47df-bdaa-62a0bc7c8601 service swift] RBAC: Authorization granted {{(pid=82025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 20:03:06.586955 dv-cinder-828806-6-smb devstack@keystone.service[82025]: [pid: 82025|app: 0|req: 1256/2454] 10.222.0.33 () {60 vars in 1384 bytes} [Tue Sep 13 20:03:06 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Sep 13 20:03:09.595066 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0727ffdb-24ba-48be-8d37-6d22bd7d6b3d None None] Authenticating user token {{(pid=82026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 20:03:09.670847 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0727ffdb-24ba-48be-8d37-6d22bd7d6b3d None None] Validating token access rules against request {{(pid=82026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 20:03:09.675668 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa042825-d4c1-4aa9-9d2a-ab3c2d9cdd0d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57539b6a6f3b4d589f5f5e1d211cd6a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b454f707d20347ada3d82aa85495635e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 20:03:09.676314 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa042825-d4c1-4aa9-9d2a-ab3c2d9cdd0d admin admin] REQUEST_METHOD: `DELETE` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:03:09.676730 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa042825-d4c1-4aa9-9d2a-ab3c2d9cdd0d admin admin] SCRIPT_NAME: `/identity` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:03:09.677028 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa042825-d4c1-4aa9-9d2a-ab3c2d9cdd0d admin admin] PATH_INFO: `/v3/users/81d86689d020477ca14bf81ba89972a0` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:03:09.678189 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa042825-d4c1-4aa9-9d2a-ab3c2d9cdd0d admin admin] RBAC: Authorizing `identity:delete_user(user_id=81d86689d020477ca14bf81ba89972a0)` {{(pid=82026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 20:03:09.680176 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa042825-d4c1-4aa9-9d2a-ab3c2d9cdd0d admin admin] RBAC: Authorization granted {{(pid=82026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 20:03:09.978987 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3c19191-bea4-47df-bdaa-62a0bc7c8601 service swift] Authenticating user token {{(pid=82025) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 20:03:09.981966 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.fernet_utils [None req-d3c19191-bea4-47df-bdaa-62a0bc7c8601 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82025) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 20:03:09.982737 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.notifications [None req-aa042825-d4c1-4aa9-9d2a-ab3c2d9cdd0d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '81d86689d020477ca14bf81ba89972a0'} {{(pid=82026) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 20:03:10.054211 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3c19191-bea4-47df-bdaa-62a0bc7c8601 service swift] Validating token access rules against request {{(pid=82025) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 20:03:10.059502 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7268f91-2b45-4cab-b03b-130b03da6623 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '023a2c79c2444611b3d431928e56685d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8c6fba0f15b4d6a84ff601919b7b8e4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82025) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 20:03:10.060241 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7268f91-2b45-4cab-b03b-130b03da6623 service neutron] REQUEST_METHOD: `GET` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:03:10.060592 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7268f91-2b45-4cab-b03b-130b03da6623 service neutron] SCRIPT_NAME: `/identity` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:03:10.061496 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7268f91-2b45-4cab-b03b-130b03da6623 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:03:10.064840 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.notifications [None req-aa042825-d4c1-4aa9-9d2a-ab3c2d9cdd0d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '81d86689d020477ca14bf81ba89972a0'} {{(pid=82026) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 20:03:10.079098 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.fernet_utils [None req-a7268f91-2b45-4cab-b03b-130b03da6623 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82025) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 20:03:10.088943 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.notifications [None req-aa042825-d4c1-4aa9-9d2a-ab3c2d9cdd0d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '81d86689d020477ca14bf81ba89972a0'} {{(pid=82026) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 20:03:10.090136 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.notifications [None req-aa042825-d4c1-4aa9-9d2a-ab3c2d9cdd0d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '81d86689d020477ca14bf81ba89972a0'} {{(pid=82026) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 20:03:10.099756 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.notifications [None req-aa042825-d4c1-4aa9-9d2a-ab3c2d9cdd0d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '81d86689d020477ca14bf81ba89972a0'} {{(pid=82026) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 20:03:10.107549 dv-cinder-828806-6-smb devstack@keystone.service[82026]: [pid: 82026|app: 0|req: 1199/2455] 10.222.0.33 () {58 vars in 1224 bytes} [Tue Sep 13 20:03:09 2022] DELETE /identity/v3/users/81d86689d020477ca14bf81ba89972a0 => generated 0 bytes in 513 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 20:03:10.113426 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd817427-c772-491b-b8dd-7b8af1adb44c None None] REQUEST_METHOD: `POST` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:03:10.113720 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd817427-c772-491b-b8dd-7b8af1adb44c None None] SCRIPT_NAME: `/identity` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:03:10.114049 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd817427-c772-491b-b8dd-7b8af1adb44c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:03:10.135293 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.auth.core [None req-dd817427-c772-491b-b8dd-7b8af1adb44c None None] MFA Rules not processed for user `57539b6a6f3b4d589f5f5e1d211cd6a0`. Rule list: `[]` (Enabled: `True`). {{(pid=82026) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 20:03:10.136515 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.common.fernet_utils [None req-dd817427-c772-491b-b8dd-7b8af1adb44c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82026) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 20:03:10.177612 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7268f91-2b45-4cab-b03b-130b03da6623 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 20:03:10.177612 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7268f91-2b45-4cab-b03b-130b03da6623 service neutron] RBAC: Authorization granted {{(pid=82025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 20:03:10.188025 dv-cinder-828806-6-smb devstack@keystone.service[82025]: [pid: 82025|app: 0|req: 1257/2456] 10.222.0.33 () {60 vars in 1365 bytes} [Tue Sep 13 20:03:09 2022] GET /identity/v3/auth/tokens => generated 3329 bytes in 210 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 20:03:10.204292 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG dbcounter [-] [82026] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82026) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 20:03:10.218547 dv-cinder-828806-6-smb devstack@keystone.service[82026]: [pid: 82026|app: 0|req: 1200/2457] 10.222.0.33 () {58 vars in 958 bytes} [Tue Sep 13 20:03:10 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 20:03:10.229819 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7268f91-2b45-4cab-b03b-130b03da6623 service neutron] Authenticating user token {{(pid=82025) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 20:03:10.231517 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.fernet_utils [None req-a7268f91-2b45-4cab-b03b-130b03da6623 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82025) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 20:03:10.244711 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7268f91-2b45-4cab-b03b-130b03da6623 service neutron] Validating token access rules against request {{(pid=82025) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 20:03:10.302334 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cdd962b-4dda-4a0b-8dd6-54c01ddab326 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '023a2c79c2444611b3d431928e56685d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8c6fba0f15b4d6a84ff601919b7b8e4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82025) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 20:03:10.302978 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cdd962b-4dda-4a0b-8dd6-54c01ddab326 service neutron] REQUEST_METHOD: `GET` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:03:10.309197 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cdd962b-4dda-4a0b-8dd6-54c01ddab326 service neutron] SCRIPT_NAME: `/identity` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:03:10.309197 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cdd962b-4dda-4a0b-8dd6-54c01ddab326 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:03:10.315179 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cdd962b-4dda-4a0b-8dd6-54c01ddab326 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 20:03:10.316643 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cdd962b-4dda-4a0b-8dd6-54c01ddab326 service neutron] RBAC: Authorization granted {{(pid=82025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 20:03:10.321996 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG dbcounter [-] [82025] Writing DB stats keystone:SELECT=100 {{(pid=82025) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 20:03:10.328511 dv-cinder-828806-6-smb devstack@keystone.service[82025]: [pid: 82025|app: 0|req: 1258/2458] 10.222.0.33 () {60 vars in 1365 bytes} [Tue Sep 13 20:03:10 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 99 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 20:03:10.649648 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd817427-c772-491b-b8dd-7b8af1adb44c None None] Authenticating user token {{(pid=82026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 20:03:10.651335 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.common.fernet_utils [None req-dd817427-c772-491b-b8dd-7b8af1adb44c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82026) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 20:03:10.667966 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd817427-c772-491b-b8dd-7b8af1adb44c None None] Validating token access rules against request {{(pid=82026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 20:03:10.674341 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d08e9d47-de26-45c3-8f34-66715eef4649 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57539b6a6f3b4d589f5f5e1d211cd6a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b454f707d20347ada3d82aa85495635e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 20:03:10.675540 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d08e9d47-de26-45c3-8f34-66715eef4649 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:03:10.675845 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d08e9d47-de26-45c3-8f34-66715eef4649 admin admin] SCRIPT_NAME: `/identity` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:03:10.676349 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d08e9d47-de26-45c3-8f34-66715eef4649 admin admin] PATH_INFO: `/v3/projects/5cf7ba62614c4b3eac9090cfc0850a43` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:03:10.677738 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d08e9d47-de26-45c3-8f34-66715eef4649 admin admin] RBAC: Authorizing `identity:delete_project(project_id=5cf7ba62614c4b3eac9090cfc0850a43)` {{(pid=82026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 20:03:10.679872 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d08e9d47-de26-45c3-8f34-66715eef4649 admin admin] RBAC: Authorization granted {{(pid=82026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 20:03:10.869498 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.notifications [None req-d08e9d47-de26-45c3-8f34-66715eef4649 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5cf7ba62614c4b3eac9090cfc0850a43', 'request_id': 'req-d08e9d47-de26-45c3-8f34-66715eef4649'} {{(pid=82026) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 20:03:10.974310 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.notifications [None req-d08e9d47-de26-45c3-8f34-66715eef4649 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5cf7ba62614c4b3eac9090cfc0850a43', 'request_id': 'req-d08e9d47-de26-45c3-8f34-66715eef4649'} {{(pid=82026) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 20:03:10.980931 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.notifications [None req-d08e9d47-de26-45c3-8f34-66715eef4649 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5cf7ba62614c4b3eac9090cfc0850a43', 'request_id': 'req-d08e9d47-de26-45c3-8f34-66715eef4649'} {{(pid=82026) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 20:03:10.993644 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.notifications [None req-d08e9d47-de26-45c3-8f34-66715eef4649 admin admin] The token cache is being invalidate because project 5cf7ba62614c4b3eac9090cfc0850a43 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82026) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 13 20:03:10.993955 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.notifications [None req-d08e9d47-de26-45c3-8f34-66715eef4649 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82026) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 20:03:10.994649 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.notifications [None req-d08e9d47-de26-45c3-8f34-66715eef4649 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82026) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 20:03:10.996216 dv-cinder-828806-6-smb devstack@keystone.service[82026]: [pid: 82026|app: 0|req: 1201/2459] 10.222.0.33 () {58 vars in 1233 bytes} [Tue Sep 13 20:03:10 2022] DELETE /identity/v3/projects/5cf7ba62614c4b3eac9090cfc0850a43 => generated 0 bytes in 347 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 20:03:13.662586 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bbe4d15-ccc5-4bf5-b551-97bd17618dda None None] REQUEST_METHOD: `POST` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:03:13.663065 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bbe4d15-ccc5-4bf5-b551-97bd17618dda None None] SCRIPT_NAME: `/identity` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:03:13.663160 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bbe4d15-ccc5-4bf5-b551-97bd17618dda None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:03:13.688507 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.auth.core [None req-8bbe4d15-ccc5-4bf5-b551-97bd17618dda None None] MFA Rules not processed for user `a28e738b894442e2bc9880eeb64fc0c8`. Rule list: `[]` (Enabled: `True`). {{(pid=82025) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 20:03:13.690168 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.fernet_utils [None req-8bbe4d15-ccc5-4bf5-b551-97bd17618dda None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82025) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 20:03:13.768517 dv-cinder-828806-6-smb devstack@keystone.service[82025]: [pid: 82025|app: 0|req: 1259/2460] 10.222.0.33 () {58 vars in 1009 bytes} [Tue Sep 13 20:03:13 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 20:03:13.782210 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d08e9d47-de26-45c3-8f34-66715eef4649 admin admin] Authenticating user token {{(pid=82026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 20:03:13.783927 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.common.fernet_utils [None req-d08e9d47-de26-45c3-8f34-66715eef4649 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82026) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 20:03:13.865632 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d08e9d47-de26-45c3-8f34-66715eef4649 admin admin] Validating token access rules against request {{(pid=82026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 20:03:13.872364 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57be91ba-8f94-40de-a8c6-51abf2a0cbfd service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa5a83574f7f424c805e130c462d5969', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8c6fba0f15b4d6a84ff601919b7b8e4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 20:03:13.873561 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57be91ba-8f94-40de-a8c6-51abf2a0cbfd service swift] REQUEST_METHOD: `GET` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:03:13.873949 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57be91ba-8f94-40de-a8c6-51abf2a0cbfd service swift] SCRIPT_NAME: `/identity` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:03:13.874329 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57be91ba-8f94-40de-a8c6-51abf2a0cbfd service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:03:13.884432 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57be91ba-8f94-40de-a8c6-51abf2a0cbfd service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=82026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 20:03:13.886198 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57be91ba-8f94-40de-a8c6-51abf2a0cbfd service swift] RBAC: Authorization granted {{(pid=82026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 20:03:13.899025 dv-cinder-828806-6-smb devstack@keystone.service[82026]: [pid: 82026|app: 0|req: 1202/2461] 10.222.0.33 () {60 vars in 1384 bytes} [Tue Sep 13 20:03:13 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 117 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Sep 13 20:03:23.761684 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG dbcounter [-] [82025] Writing DB stats keystone:SELECT=25 {{(pid=82025) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 20:03:23.893723 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG dbcounter [-] [82026] Writing DB stats keystone:SELECT=62,keystone:DELETE=7,keystone:INSERT=1 {{(pid=82026) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 20:03:29.789546 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bbe4d15-ccc5-4bf5-b551-97bd17618dda None None] Authenticating user token {{(pid=82025) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 20:03:29.791914 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.fernet_utils [None req-8bbe4d15-ccc5-4bf5-b551-97bd17618dda None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82025) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 20:03:29.883720 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bbe4d15-ccc5-4bf5-b551-97bd17618dda None None] Validating token access rules against request {{(pid=82025) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 20:03:29.889364 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78bc6b23-30ef-42d6-9be2-b141f0c2bfaa service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '060ea3dea2134429967c164bd158b272', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8c6fba0f15b4d6a84ff601919b7b8e4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82025) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 20:03:29.889981 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78bc6b23-30ef-42d6-9be2-b141f0c2bfaa service placement] REQUEST_METHOD: `GET` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:03:29.890260 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78bc6b23-30ef-42d6-9be2-b141f0c2bfaa service placement] SCRIPT_NAME: `/identity` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:03:29.890534 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78bc6b23-30ef-42d6-9be2-b141f0c2bfaa service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:03:29.892441 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.fernet_utils [None req-78bc6b23-30ef-42d6-9be2-b141f0c2bfaa service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82025) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 20:03:29.905124 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78bc6b23-30ef-42d6-9be2-b141f0c2bfaa service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=82025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 20:03:29.906853 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78bc6b23-30ef-42d6-9be2-b141f0c2bfaa service placement] RBAC: Authorization granted {{(pid=82025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 20:03:29.918287 dv-cinder-828806-6-smb devstack@keystone.service[82025]: [pid: 82025|app: 0|req: 1260/2462] 10.222.0.33 () {60 vars in 1365 bytes} [Tue Sep 13 20:03:29 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 129 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 20:03:32.806732 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-806bbb56-7349-4d75-b37c-5fe0941f4516 None None] REQUEST_METHOD: `GET` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:03:32.807383 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-806bbb56-7349-4d75-b37c-5fe0941f4516 None None] SCRIPT_NAME: `/identity` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:03:32.807383 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-806bbb56-7349-4d75-b37c-5fe0941f4516 None None] PATH_INFO: `/` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:03:32.809210 dv-cinder-828806-6-smb devstack@keystone.service[82026]: [pid: 82026|app: 0|req: 1203/2463] 10.222.0.33 () {54 vars in 921 bytes} [Tue Sep 13 20:03:32 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 20:03:32.815124 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14e57564-4bb5-41e3-8a43-a9cad1af3c40 None None] REQUEST_METHOD: `POST` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:03:32.815623 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14e57564-4bb5-41e3-8a43-a9cad1af3c40 None None] SCRIPT_NAME: `/identity` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:03:32.815724 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14e57564-4bb5-41e3-8a43-a9cad1af3c40 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:03:32.836955 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.auth.core [None req-14e57564-4bb5-41e3-8a43-a9cad1af3c40 None None] MFA Rules not processed for user `e66e7034abed4e0bad1f4137520c1e70`. Rule list: `[]` (Enabled: `True`). {{(pid=82025) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 20:03:32.842309 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.fernet_utils [None req-14e57564-4bb5-41e3-8a43-a9cad1af3c40 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82025) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 20:03:32.916106 dv-cinder-828806-6-smb devstack@keystone.service[82025]: [pid: 82025|app: 0|req: 1261/2464] 10.222.0.33 () {58 vars in 1018 bytes} [Tue Sep 13 20:03:32 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 20:03:32.927845 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-806bbb56-7349-4d75-b37c-5fe0941f4516 None None] Authenticating user token {{(pid=82026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 20:03:32.929671 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.common.fernet_utils [None req-806bbb56-7349-4d75-b37c-5fe0941f4516 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82026) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 20:03:32.989588 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-806bbb56-7349-4d75-b37c-5fe0941f4516 None None] Validating token access rules against request {{(pid=82026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 20:03:32.993247 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b85714ca-d33e-4617-a649-7cc2c3ccd805 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f7b2421bf1f84193a29f79709d1d5a19', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8c6fba0f15b4d6a84ff601919b7b8e4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 20:03:32.994361 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b85714ca-d33e-4617-a649-7cc2c3ccd805 service glance] REQUEST_METHOD: `GET` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:03:32.994640 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b85714ca-d33e-4617-a649-7cc2c3ccd805 service glance] SCRIPT_NAME: `/identity` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:03:32.995153 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b85714ca-d33e-4617-a649-7cc2c3ccd805 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:03:33.005624 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b85714ca-d33e-4617-a649-7cc2c3ccd805 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=82026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 20:03:33.007088 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b85714ca-d33e-4617-a649-7cc2c3ccd805 service glance] RBAC: Authorization granted {{(pid=82026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 20:03:33.022943 dv-cinder-828806-6-smb devstack@keystone.service[82026]: [pid: 82026|app: 0|req: 1204/2465] 10.222.0.33 () {60 vars in 1365 bytes} [Tue Sep 13 20:03:32 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 96 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 13 20:03:33.325082 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b251ee7d-f07e-40d0-a7a9-6e08170fd14c None None] REQUEST_METHOD: `GET` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:03:33.325309 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b251ee7d-f07e-40d0-a7a9-6e08170fd14c None None] SCRIPT_NAME: `/identity` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:03:33.325593 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b251ee7d-f07e-40d0-a7a9-6e08170fd14c None None] PATH_INFO: `/` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:03:33.326960 dv-cinder-828806-6-smb devstack@keystone.service[82025]: [pid: 82025|app: 0|req: 1262/2466] 10.222.0.33 () {54 vars in 921 bytes} [Tue Sep 13 20:03:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 20:03:33.331755 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83859926-6b61-417c-8206-f7a133106b40 None None] REQUEST_METHOD: `POST` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:03:33.332051 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83859926-6b61-417c-8206-f7a133106b40 None None] SCRIPT_NAME: `/identity` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:03:33.332586 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83859926-6b61-417c-8206-f7a133106b40 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:03:33.352330 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.auth.core [None req-83859926-6b61-417c-8206-f7a133106b40 None None] MFA Rules not processed for user `023a2c79c2444611b3d431928e56685d`. Rule list: `[]` (Enabled: `True`). {{(pid=82026) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 20:03:33.354265 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.common.fernet_utils [None req-83859926-6b61-417c-8206-f7a133106b40 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82026) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 20:03:33.410738 dv-cinder-828806-6-smb devstack@keystone.service[82026]: [pid: 82026|app: 0|req: 1205/2467] 10.222.0.33 () {58 vars in 1018 bytes} [Tue Sep 13 20:03:33 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 20:03:33.423357 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b251ee7d-f07e-40d0-a7a9-6e08170fd14c None None] Authenticating user token {{(pid=82025) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 20:03:33.425063 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.fernet_utils [None req-b251ee7d-f07e-40d0-a7a9-6e08170fd14c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82025) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 20:03:33.439363 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b251ee7d-f07e-40d0-a7a9-6e08170fd14c None None] Validating token access rules against request {{(pid=82025) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 20:03:33.442898 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e67dd4c1-6711-439e-bf9f-284c1bab4e14 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '023a2c79c2444611b3d431928e56685d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8c6fba0f15b4d6a84ff601919b7b8e4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82025) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 20:03:33.443527 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e67dd4c1-6711-439e-bf9f-284c1bab4e14 service neutron] REQUEST_METHOD: `GET` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:03:33.443811 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e67dd4c1-6711-439e-bf9f-284c1bab4e14 service neutron] SCRIPT_NAME: `/identity` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:03:33.444089 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e67dd4c1-6711-439e-bf9f-284c1bab4e14 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:03:33.451882 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e67dd4c1-6711-439e-bf9f-284c1bab4e14 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 20:03:33.453295 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e67dd4c1-6711-439e-bf9f-284c1bab4e14 service neutron] RBAC: Authorization granted {{(pid=82025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 20:03:33.461251 dv-cinder-828806-6-smb devstack@keystone.service[82025]: [pid: 82025|app: 0|req: 1263/2468] 10.222.0.33 () {60 vars in 1365 bytes} [Tue Sep 13 20:03:33 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 20:03:33.549132 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-227f4863-d3bc-4254-a98b-dcdd2e9a3489 None None] REQUEST_METHOD: `GET` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:03:33.549420 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-227f4863-d3bc-4254-a98b-dcdd2e9a3489 None None] SCRIPT_NAME: `/identity` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:03:33.549709 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-227f4863-d3bc-4254-a98b-dcdd2e9a3489 None None] PATH_INFO: `/` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:03:33.551078 dv-cinder-828806-6-smb devstack@keystone.service[82026]: [pid: 82026|app: 0|req: 1206/2469] 10.222.0.33 () {54 vars in 921 bytes} [Tue Sep 13 20:03:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 20:03:33.556914 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4783a75a-006e-46bd-9873-fdd7b11d18cf None None] REQUEST_METHOD: `POST` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:03:33.557200 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4783a75a-006e-46bd-9873-fdd7b11d18cf None None] SCRIPT_NAME: `/identity` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:03:33.557479 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4783a75a-006e-46bd-9873-fdd7b11d18cf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:03:33.578673 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.auth.core [None req-4783a75a-006e-46bd-9873-fdd7b11d18cf None None] MFA Rules not processed for user `e66e7034abed4e0bad1f4137520c1e70`. Rule list: `[]` (Enabled: `True`). {{(pid=82025) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 20:03:33.579925 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.fernet_utils [None req-4783a75a-006e-46bd-9873-fdd7b11d18cf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82025) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 20:03:33.592582 dv-cinder-828806-6-smb devstack@keystone.service[82025]: [pid: 82025|app: 0|req: 1264/2470] 10.222.0.33 () {58 vars in 1018 bytes} [Tue Sep 13 20:03:33 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 13 20:03:33.604489 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-227f4863-d3bc-4254-a98b-dcdd2e9a3489 None None] Authenticating user token {{(pid=82026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 20:03:33.606182 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.common.fernet_utils [None req-227f4863-d3bc-4254-a98b-dcdd2e9a3489 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82026) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 20:03:33.625734 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-227f4863-d3bc-4254-a98b-dcdd2e9a3489 None None] Validating token access rules against request {{(pid=82026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 20:03:33.630018 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eea16829-b4e7-44d7-ad23-3f72d87c0a0a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '023a2c79c2444611b3d431928e56685d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8c6fba0f15b4d6a84ff601919b7b8e4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 20:03:33.631998 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eea16829-b4e7-44d7-ad23-3f72d87c0a0a service neutron] REQUEST_METHOD: `GET` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:03:33.632290 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eea16829-b4e7-44d7-ad23-3f72d87c0a0a service neutron] SCRIPT_NAME: `/identity` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:03:33.632571 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eea16829-b4e7-44d7-ad23-3f72d87c0a0a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:03:33.644552 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eea16829-b4e7-44d7-ad23-3f72d87c0a0a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 20:03:33.646422 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eea16829-b4e7-44d7-ad23-3f72d87c0a0a service neutron] RBAC: Authorization granted {{(pid=82026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 20:03:33.667230 dv-cinder-828806-6-smb devstack@keystone.service[82026]: [pid: 82026|app: 0|req: 1207/2471] 10.222.0.33 () {60 vars in 1365 bytes} [Tue Sep 13 20:03:33 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 64 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 20:03:33.849012 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34369124-4acf-4bb1-9275-aeba78efa536 None None] REQUEST_METHOD: `POST` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:03:33.849441 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34369124-4acf-4bb1-9275-aeba78efa536 None None] SCRIPT_NAME: `/identity` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:03:33.849616 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34369124-4acf-4bb1-9275-aeba78efa536 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:03:33.869098 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.auth.core [None req-34369124-4acf-4bb1-9275-aeba78efa536 None None] MFA Rules not processed for user `8853527498a24a6c80c169929f9f48bc`. Rule list: `[]` (Enabled: `True`). {{(pid=82025) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 20:03:33.870603 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.fernet_utils [None req-34369124-4acf-4bb1-9275-aeba78efa536 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82025) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 20:03:33.935545 dv-cinder-828806-6-smb devstack@keystone.service[82025]: [pid: 82025|app: 0|req: 1265/2472] 10.222.0.33 () {58 vars in 958 bytes} [Tue Sep 13 20:03:33 2022] POST /identity/v3/auth/tokens => generated 3268 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 20:03:39.378586 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0e74b61-d017-4516-b97b-8e541680f1bc None None] REQUEST_METHOD: `POST` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:03:39.379107 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0e74b61-d017-4516-b97b-8e541680f1bc None None] SCRIPT_NAME: `/identity` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:03:39.379218 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0e74b61-d017-4516-b97b-8e541680f1bc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:03:39.401099 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.auth.core [None req-a0e74b61-d017-4516-b97b-8e541680f1bc None None] MFA Rules not processed for user `a28e738b894442e2bc9880eeb64fc0c8`. Rule list: `[]` (Enabled: `True`). {{(pid=82026) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 20:03:39.402353 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.common.fernet_utils [None req-a0e74b61-d017-4516-b97b-8e541680f1bc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82026) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 20:03:39.410403 dv-cinder-828806-6-smb devstack@keystone.service[82026]: [pid: 82026|app: 0|req: 1208/2473] 10.222.0.33 () {58 vars in 1009 bytes} [Tue Sep 13 20:03:39 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 20:03:39.435476 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34369124-4acf-4bb1-9275-aeba78efa536 None None] Authenticating user token {{(pid=82025) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 20:03:39.448876 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34369124-4acf-4bb1-9275-aeba78efa536 None None] Validating token access rules against request {{(pid=82025) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 20:03:39.455083 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fae5d520-7cdd-45cd-88bd-02154663579f service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa5a83574f7f424c805e130c462d5969', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8c6fba0f15b4d6a84ff601919b7b8e4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82025) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 20:03:39.455679 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fae5d520-7cdd-45cd-88bd-02154663579f service swift] REQUEST_METHOD: `GET` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:03:39.455962 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fae5d520-7cdd-45cd-88bd-02154663579f service swift] SCRIPT_NAME: `/identity` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:03:39.456236 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fae5d520-7cdd-45cd-88bd-02154663579f service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:03:39.465583 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG dbcounter [-] [82025] Writing DB stats keystone:SELECT=100 {{(pid=82025) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 20:03:39.469589 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fae5d520-7cdd-45cd-88bd-02154663579f service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=82025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 20:03:39.471435 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fae5d520-7cdd-45cd-88bd-02154663579f service swift] RBAC: Authorization granted {{(pid=82025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 20:03:39.482610 dv-cinder-828806-6-smb devstack@keystone.service[82025]: [pid: 82025|app: 0|req: 1266/2474] 10.222.0.33 () {60 vars in 1384 bytes} [Tue Sep 13 20:03:39 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 48 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Sep 13 20:03:49.395892 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG dbcounter [-] [82026] Writing DB stats keystone:SELECT=58 {{(pid=82026) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 20:03:49.511232 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG dbcounter [-] [82025] Writing DB stats keystone:SELECT=3 {{(pid=82025) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 20:03:55.603283 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85ea792d-40b8-4bd3-92f8-6d635714315d None None] REQUEST_METHOD: `POST` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:03:55.603778 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85ea792d-40b8-4bd3-92f8-6d635714315d None None] SCRIPT_NAME: `/identity` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:03:55.603877 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85ea792d-40b8-4bd3-92f8-6d635714315d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:03:55.625865 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.auth.core [None req-85ea792d-40b8-4bd3-92f8-6d635714315d None None] MFA Rules not processed for user `a28e738b894442e2bc9880eeb64fc0c8`. Rule list: `[]` (Enabled: `True`). {{(pid=82026) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 20:03:55.627128 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.common.fernet_utils [None req-85ea792d-40b8-4bd3-92f8-6d635714315d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82026) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 20:03:55.635233 dv-cinder-828806-6-smb devstack@keystone.service[82026]: [pid: 82026|app: 0|req: 1209/2475] 10.222.0.33 () {58 vars in 967 bytes} [Tue Sep 13 20:03:55 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 20:03:55.655955 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fae5d520-7cdd-45cd-88bd-02154663579f service swift] Authenticating user token {{(pid=82025) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 20:03:55.667106 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fae5d520-7cdd-45cd-88bd-02154663579f service swift] Validating token access rules against request {{(pid=82025) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 20:03:55.672034 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fb8e91d-4be5-498b-85d9-c88d16d3df3d service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa5a83574f7f424c805e130c462d5969', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8c6fba0f15b4d6a84ff601919b7b8e4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82025) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 20:03:55.672630 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fb8e91d-4be5-498b-85d9-c88d16d3df3d service swift] REQUEST_METHOD: `GET` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:03:55.672908 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fb8e91d-4be5-498b-85d9-c88d16d3df3d service swift] SCRIPT_NAME: `/identity` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:03:55.673181 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fb8e91d-4be5-498b-85d9-c88d16d3df3d service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:03:55.681612 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fb8e91d-4be5-498b-85d9-c88d16d3df3d service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=82025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 20:03:55.683202 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fb8e91d-4be5-498b-85d9-c88d16d3df3d service swift] RBAC: Authorization granted {{(pid=82025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 20:03:55.691244 dv-cinder-828806-6-smb devstack@keystone.service[82025]: [pid: 82025|app: 0|req: 1267/2476] 10.222.0.33 () {60 vars in 1384 bytes} [Tue Sep 13 20:03:55 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Sep 13 20:04:05.620009 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG dbcounter [-] [82026] Writing DB stats keystone:SELECT=3 {{(pid=82026) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 20:04:05.687834 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG dbcounter [-] [82025] Writing DB stats keystone:SELECT=6 {{(pid=82025) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 20:04:46.364039 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-625748f2-31df-4332-b1dd-58cee6d20cc1 None None] REQUEST_METHOD: `POST` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:04:46.364615 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-625748f2-31df-4332-b1dd-58cee6d20cc1 None None] SCRIPT_NAME: `/identity` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:04:46.364777 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-625748f2-31df-4332-b1dd-58cee6d20cc1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:04:46.386547 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.auth.core [None req-625748f2-31df-4332-b1dd-58cee6d20cc1 None None] MFA Rules not processed for user `abe7dd30d59f41b19efde48cc035aa4f`. Rule list: `[]` (Enabled: `True`). {{(pid=82026) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 20:04:46.388941 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.common.fernet_utils [None req-625748f2-31df-4332-b1dd-58cee6d20cc1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82026) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 20:04:46.479777 dv-cinder-828806-6-smb devstack@keystone.service[82026]: [pid: 82026|app: 0|req: 1210/2477] 10.222.0.33 () {58 vars in 958 bytes} [Tue Sep 13 20:04:46 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 20:04:47.154538 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fb8e91d-4be5-498b-85d9-c88d16d3df3d service swift] Authenticating user token {{(pid=82025) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 20:04:47.159856 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.fernet_utils [None req-3fb8e91d-4be5-498b-85d9-c88d16d3df3d service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82025) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 20:04:47.230969 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fb8e91d-4be5-498b-85d9-c88d16d3df3d service swift] Validating token access rules against request {{(pid=82025) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 20:04:47.236026 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c4eb0d2-de39-4ace-a6f0-3c184754222a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57539b6a6f3b4d589f5f5e1d211cd6a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b454f707d20347ada3d82aa85495635e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82025) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 20:04:47.236689 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c4eb0d2-de39-4ace-a6f0-3c184754222a admin admin] REQUEST_METHOD: `DELETE` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:04:47.236978 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c4eb0d2-de39-4ace-a6f0-3c184754222a admin admin] SCRIPT_NAME: `/identity` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:04:47.237260 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c4eb0d2-de39-4ace-a6f0-3c184754222a admin admin] PATH_INFO: `/v3/users/8853527498a24a6c80c169929f9f48bc` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:04:47.238396 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c4eb0d2-de39-4ace-a6f0-3c184754222a admin admin] RBAC: Authorizing `identity:delete_user(user_id=8853527498a24a6c80c169929f9f48bc)` {{(pid=82025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 20:04:47.240464 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c4eb0d2-de39-4ace-a6f0-3c184754222a admin admin] RBAC: Authorization granted {{(pid=82025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 20:04:47.434491 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf51ca86-5312-44cf-83da-b50e697ade9b None None] REQUEST_METHOD: `POST` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:04:47.435601 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf51ca86-5312-44cf-83da-b50e697ade9b None None] SCRIPT_NAME: `/identity` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:04:47.435772 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf51ca86-5312-44cf-83da-b50e697ade9b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:04:47.456985 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.auth.core [None req-cf51ca86-5312-44cf-83da-b50e697ade9b None None] MFA Rules not processed for user `1c2e721388804b1c8bed6ee356fce720`. Rule list: `[]` (Enabled: `True`). {{(pid=82026) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 20:04:47.458826 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.common.fernet_utils [None req-cf51ca86-5312-44cf-83da-b50e697ade9b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82026) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 20:04:47.505696 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.notifications [None req-7c4eb0d2-de39-4ace-a6f0-3c184754222a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8853527498a24a6c80c169929f9f48bc'} {{(pid=82025) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 20:04:47.536855 dv-cinder-828806-6-smb devstack@keystone.service[82026]: [pid: 82026|app: 0|req: 1211/2478] 10.222.0.33 () {58 vars in 958 bytes} [Tue Sep 13 20:04:47 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 13 20:04:47.597483 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.notifications [None req-7c4eb0d2-de39-4ace-a6f0-3c184754222a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8853527498a24a6c80c169929f9f48bc'} {{(pid=82025) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 20:04:47.598416 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.notifications [None req-7c4eb0d2-de39-4ace-a6f0-3c184754222a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8853527498a24a6c80c169929f9f48bc'} {{(pid=82025) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 20:04:47.627101 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.notifications [None req-7c4eb0d2-de39-4ace-a6f0-3c184754222a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8853527498a24a6c80c169929f9f48bc'} {{(pid=82025) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 20:04:47.642919 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.notifications [None req-7c4eb0d2-de39-4ace-a6f0-3c184754222a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8853527498a24a6c80c169929f9f48bc'} {{(pid=82025) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 20:04:47.650923 dv-cinder-828806-6-smb devstack@keystone.service[82025]: [pid: 82025|app: 0|req: 1268/2479] 10.222.0.33 () {58 vars in 1224 bytes} [Tue Sep 13 20:04:47 2022] DELETE /identity/v3/users/8853527498a24a6c80c169929f9f48bc => generated 0 bytes in 497 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 20:04:47.954217 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf51ca86-5312-44cf-83da-b50e697ade9b None None] Authenticating user token {{(pid=82026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 20:04:47.973939 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf51ca86-5312-44cf-83da-b50e697ade9b None None] Validating token access rules against request {{(pid=82026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 20:04:48.040081 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87448968-9122-43f6-bf9b-4c9a7247fba7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57539b6a6f3b4d589f5f5e1d211cd6a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b454f707d20347ada3d82aa85495635e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 20:04:48.040842 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87448968-9122-43f6-bf9b-4c9a7247fba7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:04:48.041225 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87448968-9122-43f6-bf9b-4c9a7247fba7 admin admin] SCRIPT_NAME: `/identity` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:04:48.041624 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87448968-9122-43f6-bf9b-4c9a7247fba7 admin admin] PATH_INFO: `/v3/projects/2625a02465d9493c9e8200024b4cf585` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:04:48.042889 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87448968-9122-43f6-bf9b-4c9a7247fba7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=2625a02465d9493c9e8200024b4cf585)` {{(pid=82026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 20:04:48.046128 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87448968-9122-43f6-bf9b-4c9a7247fba7 admin admin] RBAC: Authorization granted {{(pid=82026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 20:04:48.231613 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.notifications [None req-87448968-9122-43f6-bf9b-4c9a7247fba7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2625a02465d9493c9e8200024b4cf585', 'request_id': 'req-87448968-9122-43f6-bf9b-4c9a7247fba7'} {{(pid=82026) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 20:04:48.234610 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG dbcounter [-] [82026] Writing DB stats keystone:SELECT=95,keystone:DELETE=4,keystone:INSERT=1 {{(pid=82026) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 20:04:48.323228 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.notifications [None req-87448968-9122-43f6-bf9b-4c9a7247fba7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2625a02465d9493c9e8200024b4cf585', 'request_id': 'req-87448968-9122-43f6-bf9b-4c9a7247fba7'} {{(pid=82026) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 20:04:48.329864 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.notifications [None req-87448968-9122-43f6-bf9b-4c9a7247fba7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2625a02465d9493c9e8200024b4cf585', 'request_id': 'req-87448968-9122-43f6-bf9b-4c9a7247fba7'} {{(pid=82026) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 20:04:48.343371 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.notifications [None req-87448968-9122-43f6-bf9b-4c9a7247fba7 admin admin] The token cache is being invalidate because project 2625a02465d9493c9e8200024b4cf585 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82026) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 13 20:04:48.343716 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.notifications [None req-87448968-9122-43f6-bf9b-4c9a7247fba7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82026) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 20:04:48.344432 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.notifications [None req-87448968-9122-43f6-bf9b-4c9a7247fba7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82026) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 20:04:48.349369 dv-cinder-828806-6-smb devstack@keystone.service[82026]: [pid: 82026|app: 0|req: 1212/2480] 10.222.0.33 () {58 vars in 1233 bytes} [Tue Sep 13 20:04:47 2022] DELETE /identity/v3/projects/2625a02465d9493c9e8200024b4cf585 => generated 0 bytes in 392 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 20:04:48.351255 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b76ad16-180f-4639-9281-b662221b1059 None None] REQUEST_METHOD: `POST` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:04:48.351721 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b76ad16-180f-4639-9281-b662221b1059 None None] SCRIPT_NAME: `/identity` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:04:48.351821 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b76ad16-180f-4639-9281-b662221b1059 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:04:48.375430 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.auth.core [None req-7b76ad16-180f-4639-9281-b662221b1059 None None] MFA Rules not processed for user `57539b6a6f3b4d589f5f5e1d211cd6a0`. Rule list: `[]` (Enabled: `True`). {{(pid=82025) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 20:04:48.378163 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.fernet_utils [None req-7b76ad16-180f-4639-9281-b662221b1059 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82025) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 20:04:48.452977 dv-cinder-828806-6-smb devstack@keystone.service[82025]: [pid: 82025|app: 0|req: 1269/2481] 10.222.0.33 () {58 vars in 958 bytes} [Tue Sep 13 20:04:48 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 13 20:04:48.476495 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d9a926d-c059-4195-9d2f-f2705803abf7 None None] REQUEST_METHOD: `POST` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:04:48.476986 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d9a926d-c059-4195-9d2f-f2705803abf7 None None] SCRIPT_NAME: `/identity` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:04:48.477088 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d9a926d-c059-4195-9d2f-f2705803abf7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:04:48.498477 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.auth.core [None req-9d9a926d-c059-4195-9d2f-f2705803abf7 None None] MFA Rules not processed for user `57539b6a6f3b4d589f5f5e1d211cd6a0`. Rule list: `[]` (Enabled: `True`). {{(pid=82026) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 20:04:48.500380 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.common.fernet_utils [None req-9d9a926d-c059-4195-9d2f-f2705803abf7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82026) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 20:04:48.508554 dv-cinder-828806-6-smb devstack@keystone.service[82026]: [pid: 82026|app: 0|req: 1213/2482] 10.222.0.33 () {58 vars in 958 bytes} [Tue Sep 13 20:04:48 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 20:04:48.518892 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b76ad16-180f-4639-9281-b662221b1059 None None] Authenticating user token {{(pid=82025) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 20:04:48.529261 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b76ad16-180f-4639-9281-b662221b1059 None None] Validating token access rules against request {{(pid=82025) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 20:04:48.533798 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d82d014-ad1a-4550-861b-415193dc41e0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57539b6a6f3b4d589f5f5e1d211cd6a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b454f707d20347ada3d82aa85495635e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82025) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 20:04:48.534411 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d82d014-ad1a-4550-861b-415193dc41e0 admin admin] REQUEST_METHOD: `GET` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:04:48.534728 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d82d014-ad1a-4550-861b-415193dc41e0 admin admin] SCRIPT_NAME: `/identity` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:04:48.535070 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d82d014-ad1a-4550-861b-415193dc41e0 admin admin] PATH_INFO: `/v3/domains` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:04:48.535768 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d82d014-ad1a-4550-861b-415193dc41e0 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82025) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 20:04:48.536094 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d82d014-ad1a-4550-861b-415193dc41e0 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 20:04:48.537672 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d82d014-ad1a-4550-861b-415193dc41e0 admin admin] RBAC: Authorization granted {{(pid=82025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 20:04:48.562510 dv-cinder-828806-6-smb devstack@keystone.service[82025]: [pid: 82025|app: 0|req: 1270/2483] 10.222.0.33 () {58 vars in 1153 bytes} [Tue Sep 13 20:04:48 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 20:04:48.562715 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d9a926d-c059-4195-9d2f-f2705803abf7 None None] Authenticating user token {{(pid=82026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 20:04:48.566936 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d9a926d-c059-4195-9d2f-f2705803abf7 None None] Validating token access rules against request {{(pid=82026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 20:04:48.572005 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9901b24e-663c-4818-927c-5d51ad1f9f5f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57539b6a6f3b4d589f5f5e1d211cd6a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b454f707d20347ada3d82aa85495635e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 20:04:48.572872 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9901b24e-663c-4818-927c-5d51ad1f9f5f admin admin] REQUEST_METHOD: `POST` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:04:48.573149 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9901b24e-663c-4818-927c-5d51ad1f9f5f admin admin] SCRIPT_NAME: `/identity` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:04:48.573424 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9901b24e-663c-4818-927c-5d51ad1f9f5f admin admin] PATH_INFO: `/v3/projects` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:04:48.574066 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9901b24e-663c-4818-927c-5d51ad1f9f5f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 20:04:48.576170 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9901b24e-663c-4818-927c-5d51ad1f9f5f admin admin] RBAC: Authorization granted {{(pid=82026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 20:04:48.742074 dv-cinder-828806-6-smb devstack@keystone.service[82026]: [pid: 82026|app: 0|req: 1214/2484] 10.222.0.33 () {60 vars in 1153 bytes} [Tue Sep 13 20:04:48 2022] POST /identity/v3/projects => generated 383 bytes in 186 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 13 20:04:48.760761 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d82d014-ad1a-4550-861b-415193dc41e0 admin admin] Authenticating user token {{(pid=82025) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 20:04:48.771132 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d82d014-ad1a-4550-861b-415193dc41e0 admin admin] Validating token access rules against request {{(pid=82025) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 20:04:48.774645 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG dbcounter [-] [82025] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82025) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 20:04:48.830992 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaef2b39-25d7-4a8a-9839-5e6f7d385db5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57539b6a6f3b4d589f5f5e1d211cd6a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b454f707d20347ada3d82aa85495635e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82025) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 20:04:48.831749 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaef2b39-25d7-4a8a-9839-5e6f7d385db5 admin admin] REQUEST_METHOD: `POST` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:04:48.832509 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaef2b39-25d7-4a8a-9839-5e6f7d385db5 admin admin] SCRIPT_NAME: `/identity` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:04:48.832509 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaef2b39-25d7-4a8a-9839-5e6f7d385db5 admin admin] PATH_INFO: `/v3/users` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:04:48.832927 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaef2b39-25d7-4a8a-9839-5e6f7d385db5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 20:04:48.834918 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaef2b39-25d7-4a8a-9839-5e6f7d385db5 admin admin] RBAC: Authorization granted {{(pid=82025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 20:04:48.974642 dv-cinder-828806-6-smb devstack@keystone.service[82025]: [pid: 82025|app: 0|req: 1271/2485] 10.222.0.33 () {60 vars in 1144 bytes} [Tue Sep 13 20:04:48 2022] POST /identity/v3/users => generated 292 bytes in 227 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 13 20:04:48.978830 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9901b24e-663c-4818-927c-5d51ad1f9f5f admin admin] Authenticating user token {{(pid=82026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 20:04:48.989650 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9901b24e-663c-4818-927c-5d51ad1f9f5f admin admin] Validating token access rules against request {{(pid=82026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 20:04:48.994202 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f24567e7-4b03-4362-8a7a-a210ea99fb30 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57539b6a6f3b4d589f5f5e1d211cd6a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b454f707d20347ada3d82aa85495635e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 20:04:48.994798 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f24567e7-4b03-4362-8a7a-a210ea99fb30 admin admin] REQUEST_METHOD: `GET` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:04:48.995191 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f24567e7-4b03-4362-8a7a-a210ea99fb30 admin admin] SCRIPT_NAME: `/identity` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:04:48.995475 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f24567e7-4b03-4362-8a7a-a210ea99fb30 admin admin] PATH_INFO: `/v3/roles` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:04:48.996125 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f24567e7-4b03-4362-8a7a-a210ea99fb30 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 20:04:48.998397 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f24567e7-4b03-4362-8a7a-a210ea99fb30 admin admin] RBAC: Authorization granted {{(pid=82026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 20:04:49.008137 dv-cinder-828806-6-smb devstack@keystone.service[82026]: [pid: 82026|app: 0|req: 1215/2486] 10.222.0.33 () {58 vars in 1122 bytes} [Tue Sep 13 20:04:48 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 13 20:04:49.012019 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaef2b39-25d7-4a8a-9839-5e6f7d385db5 admin admin] Authenticating user token {{(pid=82025) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 20:04:49.022747 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaef2b39-25d7-4a8a-9839-5e6f7d385db5 admin admin] Validating token access rules against request {{(pid=82025) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 20:04:49.027591 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42c0c648-706b-4da5-a62b-b80944696ecf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57539b6a6f3b4d589f5f5e1d211cd6a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b454f707d20347ada3d82aa85495635e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82025) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 20:04:49.028192 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42c0c648-706b-4da5-a62b-b80944696ecf admin admin] REQUEST_METHOD: `GET` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:04:49.029167 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42c0c648-706b-4da5-a62b-b80944696ecf admin admin] SCRIPT_NAME: `/identity` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:04:49.029461 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42c0c648-706b-4da5-a62b-b80944696ecf admin admin] PATH_INFO: `/v3/roles` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:04:49.030121 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42c0c648-706b-4da5-a62b-b80944696ecf admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 20:04:49.031856 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42c0c648-706b-4da5-a62b-b80944696ecf admin admin] RBAC: Authorization granted {{(pid=82025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 20:04:49.042647 dv-cinder-828806-6-smb devstack@keystone.service[82025]: [pid: 82025|app: 0|req: 1272/2487] 10.222.0.33 () {58 vars in 1122 bytes} [Tue Sep 13 20:04:49 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 13 20:04:49.046768 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f24567e7-4b03-4362-8a7a-a210ea99fb30 admin admin] Authenticating user token {{(pid=82026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 20:04:49.057484 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f24567e7-4b03-4362-8a7a-a210ea99fb30 admin admin] Validating token access rules against request {{(pid=82026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 20:04:49.077716 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e332f0a-6513-49bd-9c7e-840b13bed1bd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57539b6a6f3b4d589f5f5e1d211cd6a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b454f707d20347ada3d82aa85495635e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 20:04:49.077716 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e332f0a-6513-49bd-9c7e-840b13bed1bd admin admin] REQUEST_METHOD: `PUT` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:04:49.077716 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e332f0a-6513-49bd-9c7e-840b13bed1bd admin admin] SCRIPT_NAME: `/identity` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:04:49.077716 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e332f0a-6513-49bd-9c7e-840b13bed1bd admin admin] PATH_INFO: `/v3/projects/00fff77958004efab37749ec46fac765/users/2f6d7f8d9db24b6fbe6b3e7663b20274/roles/3618ab638a65401f82333da7596d1daf` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:04:49.080830 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e332f0a-6513-49bd-9c7e-840b13bed1bd admin admin] RBAC: Authorizing `identity:create_grant(project_id=00fff77958004efab37749ec46fac765, user_id=2f6d7f8d9db24b6fbe6b3e7663b20274, role_id=3618ab638a65401f82333da7596d1daf)` {{(pid=82026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 20:04:49.083713 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e332f0a-6513-49bd-9c7e-840b13bed1bd admin admin] RBAC: Authorization granted {{(pid=82026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 20:04:49.227472 dv-cinder-828806-6-smb devstack@keystone.service[82026]: [pid: 82026|app: 0|req: 1216/2488] 10.222.0.33 () {60 vars in 1483 bytes} [Tue Sep 13 20:04:49 2022] PUT /identity/v3/projects/00fff77958004efab37749ec46fac765/users/2f6d7f8d9db24b6fbe6b3e7663b20274/roles/3618ab638a65401f82333da7596d1daf => generated 0 bytes in 181 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 20:04:49.232612 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34b703eb-53a3-4b79-8293-a94c04481e5f None None] REQUEST_METHOD: `POST` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:04:49.232981 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34b703eb-53a3-4b79-8293-a94c04481e5f None None] SCRIPT_NAME: `/identity` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:04:49.233334 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34b703eb-53a3-4b79-8293-a94c04481e5f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:04:49.253273 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.auth.core [None req-34b703eb-53a3-4b79-8293-a94c04481e5f None None] MFA Rules not processed for user `57539b6a6f3b4d589f5f5e1d211cd6a0`. Rule list: `[]` (Enabled: `True`). {{(pid=82025) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 20:04:49.254495 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.fernet_utils [None req-34b703eb-53a3-4b79-8293-a94c04481e5f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82025) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 20:04:49.319291 dv-cinder-828806-6-smb devstack@keystone.service[82025]: [pid: 82025|app: 0|req: 1273/2489] 10.222.0.33 () {58 vars in 958 bytes} [Tue Sep 13 20:04:49 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 13 20:04:49.329700 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e332f0a-6513-49bd-9c7e-840b13bed1bd admin admin] Authenticating user token {{(pid=82026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 20:04:49.331638 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.common.fernet_utils [None req-1e332f0a-6513-49bd-9c7e-840b13bed1bd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82026) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 20:04:49.402979 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e332f0a-6513-49bd-9c7e-840b13bed1bd admin admin] Validating token access rules against request {{(pid=82026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 20:04:49.407237 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38469257-f147-472d-8292-5c2cdac1790d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '023a2c79c2444611b3d431928e56685d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8c6fba0f15b4d6a84ff601919b7b8e4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 20:04:49.407862 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38469257-f147-472d-8292-5c2cdac1790d service neutron] REQUEST_METHOD: `GET` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:04:49.408177 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38469257-f147-472d-8292-5c2cdac1790d service neutron] SCRIPT_NAME: `/identity` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:04:49.408497 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38469257-f147-472d-8292-5c2cdac1790d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:04:49.418418 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38469257-f147-472d-8292-5c2cdac1790d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 20:04:49.420194 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38469257-f147-472d-8292-5c2cdac1790d service neutron] RBAC: Authorization granted {{(pid=82026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 20:04:49.429974 dv-cinder-828806-6-smb devstack@keystone.service[82026]: [pid: 82026|app: 0|req: 1217/2490] 10.222.0.33 () {60 vars in 1365 bytes} [Tue Sep 13 20:04:49 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 101 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 20:04:59.109807 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f583dec7-65bf-41a4-b346-ed71d6c4d987 None None] REQUEST_METHOD: `POST` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:04:59.110269 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f583dec7-65bf-41a4-b346-ed71d6c4d987 None None] SCRIPT_NAME: `/identity` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:04:59.110680 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f583dec7-65bf-41a4-b346-ed71d6c4d987 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:04:59.177329 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.auth.core [None req-f583dec7-65bf-41a4-b346-ed71d6c4d987 None None] MFA Rules not processed for user `2f6d7f8d9db24b6fbe6b3e7663b20274`. Rule list: `[]` (Enabled: `True`). {{(pid=82025) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 20:04:59.177329 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.fernet_utils [None req-f583dec7-65bf-41a4-b346-ed71d6c4d987 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82025) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 20:04:59.260152 dv-cinder-828806-6-smb devstack@keystone.service[82025]: [pid: 82025|app: 0|req: 1274/2491] 10.222.0.33 () {58 vars in 958 bytes} [Tue Sep 13 20:04:59 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 151 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 20:04:59.277837 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38469257-f147-472d-8292-5c2cdac1790d service neutron] Authenticating user token {{(pid=82026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 20:04:59.279488 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.common.fernet_utils [None req-38469257-f147-472d-8292-5c2cdac1790d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82026) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 20:04:59.374274 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38469257-f147-472d-8292-5c2cdac1790d service neutron] Validating token access rules against request {{(pid=82026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 20:04:59.381531 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-590aeb26-9e55-401f-9b93-d211d6bf5225 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e66e7034abed4e0bad1f4137520c1e70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8c6fba0f15b4d6a84ff601919b7b8e4', 'project_domain_id': 'default', 'roles': ['service', 'member', 'reader', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 20:04:59.382910 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-590aeb26-9e55-401f-9b93-d211d6bf5225 service nova] REQUEST_METHOD: `GET` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:04:59.383254 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-590aeb26-9e55-401f-9b93-d211d6bf5225 service nova] SCRIPT_NAME: `/identity` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:04:59.383542 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-590aeb26-9e55-401f-9b93-d211d6bf5225 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:04:59.394416 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-590aeb26-9e55-401f-9b93-d211d6bf5225 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 20:04:59.396343 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-590aeb26-9e55-401f-9b93-d211d6bf5225 service nova] RBAC: Authorization granted {{(pid=82026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 20:04:59.407748 dv-cinder-828806-6-smb devstack@keystone.service[82026]: [pid: 82026|app: 0|req: 1218/2492] 10.222.0.33 () {60 vars in 1365 bytes} [Tue Sep 13 20:04:59 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 131 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 20:05:02.140740 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a7fdfe9-9dfd-4536-acdd-c16495075b23 None None] REQUEST_METHOD: `POST` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:05:02.141287 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a7fdfe9-9dfd-4536-acdd-c16495075b23 None None] SCRIPT_NAME: `/identity` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:05:02.141489 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a7fdfe9-9dfd-4536-acdd-c16495075b23 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:05:02.165802 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.auth.core [None req-8a7fdfe9-9dfd-4536-acdd-c16495075b23 None None] MFA Rules not processed for user `a28e738b894442e2bc9880eeb64fc0c8`. Rule list: `[]` (Enabled: `True`). {{(pid=82025) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 20:05:02.167432 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.fernet_utils [None req-8a7fdfe9-9dfd-4536-acdd-c16495075b23 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82025) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 20:05:02.190498 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG dbcounter [-] [82025] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=82025) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 20:05:02.263789 dv-cinder-828806-6-smb devstack@keystone.service[82025]: [pid: 82025|app: 0|req: 1275/2493] 10.222.0.33 () {58 vars in 967 bytes} [Tue Sep 13 20:05:02 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 20:05:02.646133 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-590aeb26-9e55-401f-9b93-d211d6bf5225 service nova] Authenticating user token {{(pid=82026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 20:05:02.646133 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.common.fernet_utils [None req-590aeb26-9e55-401f-9b93-d211d6bf5225 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82026) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 20:05:02.653119 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG dbcounter [-] [82026] Writing DB stats keystone:DELETE=3,keystone:SELECT=95,keystone:INSERT=2 {{(pid=82026) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 20:05:02.729493 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-590aeb26-9e55-401f-9b93-d211d6bf5225 service nova] Validating token access rules against request {{(pid=82026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 20:05:02.735141 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a9965bf-1748-4c89-b3e9-c606958a8643 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa5a83574f7f424c805e130c462d5969', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8c6fba0f15b4d6a84ff601919b7b8e4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 20:05:02.735835 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a9965bf-1748-4c89-b3e9-c606958a8643 service swift] REQUEST_METHOD: `GET` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:05:02.736178 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a9965bf-1748-4c89-b3e9-c606958a8643 service swift] SCRIPT_NAME: `/identity` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:05:02.736560 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a9965bf-1748-4c89-b3e9-c606958a8643 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:05:02.745894 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a9965bf-1748-4c89-b3e9-c606958a8643 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=82026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 20:05:02.747832 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a9965bf-1748-4c89-b3e9-c606958a8643 service swift] RBAC: Authorization granted {{(pid=82026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 20:05:02.757760 dv-cinder-828806-6-smb devstack@keystone.service[82026]: [pid: 82026|app: 0|req: 1219/2494] 10.222.0.33 () {60 vars in 1384 bytes} [Tue Sep 13 20:05:02 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 116 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Sep 13 20:05:03.188377 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86cbf5ba-6230-47b1-b052-6c841db0f3ae None None] REQUEST_METHOD: `POST` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:05:03.188910 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86cbf5ba-6230-47b1-b052-6c841db0f3ae None None] SCRIPT_NAME: `/identity` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:05:03.189052 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86cbf5ba-6230-47b1-b052-6c841db0f3ae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:05:03.210294 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.auth.core [None req-86cbf5ba-6230-47b1-b052-6c841db0f3ae None None] MFA Rules not processed for user `2f6d7f8d9db24b6fbe6b3e7663b20274`. Rule list: `[]` (Enabled: `True`). {{(pid=82025) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 20:05:03.211586 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.fernet_utils [None req-86cbf5ba-6230-47b1-b052-6c841db0f3ae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82025) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 20:05:03.220037 dv-cinder-828806-6-smb devstack@keystone.service[82025]: [pid: 82025|app: 0|req: 1276/2495] 10.222.0.33 () {58 vars in 958 bytes} [Tue Sep 13 20:05:03 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 20:05:09.937906 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04533780-6253-4736-a465-1889fc9aef65 None None] REQUEST_METHOD: `GET` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:05:09.938488 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04533780-6253-4736-a465-1889fc9aef65 None None] SCRIPT_NAME: `/identity` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:05:09.938488 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04533780-6253-4736-a465-1889fc9aef65 None None] PATH_INFO: `/` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:05:09.939872 dv-cinder-828806-6-smb devstack@keystone.service[82026]: [pid: 82026|app: 0|req: 1220/2496] 10.222.0.33 () {54 vars in 921 bytes} [Tue Sep 13 20:05:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 20:05:09.976106 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97041c5a-98a3-470f-844a-e7a7e87c5a98 None None] REQUEST_METHOD: `POST` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:05:09.976672 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97041c5a-98a3-470f-844a-e7a7e87c5a98 None None] SCRIPT_NAME: `/identity` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:05:09.976672 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97041c5a-98a3-470f-844a-e7a7e87c5a98 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:05:09.996838 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.auth.core [None req-97041c5a-98a3-470f-844a-e7a7e87c5a98 None None] MFA Rules not processed for user `060ea3dea2134429967c164bd158b272`. Rule list: `[]` (Enabled: `True`). {{(pid=82025) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 20:05:09.998404 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.fernet_utils [None req-97041c5a-98a3-470f-844a-e7a7e87c5a98 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82025) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 20:05:10.087302 dv-cinder-828806-6-smb devstack@keystone.service[82025]: [pid: 82025|app: 0|req: 1277/2497] 10.222.0.33 () {58 vars in 1018 bytes} [Tue Sep 13 20:05:09 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 20:05:10.103299 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04533780-6253-4736-a465-1889fc9aef65 None None] Authenticating user token {{(pid=82026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 20:05:10.106318 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.common.fernet_utils [None req-04533780-6253-4736-a465-1889fc9aef65 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82026) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 20:05:10.137409 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04533780-6253-4736-a465-1889fc9aef65 None None] Validating token access rules against request {{(pid=82026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 20:05:10.141351 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71836e1c-bca2-4be3-9758-1e26c0494c54 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '060ea3dea2134429967c164bd158b272', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8c6fba0f15b4d6a84ff601919b7b8e4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 20:05:10.142223 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71836e1c-bca2-4be3-9758-1e26c0494c54 service placement] REQUEST_METHOD: `GET` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:05:10.142960 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71836e1c-bca2-4be3-9758-1e26c0494c54 service placement] SCRIPT_NAME: `/identity` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:05:10.143495 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71836e1c-bca2-4be3-9758-1e26c0494c54 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:05:10.154417 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71836e1c-bca2-4be3-9758-1e26c0494c54 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=82026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 20:05:10.156156 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71836e1c-bca2-4be3-9758-1e26c0494c54 service placement] RBAC: Authorization granted {{(pid=82026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 20:05:10.167864 dv-cinder-828806-6-smb devstack@keystone.service[82026]: [pid: 82026|app: 0|req: 1221/2498] 10.222.0.33 () {60 vars in 1365 bytes} [Tue Sep 13 20:05:10 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 65 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 20:05:14.864934 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97041c5a-98a3-470f-844a-e7a7e87c5a98 None None] Authenticating user token {{(pid=82025) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 20:05:14.866429 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.fernet_utils [None req-97041c5a-98a3-470f-844a-e7a7e87c5a98 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82025) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 20:05:14.881695 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97041c5a-98a3-470f-844a-e7a7e87c5a98 None None] Validating token access rules against request {{(pid=82025) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 20:05:14.887750 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6eb6104-e461-4fec-a4e5-ffe701072c09 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57539b6a6f3b4d589f5f5e1d211cd6a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b454f707d20347ada3d82aa85495635e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82025) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 20:05:14.888387 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6eb6104-e461-4fec-a4e5-ffe701072c09 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:05:14.888672 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6eb6104-e461-4fec-a4e5-ffe701072c09 admin admin] SCRIPT_NAME: `/identity` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:05:14.889526 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6eb6104-e461-4fec-a4e5-ffe701072c09 admin admin] PATH_INFO: `/v3/users/0afb3d4de8cc4a518f4e63f5d28e50ef` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:05:14.890668 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6eb6104-e461-4fec-a4e5-ffe701072c09 admin admin] RBAC: Authorizing `identity:delete_user(user_id=0afb3d4de8cc4a518f4e63f5d28e50ef)` {{(pid=82025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 20:05:14.892633 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6eb6104-e461-4fec-a4e5-ffe701072c09 admin admin] RBAC: Authorization granted {{(pid=82025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 20:05:15.364199 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.notifications [None req-e6eb6104-e461-4fec-a4e5-ffe701072c09 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0afb3d4de8cc4a518f4e63f5d28e50ef'} {{(pid=82025) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 20:05:15.468208 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.notifications [None req-e6eb6104-e461-4fec-a4e5-ffe701072c09 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0afb3d4de8cc4a518f4e63f5d28e50ef'} {{(pid=82025) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 20:05:15.469074 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.notifications [None req-e6eb6104-e461-4fec-a4e5-ffe701072c09 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0afb3d4de8cc4a518f4e63f5d28e50ef'} {{(pid=82025) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 20:05:15.482312 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.notifications [None req-e6eb6104-e461-4fec-a4e5-ffe701072c09 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0afb3d4de8cc4a518f4e63f5d28e50ef'} {{(pid=82025) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 20:05:15.491340 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.notifications [None req-e6eb6104-e461-4fec-a4e5-ffe701072c09 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0afb3d4de8cc4a518f4e63f5d28e50ef'} {{(pid=82025) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 20:05:15.498983 dv-cinder-828806-6-smb devstack@keystone.service[82025]: [pid: 82025|app: 0|req: 1278/2499] 10.222.0.33 () {58 vars in 1224 bytes} [Tue Sep 13 20:05:14 2022] DELETE /identity/v3/users/0afb3d4de8cc4a518f4e63f5d28e50ef => generated 0 bytes in 635 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 20:05:15.870678 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71836e1c-bca2-4be3-9758-1e26c0494c54 service placement] Authenticating user token {{(pid=82026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 20:05:15.879874 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71836e1c-bca2-4be3-9758-1e26c0494c54 service placement] Validating token access rules against request {{(pid=82026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 20:05:15.944763 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3476af44-827d-4732-b582-97cd2d132850 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57539b6a6f3b4d589f5f5e1d211cd6a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b454f707d20347ada3d82aa85495635e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 20:05:15.945376 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3476af44-827d-4732-b582-97cd2d132850 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:05:15.945662 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3476af44-827d-4732-b582-97cd2d132850 admin admin] SCRIPT_NAME: `/identity` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:05:15.945942 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3476af44-827d-4732-b582-97cd2d132850 admin admin] PATH_INFO: `/v3/projects/b7f7d4d580f143c0a9174ab977cc2eac` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:05:15.948161 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3476af44-827d-4732-b582-97cd2d132850 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b7f7d4d580f143c0a9174ab977cc2eac)` {{(pid=82026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 20:05:15.950095 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3476af44-827d-4732-b582-97cd2d132850 admin admin] RBAC: Authorization granted {{(pid=82026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 20:05:16.090656 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.notifications [None req-3476af44-827d-4732-b582-97cd2d132850 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b7f7d4d580f143c0a9174ab977cc2eac', 'request_id': 'req-3476af44-827d-4732-b582-97cd2d132850'} {{(pid=82026) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 20:05:16.199242 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.notifications [None req-3476af44-827d-4732-b582-97cd2d132850 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b7f7d4d580f143c0a9174ab977cc2eac', 'request_id': 'req-3476af44-827d-4732-b582-97cd2d132850'} {{(pid=82026) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 20:05:16.205607 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.notifications [None req-3476af44-827d-4732-b582-97cd2d132850 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b7f7d4d580f143c0a9174ab977cc2eac', 'request_id': 'req-3476af44-827d-4732-b582-97cd2d132850'} {{(pid=82026) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 20:05:16.218159 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.notifications [None req-3476af44-827d-4732-b582-97cd2d132850 admin admin] The token cache is being invalidate because project b7f7d4d580f143c0a9174ab977cc2eac was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82026) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 13 20:05:16.218469 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.notifications [None req-3476af44-827d-4732-b582-97cd2d132850 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82026) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 20:05:16.219164 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.notifications [None req-3476af44-827d-4732-b582-97cd2d132850 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82026) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 20:05:16.220682 dv-cinder-828806-6-smb devstack@keystone.service[82026]: [pid: 82026|app: 0|req: 1222/2500] 10.222.0.33 () {58 vars in 1233 bytes} [Tue Sep 13 20:05:15 2022] DELETE /identity/v3/projects/b7f7d4d580f143c0a9174ab977cc2eac => generated 0 bytes in 353 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 20:05:16.224616 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6eb6104-e461-4fec-a4e5-ffe701072c09 admin admin] Authenticating user token {{(pid=82025) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 20:05:16.226126 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.fernet_utils [None req-e6eb6104-e461-4fec-a4e5-ffe701072c09 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82025) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 20:05:16.240361 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6eb6104-e461-4fec-a4e5-ffe701072c09 admin admin] Validating token access rules against request {{(pid=82025) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 20:05:16.258798 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG dbcounter [-] [82025] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82025) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 20:05:16.300584 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-349db09c-34d8-4e19-92ab-e1e794b93ef9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57539b6a6f3b4d589f5f5e1d211cd6a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b454f707d20347ada3d82aa85495635e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82025) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 20:05:16.303625 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-349db09c-34d8-4e19-92ab-e1e794b93ef9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:05:16.303625 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-349db09c-34d8-4e19-92ab-e1e794b93ef9 admin admin] SCRIPT_NAME: `/identity` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:05:16.303625 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-349db09c-34d8-4e19-92ab-e1e794b93ef9 admin admin] PATH_INFO: `/v3/users/2a9d99bb42e44fd1ae3eceb8f5fa0910` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:05:16.303625 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-349db09c-34d8-4e19-92ab-e1e794b93ef9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=2a9d99bb42e44fd1ae3eceb8f5fa0910)` {{(pid=82025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 20:05:16.304818 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-349db09c-34d8-4e19-92ab-e1e794b93ef9 admin admin] RBAC: Authorization granted {{(pid=82025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 20:05:16.496491 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3476af44-827d-4732-b582-97cd2d132850 admin admin] Authenticating user token {{(pid=82026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 20:05:16.497964 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.common.fernet_utils [None req-3476af44-827d-4732-b582-97cd2d132850 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82026) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 20:05:16.511921 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG dbcounter [-] [82026] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=82026) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 20:05:16.556835 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3476af44-827d-4732-b582-97cd2d132850 admin admin] Validating token access rules against request {{(pid=82026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 20:05:16.560484 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d017382d-4188-45f1-8d07-4759a6eecb53 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '023a2c79c2444611b3d431928e56685d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8c6fba0f15b4d6a84ff601919b7b8e4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 20:05:16.561098 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d017382d-4188-45f1-8d07-4759a6eecb53 service neutron] REQUEST_METHOD: `GET` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:05:16.561379 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d017382d-4188-45f1-8d07-4759a6eecb53 service neutron] SCRIPT_NAME: `/identity` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:05:16.561655 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d017382d-4188-45f1-8d07-4759a6eecb53 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:05:16.563431 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.common.fernet_utils [None req-d017382d-4188-45f1-8d07-4759a6eecb53 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82026) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 20:05:16.583021 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.notifications [None req-349db09c-34d8-4e19-92ab-e1e794b93ef9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2a9d99bb42e44fd1ae3eceb8f5fa0910'} {{(pid=82025) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 20:05:16.635594 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d017382d-4188-45f1-8d07-4759a6eecb53 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 20:05:16.637033 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d017382d-4188-45f1-8d07-4759a6eecb53 service neutron] RBAC: Authorization granted {{(pid=82026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 20:05:16.647819 dv-cinder-828806-6-smb devstack@keystone.service[82026]: [pid: 82026|app: 0|req: 1223/2501] 10.222.0.33 () {60 vars in 1365 bytes} [Tue Sep 13 20:05:16 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 152 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 13 20:05:16.677306 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.notifications [None req-349db09c-34d8-4e19-92ab-e1e794b93ef9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2a9d99bb42e44fd1ae3eceb8f5fa0910'} {{(pid=82025) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 20:05:16.677944 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.notifications [None req-349db09c-34d8-4e19-92ab-e1e794b93ef9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2a9d99bb42e44fd1ae3eceb8f5fa0910'} {{(pid=82025) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 20:05:16.691427 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.notifications [None req-349db09c-34d8-4e19-92ab-e1e794b93ef9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2a9d99bb42e44fd1ae3eceb8f5fa0910'} {{(pid=82025) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 20:05:16.700098 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.notifications [None req-349db09c-34d8-4e19-92ab-e1e794b93ef9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2a9d99bb42e44fd1ae3eceb8f5fa0910'} {{(pid=82025) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 20:05:16.706245 dv-cinder-828806-6-smb devstack@keystone.service[82025]: [pid: 82025|app: 0|req: 1279/2502] 10.222.0.33 () {58 vars in 1224 bytes} [Tue Sep 13 20:05:16 2022] DELETE /identity/v3/users/2a9d99bb42e44fd1ae3eceb8f5fa0910 => generated 0 bytes in 482 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 20:05:17.041397 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d017382d-4188-45f1-8d07-4759a6eecb53 service neutron] Authenticating user token {{(pid=82026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 20:05:17.044420 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.common.fernet_utils [None req-d017382d-4188-45f1-8d07-4759a6eecb53 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82026) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 20:05:17.056852 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d017382d-4188-45f1-8d07-4759a6eecb53 service neutron] Validating token access rules against request {{(pid=82026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 20:05:17.113902 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9224278f-cf05-4fa3-b781-7ac2796f4f80 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57539b6a6f3b4d589f5f5e1d211cd6a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b454f707d20347ada3d82aa85495635e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 20:05:17.114534 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9224278f-cf05-4fa3-b781-7ac2796f4f80 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:05:17.114818 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9224278f-cf05-4fa3-b781-7ac2796f4f80 admin admin] SCRIPT_NAME: `/identity` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:05:17.115129 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9224278f-cf05-4fa3-b781-7ac2796f4f80 admin admin] PATH_INFO: `/v3/projects/f9f0530566f84755bee31b7df800846a` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:05:17.116267 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9224278f-cf05-4fa3-b781-7ac2796f4f80 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f9f0530566f84755bee31b7df800846a)` {{(pid=82026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 20:05:17.118195 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9224278f-cf05-4fa3-b781-7ac2796f4f80 admin admin] RBAC: Authorization granted {{(pid=82026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 20:05:17.261747 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.notifications [None req-9224278f-cf05-4fa3-b781-7ac2796f4f80 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f9f0530566f84755bee31b7df800846a', 'request_id': 'req-9224278f-cf05-4fa3-b781-7ac2796f4f80'} {{(pid=82026) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 20:05:17.397135 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.notifications [None req-9224278f-cf05-4fa3-b781-7ac2796f4f80 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f9f0530566f84755bee31b7df800846a', 'request_id': 'req-9224278f-cf05-4fa3-b781-7ac2796f4f80'} {{(pid=82026) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 20:05:17.404319 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.notifications [None req-9224278f-cf05-4fa3-b781-7ac2796f4f80 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f9f0530566f84755bee31b7df800846a', 'request_id': 'req-9224278f-cf05-4fa3-b781-7ac2796f4f80'} {{(pid=82026) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 20:05:17.416370 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.notifications [None req-9224278f-cf05-4fa3-b781-7ac2796f4f80 admin admin] The token cache is being invalidate because project f9f0530566f84755bee31b7df800846a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82026) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 13 20:05:17.416668 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.notifications [None req-9224278f-cf05-4fa3-b781-7ac2796f4f80 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82026) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 20:05:17.417315 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.notifications [None req-9224278f-cf05-4fa3-b781-7ac2796f4f80 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82026) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 20:05:17.418808 dv-cinder-828806-6-smb devstack@keystone.service[82026]: [pid: 82026|app: 0|req: 1224/2503] 10.222.0.33 () {58 vars in 1233 bytes} [Tue Sep 13 20:05:17 2022] DELETE /identity/v3/projects/f9f0530566f84755bee31b7df800846a => generated 0 bytes in 379 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 20:05:17.423855 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c6ef64c-f0e6-4663-9038-a32107795714 None None] REQUEST_METHOD: `POST` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:05:17.424330 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c6ef64c-f0e6-4663-9038-a32107795714 None None] SCRIPT_NAME: `/identity` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:05:17.424430 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c6ef64c-f0e6-4663-9038-a32107795714 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:05:17.447784 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.auth.core [None req-1c6ef64c-f0e6-4663-9038-a32107795714 None None] MFA Rules not processed for user `57539b6a6f3b4d589f5f5e1d211cd6a0`. Rule list: `[]` (Enabled: `True`). {{(pid=82025) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 20:05:17.449019 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.fernet_utils [None req-1c6ef64c-f0e6-4663-9038-a32107795714 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82025) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 20:05:17.515526 dv-cinder-828806-6-smb devstack@keystone.service[82025]: [pid: 82025|app: 0|req: 1280/2504] 10.222.0.33 () {58 vars in 958 bytes} [Tue Sep 13 20:05:17 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 20:05:17.523540 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f271711e-960c-498f-8120-55d7acbeb37c None None] REQUEST_METHOD: `POST` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:05:17.523860 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f271711e-960c-498f-8120-55d7acbeb37c None None] SCRIPT_NAME: `/identity` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:05:17.524600 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f271711e-960c-498f-8120-55d7acbeb37c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:05:17.546577 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.auth.core [None req-f271711e-960c-498f-8120-55d7acbeb37c None None] MFA Rules not processed for user `57539b6a6f3b4d589f5f5e1d211cd6a0`. Rule list: `[]` (Enabled: `True`). {{(pid=82026) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 20:05:17.547823 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.common.fernet_utils [None req-f271711e-960c-498f-8120-55d7acbeb37c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82026) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 20:05:17.557260 dv-cinder-828806-6-smb devstack@keystone.service[82026]: [pid: 82026|app: 0|req: 1225/2505] 10.222.0.33 () {58 vars in 958 bytes} [Tue Sep 13 20:05:17 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 20:05:17.561625 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c6ef64c-f0e6-4663-9038-a32107795714 None None] Authenticating user token {{(pid=82025) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 20:05:17.572764 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c6ef64c-f0e6-4663-9038-a32107795714 None None] Validating token access rules against request {{(pid=82025) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 20:05:17.578321 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d44a84b-2d88-435f-83ff-05806b98aed2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57539b6a6f3b4d589f5f5e1d211cd6a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b454f707d20347ada3d82aa85495635e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82025) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 20:05:17.578933 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d44a84b-2d88-435f-83ff-05806b98aed2 admin admin] REQUEST_METHOD: `GET` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:05:17.579244 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d44a84b-2d88-435f-83ff-05806b98aed2 admin admin] SCRIPT_NAME: `/identity` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:05:17.579520 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d44a84b-2d88-435f-83ff-05806b98aed2 admin admin] PATH_INFO: `/v3/domains` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:05:17.580167 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d44a84b-2d88-435f-83ff-05806b98aed2 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82025) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 20:05:17.580474 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d44a84b-2d88-435f-83ff-05806b98aed2 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 20:05:17.582054 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d44a84b-2d88-435f-83ff-05806b98aed2 admin admin] RBAC: Authorization granted {{(pid=82025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 20:05:17.595439 dv-cinder-828806-6-smb devstack@keystone.service[82025]: [pid: 82025|app: 0|req: 1281/2506] 10.222.0.33 () {58 vars in 1153 bytes} [Tue Sep 13 20:05:17 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 20:05:17.599856 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f271711e-960c-498f-8120-55d7acbeb37c None None] Authenticating user token {{(pid=82026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 20:05:17.609143 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f271711e-960c-498f-8120-55d7acbeb37c None None] Validating token access rules against request {{(pid=82026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 20:05:17.613806 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01ab5109-3add-4d9c-a10e-0bfbcaef584f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57539b6a6f3b4d589f5f5e1d211cd6a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b454f707d20347ada3d82aa85495635e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 20:05:17.616724 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01ab5109-3add-4d9c-a10e-0bfbcaef584f admin admin] REQUEST_METHOD: `POST` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:05:17.616724 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01ab5109-3add-4d9c-a10e-0bfbcaef584f admin admin] SCRIPT_NAME: `/identity` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:05:17.616724 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01ab5109-3add-4d9c-a10e-0bfbcaef584f admin admin] PATH_INFO: `/v3/projects` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:05:17.616724 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01ab5109-3add-4d9c-a10e-0bfbcaef584f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 20:05:17.617628 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01ab5109-3add-4d9c-a10e-0bfbcaef584f admin admin] RBAC: Authorization granted {{(pid=82026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 20:05:17.703655 dv-cinder-828806-6-smb devstack@keystone.service[82026]: [pid: 82026|app: 0|req: 1226/2507] 10.222.0.33 () {60 vars in 1153 bytes} [Tue Sep 13 20:05:17 2022] POST /identity/v3/projects => generated 371 bytes in 104 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 13 20:05:17.708340 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d44a84b-2d88-435f-83ff-05806b98aed2 admin admin] Authenticating user token {{(pid=82025) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 20:05:17.718463 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d44a84b-2d88-435f-83ff-05806b98aed2 admin admin] Validating token access rules against request {{(pid=82025) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 20:05:17.775072 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e043340-c2dd-43bb-81eb-d54e55dbdf62 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57539b6a6f3b4d589f5f5e1d211cd6a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b454f707d20347ada3d82aa85495635e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82025) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 20:05:17.778403 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e043340-c2dd-43bb-81eb-d54e55dbdf62 admin admin] REQUEST_METHOD: `POST` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:05:17.778952 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e043340-c2dd-43bb-81eb-d54e55dbdf62 admin admin] SCRIPT_NAME: `/identity` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:05:17.779754 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e043340-c2dd-43bb-81eb-d54e55dbdf62 admin admin] PATH_INFO: `/v3/users` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:05:17.780753 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e043340-c2dd-43bb-81eb-d54e55dbdf62 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 20:05:17.782992 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e043340-c2dd-43bb-81eb-d54e55dbdf62 admin admin] RBAC: Authorization granted {{(pid=82025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 20:05:17.863456 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01ab5109-3add-4d9c-a10e-0bfbcaef584f admin admin] Authenticating user token {{(pid=82026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 20:05:17.865259 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.common.fernet_utils [None req-01ab5109-3add-4d9c-a10e-0bfbcaef584f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82026) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 20:05:17.866338 dv-cinder-828806-6-smb devstack@keystone.service[82025]: [pid: 82025|app: 0|req: 1282/2508] 10.222.0.33 () {60 vars in 1144 bytes} [Tue Sep 13 20:05:17 2022] POST /identity/v3/users => generated 286 bytes in 158 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 13 20:05:17.871377 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e043340-c2dd-43bb-81eb-d54e55dbdf62 admin admin] Authenticating user token {{(pid=82025) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 20:05:17.881478 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e043340-c2dd-43bb-81eb-d54e55dbdf62 admin admin] Validating token access rules against request {{(pid=82025) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 20:05:17.887680 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec5315a3-64f4-47dd-871b-3250379769f5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57539b6a6f3b4d589f5f5e1d211cd6a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b454f707d20347ada3d82aa85495635e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82025) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 20:05:17.888311 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec5315a3-64f4-47dd-871b-3250379769f5 admin admin] REQUEST_METHOD: `GET` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:05:17.888595 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec5315a3-64f4-47dd-871b-3250379769f5 admin admin] SCRIPT_NAME: `/identity` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:05:17.888881 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec5315a3-64f4-47dd-871b-3250379769f5 admin admin] PATH_INFO: `/v3/roles` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:05:17.889540 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec5315a3-64f4-47dd-871b-3250379769f5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 20:05:17.891999 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec5315a3-64f4-47dd-871b-3250379769f5 admin admin] RBAC: Authorization granted {{(pid=82025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 20:05:17.906730 dv-cinder-828806-6-smb devstack@keystone.service[82025]: [pid: 82025|app: 0|req: 1283/2509] 10.222.0.33 () {58 vars in 1122 bytes} [Tue Sep 13 20:05:17 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 13 20:05:17.913681 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec5315a3-64f4-47dd-871b-3250379769f5 admin admin] Authenticating user token {{(pid=82025) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 20:05:17.923825 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec5315a3-64f4-47dd-871b-3250379769f5 admin admin] Validating token access rules against request {{(pid=82025) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 20:05:17.928570 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f48b289-057a-4300-9c4f-7ffe7b7dbb06 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57539b6a6f3b4d589f5f5e1d211cd6a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b454f707d20347ada3d82aa85495635e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82025) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 20:05:17.929172 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f48b289-057a-4300-9c4f-7ffe7b7dbb06 admin admin] REQUEST_METHOD: `GET` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:05:17.929457 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f48b289-057a-4300-9c4f-7ffe7b7dbb06 admin admin] SCRIPT_NAME: `/identity` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:05:17.929746 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f48b289-057a-4300-9c4f-7ffe7b7dbb06 admin admin] PATH_INFO: `/v3/roles` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:05:17.930093 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01ab5109-3add-4d9c-a10e-0bfbcaef584f admin admin] Validating token access rules against request {{(pid=82026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 20:05:17.930391 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f48b289-057a-4300-9c4f-7ffe7b7dbb06 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 20:05:17.932513 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f48b289-057a-4300-9c4f-7ffe7b7dbb06 admin admin] RBAC: Authorization granted {{(pid=82025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 20:05:17.934717 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02a5fecc-7fc2-4a72-b8a6-ce54149f1904 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '023a2c79c2444611b3d431928e56685d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8c6fba0f15b4d6a84ff601919b7b8e4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 20:05:17.935445 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02a5fecc-7fc2-4a72-b8a6-ce54149f1904 service neutron] REQUEST_METHOD: `GET` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:05:17.935799 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02a5fecc-7fc2-4a72-b8a6-ce54149f1904 service neutron] SCRIPT_NAME: `/identity` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:05:17.936143 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02a5fecc-7fc2-4a72-b8a6-ce54149f1904 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:05:17.938048 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.common.fernet_utils [None req-02a5fecc-7fc2-4a72-b8a6-ce54149f1904 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82026) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 20:05:17.942599 dv-cinder-828806-6-smb devstack@keystone.service[82025]: [pid: 82025|app: 0|req: 1284/2510] 10.222.0.33 () {58 vars in 1122 bytes} [Tue Sep 13 20:05:17 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 13 20:05:17.953777 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f48b289-057a-4300-9c4f-7ffe7b7dbb06 admin admin] Authenticating user token {{(pid=82025) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 20:05:17.964072 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f48b289-057a-4300-9c4f-7ffe7b7dbb06 admin admin] Validating token access rules against request {{(pid=82025) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 20:05:17.973968 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6480a16-53d5-4498-9482-6694f9fe360b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57539b6a6f3b4d589f5f5e1d211cd6a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b454f707d20347ada3d82aa85495635e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82025) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 20:05:17.974816 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6480a16-53d5-4498-9482-6694f9fe360b admin admin] REQUEST_METHOD: `PUT` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:05:17.975133 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6480a16-53d5-4498-9482-6694f9fe360b admin admin] SCRIPT_NAME: `/identity` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:05:17.975413 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6480a16-53d5-4498-9482-6694f9fe360b admin admin] PATH_INFO: `/v3/projects/d7bb769ba18b46779c79b75a3c150bf0/users/aaa8ec56b48a4356bbc8834b92256e24/roles/3618ab638a65401f82333da7596d1daf` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:05:17.990610 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6480a16-53d5-4498-9482-6694f9fe360b admin admin] RBAC: Authorizing `identity:create_grant(project_id=d7bb769ba18b46779c79b75a3c150bf0, user_id=aaa8ec56b48a4356bbc8834b92256e24, role_id=3618ab638a65401f82333da7596d1daf)` {{(pid=82025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 20:05:17.994060 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6480a16-53d5-4498-9482-6694f9fe360b admin admin] RBAC: Authorization granted {{(pid=82025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 20:05:18.014922 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02a5fecc-7fc2-4a72-b8a6-ce54149f1904 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 20:05:18.016449 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02a5fecc-7fc2-4a72-b8a6-ce54149f1904 service neutron] RBAC: Authorization granted {{(pid=82026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 20:05:18.028337 dv-cinder-828806-6-smb devstack@keystone.service[82026]: [pid: 82026|app: 0|req: 1227/2511] 10.222.0.33 () {60 vars in 1365 bytes} [Tue Sep 13 20:05:17 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 165 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 13 20:05:18.125033 dv-cinder-828806-6-smb devstack@keystone.service[82025]: [pid: 82025|app: 0|req: 1285/2512] 10.222.0.33 () {60 vars in 1483 bytes} [Tue Sep 13 20:05:17 2022] PUT /identity/v3/projects/d7bb769ba18b46779c79b75a3c150bf0/users/aaa8ec56b48a4356bbc8834b92256e24/roles/3618ab638a65401f82333da7596d1daf => generated 0 bytes in 172 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 13 20:05:18.130191 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abb8bdf6-5b14-47cf-864b-b92a3a8ad2e5 None None] REQUEST_METHOD: `POST` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:05:18.130681 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abb8bdf6-5b14-47cf-864b-b92a3a8ad2e5 None None] SCRIPT_NAME: `/identity` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:05:18.130797 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abb8bdf6-5b14-47cf-864b-b92a3a8ad2e5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:05:18.153062 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.auth.core [None req-abb8bdf6-5b14-47cf-864b-b92a3a8ad2e5 None None] MFA Rules not processed for user `57539b6a6f3b4d589f5f5e1d211cd6a0`. Rule list: `[]` (Enabled: `True`). {{(pid=82026) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 20:05:18.154311 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.common.fernet_utils [None req-abb8bdf6-5b14-47cf-864b-b92a3a8ad2e5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82026) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 20:05:18.220926 dv-cinder-828806-6-smb devstack@keystone.service[82026]: [pid: 82026|app: 0|req: 1228/2513] 10.222.0.33 () {58 vars in 958 bytes} [Tue Sep 13 20:05:18 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 20:05:18.232005 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6480a16-53d5-4498-9482-6694f9fe360b admin admin] Authenticating user token {{(pid=82025) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 20:05:18.233851 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.fernet_utils [None req-f6480a16-53d5-4498-9482-6694f9fe360b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82025) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 20:05:18.243203 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG dbcounter [-] [82025] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82025) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 20:05:18.296303 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6480a16-53d5-4498-9482-6694f9fe360b admin admin] Validating token access rules against request {{(pid=82025) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 20:05:18.300042 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d269edfe-c9bc-4629-adc8-bb8f3f142920 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '023a2c79c2444611b3d431928e56685d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8c6fba0f15b4d6a84ff601919b7b8e4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82025) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 20:05:18.305697 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d269edfe-c9bc-4629-adc8-bb8f3f142920 service neutron] REQUEST_METHOD: `GET` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:05:18.305697 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d269edfe-c9bc-4629-adc8-bb8f3f142920 service neutron] SCRIPT_NAME: `/identity` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:05:18.305697 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d269edfe-c9bc-4629-adc8-bb8f3f142920 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:05:18.310517 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d269edfe-c9bc-4629-adc8-bb8f3f142920 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 20:05:18.311977 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d269edfe-c9bc-4629-adc8-bb8f3f142920 service neutron] RBAC: Authorization granted {{(pid=82025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 20:05:18.322531 dv-cinder-828806-6-smb devstack@keystone.service[82025]: [pid: 82025|app: 0|req: 1286/2514] 10.222.0.33 () {60 vars in 1365 bytes} [Tue Sep 13 20:05:18 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 20:05:18.331078 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG dbcounter [-] [82026] Writing DB stats keystone:SELECT=94,keystone:DELETE=5,keystone:INSERT=1 {{(pid=82026) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 20:05:21.134903 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG dbcounter [-] [82026] Writing DB stats keystone:SELECT=97,keystone:DELETE=2,keystone:INSERT=1 {{(pid=82026) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 20:05:25.524140 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35c0d08a-267a-4742-9693-4ff828517985 None None] REQUEST_METHOD: `POST` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:05:25.524766 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35c0d08a-267a-4742-9693-4ff828517985 None None] SCRIPT_NAME: `/identity` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:05:25.524766 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35c0d08a-267a-4742-9693-4ff828517985 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:05:25.559683 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.auth.core [None req-35c0d08a-267a-4742-9693-4ff828517985 None None] MFA Rules not processed for user `aaa8ec56b48a4356bbc8834b92256e24`. Rule list: `[]` (Enabled: `True`). {{(pid=82026) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 20:05:25.561750 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.common.fernet_utils [None req-35c0d08a-267a-4742-9693-4ff828517985 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82026) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 20:05:25.679240 dv-cinder-828806-6-smb devstack@keystone.service[82026]: [pid: 82026|app: 0|req: 1229/2515] 10.222.0.33 () {58 vars in 958 bytes} [Tue Sep 13 20:05:25 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 157 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 20:05:25.681662 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d269edfe-c9bc-4629-adc8-bb8f3f142920 service neutron] Authenticating user token {{(pid=82025) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 20:05:25.696502 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d269edfe-c9bc-4629-adc8-bb8f3f142920 service neutron] Validating token access rules against request {{(pid=82025) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 20:05:25.702322 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2606cb87-28f2-4c67-8abe-4279c477ab5d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57539b6a6f3b4d589f5f5e1d211cd6a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b454f707d20347ada3d82aa85495635e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82025) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 20:05:25.703142 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2606cb87-28f2-4c67-8abe-4279c477ab5d admin admin] REQUEST_METHOD: `POST` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:05:25.703422 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2606cb87-28f2-4c67-8abe-4279c477ab5d admin admin] SCRIPT_NAME: `/identity` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:05:25.703781 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2606cb87-28f2-4c67-8abe-4279c477ab5d admin admin] PATH_INFO: `/v3/projects` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:05:25.704814 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2606cb87-28f2-4c67-8abe-4279c477ab5d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 20:05:25.707676 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2606cb87-28f2-4c67-8abe-4279c477ab5d admin admin] RBAC: Authorization granted {{(pid=82025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 20:05:25.860015 dv-cinder-828806-6-smb devstack@keystone.service[82025]: [pid: 82025|app: 0|req: 1287/2516] 10.222.0.33 () {60 vars in 1153 bytes} [Tue Sep 13 20:05:25 2022] POST /identity/v3/projects => generated 371 bytes in 179 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 13 20:05:25.864178 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35c0d08a-267a-4742-9693-4ff828517985 None None] Authenticating user token {{(pid=82026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 20:05:25.879295 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35c0d08a-267a-4742-9693-4ff828517985 None None] Validating token access rules against request {{(pid=82026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 20:05:25.971882 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f3630fa-fb21-4dae-a908-6a1671cb87c8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57539b6a6f3b4d589f5f5e1d211cd6a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b454f707d20347ada3d82aa85495635e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 20:05:25.972823 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f3630fa-fb21-4dae-a908-6a1671cb87c8 admin admin] REQUEST_METHOD: `POST` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:05:25.973187 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f3630fa-fb21-4dae-a908-6a1671cb87c8 admin admin] SCRIPT_NAME: `/identity` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:05:25.973503 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f3630fa-fb21-4dae-a908-6a1671cb87c8 admin admin] PATH_INFO: `/v3/users` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:05:25.974352 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f3630fa-fb21-4dae-a908-6a1671cb87c8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 20:05:25.977485 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f3630fa-fb21-4dae-a908-6a1671cb87c8 admin admin] RBAC: Authorization granted {{(pid=82026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 20:05:26.151372 dv-cinder-828806-6-smb devstack@keystone.service[82026]: [pid: 82026|app: 0|req: 1230/2517] 10.222.0.33 () {60 vars in 1144 bytes} [Tue Sep 13 20:05:25 2022] POST /identity/v3/users => generated 292 bytes in 288 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 13 20:05:26.158027 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2606cb87-28f2-4c67-8abe-4279c477ab5d admin admin] Authenticating user token {{(pid=82025) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 20:05:26.172467 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2606cb87-28f2-4c67-8abe-4279c477ab5d admin admin] Validating token access rules against request {{(pid=82025) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 20:05:26.178282 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3858a6c-10db-4bf2-97ac-22078b7c0492 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57539b6a6f3b4d589f5f5e1d211cd6a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b454f707d20347ada3d82aa85495635e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82025) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 20:05:26.178907 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3858a6c-10db-4bf2-97ac-22078b7c0492 admin admin] REQUEST_METHOD: `GET` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:05:26.179245 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3858a6c-10db-4bf2-97ac-22078b7c0492 admin admin] SCRIPT_NAME: `/identity` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:05:26.179520 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3858a6c-10db-4bf2-97ac-22078b7c0492 admin admin] PATH_INFO: `/v3/roles` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:05:26.180204 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3858a6c-10db-4bf2-97ac-22078b7c0492 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 20:05:26.181935 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3858a6c-10db-4bf2-97ac-22078b7c0492 admin admin] RBAC: Authorization granted {{(pid=82025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 20:05:26.196834 dv-cinder-828806-6-smb devstack@keystone.service[82025]: [pid: 82025|app: 0|req: 1288/2518] 10.222.0.33 () {58 vars in 1122 bytes} [Tue Sep 13 20:05:26 2022] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 13 20:05:26.201508 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f3630fa-fb21-4dae-a908-6a1671cb87c8 admin admin] Authenticating user token {{(pid=82026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 20:05:26.213801 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f3630fa-fb21-4dae-a908-6a1671cb87c8 admin admin] Validating token access rules against request {{(pid=82026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 20:05:26.218798 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9553d737-7afa-4f12-8e53-1705738c909e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57539b6a6f3b4d589f5f5e1d211cd6a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b454f707d20347ada3d82aa85495635e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 20:05:26.219506 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9553d737-7afa-4f12-8e53-1705738c909e admin admin] REQUEST_METHOD: `PUT` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:05:26.219802 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9553d737-7afa-4f12-8e53-1705738c909e admin admin] SCRIPT_NAME: `/identity` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:05:26.220085 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9553d737-7afa-4f12-8e53-1705738c909e admin admin] PATH_INFO: `/v3/projects/7ad1d897260e405a9635348a0efdd784/users/4f06afc3f96b41cf86f6feed34d9a9b0/roles/e5af7d5baa93469e9e486ef21c85474e` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:05:26.239225 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9553d737-7afa-4f12-8e53-1705738c909e admin admin] RBAC: Authorizing `identity:create_grant(project_id=7ad1d897260e405a9635348a0efdd784, user_id=4f06afc3f96b41cf86f6feed34d9a9b0, role_id=e5af7d5baa93469e9e486ef21c85474e)` {{(pid=82026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 20:05:26.242013 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9553d737-7afa-4f12-8e53-1705738c909e admin admin] RBAC: Authorization granted {{(pid=82026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 20:05:26.358038 dv-cinder-828806-6-smb devstack@keystone.service[82026]: [pid: 82026|app: 0|req: 1231/2519] 10.222.0.33 () {60 vars in 1483 bytes} [Tue Sep 13 20:05:26 2022] PUT /identity/v3/projects/7ad1d897260e405a9635348a0efdd784/users/4f06afc3f96b41cf86f6feed34d9a9b0/roles/e5af7d5baa93469e9e486ef21c85474e => generated 0 bytes in 157 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 13 20:05:26.362113 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3858a6c-10db-4bf2-97ac-22078b7c0492 admin admin] Authenticating user token {{(pid=82025) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 20:05:26.375626 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3858a6c-10db-4bf2-97ac-22078b7c0492 admin admin] Validating token access rules against request {{(pid=82025) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 20:05:26.427898 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG dbcounter [-] [82025] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=82025) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 20:05:26.451221 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8230931-46cb-497f-adb6-52a78903e9a2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57539b6a6f3b4d589f5f5e1d211cd6a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b454f707d20347ada3d82aa85495635e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82025) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 20:05:26.451857 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8230931-46cb-497f-adb6-52a78903e9a2 admin admin] REQUEST_METHOD: `GET` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:05:26.452150 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8230931-46cb-497f-adb6-52a78903e9a2 admin admin] SCRIPT_NAME: `/identity` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:05:26.452434 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8230931-46cb-497f-adb6-52a78903e9a2 admin admin] PATH_INFO: `/v3/roles` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:05:26.453095 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8230931-46cb-497f-adb6-52a78903e9a2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 20:05:26.454723 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8230931-46cb-497f-adb6-52a78903e9a2 admin admin] RBAC: Authorization granted {{(pid=82025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 20:05:26.469465 dv-cinder-828806-6-smb devstack@keystone.service[82025]: [pid: 82025|app: 0|req: 1289/2520] 10.222.0.33 () {58 vars in 1122 bytes} [Tue Sep 13 20:05:26 2022] GET /identity/v3/roles => generated 1420 bytes in 105 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 13 20:05:26.470975 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9553d737-7afa-4f12-8e53-1705738c909e admin admin] Authenticating user token {{(pid=82026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 20:05:26.484384 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9553d737-7afa-4f12-8e53-1705738c909e admin admin] Validating token access rules against request {{(pid=82026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 20:05:26.489728 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f751b8d-abb0-4784-993a-1114440217d7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57539b6a6f3b4d589f5f5e1d211cd6a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b454f707d20347ada3d82aa85495635e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 20:05:26.490556 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f751b8d-abb0-4784-993a-1114440217d7 admin admin] REQUEST_METHOD: `PUT` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:05:26.490849 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f751b8d-abb0-4784-993a-1114440217d7 admin admin] SCRIPT_NAME: `/identity` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:05:26.491171 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f751b8d-abb0-4784-993a-1114440217d7 admin admin] PATH_INFO: `/v3/projects/7ad1d897260e405a9635348a0efdd784/users/4f06afc3f96b41cf86f6feed34d9a9b0/roles/e5af7d5baa93469e9e486ef21c85474e` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:05:26.493938 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f751b8d-abb0-4784-993a-1114440217d7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7ad1d897260e405a9635348a0efdd784, user_id=4f06afc3f96b41cf86f6feed34d9a9b0, role_id=e5af7d5baa93469e9e486ef21c85474e)` {{(pid=82026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 20:05:26.496682 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f751b8d-abb0-4784-993a-1114440217d7 admin admin] RBAC: Authorization granted {{(pid=82026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 20:05:26.510805 dv-cinder-828806-6-smb devstack@keystone.service[82026]: [pid: 82026|app: 0|req: 1232/2521] 10.222.0.33 () {60 vars in 1483 bytes} [Tue Sep 13 20:05:26 2022] PUT /identity/v3/projects/7ad1d897260e405a9635348a0efdd784/users/4f06afc3f96b41cf86f6feed34d9a9b0/roles/e5af7d5baa93469e9e486ef21c85474e => generated 0 bytes in 41 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 20:05:32.480268 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ab784b0-8d87-4f77-b639-e3f2fec0dc22 None None] REQUEST_METHOD: `POST` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:05:32.480779 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ab784b0-8d87-4f77-b639-e3f2fec0dc22 None None] SCRIPT_NAME: `/identity` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:05:32.480874 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ab784b0-8d87-4f77-b639-e3f2fec0dc22 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:05:32.516733 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.auth.core [None req-6ab784b0-8d87-4f77-b639-e3f2fec0dc22 None None] MFA Rules not processed for user `4f06afc3f96b41cf86f6feed34d9a9b0`. Rule list: `[]` (Enabled: `True`). {{(pid=82025) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 20:05:32.517974 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.fernet_utils [None req-6ab784b0-8d87-4f77-b639-e3f2fec0dc22 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82025) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 20:05:32.595467 dv-cinder-828806-6-smb devstack@keystone.service[82025]: [pid: 82025|app: 0|req: 1290/2522] 10.222.0.33 () {58 vars in 958 bytes} [Tue Sep 13 20:05:32 2022] POST /identity/v3/auth/tokens => generated 3315 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 20:05:32.611393 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f751b8d-abb0-4784-993a-1114440217d7 admin admin] Authenticating user token {{(pid=82026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 20:05:32.613101 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.common.fernet_utils [None req-0f751b8d-abb0-4784-993a-1114440217d7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82026) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 20:05:32.683517 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG dbcounter [-] [82026] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=82026) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 20:05:32.719280 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f751b8d-abb0-4784-993a-1114440217d7 admin admin] Validating token access rules against request {{(pid=82026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 20:05:32.728275 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c91fbce-eb79-40a4-9061-1a235b859dda service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e66e7034abed4e0bad1f4137520c1e70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8c6fba0f15b4d6a84ff601919b7b8e4', 'project_domain_id': 'default', 'roles': ['service', 'member', 'reader', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 20:05:32.729038 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c91fbce-eb79-40a4-9061-1a235b859dda service nova] REQUEST_METHOD: `GET` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:05:32.729394 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c91fbce-eb79-40a4-9061-1a235b859dda service nova] SCRIPT_NAME: `/identity` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:05:32.729742 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c91fbce-eb79-40a4-9061-1a235b859dda service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:05:32.793940 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c91fbce-eb79-40a4-9061-1a235b859dda service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 20:05:32.795612 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c91fbce-eb79-40a4-9061-1a235b859dda service nova] RBAC: Authorization granted {{(pid=82026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 20:05:32.806069 dv-cinder-828806-6-smb devstack@keystone.service[82026]: [pid: 82026|app: 0|req: 1233/2523] 10.222.0.33 () {60 vars in 1365 bytes} [Tue Sep 13 20:05:32 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 195 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 20:05:36.901484 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57174f15-b1d2-4d2f-abce-82acb5ee41e1 None None] REQUEST_METHOD: `POST` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:05:36.902008 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57174f15-b1d2-4d2f-abce-82acb5ee41e1 None None] SCRIPT_NAME: `/identity` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:05:36.902140 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57174f15-b1d2-4d2f-abce-82acb5ee41e1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:05:36.922509 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.auth.core [None req-57174f15-b1d2-4d2f-abce-82acb5ee41e1 None None] MFA Rules not processed for user `aaa8ec56b48a4356bbc8834b92256e24`. Rule list: `[]` (Enabled: `True`). {{(pid=82025) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 20:05:36.923745 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.fernet_utils [None req-57174f15-b1d2-4d2f-abce-82acb5ee41e1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82025) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 20:05:36.931353 dv-cinder-828806-6-smb devstack@keystone.service[82025]: [pid: 82025|app: 0|req: 1291/2524] 10.222.0.33 () {58 vars in 958 bytes} [Tue Sep 13 20:05:36 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 20:05:42.848525 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG dbcounter [-] [82026] Writing DB stats keystone:SELECT=39 {{(pid=82026) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 20:05:42.856824 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c91fbce-eb79-40a4-9061-1a235b859dda service nova] Authenticating user token {{(pid=82026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 20:05:42.858276 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.common.fernet_utils [None req-9c91fbce-eb79-40a4-9061-1a235b859dda service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82026) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 20:05:42.873611 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c91fbce-eb79-40a4-9061-1a235b859dda service nova] Validating token access rules against request {{(pid=82026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 20:05:42.879545 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-093864fe-2942-4d06-8957-b7e339472a2b service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e66e7034abed4e0bad1f4137520c1e70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8c6fba0f15b4d6a84ff601919b7b8e4', 'project_domain_id': 'default', 'roles': ['service', 'member', 'reader', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 20:05:42.894179 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-093864fe-2942-4d06-8957-b7e339472a2b service nova] REQUEST_METHOD: `GET` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:05:42.894179 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-093864fe-2942-4d06-8957-b7e339472a2b service nova] SCRIPT_NAME: `/identity` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:05:42.894179 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-093864fe-2942-4d06-8957-b7e339472a2b service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:05:42.894179 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.common.fernet_utils [None req-093864fe-2942-4d06-8957-b7e339472a2b service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82026) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 20:05:42.947677 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-093864fe-2942-4d06-8957-b7e339472a2b service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 20:05:42.949304 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-093864fe-2942-4d06-8957-b7e339472a2b service nova] RBAC: Authorization granted {{(pid=82026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 20:05:42.958721 dv-cinder-828806-6-smb devstack@keystone.service[82026]: [pid: 82026|app: 0|req: 1234/2525] 10.222.0.33 () {60 vars in 1365 bytes} [Tue Sep 13 20:05:42 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 102 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 20:05:46.915895 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG dbcounter [-] [82025] Writing DB stats keystone:SELECT=47 {{(pid=82025) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 20:05:52.959965 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG dbcounter [-] [82026] Writing DB stats keystone:SELECT=28 {{(pid=82026) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 20:05:54.203914 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57174f15-b1d2-4d2f-abce-82acb5ee41e1 None None] Authenticating user token {{(pid=82025) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 20:05:54.256444 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57174f15-b1d2-4d2f-abce-82acb5ee41e1 None None] Validating token access rules against request {{(pid=82025) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 20:05:54.260155 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b161bf4-8988-4b8d-b8a0-c15cbffcc956 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '023a2c79c2444611b3d431928e56685d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8c6fba0f15b4d6a84ff601919b7b8e4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82025) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 20:05:54.260766 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b161bf4-8988-4b8d-b8a0-c15cbffcc956 service neutron] REQUEST_METHOD: `GET` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:05:54.261049 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b161bf4-8988-4b8d-b8a0-c15cbffcc956 service neutron] SCRIPT_NAME: `/identity` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:05:54.261328 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b161bf4-8988-4b8d-b8a0-c15cbffcc956 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:05:54.263164 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.fernet_utils [None req-3b161bf4-8988-4b8d-b8a0-c15cbffcc956 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82025) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 20:05:54.273184 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b161bf4-8988-4b8d-b8a0-c15cbffcc956 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 20:05:54.279893 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b161bf4-8988-4b8d-b8a0-c15cbffcc956 service neutron] RBAC: Authorization granted {{(pid=82025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 20:05:54.284685 dv-cinder-828806-6-smb devstack@keystone.service[82025]: [pid: 82025|app: 0|req: 1292/2526] 10.222.0.33 () {60 vars in 1365 bytes} [Tue Sep 13 20:05:54 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 20:05:55.226052 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20ee81dd-bb0d-45aa-8b16-0afe4ae82ab7 None None] REQUEST_METHOD: `GET` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:05:55.226657 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20ee81dd-bb0d-45aa-8b16-0afe4ae82ab7 None None] SCRIPT_NAME: `/identity` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:05:55.226657 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20ee81dd-bb0d-45aa-8b16-0afe4ae82ab7 None None] PATH_INFO: `/` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:05:55.228044 dv-cinder-828806-6-smb devstack@keystone.service[82026]: [pid: 82026|app: 0|req: 1235/2527] 10.222.0.33 () {54 vars in 961 bytes} [Tue Sep 13 20:05:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 20:05:55.233610 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fae8fcd9-d8c8-4341-9986-4a516c3962e0 None None] REQUEST_METHOD: `POST` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:05:55.234138 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fae8fcd9-d8c8-4341-9986-4a516c3962e0 None None] SCRIPT_NAME: `/identity` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:05:55.234233 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fae8fcd9-d8c8-4341-9986-4a516c3962e0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:05:55.258479 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.auth.core [None req-fae8fcd9-d8c8-4341-9986-4a516c3962e0 None None] MFA Rules not processed for user `060ea3dea2134429967c164bd158b272`. Rule list: `[]` (Enabled: `True`). {{(pid=82025) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 20:05:55.260579 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.fernet_utils [None req-fae8fcd9-d8c8-4341-9986-4a516c3962e0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82025) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 20:05:55.337253 dv-cinder-828806-6-smb devstack@keystone.service[82025]: [pid: 82025|app: 0|req: 1293/2528] 10.222.0.33 () {58 vars in 1058 bytes} [Tue Sep 13 20:05:55 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 13 20:05:55.347271 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20ee81dd-bb0d-45aa-8b16-0afe4ae82ab7 None None] Authenticating user token {{(pid=82026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 20:05:55.361151 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20ee81dd-bb0d-45aa-8b16-0afe4ae82ab7 None None] Validating token access rules against request {{(pid=82026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 20:05:55.366858 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0ccbfd9-2338-4228-9e45-1ede96e2b54f service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '060ea3dea2134429967c164bd158b272', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8c6fba0f15b4d6a84ff601919b7b8e4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 20:05:55.367517 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0ccbfd9-2338-4228-9e45-1ede96e2b54f service placement] REQUEST_METHOD: `GET` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:05:55.367802 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0ccbfd9-2338-4228-9e45-1ede96e2b54f service placement] SCRIPT_NAME: `/identity` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:05:55.368074 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0ccbfd9-2338-4228-9e45-1ede96e2b54f service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:05:55.372943 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.common.fernet_utils [None req-d0ccbfd9-2338-4228-9e45-1ede96e2b54f service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82026) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 20:05:55.386312 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0ccbfd9-2338-4228-9e45-1ede96e2b54f service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=82026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 20:05:55.387952 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0ccbfd9-2338-4228-9e45-1ede96e2b54f service placement] RBAC: Authorization granted {{(pid=82026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 20:05:55.398989 dv-cinder-828806-6-smb devstack@keystone.service[82026]: [pid: 82026|app: 0|req: 1236/2529] 10.222.0.33 () {60 vars in 1365 bytes} [Tue Sep 13 20:05:55 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 52 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 20:06:00.906955 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fae8fcd9-d8c8-4341-9986-4a516c3962e0 None None] Authenticating user token {{(pid=82025) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 20:06:00.918596 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fae8fcd9-d8c8-4341-9986-4a516c3962e0 None None] Validating token access rules against request {{(pid=82025) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 20:06:00.922500 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0836fa5-b320-4b67-b864-85566946d058 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '023a2c79c2444611b3d431928e56685d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8c6fba0f15b4d6a84ff601919b7b8e4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82025) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 20:06:00.923144 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0836fa5-b320-4b67-b864-85566946d058 service neutron] REQUEST_METHOD: `GET` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:06:00.923428 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0836fa5-b320-4b67-b864-85566946d058 service neutron] SCRIPT_NAME: `/identity` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:06:00.923703 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0836fa5-b320-4b67-b864-85566946d058 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:06:00.925490 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.fernet_utils [None req-b0836fa5-b320-4b67-b864-85566946d058 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82025) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 20:06:00.936637 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0836fa5-b320-4b67-b864-85566946d058 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 20:06:00.938098 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0836fa5-b320-4b67-b864-85566946d058 service neutron] RBAC: Authorization granted {{(pid=82025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 20:06:00.948065 dv-cinder-828806-6-smb devstack@keystone.service[82025]: [pid: 82025|app: 0|req: 1294/2530] 10.222.0.33 () {60 vars in 1365 bytes} [Tue Sep 13 20:06:00 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 20:06:01.873586 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0ccbfd9-2338-4228-9e45-1ede96e2b54f service placement] Authenticating user token {{(pid=82026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 20:06:01.888137 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0ccbfd9-2338-4228-9e45-1ede96e2b54f service placement] Validating token access rules against request {{(pid=82026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 20:06:01.900039 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32a8527d-29cc-4379-a76b-8d06a5b0a5a7 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e66e7034abed4e0bad1f4137520c1e70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8c6fba0f15b4d6a84ff601919b7b8e4', 'project_domain_id': 'default', 'roles': ['service', 'member', 'reader', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 20:06:01.904522 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32a8527d-29cc-4379-a76b-8d06a5b0a5a7 service nova] REQUEST_METHOD: `GET` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:06:01.904964 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32a8527d-29cc-4379-a76b-8d06a5b0a5a7 service nova] SCRIPT_NAME: `/identity` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:06:01.905318 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32a8527d-29cc-4379-a76b-8d06a5b0a5a7 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:06:01.907347 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.common.fernet_utils [None req-32a8527d-29cc-4379-a76b-8d06a5b0a5a7 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82026) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 20:06:01.921025 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32a8527d-29cc-4379-a76b-8d06a5b0a5a7 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 20:06:01.922680 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32a8527d-29cc-4379-a76b-8d06a5b0a5a7 service nova] RBAC: Authorization granted {{(pid=82026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 20:06:01.934037 dv-cinder-828806-6-smb devstack@keystone.service[82026]: [pid: 82026|app: 0|req: 1237/2531] 10.222.0.33 () {60 vars in 1365 bytes} [Tue Sep 13 20:06:01 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 61 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 20:06:06.685493 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c62b3049-0c5a-4ef2-9155-e87bae8e8f44 None None] REQUEST_METHOD: `POST` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:06:06.686137 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c62b3049-0c5a-4ef2-9155-e87bae8e8f44 None None] SCRIPT_NAME: `/identity` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:06:06.686303 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c62b3049-0c5a-4ef2-9155-e87bae8e8f44 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:06:06.706163 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.auth.core [None req-c62b3049-0c5a-4ef2-9155-e87bae8e8f44 None None] MFA Rules not processed for user `2f6d7f8d9db24b6fbe6b3e7663b20274`. Rule list: `[]` (Enabled: `True`). {{(pid=82025) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 20:06:06.707435 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.fernet_utils [None req-c62b3049-0c5a-4ef2-9155-e87bae8e8f44 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82025) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 20:06:06.765965 dv-cinder-828806-6-smb devstack@keystone.service[82025]: [pid: 82025|app: 0|req: 1295/2532] 10.222.0.33 () {58 vars in 958 bytes} [Tue Sep 13 20:06:06 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 20:06:07.883366 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32a8527d-29cc-4379-a76b-8d06a5b0a5a7 service nova] Authenticating user token {{(pid=82026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 20:06:07.896726 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32a8527d-29cc-4379-a76b-8d06a5b0a5a7 service nova] Validating token access rules against request {{(pid=82026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 20:06:07.903840 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-972eb3bd-62ec-4b80-b8cc-cd10bb45fbc7 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e66e7034abed4e0bad1f4137520c1e70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8c6fba0f15b4d6a84ff601919b7b8e4', 'project_domain_id': 'default', 'roles': ['service', 'member', 'reader', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 20:06:07.904644 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-972eb3bd-62ec-4b80-b8cc-cd10bb45fbc7 service nova] REQUEST_METHOD: `GET` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:06:07.905086 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-972eb3bd-62ec-4b80-b8cc-cd10bb45fbc7 service nova] SCRIPT_NAME: `/identity` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:06:07.905640 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-972eb3bd-62ec-4b80-b8cc-cd10bb45fbc7 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:06:07.909898 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.common.fernet_utils [None req-972eb3bd-62ec-4b80-b8cc-cd10bb45fbc7 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82026) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 20:06:07.923385 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-972eb3bd-62ec-4b80-b8cc-cd10bb45fbc7 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 20:06:07.925037 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-972eb3bd-62ec-4b80-b8cc-cd10bb45fbc7 service nova] RBAC: Authorization granted {{(pid=82026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 20:06:07.937942 dv-cinder-828806-6-smb devstack@keystone.service[82026]: [pid: 82026|app: 0|req: 1238/2533] 10.222.0.33 () {60 vars in 1365 bytes} [Tue Sep 13 20:06:07 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 55 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 20:06:09.686088 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59a1aa56-d381-4fce-9ccf-c8b5e06d9cb1 None None] REQUEST_METHOD: `POST` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:06:09.686575 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59a1aa56-d381-4fce-9ccf-c8b5e06d9cb1 None None] SCRIPT_NAME: `/identity` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:06:09.686684 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59a1aa56-d381-4fce-9ccf-c8b5e06d9cb1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:06:09.706454 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.auth.core [None req-59a1aa56-d381-4fce-9ccf-c8b5e06d9cb1 None None] MFA Rules not processed for user `a28e738b894442e2bc9880eeb64fc0c8`. Rule list: `[]` (Enabled: `True`). {{(pid=82025) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 20:06:09.707709 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.fernet_utils [None req-59a1aa56-d381-4fce-9ccf-c8b5e06d9cb1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82025) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 20:06:09.734252 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG dbcounter [-] [82025] Writing DB stats keystone:SELECT=100 {{(pid=82025) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 20:06:09.763404 dv-cinder-828806-6-smb devstack@keystone.service[82025]: [pid: 82025|app: 0|req: 1296/2534] 10.222.0.33 () {58 vars in 1009 bytes} [Tue Sep 13 20:06:09 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 20:06:10.060624 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-972eb3bd-62ec-4b80-b8cc-cd10bb45fbc7 service nova] Authenticating user token {{(pid=82026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 20:06:10.063084 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.common.fernet_utils [None req-972eb3bd-62ec-4b80-b8cc-cd10bb45fbc7 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82026) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 20:06:10.277390 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-972eb3bd-62ec-4b80-b8cc-cd10bb45fbc7 service nova] Validating token access rules against request {{(pid=82026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 20:06:10.284334 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-244d9285-74b2-4f57-bf3c-7ecc684be7d5 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa5a83574f7f424c805e130c462d5969', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8c6fba0f15b4d6a84ff601919b7b8e4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 20:06:10.284975 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-244d9285-74b2-4f57-bf3c-7ecc684be7d5 service swift] REQUEST_METHOD: `GET` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:06:10.285261 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-244d9285-74b2-4f57-bf3c-7ecc684be7d5 service swift] SCRIPT_NAME: `/identity` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:06:10.285542 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-244d9285-74b2-4f57-bf3c-7ecc684be7d5 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:06:10.294397 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-244d9285-74b2-4f57-bf3c-7ecc684be7d5 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=82026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 20:06:10.296026 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-244d9285-74b2-4f57-bf3c-7ecc684be7d5 service swift] RBAC: Authorization granted {{(pid=82026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 20:06:10.304706 dv-cinder-828806-6-smb devstack@keystone.service[82026]: [pid: 82026|app: 0|req: 1239/2535] 10.222.0.33 () {60 vars in 1384 bytes} [Tue Sep 13 20:06:10 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 246 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Sep 13 20:06:11.706282 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59a1aa56-d381-4fce-9ccf-c8b5e06d9cb1 None None] Authenticating user token {{(pid=82025) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 20:06:11.718801 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59a1aa56-d381-4fce-9ccf-c8b5e06d9cb1 None None] Validating token access rules against request {{(pid=82025) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 20:06:11.728619 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aad794cd-23b4-43da-b00f-ca649061a831 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '023a2c79c2444611b3d431928e56685d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8c6fba0f15b4d6a84ff601919b7b8e4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82025) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 20:06:11.729691 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aad794cd-23b4-43da-b00f-ca649061a831 service neutron] REQUEST_METHOD: `GET` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:06:11.730239 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aad794cd-23b4-43da-b00f-ca649061a831 service neutron] SCRIPT_NAME: `/identity` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:06:11.730712 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aad794cd-23b4-43da-b00f-ca649061a831 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:06:11.741153 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aad794cd-23b4-43da-b00f-ca649061a831 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 20:06:11.742941 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aad794cd-23b4-43da-b00f-ca649061a831 service neutron] RBAC: Authorization granted {{(pid=82025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 20:06:11.767763 dv-cinder-828806-6-smb devstack@keystone.service[82025]: [pid: 82025|app: 0|req: 1297/2536] 10.222.0.33 () {60 vars in 1365 bytes} [Tue Sep 13 20:06:11 2022] GET /identity/v3/auth/tokens => generated 3315 bytes in 62 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 20:06:16.126115 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-244d9285-74b2-4f57-bf3c-7ecc684be7d5 service swift] Authenticating user token {{(pid=82026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 20:06:16.150231 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-244d9285-74b2-4f57-bf3c-7ecc684be7d5 service swift] Validating token access rules against request {{(pid=82026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 20:06:16.171278 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36242d0a-57da-4a23-84e0-d90328942531 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e66e7034abed4e0bad1f4137520c1e70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8c6fba0f15b4d6a84ff601919b7b8e4', 'project_domain_id': 'default', 'roles': ['service', 'member', 'reader', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 20:06:16.180990 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36242d0a-57da-4a23-84e0-d90328942531 service nova] REQUEST_METHOD: `GET` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:06:16.180990 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36242d0a-57da-4a23-84e0-d90328942531 service nova] SCRIPT_NAME: `/identity` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:06:16.180990 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36242d0a-57da-4a23-84e0-d90328942531 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:06:16.184153 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.common.fernet_utils [None req-36242d0a-57da-4a23-84e0-d90328942531 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82026) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 20:06:16.221429 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36242d0a-57da-4a23-84e0-d90328942531 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 20:06:16.224468 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36242d0a-57da-4a23-84e0-d90328942531 service nova] RBAC: Authorization granted {{(pid=82026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 20:06:16.237731 dv-cinder-828806-6-smb devstack@keystone.service[82026]: [pid: 82026|app: 0|req: 1240/2537] 10.222.0.33 () {60 vars in 1365 bytes} [Tue Sep 13 20:06:16 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 112 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 20:06:18.634383 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aad794cd-23b4-43da-b00f-ca649061a831 service neutron] Authenticating user token {{(pid=82025) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 20:06:18.643445 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aad794cd-23b4-43da-b00f-ca649061a831 service neutron] Validating token access rules against request {{(pid=82025) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 20:06:18.649183 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ff2d124-c924-4c19-b7ec-1f5f3f804011 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '023a2c79c2444611b3d431928e56685d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8c6fba0f15b4d6a84ff601919b7b8e4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82025) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 20:06:18.651319 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ff2d124-c924-4c19-b7ec-1f5f3f804011 service neutron] REQUEST_METHOD: `GET` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:06:18.651610 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ff2d124-c924-4c19-b7ec-1f5f3f804011 service neutron] SCRIPT_NAME: `/identity` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:06:18.653073 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ff2d124-c924-4c19-b7ec-1f5f3f804011 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:06:18.654968 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.fernet_utils [None req-8ff2d124-c924-4c19-b7ec-1f5f3f804011 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82025) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 20:06:18.728017 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ff2d124-c924-4c19-b7ec-1f5f3f804011 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 20:06:18.729391 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ff2d124-c924-4c19-b7ec-1f5f3f804011 service neutron] RBAC: Authorization granted {{(pid=82025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 20:06:18.746058 dv-cinder-828806-6-smb devstack@keystone.service[82025]: [pid: 82025|app: 0|req: 1298/2538] 10.222.0.33 () {60 vars in 1365 bytes} [Tue Sep 13 20:06:18 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 111 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 20:06:24.250899 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36242d0a-57da-4a23-84e0-d90328942531 service nova] Authenticating user token {{(pid=82026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 20:06:24.252363 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.common.fernet_utils [None req-36242d0a-57da-4a23-84e0-d90328942531 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82026) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 20:06:24.261480 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG dbcounter [-] [82026] Writing DB stats keystone:SELECT=57 {{(pid=82026) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 20:06:24.275344 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36242d0a-57da-4a23-84e0-d90328942531 service nova] Validating token access rules against request {{(pid=82026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 20:06:24.275344 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-622fd630-c7b8-4849-bea7-8c80c5a2fda9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57539b6a6f3b4d589f5f5e1d211cd6a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b454f707d20347ada3d82aa85495635e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 20:06:24.275344 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-622fd630-c7b8-4849-bea7-8c80c5a2fda9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:06:24.275344 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-622fd630-c7b8-4849-bea7-8c80c5a2fda9 admin admin] SCRIPT_NAME: `/identity` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:06:24.276491 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-622fd630-c7b8-4849-bea7-8c80c5a2fda9 admin admin] PATH_INFO: `/v3/users/abe7dd30d59f41b19efde48cc035aa4f` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:06:24.276491 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-622fd630-c7b8-4849-bea7-8c80c5a2fda9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=abe7dd30d59f41b19efde48cc035aa4f)` {{(pid=82026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 20:06:24.277573 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-622fd630-c7b8-4849-bea7-8c80c5a2fda9 admin admin] RBAC: Authorization granted {{(pid=82026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 20:06:24.731968 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.notifications [None req-622fd630-c7b8-4849-bea7-8c80c5a2fda9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'abe7dd30d59f41b19efde48cc035aa4f'} {{(pid=82026) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 20:06:24.855733 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.notifications [None req-622fd630-c7b8-4849-bea7-8c80c5a2fda9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'abe7dd30d59f41b19efde48cc035aa4f'} {{(pid=82026) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 20:06:24.870342 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.notifications [None req-622fd630-c7b8-4849-bea7-8c80c5a2fda9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'abe7dd30d59f41b19efde48cc035aa4f'} {{(pid=82026) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 20:06:24.871627 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.notifications [None req-622fd630-c7b8-4849-bea7-8c80c5a2fda9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'abe7dd30d59f41b19efde48cc035aa4f'} {{(pid=82026) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 20:06:24.880851 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.notifications [None req-622fd630-c7b8-4849-bea7-8c80c5a2fda9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'abe7dd30d59f41b19efde48cc035aa4f'} {{(pid=82026) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 20:06:24.887265 dv-cinder-828806-6-smb devstack@keystone.service[82026]: [pid: 82026|app: 0|req: 1241/2539] 10.222.0.33 () {58 vars in 1224 bytes} [Tue Sep 13 20:06:24 2022] DELETE /identity/v3/users/abe7dd30d59f41b19efde48cc035aa4f => generated 0 bytes in 637 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 20:06:25.288616 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ff2d124-c924-4c19-b7ec-1f5f3f804011 service neutron] Authenticating user token {{(pid=82025) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 20:06:25.303177 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ff2d124-c924-4c19-b7ec-1f5f3f804011 service neutron] Validating token access rules against request {{(pid=82025) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 20:06:25.367894 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33b28fc6-7d95-4f69-8079-0022f169dfb5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57539b6a6f3b4d589f5f5e1d211cd6a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b454f707d20347ada3d82aa85495635e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82025) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 20:06:25.368525 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33b28fc6-7d95-4f69-8079-0022f169dfb5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:06:25.368810 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33b28fc6-7d95-4f69-8079-0022f169dfb5 admin admin] SCRIPT_NAME: `/identity` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:06:25.369089 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33b28fc6-7d95-4f69-8079-0022f169dfb5 admin admin] PATH_INFO: `/v3/projects/db8c0b9ac40341f6b40fee93483420f7` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:06:25.370208 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33b28fc6-7d95-4f69-8079-0022f169dfb5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=db8c0b9ac40341f6b40fee93483420f7)` {{(pid=82025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 20:06:25.372199 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33b28fc6-7d95-4f69-8079-0022f169dfb5 admin admin] RBAC: Authorization granted {{(pid=82025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 20:06:25.552800 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.notifications [None req-33b28fc6-7d95-4f69-8079-0022f169dfb5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'db8c0b9ac40341f6b40fee93483420f7', 'request_id': 'req-33b28fc6-7d95-4f69-8079-0022f169dfb5'} {{(pid=82025) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 20:06:25.571342 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.notifications [None req-33b28fc6-7d95-4f69-8079-0022f169dfb5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'db8c0b9ac40341f6b40fee93483420f7', 'request_id': 'req-33b28fc6-7d95-4f69-8079-0022f169dfb5'} {{(pid=82025) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 20:06:25.571342 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG dbcounter [-] [82025] Writing DB stats keystone:SELECT=94,keystone:DELETE=6 {{(pid=82025) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 20:06:25.571342 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.notifications [None req-33b28fc6-7d95-4f69-8079-0022f169dfb5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'db8c0b9ac40341f6b40fee93483420f7', 'request_id': 'req-33b28fc6-7d95-4f69-8079-0022f169dfb5'} {{(pid=82025) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 20:06:25.769323 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.notifications [None req-33b28fc6-7d95-4f69-8079-0022f169dfb5 admin admin] The token cache is being invalidate because project db8c0b9ac40341f6b40fee93483420f7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82025) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 13 20:06:25.769831 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.notifications [None req-33b28fc6-7d95-4f69-8079-0022f169dfb5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82025) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 20:06:25.770554 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.notifications [None req-33b28fc6-7d95-4f69-8079-0022f169dfb5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82025) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 20:06:25.774084 dv-cinder-828806-6-smb devstack@keystone.service[82025]: [pid: 82025|app: 0|req: 1299/2540] 10.222.0.33 () {58 vars in 1233 bytes} [Tue Sep 13 20:06:25 2022] DELETE /identity/v3/projects/db8c0b9ac40341f6b40fee93483420f7 => generated 0 bytes in 486 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 20:06:25.778626 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85d39152-aa89-4aaf-9d42-bb2b3bb01988 None None] REQUEST_METHOD: `POST` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:06:25.779100 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85d39152-aa89-4aaf-9d42-bb2b3bb01988 None None] SCRIPT_NAME: `/identity` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:06:25.779401 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85d39152-aa89-4aaf-9d42-bb2b3bb01988 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:06:25.803957 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.auth.core [None req-85d39152-aa89-4aaf-9d42-bb2b3bb01988 None None] MFA Rules not processed for user `57539b6a6f3b4d589f5f5e1d211cd6a0`. Rule list: `[]` (Enabled: `True`). {{(pid=82026) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 20:06:25.805295 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.common.fernet_utils [None req-85d39152-aa89-4aaf-9d42-bb2b3bb01988 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82026) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 20:06:25.881175 dv-cinder-828806-6-smb devstack@keystone.service[82026]: [pid: 82026|app: 0|req: 1242/2541] 10.222.0.33 () {58 vars in 958 bytes} [Tue Sep 13 20:06:25 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 20:06:25.888381 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7221f21-8220-4cf4-ad41-219f46f82fb7 None None] REQUEST_METHOD: `POST` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:06:25.888708 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7221f21-8220-4cf4-ad41-219f46f82fb7 None None] SCRIPT_NAME: `/identity` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:06:25.888980 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7221f21-8220-4cf4-ad41-219f46f82fb7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:06:25.916940 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.auth.core [None req-f7221f21-8220-4cf4-ad41-219f46f82fb7 None None] MFA Rules not processed for user `57539b6a6f3b4d589f5f5e1d211cd6a0`. Rule list: `[]` (Enabled: `True`). {{(pid=82025) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 20:06:25.918183 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.fernet_utils [None req-f7221f21-8220-4cf4-ad41-219f46f82fb7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82025) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 20:06:25.930531 dv-cinder-828806-6-smb devstack@keystone.service[82025]: [pid: 82025|app: 0|req: 1300/2542] 10.222.0.33 () {58 vars in 958 bytes} [Tue Sep 13 20:06:25 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 43 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 20:06:25.934871 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85d39152-aa89-4aaf-9d42-bb2b3bb01988 None None] Authenticating user token {{(pid=82026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 20:06:25.946648 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85d39152-aa89-4aaf-9d42-bb2b3bb01988 None None] Validating token access rules against request {{(pid=82026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 20:06:25.951309 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57d93c3a-b294-4a0a-9aac-374419bed6f0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57539b6a6f3b4d589f5f5e1d211cd6a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b454f707d20347ada3d82aa85495635e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 20:06:25.951944 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57d93c3a-b294-4a0a-9aac-374419bed6f0 admin admin] REQUEST_METHOD: `GET` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:06:25.952222 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57d93c3a-b294-4a0a-9aac-374419bed6f0 admin admin] SCRIPT_NAME: `/identity` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:06:25.952496 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57d93c3a-b294-4a0a-9aac-374419bed6f0 admin admin] PATH_INFO: `/v3/domains` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:06:25.953164 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57d93c3a-b294-4a0a-9aac-374419bed6f0 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82026) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 20:06:25.953467 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57d93c3a-b294-4a0a-9aac-374419bed6f0 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 20:06:25.955256 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57d93c3a-b294-4a0a-9aac-374419bed6f0 admin admin] RBAC: Authorization granted {{(pid=82026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 20:06:25.967354 dv-cinder-828806-6-smb devstack@keystone.service[82026]: [pid: 82026|app: 0|req: 1243/2543] 10.222.0.33 () {58 vars in 1153 bytes} [Tue Sep 13 20:06:25 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 20:06:25.971759 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7221f21-8220-4cf4-ad41-219f46f82fb7 None None] Authenticating user token {{(pid=82025) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 20:06:25.981935 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7221f21-8220-4cf4-ad41-219f46f82fb7 None None] Validating token access rules against request {{(pid=82025) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 20:06:25.986642 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b451dc17-4af9-4ca1-8d93-cbf1615b185b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57539b6a6f3b4d589f5f5e1d211cd6a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b454f707d20347ada3d82aa85495635e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82025) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 20:06:25.987298 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b451dc17-4af9-4ca1-8d93-cbf1615b185b admin admin] REQUEST_METHOD: `POST` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:06:25.987584 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b451dc17-4af9-4ca1-8d93-cbf1615b185b admin admin] SCRIPT_NAME: `/identity` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:06:25.987860 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b451dc17-4af9-4ca1-8d93-cbf1615b185b admin admin] PATH_INFO: `/v3/projects` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:06:25.988527 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b451dc17-4af9-4ca1-8d93-cbf1615b185b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 20:06:25.990399 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b451dc17-4af9-4ca1-8d93-cbf1615b185b admin admin] RBAC: Authorization granted {{(pid=82025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 20:06:26.153453 dv-cinder-828806-6-smb devstack@keystone.service[82025]: [pid: 82025|app: 0|req: 1301/2544] 10.222.0.33 () {60 vars in 1153 bytes} [Tue Sep 13 20:06:25 2022] POST /identity/v3/projects => generated 373 bytes in 179 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 13 20:06:26.154648 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57d93c3a-b294-4a0a-9aac-374419bed6f0 admin admin] Authenticating user token {{(pid=82026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 20:06:26.167194 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57d93c3a-b294-4a0a-9aac-374419bed6f0 admin admin] Validating token access rules against request {{(pid=82026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 20:06:26.237969 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4927e42-54ae-448b-930d-8734173adddb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57539b6a6f3b4d589f5f5e1d211cd6a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b454f707d20347ada3d82aa85495635e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 20:06:26.238787 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4927e42-54ae-448b-930d-8734173adddb admin admin] REQUEST_METHOD: `POST` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:06:26.239215 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4927e42-54ae-448b-930d-8734173adddb admin admin] SCRIPT_NAME: `/identity` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:06:26.245648 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4927e42-54ae-448b-930d-8734173adddb admin admin] PATH_INFO: `/v3/users` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:06:26.245648 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4927e42-54ae-448b-930d-8734173adddb admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 20:06:26.245648 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4927e42-54ae-448b-930d-8734173adddb admin admin] RBAC: Authorization granted {{(pid=82026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 20:06:26.254602 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG dbcounter [-] [82026] Writing DB stats keystone:SELECT=88,keystone:DELETE=10,keystone:INSERT=2 {{(pid=82026) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 20:06:26.462296 dv-cinder-828806-6-smb devstack@keystone.service[82026]: [pid: 82026|app: 0|req: 1244/2545] 10.222.0.33 () {60 vars in 1144 bytes} [Tue Sep 13 20:06:26 2022] POST /identity/v3/users => generated 287 bytes in 308 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 13 20:06:26.466366 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b451dc17-4af9-4ca1-8d93-cbf1615b185b admin admin] Authenticating user token {{(pid=82025) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 20:06:26.477477 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b451dc17-4af9-4ca1-8d93-cbf1615b185b admin admin] Validating token access rules against request {{(pid=82025) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 20:06:26.482329 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f306a9f6-5101-4bc1-9f2a-c24a20e2c3ad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57539b6a6f3b4d589f5f5e1d211cd6a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b454f707d20347ada3d82aa85495635e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82025) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 20:06:26.483004 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f306a9f6-5101-4bc1-9f2a-c24a20e2c3ad admin admin] REQUEST_METHOD: `GET` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:06:26.483390 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f306a9f6-5101-4bc1-9f2a-c24a20e2c3ad admin admin] SCRIPT_NAME: `/identity` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:06:26.483761 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f306a9f6-5101-4bc1-9f2a-c24a20e2c3ad admin admin] PATH_INFO: `/v3/roles` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:06:26.484481 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f306a9f6-5101-4bc1-9f2a-c24a20e2c3ad admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 20:06:26.486132 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f306a9f6-5101-4bc1-9f2a-c24a20e2c3ad admin admin] RBAC: Authorization granted {{(pid=82025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 20:06:26.496411 dv-cinder-828806-6-smb devstack@keystone.service[82025]: [pid: 82025|app: 0|req: 1302/2546] 10.222.0.33 () {58 vars in 1122 bytes} [Tue Sep 13 20:06:26 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 13 20:06:26.500428 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4927e42-54ae-448b-930d-8734173adddb admin admin] Authenticating user token {{(pid=82026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 20:06:26.511517 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4927e42-54ae-448b-930d-8734173adddb admin admin] Validating token access rules against request {{(pid=82026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 20:06:26.520425 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-893fb0c0-40be-406c-94f2-d27983f76c67 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57539b6a6f3b4d589f5f5e1d211cd6a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b454f707d20347ada3d82aa85495635e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 20:06:26.520425 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-893fb0c0-40be-406c-94f2-d27983f76c67 admin admin] REQUEST_METHOD: `GET` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:06:26.520425 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-893fb0c0-40be-406c-94f2-d27983f76c67 admin admin] SCRIPT_NAME: `/identity` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:06:26.520425 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-893fb0c0-40be-406c-94f2-d27983f76c67 admin admin] PATH_INFO: `/v3/roles` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:06:26.520824 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-893fb0c0-40be-406c-94f2-d27983f76c67 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 20:06:26.520921 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-893fb0c0-40be-406c-94f2-d27983f76c67 admin admin] RBAC: Authorization granted {{(pid=82026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 20:06:26.532140 dv-cinder-828806-6-smb devstack@keystone.service[82026]: [pid: 82026|app: 0|req: 1245/2547] 10.222.0.33 () {58 vars in 1122 bytes} [Tue Sep 13 20:06:26 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 13 20:06:26.540336 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f306a9f6-5101-4bc1-9f2a-c24a20e2c3ad admin admin] Authenticating user token {{(pid=82025) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 20:06:26.551403 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f306a9f6-5101-4bc1-9f2a-c24a20e2c3ad admin admin] Validating token access rules against request {{(pid=82025) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 20:06:26.559300 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a037e3e2-4123-446f-9182-2707c8345b28 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57539b6a6f3b4d589f5f5e1d211cd6a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b454f707d20347ada3d82aa85495635e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82025) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 20:06:26.560963 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a037e3e2-4123-446f-9182-2707c8345b28 admin admin] REQUEST_METHOD: `PUT` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:06:26.561351 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a037e3e2-4123-446f-9182-2707c8345b28 admin admin] SCRIPT_NAME: `/identity` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:06:26.561642 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a037e3e2-4123-446f-9182-2707c8345b28 admin admin] PATH_INFO: `/v3/projects/83aa2e3a10424363a7994cb7a49000c7/users/6a0008e12c90401fb15f753fbd785202/roles/3618ab638a65401f82333da7596d1daf` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:06:26.586003 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a037e3e2-4123-446f-9182-2707c8345b28 admin admin] RBAC: Authorizing `identity:create_grant(project_id=83aa2e3a10424363a7994cb7a49000c7, user_id=6a0008e12c90401fb15f753fbd785202, role_id=3618ab638a65401f82333da7596d1daf)` {{(pid=82025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 20:06:26.589045 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a037e3e2-4123-446f-9182-2707c8345b28 admin admin] RBAC: Authorization granted {{(pid=82025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 20:06:26.718722 dv-cinder-828806-6-smb devstack@keystone.service[82025]: [pid: 82025|app: 0|req: 1303/2548] 10.222.0.33 () {60 vars in 1483 bytes} [Tue Sep 13 20:06:26 2022] PUT /identity/v3/projects/83aa2e3a10424363a7994cb7a49000c7/users/6a0008e12c90401fb15f753fbd785202/roles/3618ab638a65401f82333da7596d1daf => generated 0 bytes in 181 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 20:06:26.731898 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddd7aafa-9686-4d18-a114-a9b451c6cd40 None None] REQUEST_METHOD: `POST` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:06:26.732192 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddd7aafa-9686-4d18-a114-a9b451c6cd40 None None] SCRIPT_NAME: `/identity` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:06:26.732472 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddd7aafa-9686-4d18-a114-a9b451c6cd40 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:06:26.768319 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.auth.core [None req-ddd7aafa-9686-4d18-a114-a9b451c6cd40 None None] MFA Rules not processed for user `6a0008e12c90401fb15f753fbd785202`. Rule list: `[]` (Enabled: `True`). {{(pid=82026) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 20:06:26.769575 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.common.fernet_utils [None req-ddd7aafa-9686-4d18-a114-a9b451c6cd40 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82026) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 20:06:26.848592 dv-cinder-828806-6-smb devstack@keystone.service[82026]: [pid: 82026|app: 0|req: 1246/2549] 10.222.0.33 () {58 vars in 958 bytes} [Tue Sep 13 20:06:26 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 20:06:26.852989 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a037e3e2-4123-446f-9182-2707c8345b28 admin admin] Authenticating user token {{(pid=82025) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 20:06:26.929713 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a037e3e2-4123-446f-9182-2707c8345b28 admin admin] Validating token access rules against request {{(pid=82025) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 20:06:26.936023 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c96dd71-c1c6-4d78-b888-660f8ee4892f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57539b6a6f3b4d589f5f5e1d211cd6a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b454f707d20347ada3d82aa85495635e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82025) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 20:06:26.936767 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c96dd71-c1c6-4d78-b888-660f8ee4892f admin admin] REQUEST_METHOD: `POST` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:06:26.937054 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c96dd71-c1c6-4d78-b888-660f8ee4892f admin admin] SCRIPT_NAME: `/identity` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:06:26.937596 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c96dd71-c1c6-4d78-b888-660f8ee4892f admin admin] PATH_INFO: `/v3/projects` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:06:26.938537 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c96dd71-c1c6-4d78-b888-660f8ee4892f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 20:06:26.940652 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c96dd71-c1c6-4d78-b888-660f8ee4892f admin admin] RBAC: Authorization granted {{(pid=82025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 20:06:27.114529 dv-cinder-828806-6-smb devstack@keystone.service[82025]: [pid: 82025|app: 0|req: 1304/2550] 10.222.0.33 () {60 vars in 1153 bytes} [Tue Sep 13 20:06:26 2022] POST /identity/v3/projects => generated 373 bytes in 253 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 13 20:06:27.114686 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddd7aafa-9686-4d18-a114-a9b451c6cd40 None None] Authenticating user token {{(pid=82026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 20:06:27.128171 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddd7aafa-9686-4d18-a114-a9b451c6cd40 None None] Validating token access rules against request {{(pid=82026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 20:06:27.207218 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59fba6b3-d655-4983-819b-37061b9585a9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57539b6a6f3b4d589f5f5e1d211cd6a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b454f707d20347ada3d82aa85495635e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 20:06:27.207982 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59fba6b3-d655-4983-819b-37061b9585a9 admin admin] REQUEST_METHOD: `POST` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:06:27.208330 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59fba6b3-d655-4983-819b-37061b9585a9 admin admin] SCRIPT_NAME: `/identity` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:06:27.208668 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59fba6b3-d655-4983-819b-37061b9585a9 admin admin] PATH_INFO: `/v3/users` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:06:27.209382 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59fba6b3-d655-4983-819b-37061b9585a9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 20:06:27.212412 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59fba6b3-d655-4983-819b-37061b9585a9 admin admin] RBAC: Authorization granted {{(pid=82026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 20:06:27.381955 dv-cinder-828806-6-smb devstack@keystone.service[82026]: [pid: 82026|app: 0|req: 1247/2551] 10.222.0.33 () {60 vars in 1144 bytes} [Tue Sep 13 20:06:27 2022] POST /identity/v3/users => generated 293 bytes in 272 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 13 20:06:27.386847 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c96dd71-c1c6-4d78-b888-660f8ee4892f admin admin] Authenticating user token {{(pid=82025) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 20:06:27.400175 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c96dd71-c1c6-4d78-b888-660f8ee4892f admin admin] Validating token access rules against request {{(pid=82025) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 20:06:27.406405 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c0fc4c1-8284-41b1-8abb-477841bb0bdc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57539b6a6f3b4d589f5f5e1d211cd6a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b454f707d20347ada3d82aa85495635e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82025) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 20:06:27.407094 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c0fc4c1-8284-41b1-8abb-477841bb0bdc admin admin] REQUEST_METHOD: `GET` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:06:27.407387 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c0fc4c1-8284-41b1-8abb-477841bb0bdc admin admin] SCRIPT_NAME: `/identity` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:06:27.407669 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c0fc4c1-8284-41b1-8abb-477841bb0bdc admin admin] PATH_INFO: `/v3/roles` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:06:27.411219 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c0fc4c1-8284-41b1-8abb-477841bb0bdc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 20:06:27.412772 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c0fc4c1-8284-41b1-8abb-477841bb0bdc admin admin] RBAC: Authorization granted {{(pid=82025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 20:06:27.429658 dv-cinder-828806-6-smb devstack@keystone.service[82025]: [pid: 82025|app: 0|req: 1305/2552] 10.222.0.33 () {58 vars in 1122 bytes} [Tue Sep 13 20:06:27 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 13 20:06:27.431018 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59fba6b3-d655-4983-819b-37061b9585a9 admin admin] Authenticating user token {{(pid=82026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 20:06:27.442895 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59fba6b3-d655-4983-819b-37061b9585a9 admin admin] Validating token access rules against request {{(pid=82026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 20:06:27.449981 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-911bd68b-9e36-4c6a-9f1c-66cbc5d9d00d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57539b6a6f3b4d589f5f5e1d211cd6a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b454f707d20347ada3d82aa85495635e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 20:06:27.452056 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-911bd68b-9e36-4c6a-9f1c-66cbc5d9d00d admin admin] REQUEST_METHOD: `PUT` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:06:27.452056 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-911bd68b-9e36-4c6a-9f1c-66cbc5d9d00d admin admin] SCRIPT_NAME: `/identity` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:06:27.452056 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-911bd68b-9e36-4c6a-9f1c-66cbc5d9d00d admin admin] PATH_INFO: `/v3/projects/1e2ea2abb1df4d31b22f5c3f93edf17e/users/96e706d0b2a943a788f6b580f58bf288/roles/e5af7d5baa93469e9e486ef21c85474e` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:06:27.473245 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-911bd68b-9e36-4c6a-9f1c-66cbc5d9d00d admin admin] RBAC: Authorizing `identity:create_grant(project_id=1e2ea2abb1df4d31b22f5c3f93edf17e, user_id=96e706d0b2a943a788f6b580f58bf288, role_id=e5af7d5baa93469e9e486ef21c85474e)` {{(pid=82026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 20:06:27.476299 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-911bd68b-9e36-4c6a-9f1c-66cbc5d9d00d admin admin] RBAC: Authorization granted {{(pid=82026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 20:06:27.561525 dv-cinder-828806-6-smb devstack@keystone.service[82026]: [pid: 82026|app: 0|req: 1248/2553] 10.222.0.33 () {60 vars in 1483 bytes} [Tue Sep 13 20:06:27 2022] PUT /identity/v3/projects/1e2ea2abb1df4d31b22f5c3f93edf17e/users/96e706d0b2a943a788f6b580f58bf288/roles/e5af7d5baa93469e9e486ef21c85474e => generated 0 bytes in 131 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 20:06:27.565971 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c0fc4c1-8284-41b1-8abb-477841bb0bdc admin admin] Authenticating user token {{(pid=82025) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 20:06:27.577068 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c0fc4c1-8284-41b1-8abb-477841bb0bdc admin admin] Validating token access rules against request {{(pid=82025) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 20:06:27.637205 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG dbcounter [-] [82025] Writing DB stats keystone:SELECT=95,keystone:INSERT=4,keystone:DELETE=1 {{(pid=82025) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 20:06:27.643272 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd7e4025-1525-456f-82e2-72233c50138e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57539b6a6f3b4d589f5f5e1d211cd6a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b454f707d20347ada3d82aa85495635e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82025) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 20:06:27.643891 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd7e4025-1525-456f-82e2-72233c50138e admin admin] REQUEST_METHOD: `GET` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:06:27.644692 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd7e4025-1525-456f-82e2-72233c50138e admin admin] SCRIPT_NAME: `/identity` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:06:27.645000 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd7e4025-1525-456f-82e2-72233c50138e admin admin] PATH_INFO: `/v3/roles` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:06:27.646002 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd7e4025-1525-456f-82e2-72233c50138e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 20:06:27.647671 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd7e4025-1525-456f-82e2-72233c50138e admin admin] RBAC: Authorization granted {{(pid=82025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 20:06:27.666284 dv-cinder-828806-6-smb devstack@keystone.service[82025]: [pid: 82025|app: 0|req: 1306/2554] 10.222.0.33 () {58 vars in 1122 bytes} [Tue Sep 13 20:06:27 2022] GET /identity/v3/roles => generated 1420 bytes in 98 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 13 20:06:27.667802 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-911bd68b-9e36-4c6a-9f1c-66cbc5d9d00d admin admin] Authenticating user token {{(pid=82026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 20:06:27.680768 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-911bd68b-9e36-4c6a-9f1c-66cbc5d9d00d admin admin] Validating token access rules against request {{(pid=82026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 20:06:27.690053 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86f6d45f-e960-4e56-859f-27960f2f6e1c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57539b6a6f3b4d589f5f5e1d211cd6a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b454f707d20347ada3d82aa85495635e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 20:06:27.691638 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86f6d45f-e960-4e56-859f-27960f2f6e1c admin admin] REQUEST_METHOD: `PUT` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:06:27.692170 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86f6d45f-e960-4e56-859f-27960f2f6e1c admin admin] SCRIPT_NAME: `/identity` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:06:27.692696 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86f6d45f-e960-4e56-859f-27960f2f6e1c admin admin] PATH_INFO: `/v3/projects/1e2ea2abb1df4d31b22f5c3f93edf17e/users/96e706d0b2a943a788f6b580f58bf288/roles/e5af7d5baa93469e9e486ef21c85474e` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:06:27.696400 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86f6d45f-e960-4e56-859f-27960f2f6e1c admin admin] RBAC: Authorizing `identity:create_grant(project_id=1e2ea2abb1df4d31b22f5c3f93edf17e, user_id=96e706d0b2a943a788f6b580f58bf288, role_id=e5af7d5baa93469e9e486ef21c85474e)` {{(pid=82026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 20:06:27.701849 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86f6d45f-e960-4e56-859f-27960f2f6e1c admin admin] RBAC: Authorization granted {{(pid=82026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 20:06:27.723927 dv-cinder-828806-6-smb devstack@keystone.service[82026]: [pid: 82026|app: 0|req: 1249/2555] 10.222.0.33 () {60 vars in 1483 bytes} [Tue Sep 13 20:06:27 2022] PUT /identity/v3/projects/1e2ea2abb1df4d31b22f5c3f93edf17e/users/96e706d0b2a943a788f6b580f58bf288/roles/e5af7d5baa93469e9e486ef21c85474e => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 20:06:27.729739 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c64bddaa-0f78-482d-824d-c9bd481e26a9 None None] REQUEST_METHOD: `POST` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:06:27.730038 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c64bddaa-0f78-482d-824d-c9bd481e26a9 None None] SCRIPT_NAME: `/identity` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:06:27.730325 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c64bddaa-0f78-482d-824d-c9bd481e26a9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:06:27.763737 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.auth.core [None req-c64bddaa-0f78-482d-824d-c9bd481e26a9 None None] MFA Rules not processed for user `96e706d0b2a943a788f6b580f58bf288`. Rule list: `[]` (Enabled: `True`). {{(pid=82025) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 20:06:27.765020 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.fernet_utils [None req-c64bddaa-0f78-482d-824d-c9bd481e26a9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82025) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 20:06:27.849204 dv-cinder-828806-6-smb devstack@keystone.service[82025]: [pid: 82025|app: 0|req: 1307/2556] 10.222.0.33 () {58 vars in 958 bytes} [Tue Sep 13 20:06:27 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 20:06:27.862181 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86f6d45f-e960-4e56-859f-27960f2f6e1c admin admin] Authenticating user token {{(pid=82026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 20:06:27.867079 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.common.fernet_utils [None req-86f6d45f-e960-4e56-859f-27960f2f6e1c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82026) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 20:06:27.899159 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG dbcounter [-] [82026] Writing DB stats keystone:INSERT=7,keystone:SELECT=93 {{(pid=82026) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 20:06:27.938724 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86f6d45f-e960-4e56-859f-27960f2f6e1c admin admin] Validating token access rules against request {{(pid=82026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 20:06:27.945311 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56ee51fb-b694-42d6-ab3f-8e55dad2b774 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46024fc6167f4321818b1bed27a521a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8c6fba0f15b4d6a84ff601919b7b8e4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 20:06:27.946049 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56ee51fb-b694-42d6-ab3f-8e55dad2b774 service cinder] REQUEST_METHOD: `GET` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:06:27.946490 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56ee51fb-b694-42d6-ab3f-8e55dad2b774 service cinder] SCRIPT_NAME: `/identity` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:06:27.946841 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56ee51fb-b694-42d6-ab3f-8e55dad2b774 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:06:28.031446 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56ee51fb-b694-42d6-ab3f-8e55dad2b774 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=82026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 20:06:28.032937 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56ee51fb-b694-42d6-ab3f-8e55dad2b774 service cinder] RBAC: Authorization granted {{(pid=82026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 20:06:28.043773 dv-cinder-828806-6-smb devstack@keystone.service[82026]: [pid: 82026|app: 0|req: 1250/2557] 10.222.0.33 () {60 vars in 1365 bytes} [Tue Sep 13 20:06:27 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 183 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 20:06:31.437191 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c64bddaa-0f78-482d-824d-c9bd481e26a9 None None] Authenticating user token {{(pid=82025) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 20:06:31.438934 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.fernet_utils [None req-c64bddaa-0f78-482d-824d-c9bd481e26a9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82025) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 20:06:31.495966 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c64bddaa-0f78-482d-824d-c9bd481e26a9 None None] Validating token access rules against request {{(pid=82025) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 20:06:31.499617 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6333ffe8-cad7-4645-aa65-8e31b38880d2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '023a2c79c2444611b3d431928e56685d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8c6fba0f15b4d6a84ff601919b7b8e4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82025) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 20:06:31.500230 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6333ffe8-cad7-4645-aa65-8e31b38880d2 service neutron] REQUEST_METHOD: `GET` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:06:31.500517 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6333ffe8-cad7-4645-aa65-8e31b38880d2 service neutron] SCRIPT_NAME: `/identity` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:06:31.500798 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6333ffe8-cad7-4645-aa65-8e31b38880d2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:06:31.502528 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.fernet_utils [None req-6333ffe8-cad7-4645-aa65-8e31b38880d2 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82025) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 20:06:31.512870 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6333ffe8-cad7-4645-aa65-8e31b38880d2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 20:06:31.517138 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6333ffe8-cad7-4645-aa65-8e31b38880d2 service neutron] RBAC: Authorization granted {{(pid=82025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 20:06:31.523026 dv-cinder-828806-6-smb devstack@keystone.service[82025]: [pid: 82025|app: 0|req: 1308/2558] 10.222.0.33 () {60 vars in 1365 bytes} [Tue Sep 13 20:06:31 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 20:06:32.993630 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56ee51fb-b694-42d6-ab3f-8e55dad2b774 service cinder] Authenticating user token {{(pid=82026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 20:06:32.995056 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.common.fernet_utils [None req-56ee51fb-b694-42d6-ab3f-8e55dad2b774 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82026) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 20:06:33.006748 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56ee51fb-b694-42d6-ab3f-8e55dad2b774 service cinder] Validating token access rules against request {{(pid=82026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 20:06:33.010387 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0702df2-3fb2-4edd-9c11-c77ad46f1c0f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46024fc6167f4321818b1bed27a521a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8c6fba0f15b4d6a84ff601919b7b8e4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 20:06:33.010992 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0702df2-3fb2-4edd-9c11-c77ad46f1c0f service cinder] REQUEST_METHOD: `GET` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:06:33.011314 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0702df2-3fb2-4edd-9c11-c77ad46f1c0f service cinder] SCRIPT_NAME: `/identity` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:06:33.011596 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0702df2-3fb2-4edd-9c11-c77ad46f1c0f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:06:33.021150 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0702df2-3fb2-4edd-9c11-c77ad46f1c0f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=82026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 20:06:33.022565 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0702df2-3fb2-4edd-9c11-c77ad46f1c0f service cinder] RBAC: Authorization granted {{(pid=82026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 20:06:33.032071 dv-cinder-828806-6-smb devstack@keystone.service[82026]: [pid: 82026|app: 0|req: 1251/2559] 10.222.0.33 () {60 vars in 1365 bytes} [Tue Sep 13 20:06:32 2022] GET /identity/v3/auth/tokens => generated 3317 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 20:06:35.466120 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2600cf65-686f-4a54-821e-46e8800b0370 None None] REQUEST_METHOD: `POST` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:06:35.469598 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2600cf65-686f-4a54-821e-46e8800b0370 None None] SCRIPT_NAME: `/identity` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:06:35.469598 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2600cf65-686f-4a54-821e-46e8800b0370 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:06:35.486484 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.auth.core [None req-2600cf65-686f-4a54-821e-46e8800b0370 None None] MFA Rules not processed for user `a28e738b894442e2bc9880eeb64fc0c8`. Rule list: `[]` (Enabled: `True`). {{(pid=82025) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 20:06:35.487870 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.fernet_utils [None req-2600cf65-686f-4a54-821e-46e8800b0370 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82025) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 20:06:35.543562 dv-cinder-828806-6-smb devstack@keystone.service[82025]: [pid: 82025|app: 0|req: 1309/2560] 10.222.0.33 () {58 vars in 1009 bytes} [Tue Sep 13 20:06:35 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 20:06:35.556175 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0702df2-3fb2-4edd-9c11-c77ad46f1c0f service cinder] Authenticating user token {{(pid=82026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 20:06:35.557577 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.common.fernet_utils [None req-f0702df2-3fb2-4edd-9c11-c77ad46f1c0f service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82026) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 20:06:35.626670 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0702df2-3fb2-4edd-9c11-c77ad46f1c0f service cinder] Validating token access rules against request {{(pid=82026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 20:06:35.632299 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d361549-bbd2-4482-8557-1c241899b479 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa5a83574f7f424c805e130c462d5969', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8c6fba0f15b4d6a84ff601919b7b8e4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 20:06:35.632895 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d361549-bbd2-4482-8557-1c241899b479 service swift] REQUEST_METHOD: `GET` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:06:35.633173 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d361549-bbd2-4482-8557-1c241899b479 service swift] SCRIPT_NAME: `/identity` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:06:35.633444 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d361549-bbd2-4482-8557-1c241899b479 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:06:35.641670 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d361549-bbd2-4482-8557-1c241899b479 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=82026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 20:06:35.643264 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d361549-bbd2-4482-8557-1c241899b479 service swift] RBAC: Authorization granted {{(pid=82026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 20:06:35.651226 dv-cinder-828806-6-smb devstack@keystone.service[82026]: [pid: 82026|app: 0|req: 1252/2561] 10.222.0.33 () {60 vars in 1384 bytes} [Tue Sep 13 20:06:35 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 96 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Sep 13 20:06:37.008076 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2600cf65-686f-4a54-821e-46e8800b0370 None None] Authenticating user token {{(pid=82025) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 20:06:37.009889 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.fernet_utils [None req-2600cf65-686f-4a54-821e-46e8800b0370 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82025) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 20:06:37.066508 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG dbcounter [-] [82025] Writing DB stats keystone:SELECT=100 {{(pid=82025) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 20:06:37.117781 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2600cf65-686f-4a54-821e-46e8800b0370 None None] Validating token access rules against request {{(pid=82025) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 20:06:37.123458 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b46f8b1-2516-4f77-b2ea-c0b23322dd39 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e66e7034abed4e0bad1f4137520c1e70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8c6fba0f15b4d6a84ff601919b7b8e4', 'project_domain_id': 'default', 'roles': ['service', 'member', 'reader', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82025) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 20:06:37.124028 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b46f8b1-2516-4f77-b2ea-c0b23322dd39 service nova] REQUEST_METHOD: `GET` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:06:37.124380 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b46f8b1-2516-4f77-b2ea-c0b23322dd39 service nova] SCRIPT_NAME: `/identity` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:06:37.124583 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b46f8b1-2516-4f77-b2ea-c0b23322dd39 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:06:37.135939 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.fernet_utils [None req-7b46f8b1-2516-4f77-b2ea-c0b23322dd39 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82025) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 20:06:37.206336 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b46f8b1-2516-4f77-b2ea-c0b23322dd39 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 20:06:37.208270 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b46f8b1-2516-4f77-b2ea-c0b23322dd39 service nova] RBAC: Authorization granted {{(pid=82025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 20:06:37.217783 dv-cinder-828806-6-smb devstack@keystone.service[82025]: [pid: 82025|app: 0|req: 1310/2562] 10.222.0.33 () {60 vars in 1365 bytes} [Tue Sep 13 20:06:37 2022] GET /identity/v3/auth/tokens => generated 3264 bytes in 210 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 20:06:45.648066 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG dbcounter [-] [82026] Writing DB stats keystone:SELECT=76 {{(pid=82026) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 20:06:47.265497 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG dbcounter [-] [82025] Writing DB stats keystone:SELECT=44 {{(pid=82025) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 20:06:49.804519 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d361549-bbd2-4482-8557-1c241899b479 service swift] Authenticating user token {{(pid=82026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 20:06:49.909356 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d361549-bbd2-4482-8557-1c241899b479 service swift] Validating token access rules against request {{(pid=82026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 20:06:49.915967 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a8c542d-7ae4-41ed-b64c-d21900ea292b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57539b6a6f3b4d589f5f5e1d211cd6a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b454f707d20347ada3d82aa85495635e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 20:06:49.916904 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a8c542d-7ae4-41ed-b64c-d21900ea292b admin admin] REQUEST_METHOD: `DELETE` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:06:49.917333 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a8c542d-7ae4-41ed-b64c-d21900ea292b admin admin] SCRIPT_NAME: `/identity` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:06:49.917749 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a8c542d-7ae4-41ed-b64c-d21900ea292b admin admin] PATH_INFO: `/v3/users/6a0008e12c90401fb15f753fbd785202` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:06:49.919457 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a8c542d-7ae4-41ed-b64c-d21900ea292b admin admin] RBAC: Authorizing `identity:delete_user(user_id=6a0008e12c90401fb15f753fbd785202)` {{(pid=82026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 20:06:49.922562 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a8c542d-7ae4-41ed-b64c-d21900ea292b admin admin] RBAC: Authorization granted {{(pid=82026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 20:06:51.092803 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.notifications [None req-5a8c542d-7ae4-41ed-b64c-d21900ea292b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6a0008e12c90401fb15f753fbd785202'} {{(pid=82026) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 20:06:51.190375 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.notifications [None req-5a8c542d-7ae4-41ed-b64c-d21900ea292b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6a0008e12c90401fb15f753fbd785202'} {{(pid=82026) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 20:06:51.205256 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.notifications [None req-5a8c542d-7ae4-41ed-b64c-d21900ea292b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6a0008e12c90401fb15f753fbd785202'} {{(pid=82026) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 20:06:51.205974 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.notifications [None req-5a8c542d-7ae4-41ed-b64c-d21900ea292b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6a0008e12c90401fb15f753fbd785202'} {{(pid=82026) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 20:06:51.215060 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.notifications [None req-5a8c542d-7ae4-41ed-b64c-d21900ea292b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6a0008e12c90401fb15f753fbd785202'} {{(pid=82026) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 20:06:51.228280 dv-cinder-828806-6-smb devstack@keystone.service[82026]: [pid: 82026|app: 0|req: 1253/2563] 10.222.0.33 () {58 vars in 1224 bytes} [Tue Sep 13 20:06:49 2022] DELETE /identity/v3/users/6a0008e12c90401fb15f753fbd785202 => generated 0 bytes in 1418 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 13 20:06:51.228428 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-878a2ec4-b3c1-4aef-8365-3eac8aa0f91e None None] REQUEST_METHOD: `POST` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:06:51.228428 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-878a2ec4-b3c1-4aef-8365-3eac8aa0f91e None None] SCRIPT_NAME: `/identity` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:06:51.228428 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-878a2ec4-b3c1-4aef-8365-3eac8aa0f91e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:06:51.247686 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.auth.core [None req-878a2ec4-b3c1-4aef-8365-3eac8aa0f91e None None] MFA Rules not processed for user `57539b6a6f3b4d589f5f5e1d211cd6a0`. Rule list: `[]` (Enabled: `True`). {{(pid=82025) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 20:06:51.248954 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.fernet_utils [None req-878a2ec4-b3c1-4aef-8365-3eac8aa0f91e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82025) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 20:06:51.322888 dv-cinder-828806-6-smb devstack@keystone.service[82025]: [pid: 82025|app: 0|req: 1311/2564] 10.222.0.33 () {58 vars in 958 bytes} [Tue Sep 13 20:06:51 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 20:06:51.332868 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a8c542d-7ae4-41ed-b64c-d21900ea292b admin admin] Authenticating user token {{(pid=82026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 20:06:51.334268 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.common.fernet_utils [None req-5a8c542d-7ae4-41ed-b64c-d21900ea292b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82026) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 20:06:51.391166 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a8c542d-7ae4-41ed-b64c-d21900ea292b admin admin] Validating token access rules against request {{(pid=82026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 20:06:51.394730 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25412cd8-4359-424f-8eea-b2a8e865586a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '023a2c79c2444611b3d431928e56685d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8c6fba0f15b4d6a84ff601919b7b8e4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 20:06:51.395379 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25412cd8-4359-424f-8eea-b2a8e865586a service neutron] REQUEST_METHOD: `GET` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:06:51.395663 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25412cd8-4359-424f-8eea-b2a8e865586a service neutron] SCRIPT_NAME: `/identity` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:06:51.395940 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25412cd8-4359-424f-8eea-b2a8e865586a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:06:51.405121 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25412cd8-4359-424f-8eea-b2a8e865586a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 20:06:51.406549 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25412cd8-4359-424f-8eea-b2a8e865586a service neutron] RBAC: Authorization granted {{(pid=82026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 20:06:51.416073 dv-cinder-828806-6-smb devstack@keystone.service[82026]: [pid: 82026|app: 0|req: 1254/2565] 10.222.0.33 () {60 vars in 1365 bytes} [Tue Sep 13 20:06:51 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 20:06:51.985716 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-878a2ec4-b3c1-4aef-8365-3eac8aa0f91e None None] Authenticating user token {{(pid=82025) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 20:06:51.987214 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.fernet_utils [None req-878a2ec4-b3c1-4aef-8365-3eac8aa0f91e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82025) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 20:06:52.000147 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-878a2ec4-b3c1-4aef-8365-3eac8aa0f91e None None] Validating token access rules against request {{(pid=82025) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 20:06:52.006359 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38956830-7553-4de4-a757-90d5d8f95c63 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57539b6a6f3b4d589f5f5e1d211cd6a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b454f707d20347ada3d82aa85495635e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82025) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 20:06:52.007048 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38956830-7553-4de4-a757-90d5d8f95c63 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:06:52.007335 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38956830-7553-4de4-a757-90d5d8f95c63 admin admin] SCRIPT_NAME: `/identity` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:06:52.007616 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38956830-7553-4de4-a757-90d5d8f95c63 admin admin] PATH_INFO: `/v3/projects/83aa2e3a10424363a7994cb7a49000c7` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:06:52.009250 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38956830-7553-4de4-a757-90d5d8f95c63 admin admin] RBAC: Authorizing `identity:delete_project(project_id=83aa2e3a10424363a7994cb7a49000c7)` {{(pid=82025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 20:06:52.010688 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38956830-7553-4de4-a757-90d5d8f95c63 admin admin] RBAC: Authorization granted {{(pid=82025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 20:06:52.174007 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.notifications [None req-38956830-7553-4de4-a757-90d5d8f95c63 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '83aa2e3a10424363a7994cb7a49000c7', 'request_id': 'req-38956830-7553-4de4-a757-90d5d8f95c63'} {{(pid=82025) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 20:06:52.180322 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.notifications [None req-38956830-7553-4de4-a757-90d5d8f95c63 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '83aa2e3a10424363a7994cb7a49000c7', 'request_id': 'req-38956830-7553-4de4-a757-90d5d8f95c63'} {{(pid=82025) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 20:06:52.186975 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.notifications [None req-38956830-7553-4de4-a757-90d5d8f95c63 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '83aa2e3a10424363a7994cb7a49000c7', 'request_id': 'req-38956830-7553-4de4-a757-90d5d8f95c63'} {{(pid=82025) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 20:06:52.292850 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.notifications [None req-38956830-7553-4de4-a757-90d5d8f95c63 admin admin] The token cache is being invalidate because project 83aa2e3a10424363a7994cb7a49000c7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82025) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 13 20:06:52.293366 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.notifications [None req-38956830-7553-4de4-a757-90d5d8f95c63 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82025) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 20:06:52.293815 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.notifications [None req-38956830-7553-4de4-a757-90d5d8f95c63 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82025) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 20:06:52.295395 dv-cinder-828806-6-smb devstack@keystone.service[82025]: [pid: 82025|app: 0|req: 1312/2566] 10.222.0.33 () {58 vars in 1233 bytes} [Tue Sep 13 20:06:51 2022] DELETE /identity/v3/projects/83aa2e3a10424363a7994cb7a49000c7 => generated 0 bytes in 310 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 20:06:52.299402 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25412cd8-4359-424f-8eea-b2a8e865586a service neutron] Authenticating user token {{(pid=82026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 20:06:52.313340 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25412cd8-4359-424f-8eea-b2a8e865586a service neutron] Validating token access rules against request {{(pid=82026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 20:06:52.329053 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG dbcounter [-] [82026] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82026) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 20:06:52.367646 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db595db4-8ecb-478a-aa5f-1efc00525755 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57539b6a6f3b4d589f5f5e1d211cd6a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b454f707d20347ada3d82aa85495635e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 20:06:52.368360 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db595db4-8ecb-478a-aa5f-1efc00525755 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:06:52.368646 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db595db4-8ecb-478a-aa5f-1efc00525755 admin admin] SCRIPT_NAME: `/identity` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:06:52.368925 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db595db4-8ecb-478a-aa5f-1efc00525755 admin admin] PATH_INFO: `/v3/users/96e706d0b2a943a788f6b580f58bf288` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:06:52.370048 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db595db4-8ecb-478a-aa5f-1efc00525755 admin admin] RBAC: Authorizing `identity:delete_user(user_id=96e706d0b2a943a788f6b580f58bf288)` {{(pid=82026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 20:06:52.372005 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db595db4-8ecb-478a-aa5f-1efc00525755 admin admin] RBAC: Authorization granted {{(pid=82026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 20:06:52.458382 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5751c93-f0dc-4bfd-8be7-cf1dfcf980cd None None] REQUEST_METHOD: `POST` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:06:52.458666 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5751c93-f0dc-4bfd-8be7-cf1dfcf980cd None None] SCRIPT_NAME: `/identity` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:06:52.458946 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5751c93-f0dc-4bfd-8be7-cf1dfcf980cd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:06:52.491778 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.auth.core [None req-a5751c93-f0dc-4bfd-8be7-cf1dfcf980cd None None] MFA Rules not processed for user `a28e738b894442e2bc9880eeb64fc0c8`. Rule list: `[]` (Enabled: `True`). {{(pid=82025) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 20:06:52.493006 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.fernet_utils [None req-a5751c93-f0dc-4bfd-8be7-cf1dfcf980cd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82025) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 20:06:52.555791 dv-cinder-828806-6-smb devstack@keystone.service[82025]: [pid: 82025|app: 0|req: 1313/2567] 10.222.0.33 () {58 vars in 967 bytes} [Tue Sep 13 20:06:52 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 20:06:52.568698 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5751c93-f0dc-4bfd-8be7-cf1dfcf980cd None None] Authenticating user token {{(pid=82025) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 20:06:52.570075 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.fernet_utils [None req-a5751c93-f0dc-4bfd-8be7-cf1dfcf980cd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82025) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 20:06:52.601078 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.notifications [None req-db595db4-8ecb-478a-aa5f-1efc00525755 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '96e706d0b2a943a788f6b580f58bf288'} {{(pid=82026) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 20:06:52.603388 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG dbcounter [-] [82025] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=82025) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 20:06:52.647507 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5751c93-f0dc-4bfd-8be7-cf1dfcf980cd None None] Validating token access rules against request {{(pid=82025) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 20:06:52.652914 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e45f80c-7a07-4e1e-acd1-efff464c27e9 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa5a83574f7f424c805e130c462d5969', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8c6fba0f15b4d6a84ff601919b7b8e4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82025) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 20:06:52.653529 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e45f80c-7a07-4e1e-acd1-efff464c27e9 service swift] REQUEST_METHOD: `GET` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:06:52.653818 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e45f80c-7a07-4e1e-acd1-efff464c27e9 service swift] SCRIPT_NAME: `/identity` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:06:52.654099 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e45f80c-7a07-4e1e-acd1-efff464c27e9 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:06:52.663257 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e45f80c-7a07-4e1e-acd1-efff464c27e9 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=82025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 20:06:52.664836 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e45f80c-7a07-4e1e-acd1-efff464c27e9 service swift] RBAC: Authorization granted {{(pid=82025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 20:06:52.672709 dv-cinder-828806-6-smb devstack@keystone.service[82025]: [pid: 82025|app: 0|req: 1314/2568] 10.222.0.33 () {60 vars in 1384 bytes} [Tue Sep 13 20:06:52 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 105 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Sep 13 20:06:52.739496 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.notifications [None req-db595db4-8ecb-478a-aa5f-1efc00525755 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '96e706d0b2a943a788f6b580f58bf288'} {{(pid=82026) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 20:06:52.752747 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.notifications [None req-db595db4-8ecb-478a-aa5f-1efc00525755 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '96e706d0b2a943a788f6b580f58bf288'} {{(pid=82026) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 20:06:52.757137 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.notifications [None req-db595db4-8ecb-478a-aa5f-1efc00525755 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '96e706d0b2a943a788f6b580f58bf288'} {{(pid=82026) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 20:06:52.764377 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.notifications [None req-db595db4-8ecb-478a-aa5f-1efc00525755 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '96e706d0b2a943a788f6b580f58bf288'} {{(pid=82026) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 20:06:52.770273 dv-cinder-828806-6-smb devstack@keystone.service[82026]: [pid: 82026|app: 0|req: 1255/2569] 10.222.0.33 () {58 vars in 1224 bytes} [Tue Sep 13 20:06:52 2022] DELETE /identity/v3/users/96e706d0b2a943a788f6b580f58bf288 => generated 0 bytes in 471 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 13 20:06:53.344848 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e45f80c-7a07-4e1e-acd1-efff464c27e9 service swift] Authenticating user token {{(pid=82025) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 20:06:53.344848 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.fernet_utils [None req-6e45f80c-7a07-4e1e-acd1-efff464c27e9 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82025) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 20:06:53.351750 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e45f80c-7a07-4e1e-acd1-efff464c27e9 service swift] Validating token access rules against request {{(pid=82025) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 20:06:53.417018 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59f8ae4f-0611-4ed4-9769-068123d6d7b3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57539b6a6f3b4d589f5f5e1d211cd6a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b454f707d20347ada3d82aa85495635e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82025) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 20:06:53.417655 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59f8ae4f-0611-4ed4-9769-068123d6d7b3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:06:53.417943 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59f8ae4f-0611-4ed4-9769-068123d6d7b3 admin admin] SCRIPT_NAME: `/identity` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:06:53.418225 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59f8ae4f-0611-4ed4-9769-068123d6d7b3 admin admin] PATH_INFO: `/v3/projects/1e2ea2abb1df4d31b22f5c3f93edf17e` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:06:53.419403 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59f8ae4f-0611-4ed4-9769-068123d6d7b3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=1e2ea2abb1df4d31b22f5c3f93edf17e)` {{(pid=82025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 20:06:53.421327 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59f8ae4f-0611-4ed4-9769-068123d6d7b3 admin admin] RBAC: Authorization granted {{(pid=82025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 20:06:53.553565 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.notifications [None req-59f8ae4f-0611-4ed4-9769-068123d6d7b3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1e2ea2abb1df4d31b22f5c3f93edf17e', 'request_id': 'req-59f8ae4f-0611-4ed4-9769-068123d6d7b3'} {{(pid=82025) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 20:06:53.559094 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.notifications [None req-59f8ae4f-0611-4ed4-9769-068123d6d7b3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1e2ea2abb1df4d31b22f5c3f93edf17e', 'request_id': 'req-59f8ae4f-0611-4ed4-9769-068123d6d7b3'} {{(pid=82025) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 20:06:53.566404 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.notifications [None req-59f8ae4f-0611-4ed4-9769-068123d6d7b3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1e2ea2abb1df4d31b22f5c3f93edf17e', 'request_id': 'req-59f8ae4f-0611-4ed4-9769-068123d6d7b3'} {{(pid=82025) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 20:06:53.646638 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.notifications [None req-59f8ae4f-0611-4ed4-9769-068123d6d7b3 admin admin] The token cache is being invalidate because project 1e2ea2abb1df4d31b22f5c3f93edf17e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82025) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 13 20:06:53.646831 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.notifications [None req-59f8ae4f-0611-4ed4-9769-068123d6d7b3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82025) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 20:06:53.647485 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.notifications [None req-59f8ae4f-0611-4ed4-9769-068123d6d7b3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82025) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 20:06:53.648964 dv-cinder-828806-6-smb devstack@keystone.service[82025]: [pid: 82025|app: 0|req: 1315/2570] 10.222.0.33 () {58 vars in 1233 bytes} [Tue Sep 13 20:06:53 2022] DELETE /identity/v3/projects/1e2ea2abb1df4d31b22f5c3f93edf17e => generated 0 bytes in 314 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 20:06:53.654121 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01059d8f-4dc8-423e-8d1c-0d8b5a99d708 None None] REQUEST_METHOD: `POST` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:06:53.656819 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01059d8f-4dc8-423e-8d1c-0d8b5a99d708 None None] SCRIPT_NAME: `/identity` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:06:53.656819 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01059d8f-4dc8-423e-8d1c-0d8b5a99d708 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:06:53.674475 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.auth.core [None req-01059d8f-4dc8-423e-8d1c-0d8b5a99d708 None None] MFA Rules not processed for user `57539b6a6f3b4d589f5f5e1d211cd6a0`. Rule list: `[]` (Enabled: `True`). {{(pid=82026) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 20:06:53.676472 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.common.fernet_utils [None req-01059d8f-4dc8-423e-8d1c-0d8b5a99d708 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82026) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 20:06:53.738768 dv-cinder-828806-6-smb devstack@keystone.service[82026]: [pid: 82026|app: 0|req: 1256/2571] 10.222.0.33 () {58 vars in 958 bytes} [Tue Sep 13 20:06:53 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 20:06:53.747844 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-234f10ab-f8a7-45fc-bbe9-c6fb5a3ea7bd None None] REQUEST_METHOD: `POST` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:06:53.748202 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-234f10ab-f8a7-45fc-bbe9-c6fb5a3ea7bd None None] SCRIPT_NAME: `/identity` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:06:53.748480 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-234f10ab-f8a7-45fc-bbe9-c6fb5a3ea7bd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:06:53.769759 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.auth.core [None req-234f10ab-f8a7-45fc-bbe9-c6fb5a3ea7bd None None] MFA Rules not processed for user `57539b6a6f3b4d589f5f5e1d211cd6a0`. Rule list: `[]` (Enabled: `True`). {{(pid=82025) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 20:06:53.770989 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.fernet_utils [None req-234f10ab-f8a7-45fc-bbe9-c6fb5a3ea7bd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82025) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 20:06:53.778998 dv-cinder-828806-6-smb devstack@keystone.service[82025]: [pid: 82025|app: 0|req: 1316/2572] 10.222.0.33 () {58 vars in 958 bytes} [Tue Sep 13 20:06:53 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 20:06:53.783497 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01059d8f-4dc8-423e-8d1c-0d8b5a99d708 None None] Authenticating user token {{(pid=82026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 20:06:53.793349 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01059d8f-4dc8-423e-8d1c-0d8b5a99d708 None None] Validating token access rules against request {{(pid=82026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 20:06:53.798143 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-440f6074-1876-45e4-afbe-c8dbba448259 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57539b6a6f3b4d589f5f5e1d211cd6a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b454f707d20347ada3d82aa85495635e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 20:06:53.800381 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-440f6074-1876-45e4-afbe-c8dbba448259 admin admin] REQUEST_METHOD: `GET` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:06:53.800381 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-440f6074-1876-45e4-afbe-c8dbba448259 admin admin] SCRIPT_NAME: `/identity` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:06:53.800381 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-440f6074-1876-45e4-afbe-c8dbba448259 admin admin] PATH_INFO: `/v3/domains` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:06:53.800706 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-440f6074-1876-45e4-afbe-c8dbba448259 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82026) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 20:06:53.800865 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-440f6074-1876-45e4-afbe-c8dbba448259 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 20:06:53.802468 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-440f6074-1876-45e4-afbe-c8dbba448259 admin admin] RBAC: Authorization granted {{(pid=82026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 20:06:53.814319 dv-cinder-828806-6-smb devstack@keystone.service[82026]: [pid: 82026|app: 0|req: 1257/2573] 10.222.0.33 () {58 vars in 1153 bytes} [Tue Sep 13 20:06:53 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 20:06:53.819576 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-234f10ab-f8a7-45fc-bbe9-c6fb5a3ea7bd None None] Authenticating user token {{(pid=82025) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 20:06:53.828784 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-234f10ab-f8a7-45fc-bbe9-c6fb5a3ea7bd None None] Validating token access rules against request {{(pid=82025) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 20:06:53.833966 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2907ad91-e527-40fb-a80b-de9609bbe329 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57539b6a6f3b4d589f5f5e1d211cd6a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b454f707d20347ada3d82aa85495635e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82025) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 20:06:53.834565 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2907ad91-e527-40fb-a80b-de9609bbe329 admin admin] REQUEST_METHOD: `POST` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:06:53.834850 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2907ad91-e527-40fb-a80b-de9609bbe329 admin admin] SCRIPT_NAME: `/identity` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:06:53.835169 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2907ad91-e527-40fb-a80b-de9609bbe329 admin admin] PATH_INFO: `/v3/projects` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:06:53.835799 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2907ad91-e527-40fb-a80b-de9609bbe329 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 20:06:53.837684 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2907ad91-e527-40fb-a80b-de9609bbe329 admin admin] RBAC: Authorization granted {{(pid=82025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 20:06:53.919636 dv-cinder-828806-6-smb devstack@keystone.service[82025]: [pid: 82025|app: 0|req: 1317/2574] 10.222.0.33 () {60 vars in 1153 bytes} [Tue Sep 13 20:06:53 2022] POST /identity/v3/projects => generated 379 bytes in 100 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 13 20:06:53.923800 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-440f6074-1876-45e4-afbe-c8dbba448259 admin admin] Authenticating user token {{(pid=82026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 20:06:53.934679 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-440f6074-1876-45e4-afbe-c8dbba448259 admin admin] Validating token access rules against request {{(pid=82026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 20:06:53.960508 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG dbcounter [-] [82026] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82026) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 20:06:53.991582 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f94fd861-768d-453f-a83f-a8a883a48b9c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57539b6a6f3b4d589f5f5e1d211cd6a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b454f707d20347ada3d82aa85495635e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 20:06:53.998778 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f94fd861-768d-453f-a83f-a8a883a48b9c admin admin] REQUEST_METHOD: `POST` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:06:53.998778 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f94fd861-768d-453f-a83f-a8a883a48b9c admin admin] SCRIPT_NAME: `/identity` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:06:53.998778 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f94fd861-768d-453f-a83f-a8a883a48b9c admin admin] PATH_INFO: `/v3/users` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:06:53.998778 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f94fd861-768d-453f-a83f-a8a883a48b9c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 20:06:53.998778 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f94fd861-768d-453f-a83f-a8a883a48b9c admin admin] RBAC: Authorization granted {{(pid=82026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 20:06:54.141508 dv-cinder-828806-6-smb devstack@keystone.service[82026]: [pid: 82026|app: 0|req: 1258/2575] 10.222.0.33 () {60 vars in 1144 bytes} [Tue Sep 13 20:06:53 2022] POST /identity/v3/users => generated 290 bytes in 218 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 13 20:06:54.145722 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2907ad91-e527-40fb-a80b-de9609bbe329 admin admin] Authenticating user token {{(pid=82025) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 20:06:54.156281 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2907ad91-e527-40fb-a80b-de9609bbe329 admin admin] Validating token access rules against request {{(pid=82025) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 20:06:54.161700 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-129f43b7-ba3c-4c5c-a561-975ef7a761c2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57539b6a6f3b4d589f5f5e1d211cd6a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b454f707d20347ada3d82aa85495635e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82025) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 20:06:54.164219 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-129f43b7-ba3c-4c5c-a561-975ef7a761c2 admin admin] REQUEST_METHOD: `GET` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:06:54.169146 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-129f43b7-ba3c-4c5c-a561-975ef7a761c2 admin admin] SCRIPT_NAME: `/identity` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:06:54.169146 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-129f43b7-ba3c-4c5c-a561-975ef7a761c2 admin admin] PATH_INFO: `/v3/roles` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:06:54.169146 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-129f43b7-ba3c-4c5c-a561-975ef7a761c2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 20:06:54.169146 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-129f43b7-ba3c-4c5c-a561-975ef7a761c2 admin admin] RBAC: Authorization granted {{(pid=82025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 20:06:54.181613 dv-cinder-828806-6-smb devstack@keystone.service[82025]: [pid: 82025|app: 0|req: 1318/2576] 10.222.0.33 () {58 vars in 1122 bytes} [Tue Sep 13 20:06:54 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 13 20:06:54.182682 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f94fd861-768d-453f-a83f-a8a883a48b9c admin admin] Authenticating user token {{(pid=82026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 20:06:54.193235 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f94fd861-768d-453f-a83f-a8a883a48b9c admin admin] Validating token access rules against request {{(pid=82026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 20:06:54.198351 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dffc2f9-1f21-4de3-ac40-f4aeac8b4dec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57539b6a6f3b4d589f5f5e1d211cd6a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b454f707d20347ada3d82aa85495635e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 20:06:54.198967 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dffc2f9-1f21-4de3-ac40-f4aeac8b4dec admin admin] REQUEST_METHOD: `GET` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:06:54.199361 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dffc2f9-1f21-4de3-ac40-f4aeac8b4dec admin admin] SCRIPT_NAME: `/identity` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:06:54.199636 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dffc2f9-1f21-4de3-ac40-f4aeac8b4dec admin admin] PATH_INFO: `/v3/roles` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:06:54.200288 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dffc2f9-1f21-4de3-ac40-f4aeac8b4dec admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 20:06:54.201913 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dffc2f9-1f21-4de3-ac40-f4aeac8b4dec admin admin] RBAC: Authorization granted {{(pid=82026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 20:06:54.215319 dv-cinder-828806-6-smb devstack@keystone.service[82026]: [pid: 82026|app: 0|req: 1259/2577] 10.222.0.33 () {58 vars in 1122 bytes} [Tue Sep 13 20:06:54 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 13 20:06:54.218150 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-129f43b7-ba3c-4c5c-a561-975ef7a761c2 admin admin] Authenticating user token {{(pid=82025) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 20:06:54.228926 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-129f43b7-ba3c-4c5c-a561-975ef7a761c2 admin admin] Validating token access rules against request {{(pid=82025) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 20:06:54.233655 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49d9dd21-9fe5-48d1-89d1-ff4f58ca3510 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57539b6a6f3b4d589f5f5e1d211cd6a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b454f707d20347ada3d82aa85495635e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82025) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 20:06:54.234320 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49d9dd21-9fe5-48d1-89d1-ff4f58ca3510 admin admin] REQUEST_METHOD: `PUT` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:06:54.234612 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49d9dd21-9fe5-48d1-89d1-ff4f58ca3510 admin admin] SCRIPT_NAME: `/identity` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:06:54.234892 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49d9dd21-9fe5-48d1-89d1-ff4f58ca3510 admin admin] PATH_INFO: `/v3/projects/4b57a32cf43a48ab82333448deb14e0c/users/36e6f8c1fee9416d9cd46e93b5873cf8/roles/3618ab638a65401f82333da7596d1daf` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:06:54.238127 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG dbcounter [-] [82025] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=82025) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 20:06:54.250647 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49d9dd21-9fe5-48d1-89d1-ff4f58ca3510 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4b57a32cf43a48ab82333448deb14e0c, user_id=36e6f8c1fee9416d9cd46e93b5873cf8, role_id=3618ab638a65401f82333da7596d1daf)` {{(pid=82025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 20:06:54.253802 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49d9dd21-9fe5-48d1-89d1-ff4f58ca3510 admin admin] RBAC: Authorization granted {{(pid=82025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 20:06:54.421421 dv-cinder-828806-6-smb devstack@keystone.service[82025]: [pid: 82025|app: 0|req: 1319/2578] 10.222.0.33 () {60 vars in 1483 bytes} [Tue Sep 13 20:06:54 2022] PUT /identity/v3/projects/4b57a32cf43a48ab82333448deb14e0c/users/36e6f8c1fee9416d9cd46e93b5873cf8/roles/3618ab638a65401f82333da7596d1daf => generated 0 bytes in 204 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 20:06:54.432456 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06ea71b1-6a45-41c4-a0d0-d475f3634ee4 None None] REQUEST_METHOD: `POST` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:06:54.432691 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06ea71b1-6a45-41c4-a0d0-d475f3634ee4 None None] SCRIPT_NAME: `/identity` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:06:54.433018 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06ea71b1-6a45-41c4-a0d0-d475f3634ee4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:06:54.462253 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.auth.core [None req-06ea71b1-6a45-41c4-a0d0-d475f3634ee4 None None] MFA Rules not processed for user `36e6f8c1fee9416d9cd46e93b5873cf8`. Rule list: `[]` (Enabled: `True`). {{(pid=82026) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 20:06:54.463524 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.common.fernet_utils [None req-06ea71b1-6a45-41c4-a0d0-d475f3634ee4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82026) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 20:06:54.529082 dv-cinder-828806-6-smb devstack@keystone.service[82026]: [pid: 82026|app: 0|req: 1260/2579] 10.222.0.33 () {58 vars in 958 bytes} [Tue Sep 13 20:06:54 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 20:06:54.533856 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49d9dd21-9fe5-48d1-89d1-ff4f58ca3510 admin admin] Authenticating user token {{(pid=82025) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 20:06:54.596445 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49d9dd21-9fe5-48d1-89d1-ff4f58ca3510 admin admin] Validating token access rules against request {{(pid=82025) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 20:06:54.602005 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-744cf7ae-c9c2-4f32-86cf-6fc37be7e2e5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57539b6a6f3b4d589f5f5e1d211cd6a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b454f707d20347ada3d82aa85495635e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82025) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 20:06:54.602617 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-744cf7ae-c9c2-4f32-86cf-6fc37be7e2e5 admin admin] REQUEST_METHOD: `POST` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:06:54.602907 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-744cf7ae-c9c2-4f32-86cf-6fc37be7e2e5 admin admin] SCRIPT_NAME: `/identity` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:06:54.603226 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-744cf7ae-c9c2-4f32-86cf-6fc37be7e2e5 admin admin] PATH_INFO: `/v3/projects` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:06:54.603879 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-744cf7ae-c9c2-4f32-86cf-6fc37be7e2e5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 20:06:54.605791 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-744cf7ae-c9c2-4f32-86cf-6fc37be7e2e5 admin admin] RBAC: Authorization granted {{(pid=82025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 20:06:54.817552 dv-cinder-828806-6-smb devstack@keystone.service[82025]: [pid: 82025|app: 0|req: 1320/2580] 10.222.0.33 () {60 vars in 1153 bytes} [Tue Sep 13 20:06:54 2022] POST /identity/v3/projects => generated 379 bytes in 284 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 13 20:06:54.821834 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06ea71b1-6a45-41c4-a0d0-d475f3634ee4 None None] Authenticating user token {{(pid=82026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 20:06:54.833077 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06ea71b1-6a45-41c4-a0d0-d475f3634ee4 None None] Validating token access rules against request {{(pid=82026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 20:06:54.895899 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edd9b9d1-8ba6-4502-bf5e-13de34b4ab10 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57539b6a6f3b4d589f5f5e1d211cd6a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b454f707d20347ada3d82aa85495635e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 20:06:54.896548 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edd9b9d1-8ba6-4502-bf5e-13de34b4ab10 admin admin] REQUEST_METHOD: `POST` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:06:54.896837 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edd9b9d1-8ba6-4502-bf5e-13de34b4ab10 admin admin] SCRIPT_NAME: `/identity` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:06:54.897119 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edd9b9d1-8ba6-4502-bf5e-13de34b4ab10 admin admin] PATH_INFO: `/v3/users` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:06:54.897799 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edd9b9d1-8ba6-4502-bf5e-13de34b4ab10 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 20:06:54.899820 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edd9b9d1-8ba6-4502-bf5e-13de34b4ab10 admin admin] RBAC: Authorization granted {{(pid=82026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 20:06:55.001428 dv-cinder-828806-6-smb devstack@keystone.service[82026]: [pid: 82026|app: 0|req: 1261/2581] 10.222.0.33 () {60 vars in 1144 bytes} [Tue Sep 13 20:06:54 2022] POST /identity/v3/users => generated 296 bytes in 180 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 13 20:06:55.005933 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-744cf7ae-c9c2-4f32-86cf-6fc37be7e2e5 admin admin] Authenticating user token {{(pid=82025) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 20:06:55.017954 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-744cf7ae-c9c2-4f32-86cf-6fc37be7e2e5 admin admin] Validating token access rules against request {{(pid=82025) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 20:06:55.023440 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1764665d-eaa9-4874-af61-3570a61c4bf9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57539b6a6f3b4d589f5f5e1d211cd6a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b454f707d20347ada3d82aa85495635e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82025) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 20:06:55.024049 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1764665d-eaa9-4874-af61-3570a61c4bf9 admin admin] REQUEST_METHOD: `GET` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:06:55.024332 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1764665d-eaa9-4874-af61-3570a61c4bf9 admin admin] SCRIPT_NAME: `/identity` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:06:55.024609 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1764665d-eaa9-4874-af61-3570a61c4bf9 admin admin] PATH_INFO: `/v3/roles` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:06:55.025261 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1764665d-eaa9-4874-af61-3570a61c4bf9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 20:06:55.026850 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1764665d-eaa9-4874-af61-3570a61c4bf9 admin admin] RBAC: Authorization granted {{(pid=82025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 20:06:55.047435 dv-cinder-828806-6-smb devstack@keystone.service[82025]: [pid: 82025|app: 0|req: 1321/2582] 10.222.0.33 () {58 vars in 1122 bytes} [Tue Sep 13 20:06:55 2022] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 13 20:06:55.052424 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edd9b9d1-8ba6-4502-bf5e-13de34b4ab10 admin admin] Authenticating user token {{(pid=82026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 20:06:55.062818 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edd9b9d1-8ba6-4502-bf5e-13de34b4ab10 admin admin] Validating token access rules against request {{(pid=82026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 20:06:55.068574 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef25b167-c769-4e5d-808a-99ccad89be93 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57539b6a6f3b4d589f5f5e1d211cd6a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b454f707d20347ada3d82aa85495635e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 20:06:55.069161 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef25b167-c769-4e5d-808a-99ccad89be93 admin admin] REQUEST_METHOD: `PUT` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:06:55.069445 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef25b167-c769-4e5d-808a-99ccad89be93 admin admin] SCRIPT_NAME: `/identity` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:06:55.069725 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef25b167-c769-4e5d-808a-99ccad89be93 admin admin] PATH_INFO: `/v3/projects/6d0af622aa0e4702923fa54b0a0f0cac/users/ecf9336019fd4526a16060a2f4d80327/roles/e5af7d5baa93469e9e486ef21c85474e` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:06:55.084984 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef25b167-c769-4e5d-808a-99ccad89be93 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6d0af622aa0e4702923fa54b0a0f0cac, user_id=ecf9336019fd4526a16060a2f4d80327, role_id=e5af7d5baa93469e9e486ef21c85474e)` {{(pid=82026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 20:06:55.088088 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef25b167-c769-4e5d-808a-99ccad89be93 admin admin] RBAC: Authorization granted {{(pid=82026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 20:06:55.201205 dv-cinder-828806-6-smb devstack@keystone.service[82026]: [pid: 82026|app: 0|req: 1262/2583] 10.222.0.33 () {60 vars in 1483 bytes} [Tue Sep 13 20:06:55 2022] PUT /identity/v3/projects/6d0af622aa0e4702923fa54b0a0f0cac/users/ecf9336019fd4526a16060a2f4d80327/roles/e5af7d5baa93469e9e486ef21c85474e => generated 0 bytes in 149 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 20:06:55.205283 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1764665d-eaa9-4874-af61-3570a61c4bf9 admin admin] Authenticating user token {{(pid=82025) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 20:06:55.215528 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1764665d-eaa9-4874-af61-3570a61c4bf9 admin admin] Validating token access rules against request {{(pid=82025) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 20:06:55.275423 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62628e7f-d7ee-45ae-9569-bea94f59e5b7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57539b6a6f3b4d589f5f5e1d211cd6a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b454f707d20347ada3d82aa85495635e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82025) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 20:06:55.276046 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62628e7f-d7ee-45ae-9569-bea94f59e5b7 admin admin] REQUEST_METHOD: `GET` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:06:55.276335 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62628e7f-d7ee-45ae-9569-bea94f59e5b7 admin admin] SCRIPT_NAME: `/identity` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:06:55.276623 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62628e7f-d7ee-45ae-9569-bea94f59e5b7 admin admin] PATH_INFO: `/v3/roles` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:06:55.277288 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62628e7f-d7ee-45ae-9569-bea94f59e5b7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 20:06:55.278878 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62628e7f-d7ee-45ae-9569-bea94f59e5b7 admin admin] RBAC: Authorization granted {{(pid=82025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 20:06:55.289596 dv-cinder-828806-6-smb devstack@keystone.service[82025]: [pid: 82025|app: 0|req: 1322/2584] 10.222.0.33 () {58 vars in 1122 bytes} [Tue Sep 13 20:06:55 2022] GET /identity/v3/roles => generated 1420 bytes in 85 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 13 20:06:55.293964 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef25b167-c769-4e5d-808a-99ccad89be93 admin admin] Authenticating user token {{(pid=82026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 20:06:55.299473 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG dbcounter [-] [82026] Writing DB stats keystone:SELECT=93,keystone:INSERT=7 {{(pid=82026) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 20:06:55.305841 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef25b167-c769-4e5d-808a-99ccad89be93 admin admin] Validating token access rules against request {{(pid=82026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 20:06:55.310789 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce5ce056-4d8a-40ca-b53e-4b3f1126eda2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57539b6a6f3b4d589f5f5e1d211cd6a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b454f707d20347ada3d82aa85495635e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 20:06:55.311729 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce5ce056-4d8a-40ca-b53e-4b3f1126eda2 admin admin] REQUEST_METHOD: `PUT` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:06:55.312046 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce5ce056-4d8a-40ca-b53e-4b3f1126eda2 admin admin] SCRIPT_NAME: `/identity` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:06:55.314865 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce5ce056-4d8a-40ca-b53e-4b3f1126eda2 admin admin] PATH_INFO: `/v3/projects/6d0af622aa0e4702923fa54b0a0f0cac/users/ecf9336019fd4526a16060a2f4d80327/roles/e5af7d5baa93469e9e486ef21c85474e` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:06:55.316340 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce5ce056-4d8a-40ca-b53e-4b3f1126eda2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6d0af622aa0e4702923fa54b0a0f0cac, user_id=ecf9336019fd4526a16060a2f4d80327, role_id=e5af7d5baa93469e9e486ef21c85474e)` {{(pid=82026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 20:06:55.319282 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce5ce056-4d8a-40ca-b53e-4b3f1126eda2 admin admin] RBAC: Authorization granted {{(pid=82026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 20:06:55.333669 dv-cinder-828806-6-smb devstack@keystone.service[82026]: [pid: 82026|app: 0|req: 1263/2585] 10.222.0.33 () {60 vars in 1483 bytes} [Tue Sep 13 20:06:55 2022] PUT /identity/v3/projects/6d0af622aa0e4702923fa54b0a0f0cac/users/ecf9336019fd4526a16060a2f4d80327/roles/e5af7d5baa93469e9e486ef21c85474e => generated 0 bytes in 40 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 20:06:55.343805 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-748546ff-5b9a-4359-82b7-b39efec6b9b2 None None] REQUEST_METHOD: `POST` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:06:55.344248 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-748546ff-5b9a-4359-82b7-b39efec6b9b2 None None] SCRIPT_NAME: `/identity` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:06:55.344370 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-748546ff-5b9a-4359-82b7-b39efec6b9b2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:06:55.374475 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.auth.core [None req-748546ff-5b9a-4359-82b7-b39efec6b9b2 None None] MFA Rules not processed for user `ecf9336019fd4526a16060a2f4d80327`. Rule list: `[]` (Enabled: `True`). {{(pid=82025) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 20:06:55.375767 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.fernet_utils [None req-748546ff-5b9a-4359-82b7-b39efec6b9b2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82025) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 20:06:55.422491 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG dbcounter [-] [82025] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=82025) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 20:06:55.447817 dv-cinder-828806-6-smb devstack@keystone.service[82025]: [pid: 82025|app: 0|req: 1323/2586] 10.222.0.33 () {58 vars in 958 bytes} [Tue Sep 13 20:06:55 2022] POST /identity/v3/auth/tokens => generated 3323 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 20:06:55.459579 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce5ce056-4d8a-40ca-b53e-4b3f1126eda2 admin admin] Authenticating user token {{(pid=82026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 20:06:55.461303 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.common.fernet_utils [None req-ce5ce056-4d8a-40ca-b53e-4b3f1126eda2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82026) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 20:06:55.519244 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce5ce056-4d8a-40ca-b53e-4b3f1126eda2 admin admin] Validating token access rules against request {{(pid=82026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 20:06:55.522942 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59d584ac-9f39-4e23-9a7a-210a1fb4177c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46024fc6167f4321818b1bed27a521a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8c6fba0f15b4d6a84ff601919b7b8e4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 20:06:55.523572 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59d584ac-9f39-4e23-9a7a-210a1fb4177c service cinder] REQUEST_METHOD: `GET` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:06:55.523857 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59d584ac-9f39-4e23-9a7a-210a1fb4177c service cinder] SCRIPT_NAME: `/identity` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:06:55.524135 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59d584ac-9f39-4e23-9a7a-210a1fb4177c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:06:55.584746 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59d584ac-9f39-4e23-9a7a-210a1fb4177c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=82026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 20:06:55.586145 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59d584ac-9f39-4e23-9a7a-210a1fb4177c service cinder] RBAC: Authorization granted {{(pid=82026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 20:06:55.595004 dv-cinder-828806-6-smb devstack@keystone.service[82026]: [pid: 82026|app: 0|req: 1264/2587] 10.222.0.33 () {60 vars in 1365 bytes} [Tue Sep 13 20:06:55 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 136 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 20:06:57.686984 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-748546ff-5b9a-4359-82b7-b39efec6b9b2 None None] Authenticating user token {{(pid=82025) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 20:06:57.686984 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.fernet_utils [None req-748546ff-5b9a-4359-82b7-b39efec6b9b2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82025) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 20:06:57.697924 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-748546ff-5b9a-4359-82b7-b39efec6b9b2 None None] Validating token access rules against request {{(pid=82025) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 20:06:57.701548 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0230cae8-0d5f-436d-abf6-461c87ea1ac6 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46024fc6167f4321818b1bed27a521a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8c6fba0f15b4d6a84ff601919b7b8e4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82025) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 20:06:57.702156 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0230cae8-0d5f-436d-abf6-461c87ea1ac6 service cinder] REQUEST_METHOD: `GET` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:06:57.702441 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0230cae8-0d5f-436d-abf6-461c87ea1ac6 service cinder] SCRIPT_NAME: `/identity` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:06:57.702717 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0230cae8-0d5f-436d-abf6-461c87ea1ac6 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:06:57.712281 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0230cae8-0d5f-436d-abf6-461c87ea1ac6 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=82025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 20:06:57.713717 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0230cae8-0d5f-436d-abf6-461c87ea1ac6 service cinder] RBAC: Authorization granted {{(pid=82025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 20:06:57.723931 dv-cinder-828806-6-smb devstack@keystone.service[82025]: [pid: 82025|app: 0|req: 1324/2588] 10.222.0.33 () {60 vars in 1365 bytes} [Tue Sep 13 20:06:57 2022] GET /identity/v3/auth/tokens => generated 3323 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 20:07:02.251129 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59d584ac-9f39-4e23-9a7a-210a1fb4177c service cinder] Authenticating user token {{(pid=82026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 20:07:02.312765 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59d584ac-9f39-4e23-9a7a-210a1fb4177c service cinder] Validating token access rules against request {{(pid=82026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 20:07:02.317921 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30a2f4b4-489c-49b4-a816-d49872ea4515 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57539b6a6f3b4d589f5f5e1d211cd6a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b454f707d20347ada3d82aa85495635e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 20:07:02.318539 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30a2f4b4-489c-49b4-a816-d49872ea4515 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:07:02.318819 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30a2f4b4-489c-49b4-a816-d49872ea4515 admin admin] SCRIPT_NAME: `/identity` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:07:02.319125 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30a2f4b4-489c-49b4-a816-d49872ea4515 admin admin] PATH_INFO: `/v3/users/36e6f8c1fee9416d9cd46e93b5873cf8` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:07:02.320236 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30a2f4b4-489c-49b4-a816-d49872ea4515 admin admin] RBAC: Authorizing `identity:delete_user(user_id=36e6f8c1fee9416d9cd46e93b5873cf8)` {{(pid=82026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 20:07:02.322153 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30a2f4b4-489c-49b4-a816-d49872ea4515 admin admin] RBAC: Authorization granted {{(pid=82026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 20:07:02.601241 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG dbcounter [-] [82026] Writing DB stats keystone:SELECT=92,keystone:INSERT=1,keystone:DELETE=7 {{(pid=82026) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 20:07:02.602854 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.notifications [None req-30a2f4b4-489c-49b4-a816-d49872ea4515 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '36e6f8c1fee9416d9cd46e93b5873cf8'} {{(pid=82026) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 20:07:02.697685 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.notifications [None req-30a2f4b4-489c-49b4-a816-d49872ea4515 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '36e6f8c1fee9416d9cd46e93b5873cf8'} {{(pid=82026) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 20:07:02.710344 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.notifications [None req-30a2f4b4-489c-49b4-a816-d49872ea4515 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '36e6f8c1fee9416d9cd46e93b5873cf8'} {{(pid=82026) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 20:07:02.710981 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.notifications [None req-30a2f4b4-489c-49b4-a816-d49872ea4515 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '36e6f8c1fee9416d9cd46e93b5873cf8'} {{(pid=82026) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 20:07:02.717825 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.notifications [None req-30a2f4b4-489c-49b4-a816-d49872ea4515 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '36e6f8c1fee9416d9cd46e93b5873cf8'} {{(pid=82026) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 20:07:02.724444 dv-cinder-828806-6-smb devstack@keystone.service[82026]: [pid: 82026|app: 0|req: 1265/2589] 10.222.0.33 () {58 vars in 1224 bytes} [Tue Sep 13 20:07:02 2022] DELETE /identity/v3/users/36e6f8c1fee9416d9cd46e93b5873cf8 => generated 0 bytes in 474 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 20:07:02.729021 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63dbd77a-924a-4a74-bb4b-30fa3978a11d None None] REQUEST_METHOD: `POST` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:07:02.729499 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63dbd77a-924a-4a74-bb4b-30fa3978a11d None None] SCRIPT_NAME: `/identity` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:07:02.729594 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63dbd77a-924a-4a74-bb4b-30fa3978a11d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:07:02.748176 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.auth.core [None req-63dbd77a-924a-4a74-bb4b-30fa3978a11d None None] MFA Rules not processed for user `57539b6a6f3b4d589f5f5e1d211cd6a0`. Rule list: `[]` (Enabled: `True`). {{(pid=82025) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 20:07:02.749375 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.fernet_utils [None req-63dbd77a-924a-4a74-bb4b-30fa3978a11d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82025) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 20:07:02.807552 dv-cinder-828806-6-smb devstack@keystone.service[82025]: [pid: 82025|app: 0|req: 1325/2590] 10.222.0.33 () {58 vars in 958 bytes} [Tue Sep 13 20:07:02 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 20:07:02.817643 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30a2f4b4-489c-49b4-a816-d49872ea4515 admin admin] Authenticating user token {{(pid=82026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 20:07:02.819076 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.common.fernet_utils [None req-30a2f4b4-489c-49b4-a816-d49872ea4515 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82026) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 20:07:02.876626 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30a2f4b4-489c-49b4-a816-d49872ea4515 admin admin] Validating token access rules against request {{(pid=82026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 20:07:02.880880 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc5ddc94-cf9e-4a83-aee9-6396618e6890 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '023a2c79c2444611b3d431928e56685d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8c6fba0f15b4d6a84ff601919b7b8e4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 20:07:02.881485 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc5ddc94-cf9e-4a83-aee9-6396618e6890 service neutron] REQUEST_METHOD: `GET` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:07:02.881772 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc5ddc94-cf9e-4a83-aee9-6396618e6890 service neutron] SCRIPT_NAME: `/identity` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:07:02.882051 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc5ddc94-cf9e-4a83-aee9-6396618e6890 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:07:02.891212 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc5ddc94-cf9e-4a83-aee9-6396618e6890 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 20:07:02.893181 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc5ddc94-cf9e-4a83-aee9-6396618e6890 service neutron] RBAC: Authorization granted {{(pid=82026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 20:07:02.903432 dv-cinder-828806-6-smb devstack@keystone.service[82026]: [pid: 82026|app: 0|req: 1266/2591] 10.222.0.33 () {60 vars in 1365 bytes} [Tue Sep 13 20:07:02 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 20:07:03.546161 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63dbd77a-924a-4a74-bb4b-30fa3978a11d None None] Authenticating user token {{(pid=82025) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 20:07:03.547092 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.fernet_utils [None req-63dbd77a-924a-4a74-bb4b-30fa3978a11d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82025) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 20:07:03.566076 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63dbd77a-924a-4a74-bb4b-30fa3978a11d None None] Validating token access rules against request {{(pid=82025) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 20:07:03.568002 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5ea2a64-dd7d-4ae4-9b80-40299c63f4c9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57539b6a6f3b4d589f5f5e1d211cd6a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b454f707d20347ada3d82aa85495635e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82025) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 20:07:03.568950 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5ea2a64-dd7d-4ae4-9b80-40299c63f4c9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:07:03.569334 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5ea2a64-dd7d-4ae4-9b80-40299c63f4c9 admin admin] SCRIPT_NAME: `/identity` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:07:03.569689 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5ea2a64-dd7d-4ae4-9b80-40299c63f4c9 admin admin] PATH_INFO: `/v3/projects/4b57a32cf43a48ab82333448deb14e0c` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:07:03.570971 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5ea2a64-dd7d-4ae4-9b80-40299c63f4c9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=4b57a32cf43a48ab82333448deb14e0c)` {{(pid=82025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 20:07:03.573075 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5ea2a64-dd7d-4ae4-9b80-40299c63f4c9 admin admin] RBAC: Authorization granted {{(pid=82025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 20:07:03.723833 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.notifications [None req-c5ea2a64-dd7d-4ae4-9b80-40299c63f4c9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4b57a32cf43a48ab82333448deb14e0c', 'request_id': 'req-c5ea2a64-dd7d-4ae4-9b80-40299c63f4c9'} {{(pid=82025) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 20:07:03.729440 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.notifications [None req-c5ea2a64-dd7d-4ae4-9b80-40299c63f4c9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4b57a32cf43a48ab82333448deb14e0c', 'request_id': 'req-c5ea2a64-dd7d-4ae4-9b80-40299c63f4c9'} {{(pid=82025) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 20:07:03.741887 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.notifications [None req-c5ea2a64-dd7d-4ae4-9b80-40299c63f4c9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4b57a32cf43a48ab82333448deb14e0c', 'request_id': 'req-c5ea2a64-dd7d-4ae4-9b80-40299c63f4c9'} {{(pid=82025) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 20:07:03.889013 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.notifications [None req-c5ea2a64-dd7d-4ae4-9b80-40299c63f4c9 admin admin] The token cache is being invalidate because project 4b57a32cf43a48ab82333448deb14e0c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82025) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 13 20:07:03.889013 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.notifications [None req-c5ea2a64-dd7d-4ae4-9b80-40299c63f4c9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82025) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 20:07:03.889480 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.notifications [None req-c5ea2a64-dd7d-4ae4-9b80-40299c63f4c9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82025) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 20:07:03.891051 dv-cinder-828806-6-smb devstack@keystone.service[82025]: [pid: 82025|app: 0|req: 1326/2592] 10.222.0.33 () {58 vars in 1233 bytes} [Tue Sep 13 20:07:03 2022] DELETE /identity/v3/projects/4b57a32cf43a48ab82333448deb14e0c => generated 0 bytes in 347 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 20:07:03.895349 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc5ddc94-cf9e-4a83-aee9-6396618e6890 service neutron] Authenticating user token {{(pid=82026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 20:07:03.905067 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc5ddc94-cf9e-4a83-aee9-6396618e6890 service neutron] Validating token access rules against request {{(pid=82026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 20:07:03.961327 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cee9470-e819-488f-9228-89094ae0299d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57539b6a6f3b4d589f5f5e1d211cd6a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b454f707d20347ada3d82aa85495635e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 20:07:03.961952 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cee9470-e819-488f-9228-89094ae0299d admin admin] REQUEST_METHOD: `DELETE` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:07:03.962238 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cee9470-e819-488f-9228-89094ae0299d admin admin] SCRIPT_NAME: `/identity` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:07:03.962517 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cee9470-e819-488f-9228-89094ae0299d admin admin] PATH_INFO: `/v3/users/ecf9336019fd4526a16060a2f4d80327` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:07:03.963648 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cee9470-e819-488f-9228-89094ae0299d admin admin] RBAC: Authorizing `identity:delete_user(user_id=ecf9336019fd4526a16060a2f4d80327)` {{(pid=82026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 20:07:03.965586 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cee9470-e819-488f-9228-89094ae0299d admin admin] RBAC: Authorization granted {{(pid=82026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 20:07:04.366668 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.notifications [None req-5cee9470-e819-488f-9228-89094ae0299d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ecf9336019fd4526a16060a2f4d80327'} {{(pid=82026) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 20:07:04.583064 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.notifications [None req-5cee9470-e819-488f-9228-89094ae0299d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ecf9336019fd4526a16060a2f4d80327'} {{(pid=82026) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 20:07:04.594393 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG dbcounter [-] [82026] Writing DB stats keystone:SELECT=86,keystone:INSERT=2,keystone:DELETE=12 {{(pid=82026) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 20:07:04.597167 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.notifications [None req-5cee9470-e819-488f-9228-89094ae0299d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ecf9336019fd4526a16060a2f4d80327'} {{(pid=82026) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 20:07:04.599874 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.notifications [None req-5cee9470-e819-488f-9228-89094ae0299d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ecf9336019fd4526a16060a2f4d80327'} {{(pid=82026) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 20:07:04.604917 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.notifications [None req-5cee9470-e819-488f-9228-89094ae0299d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ecf9336019fd4526a16060a2f4d80327'} {{(pid=82026) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 20:07:04.610751 dv-cinder-828806-6-smb devstack@keystone.service[82026]: [pid: 82026|app: 0|req: 1267/2593] 10.222.0.33 () {58 vars in 1224 bytes} [Tue Sep 13 20:07:03 2022] DELETE /identity/v3/users/ecf9336019fd4526a16060a2f4d80327 => generated 0 bytes in 716 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 20:07:05.220530 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5ea2a64-dd7d-4ae4-9b80-40299c63f4c9 admin admin] Authenticating user token {{(pid=82025) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 20:07:05.222038 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.fernet_utils [None req-c5ea2a64-dd7d-4ae4-9b80-40299c63f4c9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82025) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 20:07:05.235096 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5ea2a64-dd7d-4ae4-9b80-40299c63f4c9 admin admin] Validating token access rules against request {{(pid=82025) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 20:07:05.292467 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG dbcounter [-] [82025] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=82025) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 20:07:05.303451 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7f8c861-beb3-4edb-afec-51fab7c18b4d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57539b6a6f3b4d589f5f5e1d211cd6a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b454f707d20347ada3d82aa85495635e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82025) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 20:07:05.304090 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7f8c861-beb3-4edb-afec-51fab7c18b4d admin admin] REQUEST_METHOD: `DELETE` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:07:05.304380 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7f8c861-beb3-4edb-afec-51fab7c18b4d admin admin] SCRIPT_NAME: `/identity` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:07:05.304662 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7f8c861-beb3-4edb-afec-51fab7c18b4d admin admin] PATH_INFO: `/v3/projects/6d0af622aa0e4702923fa54b0a0f0cac` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:07:05.305808 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7f8c861-beb3-4edb-afec-51fab7c18b4d admin admin] RBAC: Authorizing `identity:delete_project(project_id=6d0af622aa0e4702923fa54b0a0f0cac)` {{(pid=82025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 20:07:05.307813 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7f8c861-beb3-4edb-afec-51fab7c18b4d admin admin] RBAC: Authorization granted {{(pid=82025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 20:07:05.493061 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.notifications [None req-d7f8c861-beb3-4edb-afec-51fab7c18b4d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6d0af622aa0e4702923fa54b0a0f0cac', 'request_id': 'req-d7f8c861-beb3-4edb-afec-51fab7c18b4d'} {{(pid=82025) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 20:07:05.498460 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.notifications [None req-d7f8c861-beb3-4edb-afec-51fab7c18b4d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6d0af622aa0e4702923fa54b0a0f0cac', 'request_id': 'req-d7f8c861-beb3-4edb-afec-51fab7c18b4d'} {{(pid=82025) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 20:07:05.505385 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.notifications [None req-d7f8c861-beb3-4edb-afec-51fab7c18b4d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6d0af622aa0e4702923fa54b0a0f0cac', 'request_id': 'req-d7f8c861-beb3-4edb-afec-51fab7c18b4d'} {{(pid=82025) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 20:07:05.604931 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.notifications [None req-d7f8c861-beb3-4edb-afec-51fab7c18b4d admin admin] The token cache is being invalidate because project 6d0af622aa0e4702923fa54b0a0f0cac was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82025) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 13 20:07:05.605228 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.notifications [None req-d7f8c861-beb3-4edb-afec-51fab7c18b4d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82025) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 20:07:05.605861 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.notifications [None req-d7f8c861-beb3-4edb-afec-51fab7c18b4d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82025) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 20:07:05.607404 dv-cinder-828806-6-smb devstack@keystone.service[82025]: [pid: 82025|app: 0|req: 1327/2594] 10.222.0.33 () {58 vars in 1233 bytes} [Tue Sep 13 20:07:05 2022] DELETE /identity/v3/projects/6d0af622aa0e4702923fa54b0a0f0cac => generated 0 bytes in 387 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 20:07:05.612940 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aae4f0af-d2b5-48c6-9736-78a676b9883f None None] REQUEST_METHOD: `POST` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:07:05.613457 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aae4f0af-d2b5-48c6-9736-78a676b9883f None None] SCRIPT_NAME: `/identity` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:07:05.618301 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aae4f0af-d2b5-48c6-9736-78a676b9883f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:07:05.634970 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.auth.core [None req-aae4f0af-d2b5-48c6-9736-78a676b9883f None None] MFA Rules not processed for user `57539b6a6f3b4d589f5f5e1d211cd6a0`. Rule list: `[]` (Enabled: `True`). {{(pid=82026) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 20:07:05.636280 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.common.fernet_utils [None req-aae4f0af-d2b5-48c6-9736-78a676b9883f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82026) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 20:07:05.697718 dv-cinder-828806-6-smb devstack@keystone.service[82026]: [pid: 82026|app: 0|req: 1268/2595] 10.222.0.33 () {58 vars in 958 bytes} [Tue Sep 13 20:07:05 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 20:07:05.705477 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9be3e85-4446-4788-bd5c-c93abbd5a18c None None] REQUEST_METHOD: `POST` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:07:05.705773 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9be3e85-4446-4788-bd5c-c93abbd5a18c None None] SCRIPT_NAME: `/identity` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:07:05.706062 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9be3e85-4446-4788-bd5c-c93abbd5a18c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:07:05.726765 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.auth.core [None req-c9be3e85-4446-4788-bd5c-c93abbd5a18c None None] MFA Rules not processed for user `57539b6a6f3b4d589f5f5e1d211cd6a0`. Rule list: `[]` (Enabled: `True`). {{(pid=82025) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 20:07:05.728111 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.fernet_utils [None req-c9be3e85-4446-4788-bd5c-c93abbd5a18c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82025) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 20:07:05.736199 dv-cinder-828806-6-smb devstack@keystone.service[82025]: [pid: 82025|app: 0|req: 1328/2596] 10.222.0.33 () {58 vars in 958 bytes} [Tue Sep 13 20:07:05 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 20:07:05.742190 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aae4f0af-d2b5-48c6-9736-78a676b9883f None None] Authenticating user token {{(pid=82026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 20:07:05.756866 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aae4f0af-d2b5-48c6-9736-78a676b9883f None None] Validating token access rules against request {{(pid=82026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 20:07:05.762295 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a7d81b7-b21c-4d10-9476-64b04f050c06 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57539b6a6f3b4d589f5f5e1d211cd6a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b454f707d20347ada3d82aa85495635e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 20:07:05.762902 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a7d81b7-b21c-4d10-9476-64b04f050c06 admin admin] REQUEST_METHOD: `GET` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:07:05.763220 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a7d81b7-b21c-4d10-9476-64b04f050c06 admin admin] SCRIPT_NAME: `/identity` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:07:05.763492 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a7d81b7-b21c-4d10-9476-64b04f050c06 admin admin] PATH_INFO: `/v3/domains` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:07:05.764169 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a7d81b7-b21c-4d10-9476-64b04f050c06 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82026) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 20:07:05.764457 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a7d81b7-b21c-4d10-9476-64b04f050c06 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 20:07:05.767317 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a7d81b7-b21c-4d10-9476-64b04f050c06 admin admin] RBAC: Authorization granted {{(pid=82026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 20:07:05.778919 dv-cinder-828806-6-smb devstack@keystone.service[82026]: [pid: 82026|app: 0|req: 1269/2597] 10.222.0.33 () {58 vars in 1153 bytes} [Tue Sep 13 20:07:05 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 20:07:05.783366 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9be3e85-4446-4788-bd5c-c93abbd5a18c None None] Authenticating user token {{(pid=82025) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 20:07:05.793348 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9be3e85-4446-4788-bd5c-c93abbd5a18c None None] Validating token access rules against request {{(pid=82025) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 20:07:05.799446 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d51a0b70-f7f2-429d-a35e-e6baaf081264 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57539b6a6f3b4d589f5f5e1d211cd6a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b454f707d20347ada3d82aa85495635e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82025) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 20:07:05.799446 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d51a0b70-f7f2-429d-a35e-e6baaf081264 admin admin] REQUEST_METHOD: `POST` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:07:05.799820 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d51a0b70-f7f2-429d-a35e-e6baaf081264 admin admin] SCRIPT_NAME: `/identity` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:07:05.800328 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d51a0b70-f7f2-429d-a35e-e6baaf081264 admin admin] PATH_INFO: `/v3/projects` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:07:05.801046 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d51a0b70-f7f2-429d-a35e-e6baaf081264 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 20:07:05.803517 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d51a0b70-f7f2-429d-a35e-e6baaf081264 admin admin] RBAC: Authorization granted {{(pid=82025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 20:07:05.993201 dv-cinder-828806-6-smb devstack@keystone.service[82025]: [pid: 82025|app: 0|req: 1329/2598] 10.222.0.33 () {60 vars in 1153 bytes} [Tue Sep 13 20:07:05 2022] POST /identity/v3/projects => generated 407 bytes in 210 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 13 20:07:05.997511 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a7d81b7-b21c-4d10-9476-64b04f050c06 admin admin] Authenticating user token {{(pid=82026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 20:07:06.008234 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a7d81b7-b21c-4d10-9476-64b04f050c06 admin admin] Validating token access rules against request {{(pid=82026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 20:07:06.066095 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cbb3c1b-8e03-475a-adf1-e7f07eb17f73 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57539b6a6f3b4d589f5f5e1d211cd6a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b454f707d20347ada3d82aa85495635e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 20:07:06.066712 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cbb3c1b-8e03-475a-adf1-e7f07eb17f73 admin admin] REQUEST_METHOD: `POST` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:07:06.093775 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cbb3c1b-8e03-475a-adf1-e7f07eb17f73 admin admin] SCRIPT_NAME: `/identity` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:07:06.093775 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cbb3c1b-8e03-475a-adf1-e7f07eb17f73 admin admin] PATH_INFO: `/v3/users` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:07:06.093775 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cbb3c1b-8e03-475a-adf1-e7f07eb17f73 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 20:07:06.093775 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cbb3c1b-8e03-475a-adf1-e7f07eb17f73 admin admin] RBAC: Authorization granted {{(pid=82026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 20:07:06.235315 dv-cinder-828806-6-smb devstack@keystone.service[82026]: [pid: 82026|app: 0|req: 1270/2599] 10.222.0.33 () {60 vars in 1144 bytes} [Tue Sep 13 20:07:05 2022] POST /identity/v3/users => generated 304 bytes in 238 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 13 20:07:06.240075 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d51a0b70-f7f2-429d-a35e-e6baaf081264 admin admin] Authenticating user token {{(pid=82025) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 20:07:06.250615 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d51a0b70-f7f2-429d-a35e-e6baaf081264 admin admin] Validating token access rules against request {{(pid=82025) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 20:07:06.255960 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-360c4e7c-b63c-4d39-baab-c26b3e1f9568 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57539b6a6f3b4d589f5f5e1d211cd6a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b454f707d20347ada3d82aa85495635e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82025) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 20:07:06.256567 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-360c4e7c-b63c-4d39-baab-c26b3e1f9568 admin admin] REQUEST_METHOD: `GET` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:07:06.256855 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-360c4e7c-b63c-4d39-baab-c26b3e1f9568 admin admin] SCRIPT_NAME: `/identity` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:07:06.257137 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-360c4e7c-b63c-4d39-baab-c26b3e1f9568 admin admin] PATH_INFO: `/v3/roles` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:07:06.257820 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-360c4e7c-b63c-4d39-baab-c26b3e1f9568 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 20:07:06.259530 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-360c4e7c-b63c-4d39-baab-c26b3e1f9568 admin admin] RBAC: Authorization granted {{(pid=82025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 20:07:06.270154 dv-cinder-828806-6-smb devstack@keystone.service[82025]: [pid: 82025|app: 0|req: 1330/2600] 10.222.0.33 () {58 vars in 1122 bytes} [Tue Sep 13 20:07:06 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 13 20:07:06.274092 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cbb3c1b-8e03-475a-adf1-e7f07eb17f73 admin admin] Authenticating user token {{(pid=82026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 20:07:06.284468 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cbb3c1b-8e03-475a-adf1-e7f07eb17f73 admin admin] Validating token access rules against request {{(pid=82026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 20:07:06.289063 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e394b9f-2978-41af-9fee-8b59bf641cdc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57539b6a6f3b4d589f5f5e1d211cd6a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b454f707d20347ada3d82aa85495635e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 20:07:06.289655 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e394b9f-2978-41af-9fee-8b59bf641cdc admin admin] REQUEST_METHOD: `GET` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:07:06.289937 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e394b9f-2978-41af-9fee-8b59bf641cdc admin admin] SCRIPT_NAME: `/identity` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:07:06.290209 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e394b9f-2978-41af-9fee-8b59bf641cdc admin admin] PATH_INFO: `/v3/roles` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:07:06.290856 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e394b9f-2978-41af-9fee-8b59bf641cdc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 20:07:06.292508 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e394b9f-2978-41af-9fee-8b59bf641cdc admin admin] RBAC: Authorization granted {{(pid=82026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 20:07:06.304377 dv-cinder-828806-6-smb devstack@keystone.service[82026]: [pid: 82026|app: 0|req: 1271/2601] 10.222.0.33 () {58 vars in 1122 bytes} [Tue Sep 13 20:07:06 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 13 20:07:06.308649 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-360c4e7c-b63c-4d39-baab-c26b3e1f9568 admin admin] Authenticating user token {{(pid=82025) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 20:07:06.319905 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-360c4e7c-b63c-4d39-baab-c26b3e1f9568 admin admin] Validating token access rules against request {{(pid=82025) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 20:07:06.324499 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-872dabe8-ae1f-4b21-a1eb-3ea4dc0b144e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57539b6a6f3b4d589f5f5e1d211cd6a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b454f707d20347ada3d82aa85495635e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82025) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 20:07:06.325163 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-872dabe8-ae1f-4b21-a1eb-3ea4dc0b144e admin admin] REQUEST_METHOD: `PUT` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:07:06.325442 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-872dabe8-ae1f-4b21-a1eb-3ea4dc0b144e admin admin] SCRIPT_NAME: `/identity` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:07:06.325727 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-872dabe8-ae1f-4b21-a1eb-3ea4dc0b144e admin admin] PATH_INFO: `/v3/projects/db0fc8adc8b544f4acfaff7600d0167c/users/ebeb0442066b4f68bfc896b0ca5d0de9/roles/3618ab638a65401f82333da7596d1daf` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:07:06.340485 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-872dabe8-ae1f-4b21-a1eb-3ea4dc0b144e admin admin] RBAC: Authorizing `identity:create_grant(project_id=db0fc8adc8b544f4acfaff7600d0167c, user_id=ebeb0442066b4f68bfc896b0ca5d0de9, role_id=3618ab638a65401f82333da7596d1daf)` {{(pid=82025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 20:07:06.349512 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-872dabe8-ae1f-4b21-a1eb-3ea4dc0b144e admin admin] RBAC: Authorization granted {{(pid=82025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 20:07:06.552943 dv-cinder-828806-6-smb devstack@keystone.service[82025]: [pid: 82025|app: 0|req: 1331/2602] 10.222.0.33 () {60 vars in 1483 bytes} [Tue Sep 13 20:07:06 2022] PUT /identity/v3/projects/db0fc8adc8b544f4acfaff7600d0167c/users/ebeb0442066b4f68bfc896b0ca5d0de9/roles/3618ab638a65401f82333da7596d1daf => generated 0 bytes in 245 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 20:07:06.563592 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0943c588-8052-409a-8c0d-3169fa985411 None None] REQUEST_METHOD: `POST` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:07:06.563909 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0943c588-8052-409a-8c0d-3169fa985411 None None] SCRIPT_NAME: `/identity` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:07:06.564182 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0943c588-8052-409a-8c0d-3169fa985411 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:07:06.592486 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.auth.core [None req-0943c588-8052-409a-8c0d-3169fa985411 None None] MFA Rules not processed for user `ebeb0442066b4f68bfc896b0ca5d0de9`. Rule list: `[]` (Enabled: `True`). {{(pid=82026) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 20:07:06.593726 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.common.fernet_utils [None req-0943c588-8052-409a-8c0d-3169fa985411 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82026) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 20:07:06.635859 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG dbcounter [-] [82026] Writing DB stats keystone:DELETE=1,keystone:SELECT=96,keystone:INSERT=3 {{(pid=82026) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 20:07:06.659591 dv-cinder-828806-6-smb devstack@keystone.service[82026]: [pid: 82026|app: 0|req: 1272/2603] 10.222.0.33 () {58 vars in 958 bytes} [Tue Sep 13 20:07:06 2022] POST /identity/v3/auth/tokens => generated 3284 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 20:07:06.664118 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-872dabe8-ae1f-4b21-a1eb-3ea4dc0b144e admin admin] Authenticating user token {{(pid=82025) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 20:07:06.746339 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-872dabe8-ae1f-4b21-a1eb-3ea4dc0b144e admin admin] Validating token access rules against request {{(pid=82025) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 20:07:06.751360 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d04e49e-2154-4e6d-af68-8eb75632109d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57539b6a6f3b4d589f5f5e1d211cd6a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b454f707d20347ada3d82aa85495635e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82025) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 20:07:06.752673 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d04e49e-2154-4e6d-af68-8eb75632109d admin admin] REQUEST_METHOD: `POST` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:07:06.753070 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d04e49e-2154-4e6d-af68-8eb75632109d admin admin] SCRIPT_NAME: `/identity` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:07:06.753525 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d04e49e-2154-4e6d-af68-8eb75632109d admin admin] PATH_INFO: `/v3/projects` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:07:06.754193 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d04e49e-2154-4e6d-af68-8eb75632109d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 20:07:06.756202 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d04e49e-2154-4e6d-af68-8eb75632109d admin admin] RBAC: Authorization granted {{(pid=82025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 20:07:06.963973 dv-cinder-828806-6-smb devstack@keystone.service[82025]: [pid: 82025|app: 0|req: 1332/2604] 10.222.0.33 () {60 vars in 1153 bytes} [Tue Sep 13 20:07:06 2022] POST /identity/v3/projects => generated 409 bytes in 300 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 13 20:07:06.968122 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0943c588-8052-409a-8c0d-3169fa985411 None None] Authenticating user token {{(pid=82026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 20:07:06.979849 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0943c588-8052-409a-8c0d-3169fa985411 None None] Validating token access rules against request {{(pid=82026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 20:07:07.040175 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00c7a138-74e3-4ad0-a29b-7e17f083f754 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57539b6a6f3b4d589f5f5e1d211cd6a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b454f707d20347ada3d82aa85495635e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 20:07:07.040790 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00c7a138-74e3-4ad0-a29b-7e17f083f754 admin admin] REQUEST_METHOD: `POST` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:07:07.041079 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00c7a138-74e3-4ad0-a29b-7e17f083f754 admin admin] SCRIPT_NAME: `/identity` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:07:07.041358 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00c7a138-74e3-4ad0-a29b-7e17f083f754 admin admin] PATH_INFO: `/v3/users` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:07:07.042001 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00c7a138-74e3-4ad0-a29b-7e17f083f754 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 20:07:07.043969 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00c7a138-74e3-4ad0-a29b-7e17f083f754 admin admin] RBAC: Authorization granted {{(pid=82026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 20:07:07.173047 dv-cinder-828806-6-smb devstack@keystone.service[82026]: [pid: 82026|app: 0|req: 1273/2605] 10.222.0.33 () {60 vars in 1144 bytes} [Tue Sep 13 20:07:06 2022] POST /identity/v3/users => generated 311 bytes in 205 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 13 20:07:07.177442 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d04e49e-2154-4e6d-af68-8eb75632109d admin admin] Authenticating user token {{(pid=82025) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 20:07:07.183236 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG dbcounter [-] [82025] Writing DB stats keystone:SELECT=89,keystone:DELETE=7,keystone:INSERT=4 {{(pid=82025) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 20:07:07.188922 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d04e49e-2154-4e6d-af68-8eb75632109d admin admin] Validating token access rules against request {{(pid=82025) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 20:07:07.194324 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5dfdbdb-e0e8-4165-8c40-3ada188a6f22 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57539b6a6f3b4d589f5f5e1d211cd6a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b454f707d20347ada3d82aa85495635e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82025) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 20:07:07.194941 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5dfdbdb-e0e8-4165-8c40-3ada188a6f22 admin admin] REQUEST_METHOD: `GET` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:07:07.195255 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5dfdbdb-e0e8-4165-8c40-3ada188a6f22 admin admin] SCRIPT_NAME: `/identity` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:07:07.195536 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5dfdbdb-e0e8-4165-8c40-3ada188a6f22 admin admin] PATH_INFO: `/v3/roles` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:07:07.196184 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5dfdbdb-e0e8-4165-8c40-3ada188a6f22 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 20:07:07.197780 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5dfdbdb-e0e8-4165-8c40-3ada188a6f22 admin admin] RBAC: Authorization granted {{(pid=82025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 20:07:07.208744 dv-cinder-828806-6-smb devstack@keystone.service[82025]: [pid: 82025|app: 0|req: 1333/2606] 10.222.0.33 () {58 vars in 1122 bytes} [Tue Sep 13 20:07:07 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 13 20:07:07.213569 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00c7a138-74e3-4ad0-a29b-7e17f083f754 admin admin] Authenticating user token {{(pid=82026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 20:07:07.225515 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00c7a138-74e3-4ad0-a29b-7e17f083f754 admin admin] Validating token access rules against request {{(pid=82026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 20:07:07.230170 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-169aae2f-fb47-4691-8ded-33a931847e62 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57539b6a6f3b4d589f5f5e1d211cd6a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b454f707d20347ada3d82aa85495635e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 20:07:07.230823 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-169aae2f-fb47-4691-8ded-33a931847e62 admin admin] REQUEST_METHOD: `PUT` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:07:07.231140 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-169aae2f-fb47-4691-8ded-33a931847e62 admin admin] SCRIPT_NAME: `/identity` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:07:07.231421 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-169aae2f-fb47-4691-8ded-33a931847e62 admin admin] PATH_INFO: `/v3/projects/2389f63b07444f14807bec86273472be/users/8233d571b9f34d68b9532a41cc5de8a8/roles/e5af7d5baa93469e9e486ef21c85474e` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:07:07.247546 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-169aae2f-fb47-4691-8ded-33a931847e62 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2389f63b07444f14807bec86273472be, user_id=8233d571b9f34d68b9532a41cc5de8a8, role_id=e5af7d5baa93469e9e486ef21c85474e)` {{(pid=82026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 20:07:07.250923 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-169aae2f-fb47-4691-8ded-33a931847e62 admin admin] RBAC: Authorization granted {{(pid=82026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 20:07:07.511544 dv-cinder-828806-6-smb devstack@keystone.service[82026]: [pid: 82026|app: 0|req: 1274/2607] 10.222.0.33 () {60 vars in 1483 bytes} [Tue Sep 13 20:07:07 2022] PUT /identity/v3/projects/2389f63b07444f14807bec86273472be/users/8233d571b9f34d68b9532a41cc5de8a8/roles/e5af7d5baa93469e9e486ef21c85474e => generated 0 bytes in 299 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 20:07:07.517406 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5dfdbdb-e0e8-4165-8c40-3ada188a6f22 admin admin] Authenticating user token {{(pid=82025) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 20:07:07.532793 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5dfdbdb-e0e8-4165-8c40-3ada188a6f22 admin admin] Validating token access rules against request {{(pid=82025) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 20:07:07.598724 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88d55d6b-af7a-483c-92d2-e5c367fe93ec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57539b6a6f3b4d589f5f5e1d211cd6a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b454f707d20347ada3d82aa85495635e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82025) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 20:07:07.599508 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88d55d6b-af7a-483c-92d2-e5c367fe93ec admin admin] REQUEST_METHOD: `GET` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:07:07.599796 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88d55d6b-af7a-483c-92d2-e5c367fe93ec admin admin] SCRIPT_NAME: `/identity` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:07:07.600092 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88d55d6b-af7a-483c-92d2-e5c367fe93ec admin admin] PATH_INFO: `/v3/roles` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:07:07.600752 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88d55d6b-af7a-483c-92d2-e5c367fe93ec admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 20:07:07.602348 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88d55d6b-af7a-483c-92d2-e5c367fe93ec admin admin] RBAC: Authorization granted {{(pid=82025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 20:07:07.614144 dv-cinder-828806-6-smb devstack@keystone.service[82025]: [pid: 82025|app: 0|req: 1334/2608] 10.222.0.33 () {58 vars in 1122 bytes} [Tue Sep 13 20:07:07 2022] GET /identity/v3/roles => generated 1420 bytes in 97 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 13 20:07:07.618427 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-169aae2f-fb47-4691-8ded-33a931847e62 admin admin] Authenticating user token {{(pid=82026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 20:07:07.634839 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-169aae2f-fb47-4691-8ded-33a931847e62 admin admin] Validating token access rules against request {{(pid=82026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 20:07:07.636801 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01a48718-e61f-4a4e-b3d2-581f78667b53 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57539b6a6f3b4d589f5f5e1d211cd6a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b454f707d20347ada3d82aa85495635e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 20:07:07.637467 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01a48718-e61f-4a4e-b3d2-581f78667b53 admin admin] REQUEST_METHOD: `PUT` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:07:07.637890 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01a48718-e61f-4a4e-b3d2-581f78667b53 admin admin] SCRIPT_NAME: `/identity` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:07:07.638261 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01a48718-e61f-4a4e-b3d2-581f78667b53 admin admin] PATH_INFO: `/v3/projects/2389f63b07444f14807bec86273472be/users/8233d571b9f34d68b9532a41cc5de8a8/roles/e5af7d5baa93469e9e486ef21c85474e` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:07:07.640393 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01a48718-e61f-4a4e-b3d2-581f78667b53 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2389f63b07444f14807bec86273472be, user_id=8233d571b9f34d68b9532a41cc5de8a8, role_id=e5af7d5baa93469e9e486ef21c85474e)` {{(pid=82026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 20:07:07.643473 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01a48718-e61f-4a4e-b3d2-581f78667b53 admin admin] RBAC: Authorization granted {{(pid=82026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 20:07:07.655610 dv-cinder-828806-6-smb devstack@keystone.service[82026]: [pid: 82026|app: 0|req: 1275/2609] 10.222.0.33 () {60 vars in 1483 bytes} [Tue Sep 13 20:07:07 2022] PUT /identity/v3/projects/2389f63b07444f14807bec86273472be/users/8233d571b9f34d68b9532a41cc5de8a8/roles/e5af7d5baa93469e9e486ef21c85474e => generated 0 bytes in 38 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 20:07:07.668226 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d78f8cd-5ce7-4134-bc9f-b5c2e8776644 None None] REQUEST_METHOD: `POST` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:07:07.668522 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d78f8cd-5ce7-4134-bc9f-b5c2e8776644 None None] SCRIPT_NAME: `/identity` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:07:07.668809 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d78f8cd-5ce7-4134-bc9f-b5c2e8776644 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:07:07.698713 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.auth.core [None req-3d78f8cd-5ce7-4134-bc9f-b5c2e8776644 None None] MFA Rules not processed for user `8233d571b9f34d68b9532a41cc5de8a8`. Rule list: `[]` (Enabled: `True`). {{(pid=82025) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 20:07:07.700005 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.fernet_utils [None req-3d78f8cd-5ce7-4134-bc9f-b5c2e8776644 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82025) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 20:07:07.772204 dv-cinder-828806-6-smb devstack@keystone.service[82025]: [pid: 82025|app: 0|req: 1335/2610] 10.222.0.33 () {58 vars in 958 bytes} [Tue Sep 13 20:07:07 2022] POST /identity/v3/auth/tokens => generated 3353 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 20:07:07.783706 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01a48718-e61f-4a4e-b3d2-581f78667b53 admin admin] Authenticating user token {{(pid=82026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 20:07:07.785466 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.common.fernet_utils [None req-01a48718-e61f-4a4e-b3d2-581f78667b53 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82026) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 20:07:07.844832 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01a48718-e61f-4a4e-b3d2-581f78667b53 admin admin] Validating token access rules against request {{(pid=82026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 20:07:07.849569 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-491d5948-0918-4385-bf64-c423f0984b94 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46024fc6167f4321818b1bed27a521a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8c6fba0f15b4d6a84ff601919b7b8e4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 20:07:07.850184 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-491d5948-0918-4385-bf64-c423f0984b94 service cinder] REQUEST_METHOD: `GET` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:07:07.850472 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-491d5948-0918-4385-bf64-c423f0984b94 service cinder] SCRIPT_NAME: `/identity` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:07:07.850756 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-491d5948-0918-4385-bf64-c423f0984b94 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:07:07.860069 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-491d5948-0918-4385-bf64-c423f0984b94 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=82026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 20:07:07.861512 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-491d5948-0918-4385-bf64-c423f0984b94 service cinder] RBAC: Authorization granted {{(pid=82026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 20:07:07.871073 dv-cinder-828806-6-smb devstack@keystone.service[82026]: [pid: 82026|app: 0|req: 1276/2611] 10.222.0.33 () {60 vars in 1365 bytes} [Tue Sep 13 20:07:07 2022] GET /identity/v3/auth/tokens => generated 3353 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 20:07:08.597413 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d78f8cd-5ce7-4134-bc9f-b5c2e8776644 None None] Authenticating user token {{(pid=82025) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 20:07:08.606940 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d78f8cd-5ce7-4134-bc9f-b5c2e8776644 None None] Validating token access rules against request {{(pid=82025) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 20:07:08.610461 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-185abcc9-e5c4-4c72-a7c1-d267ff76a1a1 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46024fc6167f4321818b1bed27a521a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8c6fba0f15b4d6a84ff601919b7b8e4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82025) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 20:07:08.611675 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-185abcc9-e5c4-4c72-a7c1-d267ff76a1a1 service cinder] REQUEST_METHOD: `GET` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:07:08.611957 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-185abcc9-e5c4-4c72-a7c1-d267ff76a1a1 service cinder] SCRIPT_NAME: `/identity` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:07:08.612234 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-185abcc9-e5c4-4c72-a7c1-d267ff76a1a1 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:07:08.678918 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-185abcc9-e5c4-4c72-a7c1-d267ff76a1a1 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=82025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 20:07:08.680398 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-185abcc9-e5c4-4c72-a7c1-d267ff76a1a1 service cinder] RBAC: Authorization granted {{(pid=82025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 20:07:08.690265 dv-cinder-828806-6-smb devstack@keystone.service[82025]: [pid: 82025|app: 0|req: 1336/2612] 10.222.0.33 () {60 vars in 1365 bytes} [Tue Sep 13 20:07:08 2022] GET /identity/v3/auth/tokens => generated 3284 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 20:07:16.769767 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-491d5948-0918-4385-bf64-c423f0984b94 service cinder] Authenticating user token {{(pid=82026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 20:07:16.808328 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG dbcounter [-] [82026] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=82026) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 20:07:16.832746 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-491d5948-0918-4385-bf64-c423f0984b94 service cinder] Validating token access rules against request {{(pid=82026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 20:07:16.837484 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eccb35f8-f457-47b4-b7b0-d3cdd912ac53 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57539b6a6f3b4d589f5f5e1d211cd6a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b454f707d20347ada3d82aa85495635e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 20:07:16.838150 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eccb35f8-f457-47b4-b7b0-d3cdd912ac53 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:07:16.838433 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eccb35f8-f457-47b4-b7b0-d3cdd912ac53 admin admin] SCRIPT_NAME: `/identity` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:07:16.838712 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eccb35f8-f457-47b4-b7b0-d3cdd912ac53 admin admin] PATH_INFO: `/v3/users/ebeb0442066b4f68bfc896b0ca5d0de9` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:07:16.839884 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eccb35f8-f457-47b4-b7b0-d3cdd912ac53 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ebeb0442066b4f68bfc896b0ca5d0de9)` {{(pid=82026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 20:07:16.841822 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eccb35f8-f457-47b4-b7b0-d3cdd912ac53 admin admin] RBAC: Authorization granted {{(pid=82026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 20:07:17.212562 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.notifications [None req-eccb35f8-f457-47b4-b7b0-d3cdd912ac53 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ebeb0442066b4f68bfc896b0ca5d0de9'} {{(pid=82026) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 20:07:17.423085 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.notifications [None req-eccb35f8-f457-47b4-b7b0-d3cdd912ac53 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ebeb0442066b4f68bfc896b0ca5d0de9'} {{(pid=82026) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 20:07:17.444402 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.notifications [None req-eccb35f8-f457-47b4-b7b0-d3cdd912ac53 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ebeb0442066b4f68bfc896b0ca5d0de9'} {{(pid=82026) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 20:07:17.444402 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.notifications [None req-eccb35f8-f457-47b4-b7b0-d3cdd912ac53 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ebeb0442066b4f68bfc896b0ca5d0de9'} {{(pid=82026) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 20:07:17.445458 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.notifications [None req-eccb35f8-f457-47b4-b7b0-d3cdd912ac53 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ebeb0442066b4f68bfc896b0ca5d0de9'} {{(pid=82026) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 20:07:17.451550 dv-cinder-828806-6-smb devstack@keystone.service[82026]: [pid: 82026|app: 0|req: 1277/2613] 10.222.0.33 () {58 vars in 1224 bytes} [Tue Sep 13 20:07:16 2022] DELETE /identity/v3/users/ebeb0442066b4f68bfc896b0ca5d0de9 => generated 0 bytes in 682 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 20:07:17.456916 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b87135a-73cf-49af-bc01-e375513bbca2 None None] REQUEST_METHOD: `POST` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:07:17.457435 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b87135a-73cf-49af-bc01-e375513bbca2 None None] SCRIPT_NAME: `/identity` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:07:17.457540 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b87135a-73cf-49af-bc01-e375513bbca2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:07:17.477215 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.auth.core [None req-4b87135a-73cf-49af-bc01-e375513bbca2 None None] MFA Rules not processed for user `57539b6a6f3b4d589f5f5e1d211cd6a0`. Rule list: `[]` (Enabled: `True`). {{(pid=82025) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 20:07:17.496078 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.fernet_utils [None req-4b87135a-73cf-49af-bc01-e375513bbca2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82025) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 20:07:17.496078 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG dbcounter [-] [82025] Writing DB stats keystone:SELECT=100 {{(pid=82025) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 20:07:17.539096 dv-cinder-828806-6-smb devstack@keystone.service[82025]: [pid: 82025|app: 0|req: 1337/2614] 10.222.0.33 () {58 vars in 958 bytes} [Tue Sep 13 20:07:17 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 20:07:17.553321 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eccb35f8-f457-47b4-b7b0-d3cdd912ac53 admin admin] Authenticating user token {{(pid=82026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 20:07:17.576205 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.common.fernet_utils [None req-eccb35f8-f457-47b4-b7b0-d3cdd912ac53 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82026) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 20:07:17.614238 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eccb35f8-f457-47b4-b7b0-d3cdd912ac53 admin admin] Validating token access rules against request {{(pid=82026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 20:07:17.617923 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb147965-86b1-427b-bb7b-6ce435d0e5af service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '023a2c79c2444611b3d431928e56685d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8c6fba0f15b4d6a84ff601919b7b8e4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 20:07:17.618533 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb147965-86b1-427b-bb7b-6ce435d0e5af service neutron] REQUEST_METHOD: `GET` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:07:17.618821 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb147965-86b1-427b-bb7b-6ce435d0e5af service neutron] SCRIPT_NAME: `/identity` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:07:17.619234 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb147965-86b1-427b-bb7b-6ce435d0e5af service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:07:17.639094 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb147965-86b1-427b-bb7b-6ce435d0e5af service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 20:07:17.639094 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb147965-86b1-427b-bb7b-6ce435d0e5af service neutron] RBAC: Authorization granted {{(pid=82026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 20:07:17.639682 dv-cinder-828806-6-smb devstack@keystone.service[82026]: [pid: 82026|app: 0|req: 1278/2615] 10.222.0.33 () {60 vars in 1365 bytes} [Tue Sep 13 20:07:17 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 20:07:18.224828 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b87135a-73cf-49af-bc01-e375513bbca2 None None] Authenticating user token {{(pid=82025) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 20:07:18.226399 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.fernet_utils [None req-4b87135a-73cf-49af-bc01-e375513bbca2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82025) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 20:07:18.241271 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b87135a-73cf-49af-bc01-e375513bbca2 None None] Validating token access rules against request {{(pid=82025) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 20:07:18.246618 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2de04ea7-466a-41e5-908e-0332f80cb83a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57539b6a6f3b4d589f5f5e1d211cd6a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b454f707d20347ada3d82aa85495635e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82025) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 20:07:18.247305 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2de04ea7-466a-41e5-908e-0332f80cb83a admin admin] REQUEST_METHOD: `DELETE` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:07:18.248309 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2de04ea7-466a-41e5-908e-0332f80cb83a admin admin] SCRIPT_NAME: `/identity` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:07:18.248599 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2de04ea7-466a-41e5-908e-0332f80cb83a admin admin] PATH_INFO: `/v3/projects/db0fc8adc8b544f4acfaff7600d0167c` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:07:18.250093 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2de04ea7-466a-41e5-908e-0332f80cb83a admin admin] RBAC: Authorizing `identity:delete_project(project_id=db0fc8adc8b544f4acfaff7600d0167c)` {{(pid=82025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 20:07:18.252510 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2de04ea7-466a-41e5-908e-0332f80cb83a admin admin] RBAC: Authorization granted {{(pid=82025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 20:07:18.417191 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.notifications [None req-2de04ea7-466a-41e5-908e-0332f80cb83a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'db0fc8adc8b544f4acfaff7600d0167c', 'request_id': 'req-2de04ea7-466a-41e5-908e-0332f80cb83a'} {{(pid=82025) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 20:07:18.422682 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.notifications [None req-2de04ea7-466a-41e5-908e-0332f80cb83a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'db0fc8adc8b544f4acfaff7600d0167c', 'request_id': 'req-2de04ea7-466a-41e5-908e-0332f80cb83a'} {{(pid=82025) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 20:07:18.429136 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.notifications [None req-2de04ea7-466a-41e5-908e-0332f80cb83a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'db0fc8adc8b544f4acfaff7600d0167c', 'request_id': 'req-2de04ea7-466a-41e5-908e-0332f80cb83a'} {{(pid=82025) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 20:07:18.618623 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.notifications [None req-2de04ea7-466a-41e5-908e-0332f80cb83a admin admin] The token cache is being invalidate because project db0fc8adc8b544f4acfaff7600d0167c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82025) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 13 20:07:18.619219 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.notifications [None req-2de04ea7-466a-41e5-908e-0332f80cb83a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82025) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 20:07:18.619906 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.notifications [None req-2de04ea7-466a-41e5-908e-0332f80cb83a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82025) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 20:07:18.621439 dv-cinder-828806-6-smb devstack@keystone.service[82025]: [pid: 82025|app: 0|req: 1338/2616] 10.222.0.33 () {58 vars in 1233 bytes} [Tue Sep 13 20:07:18 2022] DELETE /identity/v3/projects/db0fc8adc8b544f4acfaff7600d0167c => generated 0 bytes in 397 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 20:07:18.625437 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb147965-86b1-427b-bb7b-6ce435d0e5af service neutron] Authenticating user token {{(pid=82026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 20:07:18.635880 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb147965-86b1-427b-bb7b-6ce435d0e5af service neutron] Validating token access rules against request {{(pid=82026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 20:07:18.688957 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG dbcounter [-] [82026] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82026) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 20:07:18.695139 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc1fd9a3-72dc-43b9-87cb-81b81c839e73 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57539b6a6f3b4d589f5f5e1d211cd6a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b454f707d20347ada3d82aa85495635e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 20:07:18.695769 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc1fd9a3-72dc-43b9-87cb-81b81c839e73 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:07:18.696048 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc1fd9a3-72dc-43b9-87cb-81b81c839e73 admin admin] SCRIPT_NAME: `/identity` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:07:18.696318 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc1fd9a3-72dc-43b9-87cb-81b81c839e73 admin admin] PATH_INFO: `/v3/users/8233d571b9f34d68b9532a41cc5de8a8` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:07:18.697425 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc1fd9a3-72dc-43b9-87cb-81b81c839e73 admin admin] RBAC: Authorizing `identity:delete_user(user_id=8233d571b9f34d68b9532a41cc5de8a8)` {{(pid=82026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 20:07:18.699436 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc1fd9a3-72dc-43b9-87cb-81b81c839e73 admin admin] RBAC: Authorization granted {{(pid=82026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 20:07:18.918134 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.notifications [None req-fc1fd9a3-72dc-43b9-87cb-81b81c839e73 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8233d571b9f34d68b9532a41cc5de8a8'} {{(pid=82026) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 20:07:19.058938 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.notifications [None req-fc1fd9a3-72dc-43b9-87cb-81b81c839e73 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8233d571b9f34d68b9532a41cc5de8a8'} {{(pid=82026) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 20:07:19.073154 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.notifications [None req-fc1fd9a3-72dc-43b9-87cb-81b81c839e73 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8233d571b9f34d68b9532a41cc5de8a8'} {{(pid=82026) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 20:07:19.073819 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.notifications [None req-fc1fd9a3-72dc-43b9-87cb-81b81c839e73 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8233d571b9f34d68b9532a41cc5de8a8'} {{(pid=82026) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 20:07:19.080713 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.notifications [None req-fc1fd9a3-72dc-43b9-87cb-81b81c839e73 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8233d571b9f34d68b9532a41cc5de8a8'} {{(pid=82026) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 20:07:19.086533 dv-cinder-828806-6-smb devstack@keystone.service[82026]: [pid: 82026|app: 0|req: 1279/2617] 10.222.0.33 () {58 vars in 1224 bytes} [Tue Sep 13 20:07:18 2022] DELETE /identity/v3/users/8233d571b9f34d68b9532a41cc5de8a8 => generated 0 bytes in 462 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 20:07:19.637643 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2de04ea7-466a-41e5-908e-0332f80cb83a admin admin] Authenticating user token {{(pid=82025) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 20:07:19.639745 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.fernet_utils [None req-2de04ea7-466a-41e5-908e-0332f80cb83a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82025) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 20:07:19.655192 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2de04ea7-466a-41e5-908e-0332f80cb83a admin admin] Validating token access rules against request {{(pid=82025) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 20:07:19.715412 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a415cec-5f1c-4480-bcbd-b278ffa84e4d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57539b6a6f3b4d589f5f5e1d211cd6a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b454f707d20347ada3d82aa85495635e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82025) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 20:07:19.716167 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a415cec-5f1c-4480-bcbd-b278ffa84e4d admin admin] REQUEST_METHOD: `DELETE` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:07:19.716312 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a415cec-5f1c-4480-bcbd-b278ffa84e4d admin admin] SCRIPT_NAME: `/identity` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:07:19.716590 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a415cec-5f1c-4480-bcbd-b278ffa84e4d admin admin] PATH_INFO: `/v3/projects/2389f63b07444f14807bec86273472be` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:07:19.717716 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a415cec-5f1c-4480-bcbd-b278ffa84e4d admin admin] RBAC: Authorizing `identity:delete_project(project_id=2389f63b07444f14807bec86273472be)` {{(pid=82025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 20:07:19.720967 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a415cec-5f1c-4480-bcbd-b278ffa84e4d admin admin] RBAC: Authorization granted {{(pid=82025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 20:07:19.925498 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG dbcounter [-] [82025] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82025) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 20:07:19.934466 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.notifications [None req-1a415cec-5f1c-4480-bcbd-b278ffa84e4d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2389f63b07444f14807bec86273472be', 'request_id': 'req-1a415cec-5f1c-4480-bcbd-b278ffa84e4d'} {{(pid=82025) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 20:07:19.940424 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.notifications [None req-1a415cec-5f1c-4480-bcbd-b278ffa84e4d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2389f63b07444f14807bec86273472be', 'request_id': 'req-1a415cec-5f1c-4480-bcbd-b278ffa84e4d'} {{(pid=82025) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 20:07:19.946785 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.notifications [None req-1a415cec-5f1c-4480-bcbd-b278ffa84e4d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2389f63b07444f14807bec86273472be', 'request_id': 'req-1a415cec-5f1c-4480-bcbd-b278ffa84e4d'} {{(pid=82025) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 20:07:20.085413 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.notifications [None req-1a415cec-5f1c-4480-bcbd-b278ffa84e4d admin admin] The token cache is being invalidate because project 2389f63b07444f14807bec86273472be was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82025) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 13 20:07:20.089909 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.notifications [None req-1a415cec-5f1c-4480-bcbd-b278ffa84e4d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82025) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 20:07:20.089909 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.notifications [None req-1a415cec-5f1c-4480-bcbd-b278ffa84e4d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82025) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 20:07:20.089909 dv-cinder-828806-6-smb devstack@keystone.service[82025]: [pid: 82025|app: 0|req: 1339/2618] 10.222.0.33 () {58 vars in 1233 bytes} [Tue Sep 13 20:07:19 2022] DELETE /identity/v3/projects/2389f63b07444f14807bec86273472be => generated 0 bytes in 451 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 13 20:07:20.093221 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9036777-4bfb-4fe4-a389-d12375b1763b None None] REQUEST_METHOD: `POST` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:07:20.093706 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9036777-4bfb-4fe4-a389-d12375b1763b None None] SCRIPT_NAME: `/identity` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:07:20.093808 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9036777-4bfb-4fe4-a389-d12375b1763b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:07:20.113886 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.auth.core [None req-d9036777-4bfb-4fe4-a389-d12375b1763b None None] MFA Rules not processed for user `57539b6a6f3b4d589f5f5e1d211cd6a0`. Rule list: `[]` (Enabled: `True`). {{(pid=82026) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 20:07:20.115114 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.common.fernet_utils [None req-d9036777-4bfb-4fe4-a389-d12375b1763b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82026) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 20:07:20.174392 dv-cinder-828806-6-smb devstack@keystone.service[82026]: [pid: 82026|app: 0|req: 1280/2619] 10.222.0.33 () {58 vars in 958 bytes} [Tue Sep 13 20:07:20 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 13 20:07:20.182308 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1664121c-5464-4221-ad67-ce2c723efe18 None None] REQUEST_METHOD: `POST` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:07:20.182549 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1664121c-5464-4221-ad67-ce2c723efe18 None None] SCRIPT_NAME: `/identity` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:07:20.182834 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1664121c-5464-4221-ad67-ce2c723efe18 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:07:20.203528 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.auth.core [None req-1664121c-5464-4221-ad67-ce2c723efe18 None None] MFA Rules not processed for user `57539b6a6f3b4d589f5f5e1d211cd6a0`. Rule list: `[]` (Enabled: `True`). {{(pid=82025) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 20:07:20.206423 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.fernet_utils [None req-1664121c-5464-4221-ad67-ce2c723efe18 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82025) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 20:07:20.214581 dv-cinder-828806-6-smb devstack@keystone.service[82025]: [pid: 82025|app: 0|req: 1340/2620] 10.222.0.33 () {58 vars in 958 bytes} [Tue Sep 13 20:07:20 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 20:07:20.225440 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9036777-4bfb-4fe4-a389-d12375b1763b None None] Authenticating user token {{(pid=82026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 20:07:20.235272 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9036777-4bfb-4fe4-a389-d12375b1763b None None] Validating token access rules against request {{(pid=82026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 20:07:20.240024 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9002b1d-df66-4479-b660-283fff8de4a8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57539b6a6f3b4d589f5f5e1d211cd6a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b454f707d20347ada3d82aa85495635e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 20:07:20.240635 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9002b1d-df66-4479-b660-283fff8de4a8 admin admin] REQUEST_METHOD: `GET` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:07:20.240946 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9002b1d-df66-4479-b660-283fff8de4a8 admin admin] SCRIPT_NAME: `/identity` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:07:20.241219 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9002b1d-df66-4479-b660-283fff8de4a8 admin admin] PATH_INFO: `/v3/domains` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:07:20.241913 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9002b1d-df66-4479-b660-283fff8de4a8 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82026) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 20:07:20.242217 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9002b1d-df66-4479-b660-283fff8de4a8 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 20:07:20.243844 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9002b1d-df66-4479-b660-283fff8de4a8 admin admin] RBAC: Authorization granted {{(pid=82026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 20:07:20.256448 dv-cinder-828806-6-smb devstack@keystone.service[82026]: [pid: 82026|app: 0|req: 1281/2621] 10.222.0.33 () {58 vars in 1153 bytes} [Tue Sep 13 20:07:20 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 20:07:20.260891 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1664121c-5464-4221-ad67-ce2c723efe18 None None] Authenticating user token {{(pid=82025) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 20:07:20.271225 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1664121c-5464-4221-ad67-ce2c723efe18 None None] Validating token access rules against request {{(pid=82025) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 20:07:20.278825 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f380d7d5-fa1c-43ad-86aa-f6caafdec724 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57539b6a6f3b4d589f5f5e1d211cd6a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b454f707d20347ada3d82aa85495635e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82025) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 20:07:20.278825 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f380d7d5-fa1c-43ad-86aa-f6caafdec724 admin admin] REQUEST_METHOD: `POST` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:07:20.278825 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f380d7d5-fa1c-43ad-86aa-f6caafdec724 admin admin] SCRIPT_NAME: `/identity` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:07:20.278825 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f380d7d5-fa1c-43ad-86aa-f6caafdec724 admin admin] PATH_INFO: `/v3/projects` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:07:20.279219 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f380d7d5-fa1c-43ad-86aa-f6caafdec724 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 20:07:20.279956 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f380d7d5-fa1c-43ad-86aa-f6caafdec724 admin admin] RBAC: Authorization granted {{(pid=82025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 20:07:20.399442 dv-cinder-828806-6-smb devstack@keystone.service[82025]: [pid: 82025|app: 0|req: 1341/2622] 10.222.0.33 () {60 vars in 1153 bytes} [Tue Sep 13 20:07:20 2022] POST /identity/v3/projects => generated 367 bytes in 139 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 13 20:07:20.403933 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9002b1d-df66-4479-b660-283fff8de4a8 admin admin] Authenticating user token {{(pid=82026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 20:07:20.414891 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9002b1d-df66-4479-b660-283fff8de4a8 admin admin] Validating token access rules against request {{(pid=82026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 20:07:20.479111 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7297d682-f13c-46e0-af27-a4b136aac7a3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57539b6a6f3b4d589f5f5e1d211cd6a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b454f707d20347ada3d82aa85495635e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 20:07:20.479666 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7297d682-f13c-46e0-af27-a4b136aac7a3 admin admin] REQUEST_METHOD: `POST` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:07:20.479957 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7297d682-f13c-46e0-af27-a4b136aac7a3 admin admin] SCRIPT_NAME: `/identity` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:07:20.480241 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7297d682-f13c-46e0-af27-a4b136aac7a3 admin admin] PATH_INFO: `/v3/users` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:07:20.480897 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7297d682-f13c-46e0-af27-a4b136aac7a3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 20:07:20.482928 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7297d682-f13c-46e0-af27-a4b136aac7a3 admin admin] RBAC: Authorization granted {{(pid=82026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 20:07:20.494763 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG dbcounter [-] [82026] Writing DB stats keystone:SELECT=87,keystone:DELETE=10,keystone:INSERT=3 {{(pid=82026) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 20:07:20.596702 dv-cinder-828806-6-smb devstack@keystone.service[82026]: [pid: 82026|app: 0|req: 1282/2623] 10.222.0.33 () {60 vars in 1144 bytes} [Tue Sep 13 20:07:20 2022] POST /identity/v3/users => generated 284 bytes in 193 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 13 20:07:20.601076 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f380d7d5-fa1c-43ad-86aa-f6caafdec724 admin admin] Authenticating user token {{(pid=82025) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 20:07:20.612398 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f380d7d5-fa1c-43ad-86aa-f6caafdec724 admin admin] Validating token access rules against request {{(pid=82025) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 20:07:20.617152 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae797d25-40a9-4e89-8572-90c0b1f82d8e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57539b6a6f3b4d589f5f5e1d211cd6a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b454f707d20347ada3d82aa85495635e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82025) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 20:07:20.617769 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae797d25-40a9-4e89-8572-90c0b1f82d8e admin admin] REQUEST_METHOD: `GET` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:07:20.618052 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae797d25-40a9-4e89-8572-90c0b1f82d8e admin admin] SCRIPT_NAME: `/identity` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:07:20.618357 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae797d25-40a9-4e89-8572-90c0b1f82d8e admin admin] PATH_INFO: `/v3/roles` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:07:20.619011 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae797d25-40a9-4e89-8572-90c0b1f82d8e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 20:07:20.620652 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae797d25-40a9-4e89-8572-90c0b1f82d8e admin admin] RBAC: Authorization granted {{(pid=82025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 20:07:20.632070 dv-cinder-828806-6-smb devstack@keystone.service[82025]: [pid: 82025|app: 0|req: 1342/2624] 10.222.0.33 () {58 vars in 1122 bytes} [Tue Sep 13 20:07:20 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 13 20:07:20.636249 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7297d682-f13c-46e0-af27-a4b136aac7a3 admin admin] Authenticating user token {{(pid=82026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 20:07:20.647165 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7297d682-f13c-46e0-af27-a4b136aac7a3 admin admin] Validating token access rules against request {{(pid=82026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 20:07:20.652139 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5fd5196-41b7-416c-8002-124cb8933b40 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57539b6a6f3b4d589f5f5e1d211cd6a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b454f707d20347ada3d82aa85495635e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 20:07:20.652771 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5fd5196-41b7-416c-8002-124cb8933b40 admin admin] REQUEST_METHOD: `GET` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:07:20.653059 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5fd5196-41b7-416c-8002-124cb8933b40 admin admin] SCRIPT_NAME: `/identity` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:07:20.653341 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5fd5196-41b7-416c-8002-124cb8933b40 admin admin] PATH_INFO: `/v3/roles` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:07:20.653999 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5fd5196-41b7-416c-8002-124cb8933b40 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 20:07:20.655671 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5fd5196-41b7-416c-8002-124cb8933b40 admin admin] RBAC: Authorization granted {{(pid=82026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 20:07:20.666355 dv-cinder-828806-6-smb devstack@keystone.service[82026]: [pid: 82026|app: 0|req: 1283/2625] 10.222.0.33 () {58 vars in 1122 bytes} [Tue Sep 13 20:07:20 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 13 20:07:20.670474 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae797d25-40a9-4e89-8572-90c0b1f82d8e admin admin] Authenticating user token {{(pid=82025) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 20:07:20.681524 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae797d25-40a9-4e89-8572-90c0b1f82d8e admin admin] Validating token access rules against request {{(pid=82025) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 20:07:20.686551 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50dd2914-70b6-44f1-a36b-a85402819959 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57539b6a6f3b4d589f5f5e1d211cd6a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b454f707d20347ada3d82aa85495635e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82025) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 20:07:20.687264 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50dd2914-70b6-44f1-a36b-a85402819959 admin admin] REQUEST_METHOD: `PUT` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:07:20.687554 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50dd2914-70b6-44f1-a36b-a85402819959 admin admin] SCRIPT_NAME: `/identity` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:07:20.687831 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50dd2914-70b6-44f1-a36b-a85402819959 admin admin] PATH_INFO: `/v3/projects/7d2c0e5484e74ba6bfd9fa93f3649366/users/e4b897ff2bfb4b8fb4f8aff8a0eaf778/roles/3618ab638a65401f82333da7596d1daf` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:07:20.827158 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50dd2914-70b6-44f1-a36b-a85402819959 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7d2c0e5484e74ba6bfd9fa93f3649366, user_id=e4b897ff2bfb4b8fb4f8aff8a0eaf778, role_id=3618ab638a65401f82333da7596d1daf)` {{(pid=82025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 20:07:20.829355 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50dd2914-70b6-44f1-a36b-a85402819959 admin admin] RBAC: Authorization granted {{(pid=82025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 20:07:20.979458 dv-cinder-828806-6-smb devstack@keystone.service[82025]: [pid: 82025|app: 0|req: 1343/2626] 10.222.0.33 () {60 vars in 1483 bytes} [Tue Sep 13 20:07:20 2022] PUT /identity/v3/projects/7d2c0e5484e74ba6bfd9fa93f3649366/users/e4b897ff2bfb4b8fb4f8aff8a0eaf778/roles/3618ab638a65401f82333da7596d1daf => generated 0 bytes in 309 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 20:07:20.990557 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af171d08-22cd-4916-a806-0e474272c669 None None] REQUEST_METHOD: `POST` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:07:20.990848 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af171d08-22cd-4916-a806-0e474272c669 None None] SCRIPT_NAME: `/identity` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:07:20.991152 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af171d08-22cd-4916-a806-0e474272c669 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:07:21.018215 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.auth.core [None req-af171d08-22cd-4916-a806-0e474272c669 None None] MFA Rules not processed for user `e4b897ff2bfb4b8fb4f8aff8a0eaf778`. Rule list: `[]` (Enabled: `True`). {{(pid=82026) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 20:07:21.019551 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.common.fernet_utils [None req-af171d08-22cd-4916-a806-0e474272c669 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82026) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 20:07:21.083626 dv-cinder-828806-6-smb devstack@keystone.service[82026]: [pid: 82026|app: 0|req: 1284/2627] 10.222.0.33 () {58 vars in 958 bytes} [Tue Sep 13 20:07:20 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 20:07:21.088224 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50dd2914-70b6-44f1-a36b-a85402819959 admin admin] Authenticating user token {{(pid=82025) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 20:07:21.151539 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50dd2914-70b6-44f1-a36b-a85402819959 admin admin] Validating token access rules against request {{(pid=82025) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 20:07:21.156419 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8c702ec-f6ee-4d5e-8ed3-76a040e68645 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57539b6a6f3b4d589f5f5e1d211cd6a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b454f707d20347ada3d82aa85495635e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82025) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 20:07:21.157282 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8c702ec-f6ee-4d5e-8ed3-76a040e68645 admin admin] REQUEST_METHOD: `POST` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:07:21.157282 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8c702ec-f6ee-4d5e-8ed3-76a040e68645 admin admin] SCRIPT_NAME: `/identity` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:07:21.157575 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8c702ec-f6ee-4d5e-8ed3-76a040e68645 admin admin] PATH_INFO: `/v3/projects` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:07:21.158212 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8c702ec-f6ee-4d5e-8ed3-76a040e68645 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 20:07:21.160907 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8c702ec-f6ee-4d5e-8ed3-76a040e68645 admin admin] RBAC: Authorization granted {{(pid=82025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 20:07:21.346663 dv-cinder-828806-6-smb devstack@keystone.service[82025]: [pid: 82025|app: 0|req: 1344/2628] 10.222.0.33 () {60 vars in 1153 bytes} [Tue Sep 13 20:07:21 2022] POST /identity/v3/projects => generated 365 bytes in 259 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 13 20:07:21.351326 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af171d08-22cd-4916-a806-0e474272c669 None None] Authenticating user token {{(pid=82026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 20:07:21.362703 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af171d08-22cd-4916-a806-0e474272c669 None None] Validating token access rules against request {{(pid=82026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 20:07:21.424253 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb9bbef4-6f29-48c3-b015-f04d6518f97d None None] REQUEST_METHOD: `POST` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:07:21.424727 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb9bbef4-6f29-48c3-b015-f04d6518f97d None None] SCRIPT_NAME: `/identity` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:07:21.425184 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb9bbef4-6f29-48c3-b015-f04d6518f97d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:07:21.425302 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65ad217d-c13c-41e9-be73-b25b6308a44c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57539b6a6f3b4d589f5f5e1d211cd6a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b454f707d20347ada3d82aa85495635e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 20:07:21.425813 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65ad217d-c13c-41e9-be73-b25b6308a44c admin admin] REQUEST_METHOD: `POST` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:07:21.426097 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65ad217d-c13c-41e9-be73-b25b6308a44c admin admin] SCRIPT_NAME: `/identity` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:07:21.426379 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65ad217d-c13c-41e9-be73-b25b6308a44c admin admin] PATH_INFO: `/v3/users` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:07:21.427053 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65ad217d-c13c-41e9-be73-b25b6308a44c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 20:07:21.428979 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65ad217d-c13c-41e9-be73-b25b6308a44c admin admin] RBAC: Authorization granted {{(pid=82026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 20:07:21.445762 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.auth.core [None req-eb9bbef4-6f29-48c3-b015-f04d6518f97d None None] MFA Rules not processed for user `2f6d7f8d9db24b6fbe6b3e7663b20274`. Rule list: `[]` (Enabled: `True`). {{(pid=82025) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 20:07:21.446979 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.fernet_utils [None req-eb9bbef4-6f29-48c3-b015-f04d6518f97d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82025) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 20:07:21.488969 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG dbcounter [-] [82025] Writing DB stats keystone:SELECT=92,keystone:DELETE=4,keystone:INSERT=4 {{(pid=82025) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 20:07:21.501914 dv-cinder-828806-6-smb devstack@keystone.service[82025]: [pid: 82025|app: 0|req: 1345/2629] 10.222.0.33 () {58 vars in 958 bytes} [Tue Sep 13 20:07:21 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 20:07:21.616155 dv-cinder-828806-6-smb devstack@keystone.service[82026]: [pid: 82026|app: 0|req: 1285/2630] 10.222.0.33 () {60 vars in 1144 bytes} [Tue Sep 13 20:07:21 2022] POST /identity/v3/users => generated 289 bytes in 258 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 13 20:07:21.616378 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb9bbef4-6f29-48c3-b015-f04d6518f97d None None] Authenticating user token {{(pid=82025) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 20:07:21.629377 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb9bbef4-6f29-48c3-b015-f04d6518f97d None None] Validating token access rules against request {{(pid=82025) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 20:07:21.634181 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-897f3c31-c9bd-4a27-9411-d871a37c5157 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57539b6a6f3b4d589f5f5e1d211cd6a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b454f707d20347ada3d82aa85495635e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82025) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 20:07:21.634793 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-897f3c31-c9bd-4a27-9411-d871a37c5157 admin admin] REQUEST_METHOD: `GET` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:07:21.635170 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-897f3c31-c9bd-4a27-9411-d871a37c5157 admin admin] SCRIPT_NAME: `/identity` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:07:21.635453 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-897f3c31-c9bd-4a27-9411-d871a37c5157 admin admin] PATH_INFO: `/v3/roles` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:07:21.636104 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-897f3c31-c9bd-4a27-9411-d871a37c5157 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 20:07:21.637692 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-897f3c31-c9bd-4a27-9411-d871a37c5157 admin admin] RBAC: Authorization granted {{(pid=82025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 20:07:21.648720 dv-cinder-828806-6-smb devstack@keystone.service[82025]: [pid: 82025|app: 0|req: 1346/2631] 10.222.0.33 () {58 vars in 1122 bytes} [Tue Sep 13 20:07:21 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 13 20:07:21.653116 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65ad217d-c13c-41e9-be73-b25b6308a44c admin admin] Authenticating user token {{(pid=82026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 20:07:21.663309 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65ad217d-c13c-41e9-be73-b25b6308a44c admin admin] Validating token access rules against request {{(pid=82026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 20:07:21.667900 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01f282db-0d1a-4459-add2-59dc771bb182 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57539b6a6f3b4d589f5f5e1d211cd6a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b454f707d20347ada3d82aa85495635e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 20:07:21.668548 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01f282db-0d1a-4459-add2-59dc771bb182 admin admin] REQUEST_METHOD: `PUT` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:07:21.668832 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01f282db-0d1a-4459-add2-59dc771bb182 admin admin] SCRIPT_NAME: `/identity` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:07:21.669110 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01f282db-0d1a-4459-add2-59dc771bb182 admin admin] PATH_INFO: `/v3/projects/077ab583266046909c71030a51cd4e6f/users/e848833160c94978ad1f67575e6523a2/roles/e5af7d5baa93469e9e486ef21c85474e` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:07:21.684021 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01f282db-0d1a-4459-add2-59dc771bb182 admin admin] RBAC: Authorizing `identity:create_grant(project_id=077ab583266046909c71030a51cd4e6f, user_id=e848833160c94978ad1f67575e6523a2, role_id=e5af7d5baa93469e9e486ef21c85474e)` {{(pid=82026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 20:07:21.686957 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01f282db-0d1a-4459-add2-59dc771bb182 admin admin] RBAC: Authorization granted {{(pid=82026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 20:07:21.820728 dv-cinder-828806-6-smb devstack@keystone.service[82026]: [pid: 82026|app: 0|req: 1286/2632] 10.222.0.33 () {60 vars in 1483 bytes} [Tue Sep 13 20:07:21 2022] PUT /identity/v3/projects/077ab583266046909c71030a51cd4e6f/users/e848833160c94978ad1f67575e6523a2/roles/e5af7d5baa93469e9e486ef21c85474e => generated 0 bytes in 168 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 20:07:21.824829 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-897f3c31-c9bd-4a27-9411-d871a37c5157 admin admin] Authenticating user token {{(pid=82025) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 20:07:21.836944 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-897f3c31-c9bd-4a27-9411-d871a37c5157 admin admin] Validating token access rules against request {{(pid=82025) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 20:07:21.900144 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7311e97-709c-4f6d-aca1-ed69baba52ab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57539b6a6f3b4d589f5f5e1d211cd6a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b454f707d20347ada3d82aa85495635e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82025) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 20:07:21.900690 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7311e97-709c-4f6d-aca1-ed69baba52ab admin admin] REQUEST_METHOD: `GET` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:07:21.900979 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7311e97-709c-4f6d-aca1-ed69baba52ab admin admin] SCRIPT_NAME: `/identity` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:07:21.901257 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7311e97-709c-4f6d-aca1-ed69baba52ab admin admin] PATH_INFO: `/v3/roles` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:07:21.901911 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7311e97-709c-4f6d-aca1-ed69baba52ab admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 20:07:21.903557 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7311e97-709c-4f6d-aca1-ed69baba52ab admin admin] RBAC: Authorization granted {{(pid=82025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 20:07:21.913884 dv-cinder-828806-6-smb devstack@keystone.service[82025]: [pid: 82025|app: 0|req: 1347/2633] 10.222.0.33 () {58 vars in 1122 bytes} [Tue Sep 13 20:07:21 2022] GET /identity/v3/roles => generated 1420 bytes in 90 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 13 20:07:21.918223 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01f282db-0d1a-4459-add2-59dc771bb182 admin admin] Authenticating user token {{(pid=82026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 20:07:21.928844 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01f282db-0d1a-4459-add2-59dc771bb182 admin admin] Validating token access rules against request {{(pid=82026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 20:07:21.933520 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c303a4e0-7d66-4ae6-998d-ef96d1dab52d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57539b6a6f3b4d589f5f5e1d211cd6a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b454f707d20347ada3d82aa85495635e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 20:07:21.934167 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c303a4e0-7d66-4ae6-998d-ef96d1dab52d admin admin] REQUEST_METHOD: `PUT` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:07:21.934449 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c303a4e0-7d66-4ae6-998d-ef96d1dab52d admin admin] SCRIPT_NAME: `/identity` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:07:21.934724 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c303a4e0-7d66-4ae6-998d-ef96d1dab52d admin admin] PATH_INFO: `/v3/projects/077ab583266046909c71030a51cd4e6f/users/e848833160c94978ad1f67575e6523a2/roles/e5af7d5baa93469e9e486ef21c85474e` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:07:21.936962 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c303a4e0-7d66-4ae6-998d-ef96d1dab52d admin admin] RBAC: Authorizing `identity:create_grant(project_id=077ab583266046909c71030a51cd4e6f, user_id=e848833160c94978ad1f67575e6523a2, role_id=e5af7d5baa93469e9e486ef21c85474e)` {{(pid=82026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 20:07:21.940173 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c303a4e0-7d66-4ae6-998d-ef96d1dab52d admin admin] RBAC: Authorization granted {{(pid=82026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 20:07:21.950773 dv-cinder-828806-6-smb devstack@keystone.service[82026]: [pid: 82026|app: 0|req: 1287/2634] 10.222.0.33 () {60 vars in 1483 bytes} [Tue Sep 13 20:07:21 2022] PUT /identity/v3/projects/077ab583266046909c71030a51cd4e6f/users/e848833160c94978ad1f67575e6523a2/roles/e5af7d5baa93469e9e486ef21c85474e => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 20:07:21.963002 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-911e51c4-3527-4c64-aebf-a6decf1376ff None None] REQUEST_METHOD: `POST` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:07:21.963325 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-911e51c4-3527-4c64-aebf-a6decf1376ff None None] SCRIPT_NAME: `/identity` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:07:21.968999 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-911e51c4-3527-4c64-aebf-a6decf1376ff None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:07:21.993823 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.auth.core [None req-911e51c4-3527-4c64-aebf-a6decf1376ff None None] MFA Rules not processed for user `e848833160c94978ad1f67575e6523a2`. Rule list: `[]` (Enabled: `True`). {{(pid=82025) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 20:07:21.995112 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.fernet_utils [None req-911e51c4-3527-4c64-aebf-a6decf1376ff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82025) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 20:07:22.076814 dv-cinder-828806-6-smb devstack@keystone.service[82025]: [pid: 82025|app: 0|req: 1348/2635] 10.222.0.33 () {58 vars in 958 bytes} [Tue Sep 13 20:07:21 2022] POST /identity/v3/auth/tokens => generated 3309 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 20:07:22.088432 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c303a4e0-7d66-4ae6-998d-ef96d1dab52d admin admin] Authenticating user token {{(pid=82026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 20:07:22.090257 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.common.fernet_utils [None req-c303a4e0-7d66-4ae6-998d-ef96d1dab52d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82026) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 20:07:22.118491 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG dbcounter [-] [82026] Writing DB stats keystone:INSERT=6,keystone:SELECT=94 {{(pid=82026) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 20:07:22.148234 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c303a4e0-7d66-4ae6-998d-ef96d1dab52d admin admin] Validating token access rules against request {{(pid=82026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 20:07:22.151927 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaa6fe7b-0aa1-45ec-8fc3-cebb360e0b51 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46024fc6167f4321818b1bed27a521a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8c6fba0f15b4d6a84ff601919b7b8e4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 20:07:22.152470 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaa6fe7b-0aa1-45ec-8fc3-cebb360e0b51 service cinder] REQUEST_METHOD: `GET` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:07:22.152750 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaa6fe7b-0aa1-45ec-8fc3-cebb360e0b51 service cinder] SCRIPT_NAME: `/identity` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:07:22.153024 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaa6fe7b-0aa1-45ec-8fc3-cebb360e0b51 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:07:22.161928 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaa6fe7b-0aa1-45ec-8fc3-cebb360e0b51 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=82026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 20:07:22.163388 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaa6fe7b-0aa1-45ec-8fc3-cebb360e0b51 service cinder] RBAC: Authorization granted {{(pid=82026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 20:07:22.172642 dv-cinder-828806-6-smb devstack@keystone.service[82026]: [pid: 82026|app: 0|req: 1288/2636] 10.222.0.33 () {60 vars in 1365 bytes} [Tue Sep 13 20:07:22 2022] GET /identity/v3/auth/tokens => generated 3309 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 20:07:22.649504 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-911e51c4-3527-4c64-aebf-a6decf1376ff None None] Authenticating user token {{(pid=82025) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 20:07:22.660748 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-911e51c4-3527-4c64-aebf-a6decf1376ff None None] Validating token access rules against request {{(pid=82025) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 20:07:22.664679 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c46353ec-0ffe-4c49-ab1e-a981261a0557 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46024fc6167f4321818b1bed27a521a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8c6fba0f15b4d6a84ff601919b7b8e4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82025) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 20:07:22.665281 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c46353ec-0ffe-4c49-ab1e-a981261a0557 service cinder] REQUEST_METHOD: `GET` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:07:22.665565 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c46353ec-0ffe-4c49-ab1e-a981261a0557 service cinder] SCRIPT_NAME: `/identity` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:07:22.666461 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c46353ec-0ffe-4c49-ab1e-a981261a0557 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:07:22.725673 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c46353ec-0ffe-4c49-ab1e-a981261a0557 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=82025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 20:07:22.727043 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c46353ec-0ffe-4c49-ab1e-a981261a0557 service cinder] RBAC: Authorization granted {{(pid=82025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 20:07:22.731802 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG dbcounter [-] [82025] Writing DB stats keystone:SELECT=100 {{(pid=82025) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 20:07:22.737068 dv-cinder-828806-6-smb devstack@keystone.service[82025]: [pid: 82025|app: 0|req: 1349/2637] 10.222.0.33 () {60 vars in 1365 bytes} [Tue Sep 13 20:07:22 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 20:07:30.493509 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaa6fe7b-0aa1-45ec-8fc3-cebb360e0b51 service cinder] Authenticating user token {{(pid=82026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 20:07:30.556302 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaa6fe7b-0aa1-45ec-8fc3-cebb360e0b51 service cinder] Validating token access rules against request {{(pid=82026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 20:07:30.561530 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b4ae09c-0a8f-47d4-ad80-25980d74eef3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57539b6a6f3b4d589f5f5e1d211cd6a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b454f707d20347ada3d82aa85495635e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 20:07:30.562161 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b4ae09c-0a8f-47d4-ad80-25980d74eef3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:07:30.562445 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b4ae09c-0a8f-47d4-ad80-25980d74eef3 admin admin] SCRIPT_NAME: `/identity` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:07:30.562851 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b4ae09c-0a8f-47d4-ad80-25980d74eef3 admin admin] PATH_INFO: `/v3/users/e4b897ff2bfb4b8fb4f8aff8a0eaf778` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:07:30.564926 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b4ae09c-0a8f-47d4-ad80-25980d74eef3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e4b897ff2bfb4b8fb4f8aff8a0eaf778)` {{(pid=82026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 20:07:30.566923 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b4ae09c-0a8f-47d4-ad80-25980d74eef3 admin admin] RBAC: Authorization granted {{(pid=82026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 20:07:30.782341 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.notifications [None req-1b4ae09c-0a8f-47d4-ad80-25980d74eef3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e4b897ff2bfb4b8fb4f8aff8a0eaf778'} {{(pid=82026) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 20:07:30.920532 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.notifications [None req-1b4ae09c-0a8f-47d4-ad80-25980d74eef3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e4b897ff2bfb4b8fb4f8aff8a0eaf778'} {{(pid=82026) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 20:07:30.934255 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.notifications [None req-1b4ae09c-0a8f-47d4-ad80-25980d74eef3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e4b897ff2bfb4b8fb4f8aff8a0eaf778'} {{(pid=82026) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 20:07:30.935195 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.notifications [None req-1b4ae09c-0a8f-47d4-ad80-25980d74eef3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e4b897ff2bfb4b8fb4f8aff8a0eaf778'} {{(pid=82026) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 20:07:30.942595 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.notifications [None req-1b4ae09c-0a8f-47d4-ad80-25980d74eef3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e4b897ff2bfb4b8fb4f8aff8a0eaf778'} {{(pid=82026) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 20:07:30.948420 dv-cinder-828806-6-smb devstack@keystone.service[82026]: [pid: 82026|app: 0|req: 1289/2638] 10.222.0.33 () {58 vars in 1224 bytes} [Tue Sep 13 20:07:30 2022] DELETE /identity/v3/users/e4b897ff2bfb4b8fb4f8aff8a0eaf778 => generated 0 bytes in 455 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 20:07:30.953227 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d860924-6df5-4c14-b11f-55df97e1fcdc None None] REQUEST_METHOD: `POST` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:07:30.953705 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d860924-6df5-4c14-b11f-55df97e1fcdc None None] SCRIPT_NAME: `/identity` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:07:30.953802 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d860924-6df5-4c14-b11f-55df97e1fcdc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:07:30.972663 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.auth.core [None req-2d860924-6df5-4c14-b11f-55df97e1fcdc None None] MFA Rules not processed for user `57539b6a6f3b4d589f5f5e1d211cd6a0`. Rule list: `[]` (Enabled: `True`). {{(pid=82025) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 20:07:30.973880 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.fernet_utils [None req-2d860924-6df5-4c14-b11f-55df97e1fcdc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82025) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 20:07:31.035325 dv-cinder-828806-6-smb devstack@keystone.service[82025]: [pid: 82025|app: 0|req: 1350/2639] 10.222.0.33 () {58 vars in 958 bytes} [Tue Sep 13 20:07:30 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 20:07:31.045146 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b4ae09c-0a8f-47d4-ad80-25980d74eef3 admin admin] Authenticating user token {{(pid=82026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 20:07:31.046667 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.common.fernet_utils [None req-1b4ae09c-0a8f-47d4-ad80-25980d74eef3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82026) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 20:07:31.100621 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG dbcounter [-] [82026] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82026) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 20:07:31.106370 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b4ae09c-0a8f-47d4-ad80-25980d74eef3 admin admin] Validating token access rules against request {{(pid=82026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 20:07:31.110275 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82130dd1-db3f-4290-85e1-744d4c7931e8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '023a2c79c2444611b3d431928e56685d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8c6fba0f15b4d6a84ff601919b7b8e4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 20:07:31.114931 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82130dd1-db3f-4290-85e1-744d4c7931e8 service neutron] REQUEST_METHOD: `GET` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:07:31.114931 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82130dd1-db3f-4290-85e1-744d4c7931e8 service neutron] SCRIPT_NAME: `/identity` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:07:31.114931 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82130dd1-db3f-4290-85e1-744d4c7931e8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:07:31.121056 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82130dd1-db3f-4290-85e1-744d4c7931e8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 20:07:31.122643 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82130dd1-db3f-4290-85e1-744d4c7931e8 service neutron] RBAC: Authorization granted {{(pid=82026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 20:07:31.132636 dv-cinder-828806-6-smb devstack@keystone.service[82026]: [pid: 82026|app: 0|req: 1290/2640] 10.222.0.33 () {60 vars in 1365 bytes} [Tue Sep 13 20:07:31 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 20:07:31.573919 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d860924-6df5-4c14-b11f-55df97e1fcdc None None] Authenticating user token {{(pid=82025) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 20:07:31.575667 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.fernet_utils [None req-2d860924-6df5-4c14-b11f-55df97e1fcdc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82025) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 20:07:31.588292 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d860924-6df5-4c14-b11f-55df97e1fcdc None None] Validating token access rules against request {{(pid=82025) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 20:07:31.593343 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84234d07-461f-4713-97ad-a6012beeb284 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57539b6a6f3b4d589f5f5e1d211cd6a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b454f707d20347ada3d82aa85495635e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82025) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 20:07:31.593924 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84234d07-461f-4713-97ad-a6012beeb284 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:07:31.594136 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84234d07-461f-4713-97ad-a6012beeb284 admin admin] SCRIPT_NAME: `/identity` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:07:31.594438 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84234d07-461f-4713-97ad-a6012beeb284 admin admin] PATH_INFO: `/v3/projects/7d2c0e5484e74ba6bfd9fa93f3649366` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:07:31.595581 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84234d07-461f-4713-97ad-a6012beeb284 admin admin] RBAC: Authorizing `identity:delete_project(project_id=7d2c0e5484e74ba6bfd9fa93f3649366)` {{(pid=82025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 20:07:31.597617 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84234d07-461f-4713-97ad-a6012beeb284 admin admin] RBAC: Authorization granted {{(pid=82025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 20:07:31.801988 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.notifications [None req-84234d07-461f-4713-97ad-a6012beeb284 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7d2c0e5484e74ba6bfd9fa93f3649366', 'request_id': 'req-84234d07-461f-4713-97ad-a6012beeb284'} {{(pid=82025) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 20:07:31.807564 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.notifications [None req-84234d07-461f-4713-97ad-a6012beeb284 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7d2c0e5484e74ba6bfd9fa93f3649366', 'request_id': 'req-84234d07-461f-4713-97ad-a6012beeb284'} {{(pid=82025) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 20:07:31.814987 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.notifications [None req-84234d07-461f-4713-97ad-a6012beeb284 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7d2c0e5484e74ba6bfd9fa93f3649366', 'request_id': 'req-84234d07-461f-4713-97ad-a6012beeb284'} {{(pid=82025) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 20:07:32.029025 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.notifications [None req-84234d07-461f-4713-97ad-a6012beeb284 admin admin] The token cache is being invalidate because project 7d2c0e5484e74ba6bfd9fa93f3649366 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82025) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 13 20:07:32.029712 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.notifications [None req-84234d07-461f-4713-97ad-a6012beeb284 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82025) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 20:07:32.030001 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.notifications [None req-84234d07-461f-4713-97ad-a6012beeb284 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82025) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 20:07:32.031546 dv-cinder-828806-6-smb devstack@keystone.service[82025]: [pid: 82025|app: 0|req: 1351/2641] 10.222.0.33 () {58 vars in 1233 bytes} [Tue Sep 13 20:07:31 2022] DELETE /identity/v3/projects/7d2c0e5484e74ba6bfd9fa93f3649366 => generated 0 bytes in 458 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 13 20:07:32.035621 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82130dd1-db3f-4290-85e1-744d4c7931e8 service neutron] Authenticating user token {{(pid=82026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 20:07:32.045424 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82130dd1-db3f-4290-85e1-744d4c7931e8 service neutron] Validating token access rules against request {{(pid=82026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 20:07:32.101973 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52664640-58d7-443a-a12a-efa9966bd341 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57539b6a6f3b4d589f5f5e1d211cd6a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b454f707d20347ada3d82aa85495635e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 20:07:32.102611 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52664640-58d7-443a-a12a-efa9966bd341 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:07:32.102894 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52664640-58d7-443a-a12a-efa9966bd341 admin admin] SCRIPT_NAME: `/identity` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:07:32.103212 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52664640-58d7-443a-a12a-efa9966bd341 admin admin] PATH_INFO: `/v3/users/e848833160c94978ad1f67575e6523a2` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:07:32.104336 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52664640-58d7-443a-a12a-efa9966bd341 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e848833160c94978ad1f67575e6523a2)` {{(pid=82026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 20:07:32.106255 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52664640-58d7-443a-a12a-efa9966bd341 admin admin] RBAC: Authorization granted {{(pid=82026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 20:07:32.460663 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.notifications [None req-52664640-58d7-443a-a12a-efa9966bd341 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e848833160c94978ad1f67575e6523a2'} {{(pid=82026) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 20:07:32.546875 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.notifications [None req-52664640-58d7-443a-a12a-efa9966bd341 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e848833160c94978ad1f67575e6523a2'} {{(pid=82026) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 20:07:32.560044 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.notifications [None req-52664640-58d7-443a-a12a-efa9966bd341 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e848833160c94978ad1f67575e6523a2'} {{(pid=82026) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 20:07:32.560698 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.notifications [None req-52664640-58d7-443a-a12a-efa9966bd341 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e848833160c94978ad1f67575e6523a2'} {{(pid=82026) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 20:07:32.567816 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.notifications [None req-52664640-58d7-443a-a12a-efa9966bd341 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e848833160c94978ad1f67575e6523a2'} {{(pid=82026) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 20:07:32.573918 dv-cinder-828806-6-smb devstack@keystone.service[82026]: [pid: 82026|app: 0|req: 1291/2642] 10.222.0.33 () {58 vars in 1224 bytes} [Tue Sep 13 20:07:32 2022] DELETE /identity/v3/users/e848833160c94978ad1f67575e6523a2 => generated 0 bytes in 539 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 20:07:33.051835 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84234d07-461f-4713-97ad-a6012beeb284 admin admin] Authenticating user token {{(pid=82025) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 20:07:33.051835 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.fernet_utils [None req-84234d07-461f-4713-97ad-a6012beeb284 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82025) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 20:07:33.062466 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84234d07-461f-4713-97ad-a6012beeb284 admin admin] Validating token access rules against request {{(pid=82025) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 20:07:33.122535 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4948b63e-6b14-47fc-ba9d-e1fc5516916f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57539b6a6f3b4d589f5f5e1d211cd6a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b454f707d20347ada3d82aa85495635e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82025) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 20:07:33.123232 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4948b63e-6b14-47fc-ba9d-e1fc5516916f admin admin] REQUEST_METHOD: `DELETE` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:07:33.123518 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4948b63e-6b14-47fc-ba9d-e1fc5516916f admin admin] SCRIPT_NAME: `/identity` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:07:33.123795 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4948b63e-6b14-47fc-ba9d-e1fc5516916f admin admin] PATH_INFO: `/v3/projects/077ab583266046909c71030a51cd4e6f` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:07:33.124921 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4948b63e-6b14-47fc-ba9d-e1fc5516916f admin admin] RBAC: Authorizing `identity:delete_project(project_id=077ab583266046909c71030a51cd4e6f)` {{(pid=82025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 20:07:33.127967 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4948b63e-6b14-47fc-ba9d-e1fc5516916f admin admin] RBAC: Authorization granted {{(pid=82025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 20:07:33.281624 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG dbcounter [-] [82025] Writing DB stats keystone:SELECT=91,keystone:DELETE=8,keystone:INSERT=1 {{(pid=82025) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 20:07:33.296830 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52664640-58d7-443a-a12a-efa9966bd341 admin admin] Authenticating user token {{(pid=82026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 20:07:33.298937 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.common.fernet_utils [None req-52664640-58d7-443a-a12a-efa9966bd341 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82026) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 20:07:33.309026 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.notifications [None req-4948b63e-6b14-47fc-ba9d-e1fc5516916f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '077ab583266046909c71030a51cd4e6f', 'request_id': 'req-4948b63e-6b14-47fc-ba9d-e1fc5516916f'} {{(pid=82025) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 20:07:33.315422 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.notifications [None req-4948b63e-6b14-47fc-ba9d-e1fc5516916f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '077ab583266046909c71030a51cd4e6f', 'request_id': 'req-4948b63e-6b14-47fc-ba9d-e1fc5516916f'} {{(pid=82025) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 20:07:33.321827 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.notifications [None req-4948b63e-6b14-47fc-ba9d-e1fc5516916f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '077ab583266046909c71030a51cd4e6f', 'request_id': 'req-4948b63e-6b14-47fc-ba9d-e1fc5516916f'} {{(pid=82025) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 20:07:33.355814 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52664640-58d7-443a-a12a-efa9966bd341 admin admin] Validating token access rules against request {{(pid=82026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 20:07:33.375767 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG dbcounter [-] [82026] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82026) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 20:07:33.404344 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-041e00a7-209a-41ac-9908-be8889cefd21 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '023a2c79c2444611b3d431928e56685d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8c6fba0f15b4d6a84ff601919b7b8e4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 20:07:33.404952 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-041e00a7-209a-41ac-9908-be8889cefd21 service neutron] REQUEST_METHOD: `GET` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:07:33.405229 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-041e00a7-209a-41ac-9908-be8889cefd21 service neutron] SCRIPT_NAME: `/identity` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:07:33.405502 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-041e00a7-209a-41ac-9908-be8889cefd21 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:07:33.407285 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.common.fernet_utils [None req-041e00a7-209a-41ac-9908-be8889cefd21 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82026) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 20:07:33.446225 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.notifications [None req-4948b63e-6b14-47fc-ba9d-e1fc5516916f admin admin] The token cache is being invalidate because project 077ab583266046909c71030a51cd4e6f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82025) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 13 20:07:33.446526 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.notifications [None req-4948b63e-6b14-47fc-ba9d-e1fc5516916f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82025) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 20:07:33.447208 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.notifications [None req-4948b63e-6b14-47fc-ba9d-e1fc5516916f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82025) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 20:07:33.448851 dv-cinder-828806-6-smb devstack@keystone.service[82025]: [pid: 82025|app: 0|req: 1352/2643] 10.222.0.33 () {58 vars in 1233 bytes} [Tue Sep 13 20:07:33 2022] DELETE /identity/v3/projects/077ab583266046909c71030a51cd4e6f => generated 0 bytes in 402 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 20:07:33.453779 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b8bf9d0-98e6-430a-8477-43b7c814cc37 None None] REQUEST_METHOD: `POST` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:07:33.454073 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b8bf9d0-98e6-430a-8477-43b7c814cc37 None None] SCRIPT_NAME: `/identity` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:07:33.456453 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b8bf9d0-98e6-430a-8477-43b7c814cc37 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:07:33.471853 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-041e00a7-209a-41ac-9908-be8889cefd21 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 20:07:33.473293 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-041e00a7-209a-41ac-9908-be8889cefd21 service neutron] RBAC: Authorization granted {{(pid=82026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 20:07:33.478429 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.auth.core [None req-2b8bf9d0-98e6-430a-8477-43b7c814cc37 None None] MFA Rules not processed for user `57539b6a6f3b4d589f5f5e1d211cd6a0`. Rule list: `[]` (Enabled: `True`). {{(pid=82025) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 20:07:33.479757 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.fernet_utils [None req-2b8bf9d0-98e6-430a-8477-43b7c814cc37 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82025) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 20:07:33.488379 dv-cinder-828806-6-smb devstack@keystone.service[82026]: [pid: 82026|app: 0|req: 1292/2644] 10.222.0.33 () {60 vars in 1365 bytes} [Tue Sep 13 20:07:33 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 192 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 20:07:33.488725 dv-cinder-828806-6-smb devstack@keystone.service[82025]: [pid: 82025|app: 0|req: 1353/2645] 10.222.0.33 () {58 vars in 958 bytes} [Tue Sep 13 20:07:33 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 13 20:07:33.496872 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35e4470a-c6f1-43ca-91ff-233b98c5c42e None None] REQUEST_METHOD: `POST` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:07:33.500108 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35e4470a-c6f1-43ca-91ff-233b98c5c42e None None] SCRIPT_NAME: `/identity` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:07:33.500108 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35e4470a-c6f1-43ca-91ff-233b98c5c42e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:07:33.517869 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.auth.core [None req-35e4470a-c6f1-43ca-91ff-233b98c5c42e None None] MFA Rules not processed for user `57539b6a6f3b4d589f5f5e1d211cd6a0`. Rule list: `[]` (Enabled: `True`). {{(pid=82026) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 20:07:33.519108 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.common.fernet_utils [None req-35e4470a-c6f1-43ca-91ff-233b98c5c42e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82026) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 20:07:33.527164 dv-cinder-828806-6-smb devstack@keystone.service[82026]: [pid: 82026|app: 0|req: 1293/2646] 10.222.0.33 () {58 vars in 958 bytes} [Tue Sep 13 20:07:33 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 20:07:33.531366 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b8bf9d0-98e6-430a-8477-43b7c814cc37 None None] Authenticating user token {{(pid=82025) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 20:07:33.541534 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b8bf9d0-98e6-430a-8477-43b7c814cc37 None None] Validating token access rules against request {{(pid=82025) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 20:07:33.546914 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70961eb3-2d1a-47a2-953d-52eb1f57b53a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57539b6a6f3b4d589f5f5e1d211cd6a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b454f707d20347ada3d82aa85495635e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82025) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 20:07:33.547564 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70961eb3-2d1a-47a2-953d-52eb1f57b53a admin admin] REQUEST_METHOD: `GET` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:07:33.547848 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70961eb3-2d1a-47a2-953d-52eb1f57b53a admin admin] SCRIPT_NAME: `/identity` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:07:33.548771 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70961eb3-2d1a-47a2-953d-52eb1f57b53a admin admin] PATH_INFO: `/v3/domains` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:07:33.549609 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70961eb3-2d1a-47a2-953d-52eb1f57b53a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82025) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 20:07:33.549921 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70961eb3-2d1a-47a2-953d-52eb1f57b53a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 20:07:33.551542 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70961eb3-2d1a-47a2-953d-52eb1f57b53a admin admin] RBAC: Authorization granted {{(pid=82025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 20:07:33.565317 dv-cinder-828806-6-smb devstack@keystone.service[82025]: [pid: 82025|app: 0|req: 1354/2647] 10.222.0.33 () {58 vars in 1153 bytes} [Tue Sep 13 20:07:33 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 20:07:33.569763 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35e4470a-c6f1-43ca-91ff-233b98c5c42e None None] Authenticating user token {{(pid=82026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 20:07:33.579325 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35e4470a-c6f1-43ca-91ff-233b98c5c42e None None] Validating token access rules against request {{(pid=82026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 20:07:33.584201 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5361c032-94ab-4a9f-8f78-e92d670e1200 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57539b6a6f3b4d589f5f5e1d211cd6a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b454f707d20347ada3d82aa85495635e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 20:07:33.584825 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5361c032-94ab-4a9f-8f78-e92d670e1200 admin admin] REQUEST_METHOD: `POST` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:07:33.585100 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5361c032-94ab-4a9f-8f78-e92d670e1200 admin admin] SCRIPT_NAME: `/identity` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:07:33.585380 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5361c032-94ab-4a9f-8f78-e92d670e1200 admin admin] PATH_INFO: `/v3/projects` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:07:33.586035 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5361c032-94ab-4a9f-8f78-e92d670e1200 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 20:07:33.587990 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5361c032-94ab-4a9f-8f78-e92d670e1200 admin admin] RBAC: Authorization granted {{(pid=82026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 20:07:33.755094 dv-cinder-828806-6-smb devstack@keystone.service[82026]: [pid: 82026|app: 0|req: 1294/2648] 10.222.0.33 () {60 vars in 1153 bytes} [Tue Sep 13 20:07:33 2022] POST /identity/v3/projects => generated 381 bytes in 186 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 13 20:07:33.759301 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70961eb3-2d1a-47a2-953d-52eb1f57b53a admin admin] Authenticating user token {{(pid=82025) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 20:07:33.769911 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70961eb3-2d1a-47a2-953d-52eb1f57b53a admin admin] Validating token access rules against request {{(pid=82025) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 20:07:33.828314 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25aa5cf9-4f57-4258-8784-4d41083ef9e1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57539b6a6f3b4d589f5f5e1d211cd6a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b454f707d20347ada3d82aa85495635e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82025) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 20:07:33.828923 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25aa5cf9-4f57-4258-8784-4d41083ef9e1 admin admin] REQUEST_METHOD: `POST` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:07:33.829204 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25aa5cf9-4f57-4258-8784-4d41083ef9e1 admin admin] SCRIPT_NAME: `/identity` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:07:33.829477 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25aa5cf9-4f57-4258-8784-4d41083ef9e1 admin admin] PATH_INFO: `/v3/users` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:07:33.830303 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25aa5cf9-4f57-4258-8784-4d41083ef9e1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 20:07:33.832423 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25aa5cf9-4f57-4258-8784-4d41083ef9e1 admin admin] RBAC: Authorization granted {{(pid=82025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 20:07:33.929272 dv-cinder-828806-6-smb devstack@keystone.service[82025]: [pid: 82025|app: 0|req: 1355/2649] 10.222.0.33 () {60 vars in 1144 bytes} [Tue Sep 13 20:07:33 2022] POST /identity/v3/users => generated 291 bytes in 170 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 13 20:07:33.933481 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5361c032-94ab-4a9f-8f78-e92d670e1200 admin admin] Authenticating user token {{(pid=82026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 20:07:33.949374 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5361c032-94ab-4a9f-8f78-e92d670e1200 admin admin] Validating token access rules against request {{(pid=82026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 20:07:33.955724 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88384bce-8cbd-4850-839b-ca17472ee434 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57539b6a6f3b4d589f5f5e1d211cd6a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b454f707d20347ada3d82aa85495635e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 20:07:33.956921 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88384bce-8cbd-4850-839b-ca17472ee434 admin admin] REQUEST_METHOD: `GET` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:07:33.957399 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88384bce-8cbd-4850-839b-ca17472ee434 admin admin] SCRIPT_NAME: `/identity` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:07:33.957904 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88384bce-8cbd-4850-839b-ca17472ee434 admin admin] PATH_INFO: `/v3/roles` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:07:33.958898 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88384bce-8cbd-4850-839b-ca17472ee434 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 20:07:33.960879 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88384bce-8cbd-4850-839b-ca17472ee434 admin admin] RBAC: Authorization granted {{(pid=82026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 20:07:33.978029 dv-cinder-828806-6-smb devstack@keystone.service[82026]: [pid: 82026|app: 0|req: 1295/2650] 10.222.0.33 () {58 vars in 1122 bytes} [Tue Sep 13 20:07:33 2022] GET /identity/v3/roles => generated 1420 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 13 20:07:33.981784 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25aa5cf9-4f57-4258-8784-4d41083ef9e1 admin admin] Authenticating user token {{(pid=82025) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 20:07:33.993995 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25aa5cf9-4f57-4258-8784-4d41083ef9e1 admin admin] Validating token access rules against request {{(pid=82025) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 20:07:34.004249 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcddb7c8-0052-4453-b051-d5bf9f74ae7c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57539b6a6f3b4d589f5f5e1d211cd6a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b454f707d20347ada3d82aa85495635e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82025) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 20:07:34.005927 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcddb7c8-0052-4453-b051-d5bf9f74ae7c admin admin] REQUEST_METHOD: `GET` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:07:34.012443 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcddb7c8-0052-4453-b051-d5bf9f74ae7c admin admin] SCRIPT_NAME: `/identity` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:07:34.012443 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcddb7c8-0052-4453-b051-d5bf9f74ae7c admin admin] PATH_INFO: `/v3/roles` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:07:34.012443 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcddb7c8-0052-4453-b051-d5bf9f74ae7c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 20:07:34.012443 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcddb7c8-0052-4453-b051-d5bf9f74ae7c admin admin] RBAC: Authorization granted {{(pid=82025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 20:07:34.024994 dv-cinder-828806-6-smb devstack@keystone.service[82025]: [pid: 82025|app: 0|req: 1356/2651] 10.222.0.33 () {58 vars in 1122 bytes} [Tue Sep 13 20:07:33 2022] GET /identity/v3/roles => generated 1420 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 13 20:07:34.028891 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88384bce-8cbd-4850-839b-ca17472ee434 admin admin] Authenticating user token {{(pid=82026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 20:07:34.041700 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88384bce-8cbd-4850-839b-ca17472ee434 admin admin] Validating token access rules against request {{(pid=82026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 20:07:34.053479 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7246034f-6302-43c4-b361-41136c4f2807 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57539b6a6f3b4d589f5f5e1d211cd6a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b454f707d20347ada3d82aa85495635e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 20:07:34.053479 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7246034f-6302-43c4-b361-41136c4f2807 admin admin] REQUEST_METHOD: `PUT` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:07:34.053479 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7246034f-6302-43c4-b361-41136c4f2807 admin admin] SCRIPT_NAME: `/identity` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:07:34.053479 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7246034f-6302-43c4-b361-41136c4f2807 admin admin] PATH_INFO: `/v3/projects/8730bedfa217428fbcb7d9fb62b8da50/users/2dc02d82605b400cad23838955e325ad/roles/3618ab638a65401f82333da7596d1daf` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:07:34.072989 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7246034f-6302-43c4-b361-41136c4f2807 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8730bedfa217428fbcb7d9fb62b8da50, user_id=2dc02d82605b400cad23838955e325ad, role_id=3618ab638a65401f82333da7596d1daf)` {{(pid=82026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 20:07:34.077002 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7246034f-6302-43c4-b361-41136c4f2807 admin admin] RBAC: Authorization granted {{(pid=82026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 20:07:34.235318 dv-cinder-828806-6-smb devstack@keystone.service[82026]: [pid: 82026|app: 0|req: 1296/2652] 10.222.0.33 () {60 vars in 1483 bytes} [Tue Sep 13 20:07:34 2022] PUT /identity/v3/projects/8730bedfa217428fbcb7d9fb62b8da50/users/2dc02d82605b400cad23838955e325ad/roles/3618ab638a65401f82333da7596d1daf => generated 0 bytes in 207 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 13 20:07:34.247365 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de0b1de8-83c6-4358-9559-c01347646a19 None None] REQUEST_METHOD: `POST` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:07:34.247932 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de0b1de8-83c6-4358-9559-c01347646a19 None None] SCRIPT_NAME: `/identity` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:07:34.247932 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de0b1de8-83c6-4358-9559-c01347646a19 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:07:34.280285 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.auth.core [None req-de0b1de8-83c6-4358-9559-c01347646a19 None None] MFA Rules not processed for user `2dc02d82605b400cad23838955e325ad`. Rule list: `[]` (Enabled: `True`). {{(pid=82025) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 20:07:34.281649 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.fernet_utils [None req-de0b1de8-83c6-4358-9559-c01347646a19 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82025) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 20:07:34.357782 dv-cinder-828806-6-smb devstack@keystone.service[82025]: [pid: 82025|app: 0|req: 1357/2653] 10.222.0.33 () {58 vars in 958 bytes} [Tue Sep 13 20:07:34 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 20:07:34.362904 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7246034f-6302-43c4-b361-41136c4f2807 admin admin] Authenticating user token {{(pid=82026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 20:07:34.426926 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7246034f-6302-43c4-b361-41136c4f2807 admin admin] Validating token access rules against request {{(pid=82026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 20:07:34.431653 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcdca918-500a-4e73-b767-9b8f24aaf145 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57539b6a6f3b4d589f5f5e1d211cd6a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b454f707d20347ada3d82aa85495635e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 20:07:34.432254 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcdca918-500a-4e73-b767-9b8f24aaf145 admin admin] REQUEST_METHOD: `POST` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:07:34.432538 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcdca918-500a-4e73-b767-9b8f24aaf145 admin admin] SCRIPT_NAME: `/identity` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:07:34.432812 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcdca918-500a-4e73-b767-9b8f24aaf145 admin admin] PATH_INFO: `/v3/projects` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:07:34.433440 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcdca918-500a-4e73-b767-9b8f24aaf145 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 20:07:34.435671 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcdca918-500a-4e73-b767-9b8f24aaf145 admin admin] RBAC: Authorization granted {{(pid=82026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 20:07:34.586995 dv-cinder-828806-6-smb devstack@keystone.service[82026]: [pid: 82026|app: 0|req: 1297/2654] 10.222.0.33 () {60 vars in 1153 bytes} [Tue Sep 13 20:07:34 2022] POST /identity/v3/projects => generated 379 bytes in 222 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 13 20:07:34.588317 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de0b1de8-83c6-4358-9559-c01347646a19 None None] Authenticating user token {{(pid=82025) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 20:07:34.601606 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG dbcounter [-] [82025] Writing DB stats keystone:DELETE=6,keystone:SELECT=90,keystone:INSERT=4 {{(pid=82025) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 20:07:34.606221 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de0b1de8-83c6-4358-9559-c01347646a19 None None] Validating token access rules against request {{(pid=82025) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 20:07:34.650847 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG dbcounter [-] [82026] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=82026) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 20:07:34.677806 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-020ec6f5-45ac-468f-b316-4f6cf86ea8cc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57539b6a6f3b4d589f5f5e1d211cd6a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b454f707d20347ada3d82aa85495635e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82025) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 20:07:34.678571 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-020ec6f5-45ac-468f-b316-4f6cf86ea8cc admin admin] REQUEST_METHOD: `POST` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:07:34.678955 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-020ec6f5-45ac-468f-b316-4f6cf86ea8cc admin admin] SCRIPT_NAME: `/identity` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:07:34.679371 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-020ec6f5-45ac-468f-b316-4f6cf86ea8cc admin admin] PATH_INFO: `/v3/users` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:07:34.680115 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-020ec6f5-45ac-468f-b316-4f6cf86ea8cc admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 20:07:34.682951 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-020ec6f5-45ac-468f-b316-4f6cf86ea8cc admin admin] RBAC: Authorization granted {{(pid=82025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 20:07:34.775610 dv-cinder-828806-6-smb devstack@keystone.service[82025]: [pid: 82025|app: 0|req: 1358/2655] 10.222.0.33 () {60 vars in 1144 bytes} [Tue Sep 13 20:07:34 2022] POST /identity/v3/users => generated 296 bytes in 188 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 13 20:07:34.779635 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcdca918-500a-4e73-b767-9b8f24aaf145 admin admin] Authenticating user token {{(pid=82026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 20:07:34.790359 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcdca918-500a-4e73-b767-9b8f24aaf145 admin admin] Validating token access rules against request {{(pid=82026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 20:07:34.795110 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf52572e-7e5d-4fd3-801b-c8680c1f0e94 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57539b6a6f3b4d589f5f5e1d211cd6a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b454f707d20347ada3d82aa85495635e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 20:07:34.795797 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf52572e-7e5d-4fd3-801b-c8680c1f0e94 admin admin] REQUEST_METHOD: `GET` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:07:34.796150 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf52572e-7e5d-4fd3-801b-c8680c1f0e94 admin admin] SCRIPT_NAME: `/identity` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:07:34.796500 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf52572e-7e5d-4fd3-801b-c8680c1f0e94 admin admin] PATH_INFO: `/v3/roles` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:07:34.797230 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf52572e-7e5d-4fd3-801b-c8680c1f0e94 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 20:07:34.799652 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf52572e-7e5d-4fd3-801b-c8680c1f0e94 admin admin] RBAC: Authorization granted {{(pid=82026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 20:07:34.811735 dv-cinder-828806-6-smb devstack@keystone.service[82026]: [pid: 82026|app: 0|req: 1298/2656] 10.222.0.33 () {58 vars in 1122 bytes} [Tue Sep 13 20:07:34 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 13 20:07:34.816641 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-020ec6f5-45ac-468f-b316-4f6cf86ea8cc admin admin] Authenticating user token {{(pid=82025) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 20:07:34.826692 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-020ec6f5-45ac-468f-b316-4f6cf86ea8cc admin admin] Validating token access rules against request {{(pid=82025) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 20:07:34.831577 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01f7fef9-9dc1-4d8a-9f6e-a6d6326ab50d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57539b6a6f3b4d589f5f5e1d211cd6a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b454f707d20347ada3d82aa85495635e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82025) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 20:07:34.832180 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01f7fef9-9dc1-4d8a-9f6e-a6d6326ab50d admin admin] REQUEST_METHOD: `PUT` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:07:34.832464 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01f7fef9-9dc1-4d8a-9f6e-a6d6326ab50d admin admin] SCRIPT_NAME: `/identity` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:07:34.832745 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01f7fef9-9dc1-4d8a-9f6e-a6d6326ab50d admin admin] PATH_INFO: `/v3/projects/ae793372ceca4ed0966db07b729b20a4/users/db2ba7c7804c475da2a963d4e0511d1c/roles/e5af7d5baa93469e9e486ef21c85474e` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:07:34.847801 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01f7fef9-9dc1-4d8a-9f6e-a6d6326ab50d admin admin] RBAC: Authorizing `identity:create_grant(project_id=ae793372ceca4ed0966db07b729b20a4, user_id=db2ba7c7804c475da2a963d4e0511d1c, role_id=e5af7d5baa93469e9e486ef21c85474e)` {{(pid=82025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 20:07:34.850456 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01f7fef9-9dc1-4d8a-9f6e-a6d6326ab50d admin admin] RBAC: Authorization granted {{(pid=82025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 20:07:34.936728 dv-cinder-828806-6-smb devstack@keystone.service[82025]: [pid: 82025|app: 0|req: 1359/2657] 10.222.0.33 () {60 vars in 1483 bytes} [Tue Sep 13 20:07:34 2022] PUT /identity/v3/projects/ae793372ceca4ed0966db07b729b20a4/users/db2ba7c7804c475da2a963d4e0511d1c/roles/e5af7d5baa93469e9e486ef21c85474e => generated 0 bytes in 121 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 20:07:34.941665 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf52572e-7e5d-4fd3-801b-c8680c1f0e94 admin admin] Authenticating user token {{(pid=82026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 20:07:34.951941 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf52572e-7e5d-4fd3-801b-c8680c1f0e94 admin admin] Validating token access rules against request {{(pid=82026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 20:07:35.009720 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac64cd4f-ad20-4657-a471-8291d9789d37 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57539b6a6f3b4d589f5f5e1d211cd6a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b454f707d20347ada3d82aa85495635e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 20:07:35.010329 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac64cd4f-ad20-4657-a471-8291d9789d37 admin admin] REQUEST_METHOD: `GET` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:07:35.010610 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac64cd4f-ad20-4657-a471-8291d9789d37 admin admin] SCRIPT_NAME: `/identity` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:07:35.010886 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac64cd4f-ad20-4657-a471-8291d9789d37 admin admin] PATH_INFO: `/v3/roles` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:07:35.011559 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac64cd4f-ad20-4657-a471-8291d9789d37 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 20:07:35.013193 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac64cd4f-ad20-4657-a471-8291d9789d37 admin admin] RBAC: Authorization granted {{(pid=82026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 20:07:35.023672 dv-cinder-828806-6-smb devstack@keystone.service[82026]: [pid: 82026|app: 0|req: 1299/2658] 10.222.0.33 () {58 vars in 1122 bytes} [Tue Sep 13 20:07:34 2022] GET /identity/v3/roles => generated 1420 bytes in 82 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 13 20:07:35.028077 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01f7fef9-9dc1-4d8a-9f6e-a6d6326ab50d admin admin] Authenticating user token {{(pid=82025) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 20:07:35.042181 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01f7fef9-9dc1-4d8a-9f6e-a6d6326ab50d admin admin] Validating token access rules against request {{(pid=82025) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 20:07:35.047547 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3daf3e5-e99d-40a3-8c33-07f030714d0b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57539b6a6f3b4d589f5f5e1d211cd6a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b454f707d20347ada3d82aa85495635e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82025) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 20:07:35.048588 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3daf3e5-e99d-40a3-8c33-07f030714d0b admin admin] REQUEST_METHOD: `PUT` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:07:35.048945 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3daf3e5-e99d-40a3-8c33-07f030714d0b admin admin] SCRIPT_NAME: `/identity` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:07:35.049437 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3daf3e5-e99d-40a3-8c33-07f030714d0b admin admin] PATH_INFO: `/v3/projects/ae793372ceca4ed0966db07b729b20a4/users/db2ba7c7804c475da2a963d4e0511d1c/roles/e5af7d5baa93469e9e486ef21c85474e` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:07:35.051642 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3daf3e5-e99d-40a3-8c33-07f030714d0b admin admin] RBAC: Authorizing `identity:create_grant(project_id=ae793372ceca4ed0966db07b729b20a4, user_id=db2ba7c7804c475da2a963d4e0511d1c, role_id=e5af7d5baa93469e9e486ef21c85474e)` {{(pid=82025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 20:07:35.054616 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3daf3e5-e99d-40a3-8c33-07f030714d0b admin admin] RBAC: Authorization granted {{(pid=82025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 20:07:35.067568 dv-cinder-828806-6-smb devstack@keystone.service[82025]: [pid: 82025|app: 0|req: 1360/2659] 10.222.0.33 () {60 vars in 1483 bytes} [Tue Sep 13 20:07:35 2022] PUT /identity/v3/projects/ae793372ceca4ed0966db07b729b20a4/users/db2ba7c7804c475da2a963d4e0511d1c/roles/e5af7d5baa93469e9e486ef21c85474e => generated 0 bytes in 39 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 13 20:07:35.083003 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3cd7a44-7a07-42fd-ae71-0986cc86553f None None] REQUEST_METHOD: `POST` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:07:35.083383 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3cd7a44-7a07-42fd-ae71-0986cc86553f None None] SCRIPT_NAME: `/identity` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:07:35.083761 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3cd7a44-7a07-42fd-ae71-0986cc86553f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:07:35.117856 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.auth.core [None req-e3cd7a44-7a07-42fd-ae71-0986cc86553f None None] MFA Rules not processed for user `db2ba7c7804c475da2a963d4e0511d1c`. Rule list: `[]` (Enabled: `True`). {{(pid=82026) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 20:07:35.120172 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.common.fernet_utils [None req-e3cd7a44-7a07-42fd-ae71-0986cc86553f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82026) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 20:07:35.212976 dv-cinder-828806-6-smb devstack@keystone.service[82026]: [pid: 82026|app: 0|req: 1300/2660] 10.222.0.33 () {58 vars in 958 bytes} [Tue Sep 13 20:07:35 2022] POST /identity/v3/auth/tokens => generated 3323 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 20:07:35.228479 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3daf3e5-e99d-40a3-8c33-07f030714d0b admin admin] Authenticating user token {{(pid=82025) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 20:07:35.230452 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.fernet_utils [None req-a3daf3e5-e99d-40a3-8c33-07f030714d0b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82025) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 20:07:35.319588 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3daf3e5-e99d-40a3-8c33-07f030714d0b admin admin] Validating token access rules against request {{(pid=82025) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 20:07:35.342614 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-965c1b74-5496-4b87-90f6-251c13e83412 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46024fc6167f4321818b1bed27a521a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8c6fba0f15b4d6a84ff601919b7b8e4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82025) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 20:07:35.342614 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-965c1b74-5496-4b87-90f6-251c13e83412 service cinder] REQUEST_METHOD: `GET` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:07:35.342614 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-965c1b74-5496-4b87-90f6-251c13e83412 service cinder] SCRIPT_NAME: `/identity` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:07:35.342614 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-965c1b74-5496-4b87-90f6-251c13e83412 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:07:35.343094 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-965c1b74-5496-4b87-90f6-251c13e83412 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=82025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 20:07:35.343094 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-965c1b74-5496-4b87-90f6-251c13e83412 service cinder] RBAC: Authorization granted {{(pid=82025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 20:07:35.348081 dv-cinder-828806-6-smb devstack@keystone.service[82025]: [pid: 82025|app: 0|req: 1361/2661] 10.222.0.33 () {60 vars in 1365 bytes} [Tue Sep 13 20:07:35 2022] GET /identity/v3/auth/tokens => generated 3323 bytes in 120 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 20:07:36.027805 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3cd7a44-7a07-42fd-ae71-0986cc86553f None None] Authenticating user token {{(pid=82026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 20:07:36.105322 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3cd7a44-7a07-42fd-ae71-0986cc86553f None None] Validating token access rules against request {{(pid=82026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 20:07:36.110274 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30c8418e-517e-41f2-bcb5-c10828bcfdf5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57539b6a6f3b4d589f5f5e1d211cd6a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b454f707d20347ada3d82aa85495635e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 20:07:36.111155 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30c8418e-517e-41f2-bcb5-c10828bcfdf5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:07:36.111446 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30c8418e-517e-41f2-bcb5-c10828bcfdf5 admin admin] SCRIPT_NAME: `/identity` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:07:36.111735 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30c8418e-517e-41f2-bcb5-c10828bcfdf5 admin admin] PATH_INFO: `/v3/users/2dc02d82605b400cad23838955e325ad` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:07:36.113111 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30c8418e-517e-41f2-bcb5-c10828bcfdf5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=2dc02d82605b400cad23838955e325ad)` {{(pid=82026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 20:07:36.116020 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30c8418e-517e-41f2-bcb5-c10828bcfdf5 admin admin] RBAC: Authorization granted {{(pid=82026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 20:07:36.138816 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG dbcounter [-] [82026] Writing DB stats keystone:SELECT=100 {{(pid=82026) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 20:07:36.449549 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.notifications [None req-30c8418e-517e-41f2-bcb5-c10828bcfdf5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2dc02d82605b400cad23838955e325ad'} {{(pid=82026) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 20:07:36.629234 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.notifications [None req-30c8418e-517e-41f2-bcb5-c10828bcfdf5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2dc02d82605b400cad23838955e325ad'} {{(pid=82026) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 20:07:36.644539 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.notifications [None req-30c8418e-517e-41f2-bcb5-c10828bcfdf5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2dc02d82605b400cad23838955e325ad'} {{(pid=82026) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 20:07:36.645269 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.notifications [None req-30c8418e-517e-41f2-bcb5-c10828bcfdf5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2dc02d82605b400cad23838955e325ad'} {{(pid=82026) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 20:07:36.652693 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.notifications [None req-30c8418e-517e-41f2-bcb5-c10828bcfdf5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2dc02d82605b400cad23838955e325ad'} {{(pid=82026) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 20:07:36.660940 dv-cinder-828806-6-smb devstack@keystone.service[82026]: [pid: 82026|app: 0|req: 1301/2662] 10.222.0.33 () {58 vars in 1224 bytes} [Tue Sep 13 20:07:36 2022] DELETE /identity/v3/users/2dc02d82605b400cad23838955e325ad => generated 0 bytes in 634 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 20:07:36.665519 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93bd295f-104d-466f-875a-41fa45872b48 None None] REQUEST_METHOD: `POST` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:07:36.666457 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93bd295f-104d-466f-875a-41fa45872b48 None None] SCRIPT_NAME: `/identity` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:07:36.666788 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93bd295f-104d-466f-875a-41fa45872b48 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:07:36.689093 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.auth.core [None req-93bd295f-104d-466f-875a-41fa45872b48 None None] MFA Rules not processed for user `57539b6a6f3b4d589f5f5e1d211cd6a0`. Rule list: `[]` (Enabled: `True`). {{(pid=82025) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 20:07:36.690474 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.fernet_utils [None req-93bd295f-104d-466f-875a-41fa45872b48 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82025) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 20:07:36.751561 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG dbcounter [-] [82025] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=82025) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 20:07:36.760964 dv-cinder-828806-6-smb devstack@keystone.service[82025]: [pid: 82025|app: 0|req: 1362/2663] 10.222.0.33 () {58 vars in 958 bytes} [Tue Sep 13 20:07:36 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 20:07:36.771131 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30c8418e-517e-41f2-bcb5-c10828bcfdf5 admin admin] Authenticating user token {{(pid=82026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 20:07:36.772924 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.common.fernet_utils [None req-30c8418e-517e-41f2-bcb5-c10828bcfdf5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82026) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 20:07:36.846856 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30c8418e-517e-41f2-bcb5-c10828bcfdf5 admin admin] Validating token access rules against request {{(pid=82026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 20:07:36.853525 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1467a73a-0ffb-4bfa-8219-18831e172ac0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '023a2c79c2444611b3d431928e56685d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8c6fba0f15b4d6a84ff601919b7b8e4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 20:07:36.854197 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1467a73a-0ffb-4bfa-8219-18831e172ac0 service neutron] REQUEST_METHOD: `GET` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:07:36.854484 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1467a73a-0ffb-4bfa-8219-18831e172ac0 service neutron] SCRIPT_NAME: `/identity` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:07:36.854765 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1467a73a-0ffb-4bfa-8219-18831e172ac0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:07:36.864592 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1467a73a-0ffb-4bfa-8219-18831e172ac0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 20:07:36.866050 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1467a73a-0ffb-4bfa-8219-18831e172ac0 service neutron] RBAC: Authorization granted {{(pid=82026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 20:07:36.879342 dv-cinder-828806-6-smb devstack@keystone.service[82026]: [pid: 82026|app: 0|req: 1302/2664] 10.222.0.33 () {60 vars in 1365 bytes} [Tue Sep 13 20:07:36 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 109 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 20:07:37.367364 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93bd295f-104d-466f-875a-41fa45872b48 None None] Authenticating user token {{(pid=82025) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 20:07:37.369197 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.fernet_utils [None req-93bd295f-104d-466f-875a-41fa45872b48 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82025) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 20:07:37.389823 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93bd295f-104d-466f-875a-41fa45872b48 None None] Validating token access rules against request {{(pid=82025) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 20:07:37.395364 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a45b268a-ce06-4169-8c03-2d9e086e9852 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57539b6a6f3b4d589f5f5e1d211cd6a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b454f707d20347ada3d82aa85495635e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82025) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 20:07:37.396019 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a45b268a-ce06-4169-8c03-2d9e086e9852 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:07:37.396297 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a45b268a-ce06-4169-8c03-2d9e086e9852 admin admin] SCRIPT_NAME: `/identity` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:07:37.396575 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a45b268a-ce06-4169-8c03-2d9e086e9852 admin admin] PATH_INFO: `/v3/projects/8730bedfa217428fbcb7d9fb62b8da50` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:07:37.397732 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a45b268a-ce06-4169-8c03-2d9e086e9852 admin admin] RBAC: Authorizing `identity:delete_project(project_id=8730bedfa217428fbcb7d9fb62b8da50)` {{(pid=82025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 20:07:37.399721 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a45b268a-ce06-4169-8c03-2d9e086e9852 admin admin] RBAC: Authorization granted {{(pid=82025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 20:07:37.551199 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.notifications [None req-a45b268a-ce06-4169-8c03-2d9e086e9852 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8730bedfa217428fbcb7d9fb62b8da50', 'request_id': 'req-a45b268a-ce06-4169-8c03-2d9e086e9852'} {{(pid=82025) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 20:07:37.561471 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.notifications [None req-a45b268a-ce06-4169-8c03-2d9e086e9852 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8730bedfa217428fbcb7d9fb62b8da50', 'request_id': 'req-a45b268a-ce06-4169-8c03-2d9e086e9852'} {{(pid=82025) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 20:07:37.573246 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.notifications [None req-a45b268a-ce06-4169-8c03-2d9e086e9852 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8730bedfa217428fbcb7d9fb62b8da50', 'request_id': 'req-a45b268a-ce06-4169-8c03-2d9e086e9852'} {{(pid=82025) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 20:07:37.654304 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.notifications [None req-a45b268a-ce06-4169-8c03-2d9e086e9852 admin admin] The token cache is being invalidate because project 8730bedfa217428fbcb7d9fb62b8da50 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82025) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 13 20:07:37.654715 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.notifications [None req-a45b268a-ce06-4169-8c03-2d9e086e9852 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82025) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 20:07:37.655488 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.notifications [None req-a45b268a-ce06-4169-8c03-2d9e086e9852 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82025) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 20:07:37.657497 dv-cinder-828806-6-smb devstack@keystone.service[82025]: [pid: 82025|app: 0|req: 1363/2665] 10.222.0.33 () {58 vars in 1233 bytes} [Tue Sep 13 20:07:37 2022] DELETE /identity/v3/projects/8730bedfa217428fbcb7d9fb62b8da50 => generated 0 bytes in 291 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 13 20:07:37.661239 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1467a73a-0ffb-4bfa-8219-18831e172ac0 service neutron] Authenticating user token {{(pid=82026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 20:07:37.673951 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1467a73a-0ffb-4bfa-8219-18831e172ac0 service neutron] Validating token access rules against request {{(pid=82026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 20:07:37.738544 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e03cf2a-dcfb-4c8e-b2ce-72804c696311 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57539b6a6f3b4d589f5f5e1d211cd6a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b454f707d20347ada3d82aa85495635e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 20:07:37.739347 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e03cf2a-dcfb-4c8e-b2ce-72804c696311 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:07:37.739738 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e03cf2a-dcfb-4c8e-b2ce-72804c696311 admin admin] SCRIPT_NAME: `/identity` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:07:37.740079 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e03cf2a-dcfb-4c8e-b2ce-72804c696311 admin admin] PATH_INFO: `/v3/users/db2ba7c7804c475da2a963d4e0511d1c` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:07:37.741648 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e03cf2a-dcfb-4c8e-b2ce-72804c696311 admin admin] RBAC: Authorizing `identity:delete_user(user_id=db2ba7c7804c475da2a963d4e0511d1c)` {{(pid=82026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 20:07:37.744050 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e03cf2a-dcfb-4c8e-b2ce-72804c696311 admin admin] RBAC: Authorization granted {{(pid=82026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 20:07:37.978538 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a45b268a-ce06-4169-8c03-2d9e086e9852 admin admin] Authenticating user token {{(pid=82025) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 20:07:37.980171 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.fernet_utils [None req-a45b268a-ce06-4169-8c03-2d9e086e9852 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82025) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 20:07:38.000729 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a45b268a-ce06-4169-8c03-2d9e086e9852 admin admin] Validating token access rules against request {{(pid=82025) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 20:07:38.006777 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01287475-dfdd-4dae-8f0e-e7f87a7f4b15 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57539b6a6f3b4d589f5f5e1d211cd6a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b454f707d20347ada3d82aa85495635e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82025) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 20:07:38.007462 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01287475-dfdd-4dae-8f0e-e7f87a7f4b15 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:07:38.007779 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01287475-dfdd-4dae-8f0e-e7f87a7f4b15 admin admin] SCRIPT_NAME: `/identity` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:07:38.008056 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01287475-dfdd-4dae-8f0e-e7f87a7f4b15 admin admin] PATH_INFO: `/v3/users/1c2e721388804b1c8bed6ee356fce720` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:07:38.009196 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01287475-dfdd-4dae-8f0e-e7f87a7f4b15 admin admin] RBAC: Authorizing `identity:delete_user(user_id=1c2e721388804b1c8bed6ee356fce720)` {{(pid=82025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 20:07:38.011478 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01287475-dfdd-4dae-8f0e-e7f87a7f4b15 admin admin] RBAC: Authorization granted {{(pid=82025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 20:07:38.092747 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG dbcounter [-] [82026] Writing DB stats keystone:SELECT=84,keystone:DELETE=15,keystone:INSERT=1 {{(pid=82026) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 20:07:38.106278 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.notifications [None req-9e03cf2a-dcfb-4c8e-b2ce-72804c696311 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'db2ba7c7804c475da2a963d4e0511d1c'} {{(pid=82026) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 20:07:38.291951 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.notifications [None req-9e03cf2a-dcfb-4c8e-b2ce-72804c696311 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'db2ba7c7804c475da2a963d4e0511d1c'} {{(pid=82026) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 20:07:38.305219 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.notifications [None req-9e03cf2a-dcfb-4c8e-b2ce-72804c696311 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'db2ba7c7804c475da2a963d4e0511d1c'} {{(pid=82026) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 20:07:38.305917 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.notifications [None req-9e03cf2a-dcfb-4c8e-b2ce-72804c696311 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'db2ba7c7804c475da2a963d4e0511d1c'} {{(pid=82026) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 20:07:38.313310 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.notifications [None req-9e03cf2a-dcfb-4c8e-b2ce-72804c696311 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'db2ba7c7804c475da2a963d4e0511d1c'} {{(pid=82026) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 20:07:38.319394 dv-cinder-828806-6-smb devstack@keystone.service[82026]: [pid: 82026|app: 0|req: 1303/2666] 10.222.0.33 () {58 vars in 1224 bytes} [Tue Sep 13 20:07:37 2022] DELETE /identity/v3/users/db2ba7c7804c475da2a963d4e0511d1c => generated 0 bytes in 659 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 13 20:07:38.347952 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.notifications [None req-01287475-dfdd-4dae-8f0e-e7f87a7f4b15 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1c2e721388804b1c8bed6ee356fce720'} {{(pid=82025) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 20:07:38.503825 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.notifications [None req-01287475-dfdd-4dae-8f0e-e7f87a7f4b15 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1c2e721388804b1c8bed6ee356fce720'} {{(pid=82025) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 20:07:38.504467 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.notifications [None req-01287475-dfdd-4dae-8f0e-e7f87a7f4b15 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1c2e721388804b1c8bed6ee356fce720'} {{(pid=82025) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 20:07:38.518097 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.notifications [None req-01287475-dfdd-4dae-8f0e-e7f87a7f4b15 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1c2e721388804b1c8bed6ee356fce720'} {{(pid=82025) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 20:07:38.525010 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.notifications [None req-01287475-dfdd-4dae-8f0e-e7f87a7f4b15 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1c2e721388804b1c8bed6ee356fce720'} {{(pid=82025) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 20:07:38.530812 dv-cinder-828806-6-smb devstack@keystone.service[82025]: [pid: 82025|app: 0|req: 1364/2667] 10.222.0.33 () {58 vars in 1224 bytes} [Tue Sep 13 20:07:37 2022] DELETE /identity/v3/users/1c2e721388804b1c8bed6ee356fce720 => generated 0 bytes in 553 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 13 20:07:38.943830 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01287475-dfdd-4dae-8f0e-e7f87a7f4b15 admin admin] Authenticating user token {{(pid=82025) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 20:07:38.944306 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e03cf2a-dcfb-4c8e-b2ce-72804c696311 admin admin] Authenticating user token {{(pid=82026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 20:07:38.946009 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.fernet_utils [None req-01287475-dfdd-4dae-8f0e-e7f87a7f4b15 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82025) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 20:07:38.948304 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.common.fernet_utils [None req-9e03cf2a-dcfb-4c8e-b2ce-72804c696311 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82026) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 20:07:39.019120 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG dbcounter [-] [82025] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=82025) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 20:07:39.033880 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01287475-dfdd-4dae-8f0e-e7f87a7f4b15 admin admin] Validating token access rules against request {{(pid=82025) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 20:07:39.035372 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e03cf2a-dcfb-4c8e-b2ce-72804c696311 admin admin] Validating token access rules against request {{(pid=82026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 20:07:39.039739 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa8fa1a6-8b9e-4b8b-8c0a-a96239635955 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57539b6a6f3b4d589f5f5e1d211cd6a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b454f707d20347ada3d82aa85495635e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82025) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 20:07:39.040373 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa8fa1a6-8b9e-4b8b-8c0a-a96239635955 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:07:39.040662 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa8fa1a6-8b9e-4b8b-8c0a-a96239635955 admin admin] SCRIPT_NAME: `/identity` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:07:39.040942 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa8fa1a6-8b9e-4b8b-8c0a-a96239635955 admin admin] PATH_INFO: `/v3/projects/ae793372ceca4ed0966db07b729b20a4` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:07:39.041169 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-956f397f-b995-4dcf-a876-dc1dfc801be4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57539b6a6f3b4d589f5f5e1d211cd6a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b454f707d20347ada3d82aa85495635e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 20:07:39.041939 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-956f397f-b995-4dcf-a876-dc1dfc801be4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:07:39.042121 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa8fa1a6-8b9e-4b8b-8c0a-a96239635955 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ae793372ceca4ed0966db07b729b20a4)` {{(pid=82025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 20:07:39.042836 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-956f397f-b995-4dcf-a876-dc1dfc801be4 admin admin] SCRIPT_NAME: `/identity` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:07:39.043229 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-956f397f-b995-4dcf-a876-dc1dfc801be4 admin admin] PATH_INFO: `/v3/projects/8f5c5a9abf6b4366a6ff90dba40edba3` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:07:39.044028 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa8fa1a6-8b9e-4b8b-8c0a-a96239635955 admin admin] RBAC: Authorization granted {{(pid=82025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 20:07:39.044859 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-956f397f-b995-4dcf-a876-dc1dfc801be4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=8f5c5a9abf6b4366a6ff90dba40edba3)` {{(pid=82026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 20:07:39.047223 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-956f397f-b995-4dcf-a876-dc1dfc801be4 admin admin] RBAC: Authorization granted {{(pid=82026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 20:07:39.212886 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.notifications [None req-fa8fa1a6-8b9e-4b8b-8c0a-a96239635955 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ae793372ceca4ed0966db07b729b20a4', 'request_id': 'req-fa8fa1a6-8b9e-4b8b-8c0a-a96239635955'} {{(pid=82025) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 20:07:39.218598 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.notifications [None req-fa8fa1a6-8b9e-4b8b-8c0a-a96239635955 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ae793372ceca4ed0966db07b729b20a4', 'request_id': 'req-fa8fa1a6-8b9e-4b8b-8c0a-a96239635955'} {{(pid=82025) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 20:07:39.225151 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.notifications [None req-fa8fa1a6-8b9e-4b8b-8c0a-a96239635955 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ae793372ceca4ed0966db07b729b20a4', 'request_id': 'req-fa8fa1a6-8b9e-4b8b-8c0a-a96239635955'} {{(pid=82025) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 20:07:39.266445 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.notifications [None req-956f397f-b995-4dcf-a876-dc1dfc801be4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8f5c5a9abf6b4366a6ff90dba40edba3', 'request_id': 'req-956f397f-b995-4dcf-a876-dc1dfc801be4'} {{(pid=82026) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 20:07:39.348811 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.notifications [None req-fa8fa1a6-8b9e-4b8b-8c0a-a96239635955 admin admin] The token cache is being invalidate because project ae793372ceca4ed0966db07b729b20a4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82025) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 13 20:07:39.349203 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.notifications [None req-fa8fa1a6-8b9e-4b8b-8c0a-a96239635955 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82025) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 20:07:39.349838 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.notifications [None req-fa8fa1a6-8b9e-4b8b-8c0a-a96239635955 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82025) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 20:07:39.351519 dv-cinder-828806-6-smb devstack@keystone.service[82025]: [pid: 82025|app: 0|req: 1365/2668] 10.222.0.33 () {58 vars in 1233 bytes} [Tue Sep 13 20:07:38 2022] DELETE /identity/v3/projects/ae793372ceca4ed0966db07b729b20a4 => generated 0 bytes in 408 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 20:07:39.363113 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bbedf06-b757-48a3-9146-fdc7a74a0f8a None None] REQUEST_METHOD: `POST` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:07:39.363456 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bbedf06-b757-48a3-9146-fdc7a74a0f8a None None] SCRIPT_NAME: `/identity` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:07:39.363762 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bbedf06-b757-48a3-9146-fdc7a74a0f8a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:07:39.383989 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.auth.core [None req-7bbedf06-b757-48a3-9146-fdc7a74a0f8a None None] MFA Rules not processed for user `57539b6a6f3b4d589f5f5e1d211cd6a0`. Rule list: `[]` (Enabled: `True`). {{(pid=82025) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 20:07:39.385206 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.fernet_utils [None req-7bbedf06-b757-48a3-9146-fdc7a74a0f8a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82025) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 20:07:39.440627 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.notifications [None req-956f397f-b995-4dcf-a876-dc1dfc801be4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8f5c5a9abf6b4366a6ff90dba40edba3', 'request_id': 'req-956f397f-b995-4dcf-a876-dc1dfc801be4'} {{(pid=82026) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 20:07:39.446184 dv-cinder-828806-6-smb devstack@keystone.service[82025]: [pid: 82025|app: 0|req: 1366/2669] 10.222.0.33 () {58 vars in 958 bytes} [Tue Sep 13 20:07:39 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 13 20:07:39.447959 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.notifications [None req-956f397f-b995-4dcf-a876-dc1dfc801be4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8f5c5a9abf6b4366a6ff90dba40edba3', 'request_id': 'req-956f397f-b995-4dcf-a876-dc1dfc801be4'} {{(pid=82026) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 20:07:39.453796 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aedf0187-7af4-4c7d-9b95-c687d6e2e8e8 None None] REQUEST_METHOD: `POST` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:07:39.454279 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aedf0187-7af4-4c7d-9b95-c687d6e2e8e8 None None] SCRIPT_NAME: `/identity` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:07:39.454645 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aedf0187-7af4-4c7d-9b95-c687d6e2e8e8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:07:39.461967 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.notifications [None req-956f397f-b995-4dcf-a876-dc1dfc801be4 admin admin] The token cache is being invalidate because project 8f5c5a9abf6b4366a6ff90dba40edba3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82026) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 13 20:07:39.461967 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.notifications [None req-956f397f-b995-4dcf-a876-dc1dfc801be4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82026) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 20:07:39.461967 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.notifications [None req-956f397f-b995-4dcf-a876-dc1dfc801be4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82026) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 20:07:39.468246 dv-cinder-828806-6-smb devstack@keystone.service[82026]: [pid: 82026|app: 0|req: 1304/2670] 10.222.0.33 () {58 vars in 1233 bytes} [Tue Sep 13 20:07:38 2022] DELETE /identity/v3/projects/8f5c5a9abf6b4366a6ff90dba40edba3 => generated 0 bytes in 520 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 20:07:39.471620 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eee66e16-c998-4edb-8416-cd96cb17311e None None] REQUEST_METHOD: `POST` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:07:39.471968 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eee66e16-c998-4edb-8416-cd96cb17311e None None] SCRIPT_NAME: `/identity` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:07:39.472250 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eee66e16-c998-4edb-8416-cd96cb17311e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:07:39.478170 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.auth.core [None req-aedf0187-7af4-4c7d-9b95-c687d6e2e8e8 None None] MFA Rules not processed for user `57539b6a6f3b4d589f5f5e1d211cd6a0`. Rule list: `[]` (Enabled: `True`). {{(pid=82025) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 20:07:39.479640 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.fernet_utils [None req-aedf0187-7af4-4c7d-9b95-c687d6e2e8e8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82025) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 20:07:39.488649 dv-cinder-828806-6-smb devstack@keystone.service[82025]: [pid: 82025|app: 0|req: 1367/2671] 10.222.0.33 () {58 vars in 958 bytes} [Tue Sep 13 20:07:39 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 13 20:07:39.492870 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aedf0187-7af4-4c7d-9b95-c687d6e2e8e8 None None] Authenticating user token {{(pid=82025) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 20:07:39.496138 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.auth.core [None req-eee66e16-c998-4edb-8416-cd96cb17311e None None] MFA Rules not processed for user `57539b6a6f3b4d589f5f5e1d211cd6a0`. Rule list: `[]` (Enabled: `True`). {{(pid=82026) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 20:07:39.497646 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.common.fernet_utils [None req-eee66e16-c998-4edb-8416-cd96cb17311e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82026) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 20:07:39.503609 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aedf0187-7af4-4c7d-9b95-c687d6e2e8e8 None None] Validating token access rules against request {{(pid=82025) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 20:07:39.507339 dv-cinder-828806-6-smb devstack@keystone.service[82026]: [pid: 82026|app: 0|req: 1305/2672] 10.222.0.33 () {58 vars in 958 bytes} [Tue Sep 13 20:07:39 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 13 20:07:39.509155 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dafb53ab-e711-4ec6-95fa-b4400b9812c6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57539b6a6f3b4d589f5f5e1d211cd6a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b454f707d20347ada3d82aa85495635e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82025) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 20:07:39.509847 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dafb53ab-e711-4ec6-95fa-b4400b9812c6 admin admin] REQUEST_METHOD: `GET` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:07:39.510134 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dafb53ab-e711-4ec6-95fa-b4400b9812c6 admin admin] SCRIPT_NAME: `/identity` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:07:39.510438 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dafb53ab-e711-4ec6-95fa-b4400b9812c6 admin admin] PATH_INFO: `/v3/domains` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:07:39.511175 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dafb53ab-e711-4ec6-95fa-b4400b9812c6 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82025) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 20:07:39.511484 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dafb53ab-e711-4ec6-95fa-b4400b9812c6 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 20:07:39.513169 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dafb53ab-e711-4ec6-95fa-b4400b9812c6 admin admin] RBAC: Authorization granted {{(pid=82025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 20:07:39.515149 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f33707f-6b7a-4a42-90a1-52a71c30eca6 None None] REQUEST_METHOD: `POST` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:07:39.515444 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f33707f-6b7a-4a42-90a1-52a71c30eca6 None None] SCRIPT_NAME: `/identity` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:07:39.515725 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f33707f-6b7a-4a42-90a1-52a71c30eca6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:07:39.527299 dv-cinder-828806-6-smb devstack@keystone.service[82025]: [pid: 82025|app: 0|req: 1368/2673] 10.222.0.33 () {58 vars in 1153 bytes} [Tue Sep 13 20:07:39 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 13 20:07:39.531728 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dafb53ab-e711-4ec6-95fa-b4400b9812c6 admin admin] Authenticating user token {{(pid=82025) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 20:07:39.539108 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.auth.core [None req-5f33707f-6b7a-4a42-90a1-52a71c30eca6 None None] MFA Rules not processed for user `57539b6a6f3b4d589f5f5e1d211cd6a0`. Rule list: `[]` (Enabled: `True`). {{(pid=82026) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 20:07:39.540346 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.common.fernet_utils [None req-5f33707f-6b7a-4a42-90a1-52a71c30eca6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82026) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 20:07:39.542355 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dafb53ab-e711-4ec6-95fa-b4400b9812c6 admin admin] Validating token access rules against request {{(pid=82025) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 20:07:39.547473 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f327b9a-bc90-4e72-856a-f86a6396e22b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57539b6a6f3b4d589f5f5e1d211cd6a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b454f707d20347ada3d82aa85495635e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82025) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 20:07:39.548759 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f327b9a-bc90-4e72-856a-f86a6396e22b admin admin] REQUEST_METHOD: `POST` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:07:39.549038 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f327b9a-bc90-4e72-856a-f86a6396e22b admin admin] SCRIPT_NAME: `/identity` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:07:39.549458 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f327b9a-bc90-4e72-856a-f86a6396e22b admin admin] PATH_INFO: `/v3/projects` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:07:39.550556 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f327b9a-bc90-4e72-856a-f86a6396e22b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 20:07:39.551187 dv-cinder-828806-6-smb devstack@keystone.service[82026]: [pid: 82026|app: 0|req: 1306/2674] 10.222.0.33 () {58 vars in 958 bytes} [Tue Sep 13 20:07:39 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 13 20:07:39.552558 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f327b9a-bc90-4e72-856a-f86a6396e22b admin admin] RBAC: Authorization granted {{(pid=82025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 20:07:39.554140 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f33707f-6b7a-4a42-90a1-52a71c30eca6 None None] Authenticating user token {{(pid=82026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 20:07:39.567066 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f33707f-6b7a-4a42-90a1-52a71c30eca6 None None] Validating token access rules against request {{(pid=82026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 20:07:39.573038 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f732df49-f1a3-4dec-98c9-d2292c1cd03c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57539b6a6f3b4d589f5f5e1d211cd6a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b454f707d20347ada3d82aa85495635e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 20:07:39.574026 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f732df49-f1a3-4dec-98c9-d2292c1cd03c admin admin] REQUEST_METHOD: `GET` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:07:39.574026 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f732df49-f1a3-4dec-98c9-d2292c1cd03c admin admin] SCRIPT_NAME: `/identity` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:07:39.574253 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f732df49-f1a3-4dec-98c9-d2292c1cd03c admin admin] PATH_INFO: `/v3/domains` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:07:39.574909 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f732df49-f1a3-4dec-98c9-d2292c1cd03c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82026) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 20:07:39.575250 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f732df49-f1a3-4dec-98c9-d2292c1cd03c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 20:07:39.576902 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f732df49-f1a3-4dec-98c9-d2292c1cd03c admin admin] RBAC: Authorization granted {{(pid=82026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 20:07:39.590391 dv-cinder-828806-6-smb devstack@keystone.service[82026]: [pid: 82026|app: 0|req: 1307/2675] 10.222.0.33 () {58 vars in 1153 bytes} [Tue Sep 13 20:07:39 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 13 20:07:39.595719 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f732df49-f1a3-4dec-98c9-d2292c1cd03c admin admin] Authenticating user token {{(pid=82026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 20:07:39.605609 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f732df49-f1a3-4dec-98c9-d2292c1cd03c admin admin] Validating token access rules against request {{(pid=82026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 20:07:39.610583 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76004155-fc7e-4af5-acdc-0c8132264c5e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57539b6a6f3b4d589f5f5e1d211cd6a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b454f707d20347ada3d82aa85495635e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 20:07:39.611304 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76004155-fc7e-4af5-acdc-0c8132264c5e admin admin] REQUEST_METHOD: `POST` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:07:39.611592 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76004155-fc7e-4af5-acdc-0c8132264c5e admin admin] SCRIPT_NAME: `/identity` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:07:39.611879 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76004155-fc7e-4af5-acdc-0c8132264c5e admin admin] PATH_INFO: `/v3/projects` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:07:39.612521 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76004155-fc7e-4af5-acdc-0c8132264c5e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 20:07:39.614421 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76004155-fc7e-4af5-acdc-0c8132264c5e admin admin] RBAC: Authorization granted {{(pid=82026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 20:07:39.624551 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG dbcounter [-] [82026] Writing DB stats keystone:SELECT=86,keystone:DELETE=12,keystone:INSERT=2 {{(pid=82026) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 20:07:39.697304 dv-cinder-828806-6-smb devstack@keystone.service[82025]: [pid: 82025|app: 0|req: 1369/2676] 10.222.0.33 () {60 vars in 1153 bytes} [Tue Sep 13 20:07:39 2022] POST /identity/v3/projects => generated 373 bytes in 166 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 13 20:07:39.701703 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f327b9a-bc90-4e72-856a-f86a6396e22b admin admin] Authenticating user token {{(pid=82025) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 20:07:39.742575 dv-cinder-828806-6-smb devstack@keystone.service[82026]: [pid: 82026|app: 0|req: 1308/2677] 10.222.0.33 () {60 vars in 1153 bytes} [Tue Sep 13 20:07:39 2022] POST /identity/v3/projects => generated 373 bytes in 148 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 13 20:07:39.752584 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76004155-fc7e-4af5-acdc-0c8132264c5e admin admin] Authenticating user token {{(pid=82026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 20:07:39.765493 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f327b9a-bc90-4e72-856a-f86a6396e22b admin admin] Validating token access rules against request {{(pid=82025) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 20:07:39.814582 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76004155-fc7e-4af5-acdc-0c8132264c5e admin admin] Validating token access rules against request {{(pid=82026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 20:07:39.819263 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f212750b-5a98-4628-a00b-ddbe914c5d61 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57539b6a6f3b4d589f5f5e1d211cd6a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b454f707d20347ada3d82aa85495635e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 20:07:39.819864 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f212750b-5a98-4628-a00b-ddbe914c5d61 admin admin] REQUEST_METHOD: `POST` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:07:39.820141 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f212750b-5a98-4628-a00b-ddbe914c5d61 admin admin] SCRIPT_NAME: `/identity` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:07:39.820414 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f212750b-5a98-4628-a00b-ddbe914c5d61 admin admin] PATH_INFO: `/v3/users` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:07:39.821045 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f212750b-5a98-4628-a00b-ddbe914c5d61 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 20:07:39.822960 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f212750b-5a98-4628-a00b-ddbe914c5d61 admin admin] RBAC: Authorization granted {{(pid=82026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 20:07:39.824674 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-291950d0-397a-4d9c-b073-f2eb73bff041 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57539b6a6f3b4d589f5f5e1d211cd6a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b454f707d20347ada3d82aa85495635e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82025) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 20:07:39.825284 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-291950d0-397a-4d9c-b073-f2eb73bff041 admin admin] REQUEST_METHOD: `POST` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:07:39.825637 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-291950d0-397a-4d9c-b073-f2eb73bff041 admin admin] SCRIPT_NAME: `/identity` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:07:39.825922 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-291950d0-397a-4d9c-b073-f2eb73bff041 admin admin] PATH_INFO: `/v3/users` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:07:39.826567 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-291950d0-397a-4d9c-b073-f2eb73bff041 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 20:07:39.828510 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-291950d0-397a-4d9c-b073-f2eb73bff041 admin admin] RBAC: Authorization granted {{(pid=82025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 20:07:40.018368 dv-cinder-828806-6-smb devstack@keystone.service[82026]: [pid: 82026|app: 0|req: 1309/2678] 10.222.0.33 () {60 vars in 1144 bytes} [Tue Sep 13 20:07:39 2022] POST /identity/v3/users => generated 287 bytes in 268 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 13 20:07:40.022615 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f212750b-5a98-4628-a00b-ddbe914c5d61 admin admin] Authenticating user token {{(pid=82026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 20:07:40.034346 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f212750b-5a98-4628-a00b-ddbe914c5d61 admin admin] Validating token access rules against request {{(pid=82026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 20:07:40.038970 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09e2ea32-5c0f-4b1d-8512-13b025ee3278 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57539b6a6f3b4d589f5f5e1d211cd6a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b454f707d20347ada3d82aa85495635e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 20:07:40.039600 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09e2ea32-5c0f-4b1d-8512-13b025ee3278 admin admin] REQUEST_METHOD: `GET` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:07:40.039883 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09e2ea32-5c0f-4b1d-8512-13b025ee3278 admin admin] SCRIPT_NAME: `/identity` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:07:40.040158 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09e2ea32-5c0f-4b1d-8512-13b025ee3278 admin admin] PATH_INFO: `/v3/roles` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:07:40.040862 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09e2ea32-5c0f-4b1d-8512-13b025ee3278 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 20:07:40.042446 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09e2ea32-5c0f-4b1d-8512-13b025ee3278 admin admin] RBAC: Authorization granted {{(pid=82026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 20:07:40.058486 dv-cinder-828806-6-smb devstack@keystone.service[82026]: [pid: 82026|app: 0|req: 1310/2679] 10.222.0.33 () {58 vars in 1122 bytes} [Tue Sep 13 20:07:40 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 13 20:07:40.059124 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09e2ea32-5c0f-4b1d-8512-13b025ee3278 admin admin] Authenticating user token {{(pid=82026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 20:07:40.064936 dv-cinder-828806-6-smb devstack@keystone.service[82025]: [pid: 82025|app: 0|req: 1370/2680] 10.222.0.33 () {60 vars in 1144 bytes} [Tue Sep 13 20:07:39 2022] POST /identity/v3/users => generated 287 bytes in 360 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 13 20:07:40.066587 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-291950d0-397a-4d9c-b073-f2eb73bff041 admin admin] Authenticating user token {{(pid=82025) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 20:07:40.070330 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09e2ea32-5c0f-4b1d-8512-13b025ee3278 admin admin] Validating token access rules against request {{(pid=82026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 20:07:40.075282 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1d88e0b-3cd4-4519-913d-f0a553a01ffd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57539b6a6f3b4d589f5f5e1d211cd6a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b454f707d20347ada3d82aa85495635e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 20:07:40.075895 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1d88e0b-3cd4-4519-913d-f0a553a01ffd admin admin] REQUEST_METHOD: `GET` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:07:40.076165 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1d88e0b-3cd4-4519-913d-f0a553a01ffd admin admin] SCRIPT_NAME: `/identity` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:07:40.076632 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1d88e0b-3cd4-4519-913d-f0a553a01ffd admin admin] PATH_INFO: `/v3/roles` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:07:40.077275 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1d88e0b-3cd4-4519-913d-f0a553a01ffd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 20:07:40.077685 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-291950d0-397a-4d9c-b073-f2eb73bff041 admin admin] Validating token access rules against request {{(pid=82025) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 20:07:40.078905 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1d88e0b-3cd4-4519-913d-f0a553a01ffd admin admin] RBAC: Authorization granted {{(pid=82026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 20:07:40.082742 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8f38cbf-a8c1-4613-a236-5bf14457f535 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57539b6a6f3b4d589f5f5e1d211cd6a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b454f707d20347ada3d82aa85495635e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82025) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 20:07:40.083496 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8f38cbf-a8c1-4613-a236-5bf14457f535 admin admin] REQUEST_METHOD: `GET` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:07:40.083954 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8f38cbf-a8c1-4613-a236-5bf14457f535 admin admin] SCRIPT_NAME: `/identity` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:07:40.084237 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8f38cbf-a8c1-4613-a236-5bf14457f535 admin admin] PATH_INFO: `/v3/roles` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:07:40.084893 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8f38cbf-a8c1-4613-a236-5bf14457f535 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 20:07:40.086650 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8f38cbf-a8c1-4613-a236-5bf14457f535 admin admin] RBAC: Authorization granted {{(pid=82025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 20:07:40.090343 dv-cinder-828806-6-smb devstack@keystone.service[82026]: [pid: 82026|app: 0|req: 1311/2681] 10.222.0.33 () {58 vars in 1122 bytes} [Tue Sep 13 20:07:40 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 13 20:07:40.094810 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1d88e0b-3cd4-4519-913d-f0a553a01ffd admin admin] Authenticating user token {{(pid=82026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 20:07:40.102924 dv-cinder-828806-6-smb devstack@keystone.service[82025]: [pid: 82025|app: 0|req: 1371/2682] 10.222.0.33 () {58 vars in 1122 bytes} [Tue Sep 13 20:07:40 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 13 20:07:40.104264 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8f38cbf-a8c1-4613-a236-5bf14457f535 admin admin] Authenticating user token {{(pid=82025) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 20:07:40.104523 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1d88e0b-3cd4-4519-913d-f0a553a01ffd admin admin] Validating token access rules against request {{(pid=82026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 20:07:40.109535 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cea58ec-0716-4df8-a33a-b3d219db2de7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57539b6a6f3b4d589f5f5e1d211cd6a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b454f707d20347ada3d82aa85495635e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 20:07:40.110858 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cea58ec-0716-4df8-a33a-b3d219db2de7 admin admin] REQUEST_METHOD: `PUT` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:07:40.111182 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cea58ec-0716-4df8-a33a-b3d219db2de7 admin admin] SCRIPT_NAME: `/identity` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:07:40.111461 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cea58ec-0716-4df8-a33a-b3d219db2de7 admin admin] PATH_INFO: `/v3/projects/820e1d7e7e574464a198c3062f20e029/users/b7850a9466ed41a2b45a6c2ae98a357d/roles/3618ab638a65401f82333da7596d1daf` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:07:40.115823 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8f38cbf-a8c1-4613-a236-5bf14457f535 admin admin] Validating token access rules against request {{(pid=82025) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 20:07:40.120981 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12f91e32-1bae-4ad0-ade3-4ff63214ce77 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57539b6a6f3b4d589f5f5e1d211cd6a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b454f707d20347ada3d82aa85495635e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82025) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 20:07:40.121593 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12f91e32-1bae-4ad0-ade3-4ff63214ce77 admin admin] REQUEST_METHOD: `GET` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:07:40.121886 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12f91e32-1bae-4ad0-ade3-4ff63214ce77 admin admin] SCRIPT_NAME: `/identity` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:07:40.122170 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12f91e32-1bae-4ad0-ade3-4ff63214ce77 admin admin] PATH_INFO: `/v3/roles` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:07:40.122819 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12f91e32-1bae-4ad0-ade3-4ff63214ce77 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 20:07:40.124459 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12f91e32-1bae-4ad0-ade3-4ff63214ce77 admin admin] RBAC: Authorization granted {{(pid=82025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 20:07:40.129479 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cea58ec-0716-4df8-a33a-b3d219db2de7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=820e1d7e7e574464a198c3062f20e029, user_id=b7850a9466ed41a2b45a6c2ae98a357d, role_id=3618ab638a65401f82333da7596d1daf)` {{(pid=82026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 20:07:40.132402 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cea58ec-0716-4df8-a33a-b3d219db2de7 admin admin] RBAC: Authorization granted {{(pid=82026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 20:07:40.139868 dv-cinder-828806-6-smb devstack@keystone.service[82025]: [pid: 82025|app: 0|req: 1372/2683] 10.222.0.33 () {58 vars in 1122 bytes} [Tue Sep 13 20:07:40 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 13 20:07:40.140797 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12f91e32-1bae-4ad0-ade3-4ff63214ce77 admin admin] Authenticating user token {{(pid=82025) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 20:07:40.150851 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12f91e32-1bae-4ad0-ade3-4ff63214ce77 admin admin] Validating token access rules against request {{(pid=82025) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 20:07:40.155545 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad33ab20-56e2-4742-93ad-dce53fd8965c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57539b6a6f3b4d589f5f5e1d211cd6a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b454f707d20347ada3d82aa85495635e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82025) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 20:07:40.156236 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad33ab20-56e2-4742-93ad-dce53fd8965c admin admin] REQUEST_METHOD: `PUT` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:07:40.156524 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad33ab20-56e2-4742-93ad-dce53fd8965c admin admin] SCRIPT_NAME: `/identity` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:07:40.156808 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad33ab20-56e2-4742-93ad-dce53fd8965c admin admin] PATH_INFO: `/v3/projects/a2bd7bd69df145da84a59966024e11a8/users/e1782b80d3914e8395e3deb8352615d5/roles/3618ab638a65401f82333da7596d1daf` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:07:40.172215 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad33ab20-56e2-4742-93ad-dce53fd8965c admin admin] RBAC: Authorizing `identity:create_grant(project_id=a2bd7bd69df145da84a59966024e11a8, user_id=e1782b80d3914e8395e3deb8352615d5, role_id=3618ab638a65401f82333da7596d1daf)` {{(pid=82025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 20:07:40.175581 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad33ab20-56e2-4742-93ad-dce53fd8965c admin admin] RBAC: Authorization granted {{(pid=82025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 20:07:40.270192 dv-cinder-828806-6-smb devstack@keystone.service[82026]: [pid: 82026|app: 0|req: 1312/2684] 10.222.0.33 () {60 vars in 1483 bytes} [Tue Sep 13 20:07:40 2022] PUT /identity/v3/projects/820e1d7e7e574464a198c3062f20e029/users/b7850a9466ed41a2b45a6c2ae98a357d/roles/3618ab638a65401f82333da7596d1daf => generated 0 bytes in 176 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 13 20:07:40.282926 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5be52c4d-6abd-48c4-8dbe-2ee2d3779dca None None] REQUEST_METHOD: `POST` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:07:40.283341 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5be52c4d-6abd-48c4-8dbe-2ee2d3779dca None None] SCRIPT_NAME: `/identity` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:07:40.283709 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5be52c4d-6abd-48c4-8dbe-2ee2d3779dca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:07:40.309051 dv-cinder-828806-6-smb devstack@keystone.service[82025]: [pid: 82025|app: 0|req: 1373/2685] 10.222.0.33 () {60 vars in 1483 bytes} [Tue Sep 13 20:07:40 2022] PUT /identity/v3/projects/a2bd7bd69df145da84a59966024e11a8/users/e1782b80d3914e8395e3deb8352615d5/roles/3618ab638a65401f82333da7596d1daf => generated 0 bytes in 165 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 20:07:40.311197 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fc51398-3626-4661-849c-59bafaf6e0ef None None] REQUEST_METHOD: `POST` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:07:40.311489 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fc51398-3626-4661-849c-59bafaf6e0ef None None] SCRIPT_NAME: `/identity` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:07:40.311768 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fc51398-3626-4661-849c-59bafaf6e0ef None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:07:40.319580 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.auth.core [None req-5be52c4d-6abd-48c4-8dbe-2ee2d3779dca None None] MFA Rules not processed for user `b7850a9466ed41a2b45a6c2ae98a357d`. Rule list: `[]` (Enabled: `True`). {{(pid=82026) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 20:07:40.321132 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.common.fernet_utils [None req-5be52c4d-6abd-48c4-8dbe-2ee2d3779dca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82026) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 20:07:40.336842 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.auth.core [None req-0fc51398-3626-4661-849c-59bafaf6e0ef None None] MFA Rules not processed for user `57539b6a6f3b4d589f5f5e1d211cd6a0`. Rule list: `[]` (Enabled: `True`). {{(pid=82025) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 20:07:40.338118 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.fernet_utils [None req-0fc51398-3626-4661-849c-59bafaf6e0ef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82025) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 20:07:40.392792 dv-cinder-828806-6-smb devstack@keystone.service[82026]: [pid: 82026|app: 0|req: 1313/2686] 10.222.0.33 () {58 vars in 958 bytes} [Tue Sep 13 20:07:40 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 20:07:40.405163 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5be52c4d-6abd-48c4-8dbe-2ee2d3779dca None None] Authenticating user token {{(pid=82026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 20:07:40.406554 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.common.fernet_utils [None req-5be52c4d-6abd-48c4-8dbe-2ee2d3779dca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82026) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 20:07:40.411114 dv-cinder-828806-6-smb devstack@keystone.service[82025]: [pid: 82025|app: 0|req: 1374/2687] 10.222.0.33 () {58 vars in 958 bytes} [Tue Sep 13 20:07:40 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 20:07:40.422457 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fc51398-3626-4661-849c-59bafaf6e0ef None None] Authenticating user token {{(pid=82025) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 20:07:40.424770 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.fernet_utils [None req-0fc51398-3626-4661-849c-59bafaf6e0ef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82025) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 20:07:40.432024 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG dbcounter [-] [82025] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=82025) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 20:07:40.486519 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fc51398-3626-4661-849c-59bafaf6e0ef None None] Validating token access rules against request {{(pid=82025) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 20:07:40.490490 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e7940c2-084b-4a7b-b343-bde171700024 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '023a2c79c2444611b3d431928e56685d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8c6fba0f15b4d6a84ff601919b7b8e4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82025) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 20:07:40.490982 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5be52c4d-6abd-48c4-8dbe-2ee2d3779dca None None] Validating token access rules against request {{(pid=82026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 20:07:40.491289 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e7940c2-084b-4a7b-b343-bde171700024 service neutron] REQUEST_METHOD: `GET` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:07:40.491586 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e7940c2-084b-4a7b-b343-bde171700024 service neutron] SCRIPT_NAME: `/identity` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:07:40.491846 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e7940c2-084b-4a7b-b343-bde171700024 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:07:40.497808 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-378be91a-15f1-4bd8-9b4d-0f03f94512ca service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e66e7034abed4e0bad1f4137520c1e70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8c6fba0f15b4d6a84ff601919b7b8e4', 'project_domain_id': 'default', 'roles': ['service', 'member', 'reader', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 20:07:40.498655 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-378be91a-15f1-4bd8-9b4d-0f03f94512ca service nova] REQUEST_METHOD: `GET` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:07:40.498948 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-378be91a-15f1-4bd8-9b4d-0f03f94512ca service nova] SCRIPT_NAME: `/identity` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:07:40.499256 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-378be91a-15f1-4bd8-9b4d-0f03f94512ca service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:07:40.504107 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e7940c2-084b-4a7b-b343-bde171700024 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 20:07:40.505884 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e7940c2-084b-4a7b-b343-bde171700024 service neutron] RBAC: Authorization granted {{(pid=82025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 20:07:40.508956 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-378be91a-15f1-4bd8-9b4d-0f03f94512ca service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 20:07:40.510540 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-378be91a-15f1-4bd8-9b4d-0f03f94512ca service nova] RBAC: Authorization granted {{(pid=82026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 20:07:40.519720 dv-cinder-828806-6-smb devstack@keystone.service[82025]: [pid: 82025|app: 0|req: 1375/2688] 10.222.0.33 () {60 vars in 1365 bytes} [Tue Sep 13 20:07:40 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 98 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 13 20:07:40.520074 dv-cinder-828806-6-smb devstack@keystone.service[82026]: [pid: 82026|app: 0|req: 1314/2689] 10.222.0.33 () {60 vars in 1365 bytes} [Tue Sep 13 20:07:40 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 115 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 20:07:40.532589 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG dbcounter [-] [82026] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=82026) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 20:07:41.238889 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG dbcounter [-] [82025] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=82025) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 20:07:42.551762 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1a67fde-18e9-4371-89ad-cb4bf1fb0d3b None None] REQUEST_METHOD: `POST` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:07:42.552425 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1a67fde-18e9-4371-89ad-cb4bf1fb0d3b None None] SCRIPT_NAME: `/identity` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:07:42.552425 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1a67fde-18e9-4371-89ad-cb4bf1fb0d3b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:07:42.585950 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.auth.core [None req-c1a67fde-18e9-4371-89ad-cb4bf1fb0d3b None None] MFA Rules not processed for user `e1782b80d3914e8395e3deb8352615d5`. Rule list: `[]` (Enabled: `True`). {{(pid=82025) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 20:07:42.587197 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.fernet_utils [None req-c1a67fde-18e9-4371-89ad-cb4bf1fb0d3b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82025) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 20:07:42.651283 dv-cinder-828806-6-smb devstack@keystone.service[82025]: [pid: 82025|app: 0|req: 1376/2690] 10.222.0.33 () {58 vars in 958 bytes} [Tue Sep 13 20:07:42 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 20:07:42.662947 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-378be91a-15f1-4bd8-9b4d-0f03f94512ca service nova] Authenticating user token {{(pid=82026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 20:07:42.664404 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.common.fernet_utils [None req-378be91a-15f1-4bd8-9b4d-0f03f94512ca service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82026) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 20:07:42.722825 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-378be91a-15f1-4bd8-9b4d-0f03f94512ca service nova] Validating token access rules against request {{(pid=82026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 20:07:42.726472 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2cea6cb-a374-4599-8a4a-370d92c1c909 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46024fc6167f4321818b1bed27a521a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8c6fba0f15b4d6a84ff601919b7b8e4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 20:07:42.727123 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2cea6cb-a374-4599-8a4a-370d92c1c909 service cinder] REQUEST_METHOD: `GET` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:07:42.727415 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2cea6cb-a374-4599-8a4a-370d92c1c909 service cinder] SCRIPT_NAME: `/identity` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:07:42.727696 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2cea6cb-a374-4599-8a4a-370d92c1c909 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:07:42.736195 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2cea6cb-a374-4599-8a4a-370d92c1c909 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=82026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 20:07:42.737821 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2cea6cb-a374-4599-8a4a-370d92c1c909 service cinder] RBAC: Authorization granted {{(pid=82026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 20:07:42.746674 dv-cinder-828806-6-smb devstack@keystone.service[82026]: [pid: 82026|app: 0|req: 1315/2691] 10.222.0.33 () {60 vars in 1365 bytes} [Tue Sep 13 20:07:42 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 20:07:44.368618 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1a67fde-18e9-4371-89ad-cb4bf1fb0d3b None None] Authenticating user token {{(pid=82025) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 20:07:44.373635 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1a67fde-18e9-4371-89ad-cb4bf1fb0d3b None None] Validating token access rules against request {{(pid=82025) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 20:07:44.378914 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7837ad3c-c426-4c1f-a0d6-343599ebd494 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57539b6a6f3b4d589f5f5e1d211cd6a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b454f707d20347ada3d82aa85495635e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82025) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 20:07:44.379576 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7837ad3c-c426-4c1f-a0d6-343599ebd494 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:07:44.379861 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7837ad3c-c426-4c1f-a0d6-343599ebd494 admin admin] SCRIPT_NAME: `/identity` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:07:44.380139 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7837ad3c-c426-4c1f-a0d6-343599ebd494 admin admin] PATH_INFO: `/v3/users/b7850a9466ed41a2b45a6c2ae98a357d` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:07:44.381263 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7837ad3c-c426-4c1f-a0d6-343599ebd494 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b7850a9466ed41a2b45a6c2ae98a357d)` {{(pid=82025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 20:07:44.383244 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7837ad3c-c426-4c1f-a0d6-343599ebd494 admin admin] RBAC: Authorization granted {{(pid=82025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 20:07:44.705112 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.notifications [None req-7837ad3c-c426-4c1f-a0d6-343599ebd494 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b7850a9466ed41a2b45a6c2ae98a357d'} {{(pid=82025) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 20:07:44.707248 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0328448-bf0a-4315-9834-914ab8f34bfa None None] REQUEST_METHOD: `POST` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:07:44.707729 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0328448-bf0a-4315-9834-914ab8f34bfa None None] SCRIPT_NAME: `/identity` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:07:44.707830 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0328448-bf0a-4315-9834-914ab8f34bfa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:07:44.728973 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.auth.core [None req-f0328448-bf0a-4315-9834-914ab8f34bfa None None] MFA Rules not processed for user `e1782b80d3914e8395e3deb8352615d5`. Rule list: `[]` (Enabled: `True`). {{(pid=82026) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 20:07:44.730234 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.common.fernet_utils [None req-f0328448-bf0a-4315-9834-914ab8f34bfa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82026) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 20:07:44.738395 dv-cinder-828806-6-smb devstack@keystone.service[82026]: [pid: 82026|app: 0|req: 1316/2692] 10.222.0.33 () {58 vars in 958 bytes} [Tue Sep 13 20:07:44 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 13 20:07:44.832118 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.notifications [None req-7837ad3c-c426-4c1f-a0d6-343599ebd494 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b7850a9466ed41a2b45a6c2ae98a357d'} {{(pid=82025) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 20:07:44.832837 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.notifications [None req-7837ad3c-c426-4c1f-a0d6-343599ebd494 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b7850a9466ed41a2b45a6c2ae98a357d'} {{(pid=82025) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 20:07:44.845720 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.notifications [None req-7837ad3c-c426-4c1f-a0d6-343599ebd494 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b7850a9466ed41a2b45a6c2ae98a357d'} {{(pid=82025) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 20:07:44.852690 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.notifications [None req-7837ad3c-c426-4c1f-a0d6-343599ebd494 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b7850a9466ed41a2b45a6c2ae98a357d'} {{(pid=82025) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 20:07:44.858797 dv-cinder-828806-6-smb devstack@keystone.service[82025]: [pid: 82025|app: 0|req: 1377/2693] 10.222.0.33 () {58 vars in 1224 bytes} [Tue Sep 13 20:07:44 2022] DELETE /identity/v3/users/b7850a9466ed41a2b45a6c2ae98a357d => generated 0 bytes in 497 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 20:07:44.863866 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ebe5032-4ace-4b81-bc67-e0559b3d82df None None] REQUEST_METHOD: `POST` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:07:44.864236 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ebe5032-4ace-4b81-bc67-e0559b3d82df None None] SCRIPT_NAME: `/identity` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:07:44.864592 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ebe5032-4ace-4b81-bc67-e0559b3d82df None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:07:44.886048 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.auth.core [None req-5ebe5032-4ace-4b81-bc67-e0559b3d82df None None] MFA Rules not processed for user `57539b6a6f3b4d589f5f5e1d211cd6a0`. Rule list: `[]` (Enabled: `True`). {{(pid=82026) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 20:07:44.887539 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.common.fernet_utils [None req-5ebe5032-4ace-4b81-bc67-e0559b3d82df None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82026) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 20:07:44.952272 dv-cinder-828806-6-smb devstack@keystone.service[82026]: [pid: 82026|app: 0|req: 1317/2694] 10.222.0.33 () {58 vars in 958 bytes} [Tue Sep 13 20:07:44 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 20:07:44.962389 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7837ad3c-c426-4c1f-a0d6-343599ebd494 admin admin] Authenticating user token {{(pid=82025) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 20:07:44.964006 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.fernet_utils [None req-7837ad3c-c426-4c1f-a0d6-343599ebd494 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82025) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 20:07:45.009302 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG dbcounter [-] [82025] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82025) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 20:07:45.024871 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7837ad3c-c426-4c1f-a0d6-343599ebd494 admin admin] Validating token access rules against request {{(pid=82025) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 20:07:45.028540 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9440fb43-eee7-4bc4-9282-bdc9e5a31dca service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '023a2c79c2444611b3d431928e56685d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8c6fba0f15b4d6a84ff601919b7b8e4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82025) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 20:07:45.029196 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9440fb43-eee7-4bc4-9282-bdc9e5a31dca service neutron] REQUEST_METHOD: `GET` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:07:45.029482 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9440fb43-eee7-4bc4-9282-bdc9e5a31dca service neutron] SCRIPT_NAME: `/identity` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:07:45.029762 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9440fb43-eee7-4bc4-9282-bdc9e5a31dca service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:07:45.039597 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9440fb43-eee7-4bc4-9282-bdc9e5a31dca service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 20:07:45.041030 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9440fb43-eee7-4bc4-9282-bdc9e5a31dca service neutron] RBAC: Authorization granted {{(pid=82025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 20:07:45.051860 dv-cinder-828806-6-smb devstack@keystone.service[82025]: [pid: 82025|app: 0|req: 1378/2695] 10.222.0.33 () {60 vars in 1365 bytes} [Tue Sep 13 20:07:44 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 13 20:07:45.608322 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ebe5032-4ace-4b81-bc67-e0559b3d82df None None] Authenticating user token {{(pid=82026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 20:07:45.608322 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.common.fernet_utils [None req-5ebe5032-4ace-4b81-bc67-e0559b3d82df None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82026) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 20:07:45.638424 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ebe5032-4ace-4b81-bc67-e0559b3d82df None None] Validating token access rules against request {{(pid=82026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 20:07:45.645084 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e40d322-92d7-4877-9937-d49d99fb2960 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57539b6a6f3b4d589f5f5e1d211cd6a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b454f707d20347ada3d82aa85495635e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 20:07:45.645756 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e40d322-92d7-4877-9937-d49d99fb2960 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:07:45.646064 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e40d322-92d7-4877-9937-d49d99fb2960 admin admin] SCRIPT_NAME: `/identity` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:07:45.646361 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e40d322-92d7-4877-9937-d49d99fb2960 admin admin] PATH_INFO: `/v3/projects/820e1d7e7e574464a198c3062f20e029` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:07:45.647616 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e40d322-92d7-4877-9937-d49d99fb2960 admin admin] RBAC: Authorizing `identity:delete_project(project_id=820e1d7e7e574464a198c3062f20e029)` {{(pid=82026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 20:07:45.649649 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e40d322-92d7-4877-9937-d49d99fb2960 admin admin] RBAC: Authorization granted {{(pid=82026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 20:07:45.790989 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG dbcounter [-] [82026] Writing DB stats keystone:SELECT=97,keystone:DELETE=3 {{(pid=82026) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 20:07:45.797614 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.notifications [None req-8e40d322-92d7-4877-9937-d49d99fb2960 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '820e1d7e7e574464a198c3062f20e029', 'request_id': 'req-8e40d322-92d7-4877-9937-d49d99fb2960'} {{(pid=82026) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 20:07:45.892225 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.notifications [None req-8e40d322-92d7-4877-9937-d49d99fb2960 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '820e1d7e7e574464a198c3062f20e029', 'request_id': 'req-8e40d322-92d7-4877-9937-d49d99fb2960'} {{(pid=82026) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 20:07:45.898351 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.notifications [None req-8e40d322-92d7-4877-9937-d49d99fb2960 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '820e1d7e7e574464a198c3062f20e029', 'request_id': 'req-8e40d322-92d7-4877-9937-d49d99fb2960'} {{(pid=82026) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 20:07:45.910005 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.notifications [None req-8e40d322-92d7-4877-9937-d49d99fb2960 admin admin] The token cache is being invalidate because project 820e1d7e7e574464a198c3062f20e029 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82026) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 13 20:07:45.910303 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.notifications [None req-8e40d322-92d7-4877-9937-d49d99fb2960 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82026) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 20:07:45.910942 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.notifications [None req-8e40d322-92d7-4877-9937-d49d99fb2960 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82026) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 20:07:45.912496 dv-cinder-828806-6-smb devstack@keystone.service[82026]: [pid: 82026|app: 0|req: 1318/2696] 10.222.0.33 () {58 vars in 1233 bytes} [Tue Sep 13 20:07:45 2022] DELETE /identity/v3/projects/820e1d7e7e574464a198c3062f20e029 => generated 0 bytes in 312 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 20:07:45.917426 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d34c343f-a8ba-4174-ac5d-ddd7e189d43d None None] REQUEST_METHOD: `POST` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:07:45.917993 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d34c343f-a8ba-4174-ac5d-ddd7e189d43d None None] SCRIPT_NAME: `/identity` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:07:45.918095 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d34c343f-a8ba-4174-ac5d-ddd7e189d43d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:07:45.938613 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.auth.core [None req-d34c343f-a8ba-4174-ac5d-ddd7e189d43d None None] MFA Rules not processed for user `57539b6a6f3b4d589f5f5e1d211cd6a0`. Rule list: `[]` (Enabled: `True`). {{(pid=82025) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 20:07:45.939839 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.fernet_utils [None req-d34c343f-a8ba-4174-ac5d-ddd7e189d43d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82025) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 20:07:46.009184 dv-cinder-828806-6-smb devstack@keystone.service[82025]: [pid: 82025|app: 0|req: 1379/2697] 10.222.0.33 () {58 vars in 958 bytes} [Tue Sep 13 20:07:45 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 20:07:46.017844 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7973ff8-56f0-410e-9bc0-216984669f7e None None] REQUEST_METHOD: `POST` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:07:46.018138 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7973ff8-56f0-410e-9bc0-216984669f7e None None] SCRIPT_NAME: `/identity` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:07:46.018415 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7973ff8-56f0-410e-9bc0-216984669f7e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:07:46.042373 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.auth.core [None req-e7973ff8-56f0-410e-9bc0-216984669f7e None None] MFA Rules not processed for user `57539b6a6f3b4d589f5f5e1d211cd6a0`. Rule list: `[]` (Enabled: `True`). {{(pid=82026) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 20:07:46.044193 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.common.fernet_utils [None req-e7973ff8-56f0-410e-9bc0-216984669f7e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82026) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 20:07:46.054221 dv-cinder-828806-6-smb devstack@keystone.service[82026]: [pid: 82026|app: 0|req: 1319/2698] 10.222.0.33 () {58 vars in 958 bytes} [Tue Sep 13 20:07:46 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 20:07:46.058507 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d34c343f-a8ba-4174-ac5d-ddd7e189d43d None None] Authenticating user token {{(pid=82025) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 20:07:46.069248 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d34c343f-a8ba-4174-ac5d-ddd7e189d43d None None] Validating token access rules against request {{(pid=82025) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 20:07:46.073857 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f17f0607-ea53-4bfb-a20e-c431a87abcea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57539b6a6f3b4d589f5f5e1d211cd6a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b454f707d20347ada3d82aa85495635e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82025) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 20:07:46.074480 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f17f0607-ea53-4bfb-a20e-c431a87abcea admin admin] REQUEST_METHOD: `GET` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:07:46.074747 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f17f0607-ea53-4bfb-a20e-c431a87abcea admin admin] SCRIPT_NAME: `/identity` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:07:46.075025 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f17f0607-ea53-4bfb-a20e-c431a87abcea admin admin] PATH_INFO: `/v3/domains` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:07:46.075707 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f17f0607-ea53-4bfb-a20e-c431a87abcea admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82025) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 20:07:46.076018 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f17f0607-ea53-4bfb-a20e-c431a87abcea admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 20:07:46.077609 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f17f0607-ea53-4bfb-a20e-c431a87abcea admin admin] RBAC: Authorization granted {{(pid=82025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 20:07:46.089205 dv-cinder-828806-6-smb devstack@keystone.service[82025]: [pid: 82025|app: 0|req: 1380/2699] 10.222.0.33 () {58 vars in 1153 bytes} [Tue Sep 13 20:07:46 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 20:07:46.093624 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7973ff8-56f0-410e-9bc0-216984669f7e None None] Authenticating user token {{(pid=82026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 20:07:46.103212 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7973ff8-56f0-410e-9bc0-216984669f7e None None] Validating token access rules against request {{(pid=82026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 20:07:46.108181 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-710890aa-fdb7-4b8d-81c4-4fc841399d53 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57539b6a6f3b4d589f5f5e1d211cd6a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b454f707d20347ada3d82aa85495635e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 20:07:46.108877 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-710890aa-fdb7-4b8d-81c4-4fc841399d53 admin admin] REQUEST_METHOD: `POST` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:07:46.109170 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-710890aa-fdb7-4b8d-81c4-4fc841399d53 admin admin] SCRIPT_NAME: `/identity` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:07:46.109432 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-710890aa-fdb7-4b8d-81c4-4fc841399d53 admin admin] PATH_INFO: `/v3/projects` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:07:46.110846 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-710890aa-fdb7-4b8d-81c4-4fc841399d53 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 20:07:46.112776 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-710890aa-fdb7-4b8d-81c4-4fc841399d53 admin admin] RBAC: Authorization granted {{(pid=82026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 20:07:46.284352 dv-cinder-828806-6-smb devstack@keystone.service[82026]: [pid: 82026|app: 0|req: 1320/2700] 10.222.0.33 () {60 vars in 1153 bytes} [Tue Sep 13 20:07:46 2022] POST /identity/v3/projects => generated 405 bytes in 188 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 13 20:07:46.285689 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f17f0607-ea53-4bfb-a20e-c431a87abcea admin admin] Authenticating user token {{(pid=82025) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 20:07:46.296090 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f17f0607-ea53-4bfb-a20e-c431a87abcea admin admin] Validating token access rules against request {{(pid=82025) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 20:07:46.354137 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4877f1d8-326a-4b40-81f3-0785c7733862 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57539b6a6f3b4d589f5f5e1d211cd6a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b454f707d20347ada3d82aa85495635e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82025) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 20:07:46.354742 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4877f1d8-326a-4b40-81f3-0785c7733862 admin admin] REQUEST_METHOD: `POST` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:07:46.355028 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4877f1d8-326a-4b40-81f3-0785c7733862 admin admin] SCRIPT_NAME: `/identity` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:07:46.355341 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4877f1d8-326a-4b40-81f3-0785c7733862 admin admin] PATH_INFO: `/v3/users` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:07:46.355962 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4877f1d8-326a-4b40-81f3-0785c7733862 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 20:07:46.357897 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4877f1d8-326a-4b40-81f3-0785c7733862 admin admin] RBAC: Authorization granted {{(pid=82025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 20:07:46.514447 dv-cinder-828806-6-smb devstack@keystone.service[82025]: [pid: 82025|app: 0|req: 1381/2701] 10.222.0.33 () {60 vars in 1144 bytes} [Tue Sep 13 20:07:46 2022] POST /identity/v3/users => generated 303 bytes in 229 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 13 20:07:46.518754 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-710890aa-fdb7-4b8d-81c4-4fc841399d53 admin admin] Authenticating user token {{(pid=82026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 20:07:46.528853 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-710890aa-fdb7-4b8d-81c4-4fc841399d53 admin admin] Validating token access rules against request {{(pid=82026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 20:07:46.533874 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aa7cff7-1181-4aef-9451-aa772e1cfc85 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57539b6a6f3b4d589f5f5e1d211cd6a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b454f707d20347ada3d82aa85495635e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 20:07:46.534519 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aa7cff7-1181-4aef-9451-aa772e1cfc85 admin admin] REQUEST_METHOD: `GET` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:07:46.534750 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aa7cff7-1181-4aef-9451-aa772e1cfc85 admin admin] SCRIPT_NAME: `/identity` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:07:46.535025 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aa7cff7-1181-4aef-9451-aa772e1cfc85 admin admin] PATH_INFO: `/v3/roles` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:07:46.535704 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7aa7cff7-1181-4aef-9451-aa772e1cfc85 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 20:07:46.537301 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7aa7cff7-1181-4aef-9451-aa772e1cfc85 admin admin] RBAC: Authorization granted {{(pid=82026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 20:07:46.548185 dv-cinder-828806-6-smb devstack@keystone.service[82026]: [pid: 82026|app: 0|req: 1321/2702] 10.222.0.33 () {58 vars in 1122 bytes} [Tue Sep 13 20:07:46 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 13 20:07:46.555407 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4877f1d8-326a-4b40-81f3-0785c7733862 admin admin] Authenticating user token {{(pid=82025) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 20:07:46.566888 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4877f1d8-326a-4b40-81f3-0785c7733862 admin admin] Validating token access rules against request {{(pid=82025) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 20:07:46.571741 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2712c08-d1b4-408d-a923-0a9aa08f53d7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57539b6a6f3b4d589f5f5e1d211cd6a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b454f707d20347ada3d82aa85495635e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82025) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 20:07:46.572468 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2712c08-d1b4-408d-a923-0a9aa08f53d7 admin admin] REQUEST_METHOD: `GET` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:07:46.572817 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2712c08-d1b4-408d-a923-0a9aa08f53d7 admin admin] SCRIPT_NAME: `/identity` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:07:46.573169 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2712c08-d1b4-408d-a923-0a9aa08f53d7 admin admin] PATH_INFO: `/v3/roles` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:07:46.573899 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2712c08-d1b4-408d-a923-0a9aa08f53d7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 20:07:46.575636 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2712c08-d1b4-408d-a923-0a9aa08f53d7 admin admin] RBAC: Authorization granted {{(pid=82025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 20:07:46.587094 dv-cinder-828806-6-smb devstack@keystone.service[82025]: [pid: 82025|app: 0|req: 1382/2703] 10.222.0.33 () {58 vars in 1122 bytes} [Tue Sep 13 20:07:46 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 13 20:07:46.592252 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aa7cff7-1181-4aef-9451-aa772e1cfc85 admin admin] Authenticating user token {{(pid=82026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 20:07:46.603535 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aa7cff7-1181-4aef-9451-aa772e1cfc85 admin admin] Validating token access rules against request {{(pid=82026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 20:07:46.608506 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f288214-dd56-4dc3-ab33-0e23de10fd73 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57539b6a6f3b4d589f5f5e1d211cd6a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b454f707d20347ada3d82aa85495635e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 20:07:46.609268 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f288214-dd56-4dc3-ab33-0e23de10fd73 admin admin] REQUEST_METHOD: `PUT` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:07:46.609568 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f288214-dd56-4dc3-ab33-0e23de10fd73 admin admin] SCRIPT_NAME: `/identity` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:07:46.610556 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f288214-dd56-4dc3-ab33-0e23de10fd73 admin admin] PATH_INFO: `/v3/projects/d9a61b7e41514b85bbb001bc9c69c0e8/users/611f5058d30a41e3a9b9512a00768d30/roles/3618ab638a65401f82333da7596d1daf` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:07:46.626353 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f288214-dd56-4dc3-ab33-0e23de10fd73 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d9a61b7e41514b85bbb001bc9c69c0e8, user_id=611f5058d30a41e3a9b9512a00768d30, role_id=3618ab638a65401f82333da7596d1daf)` {{(pid=82026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 20:07:46.629097 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f288214-dd56-4dc3-ab33-0e23de10fd73 admin admin] RBAC: Authorization granted {{(pid=82026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 20:07:46.868870 dv-cinder-828806-6-smb devstack@keystone.service[82026]: [pid: 82026|app: 0|req: 1322/2704] 10.222.0.33 () {60 vars in 1483 bytes} [Tue Sep 13 20:07:46 2022] PUT /identity/v3/projects/d9a61b7e41514b85bbb001bc9c69c0e8/users/611f5058d30a41e3a9b9512a00768d30/roles/3618ab638a65401f82333da7596d1daf => generated 0 bytes in 277 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 13 20:07:46.873984 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc091eca-5b95-4e1f-9337-b93a598fbec5 None None] REQUEST_METHOD: `POST` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:07:46.880926 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc091eca-5b95-4e1f-9337-b93a598fbec5 None None] SCRIPT_NAME: `/identity` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:07:46.880926 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc091eca-5b95-4e1f-9337-b93a598fbec5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:07:46.893994 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.auth.core [None req-cc091eca-5b95-4e1f-9337-b93a598fbec5 None None] MFA Rules not processed for user `57539b6a6f3b4d589f5f5e1d211cd6a0`. Rule list: `[]` (Enabled: `True`). {{(pid=82025) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 20:07:46.895246 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.fernet_utils [None req-cc091eca-5b95-4e1f-9337-b93a598fbec5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82025) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 20:07:46.937577 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG dbcounter [-] [82025] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=82025) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 20:07:46.955988 dv-cinder-828806-6-smb devstack@keystone.service[82025]: [pid: 82025|app: 0|req: 1383/2705] 10.222.0.33 () {58 vars in 958 bytes} [Tue Sep 13 20:07:46 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 20:07:46.965500 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f288214-dd56-4dc3-ab33-0e23de10fd73 admin admin] Authenticating user token {{(pid=82026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 20:07:46.967331 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.common.fernet_utils [None req-6f288214-dd56-4dc3-ab33-0e23de10fd73 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82026) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 20:07:47.024976 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f288214-dd56-4dc3-ab33-0e23de10fd73 admin admin] Validating token access rules against request {{(pid=82026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 20:07:47.028553 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f6c7036-d13f-4f58-b6bc-0039bf9b8e16 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '023a2c79c2444611b3d431928e56685d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8c6fba0f15b4d6a84ff601919b7b8e4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 20:07:47.029153 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f6c7036-d13f-4f58-b6bc-0039bf9b8e16 service neutron] REQUEST_METHOD: `GET` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:07:47.029437 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f6c7036-d13f-4f58-b6bc-0039bf9b8e16 service neutron] SCRIPT_NAME: `/identity` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:07:47.029709 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f6c7036-d13f-4f58-b6bc-0039bf9b8e16 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:07:47.039129 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f6c7036-d13f-4f58-b6bc-0039bf9b8e16 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 20:07:47.040566 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f6c7036-d13f-4f58-b6bc-0039bf9b8e16 service neutron] RBAC: Authorization granted {{(pid=82026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 20:07:47.051748 dv-cinder-828806-6-smb devstack@keystone.service[82026]: [pid: 82026|app: 0|req: 1323/2706] 10.222.0.33 () {60 vars in 1365 bytes} [Tue Sep 13 20:07:46 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 20:07:48.663338 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9758f99-e590-4158-8b60-fece6d0aa31f None None] REQUEST_METHOD: `POST` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:07:48.663868 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9758f99-e590-4158-8b60-fece6d0aa31f None None] SCRIPT_NAME: `/identity` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:07:48.664056 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9758f99-e590-4158-8b60-fece6d0aa31f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:07:48.697284 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.auth.core [None req-e9758f99-e590-4158-8b60-fece6d0aa31f None None] MFA Rules not processed for user `611f5058d30a41e3a9b9512a00768d30`. Rule list: `[]` (Enabled: `True`). {{(pid=82025) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 20:07:48.698594 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.fernet_utils [None req-e9758f99-e590-4158-8b60-fece6d0aa31f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82025) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 20:07:48.769476 dv-cinder-828806-6-smb devstack@keystone.service[82025]: [pid: 82025|app: 0|req: 1384/2707] 10.222.0.33 () {58 vars in 958 bytes} [Tue Sep 13 20:07:48 2022] POST /identity/v3/auth/tokens => generated 3282 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 20:07:48.773958 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f6c7036-d13f-4f58-b6bc-0039bf9b8e16 service neutron] Authenticating user token {{(pid=82026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 20:07:48.785106 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f6c7036-d13f-4f58-b6bc-0039bf9b8e16 service neutron] Validating token access rules against request {{(pid=82026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 20:07:48.789768 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-208335bf-9851-4512-8844-b62a0c7f57e1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57539b6a6f3b4d589f5f5e1d211cd6a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b454f707d20347ada3d82aa85495635e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 20:07:48.790387 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-208335bf-9851-4512-8844-b62a0c7f57e1 admin admin] REQUEST_METHOD: `POST` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:07:48.790695 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-208335bf-9851-4512-8844-b62a0c7f57e1 admin admin] SCRIPT_NAME: `/identity` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:07:48.790964 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-208335bf-9851-4512-8844-b62a0c7f57e1 admin admin] PATH_INFO: `/v3/projects` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:07:48.804125 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-208335bf-9851-4512-8844-b62a0c7f57e1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 20:07:48.804125 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-208335bf-9851-4512-8844-b62a0c7f57e1 admin admin] RBAC: Authorization granted {{(pid=82026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 20:07:48.961558 dv-cinder-828806-6-smb devstack@keystone.service[82026]: [pid: 82026|app: 0|req: 1324/2708] 10.222.0.33 () {60 vars in 1153 bytes} [Tue Sep 13 20:07:48 2022] POST /identity/v3/projects => generated 403 bytes in 188 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 13 20:07:48.965516 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9758f99-e590-4158-8b60-fece6d0aa31f None None] Authenticating user token {{(pid=82025) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 20:07:48.976822 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9758f99-e590-4158-8b60-fece6d0aa31f None None] Validating token access rules against request {{(pid=82025) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 20:07:49.036445 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deff2817-a2b2-43b2-964e-a4c67c903cb6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57539b6a6f3b4d589f5f5e1d211cd6a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b454f707d20347ada3d82aa85495635e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82025) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 20:07:49.037003 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deff2817-a2b2-43b2-964e-a4c67c903cb6 admin admin] REQUEST_METHOD: `POST` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:07:49.037283 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deff2817-a2b2-43b2-964e-a4c67c903cb6 admin admin] SCRIPT_NAME: `/identity` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:07:49.037558 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deff2817-a2b2-43b2-964e-a4c67c903cb6 admin admin] PATH_INFO: `/v3/users` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:07:49.038191 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-deff2817-a2b2-43b2-964e-a4c67c903cb6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 20:07:49.040170 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-deff2817-a2b2-43b2-964e-a4c67c903cb6 admin admin] RBAC: Authorization granted {{(pid=82025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 20:07:49.164848 dv-cinder-828806-6-smb devstack@keystone.service[82025]: [pid: 82025|app: 0|req: 1385/2709] 10.222.0.33 () {60 vars in 1144 bytes} [Tue Sep 13 20:07:48 2022] POST /identity/v3/users => generated 308 bytes in 200 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 13 20:07:49.168844 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-208335bf-9851-4512-8844-b62a0c7f57e1 admin admin] Authenticating user token {{(pid=82026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 20:07:49.179534 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-208335bf-9851-4512-8844-b62a0c7f57e1 admin admin] Validating token access rules against request {{(pid=82026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 20:07:49.184169 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a75970ae-b030-479d-add6-d8c1b03b27a3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57539b6a6f3b4d589f5f5e1d211cd6a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b454f707d20347ada3d82aa85495635e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 20:07:49.185027 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a75970ae-b030-479d-add6-d8c1b03b27a3 admin admin] REQUEST_METHOD: `GET` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:07:49.185309 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a75970ae-b030-479d-add6-d8c1b03b27a3 admin admin] SCRIPT_NAME: `/identity` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:07:49.185583 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a75970ae-b030-479d-add6-d8c1b03b27a3 admin admin] PATH_INFO: `/v3/roles` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:07:49.186225 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a75970ae-b030-479d-add6-d8c1b03b27a3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 20:07:49.188296 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a75970ae-b030-479d-add6-d8c1b03b27a3 admin admin] RBAC: Authorization granted {{(pid=82026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 20:07:49.198673 dv-cinder-828806-6-smb devstack@keystone.service[82026]: [pid: 82026|app: 0|req: 1325/2710] 10.222.0.33 () {58 vars in 1122 bytes} [Tue Sep 13 20:07:49 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 13 20:07:49.202835 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deff2817-a2b2-43b2-964e-a4c67c903cb6 admin admin] Authenticating user token {{(pid=82025) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 20:07:49.214181 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deff2817-a2b2-43b2-964e-a4c67c903cb6 admin admin] Validating token access rules against request {{(pid=82025) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 20:07:49.219459 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb4def35-2171-4bdf-9844-c313b2b17c1d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57539b6a6f3b4d589f5f5e1d211cd6a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b454f707d20347ada3d82aa85495635e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82025) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 20:07:49.220115 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb4def35-2171-4bdf-9844-c313b2b17c1d admin admin] REQUEST_METHOD: `PUT` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:07:49.220398 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb4def35-2171-4bdf-9844-c313b2b17c1d admin admin] SCRIPT_NAME: `/identity` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:07:49.220673 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb4def35-2171-4bdf-9844-c313b2b17c1d admin admin] PATH_INFO: `/v3/projects/a18b83e24c404cb4a8da6a5915d9e623/users/9f4b9d611b0e4c3493e900b16ac5a9a4/roles/e5af7d5baa93469e9e486ef21c85474e` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:07:49.235635 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb4def35-2171-4bdf-9844-c313b2b17c1d admin admin] RBAC: Authorizing `identity:create_grant(project_id=a18b83e24c404cb4a8da6a5915d9e623, user_id=9f4b9d611b0e4c3493e900b16ac5a9a4, role_id=e5af7d5baa93469e9e486ef21c85474e)` {{(pid=82025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 20:07:49.238269 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb4def35-2171-4bdf-9844-c313b2b17c1d admin admin] RBAC: Authorization granted {{(pid=82025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 20:07:49.366957 dv-cinder-828806-6-smb devstack@keystone.service[82025]: [pid: 82025|app: 0|req: 1386/2711] 10.222.0.33 () {60 vars in 1483 bytes} [Tue Sep 13 20:07:49 2022] PUT /identity/v3/projects/a18b83e24c404cb4a8da6a5915d9e623/users/9f4b9d611b0e4c3493e900b16ac5a9a4/roles/e5af7d5baa93469e9e486ef21c85474e => generated 0 bytes in 165 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 20:07:49.370821 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a75970ae-b030-479d-add6-d8c1b03b27a3 admin admin] Authenticating user token {{(pid=82026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 20:07:49.382593 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a75970ae-b030-479d-add6-d8c1b03b27a3 admin admin] Validating token access rules against request {{(pid=82026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 20:07:49.414069 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG dbcounter [-] [82026] Writing DB stats keystone:SELECT=92,keystone:DELETE=4,keystone:INSERT=4 {{(pid=82026) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 20:07:49.441291 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aabce9de-b6b8-4c31-883d-9cb8e14fcca5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57539b6a6f3b4d589f5f5e1d211cd6a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b454f707d20347ada3d82aa85495635e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 20:07:49.441999 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aabce9de-b6b8-4c31-883d-9cb8e14fcca5 admin admin] REQUEST_METHOD: `GET` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:07:49.442291 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aabce9de-b6b8-4c31-883d-9cb8e14fcca5 admin admin] SCRIPT_NAME: `/identity` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:07:49.442568 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aabce9de-b6b8-4c31-883d-9cb8e14fcca5 admin admin] PATH_INFO: `/v3/roles` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:07:49.443247 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aabce9de-b6b8-4c31-883d-9cb8e14fcca5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 20:07:49.444883 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aabce9de-b6b8-4c31-883d-9cb8e14fcca5 admin admin] RBAC: Authorization granted {{(pid=82026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 20:07:49.456401 dv-cinder-828806-6-smb devstack@keystone.service[82026]: [pid: 82026|app: 0|req: 1326/2712] 10.222.0.33 () {58 vars in 1122 bytes} [Tue Sep 13 20:07:49 2022] GET /identity/v3/roles => generated 1420 bytes in 86 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 13 20:07:49.460710 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb4def35-2171-4bdf-9844-c313b2b17c1d admin admin] Authenticating user token {{(pid=82025) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 20:07:49.472225 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb4def35-2171-4bdf-9844-c313b2b17c1d admin admin] Validating token access rules against request {{(pid=82025) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 20:07:49.476895 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1b7fefb-3f47-4088-b895-c409e9f39811 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57539b6a6f3b4d589f5f5e1d211cd6a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b454f707d20347ada3d82aa85495635e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82025) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 20:07:49.477555 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1b7fefb-3f47-4088-b895-c409e9f39811 admin admin] REQUEST_METHOD: `PUT` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:07:49.477838 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1b7fefb-3f47-4088-b895-c409e9f39811 admin admin] SCRIPT_NAME: `/identity` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:07:49.478188 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1b7fefb-3f47-4088-b895-c409e9f39811 admin admin] PATH_INFO: `/v3/projects/a18b83e24c404cb4a8da6a5915d9e623/users/9f4b9d611b0e4c3493e900b16ac5a9a4/roles/e5af7d5baa93469e9e486ef21c85474e` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:07:49.480155 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1b7fefb-3f47-4088-b895-c409e9f39811 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a18b83e24c404cb4a8da6a5915d9e623, user_id=9f4b9d611b0e4c3493e900b16ac5a9a4, role_id=e5af7d5baa93469e9e486ef21c85474e)` {{(pid=82025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 20:07:49.482894 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1b7fefb-3f47-4088-b895-c409e9f39811 admin admin] RBAC: Authorization granted {{(pid=82025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 20:07:49.495714 dv-cinder-828806-6-smb devstack@keystone.service[82025]: [pid: 82025|app: 0|req: 1387/2713] 10.222.0.33 () {60 vars in 1483 bytes} [Tue Sep 13 20:07:49 2022] PUT /identity/v3/projects/a18b83e24c404cb4a8da6a5915d9e623/users/9f4b9d611b0e4c3493e900b16ac5a9a4/roles/e5af7d5baa93469e9e486ef21c85474e => generated 0 bytes in 36 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 20:07:51.598268 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8460980-d09d-4bfb-92e5-85ac56f70adc None None] REQUEST_METHOD: `POST` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:07:51.598824 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8460980-d09d-4bfb-92e5-85ac56f70adc None None] SCRIPT_NAME: `/identity` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:07:51.599077 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8460980-d09d-4bfb-92e5-85ac56f70adc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:07:51.629175 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.auth.core [None req-e8460980-d09d-4bfb-92e5-85ac56f70adc None None] MFA Rules not processed for user `9f4b9d611b0e4c3493e900b16ac5a9a4`. Rule list: `[]` (Enabled: `True`). {{(pid=82026) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 20:07:51.630478 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.common.fernet_utils [None req-e8460980-d09d-4bfb-92e5-85ac56f70adc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82026) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 20:07:51.713313 dv-cinder-828806-6-smb devstack@keystone.service[82026]: [pid: 82026|app: 0|req: 1327/2714] 10.222.0.33 () {58 vars in 958 bytes} [Tue Sep 13 20:07:51 2022] POST /identity/v3/auth/tokens => generated 3347 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 20:07:52.275264 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1b7fefb-3f47-4088-b895-c409e9f39811 admin admin] Authenticating user token {{(pid=82025) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 20:07:52.282317 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.fernet_utils [None req-e1b7fefb-3f47-4088-b895-c409e9f39811 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82025) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 20:07:52.330666 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG dbcounter [-] [82025] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=82025) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 20:07:52.373927 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1b7fefb-3f47-4088-b895-c409e9f39811 admin admin] Validating token access rules against request {{(pid=82025) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 20:07:52.380358 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91218275-e95c-4b31-b171-d468dacf7734 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '060ea3dea2134429967c164bd158b272', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8c6fba0f15b4d6a84ff601919b7b8e4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82025) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 20:07:52.381600 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91218275-e95c-4b31-b171-d468dacf7734 service placement] REQUEST_METHOD: `GET` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:07:52.382182 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91218275-e95c-4b31-b171-d468dacf7734 service placement] SCRIPT_NAME: `/identity` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:07:52.382641 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91218275-e95c-4b31-b171-d468dacf7734 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:07:52.384769 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.fernet_utils [None req-91218275-e95c-4b31-b171-d468dacf7734 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82025) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 20:07:52.397809 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91218275-e95c-4b31-b171-d468dacf7734 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=82025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 20:07:52.400262 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91218275-e95c-4b31-b171-d468dacf7734 service placement] RBAC: Authorization granted {{(pid=82025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 20:07:52.412347 dv-cinder-828806-6-smb devstack@keystone.service[82025]: [pid: 82025|app: 0|req: 1388/2715] 10.222.0.33 () {60 vars in 1365 bytes} [Tue Sep 13 20:07:52 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 138 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 20:07:53.346318 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8460980-d09d-4bfb-92e5-85ac56f70adc None None] Authenticating user token {{(pid=82026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 20:07:53.410129 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8460980-d09d-4bfb-92e5-85ac56f70adc None None] Validating token access rules against request {{(pid=82026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 20:07:53.414944 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-983c7eb5-bbea-4674-a5f2-d601153bb1e8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57539b6a6f3b4d589f5f5e1d211cd6a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b454f707d20347ada3d82aa85495635e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 20:07:53.415633 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-983c7eb5-bbea-4674-a5f2-d601153bb1e8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:07:53.415922 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-983c7eb5-bbea-4674-a5f2-d601153bb1e8 admin admin] SCRIPT_NAME: `/identity` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:07:53.416205 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-983c7eb5-bbea-4674-a5f2-d601153bb1e8 admin admin] PATH_INFO: `/v3/users/611f5058d30a41e3a9b9512a00768d30` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:07:53.417344 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-983c7eb5-bbea-4674-a5f2-d601153bb1e8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=611f5058d30a41e3a9b9512a00768d30)` {{(pid=82026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 20:07:53.419351 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-983c7eb5-bbea-4674-a5f2-d601153bb1e8 admin admin] RBAC: Authorization granted {{(pid=82026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 20:07:53.692106 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.notifications [None req-983c7eb5-bbea-4674-a5f2-d601153bb1e8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '611f5058d30a41e3a9b9512a00768d30'} {{(pid=82026) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 20:07:53.782254 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.notifications [None req-983c7eb5-bbea-4674-a5f2-d601153bb1e8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '611f5058d30a41e3a9b9512a00768d30'} {{(pid=82026) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 20:07:53.784583 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG dbcounter [-] [82026] Writing DB stats keystone:SELECT=91,keystone:DELETE=8,keystone:INSERT=1 {{(pid=82026) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 20:07:53.794933 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.notifications [None req-983c7eb5-bbea-4674-a5f2-d601153bb1e8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '611f5058d30a41e3a9b9512a00768d30'} {{(pid=82026) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 20:07:53.795612 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.notifications [None req-983c7eb5-bbea-4674-a5f2-d601153bb1e8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '611f5058d30a41e3a9b9512a00768d30'} {{(pid=82026) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 20:07:53.803522 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.notifications [None req-983c7eb5-bbea-4674-a5f2-d601153bb1e8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '611f5058d30a41e3a9b9512a00768d30'} {{(pid=82026) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 20:07:53.809643 dv-cinder-828806-6-smb devstack@keystone.service[82026]: [pid: 82026|app: 0|req: 1328/2716] 10.222.0.33 () {58 vars in 1224 bytes} [Tue Sep 13 20:07:53 2022] DELETE /identity/v3/users/611f5058d30a41e3a9b9512a00768d30 => generated 0 bytes in 464 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 20:07:54.098254 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91218275-e95c-4b31-b171-d468dacf7734 service placement] Authenticating user token {{(pid=82025) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 20:07:54.109916 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91218275-e95c-4b31-b171-d468dacf7734 service placement] Validating token access rules against request {{(pid=82025) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 20:07:54.166505 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-365f4c9b-9feb-4eaa-ab13-a67fd4a8aa64 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57539b6a6f3b4d589f5f5e1d211cd6a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b454f707d20347ada3d82aa85495635e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82025) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 20:07:54.167309 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-365f4c9b-9feb-4eaa-ab13-a67fd4a8aa64 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:07:54.167615 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-365f4c9b-9feb-4eaa-ab13-a67fd4a8aa64 admin admin] SCRIPT_NAME: `/identity` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:07:54.167933 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-365f4c9b-9feb-4eaa-ab13-a67fd4a8aa64 admin admin] PATH_INFO: `/v3/projects/d9a61b7e41514b85bbb001bc9c69c0e8` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:07:54.169063 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-365f4c9b-9feb-4eaa-ab13-a67fd4a8aa64 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d9a61b7e41514b85bbb001bc9c69c0e8)` {{(pid=82025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 20:07:54.170972 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-365f4c9b-9feb-4eaa-ab13-a67fd4a8aa64 admin admin] RBAC: Authorization granted {{(pid=82025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 20:07:54.349210 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.notifications [None req-365f4c9b-9feb-4eaa-ab13-a67fd4a8aa64 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd9a61b7e41514b85bbb001bc9c69c0e8', 'request_id': 'req-365f4c9b-9feb-4eaa-ab13-a67fd4a8aa64'} {{(pid=82025) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 20:07:54.354602 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.notifications [None req-365f4c9b-9feb-4eaa-ab13-a67fd4a8aa64 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd9a61b7e41514b85bbb001bc9c69c0e8', 'request_id': 'req-365f4c9b-9feb-4eaa-ab13-a67fd4a8aa64'} {{(pid=82025) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 20:07:54.361181 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.notifications [None req-365f4c9b-9feb-4eaa-ab13-a67fd4a8aa64 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd9a61b7e41514b85bbb001bc9c69c0e8', 'request_id': 'req-365f4c9b-9feb-4eaa-ab13-a67fd4a8aa64'} {{(pid=82025) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 20:07:54.505126 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.notifications [None req-365f4c9b-9feb-4eaa-ab13-a67fd4a8aa64 admin admin] The token cache is being invalidate because project d9a61b7e41514b85bbb001bc9c69c0e8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82025) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 13 20:07:54.505419 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.notifications [None req-365f4c9b-9feb-4eaa-ab13-a67fd4a8aa64 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82025) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 20:07:54.506035 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.notifications [None req-365f4c9b-9feb-4eaa-ab13-a67fd4a8aa64 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82025) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 20:07:54.507641 dv-cinder-828806-6-smb devstack@keystone.service[82025]: [pid: 82025|app: 0|req: 1389/2717] 10.222.0.33 () {58 vars in 1233 bytes} [Tue Sep 13 20:07:54 2022] DELETE /identity/v3/projects/d9a61b7e41514b85bbb001bc9c69c0e8 => generated 0 bytes in 410 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 20:07:54.511600 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-983c7eb5-bbea-4674-a5f2-d601153bb1e8 admin admin] Authenticating user token {{(pid=82026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 20:07:54.512998 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.common.fernet_utils [None req-983c7eb5-bbea-4674-a5f2-d601153bb1e8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82026) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 20:07:54.526591 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-983c7eb5-bbea-4674-a5f2-d601153bb1e8 admin admin] Validating token access rules against request {{(pid=82026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 20:07:54.582555 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb06714b-1ae9-4804-a4e9-e599d75ffe9e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57539b6a6f3b4d589f5f5e1d211cd6a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b454f707d20347ada3d82aa85495635e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 20:07:54.583224 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb06714b-1ae9-4804-a4e9-e599d75ffe9e admin admin] REQUEST_METHOD: `DELETE` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:07:54.583515 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb06714b-1ae9-4804-a4e9-e599d75ffe9e admin admin] SCRIPT_NAME: `/identity` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:07:54.583803 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb06714b-1ae9-4804-a4e9-e599d75ffe9e admin admin] PATH_INFO: `/v3/users/9f4b9d611b0e4c3493e900b16ac5a9a4` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:07:54.584941 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb06714b-1ae9-4804-a4e9-e599d75ffe9e admin admin] RBAC: Authorizing `identity:delete_user(user_id=9f4b9d611b0e4c3493e900b16ac5a9a4)` {{(pid=82026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 20:07:54.586871 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb06714b-1ae9-4804-a4e9-e599d75ffe9e admin admin] RBAC: Authorization granted {{(pid=82026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 20:07:54.795949 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.notifications [None req-eb06714b-1ae9-4804-a4e9-e599d75ffe9e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9f4b9d611b0e4c3493e900b16ac5a9a4'} {{(pid=82026) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 20:07:54.862176 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.notifications [None req-eb06714b-1ae9-4804-a4e9-e599d75ffe9e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9f4b9d611b0e4c3493e900b16ac5a9a4'} {{(pid=82026) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 20:07:54.875234 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.notifications [None req-eb06714b-1ae9-4804-a4e9-e599d75ffe9e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9f4b9d611b0e4c3493e900b16ac5a9a4'} {{(pid=82026) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 20:07:54.875934 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.notifications [None req-eb06714b-1ae9-4804-a4e9-e599d75ffe9e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9f4b9d611b0e4c3493e900b16ac5a9a4'} {{(pid=82026) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 20:07:54.882931 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.notifications [None req-eb06714b-1ae9-4804-a4e9-e599d75ffe9e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9f4b9d611b0e4c3493e900b16ac5a9a4'} {{(pid=82026) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 20:07:54.893023 dv-cinder-828806-6-smb devstack@keystone.service[82026]: [pid: 82026|app: 0|req: 1329/2718] 10.222.0.33 () {58 vars in 1224 bytes} [Tue Sep 13 20:07:54 2022] DELETE /identity/v3/users/9f4b9d611b0e4c3493e900b16ac5a9a4 => generated 0 bytes in 378 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 20:07:55.198493 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-365f4c9b-9feb-4eaa-ab13-a67fd4a8aa64 admin admin] Authenticating user token {{(pid=82025) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 20:07:55.200027 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.fernet_utils [None req-365f4c9b-9feb-4eaa-ab13-a67fd4a8aa64 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82025) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 20:07:55.213113 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-365f4c9b-9feb-4eaa-ab13-a67fd4a8aa64 admin admin] Validating token access rules against request {{(pid=82025) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 20:07:55.261694 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG dbcounter [-] [82025] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=82025) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 20:07:55.273938 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8f8d5ee-954b-4002-b198-8e94b6b9b3dc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57539b6a6f3b4d589f5f5e1d211cd6a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b454f707d20347ada3d82aa85495635e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82025) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 20:07:55.274566 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8f8d5ee-954b-4002-b198-8e94b6b9b3dc admin admin] REQUEST_METHOD: `DELETE` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:07:55.274849 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8f8d5ee-954b-4002-b198-8e94b6b9b3dc admin admin] SCRIPT_NAME: `/identity` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:07:55.275156 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8f8d5ee-954b-4002-b198-8e94b6b9b3dc admin admin] PATH_INFO: `/v3/projects/a18b83e24c404cb4a8da6a5915d9e623` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:07:55.276308 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8f8d5ee-954b-4002-b198-8e94b6b9b3dc admin admin] RBAC: Authorizing `identity:delete_project(project_id=a18b83e24c404cb4a8da6a5915d9e623)` {{(pid=82025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 20:07:55.278201 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8f8d5ee-954b-4002-b198-8e94b6b9b3dc admin admin] RBAC: Authorization granted {{(pid=82025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 20:07:55.410020 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.notifications [None req-b8f8d5ee-954b-4002-b198-8e94b6b9b3dc admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a18b83e24c404cb4a8da6a5915d9e623', 'request_id': 'req-b8f8d5ee-954b-4002-b198-8e94b6b9b3dc'} {{(pid=82025) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 20:07:55.415461 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.notifications [None req-b8f8d5ee-954b-4002-b198-8e94b6b9b3dc admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a18b83e24c404cb4a8da6a5915d9e623', 'request_id': 'req-b8f8d5ee-954b-4002-b198-8e94b6b9b3dc'} {{(pid=82025) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 20:07:55.422283 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.notifications [None req-b8f8d5ee-954b-4002-b198-8e94b6b9b3dc admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a18b83e24c404cb4a8da6a5915d9e623', 'request_id': 'req-b8f8d5ee-954b-4002-b198-8e94b6b9b3dc'} {{(pid=82025) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 20:07:55.506785 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.notifications [None req-b8f8d5ee-954b-4002-b198-8e94b6b9b3dc admin admin] The token cache is being invalidate because project a18b83e24c404cb4a8da6a5915d9e623 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82025) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 13 20:07:55.506995 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.notifications [None req-b8f8d5ee-954b-4002-b198-8e94b6b9b3dc admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82025) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 20:07:55.507678 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.notifications [None req-b8f8d5ee-954b-4002-b198-8e94b6b9b3dc admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82025) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 20:07:55.509167 dv-cinder-828806-6-smb devstack@keystone.service[82025]: [pid: 82025|app: 0|req: 1390/2719] 10.222.0.33 () {58 vars in 1233 bytes} [Tue Sep 13 20:07:55 2022] DELETE /identity/v3/projects/a18b83e24c404cb4a8da6a5915d9e623 => generated 0 bytes in 311 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 20:07:55.514289 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a601661e-9246-4ce7-a3f9-6a3646bb79f1 None None] REQUEST_METHOD: `POST` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:07:55.514793 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a601661e-9246-4ce7-a3f9-6a3646bb79f1 None None] SCRIPT_NAME: `/identity` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:07:55.514957 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a601661e-9246-4ce7-a3f9-6a3646bb79f1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:07:55.535828 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.auth.core [None req-a601661e-9246-4ce7-a3f9-6a3646bb79f1 None None] MFA Rules not processed for user `57539b6a6f3b4d589f5f5e1d211cd6a0`. Rule list: `[]` (Enabled: `True`). {{(pid=82026) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 20:07:55.537035 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.common.fernet_utils [None req-a601661e-9246-4ce7-a3f9-6a3646bb79f1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82026) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 20:07:55.590810 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG dbcounter [-] [82026] Writing DB stats keystone:SELECT=87,keystone:DELETE=12,keystone:INSERT=1 {{(pid=82026) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 20:07:55.603714 dv-cinder-828806-6-smb devstack@keystone.service[82026]: [pid: 82026|app: 0|req: 1330/2720] 10.222.0.33 () {58 vars in 958 bytes} [Tue Sep 13 20:07:55 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 13 20:07:55.612820 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94c4e9c8-450b-4abd-94b9-664e036090e7 None None] REQUEST_METHOD: `POST` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:07:55.613120 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94c4e9c8-450b-4abd-94b9-664e036090e7 None None] SCRIPT_NAME: `/identity` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:07:55.613407 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94c4e9c8-450b-4abd-94b9-664e036090e7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:07:55.633517 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.auth.core [None req-94c4e9c8-450b-4abd-94b9-664e036090e7 None None] MFA Rules not processed for user `57539b6a6f3b4d589f5f5e1d211cd6a0`. Rule list: `[]` (Enabled: `True`). {{(pid=82025) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 20:07:55.634734 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.fernet_utils [None req-94c4e9c8-450b-4abd-94b9-664e036090e7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82025) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 20:07:55.643181 dv-cinder-828806-6-smb devstack@keystone.service[82025]: [pid: 82025|app: 0|req: 1391/2721] 10.222.0.33 () {58 vars in 958 bytes} [Tue Sep 13 20:07:55 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 20:07:55.647441 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a601661e-9246-4ce7-a3f9-6a3646bb79f1 None None] Authenticating user token {{(pid=82026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 20:07:55.657772 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a601661e-9246-4ce7-a3f9-6a3646bb79f1 None None] Validating token access rules against request {{(pid=82026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 20:07:55.663281 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99fc672b-9289-4f8a-8c17-798f63a235a4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57539b6a6f3b4d589f5f5e1d211cd6a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b454f707d20347ada3d82aa85495635e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 20:07:55.664098 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99fc672b-9289-4f8a-8c17-798f63a235a4 admin admin] REQUEST_METHOD: `GET` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:07:55.664388 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99fc672b-9289-4f8a-8c17-798f63a235a4 admin admin] SCRIPT_NAME: `/identity` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:07:55.664668 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99fc672b-9289-4f8a-8c17-798f63a235a4 admin admin] PATH_INFO: `/v3/domains` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:07:55.665461 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99fc672b-9289-4f8a-8c17-798f63a235a4 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82026) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 20:07:55.665773 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99fc672b-9289-4f8a-8c17-798f63a235a4 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 20:07:55.667538 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99fc672b-9289-4f8a-8c17-798f63a235a4 admin admin] RBAC: Authorization granted {{(pid=82026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 20:07:55.680029 dv-cinder-828806-6-smb devstack@keystone.service[82026]: [pid: 82026|app: 0|req: 1331/2722] 10.222.0.33 () {58 vars in 1153 bytes} [Tue Sep 13 20:07:55 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 20:07:55.687656 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94c4e9c8-450b-4abd-94b9-664e036090e7 None None] Authenticating user token {{(pid=82025) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 20:07:55.696946 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94c4e9c8-450b-4abd-94b9-664e036090e7 None None] Validating token access rules against request {{(pid=82025) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 20:07:55.701631 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b33a1ae1-78a5-4c17-b680-7315392feae9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57539b6a6f3b4d589f5f5e1d211cd6a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b454f707d20347ada3d82aa85495635e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82025) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 20:07:55.702230 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b33a1ae1-78a5-4c17-b680-7315392feae9 admin admin] REQUEST_METHOD: `POST` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:07:55.702516 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b33a1ae1-78a5-4c17-b680-7315392feae9 admin admin] SCRIPT_NAME: `/identity` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:07:55.702890 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b33a1ae1-78a5-4c17-b680-7315392feae9 admin admin] PATH_INFO: `/v3/projects` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:07:55.704075 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b33a1ae1-78a5-4c17-b680-7315392feae9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 20:07:55.706380 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b33a1ae1-78a5-4c17-b680-7315392feae9 admin admin] RBAC: Authorization granted {{(pid=82025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 20:07:55.798744 dv-cinder-828806-6-smb devstack@keystone.service[82025]: [pid: 82025|app: 0|req: 1392/2723] 10.222.0.33 () {60 vars in 1153 bytes} [Tue Sep 13 20:07:55 2022] POST /identity/v3/projects => generated 387 bytes in 112 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 13 20:07:55.802901 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99fc672b-9289-4f8a-8c17-798f63a235a4 admin admin] Authenticating user token {{(pid=82026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 20:07:55.812973 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99fc672b-9289-4f8a-8c17-798f63a235a4 admin admin] Validating token access rules against request {{(pid=82026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 20:07:55.869831 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-670c409d-1617-4463-8885-eb605ccf1ffa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57539b6a6f3b4d589f5f5e1d211cd6a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b454f707d20347ada3d82aa85495635e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 20:07:55.870447 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-670c409d-1617-4463-8885-eb605ccf1ffa admin admin] REQUEST_METHOD: `POST` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:07:55.870753 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-670c409d-1617-4463-8885-eb605ccf1ffa admin admin] SCRIPT_NAME: `/identity` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:07:55.871042 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-670c409d-1617-4463-8885-eb605ccf1ffa admin admin] PATH_INFO: `/v3/users` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:07:55.871702 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-670c409d-1617-4463-8885-eb605ccf1ffa admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 20:07:55.873608 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-670c409d-1617-4463-8885-eb605ccf1ffa admin admin] RBAC: Authorization granted {{(pid=82026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 20:07:56.010519 dv-cinder-828806-6-smb devstack@keystone.service[82026]: [pid: 82026|app: 0|req: 1332/2724] 10.222.0.33 () {60 vars in 1144 bytes} [Tue Sep 13 20:07:55 2022] POST /identity/v3/users => generated 294 bytes in 208 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 13 20:07:56.017807 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b33a1ae1-78a5-4c17-b680-7315392feae9 admin admin] Authenticating user token {{(pid=82025) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 20:07:56.028215 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b33a1ae1-78a5-4c17-b680-7315392feae9 admin admin] Validating token access rules against request {{(pid=82025) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 20:07:56.034982 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-841e4fdd-2fdb-4726-a5d9-99a945702f06 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57539b6a6f3b4d589f5f5e1d211cd6a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b454f707d20347ada3d82aa85495635e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82025) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 20:07:56.035624 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-841e4fdd-2fdb-4726-a5d9-99a945702f06 admin admin] REQUEST_METHOD: `GET` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:07:56.035911 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-841e4fdd-2fdb-4726-a5d9-99a945702f06 admin admin] SCRIPT_NAME: `/identity` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:07:56.036190 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-841e4fdd-2fdb-4726-a5d9-99a945702f06 admin admin] PATH_INFO: `/v3/roles` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:07:56.036873 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-841e4fdd-2fdb-4726-a5d9-99a945702f06 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 20:07:56.038461 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-841e4fdd-2fdb-4726-a5d9-99a945702f06 admin admin] RBAC: Authorization granted {{(pid=82025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 20:07:56.053050 dv-cinder-828806-6-smb devstack@keystone.service[82025]: [pid: 82025|app: 0|req: 1393/2725] 10.222.0.33 () {58 vars in 1122 bytes} [Tue Sep 13 20:07:56 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 13 20:07:56.055918 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-670c409d-1617-4463-8885-eb605ccf1ffa admin admin] Authenticating user token {{(pid=82026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 20:07:56.067385 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-670c409d-1617-4463-8885-eb605ccf1ffa admin admin] Validating token access rules against request {{(pid=82026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 20:07:56.072090 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-387d1077-9028-4caa-bc32-d64d0b36e50e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57539b6a6f3b4d589f5f5e1d211cd6a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b454f707d20347ada3d82aa85495635e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 20:07:56.072696 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-387d1077-9028-4caa-bc32-d64d0b36e50e admin admin] REQUEST_METHOD: `GET` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:07:56.072986 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-387d1077-9028-4caa-bc32-d64d0b36e50e admin admin] SCRIPT_NAME: `/identity` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:07:56.073269 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-387d1077-9028-4caa-bc32-d64d0b36e50e admin admin] PATH_INFO: `/v3/roles` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:07:56.073927 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-387d1077-9028-4caa-bc32-d64d0b36e50e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 20:07:56.075604 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-387d1077-9028-4caa-bc32-d64d0b36e50e admin admin] RBAC: Authorization granted {{(pid=82026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 20:07:56.086879 dv-cinder-828806-6-smb devstack@keystone.service[82026]: [pid: 82026|app: 0|req: 1333/2726] 10.222.0.33 () {58 vars in 1122 bytes} [Tue Sep 13 20:07:56 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 13 20:07:56.096930 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-841e4fdd-2fdb-4726-a5d9-99a945702f06 admin admin] Authenticating user token {{(pid=82025) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 20:07:56.106985 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-841e4fdd-2fdb-4726-a5d9-99a945702f06 admin admin] Validating token access rules against request {{(pid=82025) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 20:07:56.111849 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cca85b7-02f9-4985-b6d7-a3fcca8403f8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57539b6a6f3b4d589f5f5e1d211cd6a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b454f707d20347ada3d82aa85495635e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82025) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 20:07:56.112516 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cca85b7-02f9-4985-b6d7-a3fcca8403f8 admin admin] REQUEST_METHOD: `PUT` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:07:56.112872 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cca85b7-02f9-4985-b6d7-a3fcca8403f8 admin admin] SCRIPT_NAME: `/identity` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:07:56.113175 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cca85b7-02f9-4985-b6d7-a3fcca8403f8 admin admin] PATH_INFO: `/v3/projects/c52970bb2dd74f8083fdb7c885a687af/users/c29f84c23ca14e008ede277c3b670005/roles/3618ab638a65401f82333da7596d1daf` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:07:56.129099 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cca85b7-02f9-4985-b6d7-a3fcca8403f8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c52970bb2dd74f8083fdb7c885a687af, user_id=c29f84c23ca14e008ede277c3b670005, role_id=3618ab638a65401f82333da7596d1daf)` {{(pid=82025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 20:07:56.131793 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cca85b7-02f9-4985-b6d7-a3fcca8403f8 admin admin] RBAC: Authorization granted {{(pid=82025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 20:07:56.286813 dv-cinder-828806-6-smb devstack@keystone.service[82025]: [pid: 82025|app: 0|req: 1394/2727] 10.222.0.33 () {60 vars in 1483 bytes} [Tue Sep 13 20:07:56 2022] PUT /identity/v3/projects/c52970bb2dd74f8083fdb7c885a687af/users/c29f84c23ca14e008ede277c3b670005/roles/3618ab638a65401f82333da7596d1daf => generated 0 bytes in 190 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 20:07:56.297753 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71b055f0-a412-4cca-b0d2-384757828874 None None] REQUEST_METHOD: `POST` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:07:56.298055 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71b055f0-a412-4cca-b0d2-384757828874 None None] SCRIPT_NAME: `/identity` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:07:56.298321 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71b055f0-a412-4cca-b0d2-384757828874 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:07:56.329227 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.auth.core [None req-71b055f0-a412-4cca-b0d2-384757828874 None None] MFA Rules not processed for user `c29f84c23ca14e008ede277c3b670005`. Rule list: `[]` (Enabled: `True`). {{(pid=82026) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 20:07:56.330463 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.common.fernet_utils [None req-71b055f0-a412-4cca-b0d2-384757828874 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82026) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 20:07:56.394998 dv-cinder-828806-6-smb devstack@keystone.service[82026]: [pid: 82026|app: 0|req: 1334/2728] 10.222.0.33 () {58 vars in 958 bytes} [Tue Sep 13 20:07:56 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 20:07:56.403139 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cca85b7-02f9-4985-b6d7-a3fcca8403f8 admin admin] Authenticating user token {{(pid=82025) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 20:07:56.467314 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cca85b7-02f9-4985-b6d7-a3fcca8403f8 admin admin] Validating token access rules against request {{(pid=82025) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 20:07:56.472468 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6677de90-5f22-432f-8af5-1c02ba3c2b95 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57539b6a6f3b4d589f5f5e1d211cd6a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b454f707d20347ada3d82aa85495635e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82025) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 20:07:56.473099 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6677de90-5f22-432f-8af5-1c02ba3c2b95 admin admin] REQUEST_METHOD: `POST` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:07:56.473379 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6677de90-5f22-432f-8af5-1c02ba3c2b95 admin admin] SCRIPT_NAME: `/identity` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:07:56.473683 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6677de90-5f22-432f-8af5-1c02ba3c2b95 admin admin] PATH_INFO: `/v3/projects` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:07:56.474321 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6677de90-5f22-432f-8af5-1c02ba3c2b95 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 20:07:56.476328 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6677de90-5f22-432f-8af5-1c02ba3c2b95 admin admin] RBAC: Authorization granted {{(pid=82025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 20:07:56.577520 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG dbcounter [-] [82025] Writing DB stats keystone:SELECT=89,keystone:DELETE=7,keystone:INSERT=4 {{(pid=82025) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 20:07:56.584169 dv-cinder-828806-6-smb devstack@keystone.service[82025]: [pid: 82025|app: 0|req: 1395/2729] 10.222.0.33 () {60 vars in 1153 bytes} [Tue Sep 13 20:07:56 2022] POST /identity/v3/projects => generated 387 bytes in 182 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 13 20:07:56.589364 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71b055f0-a412-4cca-b0d2-384757828874 None None] Authenticating user token {{(pid=82026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 20:07:56.599734 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71b055f0-a412-4cca-b0d2-384757828874 None None] Validating token access rules against request {{(pid=82026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 20:07:56.644724 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG dbcounter [-] [82026] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=82026) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 20:07:56.656180 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86525c6d-d14d-4680-89a8-607951cfc261 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57539b6a6f3b4d589f5f5e1d211cd6a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b454f707d20347ada3d82aa85495635e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 20:07:56.656788 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86525c6d-d14d-4680-89a8-607951cfc261 admin admin] REQUEST_METHOD: `POST` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:07:56.663988 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86525c6d-d14d-4680-89a8-607951cfc261 admin admin] SCRIPT_NAME: `/identity` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:07:56.663988 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86525c6d-d14d-4680-89a8-607951cfc261 admin admin] PATH_INFO: `/v3/users` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:07:56.663988 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86525c6d-d14d-4680-89a8-607951cfc261 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 20:07:56.663988 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86525c6d-d14d-4680-89a8-607951cfc261 admin admin] RBAC: Authorization granted {{(pid=82026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 20:07:56.771258 dv-cinder-828806-6-smb devstack@keystone.service[82026]: [pid: 82026|app: 0|req: 1335/2730] 10.222.0.33 () {60 vars in 1144 bytes} [Tue Sep 13 20:07:56 2022] POST /identity/v3/users => generated 300 bytes in 183 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 13 20:07:56.776069 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6677de90-5f22-432f-8af5-1c02ba3c2b95 admin admin] Authenticating user token {{(pid=82025) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 20:07:56.788093 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6677de90-5f22-432f-8af5-1c02ba3c2b95 admin admin] Validating token access rules against request {{(pid=82025) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 20:07:56.792766 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0b54e1b-dddd-4bff-9404-630584234f07 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57539b6a6f3b4d589f5f5e1d211cd6a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b454f707d20347ada3d82aa85495635e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82025) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 20:07:56.793394 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0b54e1b-dddd-4bff-9404-630584234f07 admin admin] REQUEST_METHOD: `GET` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:07:56.793681 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0b54e1b-dddd-4bff-9404-630584234f07 admin admin] SCRIPT_NAME: `/identity` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:07:56.793962 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0b54e1b-dddd-4bff-9404-630584234f07 admin admin] PATH_INFO: `/v3/roles` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:07:56.794642 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0b54e1b-dddd-4bff-9404-630584234f07 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 20:07:56.797575 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0b54e1b-dddd-4bff-9404-630584234f07 admin admin] RBAC: Authorization granted {{(pid=82025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 20:07:56.811590 dv-cinder-828806-6-smb devstack@keystone.service[82025]: [pid: 82025|app: 0|req: 1396/2731] 10.222.0.33 () {58 vars in 1122 bytes} [Tue Sep 13 20:07:56 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 13 20:07:56.817994 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86525c6d-d14d-4680-89a8-607951cfc261 admin admin] Authenticating user token {{(pid=82026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 20:07:56.832566 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86525c6d-d14d-4680-89a8-607951cfc261 admin admin] Validating token access rules against request {{(pid=82026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 20:07:56.837968 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65f8214f-623d-482a-aecd-68bc009ac19e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57539b6a6f3b4d589f5f5e1d211cd6a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b454f707d20347ada3d82aa85495635e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 20:07:56.842668 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65f8214f-623d-482a-aecd-68bc009ac19e admin admin] REQUEST_METHOD: `PUT` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:07:56.842668 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65f8214f-623d-482a-aecd-68bc009ac19e admin admin] SCRIPT_NAME: `/identity` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:07:56.842668 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65f8214f-623d-482a-aecd-68bc009ac19e admin admin] PATH_INFO: `/v3/projects/9bb408537d364e27ab0428c92fb61141/users/9a4dee5a2e6b4bda9d125922b1f10cf5/roles/e5af7d5baa93469e9e486ef21c85474e` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:07:56.854727 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65f8214f-623d-482a-aecd-68bc009ac19e admin admin] RBAC: Authorizing `identity:create_grant(project_id=9bb408537d364e27ab0428c92fb61141, user_id=9a4dee5a2e6b4bda9d125922b1f10cf5, role_id=e5af7d5baa93469e9e486ef21c85474e)` {{(pid=82026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 20:07:56.857533 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65f8214f-623d-482a-aecd-68bc009ac19e admin admin] RBAC: Authorization granted {{(pid=82026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 20:07:56.993561 dv-cinder-828806-6-smb devstack@keystone.service[82026]: [pid: 82026|app: 0|req: 1336/2732] 10.222.0.33 () {60 vars in 1483 bytes} [Tue Sep 13 20:07:56 2022] PUT /identity/v3/projects/9bb408537d364e27ab0428c92fb61141/users/9a4dee5a2e6b4bda9d125922b1f10cf5/roles/e5af7d5baa93469e9e486ef21c85474e => generated 0 bytes in 178 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 20:07:56.997569 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0b54e1b-dddd-4bff-9404-630584234f07 admin admin] Authenticating user token {{(pid=82025) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 20:07:57.008168 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0b54e1b-dddd-4bff-9404-630584234f07 admin admin] Validating token access rules against request {{(pid=82025) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 20:07:57.065452 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-398c39d1-0c3d-4aa3-9308-c71e7955e1a9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57539b6a6f3b4d589f5f5e1d211cd6a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b454f707d20347ada3d82aa85495635e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82025) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 20:07:57.066060 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-398c39d1-0c3d-4aa3-9308-c71e7955e1a9 admin admin] REQUEST_METHOD: `GET` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:07:57.066343 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-398c39d1-0c3d-4aa3-9308-c71e7955e1a9 admin admin] SCRIPT_NAME: `/identity` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:07:57.066627 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-398c39d1-0c3d-4aa3-9308-c71e7955e1a9 admin admin] PATH_INFO: `/v3/roles` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:07:57.067343 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-398c39d1-0c3d-4aa3-9308-c71e7955e1a9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 20:07:57.068928 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-398c39d1-0c3d-4aa3-9308-c71e7955e1a9 admin admin] RBAC: Authorization granted {{(pid=82025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 20:07:57.079967 dv-cinder-828806-6-smb devstack@keystone.service[82025]: [pid: 82025|app: 0|req: 1397/2733] 10.222.0.33 () {58 vars in 1122 bytes} [Tue Sep 13 20:07:56 2022] GET /identity/v3/roles => generated 1420 bytes in 83 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 13 20:07:57.084148 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65f8214f-623d-482a-aecd-68bc009ac19e admin admin] Authenticating user token {{(pid=82026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 20:07:57.094906 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65f8214f-623d-482a-aecd-68bc009ac19e admin admin] Validating token access rules against request {{(pid=82026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 20:07:57.099704 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f27155c-ebb5-4a89-9bea-433b27c31479 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57539b6a6f3b4d589f5f5e1d211cd6a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b454f707d20347ada3d82aa85495635e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 20:07:57.100437 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f27155c-ebb5-4a89-9bea-433b27c31479 admin admin] REQUEST_METHOD: `PUT` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:07:57.100724 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f27155c-ebb5-4a89-9bea-433b27c31479 admin admin] SCRIPT_NAME: `/identity` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:07:57.101009 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f27155c-ebb5-4a89-9bea-433b27c31479 admin admin] PATH_INFO: `/v3/projects/9bb408537d364e27ab0428c92fb61141/users/9a4dee5a2e6b4bda9d125922b1f10cf5/roles/e5af7d5baa93469e9e486ef21c85474e` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:07:57.103141 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f27155c-ebb5-4a89-9bea-433b27c31479 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9bb408537d364e27ab0428c92fb61141, user_id=9a4dee5a2e6b4bda9d125922b1f10cf5, role_id=e5af7d5baa93469e9e486ef21c85474e)` {{(pid=82026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 20:07:57.105878 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f27155c-ebb5-4a89-9bea-433b27c31479 admin admin] RBAC: Authorization granted {{(pid=82026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 20:07:57.117949 dv-cinder-828806-6-smb devstack@keystone.service[82026]: [pid: 82026|app: 0|req: 1337/2734] 10.222.0.33 () {60 vars in 1483 bytes} [Tue Sep 13 20:07:57 2022] PUT /identity/v3/projects/9bb408537d364e27ab0428c92fb61141/users/9a4dee5a2e6b4bda9d125922b1f10cf5/roles/e5af7d5baa93469e9e486ef21c85474e => generated 0 bytes in 34 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 13 20:07:57.129416 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf4bc76c-deac-4597-a9a0-e7e597f37403 None None] REQUEST_METHOD: `POST` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:07:57.129703 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf4bc76c-deac-4597-a9a0-e7e597f37403 None None] SCRIPT_NAME: `/identity` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:07:57.129981 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf4bc76c-deac-4597-a9a0-e7e597f37403 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:07:57.158984 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.auth.core [None req-bf4bc76c-deac-4597-a9a0-e7e597f37403 None None] MFA Rules not processed for user `9a4dee5a2e6b4bda9d125922b1f10cf5`. Rule list: `[]` (Enabled: `True`). {{(pid=82025) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 20:07:57.160319 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.fernet_utils [None req-bf4bc76c-deac-4597-a9a0-e7e597f37403 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82025) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 20:07:57.230429 dv-cinder-828806-6-smb devstack@keystone.service[82025]: [pid: 82025|app: 0|req: 1398/2735] 10.222.0.33 () {58 vars in 958 bytes} [Tue Sep 13 20:07:57 2022] POST /identity/v3/auth/tokens => generated 3331 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 20:07:57.241338 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f27155c-ebb5-4a89-9bea-433b27c31479 admin admin] Authenticating user token {{(pid=82026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 20:07:57.243153 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.common.fernet_utils [None req-9f27155c-ebb5-4a89-9bea-433b27c31479 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82026) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 20:07:57.302537 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f27155c-ebb5-4a89-9bea-433b27c31479 admin admin] Validating token access rules against request {{(pid=82026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 20:07:57.306462 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23887cc8-f24f-4872-b8f7-8884ebf633f7 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46024fc6167f4321818b1bed27a521a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8c6fba0f15b4d6a84ff601919b7b8e4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 20:07:57.307117 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23887cc8-f24f-4872-b8f7-8884ebf633f7 service cinder] REQUEST_METHOD: `GET` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:07:57.307405 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23887cc8-f24f-4872-b8f7-8884ebf633f7 service cinder] SCRIPT_NAME: `/identity` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:07:57.307684 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23887cc8-f24f-4872-b8f7-8884ebf633f7 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:07:57.317713 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23887cc8-f24f-4872-b8f7-8884ebf633f7 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=82026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 20:07:57.319188 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23887cc8-f24f-4872-b8f7-8884ebf633f7 service cinder] RBAC: Authorization granted {{(pid=82026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 20:07:57.328459 dv-cinder-828806-6-smb devstack@keystone.service[82026]: [pid: 82026|app: 0|req: 1338/2736] 10.222.0.33 () {60 vars in 1365 bytes} [Tue Sep 13 20:07:57 2022] GET /identity/v3/auth/tokens => generated 3331 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 20:07:58.750753 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf4bc76c-deac-4597-a9a0-e7e597f37403 None None] Authenticating user token {{(pid=82025) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 20:07:58.817849 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf4bc76c-deac-4597-a9a0-e7e597f37403 None None] Validating token access rules against request {{(pid=82025) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 20:07:58.830917 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b460a7c-6a9d-43f3-a773-740cb2d88efe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57539b6a6f3b4d589f5f5e1d211cd6a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b454f707d20347ada3d82aa85495635e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82025) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 20:07:58.830917 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b460a7c-6a9d-43f3-a773-740cb2d88efe admin admin] REQUEST_METHOD: `DELETE` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:07:58.830917 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b460a7c-6a9d-43f3-a773-740cb2d88efe admin admin] SCRIPT_NAME: `/identity` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:07:58.830917 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b460a7c-6a9d-43f3-a773-740cb2d88efe admin admin] PATH_INFO: `/v3/users/c29f84c23ca14e008ede277c3b670005` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:07:58.831364 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b460a7c-6a9d-43f3-a773-740cb2d88efe admin admin] RBAC: Authorizing `identity:delete_user(user_id=c29f84c23ca14e008ede277c3b670005)` {{(pid=82025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 20:07:58.831364 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b460a7c-6a9d-43f3-a773-740cb2d88efe admin admin] RBAC: Authorization granted {{(pid=82025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 20:07:58.840693 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG dbcounter [-] [82025] Writing DB stats keystone:SELECT=99,keystone:DELETE=1 {{(pid=82025) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 20:07:59.074839 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.notifications [None req-3b460a7c-6a9d-43f3-a773-740cb2d88efe admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c29f84c23ca14e008ede277c3b670005'} {{(pid=82025) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 20:07:59.181419 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.notifications [None req-3b460a7c-6a9d-43f3-a773-740cb2d88efe admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c29f84c23ca14e008ede277c3b670005'} {{(pid=82025) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 20:07:59.182112 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.notifications [None req-3b460a7c-6a9d-43f3-a773-740cb2d88efe admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c29f84c23ca14e008ede277c3b670005'} {{(pid=82025) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 20:07:59.195565 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.notifications [None req-3b460a7c-6a9d-43f3-a773-740cb2d88efe admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c29f84c23ca14e008ede277c3b670005'} {{(pid=82025) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 20:07:59.202375 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.notifications [None req-3b460a7c-6a9d-43f3-a773-740cb2d88efe admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c29f84c23ca14e008ede277c3b670005'} {{(pid=82025) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 20:07:59.209159 dv-cinder-828806-6-smb devstack@keystone.service[82025]: [pid: 82025|app: 0|req: 1399/2737] 10.222.0.33 () {58 vars in 1224 bytes} [Tue Sep 13 20:07:58 2022] DELETE /identity/v3/users/c29f84c23ca14e008ede277c3b670005 => generated 0 bytes in 459 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 20:07:59.214791 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a8c4410-7ecd-46d8-b313-ff21e5b4c26e None None] REQUEST_METHOD: `POST` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:07:59.215499 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a8c4410-7ecd-46d8-b313-ff21e5b4c26e None None] SCRIPT_NAME: `/identity` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:07:59.215499 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a8c4410-7ecd-46d8-b313-ff21e5b4c26e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:07:59.234652 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.auth.core [None req-6a8c4410-7ecd-46d8-b313-ff21e5b4c26e None None] MFA Rules not processed for user `57539b6a6f3b4d589f5f5e1d211cd6a0`. Rule list: `[]` (Enabled: `True`). {{(pid=82026) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 20:07:59.235948 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.common.fernet_utils [None req-6a8c4410-7ecd-46d8-b313-ff21e5b4c26e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82026) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 20:07:59.301012 dv-cinder-828806-6-smb devstack@keystone.service[82026]: [pid: 82026|app: 0|req: 1339/2738] 10.222.0.33 () {58 vars in 958 bytes} [Tue Sep 13 20:07:59 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 20:07:59.310957 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b460a7c-6a9d-43f3-a773-740cb2d88efe admin admin] Authenticating user token {{(pid=82025) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 20:07:59.313629 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.fernet_utils [None req-3b460a7c-6a9d-43f3-a773-740cb2d88efe admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82025) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 20:07:59.372034 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b460a7c-6a9d-43f3-a773-740cb2d88efe admin admin] Validating token access rules against request {{(pid=82025) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 20:07:59.376818 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd89d77d-5891-4083-9bc7-34b395bfe3fe service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '023a2c79c2444611b3d431928e56685d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8c6fba0f15b4d6a84ff601919b7b8e4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82025) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 20:07:59.377254 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd89d77d-5891-4083-9bc7-34b395bfe3fe service neutron] REQUEST_METHOD: `GET` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:07:59.377539 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd89d77d-5891-4083-9bc7-34b395bfe3fe service neutron] SCRIPT_NAME: `/identity` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:07:59.377815 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd89d77d-5891-4083-9bc7-34b395bfe3fe service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:07:59.387299 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd89d77d-5891-4083-9bc7-34b395bfe3fe service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 20:07:59.388720 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd89d77d-5891-4083-9bc7-34b395bfe3fe service neutron] RBAC: Authorization granted {{(pid=82025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 20:07:59.399989 dv-cinder-828806-6-smb devstack@keystone.service[82025]: [pid: 82025|app: 0|req: 1400/2739] 10.222.0.33 () {60 vars in 1365 bytes} [Tue Sep 13 20:07:59 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 20:07:59.915294 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a8c4410-7ecd-46d8-b313-ff21e5b4c26e None None] Authenticating user token {{(pid=82026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 20:07:59.916765 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.common.fernet_utils [None req-6a8c4410-7ecd-46d8-b313-ff21e5b4c26e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82026) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 20:07:59.932120 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a8c4410-7ecd-46d8-b313-ff21e5b4c26e None None] Validating token access rules against request {{(pid=82026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 20:07:59.937246 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d17a8f6c-98a3-46cc-b8d6-8e116e5c05bb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57539b6a6f3b4d589f5f5e1d211cd6a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b454f707d20347ada3d82aa85495635e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 20:07:59.937920 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d17a8f6c-98a3-46cc-b8d6-8e116e5c05bb admin admin] REQUEST_METHOD: `DELETE` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:07:59.938201 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d17a8f6c-98a3-46cc-b8d6-8e116e5c05bb admin admin] SCRIPT_NAME: `/identity` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:07:59.938471 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d17a8f6c-98a3-46cc-b8d6-8e116e5c05bb admin admin] PATH_INFO: `/v3/projects/c52970bb2dd74f8083fdb7c885a687af` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:07:59.940231 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d17a8f6c-98a3-46cc-b8d6-8e116e5c05bb admin admin] RBAC: Authorizing `identity:delete_project(project_id=c52970bb2dd74f8083fdb7c885a687af)` {{(pid=82026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 20:07:59.943596 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d17a8f6c-98a3-46cc-b8d6-8e116e5c05bb admin admin] RBAC: Authorization granted {{(pid=82026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 20:08:00.078024 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG dbcounter [-] [82026] Writing DB stats keystone:SELECT=92,keystone:INSERT=5,keystone:DELETE=3 {{(pid=82026) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 20:08:00.084899 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.notifications [None req-d17a8f6c-98a3-46cc-b8d6-8e116e5c05bb admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c52970bb2dd74f8083fdb7c885a687af', 'request_id': 'req-d17a8f6c-98a3-46cc-b8d6-8e116e5c05bb'} {{(pid=82026) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 20:08:00.236649 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.notifications [None req-d17a8f6c-98a3-46cc-b8d6-8e116e5c05bb admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c52970bb2dd74f8083fdb7c885a687af', 'request_id': 'req-d17a8f6c-98a3-46cc-b8d6-8e116e5c05bb'} {{(pid=82026) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 20:08:00.242551 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.notifications [None req-d17a8f6c-98a3-46cc-b8d6-8e116e5c05bb admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c52970bb2dd74f8083fdb7c885a687af', 'request_id': 'req-d17a8f6c-98a3-46cc-b8d6-8e116e5c05bb'} {{(pid=82026) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 20:08:00.253973 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.notifications [None req-d17a8f6c-98a3-46cc-b8d6-8e116e5c05bb admin admin] The token cache is being invalidate because project c52970bb2dd74f8083fdb7c885a687af was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82026) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 13 20:08:00.254326 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.notifications [None req-d17a8f6c-98a3-46cc-b8d6-8e116e5c05bb admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82026) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 20:08:00.254965 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.notifications [None req-d17a8f6c-98a3-46cc-b8d6-8e116e5c05bb admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82026) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 20:08:00.256470 dv-cinder-828806-6-smb devstack@keystone.service[82026]: [pid: 82026|app: 0|req: 1340/2740] 10.222.0.33 () {58 vars in 1233 bytes} [Tue Sep 13 20:07:59 2022] DELETE /identity/v3/projects/c52970bb2dd74f8083fdb7c885a687af => generated 0 bytes in 342 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 20:08:00.260482 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd89d77d-5891-4083-9bc7-34b395bfe3fe service neutron] Authenticating user token {{(pid=82025) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 20:08:00.270824 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd89d77d-5891-4083-9bc7-34b395bfe3fe service neutron] Validating token access rules against request {{(pid=82025) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 20:08:00.332185 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fe2a03a-5a5e-43a4-a1d6-60fc2e57a2a8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57539b6a6f3b4d589f5f5e1d211cd6a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b454f707d20347ada3d82aa85495635e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82025) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 20:08:00.332809 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fe2a03a-5a5e-43a4-a1d6-60fc2e57a2a8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:08:00.333090 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fe2a03a-5a5e-43a4-a1d6-60fc2e57a2a8 admin admin] SCRIPT_NAME: `/identity` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:08:00.333366 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fe2a03a-5a5e-43a4-a1d6-60fc2e57a2a8 admin admin] PATH_INFO: `/v3/users/9a4dee5a2e6b4bda9d125922b1f10cf5` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:08:00.334568 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fe2a03a-5a5e-43a4-a1d6-60fc2e57a2a8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=9a4dee5a2e6b4bda9d125922b1f10cf5)` {{(pid=82025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 20:08:00.336500 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fe2a03a-5a5e-43a4-a1d6-60fc2e57a2a8 admin admin] RBAC: Authorization granted {{(pid=82025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 20:08:00.539096 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG dbcounter [-] [82025] Writing DB stats keystone:SELECT=85,keystone:DELETE=14,keystone:INSERT=1 {{(pid=82025) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 20:08:00.548408 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.notifications [None req-4fe2a03a-5a5e-43a4-a1d6-60fc2e57a2a8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9a4dee5a2e6b4bda9d125922b1f10cf5'} {{(pid=82025) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 20:08:00.630821 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.notifications [None req-4fe2a03a-5a5e-43a4-a1d6-60fc2e57a2a8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9a4dee5a2e6b4bda9d125922b1f10cf5'} {{(pid=82025) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 20:08:00.631553 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.notifications [None req-4fe2a03a-5a5e-43a4-a1d6-60fc2e57a2a8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9a4dee5a2e6b4bda9d125922b1f10cf5'} {{(pid=82025) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 20:08:00.646501 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.notifications [None req-4fe2a03a-5a5e-43a4-a1d6-60fc2e57a2a8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9a4dee5a2e6b4bda9d125922b1f10cf5'} {{(pid=82025) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 20:08:00.653772 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.notifications [None req-4fe2a03a-5a5e-43a4-a1d6-60fc2e57a2a8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9a4dee5a2e6b4bda9d125922b1f10cf5'} {{(pid=82025) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 20:08:00.659863 dv-cinder-828806-6-smb devstack@keystone.service[82025]: [pid: 82025|app: 0|req: 1401/2741] 10.222.0.33 () {58 vars in 1224 bytes} [Tue Sep 13 20:08:00 2022] DELETE /identity/v3/users/9a4dee5a2e6b4bda9d125922b1f10cf5 => generated 0 bytes in 400 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 20:08:01.091411 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d17a8f6c-98a3-46cc-b8d6-8e116e5c05bb admin admin] Authenticating user token {{(pid=82026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 20:08:01.092970 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.common.fernet_utils [None req-d17a8f6c-98a3-46cc-b8d6-8e116e5c05bb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82026) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 20:08:01.108046 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d17a8f6c-98a3-46cc-b8d6-8e116e5c05bb admin admin] Validating token access rules against request {{(pid=82026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 20:08:01.178358 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5cbe5a3-1b9e-49d4-be03-90caba70935a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57539b6a6f3b4d589f5f5e1d211cd6a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b454f707d20347ada3d82aa85495635e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 20:08:01.178994 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5cbe5a3-1b9e-49d4-be03-90caba70935a admin admin] REQUEST_METHOD: `DELETE` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:08:01.179350 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5cbe5a3-1b9e-49d4-be03-90caba70935a admin admin] SCRIPT_NAME: `/identity` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:08:01.179623 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5cbe5a3-1b9e-49d4-be03-90caba70935a admin admin] PATH_INFO: `/v3/projects/9bb408537d364e27ab0428c92fb61141` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:08:01.180828 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5cbe5a3-1b9e-49d4-be03-90caba70935a admin admin] RBAC: Authorizing `identity:delete_project(project_id=9bb408537d364e27ab0428c92fb61141)` {{(pid=82026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 20:08:01.182724 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5cbe5a3-1b9e-49d4-be03-90caba70935a admin admin] RBAC: Authorization granted {{(pid=82026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 20:08:01.319659 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.notifications [None req-d5cbe5a3-1b9e-49d4-be03-90caba70935a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9bb408537d364e27ab0428c92fb61141', 'request_id': 'req-d5cbe5a3-1b9e-49d4-be03-90caba70935a'} {{(pid=82026) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 20:08:01.404406 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.notifications [None req-d5cbe5a3-1b9e-49d4-be03-90caba70935a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9bb408537d364e27ab0428c92fb61141', 'request_id': 'req-d5cbe5a3-1b9e-49d4-be03-90caba70935a'} {{(pid=82026) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 20:08:01.411356 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.notifications [None req-d5cbe5a3-1b9e-49d4-be03-90caba70935a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9bb408537d364e27ab0428c92fb61141', 'request_id': 'req-d5cbe5a3-1b9e-49d4-be03-90caba70935a'} {{(pid=82026) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 20:08:01.423358 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.notifications [None req-d5cbe5a3-1b9e-49d4-be03-90caba70935a admin admin] The token cache is being invalidate because project 9bb408537d364e27ab0428c92fb61141 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82026) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 13 20:08:01.423637 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.notifications [None req-d5cbe5a3-1b9e-49d4-be03-90caba70935a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82026) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 20:08:01.424281 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.notifications [None req-d5cbe5a3-1b9e-49d4-be03-90caba70935a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82026) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 20:08:01.425828 dv-cinder-828806-6-smb devstack@keystone.service[82026]: [pid: 82026|app: 0|req: 1341/2742] 10.222.0.33 () {58 vars in 1233 bytes} [Tue Sep 13 20:08:01 2022] DELETE /identity/v3/projects/9bb408537d364e27ab0428c92fb61141 => generated 0 bytes in 335 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 20:08:01.430719 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72e8b7cd-32f5-401d-8edf-e3cc6e7b906a None None] REQUEST_METHOD: `POST` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:08:01.431255 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72e8b7cd-32f5-401d-8edf-e3cc6e7b906a None None] SCRIPT_NAME: `/identity` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:08:01.431526 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72e8b7cd-32f5-401d-8edf-e3cc6e7b906a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:08:01.451597 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.auth.core [None req-72e8b7cd-32f5-401d-8edf-e3cc6e7b906a None None] MFA Rules not processed for user `57539b6a6f3b4d589f5f5e1d211cd6a0`. Rule list: `[]` (Enabled: `True`). {{(pid=82025) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 20:08:01.453029 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.fernet_utils [None req-72e8b7cd-32f5-401d-8edf-e3cc6e7b906a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82025) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 20:08:01.525146 dv-cinder-828806-6-smb devstack@keystone.service[82025]: [pid: 82025|app: 0|req: 1402/2743] 10.222.0.33 () {58 vars in 958 bytes} [Tue Sep 13 20:08:01 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 20:08:01.533865 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09fa918a-886e-4ac7-81ed-709073ae3564 None None] REQUEST_METHOD: `POST` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:08:01.534158 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09fa918a-886e-4ac7-81ed-709073ae3564 None None] SCRIPT_NAME: `/identity` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:08:01.534435 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09fa918a-886e-4ac7-81ed-709073ae3564 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:08:01.557114 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.auth.core [None req-09fa918a-886e-4ac7-81ed-709073ae3564 None None] MFA Rules not processed for user `57539b6a6f3b4d589f5f5e1d211cd6a0`. Rule list: `[]` (Enabled: `True`). {{(pid=82026) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 20:08:01.558321 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.common.fernet_utils [None req-09fa918a-886e-4ac7-81ed-709073ae3564 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82026) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 20:08:01.566414 dv-cinder-828806-6-smb devstack@keystone.service[82026]: [pid: 82026|app: 0|req: 1342/2744] 10.222.0.33 () {58 vars in 958 bytes} [Tue Sep 13 20:08:01 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 20:08:01.570659 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72e8b7cd-32f5-401d-8edf-e3cc6e7b906a None None] Authenticating user token {{(pid=82025) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 20:08:01.580854 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72e8b7cd-32f5-401d-8edf-e3cc6e7b906a None None] Validating token access rules against request {{(pid=82025) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 20:08:01.585434 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b33f528a-4fb5-4634-85d4-16d0f800610d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57539b6a6f3b4d589f5f5e1d211cd6a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b454f707d20347ada3d82aa85495635e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82025) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 20:08:01.586031 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b33f528a-4fb5-4634-85d4-16d0f800610d admin admin] REQUEST_METHOD: `GET` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:08:01.586315 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b33f528a-4fb5-4634-85d4-16d0f800610d admin admin] SCRIPT_NAME: `/identity` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:08:01.586591 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b33f528a-4fb5-4634-85d4-16d0f800610d admin admin] PATH_INFO: `/v3/domains` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:08:01.587274 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b33f528a-4fb5-4634-85d4-16d0f800610d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82025) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 20:08:01.587582 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b33f528a-4fb5-4634-85d4-16d0f800610d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 20:08:01.589171 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b33f528a-4fb5-4634-85d4-16d0f800610d admin admin] RBAC: Authorization granted {{(pid=82025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 20:08:01.601662 dv-cinder-828806-6-smb devstack@keystone.service[82025]: [pid: 82025|app: 0|req: 1403/2745] 10.222.0.33 () {58 vars in 1153 bytes} [Tue Sep 13 20:08:01 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 20:08:01.606035 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09fa918a-886e-4ac7-81ed-709073ae3564 None None] Authenticating user token {{(pid=82026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 20:08:01.619558 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09fa918a-886e-4ac7-81ed-709073ae3564 None None] Validating token access rules against request {{(pid=82026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 20:08:01.624304 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d8c03fa-b414-4d88-807c-fe4434d863cb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57539b6a6f3b4d589f5f5e1d211cd6a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b454f707d20347ada3d82aa85495635e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 20:08:01.625138 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d8c03fa-b414-4d88-807c-fe4434d863cb admin admin] REQUEST_METHOD: `POST` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:08:01.625431 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d8c03fa-b414-4d88-807c-fe4434d863cb admin admin] SCRIPT_NAME: `/identity` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:08:01.625713 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d8c03fa-b414-4d88-807c-fe4434d863cb admin admin] PATH_INFO: `/v3/projects` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:08:01.626363 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d8c03fa-b414-4d88-807c-fe4434d863cb admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 20:08:01.628314 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d8c03fa-b414-4d88-807c-fe4434d863cb admin admin] RBAC: Authorization granted {{(pid=82026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 20:08:01.718646 dv-cinder-828806-6-smb devstack@keystone.service[82026]: [pid: 82026|app: 0|req: 1343/2746] 10.222.0.33 () {60 vars in 1153 bytes} [Tue Sep 13 20:08:01 2022] POST /identity/v3/projects => generated 383 bytes in 113 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 13 20:08:01.722722 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b33f528a-4fb5-4634-85d4-16d0f800610d admin admin] Authenticating user token {{(pid=82025) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 20:08:01.733115 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b33f528a-4fb5-4634-85d4-16d0f800610d admin admin] Validating token access rules against request {{(pid=82025) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 20:08:01.796136 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ace442ff-aa21-4bdb-a2a9-e605f839bbd5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57539b6a6f3b4d589f5f5e1d211cd6a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b454f707d20347ada3d82aa85495635e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82025) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 20:08:01.796849 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ace442ff-aa21-4bdb-a2a9-e605f839bbd5 admin admin] REQUEST_METHOD: `POST` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:08:01.797166 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ace442ff-aa21-4bdb-a2a9-e605f839bbd5 admin admin] SCRIPT_NAME: `/identity` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:08:01.797445 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ace442ff-aa21-4bdb-a2a9-e605f839bbd5 admin admin] PATH_INFO: `/v3/users` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:08:01.798101 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ace442ff-aa21-4bdb-a2a9-e605f839bbd5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 20:08:01.800088 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ace442ff-aa21-4bdb-a2a9-e605f839bbd5 admin admin] RBAC: Authorization granted {{(pid=82025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 20:08:01.900547 dv-cinder-828806-6-smb devstack@keystone.service[82025]: [pid: 82025|app: 0|req: 1404/2747] 10.222.0.33 () {60 vars in 1144 bytes} [Tue Sep 13 20:08:01 2022] POST /identity/v3/users => generated 292 bytes in 178 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 13 20:08:01.904449 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d8c03fa-b414-4d88-807c-fe4434d863cb admin admin] Authenticating user token {{(pid=82026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 20:08:01.915848 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d8c03fa-b414-4d88-807c-fe4434d863cb admin admin] Validating token access rules against request {{(pid=82026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 20:08:01.920890 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5478947d-bd9e-43e3-b2e3-2fffae962014 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57539b6a6f3b4d589f5f5e1d211cd6a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b454f707d20347ada3d82aa85495635e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 20:08:01.921828 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5478947d-bd9e-43e3-b2e3-2fffae962014 admin admin] REQUEST_METHOD: `GET` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:08:01.921828 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5478947d-bd9e-43e3-b2e3-2fffae962014 admin admin] SCRIPT_NAME: `/identity` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:08:01.922101 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5478947d-bd9e-43e3-b2e3-2fffae962014 admin admin] PATH_INFO: `/v3/roles` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:08:01.922728 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5478947d-bd9e-43e3-b2e3-2fffae962014 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 20:08:01.924354 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5478947d-bd9e-43e3-b2e3-2fffae962014 admin admin] RBAC: Authorization granted {{(pid=82026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 20:08:01.936174 dv-cinder-828806-6-smb devstack@keystone.service[82026]: [pid: 82026|app: 0|req: 1344/2748] 10.222.0.33 () {58 vars in 1122 bytes} [Tue Sep 13 20:08:01 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 13 20:08:01.939578 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ace442ff-aa21-4bdb-a2a9-e605f839bbd5 admin admin] Authenticating user token {{(pid=82025) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 20:08:01.949896 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ace442ff-aa21-4bdb-a2a9-e605f839bbd5 admin admin] Validating token access rules against request {{(pid=82025) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 20:08:01.955676 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4a0befc-a9b7-4e1f-950c-d8565f2f58a2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57539b6a6f3b4d589f5f5e1d211cd6a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b454f707d20347ada3d82aa85495635e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82025) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 20:08:01.958784 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4a0befc-a9b7-4e1f-950c-d8565f2f58a2 admin admin] REQUEST_METHOD: `GET` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:08:01.958784 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4a0befc-a9b7-4e1f-950c-d8565f2f58a2 admin admin] SCRIPT_NAME: `/identity` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:08:01.958784 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4a0befc-a9b7-4e1f-950c-d8565f2f58a2 admin admin] PATH_INFO: `/v3/roles` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:08:01.958784 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4a0befc-a9b7-4e1f-950c-d8565f2f58a2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 20:08:01.959218 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4a0befc-a9b7-4e1f-950c-d8565f2f58a2 admin admin] RBAC: Authorization granted {{(pid=82025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 20:08:01.970688 dv-cinder-828806-6-smb devstack@keystone.service[82025]: [pid: 82025|app: 0|req: 1405/2749] 10.222.0.33 () {58 vars in 1122 bytes} [Tue Sep 13 20:08:01 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 13 20:08:01.974913 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5478947d-bd9e-43e3-b2e3-2fffae962014 admin admin] Authenticating user token {{(pid=82026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 20:08:01.985038 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5478947d-bd9e-43e3-b2e3-2fffae962014 admin admin] Validating token access rules against request {{(pid=82026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 20:08:01.989645 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9feae00-d98b-4177-bf24-9a106509a501 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57539b6a6f3b4d589f5f5e1d211cd6a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b454f707d20347ada3d82aa85495635e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 20:08:01.990289 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9feae00-d98b-4177-bf24-9a106509a501 admin admin] REQUEST_METHOD: `PUT` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:08:01.990570 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9feae00-d98b-4177-bf24-9a106509a501 admin admin] SCRIPT_NAME: `/identity` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:08:01.990871 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9feae00-d98b-4177-bf24-9a106509a501 admin admin] PATH_INFO: `/v3/projects/febc77d76fc945bcbd785c73ffc965cf/users/69ffc0ea0b8a4ac38e0ade1a3389aec3/roles/3618ab638a65401f82333da7596d1daf` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:08:02.006620 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9feae00-d98b-4177-bf24-9a106509a501 admin admin] RBAC: Authorizing `identity:create_grant(project_id=febc77d76fc945bcbd785c73ffc965cf, user_id=69ffc0ea0b8a4ac38e0ade1a3389aec3, role_id=3618ab638a65401f82333da7596d1daf)` {{(pid=82026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 20:08:02.009717 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9feae00-d98b-4177-bf24-9a106509a501 admin admin] RBAC: Authorization granted {{(pid=82026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 20:08:02.011921 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG dbcounter [-] [82026] Writing DB stats keystone:SELECT=86,keystone:DELETE=11,keystone:INSERT=3 {{(pid=82026) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 20:08:02.129809 dv-cinder-828806-6-smb devstack@keystone.service[82026]: [pid: 82026|app: 0|req: 1345/2750] 10.222.0.33 () {60 vars in 1483 bytes} [Tue Sep 13 20:08:01 2022] PUT /identity/v3/projects/febc77d76fc945bcbd785c73ffc965cf/users/69ffc0ea0b8a4ac38e0ade1a3389aec3/roles/3618ab638a65401f82333da7596d1daf => generated 0 bytes in 155 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 20:08:02.141008 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-425f6c34-7d9b-4dd9-b084-01bf8aa2da5f None None] REQUEST_METHOD: `POST` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:08:02.141294 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-425f6c34-7d9b-4dd9-b084-01bf8aa2da5f None None] SCRIPT_NAME: `/identity` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:08:02.141606 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-425f6c34-7d9b-4dd9-b084-01bf8aa2da5f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:08:02.169924 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.auth.core [None req-425f6c34-7d9b-4dd9-b084-01bf8aa2da5f None None] MFA Rules not processed for user `69ffc0ea0b8a4ac38e0ade1a3389aec3`. Rule list: `[]` (Enabled: `True`). {{(pid=82025) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 20:08:02.171309 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.fernet_utils [None req-425f6c34-7d9b-4dd9-b084-01bf8aa2da5f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82025) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 20:08:02.177351 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG dbcounter [-] [82025] Writing DB stats keystone:SELECT=91,keystone:DELETE=5,keystone:INSERT=4 {{(pid=82025) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 20:08:02.238669 dv-cinder-828806-6-smb devstack@keystone.service[82025]: [pid: 82025|app: 0|req: 1406/2751] 10.222.0.33 () {58 vars in 958 bytes} [Tue Sep 13 20:08:02 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 20:08:02.252886 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9feae00-d98b-4177-bf24-9a106509a501 admin admin] Authenticating user token {{(pid=82026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 20:08:02.254923 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.common.fernet_utils [None req-b9feae00-d98b-4177-bf24-9a106509a501 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82026) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 20:08:02.314093 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9feae00-d98b-4177-bf24-9a106509a501 admin admin] Validating token access rules against request {{(pid=82026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 20:08:02.318658 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb077cf7-a763-4496-adbf-76c7b0e2e18b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46024fc6167f4321818b1bed27a521a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8c6fba0f15b4d6a84ff601919b7b8e4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 20:08:02.319286 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb077cf7-a763-4496-adbf-76c7b0e2e18b service cinder] REQUEST_METHOD: `GET` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:08:02.319570 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb077cf7-a763-4496-adbf-76c7b0e2e18b service cinder] SCRIPT_NAME: `/identity` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:08:02.319847 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb077cf7-a763-4496-adbf-76c7b0e2e18b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:08:02.328943 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb077cf7-a763-4496-adbf-76c7b0e2e18b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=82026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 20:08:02.333085 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb077cf7-a763-4496-adbf-76c7b0e2e18b service cinder] RBAC: Authorization granted {{(pid=82026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 20:08:02.339619 dv-cinder-828806-6-smb devstack@keystone.service[82026]: [pid: 82026|app: 0|req: 1346/2752] 10.222.0.33 () {60 vars in 1365 bytes} [Tue Sep 13 20:08:02 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 20:08:05.438965 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-425f6c34-7d9b-4dd9-b084-01bf8aa2da5f None None] Authenticating user token {{(pid=82025) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 20:08:05.510357 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-425f6c34-7d9b-4dd9-b084-01bf8aa2da5f None None] Validating token access rules against request {{(pid=82025) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 20:08:05.517565 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0469f1eb-f3cb-45a2-a6d0-8270f25f95c3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57539b6a6f3b4d589f5f5e1d211cd6a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b454f707d20347ada3d82aa85495635e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82025) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 20:08:05.518219 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0469f1eb-f3cb-45a2-a6d0-8270f25f95c3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:08:05.518504 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0469f1eb-f3cb-45a2-a6d0-8270f25f95c3 admin admin] SCRIPT_NAME: `/identity` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:08:05.518782 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0469f1eb-f3cb-45a2-a6d0-8270f25f95c3 admin admin] PATH_INFO: `/v3/users/69ffc0ea0b8a4ac38e0ade1a3389aec3` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:08:05.519968 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0469f1eb-f3cb-45a2-a6d0-8270f25f95c3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=69ffc0ea0b8a4ac38e0ade1a3389aec3)` {{(pid=82025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 20:08:05.521907 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0469f1eb-f3cb-45a2-a6d0-8270f25f95c3 admin admin] RBAC: Authorization granted {{(pid=82025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 20:08:05.825586 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.notifications [None req-0469f1eb-f3cb-45a2-a6d0-8270f25f95c3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '69ffc0ea0b8a4ac38e0ade1a3389aec3'} {{(pid=82025) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 20:08:05.916658 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.notifications [None req-0469f1eb-f3cb-45a2-a6d0-8270f25f95c3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '69ffc0ea0b8a4ac38e0ade1a3389aec3'} {{(pid=82025) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 20:08:05.917321 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.notifications [None req-0469f1eb-f3cb-45a2-a6d0-8270f25f95c3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '69ffc0ea0b8a4ac38e0ade1a3389aec3'} {{(pid=82025) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 20:08:05.931488 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.notifications [None req-0469f1eb-f3cb-45a2-a6d0-8270f25f95c3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '69ffc0ea0b8a4ac38e0ade1a3389aec3'} {{(pid=82025) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 20:08:05.939244 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.notifications [None req-0469f1eb-f3cb-45a2-a6d0-8270f25f95c3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '69ffc0ea0b8a4ac38e0ade1a3389aec3'} {{(pid=82025) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 20:08:05.945185 dv-cinder-828806-6-smb devstack@keystone.service[82025]: [pid: 82025|app: 0|req: 1407/2753] 10.222.0.33 () {58 vars in 1224 bytes} [Tue Sep 13 20:08:05 2022] DELETE /identity/v3/users/69ffc0ea0b8a4ac38e0ade1a3389aec3 => generated 0 bytes in 507 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 20:08:05.950033 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81e3c303-aa85-4911-a279-c5257435e377 None None] REQUEST_METHOD: `POST` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:08:05.950570 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81e3c303-aa85-4911-a279-c5257435e377 None None] SCRIPT_NAME: `/identity` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:08:05.950718 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81e3c303-aa85-4911-a279-c5257435e377 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:08:05.971186 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.auth.core [None req-81e3c303-aa85-4911-a279-c5257435e377 None None] MFA Rules not processed for user `57539b6a6f3b4d589f5f5e1d211cd6a0`. Rule list: `[]` (Enabled: `True`). {{(pid=82026) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 20:08:05.972526 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.common.fernet_utils [None req-81e3c303-aa85-4911-a279-c5257435e377 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82026) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 20:08:06.033994 dv-cinder-828806-6-smb devstack@keystone.service[82026]: [pid: 82026|app: 0|req: 1347/2754] 10.222.0.33 () {58 vars in 958 bytes} [Tue Sep 13 20:08:05 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 20:08:06.044591 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0469f1eb-f3cb-45a2-a6d0-8270f25f95c3 admin admin] Authenticating user token {{(pid=82025) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 20:08:06.046154 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.fernet_utils [None req-0469f1eb-f3cb-45a2-a6d0-8270f25f95c3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82025) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 20:08:06.079187 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG dbcounter [-] [82025] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82025) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 20:08:06.106151 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0469f1eb-f3cb-45a2-a6d0-8270f25f95c3 admin admin] Validating token access rules against request {{(pid=82025) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 20:08:06.110231 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc236bb5-7bfa-47b4-bb46-2abdee221f61 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '023a2c79c2444611b3d431928e56685d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8c6fba0f15b4d6a84ff601919b7b8e4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82025) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 20:08:06.110892 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc236bb5-7bfa-47b4-bb46-2abdee221f61 service neutron] REQUEST_METHOD: `GET` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:08:06.111273 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc236bb5-7bfa-47b4-bb46-2abdee221f61 service neutron] SCRIPT_NAME: `/identity` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:08:06.111551 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc236bb5-7bfa-47b4-bb46-2abdee221f61 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:08:06.121263 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc236bb5-7bfa-47b4-bb46-2abdee221f61 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 20:08:06.122718 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc236bb5-7bfa-47b4-bb46-2abdee221f61 service neutron] RBAC: Authorization granted {{(pid=82025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 20:08:06.133136 dv-cinder-828806-6-smb devstack@keystone.service[82025]: [pid: 82025|app: 0|req: 1408/2755] 10.222.0.33 () {60 vars in 1365 bytes} [Tue Sep 13 20:08:06 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 20:08:06.629771 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81e3c303-aa85-4911-a279-c5257435e377 None None] Authenticating user token {{(pid=82026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 20:08:06.631281 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.common.fernet_utils [None req-81e3c303-aa85-4911-a279-c5257435e377 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82026) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 20:08:06.644279 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81e3c303-aa85-4911-a279-c5257435e377 None None] Validating token access rules against request {{(pid=82026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 20:08:06.648969 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67d366cc-7be0-4059-8dba-1a75f186b383 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57539b6a6f3b4d589f5f5e1d211cd6a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b454f707d20347ada3d82aa85495635e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 20:08:06.649604 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67d366cc-7be0-4059-8dba-1a75f186b383 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:08:06.649896 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67d366cc-7be0-4059-8dba-1a75f186b383 admin admin] SCRIPT_NAME: `/identity` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:08:06.650327 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67d366cc-7be0-4059-8dba-1a75f186b383 admin admin] PATH_INFO: `/v3/projects/febc77d76fc945bcbd785c73ffc965cf` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:08:06.651493 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67d366cc-7be0-4059-8dba-1a75f186b383 admin admin] RBAC: Authorizing `identity:delete_project(project_id=febc77d76fc945bcbd785c73ffc965cf)` {{(pid=82026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 20:08:06.653421 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67d366cc-7be0-4059-8dba-1a75f186b383 admin admin] RBAC: Authorization granted {{(pid=82026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 20:08:06.754011 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.notifications [None req-67d366cc-7be0-4059-8dba-1a75f186b383 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'febc77d76fc945bcbd785c73ffc965cf', 'request_id': 'req-67d366cc-7be0-4059-8dba-1a75f186b383'} {{(pid=82026) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 20:08:06.826867 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.notifications [None req-67d366cc-7be0-4059-8dba-1a75f186b383 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'febc77d76fc945bcbd785c73ffc965cf', 'request_id': 'req-67d366cc-7be0-4059-8dba-1a75f186b383'} {{(pid=82026) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 20:08:06.833570 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.notifications [None req-67d366cc-7be0-4059-8dba-1a75f186b383 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'febc77d76fc945bcbd785c73ffc965cf', 'request_id': 'req-67d366cc-7be0-4059-8dba-1a75f186b383'} {{(pid=82026) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 20:08:06.846241 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.notifications [None req-67d366cc-7be0-4059-8dba-1a75f186b383 admin admin] The token cache is being invalidate because project febc77d76fc945bcbd785c73ffc965cf was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82026) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 13 20:08:06.846641 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.notifications [None req-67d366cc-7be0-4059-8dba-1a75f186b383 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82026) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 20:08:06.847375 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.notifications [None req-67d366cc-7be0-4059-8dba-1a75f186b383 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82026) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 20:08:06.848875 dv-cinder-828806-6-smb devstack@keystone.service[82026]: [pid: 82026|app: 0|req: 1348/2756] 10.222.0.33 () {58 vars in 1233 bytes} [Tue Sep 13 20:08:06 2022] DELETE /identity/v3/projects/febc77d76fc945bcbd785c73ffc965cf => generated 0 bytes in 220 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 20:08:06.854248 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afd4c634-aa24-4ee6-b5db-4c58c8406d0f None None] REQUEST_METHOD: `POST` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:08:06.854756 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afd4c634-aa24-4ee6-b5db-4c58c8406d0f None None] SCRIPT_NAME: `/identity` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:08:06.854878 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afd4c634-aa24-4ee6-b5db-4c58c8406d0f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:08:06.877524 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.auth.core [None req-afd4c634-aa24-4ee6-b5db-4c58c8406d0f None None] MFA Rules not processed for user `57539b6a6f3b4d589f5f5e1d211cd6a0`. Rule list: `[]` (Enabled: `True`). {{(pid=82025) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 20:08:06.879026 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.fernet_utils [None req-afd4c634-aa24-4ee6-b5db-4c58c8406d0f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82025) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 20:08:06.944684 dv-cinder-828806-6-smb devstack@keystone.service[82025]: [pid: 82025|app: 0|req: 1409/2757] 10.222.0.33 () {58 vars in 958 bytes} [Tue Sep 13 20:08:06 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 20:08:06.958908 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5385d57-ab23-47d0-9357-dcd5bd64a746 None None] REQUEST_METHOD: `POST` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:08:06.959423 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5385d57-ab23-47d0-9357-dcd5bd64a746 None None] SCRIPT_NAME: `/identity` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:08:06.959543 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5385d57-ab23-47d0-9357-dcd5bd64a746 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:08:06.980353 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.auth.core [None req-b5385d57-ab23-47d0-9357-dcd5bd64a746 None None] MFA Rules not processed for user `57539b6a6f3b4d589f5f5e1d211cd6a0`. Rule list: `[]` (Enabled: `True`). {{(pid=82026) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 20:08:06.981571 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.common.fernet_utils [None req-b5385d57-ab23-47d0-9357-dcd5bd64a746 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82026) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 20:08:06.990833 dv-cinder-828806-6-smb devstack@keystone.service[82026]: [pid: 82026|app: 0|req: 1349/2758] 10.222.0.33 () {58 vars in 958 bytes} [Tue Sep 13 20:08:06 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 20:08:07.000026 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afd4c634-aa24-4ee6-b5db-4c58c8406d0f None None] Authenticating user token {{(pid=82025) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 20:08:07.009837 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afd4c634-aa24-4ee6-b5db-4c58c8406d0f None None] Validating token access rules against request {{(pid=82025) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 20:08:07.015018 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50175f1f-b3e7-4301-a5b0-68e7bd4ac199 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57539b6a6f3b4d589f5f5e1d211cd6a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b454f707d20347ada3d82aa85495635e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82025) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 20:08:07.015627 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50175f1f-b3e7-4301-a5b0-68e7bd4ac199 admin admin] REQUEST_METHOD: `GET` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:08:07.015911 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50175f1f-b3e7-4301-a5b0-68e7bd4ac199 admin admin] SCRIPT_NAME: `/identity` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:08:07.016185 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50175f1f-b3e7-4301-a5b0-68e7bd4ac199 admin admin] PATH_INFO: `/v3/domains` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:08:07.016829 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50175f1f-b3e7-4301-a5b0-68e7bd4ac199 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82025) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 20:08:07.017137 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50175f1f-b3e7-4301-a5b0-68e7bd4ac199 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 20:08:07.018747 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50175f1f-b3e7-4301-a5b0-68e7bd4ac199 admin admin] RBAC: Authorization granted {{(pid=82025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 20:08:07.030179 dv-cinder-828806-6-smb devstack@keystone.service[82025]: [pid: 82025|app: 0|req: 1410/2759] 10.222.0.33 () {58 vars in 1153 bytes} [Tue Sep 13 20:08:06 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 20:08:07.035059 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5385d57-ab23-47d0-9357-dcd5bd64a746 None None] Authenticating user token {{(pid=82026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 20:08:07.044449 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5385d57-ab23-47d0-9357-dcd5bd64a746 None None] Validating token access rules against request {{(pid=82026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 20:08:07.049298 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1945d299-0898-4c3f-89e5-2807631fd419 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57539b6a6f3b4d589f5f5e1d211cd6a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b454f707d20347ada3d82aa85495635e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 20:08:07.049898 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1945d299-0898-4c3f-89e5-2807631fd419 admin admin] REQUEST_METHOD: `POST` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:08:07.050185 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1945d299-0898-4c3f-89e5-2807631fd419 admin admin] SCRIPT_NAME: `/identity` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:08:07.050466 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1945d299-0898-4c3f-89e5-2807631fd419 admin admin] PATH_INFO: `/v3/projects` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:08:07.051235 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1945d299-0898-4c3f-89e5-2807631fd419 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 20:08:07.053135 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1945d299-0898-4c3f-89e5-2807631fd419 admin admin] RBAC: Authorization granted {{(pid=82026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 20:08:07.064601 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG dbcounter [-] [82026] Writing DB stats keystone:INSERT=2,keystone:SELECT=91,keystone:DELETE=7 {{(pid=82026) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 20:08:07.217392 dv-cinder-828806-6-smb devstack@keystone.service[82026]: [pid: 82026|app: 0|req: 1350/2760] 10.222.0.33 () {60 vars in 1153 bytes} [Tue Sep 13 20:08:07 2022] POST /identity/v3/projects => generated 381 bytes in 183 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 13 20:08:07.222327 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50175f1f-b3e7-4301-a5b0-68e7bd4ac199 admin admin] Authenticating user token {{(pid=82025) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 20:08:07.232690 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50175f1f-b3e7-4301-a5b0-68e7bd4ac199 admin admin] Validating token access rules against request {{(pid=82025) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 20:08:07.290296 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f991326-45dd-4cd4-b7af-093e22fe6175 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57539b6a6f3b4d589f5f5e1d211cd6a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b454f707d20347ada3d82aa85495635e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82025) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 20:08:07.290926 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f991326-45dd-4cd4-b7af-093e22fe6175 admin admin] REQUEST_METHOD: `POST` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:08:07.291236 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f991326-45dd-4cd4-b7af-093e22fe6175 admin admin] SCRIPT_NAME: `/identity` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:08:07.291512 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f991326-45dd-4cd4-b7af-093e22fe6175 admin admin] PATH_INFO: `/v3/users` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:08:07.292153 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f991326-45dd-4cd4-b7af-093e22fe6175 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 20:08:07.294045 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f991326-45dd-4cd4-b7af-093e22fe6175 admin admin] RBAC: Authorization granted {{(pid=82025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 20:08:07.484693 dv-cinder-828806-6-smb devstack@keystone.service[82025]: [pid: 82025|app: 0|req: 1411/2761] 10.222.0.33 () {60 vars in 1144 bytes} [Tue Sep 13 20:08:07 2022] POST /identity/v3/users => generated 291 bytes in 263 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 13 20:08:07.488896 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1945d299-0898-4c3f-89e5-2807631fd419 admin admin] Authenticating user token {{(pid=82026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 20:08:07.499967 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1945d299-0898-4c3f-89e5-2807631fd419 admin admin] Validating token access rules against request {{(pid=82026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 20:08:07.504734 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7def30e-7bc1-4335-acfb-ac316446aaa8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57539b6a6f3b4d589f5f5e1d211cd6a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b454f707d20347ada3d82aa85495635e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 20:08:07.510607 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7def30e-7bc1-4335-acfb-ac316446aaa8 admin admin] REQUEST_METHOD: `GET` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:08:07.510607 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7def30e-7bc1-4335-acfb-ac316446aaa8 admin admin] SCRIPT_NAME: `/identity` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:08:07.510607 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7def30e-7bc1-4335-acfb-ac316446aaa8 admin admin] PATH_INFO: `/v3/roles` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:08:07.510607 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7def30e-7bc1-4335-acfb-ac316446aaa8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 20:08:07.510607 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7def30e-7bc1-4335-acfb-ac316446aaa8 admin admin] RBAC: Authorization granted {{(pid=82026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 20:08:07.519058 dv-cinder-828806-6-smb devstack@keystone.service[82026]: [pid: 82026|app: 0|req: 1351/2762] 10.222.0.33 () {58 vars in 1122 bytes} [Tue Sep 13 20:08:07 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 13 20:08:07.522976 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f991326-45dd-4cd4-b7af-093e22fe6175 admin admin] Authenticating user token {{(pid=82025) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 20:08:07.533205 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f991326-45dd-4cd4-b7af-093e22fe6175 admin admin] Validating token access rules against request {{(pid=82025) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 20:08:07.538133 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71ae66a9-413f-42b0-91af-5ec8f929c4b2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57539b6a6f3b4d589f5f5e1d211cd6a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b454f707d20347ada3d82aa85495635e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82025) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 20:08:07.538739 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71ae66a9-413f-42b0-91af-5ec8f929c4b2 admin admin] REQUEST_METHOD: `GET` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:08:07.539022 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71ae66a9-413f-42b0-91af-5ec8f929c4b2 admin admin] SCRIPT_NAME: `/identity` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:08:07.539318 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71ae66a9-413f-42b0-91af-5ec8f929c4b2 admin admin] PATH_INFO: `/v3/roles` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:08:07.539963 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71ae66a9-413f-42b0-91af-5ec8f929c4b2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 20:08:07.541566 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71ae66a9-413f-42b0-91af-5ec8f929c4b2 admin admin] RBAC: Authorization granted {{(pid=82025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 20:08:07.552108 dv-cinder-828806-6-smb devstack@keystone.service[82025]: [pid: 82025|app: 0|req: 1412/2763] 10.222.0.33 () {58 vars in 1122 bytes} [Tue Sep 13 20:08:07 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 13 20:08:07.556452 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7def30e-7bc1-4335-acfb-ac316446aaa8 admin admin] Authenticating user token {{(pid=82026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 20:08:07.567180 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7def30e-7bc1-4335-acfb-ac316446aaa8 admin admin] Validating token access rules against request {{(pid=82026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 20:08:07.571593 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f442bec-1792-41d7-b08f-4a68adc460ec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57539b6a6f3b4d589f5f5e1d211cd6a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b454f707d20347ada3d82aa85495635e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 20:08:07.572227 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f442bec-1792-41d7-b08f-4a68adc460ec admin admin] REQUEST_METHOD: `PUT` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:08:07.572504 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f442bec-1792-41d7-b08f-4a68adc460ec admin admin] SCRIPT_NAME: `/identity` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:08:07.572779 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f442bec-1792-41d7-b08f-4a68adc460ec admin admin] PATH_INFO: `/v3/projects/30ba66a0b70145dfaf9922eceff30288/users/f665d658f56e4d569ee87443946cc906/roles/3618ab638a65401f82333da7596d1daf` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:08:07.587505 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f442bec-1792-41d7-b08f-4a68adc460ec admin admin] RBAC: Authorizing `identity:create_grant(project_id=30ba66a0b70145dfaf9922eceff30288, user_id=f665d658f56e4d569ee87443946cc906, role_id=3618ab638a65401f82333da7596d1daf)` {{(pid=82026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 20:08:07.590122 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f442bec-1792-41d7-b08f-4a68adc460ec admin admin] RBAC: Authorization granted {{(pid=82026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 20:08:07.694752 dv-cinder-828806-6-smb devstack@keystone.service[82026]: [pid: 82026|app: 0|req: 1352/2764] 10.222.0.33 () {60 vars in 1483 bytes} [Tue Sep 13 20:08:07 2022] PUT /identity/v3/projects/30ba66a0b70145dfaf9922eceff30288/users/f665d658f56e4d569ee87443946cc906/roles/3618ab638a65401f82333da7596d1daf => generated 0 bytes in 139 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 20:08:07.699791 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-210e8f5d-20e3-41d9-9f01-5a2b35efccbf None None] REQUEST_METHOD: `POST` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:08:07.700078 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-210e8f5d-20e3-41d9-9f01-5a2b35efccbf None None] SCRIPT_NAME: `/identity` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:08:07.700355 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-210e8f5d-20e3-41d9-9f01-5a2b35efccbf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:08:07.719550 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.auth.core [None req-210e8f5d-20e3-41d9-9f01-5a2b35efccbf None None] MFA Rules not processed for user `57539b6a6f3b4d589f5f5e1d211cd6a0`. Rule list: `[]` (Enabled: `True`). {{(pid=82025) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 20:08:07.720744 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.fernet_utils [None req-210e8f5d-20e3-41d9-9f01-5a2b35efccbf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82025) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 20:08:07.750542 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG dbcounter [-] [82025] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=82025) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 20:08:07.779830 dv-cinder-828806-6-smb devstack@keystone.service[82025]: [pid: 82025|app: 0|req: 1413/2765] 10.222.0.33 () {58 vars in 958 bytes} [Tue Sep 13 20:08:07 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 20:08:07.789557 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f442bec-1792-41d7-b08f-4a68adc460ec admin admin] Authenticating user token {{(pid=82026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 20:08:07.791306 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.common.fernet_utils [None req-5f442bec-1792-41d7-b08f-4a68adc460ec admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82026) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 20:08:07.849485 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f442bec-1792-41d7-b08f-4a68adc460ec admin admin] Validating token access rules against request {{(pid=82026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 20:08:07.853119 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79d0797c-caa3-4fd7-b387-d082d47326b1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '023a2c79c2444611b3d431928e56685d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8c6fba0f15b4d6a84ff601919b7b8e4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 20:08:07.853724 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79d0797c-caa3-4fd7-b387-d082d47326b1 service neutron] REQUEST_METHOD: `GET` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:08:07.854005 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79d0797c-caa3-4fd7-b387-d082d47326b1 service neutron] SCRIPT_NAME: `/identity` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:08:07.854276 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79d0797c-caa3-4fd7-b387-d082d47326b1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:08:07.863813 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79d0797c-caa3-4fd7-b387-d082d47326b1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 20:08:07.865264 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79d0797c-caa3-4fd7-b387-d082d47326b1 service neutron] RBAC: Authorization granted {{(pid=82026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 20:08:07.874948 dv-cinder-828806-6-smb devstack@keystone.service[82026]: [pid: 82026|app: 0|req: 1353/2766] 10.222.0.33 () {60 vars in 1365 bytes} [Tue Sep 13 20:08:07 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 20:08:08.003076 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e9e6827-e0c0-46b4-881f-82e414a38bb7 None None] REQUEST_METHOD: `POST` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:08:08.003076 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e9e6827-e0c0-46b4-881f-82e414a38bb7 None None] SCRIPT_NAME: `/identity` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:08:08.003076 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e9e6827-e0c0-46b4-881f-82e414a38bb7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:08:08.019542 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.auth.core [None req-4e9e6827-e0c0-46b4-881f-82e414a38bb7 None None] MFA Rules not processed for user `e1782b80d3914e8395e3deb8352615d5`. Rule list: `[]` (Enabled: `True`). {{(pid=82025) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 20:08:08.020906 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.fernet_utils [None req-4e9e6827-e0c0-46b4-881f-82e414a38bb7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82025) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 20:08:08.078188 dv-cinder-828806-6-smb devstack@keystone.service[82025]: [pid: 82025|app: 0|req: 1414/2767] 10.222.0.33 () {58 vars in 958 bytes} [Tue Sep 13 20:08:07 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 20:08:09.491787 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2003689b-02ca-409d-b5b8-6e1f0e3512df None None] REQUEST_METHOD: `POST` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:08:09.492326 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2003689b-02ca-409d-b5b8-6e1f0e3512df None None] SCRIPT_NAME: `/identity` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:08:09.492622 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2003689b-02ca-409d-b5b8-6e1f0e3512df None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:08:09.523049 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.auth.core [None req-2003689b-02ca-409d-b5b8-6e1f0e3512df None None] MFA Rules not processed for user `f665d658f56e4d569ee87443946cc906`. Rule list: `[]` (Enabled: `True`). {{(pid=82026) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 20:08:09.524463 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.common.fernet_utils [None req-2003689b-02ca-409d-b5b8-6e1f0e3512df None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82026) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 20:08:09.596779 dv-cinder-828806-6-smb devstack@keystone.service[82026]: [pid: 82026|app: 0|req: 1354/2768] 10.222.0.33 () {58 vars in 958 bytes} [Tue Sep 13 20:08:09 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 20:08:09.607764 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e9e6827-e0c0-46b4-881f-82e414a38bb7 None None] Authenticating user token {{(pid=82025) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 20:08:09.609881 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.fernet_utils [None req-4e9e6827-e0c0-46b4-881f-82e414a38bb7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82025) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 20:08:09.667808 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e9e6827-e0c0-46b4-881f-82e414a38bb7 None None] Validating token access rules against request {{(pid=82025) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 20:08:09.672553 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e7354d0-a337-4cad-b5a3-d560ca628572 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46024fc6167f4321818b1bed27a521a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8c6fba0f15b4d6a84ff601919b7b8e4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82025) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 20:08:09.673307 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e7354d0-a337-4cad-b5a3-d560ca628572 service cinder] REQUEST_METHOD: `GET` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:08:09.673307 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e7354d0-a337-4cad-b5a3-d560ca628572 service cinder] SCRIPT_NAME: `/identity` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:08:09.673505 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e7354d0-a337-4cad-b5a3-d560ca628572 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:08:09.686328 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e7354d0-a337-4cad-b5a3-d560ca628572 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=82025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 20:08:09.692127 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e7354d0-a337-4cad-b5a3-d560ca628572 service cinder] RBAC: Authorization granted {{(pid=82025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 20:08:09.699900 dv-cinder-828806-6-smb devstack@keystone.service[82025]: [pid: 82025|app: 0|req: 1415/2769] 10.222.0.33 () {60 vars in 1365 bytes} [Tue Sep 13 20:08:09 2022] GET /identity/v3/auth/tokens => generated 3258 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 20:08:11.638575 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2359787-c495-4c4d-a8f0-5363ef33bfb4 None None] REQUEST_METHOD: `POST` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:08:11.639100 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2359787-c495-4c4d-a8f0-5363ef33bfb4 None None] SCRIPT_NAME: `/identity` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:08:11.639200 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2359787-c495-4c4d-a8f0-5363ef33bfb4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:08:11.659976 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.auth.core [None req-d2359787-c495-4c4d-a8f0-5363ef33bfb4 None None] MFA Rules not processed for user `f665d658f56e4d569ee87443946cc906`. Rule list: `[]` (Enabled: `True`). {{(pid=82026) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 20:08:11.661187 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.common.fernet_utils [None req-d2359787-c495-4c4d-a8f0-5363ef33bfb4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82026) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 20:08:11.668053 dv-cinder-828806-6-smb devstack@keystone.service[82026]: [pid: 82026|app: 0|req: 1355/2770] 10.222.0.33 () {58 vars in 958 bytes} [Tue Sep 13 20:08:11 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 20:08:19.695579 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG dbcounter [-] [82025] Writing DB stats keystone:SELECT=62 {{(pid=82025) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 20:08:21.653850 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG dbcounter [-] [82026] Writing DB stats keystone:SELECT=79,keystone:INSERT=2 {{(pid=82026) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 20:08:31.717609 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e7354d0-a337-4cad-b5a3-d560ca628572 service cinder] Authenticating user token {{(pid=82025) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 20:08:31.721755 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.fernet_utils [None req-6e7354d0-a337-4cad-b5a3-d560ca628572 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82025) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 20:08:31.948332 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e7354d0-a337-4cad-b5a3-d560ca628572 service cinder] Validating token access rules against request {{(pid=82025) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 20:08:31.954263 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec1f4fdc-20bd-47d9-a688-0ef17423bccd service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '060ea3dea2134429967c164bd158b272', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8c6fba0f15b4d6a84ff601919b7b8e4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82025) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 20:08:31.954909 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec1f4fdc-20bd-47d9-a688-0ef17423bccd service placement] REQUEST_METHOD: `GET` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:08:31.955238 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec1f4fdc-20bd-47d9-a688-0ef17423bccd service placement] SCRIPT_NAME: `/identity` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:08:31.955519 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec1f4fdc-20bd-47d9-a688-0ef17423bccd service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:08:31.957281 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.fernet_utils [None req-ec1f4fdc-20bd-47d9-a688-0ef17423bccd service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82025) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 20:08:31.970120 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec1f4fdc-20bd-47d9-a688-0ef17423bccd service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=82025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 20:08:31.971949 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec1f4fdc-20bd-47d9-a688-0ef17423bccd service placement] RBAC: Authorization granted {{(pid=82025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 20:08:31.991428 dv-cinder-828806-6-smb devstack@keystone.service[82025]: [pid: 82025|app: 0|req: 1416/2771] 10.222.0.33 () {60 vars in 1365 bytes} [Tue Sep 13 20:08:31 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 274 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 20:08:34.342764 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8be43af1-f570-4fbe-bcdd-fa5747558254 None None] REQUEST_METHOD: `GET` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:08:34.343395 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8be43af1-f570-4fbe-bcdd-fa5747558254 None None] SCRIPT_NAME: `/identity` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:08:34.346467 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8be43af1-f570-4fbe-bcdd-fa5747558254 None None] PATH_INFO: `/` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:08:34.348503 dv-cinder-828806-6-smb devstack@keystone.service[82026]: [pid: 82026|app: 0|req: 1356/2772] 10.222.0.33 () {54 vars in 921 bytes} [Tue Sep 13 20:08:34 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 20:08:34.356587 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf662964-bfbd-4c8b-9fc8-f3023baf51c9 None None] REQUEST_METHOD: `POST` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:08:34.357882 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf662964-bfbd-4c8b-9fc8-f3023baf51c9 None None] SCRIPT_NAME: `/identity` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:08:34.358148 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf662964-bfbd-4c8b-9fc8-f3023baf51c9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:08:34.458164 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.auth.core [None req-bf662964-bfbd-4c8b-9fc8-f3023baf51c9 None None] MFA Rules not processed for user `023a2c79c2444611b3d431928e56685d`. Rule list: `[]` (Enabled: `True`). {{(pid=82025) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 20:08:34.459433 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.fernet_utils [None req-bf662964-bfbd-4c8b-9fc8-f3023baf51c9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82025) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 20:08:34.479852 dv-cinder-828806-6-smb devstack@keystone.service[82025]: [pid: 82025|app: 0|req: 1417/2773] 10.222.0.33 () {58 vars in 1018 bytes} [Tue Sep 13 20:08:34 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 20:08:34.492212 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8be43af1-f570-4fbe-bcdd-fa5747558254 None None] Authenticating user token {{(pid=82026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 20:08:34.493990 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.common.fernet_utils [None req-8be43af1-f570-4fbe-bcdd-fa5747558254 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82026) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 20:08:34.509111 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8be43af1-f570-4fbe-bcdd-fa5747558254 None None] Validating token access rules against request {{(pid=82026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 20:08:34.518272 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-454a813d-012c-4503-86d6-5bea78fa6138 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '023a2c79c2444611b3d431928e56685d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8c6fba0f15b4d6a84ff601919b7b8e4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 20:08:34.518272 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-454a813d-012c-4503-86d6-5bea78fa6138 service neutron] REQUEST_METHOD: `GET` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:08:34.518272 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-454a813d-012c-4503-86d6-5bea78fa6138 service neutron] SCRIPT_NAME: `/identity` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:08:34.518272 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-454a813d-012c-4503-86d6-5bea78fa6138 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:08:34.522649 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-454a813d-012c-4503-86d6-5bea78fa6138 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 20:08:34.524144 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-454a813d-012c-4503-86d6-5bea78fa6138 service neutron] RBAC: Authorization granted {{(pid=82026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 20:08:34.532820 dv-cinder-828806-6-smb devstack@keystone.service[82026]: [pid: 82026|app: 0|req: 1357/2774] 10.222.0.33 () {60 vars in 1365 bytes} [Tue Sep 13 20:08:34 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 20:08:34.622697 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-accb648d-4892-4f77-a6f9-58a26fcee5d2 None None] REQUEST_METHOD: `GET` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:08:34.623052 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-accb648d-4892-4f77-a6f9-58a26fcee5d2 None None] SCRIPT_NAME: `/identity` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:08:34.623405 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-accb648d-4892-4f77-a6f9-58a26fcee5d2 None None] PATH_INFO: `/` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:08:34.624852 dv-cinder-828806-6-smb devstack@keystone.service[82025]: [pid: 82025|app: 0|req: 1418/2775] 10.222.0.33 () {54 vars in 921 bytes} [Tue Sep 13 20:08:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 20:08:34.630476 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d308e0f6-849a-4018-b792-3b5e84e6b502 None None] REQUEST_METHOD: `POST` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:08:34.630818 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d308e0f6-849a-4018-b792-3b5e84e6b502 None None] SCRIPT_NAME: `/identity` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:08:34.631134 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d308e0f6-849a-4018-b792-3b5e84e6b502 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:08:34.676279 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.auth.core [None req-d308e0f6-849a-4018-b792-3b5e84e6b502 None None] MFA Rules not processed for user `e66e7034abed4e0bad1f4137520c1e70`. Rule list: `[]` (Enabled: `True`). {{(pid=82026) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 20:08:34.677519 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.common.fernet_utils [None req-d308e0f6-849a-4018-b792-3b5e84e6b502 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82026) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 20:08:34.809243 dv-cinder-828806-6-smb devstack@keystone.service[82026]: [pid: 82026|app: 0|req: 1358/2776] 10.222.0.33 () {58 vars in 1018 bytes} [Tue Sep 13 20:08:34 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 180 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 20:08:34.820764 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-accb648d-4892-4f77-a6f9-58a26fcee5d2 None None] Authenticating user token {{(pid=82025) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 20:08:34.832104 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-accb648d-4892-4f77-a6f9-58a26fcee5d2 None None] Validating token access rules against request {{(pid=82025) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 20:08:34.836141 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c61da222-18f9-4e39-ae18-82e23ff78ef3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '023a2c79c2444611b3d431928e56685d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8c6fba0f15b4d6a84ff601919b7b8e4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82025) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 20:08:34.839817 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c61da222-18f9-4e39-ae18-82e23ff78ef3 service neutron] REQUEST_METHOD: `GET` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:08:34.839817 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c61da222-18f9-4e39-ae18-82e23ff78ef3 service neutron] SCRIPT_NAME: `/identity` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:08:34.839817 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c61da222-18f9-4e39-ae18-82e23ff78ef3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:08:34.848475 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c61da222-18f9-4e39-ae18-82e23ff78ef3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 20:08:34.849961 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c61da222-18f9-4e39-ae18-82e23ff78ef3 service neutron] RBAC: Authorization granted {{(pid=82025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 20:08:34.863208 dv-cinder-828806-6-smb devstack@keystone.service[82025]: [pid: 82025|app: 0|req: 1419/2777] 10.222.0.33 () {60 vars in 1365 bytes} [Tue Sep 13 20:08:34 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 20:08:36.291872 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-343183cd-8afb-4bbe-baa7-bc8123728d17 None None] REQUEST_METHOD: `POST` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:08:36.292312 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-343183cd-8afb-4bbe-baa7-bc8123728d17 None None] SCRIPT_NAME: `/identity` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:08:36.292441 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-343183cd-8afb-4bbe-baa7-bc8123728d17 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:08:36.314597 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.auth.core [None req-343183cd-8afb-4bbe-baa7-bc8123728d17 None None] MFA Rules not processed for user `a28e738b894442e2bc9880eeb64fc0c8`. Rule list: `[]` (Enabled: `True`). {{(pid=82026) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 20:08:36.316008 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.common.fernet_utils [None req-343183cd-8afb-4bbe-baa7-bc8123728d17 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82026) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 20:08:36.393418 dv-cinder-828806-6-smb devstack@keystone.service[82026]: [pid: 82026|app: 0|req: 1359/2778] 10.222.0.33 () {58 vars in 1009 bytes} [Tue Sep 13 20:08:36 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 20:08:36.559159 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c61da222-18f9-4e39-ae18-82e23ff78ef3 service neutron] Authenticating user token {{(pid=82025) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 20:08:36.568328 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.fernet_utils [None req-c61da222-18f9-4e39-ae18-82e23ff78ef3 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82025) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 20:08:36.600945 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG dbcounter [-] [82025] Writing DB stats keystone:SELECT=100 {{(pid=82025) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 20:08:36.663224 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c61da222-18f9-4e39-ae18-82e23ff78ef3 service neutron] Validating token access rules against request {{(pid=82025) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 20:08:36.672042 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6879dc2a-fb56-4655-82af-fd4e7545081c service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa5a83574f7f424c805e130c462d5969', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8c6fba0f15b4d6a84ff601919b7b8e4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82025) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 20:08:36.673917 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6879dc2a-fb56-4655-82af-fd4e7545081c service swift] REQUEST_METHOD: `GET` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:08:36.674575 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6879dc2a-fb56-4655-82af-fd4e7545081c service swift] SCRIPT_NAME: `/identity` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:08:36.675289 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6879dc2a-fb56-4655-82af-fd4e7545081c service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:08:36.693419 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6879dc2a-fb56-4655-82af-fd4e7545081c service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=82025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 20:08:36.695606 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6879dc2a-fb56-4655-82af-fd4e7545081c service swift] RBAC: Authorization granted {{(pid=82025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 20:08:36.710302 dv-cinder-828806-6-smb devstack@keystone.service[82025]: [pid: 82025|app: 0|req: 1420/2779] 10.222.0.33 () {60 vars in 1384 bytes} [Tue Sep 13 20:08:36 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 152 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Sep 13 20:08:37.767410 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d7d5581-46ad-486c-96d0-6359ae073cc7 None None] REQUEST_METHOD: `POST` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:08:37.768010 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d7d5581-46ad-486c-96d0-6359ae073cc7 None None] SCRIPT_NAME: `/identity` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:08:37.772910 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d7d5581-46ad-486c-96d0-6359ae073cc7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:08:37.799515 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.auth.core [None req-7d7d5581-46ad-486c-96d0-6359ae073cc7 None None] MFA Rules not processed for user `2f6d7f8d9db24b6fbe6b3e7663b20274`. Rule list: `[]` (Enabled: `True`). {{(pid=82026) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 20:08:37.801429 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.common.fernet_utils [None req-7d7d5581-46ad-486c-96d0-6359ae073cc7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82026) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 20:08:37.866852 dv-cinder-828806-6-smb devstack@keystone.service[82026]: [pid: 82026|app: 0|req: 1360/2780] 10.222.0.33 () {58 vars in 958 bytes} [Tue Sep 13 20:08:37 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 20:08:46.702452 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG dbcounter [-] [82025] Writing DB stats keystone:SELECT=21 {{(pid=82025) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 20:08:47.859449 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG dbcounter [-] [82026] Writing DB stats keystone:SELECT=99 {{(pid=82026) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 20:08:52.705490 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfbbac68-2fef-4f72-a190-b1f7ffcd5f47 None None] REQUEST_METHOD: `POST` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:08:52.706095 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfbbac68-2fef-4f72-a190-b1f7ffcd5f47 None None] SCRIPT_NAME: `/identity` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:08:52.706095 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfbbac68-2fef-4f72-a190-b1f7ffcd5f47 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:08:52.772786 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.auth.core [None req-dfbbac68-2fef-4f72-a190-b1f7ffcd5f47 None None] MFA Rules not processed for user `57539b6a6f3b4d589f5f5e1d211cd6a0`. Rule list: `[]` (Enabled: `True`). {{(pid=82025) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 20:08:52.774034 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.fernet_utils [None req-dfbbac68-2fef-4f72-a190-b1f7ffcd5f47 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82025) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 20:08:52.806130 dv-cinder-828806-6-smb devstack@keystone.service[82025]: [pid: 82025|app: 0|req: 1421/2781] 10.222.0.16 () {58 vars in 1016 bytes} [Tue Sep 13 20:08:52 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 20:08:52.828678 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d7d5581-46ad-486c-96d0-6359ae073cc7 None None] Authenticating user token {{(pid=82026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 20:08:52.830339 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.common.fernet_utils [None req-7d7d5581-46ad-486c-96d0-6359ae073cc7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82026) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 20:08:52.847632 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d7d5581-46ad-486c-96d0-6359ae073cc7 None None] Validating token access rules against request {{(pid=82026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 20:08:52.853259 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acd07291-4da4-484d-845d-2b6370fe9aa5 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e66e7034abed4e0bad1f4137520c1e70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8c6fba0f15b4d6a84ff601919b7b8e4', 'project_domain_id': 'default', 'roles': ['service', 'member', 'reader', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 20:08:52.853887 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acd07291-4da4-484d-845d-2b6370fe9aa5 service nova] REQUEST_METHOD: `GET` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:08:52.854171 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acd07291-4da4-484d-845d-2b6370fe9aa5 service nova] SCRIPT_NAME: `/identity` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:08:52.854448 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acd07291-4da4-484d-845d-2b6370fe9aa5 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:08:52.865559 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acd07291-4da4-484d-845d-2b6370fe9aa5 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 20:08:52.867422 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acd07291-4da4-484d-845d-2b6370fe9aa5 service nova] RBAC: Authorization granted {{(pid=82026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 20:08:52.882526 dv-cinder-828806-6-smb devstack@keystone.service[82026]: [pid: 82026|app: 0|req: 1361/2782] 10.222.0.33 () {60 vars in 1365 bytes} [Tue Sep 13 20:08:52 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 55 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 20:08:57.224128 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29338f15-2ea3-426c-b178-7b99a149d51c None None] REQUEST_METHOD: `POST` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:08:57.224623 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29338f15-2ea3-426c-b178-7b99a149d51c None None] SCRIPT_NAME: `/identity` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:08:57.224733 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29338f15-2ea3-426c-b178-7b99a149d51c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:08:57.243956 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.auth.core [None req-29338f15-2ea3-426c-b178-7b99a149d51c None None] MFA Rules not processed for user `a28e738b894442e2bc9880eeb64fc0c8`. Rule list: `[]` (Enabled: `True`). {{(pid=82025) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 20:08:57.245148 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.fernet_utils [None req-29338f15-2ea3-426c-b178-7b99a149d51c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82025) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 20:08:57.254325 dv-cinder-828806-6-smb devstack@keystone.service[82025]: [pid: 82025|app: 0|req: 1422/2783] 10.222.0.33 () {58 vars in 967 bytes} [Tue Sep 13 20:08:57 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 20:08:57.266750 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acd07291-4da4-484d-845d-2b6370fe9aa5 service nova] Authenticating user token {{(pid=82026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 20:08:57.277816 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acd07291-4da4-484d-845d-2b6370fe9aa5 service nova] Validating token access rules against request {{(pid=82026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 20:08:57.282772 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5083879-28f8-4371-a2fe-dbf949dfaa8a service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa5a83574f7f424c805e130c462d5969', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8c6fba0f15b4d6a84ff601919b7b8e4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 20:08:57.283421 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5083879-28f8-4371-a2fe-dbf949dfaa8a service swift] REQUEST_METHOD: `GET` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:08:57.283706 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5083879-28f8-4371-a2fe-dbf949dfaa8a service swift] SCRIPT_NAME: `/identity` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:08:57.283983 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5083879-28f8-4371-a2fe-dbf949dfaa8a service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:08:57.292524 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5083879-28f8-4371-a2fe-dbf949dfaa8a service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=82026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 20:08:57.294115 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5083879-28f8-4371-a2fe-dbf949dfaa8a service swift] RBAC: Authorization granted {{(pid=82026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 20:08:57.303056 dv-cinder-828806-6-smb devstack@keystone.service[82026]: [pid: 82026|app: 0|req: 1362/2784] 10.222.0.33 () {60 vars in 1384 bytes} [Tue Sep 13 20:08:57 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Sep 13 20:09:00.482823 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29338f15-2ea3-426c-b178-7b99a149d51c None None] Authenticating user token {{(pid=82025) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 20:09:00.484347 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.fernet_utils [None req-29338f15-2ea3-426c-b178-7b99a149d51c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82025) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 20:09:00.499172 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29338f15-2ea3-426c-b178-7b99a149d51c None None] Validating token access rules against request {{(pid=82025) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 20:09:00.503884 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f01e6e29-74b5-4795-a413-f76fd9daf352 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57539b6a6f3b4d589f5f5e1d211cd6a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b454f707d20347ada3d82aa85495635e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82025) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 20:09:00.507250 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f01e6e29-74b5-4795-a413-f76fd9daf352 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:09:00.507407 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f01e6e29-74b5-4795-a413-f76fd9daf352 admin admin] SCRIPT_NAME: `/identity` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:09:00.507694 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f01e6e29-74b5-4795-a413-f76fd9daf352 admin admin] PATH_INFO: `/v3/users/e1782b80d3914e8395e3deb8352615d5` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:09:00.509005 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f01e6e29-74b5-4795-a413-f76fd9daf352 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e1782b80d3914e8395e3deb8352615d5)` {{(pid=82025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 20:09:00.510975 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f01e6e29-74b5-4795-a413-f76fd9daf352 admin admin] RBAC: Authorization granted {{(pid=82025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 20:09:00.746303 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.notifications [None req-f01e6e29-74b5-4795-a413-f76fd9daf352 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e1782b80d3914e8395e3deb8352615d5'} {{(pid=82025) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 20:09:00.818045 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.notifications [None req-f01e6e29-74b5-4795-a413-f76fd9daf352 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e1782b80d3914e8395e3deb8352615d5'} {{(pid=82025) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 20:09:00.818668 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.notifications [None req-f01e6e29-74b5-4795-a413-f76fd9daf352 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e1782b80d3914e8395e3deb8352615d5'} {{(pid=82025) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 20:09:00.831786 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.notifications [None req-f01e6e29-74b5-4795-a413-f76fd9daf352 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e1782b80d3914e8395e3deb8352615d5'} {{(pid=82025) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 20:09:00.838593 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.notifications [None req-f01e6e29-74b5-4795-a413-f76fd9daf352 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e1782b80d3914e8395e3deb8352615d5'} {{(pid=82025) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 20:09:00.844471 dv-cinder-828806-6-smb devstack@keystone.service[82025]: [pid: 82025|app: 0|req: 1423/2785] 10.222.0.33 () {58 vars in 1224 bytes} [Tue Sep 13 20:09:00 2022] DELETE /identity/v3/users/e1782b80d3914e8395e3deb8352615d5 => generated 0 bytes in 363 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 20:09:01.116626 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5083879-28f8-4371-a2fe-dbf949dfaa8a service swift] Authenticating user token {{(pid=82026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 20:09:01.128156 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5083879-28f8-4371-a2fe-dbf949dfaa8a service swift] Validating token access rules against request {{(pid=82026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 20:09:01.194050 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02f597ef-2b66-42ee-8474-1f8e02a184a4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57539b6a6f3b4d589f5f5e1d211cd6a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b454f707d20347ada3d82aa85495635e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 20:09:01.194676 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02f597ef-2b66-42ee-8474-1f8e02a184a4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:09:01.194959 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02f597ef-2b66-42ee-8474-1f8e02a184a4 admin admin] SCRIPT_NAME: `/identity` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:09:01.202106 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02f597ef-2b66-42ee-8474-1f8e02a184a4 admin admin] PATH_INFO: `/v3/projects/a2bd7bd69df145da84a59966024e11a8` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:09:01.202106 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02f597ef-2b66-42ee-8474-1f8e02a184a4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a2bd7bd69df145da84a59966024e11a8)` {{(pid=82026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 20:09:01.202106 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02f597ef-2b66-42ee-8474-1f8e02a184a4 admin admin] RBAC: Authorization granted {{(pid=82026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 20:09:01.349675 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.notifications [None req-02f597ef-2b66-42ee-8474-1f8e02a184a4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a2bd7bd69df145da84a59966024e11a8', 'request_id': 'req-02f597ef-2b66-42ee-8474-1f8e02a184a4'} {{(pid=82026) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 20:09:01.429433 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.notifications [None req-02f597ef-2b66-42ee-8474-1f8e02a184a4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a2bd7bd69df145da84a59966024e11a8', 'request_id': 'req-02f597ef-2b66-42ee-8474-1f8e02a184a4'} {{(pid=82026) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 20:09:01.436293 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.notifications [None req-02f597ef-2b66-42ee-8474-1f8e02a184a4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a2bd7bd69df145da84a59966024e11a8', 'request_id': 'req-02f597ef-2b66-42ee-8474-1f8e02a184a4'} {{(pid=82026) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 20:09:01.451765 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.notifications [None req-02f597ef-2b66-42ee-8474-1f8e02a184a4 admin admin] The token cache is being invalidate because project a2bd7bd69df145da84a59966024e11a8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82026) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 13 20:09:01.454340 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.notifications [None req-02f597ef-2b66-42ee-8474-1f8e02a184a4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82026) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 20:09:01.454340 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.notifications [None req-02f597ef-2b66-42ee-8474-1f8e02a184a4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82026) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 20:09:01.455347 dv-cinder-828806-6-smb devstack@keystone.service[82026]: [pid: 82026|app: 0|req: 1363/2786] 10.222.0.33 () {58 vars in 1233 bytes} [Tue Sep 13 20:09:01 2022] DELETE /identity/v3/projects/a2bd7bd69df145da84a59966024e11a8 => generated 0 bytes in 339 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 20:09:01.461355 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abe7e910-89be-416d-96fb-f3b7dde1bc9e None None] REQUEST_METHOD: `POST` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:09:01.461648 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abe7e910-89be-416d-96fb-f3b7dde1bc9e None None] SCRIPT_NAME: `/identity` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:09:01.461975 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abe7e910-89be-416d-96fb-f3b7dde1bc9e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:09:01.482255 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.auth.core [None req-abe7e910-89be-416d-96fb-f3b7dde1bc9e None None] MFA Rules not processed for user `57539b6a6f3b4d589f5f5e1d211cd6a0`. Rule list: `[]` (Enabled: `True`). {{(pid=82025) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 20:09:01.483506 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.fernet_utils [None req-abe7e910-89be-416d-96fb-f3b7dde1bc9e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82025) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 20:09:01.544231 dv-cinder-828806-6-smb devstack@keystone.service[82025]: [pid: 82025|app: 0|req: 1424/2787] 10.222.0.33 () {58 vars in 958 bytes} [Tue Sep 13 20:09:01 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 20:09:01.552403 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efdb1951-03cb-4088-b53e-0a2e18d5f0ce None None] REQUEST_METHOD: `POST` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:09:01.552695 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efdb1951-03cb-4088-b53e-0a2e18d5f0ce None None] SCRIPT_NAME: `/identity` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:09:01.553007 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efdb1951-03cb-4088-b53e-0a2e18d5f0ce None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:09:01.573668 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.auth.core [None req-efdb1951-03cb-4088-b53e-0a2e18d5f0ce None None] MFA Rules not processed for user `57539b6a6f3b4d589f5f5e1d211cd6a0`. Rule list: `[]` (Enabled: `True`). {{(pid=82026) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 20:09:01.574869 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.common.fernet_utils [None req-efdb1951-03cb-4088-b53e-0a2e18d5f0ce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82026) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 20:09:01.583425 dv-cinder-828806-6-smb devstack@keystone.service[82026]: [pid: 82026|app: 0|req: 1364/2788] 10.222.0.33 () {58 vars in 958 bytes} [Tue Sep 13 20:09:01 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 20:09:01.587857 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abe7e910-89be-416d-96fb-f3b7dde1bc9e None None] Authenticating user token {{(pid=82025) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 20:09:01.598960 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abe7e910-89be-416d-96fb-f3b7dde1bc9e None None] Validating token access rules against request {{(pid=82025) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 20:09:01.603872 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2a21a2f-ccbb-4e75-b37c-f5d24ab28a72 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57539b6a6f3b4d589f5f5e1d211cd6a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b454f707d20347ada3d82aa85495635e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82025) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 20:09:01.604489 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2a21a2f-ccbb-4e75-b37c-f5d24ab28a72 admin admin] REQUEST_METHOD: `GET` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:09:01.604777 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2a21a2f-ccbb-4e75-b37c-f5d24ab28a72 admin admin] SCRIPT_NAME: `/identity` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:09:01.605057 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2a21a2f-ccbb-4e75-b37c-f5d24ab28a72 admin admin] PATH_INFO: `/v3/domains` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:09:01.605712 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2a21a2f-ccbb-4e75-b37c-f5d24ab28a72 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82025) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 20:09:01.606026 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2a21a2f-ccbb-4e75-b37c-f5d24ab28a72 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 20:09:01.607868 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2a21a2f-ccbb-4e75-b37c-f5d24ab28a72 admin admin] RBAC: Authorization granted {{(pid=82025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 20:09:01.610428 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG dbcounter [-] [82025] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82025) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 20:09:01.620067 dv-cinder-828806-6-smb devstack@keystone.service[82025]: [pid: 82025|app: 0|req: 1425/2789] 10.222.0.33 () {58 vars in 1153 bytes} [Tue Sep 13 20:09:01 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 20:09:01.628511 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efdb1951-03cb-4088-b53e-0a2e18d5f0ce None None] Authenticating user token {{(pid=82026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 20:09:01.638197 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efdb1951-03cb-4088-b53e-0a2e18d5f0ce None None] Validating token access rules against request {{(pid=82026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 20:09:01.643742 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f3df754-383b-4b02-b1a5-ff9115e34f4a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57539b6a6f3b4d589f5f5e1d211cd6a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b454f707d20347ada3d82aa85495635e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 20:09:01.644371 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f3df754-383b-4b02-b1a5-ff9115e34f4a admin admin] REQUEST_METHOD: `POST` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:09:01.644629 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f3df754-383b-4b02-b1a5-ff9115e34f4a admin admin] SCRIPT_NAME: `/identity` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:09:01.644995 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f3df754-383b-4b02-b1a5-ff9115e34f4a admin admin] PATH_INFO: `/v3/projects` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:09:01.645556 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f3df754-383b-4b02-b1a5-ff9115e34f4a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 20:09:01.647498 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f3df754-383b-4b02-b1a5-ff9115e34f4a admin admin] RBAC: Authorization granted {{(pid=82026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 20:09:01.740992 dv-cinder-828806-6-smb devstack@keystone.service[82026]: [pid: 82026|app: 0|req: 1365/2790] 10.222.0.33 () {60 vars in 1153 bytes} [Tue Sep 13 20:09:01 2022] POST /identity/v3/projects => generated 373 bytes in 113 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 13 20:09:01.745488 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2a21a2f-ccbb-4e75-b37c-f5d24ab28a72 admin admin] Authenticating user token {{(pid=82025) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 20:09:01.756208 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2a21a2f-ccbb-4e75-b37c-f5d24ab28a72 admin admin] Validating token access rules against request {{(pid=82025) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 20:09:01.818542 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a83ebf38-6d68-432c-9ee4-ebbd97905937 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57539b6a6f3b4d589f5f5e1d211cd6a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b454f707d20347ada3d82aa85495635e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82025) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 20:09:01.823162 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a83ebf38-6d68-432c-9ee4-ebbd97905937 admin admin] REQUEST_METHOD: `POST` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:09:01.823162 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a83ebf38-6d68-432c-9ee4-ebbd97905937 admin admin] SCRIPT_NAME: `/identity` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:09:01.823162 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a83ebf38-6d68-432c-9ee4-ebbd97905937 admin admin] PATH_INFO: `/v3/users` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:09:01.823162 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a83ebf38-6d68-432c-9ee4-ebbd97905937 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 20:09:01.823162 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a83ebf38-6d68-432c-9ee4-ebbd97905937 admin admin] RBAC: Authorization granted {{(pid=82025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 20:09:01.955564 dv-cinder-828806-6-smb devstack@keystone.service[82025]: [pid: 82025|app: 0|req: 1426/2791] 10.222.0.33 () {60 vars in 1144 bytes} [Tue Sep 13 20:09:01 2022] POST /identity/v3/users => generated 287 bytes in 210 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 13 20:09:01.959583 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f3df754-383b-4b02-b1a5-ff9115e34f4a admin admin] Authenticating user token {{(pid=82026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 20:09:01.969971 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f3df754-383b-4b02-b1a5-ff9115e34f4a admin admin] Validating token access rules against request {{(pid=82026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 20:09:01.975021 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbbda9cc-2a60-4bc9-bbab-e3d2c8073a82 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57539b6a6f3b4d589f5f5e1d211cd6a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b454f707d20347ada3d82aa85495635e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 20:09:01.975799 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbbda9cc-2a60-4bc9-bbab-e3d2c8073a82 admin admin] REQUEST_METHOD: `GET` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:09:01.976123 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbbda9cc-2a60-4bc9-bbab-e3d2c8073a82 admin admin] SCRIPT_NAME: `/identity` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:09:01.976532 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbbda9cc-2a60-4bc9-bbab-e3d2c8073a82 admin admin] PATH_INFO: `/v3/roles` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:09:01.977289 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbbda9cc-2a60-4bc9-bbab-e3d2c8073a82 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 20:09:01.979004 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbbda9cc-2a60-4bc9-bbab-e3d2c8073a82 admin admin] RBAC: Authorization granted {{(pid=82026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 20:09:01.989659 dv-cinder-828806-6-smb devstack@keystone.service[82026]: [pid: 82026|app: 0|req: 1366/2792] 10.222.0.33 () {58 vars in 1122 bytes} [Tue Sep 13 20:09:01 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 13 20:09:01.996488 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a83ebf38-6d68-432c-9ee4-ebbd97905937 admin admin] Authenticating user token {{(pid=82025) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 20:09:02.007310 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a83ebf38-6d68-432c-9ee4-ebbd97905937 admin admin] Validating token access rules against request {{(pid=82025) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 20:09:02.012556 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71b5d132-5f3f-44d6-b1b1-84f4d491a5f1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57539b6a6f3b4d589f5f5e1d211cd6a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b454f707d20347ada3d82aa85495635e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82025) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 20:09:02.013207 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71b5d132-5f3f-44d6-b1b1-84f4d491a5f1 admin admin] REQUEST_METHOD: `GET` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:09:02.013669 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71b5d132-5f3f-44d6-b1b1-84f4d491a5f1 admin admin] SCRIPT_NAME: `/identity` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:09:02.014049 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71b5d132-5f3f-44d6-b1b1-84f4d491a5f1 admin admin] PATH_INFO: `/v3/roles` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:09:02.014715 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71b5d132-5f3f-44d6-b1b1-84f4d491a5f1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 20:09:02.016352 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71b5d132-5f3f-44d6-b1b1-84f4d491a5f1 admin admin] RBAC: Authorization granted {{(pid=82025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 20:09:02.027687 dv-cinder-828806-6-smb devstack@keystone.service[82025]: [pid: 82025|app: 0|req: 1427/2793] 10.222.0.33 () {58 vars in 1122 bytes} [Tue Sep 13 20:09:01 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 13 20:09:02.032087 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbbda9cc-2a60-4bc9-bbab-e3d2c8073a82 admin admin] Authenticating user token {{(pid=82026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 20:09:02.042088 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbbda9cc-2a60-4bc9-bbab-e3d2c8073a82 admin admin] Validating token access rules against request {{(pid=82026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 20:09:02.047373 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaac9dcb-898e-45fb-9a96-8e4dda8970d3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57539b6a6f3b4d589f5f5e1d211cd6a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b454f707d20347ada3d82aa85495635e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 20:09:02.051349 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaac9dcb-898e-45fb-9a96-8e4dda8970d3 admin admin] REQUEST_METHOD: `PUT` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:09:02.051349 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaac9dcb-898e-45fb-9a96-8e4dda8970d3 admin admin] SCRIPT_NAME: `/identity` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:09:02.051349 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaac9dcb-898e-45fb-9a96-8e4dda8970d3 admin admin] PATH_INFO: `/v3/projects/456b6700026d44d590757f0bd05361d6/users/179f580744544f93b214dbba2b1a9003/roles/3618ab638a65401f82333da7596d1daf` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:09:02.064249 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaac9dcb-898e-45fb-9a96-8e4dda8970d3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=456b6700026d44d590757f0bd05361d6, user_id=179f580744544f93b214dbba2b1a9003, role_id=3618ab638a65401f82333da7596d1daf)` {{(pid=82026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 20:09:02.066884 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaac9dcb-898e-45fb-9a96-8e4dda8970d3 admin admin] RBAC: Authorization granted {{(pid=82026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 20:09:02.140242 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG dbcounter [-] [82026] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=82026) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 20:09:02.145295 dv-cinder-828806-6-smb devstack@keystone.service[82026]: [pid: 82026|app: 0|req: 1367/2794] 10.222.0.33 () {60 vars in 1483 bytes} [Tue Sep 13 20:09:02 2022] PUT /identity/v3/projects/456b6700026d44d590757f0bd05361d6/users/179f580744544f93b214dbba2b1a9003/roles/3618ab638a65401f82333da7596d1daf => generated 0 bytes in 113 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 13 20:09:02.156762 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3379eb38-f05b-48f1-ab5f-39cc7f484cbc None None] REQUEST_METHOD: `POST` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:09:02.157239 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3379eb38-f05b-48f1-ab5f-39cc7f484cbc None None] SCRIPT_NAME: `/identity` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:09:02.157543 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3379eb38-f05b-48f1-ab5f-39cc7f484cbc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:09:02.190234 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.auth.core [None req-3379eb38-f05b-48f1-ab5f-39cc7f484cbc None None] MFA Rules not processed for user `179f580744544f93b214dbba2b1a9003`. Rule list: `[]` (Enabled: `True`). {{(pid=82025) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 20:09:02.191489 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.fernet_utils [None req-3379eb38-f05b-48f1-ab5f-39cc7f484cbc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82025) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 20:09:02.265285 dv-cinder-828806-6-smb devstack@keystone.service[82025]: [pid: 82025|app: 0|req: 1428/2795] 10.222.0.33 () {58 vars in 958 bytes} [Tue Sep 13 20:09:02 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 20:09:02.276011 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaac9dcb-898e-45fb-9a96-8e4dda8970d3 admin admin] Authenticating user token {{(pid=82026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 20:09:02.277761 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.common.fernet_utils [None req-aaac9dcb-898e-45fb-9a96-8e4dda8970d3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82026) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 20:09:02.356714 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaac9dcb-898e-45fb-9a96-8e4dda8970d3 admin admin] Validating token access rules against request {{(pid=82026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 20:09:02.361956 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1753bcfb-e590-462b-a672-940d9e3a8401 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46024fc6167f4321818b1bed27a521a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8c6fba0f15b4d6a84ff601919b7b8e4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 20:09:02.362626 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1753bcfb-e590-462b-a672-940d9e3a8401 service cinder] REQUEST_METHOD: `GET` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:09:02.362913 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1753bcfb-e590-462b-a672-940d9e3a8401 service cinder] SCRIPT_NAME: `/identity` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:09:02.363236 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1753bcfb-e590-462b-a672-940d9e3a8401 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:09:02.371550 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1753bcfb-e590-462b-a672-940d9e3a8401 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=82026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 20:09:02.373426 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1753bcfb-e590-462b-a672-940d9e3a8401 service cinder] RBAC: Authorization granted {{(pid=82026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 20:09:02.385014 dv-cinder-828806-6-smb devstack@keystone.service[82026]: [pid: 82026|app: 0|req: 1368/2796] 10.222.0.33 () {60 vars in 1365 bytes} [Tue Sep 13 20:09:02 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 109 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 20:09:03.071237 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b34d5f50-9c22-4e7f-a336-4db3b80a25d2 None None] REQUEST_METHOD: `POST` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:09:03.071790 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b34d5f50-9c22-4e7f-a336-4db3b80a25d2 None None] SCRIPT_NAME: `/identity` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:09:03.071892 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b34d5f50-9c22-4e7f-a336-4db3b80a25d2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:09:03.093666 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.auth.core [None req-b34d5f50-9c22-4e7f-a336-4db3b80a25d2 None None] MFA Rules not processed for user `57539b6a6f3b4d589f5f5e1d211cd6a0`. Rule list: `[]` (Enabled: `True`). {{(pid=82025) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 20:09:03.094924 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.fernet_utils [None req-b34d5f50-9c22-4e7f-a336-4db3b80a25d2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82025) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 20:09:03.175704 dv-cinder-828806-6-smb devstack@keystone.service[82025]: [pid: 82025|app: 0|req: 1429/2797] 10.222.0.16 () {58 vars in 1016 bytes} [Tue Sep 13 20:09:03 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 20:09:03.185872 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1753bcfb-e590-462b-a672-940d9e3a8401 service cinder] Authenticating user token {{(pid=82026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 20:09:03.187581 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.common.fernet_utils [None req-1753bcfb-e590-462b-a672-940d9e3a8401 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82026) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 20:09:03.269425 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1753bcfb-e590-462b-a672-940d9e3a8401 service cinder] Validating token access rules against request {{(pid=82026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 20:09:03.275471 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-339b3492-8942-4401-99cd-68b925329c1c service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e66e7034abed4e0bad1f4137520c1e70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8c6fba0f15b4d6a84ff601919b7b8e4', 'project_domain_id': 'default', 'roles': ['service', 'member', 'reader', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 20:09:03.278765 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-339b3492-8942-4401-99cd-68b925329c1c service nova] REQUEST_METHOD: `GET` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:09:03.278765 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-339b3492-8942-4401-99cd-68b925329c1c service nova] SCRIPT_NAME: `/identity` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:09:03.278765 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-339b3492-8942-4401-99cd-68b925329c1c service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:09:03.290692 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-339b3492-8942-4401-99cd-68b925329c1c service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 20:09:03.292479 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-339b3492-8942-4401-99cd-68b925329c1c service nova] RBAC: Authorization granted {{(pid=82026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 20:09:03.303316 dv-cinder-828806-6-smb devstack@keystone.service[82026]: [pid: 82026|app: 0|req: 1369/2798] 10.222.0.33 () {60 vars in 1365 bytes} [Tue Sep 13 20:09:03 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 118 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 20:09:07.754787 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7355f34d-02dd-4674-8532-d7b8033b8ae2 None None] REQUEST_METHOD: `POST` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:09:07.755241 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7355f34d-02dd-4674-8532-d7b8033b8ae2 None None] SCRIPT_NAME: `/identity` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:09:07.755399 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7355f34d-02dd-4674-8532-d7b8033b8ae2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:09:07.765678 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG dbcounter [-] [82025] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=82025) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 20:09:07.776464 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.auth.core [None req-7355f34d-02dd-4674-8532-d7b8033b8ae2 None None] MFA Rules not processed for user `57539b6a6f3b4d589f5f5e1d211cd6a0`. Rule list: `[]` (Enabled: `True`). {{(pid=82025) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 20:09:07.779602 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.fernet_utils [None req-7355f34d-02dd-4674-8532-d7b8033b8ae2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82025) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 20:09:07.786630 dv-cinder-828806-6-smb devstack@keystone.service[82025]: [pid: 82025|app: 0|req: 1430/2799] 10.222.0.16 () {58 vars in 1016 bytes} [Tue Sep 13 20:09:07 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 20:09:07.807966 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-339b3492-8942-4401-99cd-68b925329c1c service nova] Authenticating user token {{(pid=82026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 20:09:07.820232 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-339b3492-8942-4401-99cd-68b925329c1c service nova] Validating token access rules against request {{(pid=82026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 20:09:07.826478 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6093c82b-e18b-41ab-97c5-9e5f03739079 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e66e7034abed4e0bad1f4137520c1e70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8c6fba0f15b4d6a84ff601919b7b8e4', 'project_domain_id': 'default', 'roles': ['service', 'member', 'reader', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 20:09:07.827135 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6093c82b-e18b-41ab-97c5-9e5f03739079 service nova] REQUEST_METHOD: `GET` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:09:07.827399 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6093c82b-e18b-41ab-97c5-9e5f03739079 service nova] SCRIPT_NAME: `/identity` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:09:07.827682 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6093c82b-e18b-41ab-97c5-9e5f03739079 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:09:07.836319 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6093c82b-e18b-41ab-97c5-9e5f03739079 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 20:09:07.837902 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6093c82b-e18b-41ab-97c5-9e5f03739079 service nova] RBAC: Authorization granted {{(pid=82026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 20:09:07.848569 dv-cinder-828806-6-smb devstack@keystone.service[82026]: [pid: 82026|app: 0|req: 1370/2800] 10.222.0.33 () {60 vars in 1365 bytes} [Tue Sep 13 20:09:07 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 20:09:11.459051 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff974df4-afc0-481d-a0d9-ac5cf4a95285 None None] REQUEST_METHOD: `POST` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:09:11.459711 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff974df4-afc0-481d-a0d9-ac5cf4a95285 None None] SCRIPT_NAME: `/identity` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:09:11.459711 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff974df4-afc0-481d-a0d9-ac5cf4a95285 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:09:11.480568 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.auth.core [None req-ff974df4-afc0-481d-a0d9-ac5cf4a95285 None None] MFA Rules not processed for user `57539b6a6f3b4d589f5f5e1d211cd6a0`. Rule list: `[]` (Enabled: `True`). {{(pid=82025) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 20:09:11.482292 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.fernet_utils [None req-ff974df4-afc0-481d-a0d9-ac5cf4a95285 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82025) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 20:09:11.490251 dv-cinder-828806-6-smb devstack@keystone.service[82025]: [pid: 82025|app: 0|req: 1431/2801] 10.222.0.16 () {58 vars in 1016 bytes} [Tue Sep 13 20:09:11 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 20:09:11.513952 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6093c82b-e18b-41ab-97c5-9e5f03739079 service nova] Authenticating user token {{(pid=82026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 20:09:11.515361 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.common.fernet_utils [None req-6093c82b-e18b-41ab-97c5-9e5f03739079 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82026) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 20:09:11.530153 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6093c82b-e18b-41ab-97c5-9e5f03739079 service nova] Validating token access rules against request {{(pid=82026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 20:09:11.535573 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96ed3e9b-eb6d-42f9-a1e0-1bf75698b02f service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e66e7034abed4e0bad1f4137520c1e70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8c6fba0f15b4d6a84ff601919b7b8e4', 'project_domain_id': 'default', 'roles': ['service', 'member', 'reader', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 20:09:11.536161 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96ed3e9b-eb6d-42f9-a1e0-1bf75698b02f service nova] REQUEST_METHOD: `GET` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:09:11.536481 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96ed3e9b-eb6d-42f9-a1e0-1bf75698b02f service nova] SCRIPT_NAME: `/identity` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:09:11.536770 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96ed3e9b-eb6d-42f9-a1e0-1bf75698b02f service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:09:11.547011 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96ed3e9b-eb6d-42f9-a1e0-1bf75698b02f service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 20:09:11.548617 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96ed3e9b-eb6d-42f9-a1e0-1bf75698b02f service nova] RBAC: Authorization granted {{(pid=82026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 20:09:11.561165 dv-cinder-828806-6-smb devstack@keystone.service[82026]: [pid: 82026|app: 0|req: 1371/2802] 10.222.0.33 () {60 vars in 1365 bytes} [Tue Sep 13 20:09:11 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 48 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 13 20:09:13.903093 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff974df4-afc0-481d-a0d9-ac5cf4a95285 None None] Authenticating user token {{(pid=82025) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 20:09:13.913825 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff974df4-afc0-481d-a0d9-ac5cf4a95285 None None] Validating token access rules against request {{(pid=82025) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 20:09:13.918350 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ddf3c3c-c78b-4100-8f64-47ab78946604 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57539b6a6f3b4d589f5f5e1d211cd6a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b454f707d20347ada3d82aa85495635e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82025) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 20:09:13.919541 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ddf3c3c-c78b-4100-8f64-47ab78946604 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:09:13.919930 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ddf3c3c-c78b-4100-8f64-47ab78946604 admin admin] SCRIPT_NAME: `/identity` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:09:13.920191 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ddf3c3c-c78b-4100-8f64-47ab78946604 admin admin] PATH_INFO: `/v3/users/179f580744544f93b214dbba2b1a9003` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:09:13.921321 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ddf3c3c-c78b-4100-8f64-47ab78946604 admin admin] RBAC: Authorizing `identity:delete_user(user_id=179f580744544f93b214dbba2b1a9003)` {{(pid=82025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 20:09:13.923261 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ddf3c3c-c78b-4100-8f64-47ab78946604 admin admin] RBAC: Authorization granted {{(pid=82025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 20:09:14.207811 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.notifications [None req-1ddf3c3c-c78b-4100-8f64-47ab78946604 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '179f580744544f93b214dbba2b1a9003'} {{(pid=82025) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 20:09:14.365530 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.notifications [None req-1ddf3c3c-c78b-4100-8f64-47ab78946604 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '179f580744544f93b214dbba2b1a9003'} {{(pid=82025) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 20:09:14.366162 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.notifications [None req-1ddf3c3c-c78b-4100-8f64-47ab78946604 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '179f580744544f93b214dbba2b1a9003'} {{(pid=82025) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 20:09:14.379362 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.notifications [None req-1ddf3c3c-c78b-4100-8f64-47ab78946604 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '179f580744544f93b214dbba2b1a9003'} {{(pid=82025) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 20:09:14.386381 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.notifications [None req-1ddf3c3c-c78b-4100-8f64-47ab78946604 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '179f580744544f93b214dbba2b1a9003'} {{(pid=82025) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 20:09:14.392827 dv-cinder-828806-6-smb devstack@keystone.service[82025]: [pid: 82025|app: 0|req: 1432/2803] 10.222.0.33 () {58 vars in 1224 bytes} [Tue Sep 13 20:09:13 2022] DELETE /identity/v3/users/179f580744544f93b214dbba2b1a9003 => generated 0 bytes in 490 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 20:09:14.397496 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b275cf6-e9b4-42e9-ab5b-7e3123abcb5b None None] REQUEST_METHOD: `POST` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:09:14.398034 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b275cf6-e9b4-42e9-ab5b-7e3123abcb5b None None] SCRIPT_NAME: `/identity` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:09:14.398226 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b275cf6-e9b4-42e9-ab5b-7e3123abcb5b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:09:14.418060 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.auth.core [None req-0b275cf6-e9b4-42e9-ab5b-7e3123abcb5b None None] MFA Rules not processed for user `57539b6a6f3b4d589f5f5e1d211cd6a0`. Rule list: `[]` (Enabled: `True`). {{(pid=82026) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 20:09:14.420030 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.common.fernet_utils [None req-0b275cf6-e9b4-42e9-ab5b-7e3123abcb5b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82026) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 20:09:14.458243 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG dbcounter [-] [82026] Writing DB stats keystone:SELECT=100 {{(pid=82026) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 20:09:14.479246 dv-cinder-828806-6-smb devstack@keystone.service[82026]: [pid: 82026|app: 0|req: 1372/2804] 10.222.0.33 () {58 vars in 958 bytes} [Tue Sep 13 20:09:14 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 20:09:14.489234 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ddf3c3c-c78b-4100-8f64-47ab78946604 admin admin] Authenticating user token {{(pid=82025) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 20:09:14.490884 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.fernet_utils [None req-1ddf3c3c-c78b-4100-8f64-47ab78946604 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82025) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 20:09:14.555664 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ddf3c3c-c78b-4100-8f64-47ab78946604 admin admin] Validating token access rules against request {{(pid=82025) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 20:09:14.559539 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-842c32be-48af-45f7-b3c3-ec10b58c88db service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '023a2c79c2444611b3d431928e56685d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8c6fba0f15b4d6a84ff601919b7b8e4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82025) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 20:09:14.560187 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-842c32be-48af-45f7-b3c3-ec10b58c88db service neutron] REQUEST_METHOD: `GET` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:09:14.560468 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-842c32be-48af-45f7-b3c3-ec10b58c88db service neutron] SCRIPT_NAME: `/identity` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:09:14.560742 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-842c32be-48af-45f7-b3c3-ec10b58c88db service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:09:14.570000 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-842c32be-48af-45f7-b3c3-ec10b58c88db service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 20:09:14.571462 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-842c32be-48af-45f7-b3c3-ec10b58c88db service neutron] RBAC: Authorization granted {{(pid=82025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 20:09:14.581662 dv-cinder-828806-6-smb devstack@keystone.service[82025]: [pid: 82025|app: 0|req: 1433/2805] 10.222.0.33 () {60 vars in 1365 bytes} [Tue Sep 13 20:09:14 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 13 20:09:14.722243 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4399c83c-9d0e-4c66-bf1b-c45d752a9ef9 None None] REQUEST_METHOD: `POST` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:09:14.722473 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4399c83c-9d0e-4c66-bf1b-c45d752a9ef9 None None] SCRIPT_NAME: `/identity` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:09:14.722750 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4399c83c-9d0e-4c66-bf1b-c45d752a9ef9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:09:14.742152 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.auth.core [None req-4399c83c-9d0e-4c66-bf1b-c45d752a9ef9 None None] MFA Rules not processed for user `57539b6a6f3b4d589f5f5e1d211cd6a0`. Rule list: `[]` (Enabled: `True`). {{(pid=82026) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 20:09:14.743372 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.common.fernet_utils [None req-4399c83c-9d0e-4c66-bf1b-c45d752a9ef9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82026) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 20:09:14.751438 dv-cinder-828806-6-smb devstack@keystone.service[82026]: [pid: 82026|app: 0|req: 1373/2806] 10.222.0.16 () {58 vars in 1016 bytes} [Tue Sep 13 20:09:14 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 20:09:14.774069 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-842c32be-48af-45f7-b3c3-ec10b58c88db service neutron] Authenticating user token {{(pid=82025) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 20:09:14.775557 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.fernet_utils [None req-842c32be-48af-45f7-b3c3-ec10b58c88db service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82025) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 20:09:14.849994 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG dbcounter [-] [82025] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82025) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 20:09:14.855111 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-842c32be-48af-45f7-b3c3-ec10b58c88db service neutron] Validating token access rules against request {{(pid=82025) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 20:09:14.860803 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6026973e-3191-47b8-a533-ac07f0b16b2e service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e66e7034abed4e0bad1f4137520c1e70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8c6fba0f15b4d6a84ff601919b7b8e4', 'project_domain_id': 'default', 'roles': ['service', 'member', 'reader', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82025) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 20:09:14.861495 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6026973e-3191-47b8-a533-ac07f0b16b2e service nova] REQUEST_METHOD: `GET` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:09:14.861790 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6026973e-3191-47b8-a533-ac07f0b16b2e service nova] SCRIPT_NAME: `/identity` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:09:14.862070 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6026973e-3191-47b8-a533-ac07f0b16b2e service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:09:14.870659 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6026973e-3191-47b8-a533-ac07f0b16b2e service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 20:09:14.873010 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6026973e-3191-47b8-a533-ac07f0b16b2e service nova] RBAC: Authorization granted {{(pid=82025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 20:09:14.883503 dv-cinder-828806-6-smb devstack@keystone.service[82025]: [pid: 82025|app: 0|req: 1434/2807] 10.222.0.33 () {60 vars in 1365 bytes} [Tue Sep 13 20:09:14 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 110 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 20:09:15.055891 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4399c83c-9d0e-4c66-bf1b-c45d752a9ef9 None None] Authenticating user token {{(pid=82026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 20:09:15.055891 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.common.fernet_utils [None req-4399c83c-9d0e-4c66-bf1b-c45d752a9ef9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82026) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 20:09:15.069186 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4399c83c-9d0e-4c66-bf1b-c45d752a9ef9 None None] Validating token access rules against request {{(pid=82026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 20:09:15.075092 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-151dbf42-5fe1-4261-b2bc-c1bdc447face admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57539b6a6f3b4d589f5f5e1d211cd6a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b454f707d20347ada3d82aa85495635e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 20:09:15.076543 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-151dbf42-5fe1-4261-b2bc-c1bdc447face admin admin] REQUEST_METHOD: `DELETE` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:09:15.076826 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-151dbf42-5fe1-4261-b2bc-c1bdc447face admin admin] SCRIPT_NAME: `/identity` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:09:15.078919 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-151dbf42-5fe1-4261-b2bc-c1bdc447face admin admin] PATH_INFO: `/v3/projects/456b6700026d44d590757f0bd05361d6` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:09:15.078919 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-151dbf42-5fe1-4261-b2bc-c1bdc447face admin admin] RBAC: Authorizing `identity:delete_project(project_id=456b6700026d44d590757f0bd05361d6)` {{(pid=82026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 20:09:15.081570 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-151dbf42-5fe1-4261-b2bc-c1bdc447face admin admin] RBAC: Authorization granted {{(pid=82026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 20:09:15.202760 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.notifications [None req-151dbf42-5fe1-4261-b2bc-c1bdc447face admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '456b6700026d44d590757f0bd05361d6', 'request_id': 'req-151dbf42-5fe1-4261-b2bc-c1bdc447face'} {{(pid=82026) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 20:09:15.320365 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.notifications [None req-151dbf42-5fe1-4261-b2bc-c1bdc447face admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '456b6700026d44d590757f0bd05361d6', 'request_id': 'req-151dbf42-5fe1-4261-b2bc-c1bdc447face'} {{(pid=82026) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 20:09:15.326618 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.notifications [None req-151dbf42-5fe1-4261-b2bc-c1bdc447face admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '456b6700026d44d590757f0bd05361d6', 'request_id': 'req-151dbf42-5fe1-4261-b2bc-c1bdc447face'} {{(pid=82026) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 20:09:15.338201 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.notifications [None req-151dbf42-5fe1-4261-b2bc-c1bdc447face admin admin] The token cache is being invalidate because project 456b6700026d44d590757f0bd05361d6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82026) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 13 20:09:15.338498 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.notifications [None req-151dbf42-5fe1-4261-b2bc-c1bdc447face admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82026) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 20:09:15.339196 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.notifications [None req-151dbf42-5fe1-4261-b2bc-c1bdc447face admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82026) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 20:09:15.340687 dv-cinder-828806-6-smb devstack@keystone.service[82026]: [pid: 82026|app: 0|req: 1374/2808] 10.222.0.33 () {58 vars in 1233 bytes} [Tue Sep 13 20:09:15 2022] DELETE /identity/v3/projects/456b6700026d44d590757f0bd05361d6 => generated 0 bytes in 288 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 20:09:18.032775 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1829bb52-a62b-4cdf-ab3f-213194607bae None None] REQUEST_METHOD: `POST` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:09:18.033248 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1829bb52-a62b-4cdf-ab3f-213194607bae None None] SCRIPT_NAME: `/identity` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:09:18.033367 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1829bb52-a62b-4cdf-ab3f-213194607bae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:09:18.052994 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.auth.core [None req-1829bb52-a62b-4cdf-ab3f-213194607bae None None] MFA Rules not processed for user `57539b6a6f3b4d589f5f5e1d211cd6a0`. Rule list: `[]` (Enabled: `True`). {{(pid=82025) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 20:09:18.054204 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.fernet_utils [None req-1829bb52-a62b-4cdf-ab3f-213194607bae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82025) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 20:09:18.114501 dv-cinder-828806-6-smb devstack@keystone.service[82025]: [pid: 82025|app: 0|req: 1435/2809] 10.222.0.16 () {58 vars in 1016 bytes} [Tue Sep 13 20:09:18 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 20:09:18.155151 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-151dbf42-5fe1-4261-b2bc-c1bdc447face admin admin] Authenticating user token {{(pid=82026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 20:09:18.157300 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.common.fernet_utils [None req-151dbf42-5fe1-4261-b2bc-c1bdc447face admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82026) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 20:09:18.234776 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-151dbf42-5fe1-4261-b2bc-c1bdc447face admin admin] Validating token access rules against request {{(pid=82026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 20:09:18.242157 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8643200e-59ae-4dca-95eb-4d7168a8bce0 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e66e7034abed4e0bad1f4137520c1e70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8c6fba0f15b4d6a84ff601919b7b8e4', 'project_domain_id': 'default', 'roles': ['service', 'member', 'reader', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 20:09:18.242769 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8643200e-59ae-4dca-95eb-4d7168a8bce0 service nova] REQUEST_METHOD: `GET` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:09:18.243075 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8643200e-59ae-4dca-95eb-4d7168a8bce0 service nova] SCRIPT_NAME: `/identity` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:09:18.243359 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8643200e-59ae-4dca-95eb-4d7168a8bce0 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:09:18.253617 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8643200e-59ae-4dca-95eb-4d7168a8bce0 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 20:09:18.255250 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8643200e-59ae-4dca-95eb-4d7168a8bce0 service nova] RBAC: Authorization granted {{(pid=82026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 20:09:18.271668 dv-cinder-828806-6-smb devstack@keystone.service[82026]: [pid: 82026|app: 0|req: 1375/2810] 10.222.0.33 () {60 vars in 1365 bytes} [Tue Sep 13 20:09:18 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 117 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 20:09:28.106667 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG dbcounter [-] [82025] Writing DB stats keystone:SELECT=31 {{(pid=82025) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 20:09:28.263370 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG dbcounter [-] [82026] Writing DB stats keystone:SELECT=72,keystone:DELETE=7,keystone:INSERT=1 {{(pid=82026) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 20:09:35.346333 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-721426e9-9aab-4649-ae0e-a7ce5220b0b2 None None] REQUEST_METHOD: `POST` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:09:35.346861 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-721426e9-9aab-4649-ae0e-a7ce5220b0b2 None None] SCRIPT_NAME: `/identity` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:09:35.346861 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-721426e9-9aab-4649-ae0e-a7ce5220b0b2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:09:35.366983 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.auth.core [None req-721426e9-9aab-4649-ae0e-a7ce5220b0b2 None None] MFA Rules not processed for user `f665d658f56e4d569ee87443946cc906`. Rule list: `[]` (Enabled: `True`). {{(pid=82025) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 20:09:35.368353 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.fernet_utils [None req-721426e9-9aab-4649-ae0e-a7ce5220b0b2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82025) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 20:09:35.431053 dv-cinder-828806-6-smb devstack@keystone.service[82025]: [pid: 82025|app: 0|req: 1436/2811] 10.222.0.33 () {58 vars in 958 bytes} [Tue Sep 13 20:09:35 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 20:09:45.424439 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG dbcounter [-] [82025] Writing DB stats keystone:SELECT=25 {{(pid=82025) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 20:09:55.671754 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35f17b13-626e-4fde-b968-044b3159cf36 None None] REQUEST_METHOD: `POST` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:09:55.672365 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35f17b13-626e-4fde-b968-044b3159cf36 None None] SCRIPT_NAME: `/identity` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:09:55.672365 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35f17b13-626e-4fde-b968-044b3159cf36 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:09:55.693191 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.auth.core [None req-35f17b13-626e-4fde-b968-044b3159cf36 None None] MFA Rules not processed for user `57539b6a6f3b4d589f5f5e1d211cd6a0`. Rule list: `[]` (Enabled: `True`). {{(pid=82026) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 20:09:55.694773 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.common.fernet_utils [None req-35f17b13-626e-4fde-b968-044b3159cf36 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82026) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 20:09:55.702265 dv-cinder-828806-6-smb devstack@keystone.service[82026]: [pid: 82026|app: 0|req: 1376/2812] 10.222.0.16 () {58 vars in 1016 bytes} [Tue Sep 13 20:09:55 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 20:09:55.738297 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-721426e9-9aab-4649-ae0e-a7ce5220b0b2 None None] Authenticating user token {{(pid=82025) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 20:09:55.739821 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.fernet_utils [None req-721426e9-9aab-4649-ae0e-a7ce5220b0b2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82025) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 20:09:55.756239 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-721426e9-9aab-4649-ae0e-a7ce5220b0b2 None None] Validating token access rules against request {{(pid=82025) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 20:09:55.761817 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc9cb159-9b1a-46a3-a932-95c110dded8a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e66e7034abed4e0bad1f4137520c1e70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8c6fba0f15b4d6a84ff601919b7b8e4', 'project_domain_id': 'default', 'roles': ['service', 'member', 'reader', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82025) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 20:09:55.762430 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc9cb159-9b1a-46a3-a932-95c110dded8a service nova] REQUEST_METHOD: `GET` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:09:55.762717 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc9cb159-9b1a-46a3-a932-95c110dded8a service nova] SCRIPT_NAME: `/identity` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:09:55.763059 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc9cb159-9b1a-46a3-a932-95c110dded8a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:09:55.771973 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc9cb159-9b1a-46a3-a932-95c110dded8a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 20:09:55.773553 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc9cb159-9b1a-46a3-a932-95c110dded8a service nova] RBAC: Authorization granted {{(pid=82025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 20:09:55.786504 dv-cinder-828806-6-smb devstack@keystone.service[82025]: [pid: 82025|app: 0|req: 1437/2813] 10.222.0.33 () {60 vars in 1365 bytes} [Tue Sep 13 20:09:55 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 49 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 13 20:10:00.009758 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35f17b13-626e-4fde-b968-044b3159cf36 None None] Authenticating user token {{(pid=82026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 20:10:00.017143 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.common.fernet_utils [None req-35f17b13-626e-4fde-b968-044b3159cf36 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82026) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 20:10:00.069886 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35f17b13-626e-4fde-b968-044b3159cf36 None None] Validating token access rules against request {{(pid=82026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 20:10:00.073513 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec388854-c768-47f3-a270-c63ffd463749 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46024fc6167f4321818b1bed27a521a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8c6fba0f15b4d6a84ff601919b7b8e4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 20:10:00.074103 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec388854-c768-47f3-a270-c63ffd463749 service cinder] REQUEST_METHOD: `GET` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:10:00.074382 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec388854-c768-47f3-a270-c63ffd463749 service cinder] SCRIPT_NAME: `/identity` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:10:00.074655 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec388854-c768-47f3-a270-c63ffd463749 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:10:00.076409 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.common.fernet_utils [None req-ec388854-c768-47f3-a270-c63ffd463749 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82026) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 20:10:00.134651 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec388854-c768-47f3-a270-c63ffd463749 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=82026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 20:10:00.136124 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec388854-c768-47f3-a270-c63ffd463749 service cinder] RBAC: Authorization granted {{(pid=82026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 20:10:00.145773 dv-cinder-828806-6-smb devstack@keystone.service[82026]: [pid: 82026|app: 0|req: 1377/2814] 10.222.0.33 () {60 vars in 1365 bytes} [Tue Sep 13 20:10:00 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 136 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 20:10:00.245966 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc9cb159-9b1a-46a3-a932-95c110dded8a service nova] Authenticating user token {{(pid=82025) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 20:10:00.247430 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.fernet_utils [None req-cc9cb159-9b1a-46a3-a932-95c110dded8a service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82025) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 20:10:00.306506 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc9cb159-9b1a-46a3-a932-95c110dded8a service nova] Validating token access rules against request {{(pid=82025) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 20:10:00.310421 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54ea05ca-3e12-43e3-92ee-cc59c3ba6776 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '023a2c79c2444611b3d431928e56685d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8c6fba0f15b4d6a84ff601919b7b8e4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82025) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 20:10:00.311049 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54ea05ca-3e12-43e3-92ee-cc59c3ba6776 service neutron] REQUEST_METHOD: `GET` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:10:00.311350 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54ea05ca-3e12-43e3-92ee-cc59c3ba6776 service neutron] SCRIPT_NAME: `/identity` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:10:00.311626 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54ea05ca-3e12-43e3-92ee-cc59c3ba6776 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:10:00.313442 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.fernet_utils [None req-54ea05ca-3e12-43e3-92ee-cc59c3ba6776 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82025) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 20:10:00.324634 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d75830ae-4840-44d0-a988-8738aa92cd84 None None] REQUEST_METHOD: `POST` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:10:00.325001 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d75830ae-4840-44d0-a988-8738aa92cd84 None None] SCRIPT_NAME: `/identity` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:10:00.325372 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d75830ae-4840-44d0-a988-8738aa92cd84 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:10:00.325986 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54ea05ca-3e12-43e3-92ee-cc59c3ba6776 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 20:10:00.327548 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54ea05ca-3e12-43e3-92ee-cc59c3ba6776 service neutron] RBAC: Authorization granted {{(pid=82025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 20:10:00.338238 dv-cinder-828806-6-smb devstack@keystone.service[82025]: [pid: 82025|app: 0|req: 1438/2815] 10.222.0.33 () {60 vars in 1365 bytes} [Tue Sep 13 20:10:00 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 20:10:00.346275 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.auth.core [None req-d75830ae-4840-44d0-a988-8738aa92cd84 None None] MFA Rules not processed for user `57539b6a6f3b4d589f5f5e1d211cd6a0`. Rule list: `[]` (Enabled: `True`). {{(pid=82026) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 20:10:00.351634 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.common.fernet_utils [None req-d75830ae-4840-44d0-a988-8738aa92cd84 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82026) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 20:10:00.355964 dv-cinder-828806-6-smb devstack@keystone.service[82026]: [pid: 82026|app: 0|req: 1378/2816] 10.222.0.16 () {58 vars in 1016 bytes} [Tue Sep 13 20:10:00 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 13 20:10:00.374798 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54ea05ca-3e12-43e3-92ee-cc59c3ba6776 service neutron] Authenticating user token {{(pid=82025) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 20:10:00.387374 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54ea05ca-3e12-43e3-92ee-cc59c3ba6776 service neutron] Validating token access rules against request {{(pid=82025) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 20:10:00.392872 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61958467-c565-4e36-b195-116bffa7322c service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e66e7034abed4e0bad1f4137520c1e70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8c6fba0f15b4d6a84ff601919b7b8e4', 'project_domain_id': 'default', 'roles': ['service', 'member', 'reader', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82025) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 20:10:00.394085 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61958467-c565-4e36-b195-116bffa7322c service nova] REQUEST_METHOD: `GET` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:10:00.394365 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61958467-c565-4e36-b195-116bffa7322c service nova] SCRIPT_NAME: `/identity` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:10:00.394638 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61958467-c565-4e36-b195-116bffa7322c service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:10:00.403203 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61958467-c565-4e36-b195-116bffa7322c service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 20:10:00.413923 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61958467-c565-4e36-b195-116bffa7322c service nova] RBAC: Authorization granted {{(pid=82025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 20:10:00.414809 dv-cinder-828806-6-smb devstack@keystone.service[82025]: [pid: 82025|app: 0|req: 1439/2817] 10.222.0.33 () {60 vars in 1365 bytes} [Tue Sep 13 20:10:00 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 20:10:03.078170 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dff8f5c-3bc9-4f86-91fb-e30eaafc97ea None None] REQUEST_METHOD: `POST` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:10:03.078659 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dff8f5c-3bc9-4f86-91fb-e30eaafc97ea None None] SCRIPT_NAME: `/identity` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:10:03.078777 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dff8f5c-3bc9-4f86-91fb-e30eaafc97ea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:10:03.102342 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.auth.core [None req-8dff8f5c-3bc9-4f86-91fb-e30eaafc97ea None None] MFA Rules not processed for user `57539b6a6f3b4d589f5f5e1d211cd6a0`. Rule list: `[]` (Enabled: `True`). {{(pid=82026) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 20:10:03.102342 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.common.fernet_utils [None req-8dff8f5c-3bc9-4f86-91fb-e30eaafc97ea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82026) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 20:10:03.109304 dv-cinder-828806-6-smb devstack@keystone.service[82026]: [pid: 82026|app: 0|req: 1379/2818] 10.222.0.16 () {58 vars in 1016 bytes} [Tue Sep 13 20:10:03 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 20:10:03.147850 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61958467-c565-4e36-b195-116bffa7322c service nova] Authenticating user token {{(pid=82025) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 20:10:03.154786 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61958467-c565-4e36-b195-116bffa7322c service nova] Validating token access rules against request {{(pid=82025) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 20:10:03.161128 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-526f59c7-c7d6-4b78-a0b4-6d46e9ee18d5 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e66e7034abed4e0bad1f4137520c1e70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8c6fba0f15b4d6a84ff601919b7b8e4', 'project_domain_id': 'default', 'roles': ['service', 'member', 'reader', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82025) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 20:10:03.161755 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-526f59c7-c7d6-4b78-a0b4-6d46e9ee18d5 service nova] REQUEST_METHOD: `GET` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:10:03.162048 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-526f59c7-c7d6-4b78-a0b4-6d46e9ee18d5 service nova] SCRIPT_NAME: `/identity` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:10:03.162314 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-526f59c7-c7d6-4b78-a0b4-6d46e9ee18d5 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:10:03.171537 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-526f59c7-c7d6-4b78-a0b4-6d46e9ee18d5 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 20:10:03.173124 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-526f59c7-c7d6-4b78-a0b4-6d46e9ee18d5 service nova] RBAC: Authorization granted {{(pid=82025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 20:10:03.184385 dv-cinder-828806-6-smb devstack@keystone.service[82025]: [pid: 82025|app: 0|req: 1440/2819] 10.222.0.33 () {60 vars in 1365 bytes} [Tue Sep 13 20:10:03 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 20:10:04.349443 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dff8f5c-3bc9-4f86-91fb-e30eaafc97ea None None] Authenticating user token {{(pid=82026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 20:10:04.350214 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.common.fernet_utils [None req-8dff8f5c-3bc9-4f86-91fb-e30eaafc97ea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82026) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 20:10:04.362667 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dff8f5c-3bc9-4f86-91fb-e30eaafc97ea None None] Validating token access rules against request {{(pid=82026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 20:10:04.368985 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-693dfc62-9c0b-41d9-b4f2-c291880e805c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57539b6a6f3b4d589f5f5e1d211cd6a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b454f707d20347ada3d82aa85495635e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 20:10:04.369616 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-693dfc62-9c0b-41d9-b4f2-c291880e805c admin admin] REQUEST_METHOD: `DELETE` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:10:04.369900 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-693dfc62-9c0b-41d9-b4f2-c291880e805c admin admin] SCRIPT_NAME: `/identity` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:10:04.370176 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-693dfc62-9c0b-41d9-b4f2-c291880e805c admin admin] PATH_INFO: `/v3/users/2f6d7f8d9db24b6fbe6b3e7663b20274` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:10:04.371363 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-693dfc62-9c0b-41d9-b4f2-c291880e805c admin admin] RBAC: Authorizing `identity:delete_user(user_id=2f6d7f8d9db24b6fbe6b3e7663b20274)` {{(pid=82026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 20:10:04.373303 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-693dfc62-9c0b-41d9-b4f2-c291880e805c admin admin] RBAC: Authorization granted {{(pid=82026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 20:10:04.643898 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.notifications [None req-693dfc62-9c0b-41d9-b4f2-c291880e805c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2f6d7f8d9db24b6fbe6b3e7663b20274'} {{(pid=82026) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 20:10:04.729880 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.notifications [None req-693dfc62-9c0b-41d9-b4f2-c291880e805c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2f6d7f8d9db24b6fbe6b3e7663b20274'} {{(pid=82026) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 20:10:04.745121 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.notifications [None req-693dfc62-9c0b-41d9-b4f2-c291880e805c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2f6d7f8d9db24b6fbe6b3e7663b20274'} {{(pid=82026) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 20:10:04.745867 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.notifications [None req-693dfc62-9c0b-41d9-b4f2-c291880e805c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2f6d7f8d9db24b6fbe6b3e7663b20274'} {{(pid=82026) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 20:10:04.753570 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.notifications [None req-693dfc62-9c0b-41d9-b4f2-c291880e805c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2f6d7f8d9db24b6fbe6b3e7663b20274'} {{(pid=82026) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 20:10:04.760506 dv-cinder-828806-6-smb devstack@keystone.service[82026]: [pid: 82026|app: 0|req: 1380/2820] 10.222.0.33 () {58 vars in 1224 bytes} [Tue Sep 13 20:10:04 2022] DELETE /identity/v3/users/2f6d7f8d9db24b6fbe6b3e7663b20274 => generated 0 bytes in 413 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 20:10:05.046075 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-526f59c7-c7d6-4b78-a0b4-6d46e9ee18d5 service nova] Authenticating user token {{(pid=82025) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 20:10:05.058992 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-526f59c7-c7d6-4b78-a0b4-6d46e9ee18d5 service nova] Validating token access rules against request {{(pid=82025) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 20:10:05.119727 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbfc618a-24aa-4f96-a851-762da25c77cb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57539b6a6f3b4d589f5f5e1d211cd6a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b454f707d20347ada3d82aa85495635e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82025) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 20:10:05.120380 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbfc618a-24aa-4f96-a851-762da25c77cb admin admin] REQUEST_METHOD: `DELETE` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:10:05.120661 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbfc618a-24aa-4f96-a851-762da25c77cb admin admin] SCRIPT_NAME: `/identity` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:10:05.120940 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbfc618a-24aa-4f96-a851-762da25c77cb admin admin] PATH_INFO: `/v3/projects/00fff77958004efab37749ec46fac765` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:10:05.122048 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbfc618a-24aa-4f96-a851-762da25c77cb admin admin] RBAC: Authorizing `identity:delete_project(project_id=00fff77958004efab37749ec46fac765)` {{(pid=82025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 20:10:05.123981 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbfc618a-24aa-4f96-a851-762da25c77cb admin admin] RBAC: Authorization granted {{(pid=82025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 20:10:05.286238 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.notifications [None req-fbfc618a-24aa-4f96-a851-762da25c77cb admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '00fff77958004efab37749ec46fac765', 'request_id': 'req-fbfc618a-24aa-4f96-a851-762da25c77cb'} {{(pid=82025) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 20:10:05.292228 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.notifications [None req-fbfc618a-24aa-4f96-a851-762da25c77cb admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '00fff77958004efab37749ec46fac765', 'request_id': 'req-fbfc618a-24aa-4f96-a851-762da25c77cb'} {{(pid=82025) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 20:10:05.299173 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.notifications [None req-fbfc618a-24aa-4f96-a851-762da25c77cb admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '00fff77958004efab37749ec46fac765', 'request_id': 'req-fbfc618a-24aa-4f96-a851-762da25c77cb'} {{(pid=82025) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 20:10:05.302376 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG dbcounter [-] [82025] Writing DB stats keystone:SELECT=93,keystone:DELETE=6,keystone:INSERT=1 {{(pid=82025) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 20:10:05.414806 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.notifications [None req-fbfc618a-24aa-4f96-a851-762da25c77cb admin admin] The token cache is being invalidate because project 00fff77958004efab37749ec46fac765 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82025) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 13 20:10:05.415132 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.notifications [None req-fbfc618a-24aa-4f96-a851-762da25c77cb admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82025) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 20:10:05.415757 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.notifications [None req-fbfc618a-24aa-4f96-a851-762da25c77cb admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82025) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 20:10:05.417251 dv-cinder-828806-6-smb devstack@keystone.service[82025]: [pid: 82025|app: 0|req: 1441/2821] 10.222.0.33 () {58 vars in 1233 bytes} [Tue Sep 13 20:10:05 2022] DELETE /identity/v3/projects/00fff77958004efab37749ec46fac765 => generated 0 bytes in 372 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 20:10:05.422233 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-babb29ed-3396-405e-849a-ad85d4193c57 None None] REQUEST_METHOD: `POST` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:10:05.422750 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-babb29ed-3396-405e-849a-ad85d4193c57 None None] SCRIPT_NAME: `/identity` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:10:05.422863 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-babb29ed-3396-405e-849a-ad85d4193c57 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:10:05.436639 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG dbcounter [-] [82026] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82026) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 20:10:05.443206 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.auth.core [None req-babb29ed-3396-405e-849a-ad85d4193c57 None None] MFA Rules not processed for user `57539b6a6f3b4d589f5f5e1d211cd6a0`. Rule list: `[]` (Enabled: `True`). {{(pid=82026) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 20:10:05.444420 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.common.fernet_utils [None req-babb29ed-3396-405e-849a-ad85d4193c57 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82026) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 20:10:05.501788 dv-cinder-828806-6-smb devstack@keystone.service[82026]: [pid: 82026|app: 0|req: 1381/2822] 10.222.0.33 () {58 vars in 958 bytes} [Tue Sep 13 20:10:05 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 20:10:05.510060 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea5b4246-d474-4e4d-9072-59c0c06f7c34 None None] REQUEST_METHOD: `POST` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:10:05.510349 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea5b4246-d474-4e4d-9072-59c0c06f7c34 None None] SCRIPT_NAME: `/identity` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:10:05.510629 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea5b4246-d474-4e4d-9072-59c0c06f7c34 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:10:05.531287 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.auth.core [None req-ea5b4246-d474-4e4d-9072-59c0c06f7c34 None None] MFA Rules not processed for user `57539b6a6f3b4d589f5f5e1d211cd6a0`. Rule list: `[]` (Enabled: `True`). {{(pid=82025) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 20:10:05.532531 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.fernet_utils [None req-ea5b4246-d474-4e4d-9072-59c0c06f7c34 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82025) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 20:10:05.540767 dv-cinder-828806-6-smb devstack@keystone.service[82025]: [pid: 82025|app: 0|req: 1442/2823] 10.222.0.33 () {58 vars in 958 bytes} [Tue Sep 13 20:10:05 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 20:10:05.544948 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-babb29ed-3396-405e-849a-ad85d4193c57 None None] Authenticating user token {{(pid=82026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 20:10:05.554590 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-babb29ed-3396-405e-849a-ad85d4193c57 None None] Validating token access rules against request {{(pid=82026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 20:10:05.560300 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d66c4b5-977a-4b8f-9519-e1d405b81758 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57539b6a6f3b4d589f5f5e1d211cd6a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b454f707d20347ada3d82aa85495635e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 20:10:05.560300 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d66c4b5-977a-4b8f-9519-e1d405b81758 admin admin] REQUEST_METHOD: `GET` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:10:05.560538 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d66c4b5-977a-4b8f-9519-e1d405b81758 admin admin] SCRIPT_NAME: `/identity` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:10:05.560632 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d66c4b5-977a-4b8f-9519-e1d405b81758 admin admin] PATH_INFO: `/v3/domains` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:10:05.561244 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d66c4b5-977a-4b8f-9519-e1d405b81758 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82026) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 20:10:05.561554 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d66c4b5-977a-4b8f-9519-e1d405b81758 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 20:10:05.563182 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d66c4b5-977a-4b8f-9519-e1d405b81758 admin admin] RBAC: Authorization granted {{(pid=82026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 20:10:05.575215 dv-cinder-828806-6-smb devstack@keystone.service[82026]: [pid: 82026|app: 0|req: 1382/2824] 10.222.0.33 () {58 vars in 1153 bytes} [Tue Sep 13 20:10:05 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 20:10:05.579540 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea5b4246-d474-4e4d-9072-59c0c06f7c34 None None] Authenticating user token {{(pid=82025) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 20:10:05.589394 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea5b4246-d474-4e4d-9072-59c0c06f7c34 None None] Validating token access rules against request {{(pid=82025) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 20:10:05.594156 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a114325-2cd9-48f2-8d71-5a4ed284425e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57539b6a6f3b4d589f5f5e1d211cd6a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b454f707d20347ada3d82aa85495635e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82025) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 20:10:05.594755 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a114325-2cd9-48f2-8d71-5a4ed284425e admin admin] REQUEST_METHOD: `POST` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:10:05.595047 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a114325-2cd9-48f2-8d71-5a4ed284425e admin admin] SCRIPT_NAME: `/identity` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:10:05.595331 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a114325-2cd9-48f2-8d71-5a4ed284425e admin admin] PATH_INFO: `/v3/projects` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:10:05.595993 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a114325-2cd9-48f2-8d71-5a4ed284425e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 20:10:05.597926 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a114325-2cd9-48f2-8d71-5a4ed284425e admin admin] RBAC: Authorization granted {{(pid=82025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 20:10:05.702283 dv-cinder-828806-6-smb devstack@keystone.service[82025]: [pid: 82025|app: 0|req: 1443/2825] 10.222.0.33 () {60 vars in 1153 bytes} [Tue Sep 13 20:10:05 2022] POST /identity/v3/projects => generated 363 bytes in 123 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 13 20:10:05.706463 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d66c4b5-977a-4b8f-9519-e1d405b81758 admin admin] Authenticating user token {{(pid=82026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 20:10:05.717359 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d66c4b5-977a-4b8f-9519-e1d405b81758 admin admin] Validating token access rules against request {{(pid=82026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 20:10:05.774728 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9535580-071c-4d48-ab35-668c954e17d3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57539b6a6f3b4d589f5f5e1d211cd6a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b454f707d20347ada3d82aa85495635e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 20:10:05.775421 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9535580-071c-4d48-ab35-668c954e17d3 admin admin] REQUEST_METHOD: `POST` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:10:05.775714 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9535580-071c-4d48-ab35-668c954e17d3 admin admin] SCRIPT_NAME: `/identity` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:10:05.775997 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9535580-071c-4d48-ab35-668c954e17d3 admin admin] PATH_INFO: `/v3/users` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:10:05.776649 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9535580-071c-4d48-ab35-668c954e17d3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 20:10:05.778620 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9535580-071c-4d48-ab35-668c954e17d3 admin admin] RBAC: Authorization granted {{(pid=82026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 20:10:05.901286 dv-cinder-828806-6-smb devstack@keystone.service[82026]: [pid: 82026|app: 0|req: 1383/2826] 10.222.0.33 () {60 vars in 1144 bytes} [Tue Sep 13 20:10:05 2022] POST /identity/v3/users => generated 282 bytes in 195 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 13 20:10:05.905388 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a114325-2cd9-48f2-8d71-5a4ed284425e admin admin] Authenticating user token {{(pid=82025) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 20:10:05.915591 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a114325-2cd9-48f2-8d71-5a4ed284425e admin admin] Validating token access rules against request {{(pid=82025) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 20:10:05.920206 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f69f0ac6-b073-4520-9114-948609b8a9dd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57539b6a6f3b4d589f5f5e1d211cd6a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b454f707d20347ada3d82aa85495635e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82025) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 20:10:05.920808 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f69f0ac6-b073-4520-9114-948609b8a9dd admin admin] REQUEST_METHOD: `GET` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:10:05.921094 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f69f0ac6-b073-4520-9114-948609b8a9dd admin admin] SCRIPT_NAME: `/identity` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:10:05.921382 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f69f0ac6-b073-4520-9114-948609b8a9dd admin admin] PATH_INFO: `/v3/roles` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:10:05.922026 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f69f0ac6-b073-4520-9114-948609b8a9dd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 20:10:05.923747 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f69f0ac6-b073-4520-9114-948609b8a9dd admin admin] RBAC: Authorization granted {{(pid=82025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 20:10:05.935516 dv-cinder-828806-6-smb devstack@keystone.service[82025]: [pid: 82025|app: 0|req: 1444/2827] 10.222.0.33 () {58 vars in 1122 bytes} [Tue Sep 13 20:10:05 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 13 20:10:05.939407 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9535580-071c-4d48-ab35-668c954e17d3 admin admin] Authenticating user token {{(pid=82026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 20:10:05.950290 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9535580-071c-4d48-ab35-668c954e17d3 admin admin] Validating token access rules against request {{(pid=82026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 20:10:05.954987 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13c1bede-21d1-443a-9bce-e9076f0fc434 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57539b6a6f3b4d589f5f5e1d211cd6a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b454f707d20347ada3d82aa85495635e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 20:10:05.955686 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13c1bede-21d1-443a-9bce-e9076f0fc434 admin admin] REQUEST_METHOD: `GET` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:10:05.955971 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13c1bede-21d1-443a-9bce-e9076f0fc434 admin admin] SCRIPT_NAME: `/identity` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:10:05.956276 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13c1bede-21d1-443a-9bce-e9076f0fc434 admin admin] PATH_INFO: `/v3/roles` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:10:05.957081 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13c1bede-21d1-443a-9bce-e9076f0fc434 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 20:10:05.959324 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13c1bede-21d1-443a-9bce-e9076f0fc434 admin admin] RBAC: Authorization granted {{(pid=82026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 20:10:05.970161 dv-cinder-828806-6-smb devstack@keystone.service[82026]: [pid: 82026|app: 0|req: 1384/2828] 10.222.0.33 () {58 vars in 1122 bytes} [Tue Sep 13 20:10:05 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 13 20:10:05.974637 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f69f0ac6-b073-4520-9114-948609b8a9dd admin admin] Authenticating user token {{(pid=82025) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 20:10:05.985703 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f69f0ac6-b073-4520-9114-948609b8a9dd admin admin] Validating token access rules against request {{(pid=82025) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 20:10:05.991095 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abad50a3-3ed8-4587-b993-ae44b3cd5480 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57539b6a6f3b4d589f5f5e1d211cd6a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b454f707d20347ada3d82aa85495635e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82025) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 20:10:05.991778 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abad50a3-3ed8-4587-b993-ae44b3cd5480 admin admin] REQUEST_METHOD: `PUT` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:10:05.992344 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abad50a3-3ed8-4587-b993-ae44b3cd5480 admin admin] SCRIPT_NAME: `/identity` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:10:05.992707 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abad50a3-3ed8-4587-b993-ae44b3cd5480 admin admin] PATH_INFO: `/v3/projects/567c208e333546f4938c57c9affc1436/users/268fba70e3fd4c948c353e097de605dc/roles/3618ab638a65401f82333da7596d1daf` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:10:06.009576 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abad50a3-3ed8-4587-b993-ae44b3cd5480 admin admin] RBAC: Authorizing `identity:create_grant(project_id=567c208e333546f4938c57c9affc1436, user_id=268fba70e3fd4c948c353e097de605dc, role_id=3618ab638a65401f82333da7596d1daf)` {{(pid=82025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 20:10:06.012370 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abad50a3-3ed8-4587-b993-ae44b3cd5480 admin admin] RBAC: Authorization granted {{(pid=82025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 20:10:06.095914 dv-cinder-828806-6-smb devstack@keystone.service[82025]: [pid: 82025|app: 0|req: 1445/2829] 10.222.0.33 () {60 vars in 1483 bytes} [Tue Sep 13 20:10:05 2022] PUT /identity/v3/projects/567c208e333546f4938c57c9affc1436/users/268fba70e3fd4c948c353e097de605dc/roles/3618ab638a65401f82333da7596d1daf => generated 0 bytes in 122 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 20:10:06.108011 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50f7b89c-04ee-4cf4-bb8d-a466c920240d None None] REQUEST_METHOD: `POST` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:10:06.108330 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50f7b89c-04ee-4cf4-bb8d-a466c920240d None None] SCRIPT_NAME: `/identity` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:10:06.108609 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50f7b89c-04ee-4cf4-bb8d-a466c920240d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:10:06.139350 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.auth.core [None req-50f7b89c-04ee-4cf4-bb8d-a466c920240d None None] MFA Rules not processed for user `268fba70e3fd4c948c353e097de605dc`. Rule list: `[]` (Enabled: `True`). {{(pid=82026) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 20:10:06.140708 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.common.fernet_utils [None req-50f7b89c-04ee-4cf4-bb8d-a466c920240d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82026) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 20:10:06.208260 dv-cinder-828806-6-smb devstack@keystone.service[82026]: [pid: 82026|app: 0|req: 1385/2830] 10.222.0.33 () {58 vars in 958 bytes} [Tue Sep 13 20:10:06 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 20:10:06.212936 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abad50a3-3ed8-4587-b993-ae44b3cd5480 admin admin] Authenticating user token {{(pid=82025) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 20:10:06.279945 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abad50a3-3ed8-4587-b993-ae44b3cd5480 admin admin] Validating token access rules against request {{(pid=82025) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 20:10:06.285616 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98a58493-8c12-4015-8c6e-8abd0cb20bc9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57539b6a6f3b4d589f5f5e1d211cd6a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b454f707d20347ada3d82aa85495635e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82025) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 20:10:06.286279 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98a58493-8c12-4015-8c6e-8abd0cb20bc9 admin admin] REQUEST_METHOD: `POST` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:10:06.286559 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98a58493-8c12-4015-8c6e-8abd0cb20bc9 admin admin] SCRIPT_NAME: `/identity` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:10:06.286837 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98a58493-8c12-4015-8c6e-8abd0cb20bc9 admin admin] PATH_INFO: `/v3/projects` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:10:06.287546 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98a58493-8c12-4015-8c6e-8abd0cb20bc9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 20:10:06.289661 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98a58493-8c12-4015-8c6e-8abd0cb20bc9 admin admin] RBAC: Authorization granted {{(pid=82025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 20:10:06.310250 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18ea961a-581f-4e92-a12c-116a3160ef8b None None] REQUEST_METHOD: `POST` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:10:06.310546 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18ea961a-581f-4e92-a12c-116a3160ef8b None None] SCRIPT_NAME: `/identity` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:10:06.310824 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18ea961a-581f-4e92-a12c-116a3160ef8b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:10:06.325272 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG dbcounter [-] [82026] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=82026) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 20:10:06.342095 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.auth.core [None req-18ea961a-581f-4e92-a12c-116a3160ef8b None None] MFA Rules not processed for user `57539b6a6f3b4d589f5f5e1d211cd6a0`. Rule list: `[]` (Enabled: `True`). {{(pid=82026) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 20:10:06.343346 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.common.fernet_utils [None req-18ea961a-581f-4e92-a12c-116a3160ef8b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82026) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 20:10:06.352537 dv-cinder-828806-6-smb devstack@keystone.service[82026]: [pid: 82026|app: 0|req: 1386/2831] 10.222.0.16 () {58 vars in 1016 bytes} [Tue Sep 13 20:10:06 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 45 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 13 20:10:06.374736 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18ea961a-581f-4e92-a12c-116a3160ef8b None None] Authenticating user token {{(pid=82026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 20:10:06.376160 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.common.fernet_utils [None req-18ea961a-581f-4e92-a12c-116a3160ef8b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82026) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 20:10:06.443385 dv-cinder-828806-6-smb devstack@keystone.service[82025]: [pid: 82025|app: 0|req: 1446/2832] 10.222.0.33 () {60 vars in 1153 bytes} [Tue Sep 13 20:10:06 2022] POST /identity/v3/projects => generated 363 bytes in 228 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 13 20:10:06.444500 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98a58493-8c12-4015-8c6e-8abd0cb20bc9 admin admin] Authenticating user token {{(pid=82025) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 20:10:06.448816 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18ea961a-581f-4e92-a12c-116a3160ef8b None None] Validating token access rules against request {{(pid=82026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 20:10:06.508478 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98a58493-8c12-4015-8c6e-8abd0cb20bc9 admin admin] Validating token access rules against request {{(pid=82025) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 20:10:06.513205 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecf2dacb-5125-403d-b90a-39eccc8b080c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57539b6a6f3b4d589f5f5e1d211cd6a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b454f707d20347ada3d82aa85495635e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82025) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 20:10:06.513808 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecf2dacb-5125-403d-b90a-39eccc8b080c admin admin] REQUEST_METHOD: `POST` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:10:06.514002 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39cc1836-f676-4b5c-b3c9-dc78b6317137 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e66e7034abed4e0bad1f4137520c1e70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8c6fba0f15b4d6a84ff601919b7b8e4', 'project_domain_id': 'default', 'roles': ['service', 'member', 'reader', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 20:10:06.514122 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecf2dacb-5125-403d-b90a-39eccc8b080c admin admin] SCRIPT_NAME: `/identity` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:10:06.514354 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecf2dacb-5125-403d-b90a-39eccc8b080c admin admin] PATH_INFO: `/v3/users` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:10:06.514620 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39cc1836-f676-4b5c-b3c9-dc78b6317137 service nova] REQUEST_METHOD: `GET` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:10:06.514909 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39cc1836-f676-4b5c-b3c9-dc78b6317137 service nova] SCRIPT_NAME: `/identity` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:10:06.515017 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecf2dacb-5125-403d-b90a-39eccc8b080c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 20:10:06.515231 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39cc1836-f676-4b5c-b3c9-dc78b6317137 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:10:06.516903 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecf2dacb-5125-403d-b90a-39eccc8b080c admin admin] RBAC: Authorization granted {{(pid=82025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 20:10:06.524305 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39cc1836-f676-4b5c-b3c9-dc78b6317137 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 20:10:06.525903 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39cc1836-f676-4b5c-b3c9-dc78b6317137 service nova] RBAC: Authorization granted {{(pid=82026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 20:10:06.536401 dv-cinder-828806-6-smb devstack@keystone.service[82026]: [pid: 82026|app: 0|req: 1387/2833] 10.222.0.33 () {60 vars in 1365 bytes} [Tue Sep 13 20:10:06 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 162 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 13 20:10:06.656472 dv-cinder-828806-6-smb devstack@keystone.service[82025]: [pid: 82025|app: 0|req: 1447/2834] 10.222.0.33 () {60 vars in 1144 bytes} [Tue Sep 13 20:10:06 2022] POST /identity/v3/users => generated 288 bytes in 212 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 13 20:10:06.660294 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39cc1836-f676-4b5c-b3c9-dc78b6317137 service nova] Authenticating user token {{(pid=82026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 20:10:06.670999 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39cc1836-f676-4b5c-b3c9-dc78b6317137 service nova] Validating token access rules against request {{(pid=82026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 20:10:06.678305 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-803a1e35-78c6-4906-80ca-cff37cca4990 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57539b6a6f3b4d589f5f5e1d211cd6a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b454f707d20347ada3d82aa85495635e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 20:10:06.678305 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-803a1e35-78c6-4906-80ca-cff37cca4990 admin admin] REQUEST_METHOD: `GET` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:10:06.678305 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-803a1e35-78c6-4906-80ca-cff37cca4990 admin admin] SCRIPT_NAME: `/identity` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:10:06.678305 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-803a1e35-78c6-4906-80ca-cff37cca4990 admin admin] PATH_INFO: `/v3/roles` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:10:06.678920 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-803a1e35-78c6-4906-80ca-cff37cca4990 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 20:10:06.680639 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-803a1e35-78c6-4906-80ca-cff37cca4990 admin admin] RBAC: Authorization granted {{(pid=82026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 20:10:06.691313 dv-cinder-828806-6-smb devstack@keystone.service[82026]: [pid: 82026|app: 0|req: 1388/2835] 10.222.0.33 () {58 vars in 1122 bytes} [Tue Sep 13 20:10:06 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 13 20:10:06.700825 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecf2dacb-5125-403d-b90a-39eccc8b080c admin admin] Authenticating user token {{(pid=82025) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 20:10:06.707877 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG dbcounter [-] [82025] Writing DB stats keystone:DELETE=1,keystone:SELECT=93,keystone:INSERT=6 {{(pid=82025) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 20:10:06.712023 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecf2dacb-5125-403d-b90a-39eccc8b080c admin admin] Validating token access rules against request {{(pid=82025) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 20:10:06.716769 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e4ec872-c3ae-40d4-a9a7-f24eb09f78d9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57539b6a6f3b4d589f5f5e1d211cd6a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b454f707d20347ada3d82aa85495635e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82025) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 20:10:06.717422 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e4ec872-c3ae-40d4-a9a7-f24eb09f78d9 admin admin] REQUEST_METHOD: `PUT` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:10:06.717705 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e4ec872-c3ae-40d4-a9a7-f24eb09f78d9 admin admin] SCRIPT_NAME: `/identity` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:10:06.717984 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e4ec872-c3ae-40d4-a9a7-f24eb09f78d9 admin admin] PATH_INFO: `/v3/projects/7087010e0c72423aaebe8a498dd58228/users/52c9bd70673b452aad89c6d619964eb1/roles/e5af7d5baa93469e9e486ef21c85474e` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:10:06.734024 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e4ec872-c3ae-40d4-a9a7-f24eb09f78d9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7087010e0c72423aaebe8a498dd58228, user_id=52c9bd70673b452aad89c6d619964eb1, role_id=e5af7d5baa93469e9e486ef21c85474e)` {{(pid=82025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 20:10:06.736712 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e4ec872-c3ae-40d4-a9a7-f24eb09f78d9 admin admin] RBAC: Authorization granted {{(pid=82025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 20:10:06.844261 dv-cinder-828806-6-smb devstack@keystone.service[82025]: [pid: 82025|app: 0|req: 1448/2836] 10.222.0.33 () {60 vars in 1483 bytes} [Tue Sep 13 20:10:06 2022] PUT /identity/v3/projects/7087010e0c72423aaebe8a498dd58228/users/52c9bd70673b452aad89c6d619964eb1/roles/e5af7d5baa93469e9e486ef21c85474e => generated 0 bytes in 144 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 20:10:06.848780 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-803a1e35-78c6-4906-80ca-cff37cca4990 admin admin] Authenticating user token {{(pid=82026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 20:10:06.859190 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-803a1e35-78c6-4906-80ca-cff37cca4990 admin admin] Validating token access rules against request {{(pid=82026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 20:10:06.916544 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de5c680e-5681-4177-8fad-860b358cc40e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57539b6a6f3b4d589f5f5e1d211cd6a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b454f707d20347ada3d82aa85495635e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 20:10:06.917065 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de5c680e-5681-4177-8fad-860b358cc40e admin admin] REQUEST_METHOD: `GET` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:10:06.917346 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de5c680e-5681-4177-8fad-860b358cc40e admin admin] SCRIPT_NAME: `/identity` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:10:06.917622 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de5c680e-5681-4177-8fad-860b358cc40e admin admin] PATH_INFO: `/v3/roles` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:10:06.918262 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de5c680e-5681-4177-8fad-860b358cc40e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 20:10:06.919887 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de5c680e-5681-4177-8fad-860b358cc40e admin admin] RBAC: Authorization granted {{(pid=82026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 20:10:06.929472 dv-cinder-828806-6-smb devstack@keystone.service[82026]: [pid: 82026|app: 0|req: 1389/2837] 10.222.0.33 () {58 vars in 1122 bytes} [Tue Sep 13 20:10:06 2022] GET /identity/v3/roles => generated 1420 bytes in 82 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 13 20:10:06.933910 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e4ec872-c3ae-40d4-a9a7-f24eb09f78d9 admin admin] Authenticating user token {{(pid=82025) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 20:10:06.945036 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e4ec872-c3ae-40d4-a9a7-f24eb09f78d9 admin admin] Validating token access rules against request {{(pid=82025) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 20:10:06.949744 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fb0e452-b930-4841-8cb3-685bd7e7080c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57539b6a6f3b4d589f5f5e1d211cd6a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b454f707d20347ada3d82aa85495635e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82025) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 20:10:06.950393 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fb0e452-b930-4841-8cb3-685bd7e7080c admin admin] REQUEST_METHOD: `PUT` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:10:06.950681 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fb0e452-b930-4841-8cb3-685bd7e7080c admin admin] SCRIPT_NAME: `/identity` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:10:06.950963 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fb0e452-b930-4841-8cb3-685bd7e7080c admin admin] PATH_INFO: `/v3/projects/7087010e0c72423aaebe8a498dd58228/users/52c9bd70673b452aad89c6d619964eb1/roles/e5af7d5baa93469e9e486ef21c85474e` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:10:06.952931 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fb0e452-b930-4841-8cb3-685bd7e7080c admin admin] RBAC: Authorizing `identity:create_grant(project_id=7087010e0c72423aaebe8a498dd58228, user_id=52c9bd70673b452aad89c6d619964eb1, role_id=e5af7d5baa93469e9e486ef21c85474e)` {{(pid=82025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 20:10:06.955588 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fb0e452-b930-4841-8cb3-685bd7e7080c admin admin] RBAC: Authorization granted {{(pid=82025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 20:10:06.966920 dv-cinder-828806-6-smb devstack@keystone.service[82025]: [pid: 82025|app: 0|req: 1449/2838] 10.222.0.33 () {60 vars in 1483 bytes} [Tue Sep 13 20:10:06 2022] PUT /identity/v3/projects/7087010e0c72423aaebe8a498dd58228/users/52c9bd70673b452aad89c6d619964eb1/roles/e5af7d5baa93469e9e486ef21c85474e => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 20:10:06.979142 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae2344f0-d45c-46b5-b57b-1b14a6e8086f None None] REQUEST_METHOD: `POST` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:10:06.979438 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae2344f0-d45c-46b5-b57b-1b14a6e8086f None None] SCRIPT_NAME: `/identity` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:10:06.979720 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae2344f0-d45c-46b5-b57b-1b14a6e8086f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:10:06.987783 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG dbcounter [-] [82026] Writing DB stats keystone:SELECT=100 {{(pid=82026) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 20:10:07.008308 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.auth.core [None req-ae2344f0-d45c-46b5-b57b-1b14a6e8086f None None] MFA Rules not processed for user `52c9bd70673b452aad89c6d619964eb1`. Rule list: `[]` (Enabled: `True`). {{(pid=82026) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 20:10:07.009526 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.common.fernet_utils [None req-ae2344f0-d45c-46b5-b57b-1b14a6e8086f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82026) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 20:10:07.078367 dv-cinder-828806-6-smb devstack@keystone.service[82026]: [pid: 82026|app: 0|req: 1390/2839] 10.222.0.33 () {58 vars in 958 bytes} [Tue Sep 13 20:10:06 2022] POST /identity/v3/auth/tokens => generated 3307 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 20:10:07.091266 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fb0e452-b930-4841-8cb3-685bd7e7080c admin admin] Authenticating user token {{(pid=82025) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 20:10:07.093007 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.fernet_utils [None req-9fb0e452-b930-4841-8cb3-685bd7e7080c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82025) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 20:10:07.152055 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fb0e452-b930-4841-8cb3-685bd7e7080c admin admin] Validating token access rules against request {{(pid=82025) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 20:10:07.155998 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e05bbc5-d516-40a7-a64d-aa51d2126b69 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46024fc6167f4321818b1bed27a521a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8c6fba0f15b4d6a84ff601919b7b8e4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82025) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 20:10:07.156612 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e05bbc5-d516-40a7-a64d-aa51d2126b69 service cinder] REQUEST_METHOD: `GET` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:10:07.156900 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e05bbc5-d516-40a7-a64d-aa51d2126b69 service cinder] SCRIPT_NAME: `/identity` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:10:07.157179 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e05bbc5-d516-40a7-a64d-aa51d2126b69 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:10:07.166532 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e05bbc5-d516-40a7-a64d-aa51d2126b69 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=82025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 20:10:07.168076 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e05bbc5-d516-40a7-a64d-aa51d2126b69 service cinder] RBAC: Authorization granted {{(pid=82025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 20:10:07.178285 dv-cinder-828806-6-smb devstack@keystone.service[82025]: [pid: 82025|app: 0|req: 1450/2840] 10.222.0.33 () {60 vars in 1365 bytes} [Tue Sep 13 20:10:07 2022] GET /identity/v3/auth/tokens => generated 3307 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 20:10:07.441631 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae2344f0-d45c-46b5-b57b-1b14a6e8086f None None] Authenticating user token {{(pid=82026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 20:10:07.443805 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.common.fernet_utils [None req-ae2344f0-d45c-46b5-b57b-1b14a6e8086f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82026) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 20:10:07.455852 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae2344f0-d45c-46b5-b57b-1b14a6e8086f None None] Validating token access rules against request {{(pid=82026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 20:10:07.459616 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cc49ee7-2373-418a-a305-b9d567b85b45 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46024fc6167f4321818b1bed27a521a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8c6fba0f15b4d6a84ff601919b7b8e4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 20:10:07.460214 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cc49ee7-2373-418a-a305-b9d567b85b45 service cinder] REQUEST_METHOD: `GET` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:10:07.460495 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cc49ee7-2373-418a-a305-b9d567b85b45 service cinder] SCRIPT_NAME: `/identity` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:10:07.460770 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cc49ee7-2373-418a-a305-b9d567b85b45 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:10:07.516057 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cc49ee7-2373-418a-a305-b9d567b85b45 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=82026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 20:10:07.517485 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cc49ee7-2373-418a-a305-b9d567b85b45 service cinder] RBAC: Authorization granted {{(pid=82026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 20:10:07.526268 dv-cinder-828806-6-smb devstack@keystone.service[82026]: [pid: 82026|app: 0|req: 1391/2841] 10.222.0.33 () {60 vars in 1365 bytes} [Tue Sep 13 20:10:07 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 20:10:09.576062 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80b41f02-6209-4746-a3f3-14453a5af2cb None None] REQUEST_METHOD: `POST` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:10:09.576557 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80b41f02-6209-4746-a3f3-14453a5af2cb None None] SCRIPT_NAME: `/identity` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:10:09.576687 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80b41f02-6209-4746-a3f3-14453a5af2cb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:10:09.596846 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.auth.core [None req-80b41f02-6209-4746-a3f3-14453a5af2cb None None] MFA Rules not processed for user `57539b6a6f3b4d589f5f5e1d211cd6a0`. Rule list: `[]` (Enabled: `True`). {{(pid=82025) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 20:10:09.598055 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.fernet_utils [None req-80b41f02-6209-4746-a3f3-14453a5af2cb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82025) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 20:10:09.662109 dv-cinder-828806-6-smb devstack@keystone.service[82025]: [pid: 82025|app: 0|req: 1451/2842] 10.222.0.16 () {58 vars in 1016 bytes} [Tue Sep 13 20:10:09 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 20:10:09.684725 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cc49ee7-2373-418a-a305-b9d567b85b45 service cinder] Authenticating user token {{(pid=82026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 20:10:09.686198 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.common.fernet_utils [None req-7cc49ee7-2373-418a-a305-b9d567b85b45 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82026) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 20:10:09.779227 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cc49ee7-2373-418a-a305-b9d567b85b45 service cinder] Validating token access rules against request {{(pid=82026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 20:10:09.784749 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-470a2c1f-4ef8-4f50-8b55-31ae9c58c81d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e66e7034abed4e0bad1f4137520c1e70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8c6fba0f15b4d6a84ff601919b7b8e4', 'project_domain_id': 'default', 'roles': ['service', 'member', 'reader', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 20:10:09.785373 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-470a2c1f-4ef8-4f50-8b55-31ae9c58c81d service nova] REQUEST_METHOD: `GET` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:10:09.785656 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-470a2c1f-4ef8-4f50-8b55-31ae9c58c81d service nova] SCRIPT_NAME: `/identity` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:10:09.785930 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-470a2c1f-4ef8-4f50-8b55-31ae9c58c81d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:10:09.794728 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-470a2c1f-4ef8-4f50-8b55-31ae9c58c81d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 20:10:09.796364 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-470a2c1f-4ef8-4f50-8b55-31ae9c58c81d service nova] RBAC: Authorization granted {{(pid=82026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 20:10:09.806407 dv-cinder-828806-6-smb devstack@keystone.service[82026]: [pid: 82026|app: 0|req: 1392/2843] 10.222.0.33 () {60 vars in 1365 bytes} [Tue Sep 13 20:10:09 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 122 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 20:10:11.504071 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80b41f02-6209-4746-a3f3-14453a5af2cb None None] Authenticating user token {{(pid=82025) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 20:10:11.513845 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80b41f02-6209-4746-a3f3-14453a5af2cb None None] Validating token access rules against request {{(pid=82025) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 20:10:11.518405 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c37db73-6b23-434b-9800-b7fcf1d2def8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57539b6a6f3b4d589f5f5e1d211cd6a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b454f707d20347ada3d82aa85495635e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82025) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 20:10:11.519024 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c37db73-6b23-434b-9800-b7fcf1d2def8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:10:11.520263 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c37db73-6b23-434b-9800-b7fcf1d2def8 admin admin] SCRIPT_NAME: `/identity` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:10:11.520263 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c37db73-6b23-434b-9800-b7fcf1d2def8 admin admin] PATH_INFO: `/v3/users/268fba70e3fd4c948c353e097de605dc` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:10:11.520769 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c37db73-6b23-434b-9800-b7fcf1d2def8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=268fba70e3fd4c948c353e097de605dc)` {{(pid=82025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 20:10:11.522706 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c37db73-6b23-434b-9800-b7fcf1d2def8 admin admin] RBAC: Authorization granted {{(pid=82025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 20:10:11.769928 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.notifications [None req-1c37db73-6b23-434b-9800-b7fcf1d2def8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '268fba70e3fd4c948c353e097de605dc'} {{(pid=82025) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 20:10:11.889764 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.notifications [None req-1c37db73-6b23-434b-9800-b7fcf1d2def8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '268fba70e3fd4c948c353e097de605dc'} {{(pid=82025) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 20:10:11.890890 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.notifications [None req-1c37db73-6b23-434b-9800-b7fcf1d2def8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '268fba70e3fd4c948c353e097de605dc'} {{(pid=82025) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 20:10:11.901410 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG dbcounter [-] [82025] Writing DB stats keystone:SELECT=88,keystone:INSERT=3,keystone:DELETE=9 {{(pid=82025) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 20:10:11.906862 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.notifications [None req-1c37db73-6b23-434b-9800-b7fcf1d2def8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '268fba70e3fd4c948c353e097de605dc'} {{(pid=82025) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 20:10:11.915319 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.notifications [None req-1c37db73-6b23-434b-9800-b7fcf1d2def8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '268fba70e3fd4c948c353e097de605dc'} {{(pid=82025) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 20:10:11.921889 dv-cinder-828806-6-smb devstack@keystone.service[82025]: [pid: 82025|app: 0|req: 1452/2844] 10.222.0.33 () {58 vars in 1224 bytes} [Tue Sep 13 20:10:11 2022] DELETE /identity/v3/users/268fba70e3fd4c948c353e097de605dc => generated 0 bytes in 418 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 20:10:11.926363 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef8d80f6-d225-4825-8299-351f113e5afd None None] REQUEST_METHOD: `POST` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:10:11.926912 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef8d80f6-d225-4825-8299-351f113e5afd None None] SCRIPT_NAME: `/identity` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:10:11.927225 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef8d80f6-d225-4825-8299-351f113e5afd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:10:11.948340 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.auth.core [None req-ef8d80f6-d225-4825-8299-351f113e5afd None None] MFA Rules not processed for user `57539b6a6f3b4d589f5f5e1d211cd6a0`. Rule list: `[]` (Enabled: `True`). {{(pid=82026) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 20:10:11.949685 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.common.fernet_utils [None req-ef8d80f6-d225-4825-8299-351f113e5afd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82026) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 20:10:11.960295 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG dbcounter [-] [82026] Writing DB stats keystone:SELECT=100 {{(pid=82026) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 20:10:12.025428 dv-cinder-828806-6-smb devstack@keystone.service[82026]: [pid: 82026|app: 0|req: 1393/2845] 10.222.0.33 () {58 vars in 958 bytes} [Tue Sep 13 20:10:11 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 20:10:12.037161 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c37db73-6b23-434b-9800-b7fcf1d2def8 admin admin] Authenticating user token {{(pid=82025) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 20:10:12.039451 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.fernet_utils [None req-1c37db73-6b23-434b-9800-b7fcf1d2def8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82025) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 20:10:12.104086 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c37db73-6b23-434b-9800-b7fcf1d2def8 admin admin] Validating token access rules against request {{(pid=82025) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 20:10:12.107907 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a07f3732-3a34-44db-a749-79251524ff2c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '023a2c79c2444611b3d431928e56685d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8c6fba0f15b4d6a84ff601919b7b8e4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82025) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 20:10:12.108536 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a07f3732-3a34-44db-a749-79251524ff2c service neutron] REQUEST_METHOD: `GET` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:10:12.108824 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a07f3732-3a34-44db-a749-79251524ff2c service neutron] SCRIPT_NAME: `/identity` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:10:12.109103 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a07f3732-3a34-44db-a749-79251524ff2c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:10:12.119779 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a07f3732-3a34-44db-a749-79251524ff2c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 20:10:12.121442 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a07f3732-3a34-44db-a749-79251524ff2c service neutron] RBAC: Authorization granted {{(pid=82025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 20:10:12.131947 dv-cinder-828806-6-smb devstack@keystone.service[82025]: [pid: 82025|app: 0|req: 1453/2846] 10.222.0.33 () {60 vars in 1365 bytes} [Tue Sep 13 20:10:12 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 96 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 20:10:12.823216 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef8d80f6-d225-4825-8299-351f113e5afd None None] Authenticating user token {{(pid=82026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 20:10:12.824868 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.common.fernet_utils [None req-ef8d80f6-d225-4825-8299-351f113e5afd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82026) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 20:10:12.838234 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef8d80f6-d225-4825-8299-351f113e5afd None None] Validating token access rules against request {{(pid=82026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 20:10:12.843210 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8402f0c-af46-4546-a3b3-4bfd2d918ce0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57539b6a6f3b4d589f5f5e1d211cd6a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b454f707d20347ada3d82aa85495635e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 20:10:12.843862 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8402f0c-af46-4546-a3b3-4bfd2d918ce0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:10:12.844149 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8402f0c-af46-4546-a3b3-4bfd2d918ce0 admin admin] SCRIPT_NAME: `/identity` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:10:12.844423 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8402f0c-af46-4546-a3b3-4bfd2d918ce0 admin admin] PATH_INFO: `/v3/projects/567c208e333546f4938c57c9affc1436` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:10:12.845567 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8402f0c-af46-4546-a3b3-4bfd2d918ce0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=567c208e333546f4938c57c9affc1436)` {{(pid=82026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 20:10:12.847564 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8402f0c-af46-4546-a3b3-4bfd2d918ce0 admin admin] RBAC: Authorization granted {{(pid=82026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 20:10:12.972784 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.notifications [None req-c8402f0c-af46-4546-a3b3-4bfd2d918ce0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '567c208e333546f4938c57c9affc1436', 'request_id': 'req-c8402f0c-af46-4546-a3b3-4bfd2d918ce0'} {{(pid=82026) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 20:10:13.060805 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.notifications [None req-c8402f0c-af46-4546-a3b3-4bfd2d918ce0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '567c208e333546f4938c57c9affc1436', 'request_id': 'req-c8402f0c-af46-4546-a3b3-4bfd2d918ce0'} {{(pid=82026) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 20:10:13.066994 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.notifications [None req-c8402f0c-af46-4546-a3b3-4bfd2d918ce0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '567c208e333546f4938c57c9affc1436', 'request_id': 'req-c8402f0c-af46-4546-a3b3-4bfd2d918ce0'} {{(pid=82026) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 20:10:13.078896 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.notifications [None req-c8402f0c-af46-4546-a3b3-4bfd2d918ce0 admin admin] The token cache is being invalidate because project 567c208e333546f4938c57c9affc1436 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82026) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 13 20:10:13.079242 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.notifications [None req-c8402f0c-af46-4546-a3b3-4bfd2d918ce0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82026) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 20:10:13.079878 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.notifications [None req-c8402f0c-af46-4546-a3b3-4bfd2d918ce0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82026) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 20:10:13.081358 dv-cinder-828806-6-smb devstack@keystone.service[82026]: [pid: 82026|app: 0|req: 1394/2847] 10.222.0.33 () {58 vars in 1233 bytes} [Tue Sep 13 20:10:12 2022] DELETE /identity/v3/projects/567c208e333546f4938c57c9affc1436 => generated 0 bytes in 259 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 13 20:10:13.086201 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a07f3732-3a34-44db-a749-79251524ff2c service neutron] Authenticating user token {{(pid=82025) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 20:10:13.096301 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a07f3732-3a34-44db-a749-79251524ff2c service neutron] Validating token access rules against request {{(pid=82025) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 20:10:13.154653 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57ee48d2-2af0-4847-b3b8-17ed2952ed07 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57539b6a6f3b4d589f5f5e1d211cd6a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b454f707d20347ada3d82aa85495635e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82025) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 20:10:13.155381 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57ee48d2-2af0-4847-b3b8-17ed2952ed07 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:10:13.155668 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57ee48d2-2af0-4847-b3b8-17ed2952ed07 admin admin] SCRIPT_NAME: `/identity` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:10:13.155944 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57ee48d2-2af0-4847-b3b8-17ed2952ed07 admin admin] PATH_INFO: `/v3/users/52c9bd70673b452aad89c6d619964eb1` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:10:13.157179 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57ee48d2-2af0-4847-b3b8-17ed2952ed07 admin admin] RBAC: Authorizing `identity:delete_user(user_id=52c9bd70673b452aad89c6d619964eb1)` {{(pid=82025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 20:10:13.159127 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57ee48d2-2af0-4847-b3b8-17ed2952ed07 admin admin] RBAC: Authorization granted {{(pid=82025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 20:10:13.436359 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.notifications [None req-57ee48d2-2af0-4847-b3b8-17ed2952ed07 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '52c9bd70673b452aad89c6d619964eb1'} {{(pid=82025) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 20:10:13.546719 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.notifications [None req-57ee48d2-2af0-4847-b3b8-17ed2952ed07 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '52c9bd70673b452aad89c6d619964eb1'} {{(pid=82025) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 20:10:13.547530 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.notifications [None req-57ee48d2-2af0-4847-b3b8-17ed2952ed07 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '52c9bd70673b452aad89c6d619964eb1'} {{(pid=82025) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 20:10:13.561744 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.notifications [None req-57ee48d2-2af0-4847-b3b8-17ed2952ed07 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '52c9bd70673b452aad89c6d619964eb1'} {{(pid=82025) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 20:10:13.568915 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.notifications [None req-57ee48d2-2af0-4847-b3b8-17ed2952ed07 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '52c9bd70673b452aad89c6d619964eb1'} {{(pid=82025) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 20:10:13.575269 dv-cinder-828806-6-smb devstack@keystone.service[82025]: [pid: 82025|app: 0|req: 1454/2848] 10.222.0.33 () {58 vars in 1224 bytes} [Tue Sep 13 20:10:13 2022] DELETE /identity/v3/users/52c9bd70673b452aad89c6d619964eb1 => generated 0 bytes in 490 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 20:10:14.059054 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8402f0c-af46-4546-a3b3-4bfd2d918ce0 admin admin] Authenticating user token {{(pid=82026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 20:10:14.060919 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.common.fernet_utils [None req-c8402f0c-af46-4546-a3b3-4bfd2d918ce0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82026) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 20:10:14.074589 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8402f0c-af46-4546-a3b3-4bfd2d918ce0 admin admin] Validating token access rules against request {{(pid=82026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 20:10:14.157145 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-058fb4a6-12e1-431e-9330-74280b46b721 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57539b6a6f3b4d589f5f5e1d211cd6a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b454f707d20347ada3d82aa85495635e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 20:10:14.157800 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-058fb4a6-12e1-431e-9330-74280b46b721 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:10:14.167543 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-058fb4a6-12e1-431e-9330-74280b46b721 admin admin] SCRIPT_NAME: `/identity` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:10:14.167543 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-058fb4a6-12e1-431e-9330-74280b46b721 admin admin] PATH_INFO: `/v3/projects/7087010e0c72423aaebe8a498dd58228` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:10:14.167543 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-058fb4a6-12e1-431e-9330-74280b46b721 admin admin] RBAC: Authorizing `identity:delete_project(project_id=7087010e0c72423aaebe8a498dd58228)` {{(pid=82026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 20:10:14.167543 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-058fb4a6-12e1-431e-9330-74280b46b721 admin admin] RBAC: Authorization granted {{(pid=82026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 20:10:14.410199 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG dbcounter [-] [82026] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82026) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 20:10:14.417674 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.notifications [None req-058fb4a6-12e1-431e-9330-74280b46b721 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7087010e0c72423aaebe8a498dd58228', 'request_id': 'req-058fb4a6-12e1-431e-9330-74280b46b721'} {{(pid=82026) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 20:10:14.552468 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.notifications [None req-058fb4a6-12e1-431e-9330-74280b46b721 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7087010e0c72423aaebe8a498dd58228', 'request_id': 'req-058fb4a6-12e1-431e-9330-74280b46b721'} {{(pid=82026) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 20:10:14.558843 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.notifications [None req-058fb4a6-12e1-431e-9330-74280b46b721 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7087010e0c72423aaebe8a498dd58228', 'request_id': 'req-058fb4a6-12e1-431e-9330-74280b46b721'} {{(pid=82026) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 20:10:14.571382 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.notifications [None req-058fb4a6-12e1-431e-9330-74280b46b721 admin admin] The token cache is being invalidate because project 7087010e0c72423aaebe8a498dd58228 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82026) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 13 20:10:14.571677 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.notifications [None req-058fb4a6-12e1-431e-9330-74280b46b721 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82026) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 20:10:14.572325 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.notifications [None req-058fb4a6-12e1-431e-9330-74280b46b721 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82026) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 20:10:14.573972 dv-cinder-828806-6-smb devstack@keystone.service[82026]: [pid: 82026|app: 0|req: 1395/2849] 10.222.0.33 () {58 vars in 1233 bytes} [Tue Sep 13 20:10:14 2022] DELETE /identity/v3/projects/7087010e0c72423aaebe8a498dd58228 => generated 0 bytes in 516 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 20:10:14.580091 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2643691-c7ac-471f-9454-9d33e9eabb50 None None] REQUEST_METHOD: `POST` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:10:14.580588 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2643691-c7ac-471f-9454-9d33e9eabb50 None None] SCRIPT_NAME: `/identity` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:10:14.580688 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2643691-c7ac-471f-9454-9d33e9eabb50 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:10:14.589967 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG dbcounter [-] [82025] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=82025) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 20:10:14.601086 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.auth.core [None req-d2643691-c7ac-471f-9454-9d33e9eabb50 None None] MFA Rules not processed for user `57539b6a6f3b4d589f5f5e1d211cd6a0`. Rule list: `[]` (Enabled: `True`). {{(pid=82025) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 20:10:14.602410 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.fernet_utils [None req-d2643691-c7ac-471f-9454-9d33e9eabb50 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82025) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 20:10:14.661156 dv-cinder-828806-6-smb devstack@keystone.service[82025]: [pid: 82025|app: 0|req: 1455/2850] 10.222.0.33 () {58 vars in 958 bytes} [Tue Sep 13 20:10:14 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 20:10:14.668702 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f541eb37-d194-49ae-aef4-36f60556fd57 None None] REQUEST_METHOD: `POST` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:10:14.668991 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f541eb37-d194-49ae-aef4-36f60556fd57 None None] SCRIPT_NAME: `/identity` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:10:14.669271 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f541eb37-d194-49ae-aef4-36f60556fd57 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:10:14.689511 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.auth.core [None req-f541eb37-d194-49ae-aef4-36f60556fd57 None None] MFA Rules not processed for user `57539b6a6f3b4d589f5f5e1d211cd6a0`. Rule list: `[]` (Enabled: `True`). {{(pid=82026) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 20:10:14.690743 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.common.fernet_utils [None req-f541eb37-d194-49ae-aef4-36f60556fd57 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82026) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 20:10:14.704909 dv-cinder-828806-6-smb devstack@keystone.service[82026]: [pid: 82026|app: 0|req: 1396/2851] 10.222.0.33 () {58 vars in 958 bytes} [Tue Sep 13 20:10:14 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 20:10:14.711553 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2643691-c7ac-471f-9454-9d33e9eabb50 None None] Authenticating user token {{(pid=82025) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 20:10:14.721257 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2643691-c7ac-471f-9454-9d33e9eabb50 None None] Validating token access rules against request {{(pid=82025) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 20:10:14.726070 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afd36ea0-8548-460e-ba77-f1d80e432c83 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57539b6a6f3b4d589f5f5e1d211cd6a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b454f707d20347ada3d82aa85495635e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82025) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 20:10:14.726682 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afd36ea0-8548-460e-ba77-f1d80e432c83 admin admin] REQUEST_METHOD: `GET` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:10:14.726965 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afd36ea0-8548-460e-ba77-f1d80e432c83 admin admin] SCRIPT_NAME: `/identity` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:10:14.727272 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afd36ea0-8548-460e-ba77-f1d80e432c83 admin admin] PATH_INFO: `/v3/domains` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:10:14.727954 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afd36ea0-8548-460e-ba77-f1d80e432c83 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82025) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 20:10:14.728262 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afd36ea0-8548-460e-ba77-f1d80e432c83 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 20:10:14.730742 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afd36ea0-8548-460e-ba77-f1d80e432c83 admin admin] RBAC: Authorization granted {{(pid=82025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 20:10:14.743147 dv-cinder-828806-6-smb devstack@keystone.service[82025]: [pid: 82025|app: 0|req: 1456/2852] 10.222.0.33 () {58 vars in 1153 bytes} [Tue Sep 13 20:10:14 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 13 20:10:14.747494 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f541eb37-d194-49ae-aef4-36f60556fd57 None None] Authenticating user token {{(pid=82026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 20:10:14.757354 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f541eb37-d194-49ae-aef4-36f60556fd57 None None] Validating token access rules against request {{(pid=82026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 20:10:14.761984 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7b3bc1d-f061-4fab-9a30-2d1907fb7803 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57539b6a6f3b4d589f5f5e1d211cd6a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b454f707d20347ada3d82aa85495635e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 20:10:14.762585 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7b3bc1d-f061-4fab-9a30-2d1907fb7803 admin admin] REQUEST_METHOD: `POST` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:10:14.762870 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7b3bc1d-f061-4fab-9a30-2d1907fb7803 admin admin] SCRIPT_NAME: `/identity` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:10:14.763216 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7b3bc1d-f061-4fab-9a30-2d1907fb7803 admin admin] PATH_INFO: `/v3/projects` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:10:14.763914 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7b3bc1d-f061-4fab-9a30-2d1907fb7803 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 20:10:14.765829 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7b3bc1d-f061-4fab-9a30-2d1907fb7803 admin admin] RBAC: Authorization granted {{(pid=82026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 20:10:14.935260 dv-cinder-828806-6-smb devstack@keystone.service[82026]: [pid: 82026|app: 0|req: 1397/2853] 10.222.0.33 () {60 vars in 1153 bytes} [Tue Sep 13 20:10:14 2022] POST /identity/v3/projects => generated 373 bytes in 185 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 13 20:10:14.936425 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afd36ea0-8548-460e-ba77-f1d80e432c83 admin admin] Authenticating user token {{(pid=82025) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 20:10:14.947681 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afd36ea0-8548-460e-ba77-f1d80e432c83 admin admin] Validating token access rules against request {{(pid=82025) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 20:10:15.009054 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdade3c1-fb21-47a9-9af5-f566cd6e6322 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57539b6a6f3b4d589f5f5e1d211cd6a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b454f707d20347ada3d82aa85495635e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82025) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 20:10:15.009665 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdade3c1-fb21-47a9-9af5-f566cd6e6322 admin admin] REQUEST_METHOD: `POST` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:10:15.009946 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdade3c1-fb21-47a9-9af5-f566cd6e6322 admin admin] SCRIPT_NAME: `/identity` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:10:15.010248 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdade3c1-fb21-47a9-9af5-f566cd6e6322 admin admin] PATH_INFO: `/v3/users` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:10:15.010882 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdade3c1-fb21-47a9-9af5-f566cd6e6322 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 20:10:15.012877 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdade3c1-fb21-47a9-9af5-f566cd6e6322 admin admin] RBAC: Authorization granted {{(pid=82025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 20:10:15.136999 dv-cinder-828806-6-smb devstack@keystone.service[82025]: [pid: 82025|app: 0|req: 1457/2854] 10.222.0.33 () {60 vars in 1144 bytes} [Tue Sep 13 20:10:14 2022] POST /identity/v3/users => generated 287 bytes in 201 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 13 20:10:15.151216 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7b3bc1d-f061-4fab-9a30-2d1907fb7803 admin admin] Authenticating user token {{(pid=82026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 20:10:15.153455 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7b3bc1d-f061-4fab-9a30-2d1907fb7803 admin admin] Validating token access rules against request {{(pid=82026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 20:10:15.165570 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30a4b675-17f9-46cb-bdfc-64360744bca4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57539b6a6f3b4d589f5f5e1d211cd6a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b454f707d20347ada3d82aa85495635e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 20:10:15.166198 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30a4b675-17f9-46cb-bdfc-64360744bca4 admin admin] REQUEST_METHOD: `GET` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:10:15.166479 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30a4b675-17f9-46cb-bdfc-64360744bca4 admin admin] SCRIPT_NAME: `/identity` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:10:15.166756 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30a4b675-17f9-46cb-bdfc-64360744bca4 admin admin] PATH_INFO: `/v3/roles` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:10:15.167447 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30a4b675-17f9-46cb-bdfc-64360744bca4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 20:10:15.169050 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30a4b675-17f9-46cb-bdfc-64360744bca4 admin admin] RBAC: Authorization granted {{(pid=82026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 20:10:15.181139 dv-cinder-828806-6-smb devstack@keystone.service[82026]: [pid: 82026|app: 0|req: 1398/2855] 10.222.0.33 () {58 vars in 1122 bytes} [Tue Sep 13 20:10:15 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 13 20:10:15.186160 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdade3c1-fb21-47a9-9af5-f566cd6e6322 admin admin] Authenticating user token {{(pid=82025) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 20:10:15.196671 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdade3c1-fb21-47a9-9af5-f566cd6e6322 admin admin] Validating token access rules against request {{(pid=82025) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 20:10:15.202333 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8739221e-c2b1-4e3d-9eab-46fc8de9e4e7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57539b6a6f3b4d589f5f5e1d211cd6a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b454f707d20347ada3d82aa85495635e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82025) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 20:10:15.203201 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8739221e-c2b1-4e3d-9eab-46fc8de9e4e7 admin admin] REQUEST_METHOD: `GET` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:10:15.203554 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8739221e-c2b1-4e3d-9eab-46fc8de9e4e7 admin admin] SCRIPT_NAME: `/identity` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:10:15.203910 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8739221e-c2b1-4e3d-9eab-46fc8de9e4e7 admin admin] PATH_INFO: `/v3/roles` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:10:15.204653 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8739221e-c2b1-4e3d-9eab-46fc8de9e4e7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 20:10:15.206800 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8739221e-c2b1-4e3d-9eab-46fc8de9e4e7 admin admin] RBAC: Authorization granted {{(pid=82025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 20:10:15.218474 dv-cinder-828806-6-smb devstack@keystone.service[82025]: [pid: 82025|app: 0|req: 1458/2856] 10.222.0.33 () {58 vars in 1122 bytes} [Tue Sep 13 20:10:15 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 13 20:10:15.228123 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30a4b675-17f9-46cb-bdfc-64360744bca4 admin admin] Authenticating user token {{(pid=82026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 20:10:15.239861 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30a4b675-17f9-46cb-bdfc-64360744bca4 admin admin] Validating token access rules against request {{(pid=82026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 20:10:15.245033 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98236d8b-5d0f-46e0-ad03-2df115805efb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57539b6a6f3b4d589f5f5e1d211cd6a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b454f707d20347ada3d82aa85495635e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 20:10:15.245803 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98236d8b-5d0f-46e0-ad03-2df115805efb admin admin] REQUEST_METHOD: `PUT` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:10:15.245979 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98236d8b-5d0f-46e0-ad03-2df115805efb admin admin] SCRIPT_NAME: `/identity` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:10:15.246433 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98236d8b-5d0f-46e0-ad03-2df115805efb admin admin] PATH_INFO: `/v3/projects/e327f0c9e8fd41889d447dd6147df9cf/users/42b29d1badfe4200910ff0fb48d63dcd/roles/3618ab638a65401f82333da7596d1daf` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:10:15.268439 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98236d8b-5d0f-46e0-ad03-2df115805efb admin admin] RBAC: Authorizing `identity:create_grant(project_id=e327f0c9e8fd41889d447dd6147df9cf, user_id=42b29d1badfe4200910ff0fb48d63dcd, role_id=3618ab638a65401f82333da7596d1daf)` {{(pid=82026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 20:10:15.271722 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98236d8b-5d0f-46e0-ad03-2df115805efb admin admin] RBAC: Authorization granted {{(pid=82026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 20:10:15.478815 dv-cinder-828806-6-smb devstack@keystone.service[82026]: [pid: 82026|app: 0|req: 1399/2857] 10.222.0.33 () {60 vars in 1483 bytes} [Tue Sep 13 20:10:15 2022] PUT /identity/v3/projects/e327f0c9e8fd41889d447dd6147df9cf/users/42b29d1badfe4200910ff0fb48d63dcd/roles/3618ab638a65401f82333da7596d1daf => generated 0 bytes in 253 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 20:10:15.483940 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-916c344f-cf3c-4cf8-965b-28af87becb67 None None] REQUEST_METHOD: `POST` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:10:15.484233 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-916c344f-cf3c-4cf8-965b-28af87becb67 None None] SCRIPT_NAME: `/identity` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:10:15.484509 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-916c344f-cf3c-4cf8-965b-28af87becb67 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:10:15.503463 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.auth.core [None req-916c344f-cf3c-4cf8-965b-28af87becb67 None None] MFA Rules not processed for user `57539b6a6f3b4d589f5f5e1d211cd6a0`. Rule list: `[]` (Enabled: `True`). {{(pid=82025) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 20:10:15.505376 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.fernet_utils [None req-916c344f-cf3c-4cf8-965b-28af87becb67 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82025) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 20:10:15.564198 dv-cinder-828806-6-smb devstack@keystone.service[82025]: [pid: 82025|app: 0|req: 1459/2858] 10.222.0.33 () {58 vars in 958 bytes} [Tue Sep 13 20:10:15 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 20:10:15.577537 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98236d8b-5d0f-46e0-ad03-2df115805efb admin admin] Authenticating user token {{(pid=82026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 20:10:15.579317 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.common.fernet_utils [None req-98236d8b-5d0f-46e0-ad03-2df115805efb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82026) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 20:10:15.644518 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98236d8b-5d0f-46e0-ad03-2df115805efb admin admin] Validating token access rules against request {{(pid=82026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 20:10:15.648238 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a939f0f4-44dd-445d-94ed-4542aa6e0bc4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '023a2c79c2444611b3d431928e56685d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8c6fba0f15b4d6a84ff601919b7b8e4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 20:10:15.651779 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a939f0f4-44dd-445d-94ed-4542aa6e0bc4 service neutron] REQUEST_METHOD: `GET` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:10:15.651779 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a939f0f4-44dd-445d-94ed-4542aa6e0bc4 service neutron] SCRIPT_NAME: `/identity` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:10:15.651779 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a939f0f4-44dd-445d-94ed-4542aa6e0bc4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:10:15.658189 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a939f0f4-44dd-445d-94ed-4542aa6e0bc4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 20:10:15.659667 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a939f0f4-44dd-445d-94ed-4542aa6e0bc4 service neutron] RBAC: Authorization granted {{(pid=82026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 20:10:15.669274 dv-cinder-828806-6-smb devstack@keystone.service[82026]: [pid: 82026|app: 0|req: 1400/2859] 10.222.0.33 () {60 vars in 1365 bytes} [Tue Sep 13 20:10:15 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 20:10:17.646412 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-983d639a-18ee-4e5b-ac87-f09664a71a46 None None] REQUEST_METHOD: `POST` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:10:17.648005 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-983d639a-18ee-4e5b-ac87-f09664a71a46 None None] SCRIPT_NAME: `/identity` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:10:17.648005 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-983d639a-18ee-4e5b-ac87-f09664a71a46 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:10:17.671910 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG dbcounter [-] [82025] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=82025) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 20:10:17.680266 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.auth.core [None req-983d639a-18ee-4e5b-ac87-f09664a71a46 None None] MFA Rules not processed for user `42b29d1badfe4200910ff0fb48d63dcd`. Rule list: `[]` (Enabled: `True`). {{(pid=82025) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 20:10:17.681615 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.fernet_utils [None req-983d639a-18ee-4e5b-ac87-f09664a71a46 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82025) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 20:10:17.760390 dv-cinder-828806-6-smb devstack@keystone.service[82025]: [pid: 82025|app: 0|req: 1460/2860] 10.222.0.33 () {58 vars in 958 bytes} [Tue Sep 13 20:10:17 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 20:10:17.764452 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a939f0f4-44dd-445d-94ed-4542aa6e0bc4 service neutron] Authenticating user token {{(pid=82026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 20:10:17.776105 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a939f0f4-44dd-445d-94ed-4542aa6e0bc4 service neutron] Validating token access rules against request {{(pid=82026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 20:10:17.781807 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3ff2154-4e7d-464a-9a22-1cc43fe68a89 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57539b6a6f3b4d589f5f5e1d211cd6a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b454f707d20347ada3d82aa85495635e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 20:10:17.782417 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3ff2154-4e7d-464a-9a22-1cc43fe68a89 admin admin] REQUEST_METHOD: `POST` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:10:17.782761 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3ff2154-4e7d-464a-9a22-1cc43fe68a89 admin admin] SCRIPT_NAME: `/identity` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:10:17.783068 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3ff2154-4e7d-464a-9a22-1cc43fe68a89 admin admin] PATH_INFO: `/v3/projects` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:10:17.783711 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3ff2154-4e7d-464a-9a22-1cc43fe68a89 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 20:10:17.786361 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3ff2154-4e7d-464a-9a22-1cc43fe68a89 admin admin] RBAC: Authorization granted {{(pid=82026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 20:10:17.995972 dv-cinder-828806-6-smb devstack@keystone.service[82026]: [pid: 82026|app: 0|req: 1401/2861] 10.222.0.33 () {60 vars in 1153 bytes} [Tue Sep 13 20:10:17 2022] POST /identity/v3/projects => generated 369 bytes in 222 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 13 20:10:17.996218 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-983d639a-18ee-4e5b-ac87-f09664a71a46 None None] Authenticating user token {{(pid=82025) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 20:10:18.002430 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-983d639a-18ee-4e5b-ac87-f09664a71a46 None None] Validating token access rules against request {{(pid=82025) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 20:10:18.066807 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5f2aa4e-bf4e-470b-8f93-3321081a2ca5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57539b6a6f3b4d589f5f5e1d211cd6a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b454f707d20347ada3d82aa85495635e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82025) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 20:10:18.068187 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5f2aa4e-bf4e-470b-8f93-3321081a2ca5 admin admin] REQUEST_METHOD: `POST` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:10:18.068685 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5f2aa4e-bf4e-470b-8f93-3321081a2ca5 admin admin] SCRIPT_NAME: `/identity` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:10:18.069501 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5f2aa4e-bf4e-470b-8f93-3321081a2ca5 admin admin] PATH_INFO: `/v3/users` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:10:18.069857 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5f2aa4e-bf4e-470b-8f93-3321081a2ca5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 20:10:18.072061 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5f2aa4e-bf4e-470b-8f93-3321081a2ca5 admin admin] RBAC: Authorization granted {{(pid=82025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 20:10:18.381189 dv-cinder-828806-6-smb devstack@keystone.service[82025]: [pid: 82025|app: 0|req: 1461/2862] 10.222.0.33 () {60 vars in 1144 bytes} [Tue Sep 13 20:10:17 2022] POST /identity/v3/users => generated 291 bytes in 392 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 13 20:10:18.385309 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3ff2154-4e7d-464a-9a22-1cc43fe68a89 admin admin] Authenticating user token {{(pid=82026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 20:10:18.396565 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3ff2154-4e7d-464a-9a22-1cc43fe68a89 admin admin] Validating token access rules against request {{(pid=82026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 20:10:18.401474 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d79253eb-a9ff-431b-bfae-9b890929cc7e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57539b6a6f3b4d589f5f5e1d211cd6a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b454f707d20347ada3d82aa85495635e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 20:10:18.402137 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d79253eb-a9ff-431b-bfae-9b890929cc7e admin admin] REQUEST_METHOD: `GET` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:10:18.402426 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d79253eb-a9ff-431b-bfae-9b890929cc7e admin admin] SCRIPT_NAME: `/identity` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:10:18.402709 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d79253eb-a9ff-431b-bfae-9b890929cc7e admin admin] PATH_INFO: `/v3/roles` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:10:18.403409 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d79253eb-a9ff-431b-bfae-9b890929cc7e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 20:10:18.405024 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d79253eb-a9ff-431b-bfae-9b890929cc7e admin admin] RBAC: Authorization granted {{(pid=82026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 20:10:18.416552 dv-cinder-828806-6-smb devstack@keystone.service[82026]: [pid: 82026|app: 0|req: 1402/2863] 10.222.0.33 () {58 vars in 1122 bytes} [Tue Sep 13 20:10:18 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 13 20:10:18.420911 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5f2aa4e-bf4e-470b-8f93-3321081a2ca5 admin admin] Authenticating user token {{(pid=82025) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 20:10:18.431095 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5f2aa4e-bf4e-470b-8f93-3321081a2ca5 admin admin] Validating token access rules against request {{(pid=82025) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 20:10:18.435968 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-add8575d-2fb6-4aa0-857c-2a2d3c524844 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57539b6a6f3b4d589f5f5e1d211cd6a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b454f707d20347ada3d82aa85495635e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82025) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 20:10:18.442680 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-add8575d-2fb6-4aa0-857c-2a2d3c524844 admin admin] REQUEST_METHOD: `PUT` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:10:18.442680 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-add8575d-2fb6-4aa0-857c-2a2d3c524844 admin admin] SCRIPT_NAME: `/identity` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:10:18.442680 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-add8575d-2fb6-4aa0-857c-2a2d3c524844 admin admin] PATH_INFO: `/v3/projects/4110aafeb3d544039ada9c1c742dd5c4/users/175efa6933cd4ac7a91fe0a2dd2f7822/roles/e5af7d5baa93469e9e486ef21c85474e` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:10:18.452038 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-add8575d-2fb6-4aa0-857c-2a2d3c524844 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4110aafeb3d544039ada9c1c742dd5c4, user_id=175efa6933cd4ac7a91fe0a2dd2f7822, role_id=e5af7d5baa93469e9e486ef21c85474e)` {{(pid=82025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 20:10:18.454691 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-add8575d-2fb6-4aa0-857c-2a2d3c524844 admin admin] RBAC: Authorization granted {{(pid=82025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 20:10:18.521553 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d79253eb-a9ff-431b-bfae-9b890929cc7e admin admin] Authenticating user token {{(pid=82026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 20:10:18.524152 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.common.fernet_utils [None req-d79253eb-a9ff-431b-bfae-9b890929cc7e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82026) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 20:10:18.560096 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG dbcounter [-] [82026] Writing DB stats keystone:SELECT=92,keystone:DELETE=4,keystone:INSERT=4 {{(pid=82026) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 20:10:18.605744 dv-cinder-828806-6-smb devstack@keystone.service[82025]: [pid: 82025|app: 0|req: 1462/2864] 10.222.0.33 () {60 vars in 1483 bytes} [Tue Sep 13 20:10:18 2022] PUT /identity/v3/projects/4110aafeb3d544039ada9c1c742dd5c4/users/175efa6933cd4ac7a91fe0a2dd2f7822/roles/e5af7d5baa93469e9e486ef21c85474e => generated 0 bytes in 185 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 20:10:18.608790 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d79253eb-a9ff-431b-bfae-9b890929cc7e admin admin] Validating token access rules against request {{(pid=82026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 20:10:18.609699 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-add8575d-2fb6-4aa0-857c-2a2d3c524844 admin admin] Authenticating user token {{(pid=82025) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 20:10:18.678077 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2800f31-4ca0-42d3-bd65-0bae66576782 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '023a2c79c2444611b3d431928e56685d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8c6fba0f15b4d6a84ff601919b7b8e4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 20:10:18.679004 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2800f31-4ca0-42d3-bd65-0bae66576782 service neutron] REQUEST_METHOD: `GET` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:10:18.679426 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2800f31-4ca0-42d3-bd65-0bae66576782 service neutron] SCRIPT_NAME: `/identity` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:10:18.679983 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2800f31-4ca0-42d3-bd65-0bae66576782 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:10:18.682776 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.common.fernet_utils [None req-e2800f31-4ca0-42d3-bd65-0bae66576782 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82026) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 20:10:18.691876 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-add8575d-2fb6-4aa0-857c-2a2d3c524844 admin admin] Validating token access rules against request {{(pid=82025) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 20:10:18.697049 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffd80512-fa64-4833-8af2-f5192cbb9a49 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57539b6a6f3b4d589f5f5e1d211cd6a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b454f707d20347ada3d82aa85495635e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82025) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 20:10:18.697739 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffd80512-fa64-4833-8af2-f5192cbb9a49 admin admin] REQUEST_METHOD: `GET` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:10:18.698021 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffd80512-fa64-4833-8af2-f5192cbb9a49 admin admin] SCRIPT_NAME: `/identity` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:10:18.698539 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffd80512-fa64-4833-8af2-f5192cbb9a49 admin admin] PATH_INFO: `/v3/roles` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:10:18.699324 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffd80512-fa64-4833-8af2-f5192cbb9a49 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 20:10:18.700945 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffd80512-fa64-4833-8af2-f5192cbb9a49 admin admin] RBAC: Authorization granted {{(pid=82025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 20:10:18.714323 dv-cinder-828806-6-smb devstack@keystone.service[82025]: [pid: 82025|app: 0|req: 1463/2865] 10.222.0.33 () {58 vars in 1122 bytes} [Tue Sep 13 20:10:18 2022] GET /identity/v3/roles => generated 1420 bytes in 105 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 13 20:10:18.719192 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffd80512-fa64-4833-8af2-f5192cbb9a49 admin admin] Authenticating user token {{(pid=82025) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 20:10:18.725437 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG dbcounter [-] [82025] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=82025) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 20:10:18.731553 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffd80512-fa64-4833-8af2-f5192cbb9a49 admin admin] Validating token access rules against request {{(pid=82025) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 20:10:18.736551 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d341c29-3498-4625-83a6-0964d3af3dc3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57539b6a6f3b4d589f5f5e1d211cd6a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b454f707d20347ada3d82aa85495635e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82025) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 20:10:18.737220 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d341c29-3498-4625-83a6-0964d3af3dc3 admin admin] REQUEST_METHOD: `PUT` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:10:18.737506 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d341c29-3498-4625-83a6-0964d3af3dc3 admin admin] SCRIPT_NAME: `/identity` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:10:18.737785 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d341c29-3498-4625-83a6-0964d3af3dc3 admin admin] PATH_INFO: `/v3/projects/4110aafeb3d544039ada9c1c742dd5c4/users/175efa6933cd4ac7a91fe0a2dd2f7822/roles/e5af7d5baa93469e9e486ef21c85474e` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:10:18.739907 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d341c29-3498-4625-83a6-0964d3af3dc3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4110aafeb3d544039ada9c1c742dd5c4, user_id=175efa6933cd4ac7a91fe0a2dd2f7822, role_id=e5af7d5baa93469e9e486ef21c85474e)` {{(pid=82025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 20:10:18.742547 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d341c29-3498-4625-83a6-0964d3af3dc3 admin admin] RBAC: Authorization granted {{(pid=82025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 20:10:18.753397 dv-cinder-828806-6-smb devstack@keystone.service[82025]: [pid: 82025|app: 0|req: 1464/2866] 10.222.0.33 () {60 vars in 1483 bytes} [Tue Sep 13 20:10:18 2022] PUT /identity/v3/projects/4110aafeb3d544039ada9c1c742dd5c4/users/175efa6933cd4ac7a91fe0a2dd2f7822/roles/e5af7d5baa93469e9e486ef21c85474e => generated 0 bytes in 35 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 20:10:18.769424 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2800f31-4ca0-42d3-bd65-0bae66576782 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 20:10:18.776772 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2800f31-4ca0-42d3-bd65-0bae66576782 service neutron] RBAC: Authorization granted {{(pid=82026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 20:10:18.787374 dv-cinder-828806-6-smb devstack@keystone.service[82026]: [pid: 82026|app: 0|req: 1403/2867] 10.222.0.33 () {60 vars in 1365 bytes} [Tue Sep 13 20:10:18 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 267 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 13 20:10:18.835551 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d341c29-3498-4625-83a6-0964d3af3dc3 admin admin] Authenticating user token {{(pid=82025) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 20:10:18.902936 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d341c29-3498-4625-83a6-0964d3af3dc3 admin admin] Validating token access rules against request {{(pid=82025) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 20:10:18.907529 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a62700b-ce96-4a37-8d5f-29c4d8dd544d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '023a2c79c2444611b3d431928e56685d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8c6fba0f15b4d6a84ff601919b7b8e4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82025) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 20:10:18.908902 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a62700b-ce96-4a37-8d5f-29c4d8dd544d service neutron] REQUEST_METHOD: `GET` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:10:18.909218 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a62700b-ce96-4a37-8d5f-29c4d8dd544d service neutron] SCRIPT_NAME: `/identity` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:10:18.909576 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a62700b-ce96-4a37-8d5f-29c4d8dd544d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:10:18.911913 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.fernet_utils [None req-2a62700b-ce96-4a37-8d5f-29c4d8dd544d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82025) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 20:10:18.999390 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a62700b-ce96-4a37-8d5f-29c4d8dd544d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 20:10:19.000851 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a62700b-ce96-4a37-8d5f-29c4d8dd544d service neutron] RBAC: Authorization granted {{(pid=82025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 20:10:19.011292 dv-cinder-828806-6-smb devstack@keystone.service[82025]: [pid: 82025|app: 0|req: 1465/2868] 10.222.0.33 () {60 vars in 1365 bytes} [Tue Sep 13 20:10:18 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 176 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 20:10:19.994138 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2800f31-4ca0-42d3-bd65-0bae66576782 service neutron] Authenticating user token {{(pid=82026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 20:10:20.003404 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2800f31-4ca0-42d3-bd65-0bae66576782 service neutron] Validating token access rules against request {{(pid=82026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 20:10:20.007939 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-510d70d2-51a4-4bef-9480-8518e2373911 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '023a2c79c2444611b3d431928e56685d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8c6fba0f15b4d6a84ff601919b7b8e4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 20:10:20.008664 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-510d70d2-51a4-4bef-9480-8518e2373911 service neutron] REQUEST_METHOD: `GET` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:10:20.009050 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-510d70d2-51a4-4bef-9480-8518e2373911 service neutron] SCRIPT_NAME: `/identity` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:10:20.009426 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-510d70d2-51a4-4bef-9480-8518e2373911 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:10:20.011379 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.common.fernet_utils [None req-510d70d2-51a4-4bef-9480-8518e2373911 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82026) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 20:10:20.128249 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a62700b-ce96-4a37-8d5f-29c4d8dd544d service neutron] Authenticating user token {{(pid=82025) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 20:10:20.129853 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.fernet_utils [None req-2a62700b-ce96-4a37-8d5f-29c4d8dd544d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82025) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 20:10:20.154162 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-510d70d2-51a4-4bef-9480-8518e2373911 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 20:10:20.156640 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-510d70d2-51a4-4bef-9480-8518e2373911 service neutron] RBAC: Authorization granted {{(pid=82026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 20:10:20.170906 dv-cinder-828806-6-smb devstack@keystone.service[82026]: [pid: 82026|app: 0|req: 1404/2869] 10.222.0.33 () {60 vars in 1365 bytes} [Tue Sep 13 20:10:19 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 177 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 20:10:20.220058 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a62700b-ce96-4a37-8d5f-29c4d8dd544d service neutron] Validating token access rules against request {{(pid=82025) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 20:10:20.236551 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f07dd53-11f0-4e45-a54d-64293eaf0514 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '060ea3dea2134429967c164bd158b272', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8c6fba0f15b4d6a84ff601919b7b8e4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82025) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 20:10:20.237185 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f07dd53-11f0-4e45-a54d-64293eaf0514 service placement] REQUEST_METHOD: `GET` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:10:20.238022 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f07dd53-11f0-4e45-a54d-64293eaf0514 service placement] SCRIPT_NAME: `/identity` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:10:20.238022 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f07dd53-11f0-4e45-a54d-64293eaf0514 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:10:20.240726 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.fernet_utils [None req-5f07dd53-11f0-4e45-a54d-64293eaf0514 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82025) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 20:10:20.253751 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f07dd53-11f0-4e45-a54d-64293eaf0514 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=82025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 20:10:20.262352 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f07dd53-11f0-4e45-a54d-64293eaf0514 service placement] RBAC: Authorization granted {{(pid=82025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 20:10:20.274112 dv-cinder-828806-6-smb devstack@keystone.service[82025]: [pid: 82025|app: 0|req: 1466/2870] 10.222.0.33 () {60 vars in 1365 bytes} [Tue Sep 13 20:10:20 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 146 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 20:10:20.535696 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c788a380-6b51-4784-aefa-a1dc80b74c4e None None] REQUEST_METHOD: `POST` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:10:20.536126 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c788a380-6b51-4784-aefa-a1dc80b74c4e None None] SCRIPT_NAME: `/identity` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:10:20.536542 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c788a380-6b51-4784-aefa-a1dc80b74c4e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:10:20.556913 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG dbcounter [-] [82026] Writing DB stats keystone:SELECT=100 {{(pid=82026) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 20:10:20.575958 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.auth.core [None req-c788a380-6b51-4784-aefa-a1dc80b74c4e None None] MFA Rules not processed for user `175efa6933cd4ac7a91fe0a2dd2f7822`. Rule list: `[]` (Enabled: `True`). {{(pid=82026) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 20:10:20.577253 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.common.fernet_utils [None req-c788a380-6b51-4784-aefa-a1dc80b74c4e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82026) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 20:10:20.656113 dv-cinder-828806-6-smb devstack@keystone.service[82026]: [pid: 82026|app: 0|req: 1405/2871] 10.222.0.33 () {58 vars in 958 bytes} [Tue Sep 13 20:10:20 2022] POST /identity/v3/auth/tokens => generated 3313 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 20:10:20.666737 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6254cd5-1bd3-427b-877f-97a5b086bc07 None None] REQUEST_METHOD: `POST` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:10:20.667074 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6254cd5-1bd3-427b-877f-97a5b086bc07 None None] SCRIPT_NAME: `/identity` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:10:20.671170 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6254cd5-1bd3-427b-877f-97a5b086bc07 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:10:20.688107 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.auth.core [None req-a6254cd5-1bd3-427b-877f-97a5b086bc07 None None] MFA Rules not processed for user `42b29d1badfe4200910ff0fb48d63dcd`. Rule list: `[]` (Enabled: `True`). {{(pid=82025) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 20:10:20.689421 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.fernet_utils [None req-a6254cd5-1bd3-427b-877f-97a5b086bc07 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82025) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 20:10:20.714217 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG dbcounter [-] [82025] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82025) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 20:10:20.746273 dv-cinder-828806-6-smb devstack@keystone.service[82025]: [pid: 82025|app: 0|req: 1467/2872] 10.222.0.33 () {58 vars in 958 bytes} [Tue Sep 13 20:10:20 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 20:10:20.759757 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c788a380-6b51-4784-aefa-a1dc80b74c4e None None] Authenticating user token {{(pid=82026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 20:10:20.761226 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.common.fernet_utils [None req-c788a380-6b51-4784-aefa-a1dc80b74c4e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82026) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 20:10:20.781423 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c788a380-6b51-4784-aefa-a1dc80b74c4e None None] Validating token access rules against request {{(pid=82026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 20:10:20.788155 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d44a21d-31bb-46ed-b4e5-de39788470f5 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e66e7034abed4e0bad1f4137520c1e70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8c6fba0f15b4d6a84ff601919b7b8e4', 'project_domain_id': 'default', 'roles': ['service', 'member', 'reader', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 20:10:20.788781 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d44a21d-31bb-46ed-b4e5-de39788470f5 service nova] REQUEST_METHOD: `GET` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:10:20.789073 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d44a21d-31bb-46ed-b4e5-de39788470f5 service nova] SCRIPT_NAME: `/identity` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:10:20.789328 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d44a21d-31bb-46ed-b4e5-de39788470f5 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:10:20.798351 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d44a21d-31bb-46ed-b4e5-de39788470f5 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 20:10:20.800044 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d44a21d-31bb-46ed-b4e5-de39788470f5 service nova] RBAC: Authorization granted {{(pid=82026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 20:10:20.811014 dv-cinder-828806-6-smb devstack@keystone.service[82026]: [pid: 82026|app: 0|req: 1406/2873] 10.222.0.33 () {60 vars in 1365 bytes} [Tue Sep 13 20:10:20 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 52 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 20:10:25.031876 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6254cd5-1bd3-427b-877f-97a5b086bc07 None None] Authenticating user token {{(pid=82025) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 20:10:25.036393 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.fernet_utils [None req-a6254cd5-1bd3-427b-877f-97a5b086bc07 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82025) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 20:10:25.053657 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6254cd5-1bd3-427b-877f-97a5b086bc07 None None] Validating token access rules against request {{(pid=82025) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 20:10:25.058485 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-870d4454-fade-4aad-a27e-19d54bc2911e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57539b6a6f3b4d589f5f5e1d211cd6a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b454f707d20347ada3d82aa85495635e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82025) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 20:10:25.059150 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-870d4454-fade-4aad-a27e-19d54bc2911e admin admin] REQUEST_METHOD: `DELETE` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:10:25.059437 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-870d4454-fade-4aad-a27e-19d54bc2911e admin admin] SCRIPT_NAME: `/identity` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:10:25.059718 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-870d4454-fade-4aad-a27e-19d54bc2911e admin admin] PATH_INFO: `/v3/users/aaa8ec56b48a4356bbc8834b92256e24` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:10:25.060847 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-870d4454-fade-4aad-a27e-19d54bc2911e admin admin] RBAC: Authorizing `identity:delete_user(user_id=aaa8ec56b48a4356bbc8834b92256e24)` {{(pid=82025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 20:10:25.062773 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-870d4454-fade-4aad-a27e-19d54bc2911e admin admin] RBAC: Authorization granted {{(pid=82025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 20:10:25.331792 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.notifications [None req-870d4454-fade-4aad-a27e-19d54bc2911e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'aaa8ec56b48a4356bbc8834b92256e24'} {{(pid=82025) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 20:10:25.512505 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.notifications [None req-870d4454-fade-4aad-a27e-19d54bc2911e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'aaa8ec56b48a4356bbc8834b92256e24'} {{(pid=82025) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 20:10:25.513437 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.notifications [None req-870d4454-fade-4aad-a27e-19d54bc2911e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'aaa8ec56b48a4356bbc8834b92256e24'} {{(pid=82025) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 20:10:25.531816 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.notifications [None req-870d4454-fade-4aad-a27e-19d54bc2911e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'aaa8ec56b48a4356bbc8834b92256e24'} {{(pid=82025) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 20:10:25.539312 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.notifications [None req-870d4454-fade-4aad-a27e-19d54bc2911e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'aaa8ec56b48a4356bbc8834b92256e24'} {{(pid=82025) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 20:10:25.548093 dv-cinder-828806-6-smb devstack@keystone.service[82025]: [pid: 82025|app: 0|req: 1468/2874] 10.222.0.33 () {58 vars in 1224 bytes} [Tue Sep 13 20:10:25 2022] DELETE /identity/v3/users/aaa8ec56b48a4356bbc8834b92256e24 => generated 0 bytes in 518 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 20:10:25.893265 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d44a21d-31bb-46ed-b4e5-de39788470f5 service nova] Authenticating user token {{(pid=82026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 20:10:25.920518 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d44a21d-31bb-46ed-b4e5-de39788470f5 service nova] Validating token access rules against request {{(pid=82026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 20:10:26.013678 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67f16a0f-3e84-4cdf-9549-1b488ef647a9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57539b6a6f3b4d589f5f5e1d211cd6a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b454f707d20347ada3d82aa85495635e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 20:10:26.013678 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67f16a0f-3e84-4cdf-9549-1b488ef647a9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:10:26.013678 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67f16a0f-3e84-4cdf-9549-1b488ef647a9 admin admin] SCRIPT_NAME: `/identity` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:10:26.013678 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67f16a0f-3e84-4cdf-9549-1b488ef647a9 admin admin] PATH_INFO: `/v3/projects/d7bb769ba18b46779c79b75a3c150bf0` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:10:26.015451 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67f16a0f-3e84-4cdf-9549-1b488ef647a9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d7bb769ba18b46779c79b75a3c150bf0)` {{(pid=82026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 20:10:26.015451 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67f16a0f-3e84-4cdf-9549-1b488ef647a9 admin admin] RBAC: Authorization granted {{(pid=82026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 20:10:26.295775 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.notifications [None req-67f16a0f-3e84-4cdf-9549-1b488ef647a9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd7bb769ba18b46779c79b75a3c150bf0', 'request_id': 'req-67f16a0f-3e84-4cdf-9549-1b488ef647a9'} {{(pid=82026) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 20:10:26.437611 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.notifications [None req-67f16a0f-3e84-4cdf-9549-1b488ef647a9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd7bb769ba18b46779c79b75a3c150bf0', 'request_id': 'req-67f16a0f-3e84-4cdf-9549-1b488ef647a9'} {{(pid=82026) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 20:10:26.444511 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.notifications [None req-67f16a0f-3e84-4cdf-9549-1b488ef647a9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd7bb769ba18b46779c79b75a3c150bf0', 'request_id': 'req-67f16a0f-3e84-4cdf-9549-1b488ef647a9'} {{(pid=82026) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 20:10:26.456802 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.notifications [None req-67f16a0f-3e84-4cdf-9549-1b488ef647a9 admin admin] The token cache is being invalidate because project d7bb769ba18b46779c79b75a3c150bf0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82026) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 13 20:10:26.457098 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.notifications [None req-67f16a0f-3e84-4cdf-9549-1b488ef647a9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82026) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 20:10:26.458916 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.notifications [None req-67f16a0f-3e84-4cdf-9549-1b488ef647a9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82026) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 20:10:26.460552 dv-cinder-828806-6-smb devstack@keystone.service[82026]: [pid: 82026|app: 0|req: 1407/2875] 10.222.0.33 () {58 vars in 1233 bytes} [Tue Sep 13 20:10:25 2022] DELETE /identity/v3/projects/d7bb769ba18b46779c79b75a3c150bf0 => generated 0 bytes in 570 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 20:10:26.464586 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-870d4454-fade-4aad-a27e-19d54bc2911e admin admin] Authenticating user token {{(pid=82025) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 20:10:26.466029 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.fernet_utils [None req-870d4454-fade-4aad-a27e-19d54bc2911e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82025) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 20:10:26.480759 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-870d4454-fade-4aad-a27e-19d54bc2911e admin admin] Validating token access rules against request {{(pid=82025) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 20:10:26.539731 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bf3e736-47c6-44ac-9877-6994f4b7b653 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57539b6a6f3b4d589f5f5e1d211cd6a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b454f707d20347ada3d82aa85495635e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82025) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 20:10:26.540360 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bf3e736-47c6-44ac-9877-6994f4b7b653 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:10:26.540645 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bf3e736-47c6-44ac-9877-6994f4b7b653 admin admin] SCRIPT_NAME: `/identity` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:10:26.540952 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bf3e736-47c6-44ac-9877-6994f4b7b653 admin admin] PATH_INFO: `/v3/users/4f06afc3f96b41cf86f6feed34d9a9b0` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:10:26.542087 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bf3e736-47c6-44ac-9877-6994f4b7b653 admin admin] RBAC: Authorizing `identity:delete_user(user_id=4f06afc3f96b41cf86f6feed34d9a9b0)` {{(pid=82025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 20:10:26.544100 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bf3e736-47c6-44ac-9877-6994f4b7b653 admin admin] RBAC: Authorization granted {{(pid=82025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 20:10:26.845276 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.notifications [None req-7bf3e736-47c6-44ac-9877-6994f4b7b653 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4f06afc3f96b41cf86f6feed34d9a9b0'} {{(pid=82025) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 20:10:26.847121 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG dbcounter [-] [82025] Writing DB stats keystone:SELECT=82,keystone:DELETE=17,keystone:INSERT=1 {{(pid=82025) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 20:10:26.941590 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.notifications [None req-7bf3e736-47c6-44ac-9877-6994f4b7b653 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4f06afc3f96b41cf86f6feed34d9a9b0'} {{(pid=82025) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 20:10:26.943022 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.notifications [None req-7bf3e736-47c6-44ac-9877-6994f4b7b653 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4f06afc3f96b41cf86f6feed34d9a9b0'} {{(pid=82025) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 20:10:26.960408 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.notifications [None req-7bf3e736-47c6-44ac-9877-6994f4b7b653 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4f06afc3f96b41cf86f6feed34d9a9b0'} {{(pid=82025) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 20:10:26.966032 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.notifications [None req-7bf3e736-47c6-44ac-9877-6994f4b7b653 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4f06afc3f96b41cf86f6feed34d9a9b0'} {{(pid=82025) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 20:10:26.971940 dv-cinder-828806-6-smb devstack@keystone.service[82025]: [pid: 82025|app: 0|req: 1469/2876] 10.222.0.33 () {58 vars in 1224 bytes} [Tue Sep 13 20:10:26 2022] DELETE /identity/v3/users/4f06afc3f96b41cf86f6feed34d9a9b0 => generated 0 bytes in 508 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 20:10:27.376620 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67f16a0f-3e84-4cdf-9549-1b488ef647a9 admin admin] Authenticating user token {{(pid=82026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 20:10:27.378083 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.common.fernet_utils [None req-67f16a0f-3e84-4cdf-9549-1b488ef647a9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82026) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 20:10:27.390861 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67f16a0f-3e84-4cdf-9549-1b488ef647a9 admin admin] Validating token access rules against request {{(pid=82026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 20:10:27.401672 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG dbcounter [-] [82026] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=82026) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 20:10:27.466634 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-681e9bc3-0b4c-4b07-aac4-c47eb7fa3538 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57539b6a6f3b4d589f5f5e1d211cd6a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b454f707d20347ada3d82aa85495635e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 20:10:27.467327 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-681e9bc3-0b4c-4b07-aac4-c47eb7fa3538 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:10:27.467613 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-681e9bc3-0b4c-4b07-aac4-c47eb7fa3538 admin admin] SCRIPT_NAME: `/identity` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:10:27.467892 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-681e9bc3-0b4c-4b07-aac4-c47eb7fa3538 admin admin] PATH_INFO: `/v3/projects/7ad1d897260e405a9635348a0efdd784` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:10:27.469276 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-681e9bc3-0b4c-4b07-aac4-c47eb7fa3538 admin admin] RBAC: Authorizing `identity:delete_project(project_id=7ad1d897260e405a9635348a0efdd784)` {{(pid=82026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 20:10:27.471566 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-681e9bc3-0b4c-4b07-aac4-c47eb7fa3538 admin admin] RBAC: Authorization granted {{(pid=82026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 20:10:27.634269 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.notifications [None req-681e9bc3-0b4c-4b07-aac4-c47eb7fa3538 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7ad1d897260e405a9635348a0efdd784', 'request_id': 'req-681e9bc3-0b4c-4b07-aac4-c47eb7fa3538'} {{(pid=82026) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 20:10:27.724036 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.notifications [None req-681e9bc3-0b4c-4b07-aac4-c47eb7fa3538 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7ad1d897260e405a9635348a0efdd784', 'request_id': 'req-681e9bc3-0b4c-4b07-aac4-c47eb7fa3538'} {{(pid=82026) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 20:10:27.730787 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.notifications [None req-681e9bc3-0b4c-4b07-aac4-c47eb7fa3538 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7ad1d897260e405a9635348a0efdd784', 'request_id': 'req-681e9bc3-0b4c-4b07-aac4-c47eb7fa3538'} {{(pid=82026) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 20:10:27.743414 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.notifications [None req-681e9bc3-0b4c-4b07-aac4-c47eb7fa3538 admin admin] The token cache is being invalidate because project 7ad1d897260e405a9635348a0efdd784 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82026) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 13 20:10:27.743710 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.notifications [None req-681e9bc3-0b4c-4b07-aac4-c47eb7fa3538 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82026) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 20:10:27.744393 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.notifications [None req-681e9bc3-0b4c-4b07-aac4-c47eb7fa3538 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82026) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 20:10:27.745893 dv-cinder-828806-6-smb devstack@keystone.service[82026]: [pid: 82026|app: 0|req: 1408/2877] 10.222.0.33 () {58 vars in 1233 bytes} [Tue Sep 13 20:10:27 2022] DELETE /identity/v3/projects/7ad1d897260e405a9635348a0efdd784 => generated 0 bytes in 370 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 20:10:38.962878 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG dbcounter [-] [82025] Writing DB stats keystone:INSERT=1,keystone:DELETE=3,keystone:SELECT=12 {{(pid=82025) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 20:10:39.220561 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG dbcounter [-] [82026] Writing DB stats keystone:SELECT=47,keystone:DELETE=7,keystone:INSERT=1 {{(pid=82026) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 20:10:39.267450 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bf3e736-47c6-44ac-9877-6994f4b7b653 admin admin] Authenticating user token {{(pid=82025) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 20:10:39.268886 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.fernet_utils [None req-7bf3e736-47c6-44ac-9877-6994f4b7b653 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82025) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 20:10:39.331422 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bf3e736-47c6-44ac-9877-6994f4b7b653 admin admin] Validating token access rules against request {{(pid=82025) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 20:10:39.380344 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77767780-bf1d-4a97-b27e-f40db7d61712 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46024fc6167f4321818b1bed27a521a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8c6fba0f15b4d6a84ff601919b7b8e4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82025) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 20:10:39.380946 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77767780-bf1d-4a97-b27e-f40db7d61712 service cinder] REQUEST_METHOD: `GET` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:10:39.381210 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77767780-bf1d-4a97-b27e-f40db7d61712 service cinder] SCRIPT_NAME: `/identity` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:10:39.381486 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77767780-bf1d-4a97-b27e-f40db7d61712 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:10:39.383225 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.fernet_utils [None req-77767780-bf1d-4a97-b27e-f40db7d61712 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82025) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 20:10:39.453414 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77767780-bf1d-4a97-b27e-f40db7d61712 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=82025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 20:10:39.454884 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77767780-bf1d-4a97-b27e-f40db7d61712 service cinder] RBAC: Authorization granted {{(pid=82025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 20:10:39.464769 dv-cinder-828806-6-smb devstack@keystone.service[82025]: [pid: 82025|app: 0|req: 1470/2878] 10.222.0.33 () {60 vars in 1365 bytes} [Tue Sep 13 20:10:39 2022] GET /identity/v3/auth/tokens => generated 3313 bytes in 198 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 20:10:47.342650 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-681e9bc3-0b4c-4b07-aac4-c47eb7fa3538 admin admin] Authenticating user token {{(pid=82026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 20:10:47.345100 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.common.fernet_utils [None req-681e9bc3-0b4c-4b07-aac4-c47eb7fa3538 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82026) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 20:10:47.410614 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-681e9bc3-0b4c-4b07-aac4-c47eb7fa3538 admin admin] Validating token access rules against request {{(pid=82026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 20:10:47.415229 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9ffb5c1-f01e-4e8f-bfe7-00a6cfeaf19b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57539b6a6f3b4d589f5f5e1d211cd6a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b454f707d20347ada3d82aa85495635e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 20:10:47.415846 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9ffb5c1-f01e-4e8f-bfe7-00a6cfeaf19b admin admin] REQUEST_METHOD: `DELETE` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:10:47.416137 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9ffb5c1-f01e-4e8f-bfe7-00a6cfeaf19b admin admin] SCRIPT_NAME: `/identity` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:10:47.416403 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9ffb5c1-f01e-4e8f-bfe7-00a6cfeaf19b admin admin] PATH_INFO: `/v3/users/f665d658f56e4d569ee87443946cc906` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:10:47.417825 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9ffb5c1-f01e-4e8f-bfe7-00a6cfeaf19b admin admin] RBAC: Authorizing `identity:delete_user(user_id=f665d658f56e4d569ee87443946cc906)` {{(pid=82026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 20:10:47.419781 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9ffb5c1-f01e-4e8f-bfe7-00a6cfeaf19b admin admin] RBAC: Authorization granted {{(pid=82026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 20:10:47.622756 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.notifications [None req-e9ffb5c1-f01e-4e8f-bfe7-00a6cfeaf19b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f665d658f56e4d569ee87443946cc906'} {{(pid=82026) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 20:10:47.700267 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.notifications [None req-e9ffb5c1-f01e-4e8f-bfe7-00a6cfeaf19b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f665d658f56e4d569ee87443946cc906'} {{(pid=82026) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 20:10:47.714415 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.notifications [None req-e9ffb5c1-f01e-4e8f-bfe7-00a6cfeaf19b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f665d658f56e4d569ee87443946cc906'} {{(pid=82026) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 20:10:47.715463 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.notifications [None req-e9ffb5c1-f01e-4e8f-bfe7-00a6cfeaf19b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f665d658f56e4d569ee87443946cc906'} {{(pid=82026) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 20:10:47.723133 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.notifications [None req-e9ffb5c1-f01e-4e8f-bfe7-00a6cfeaf19b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f665d658f56e4d569ee87443946cc906'} {{(pid=82026) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 20:10:47.733261 dv-cinder-828806-6-smb devstack@keystone.service[82026]: [pid: 82026|app: 0|req: 1409/2879] 10.222.0.33 () {58 vars in 1224 bytes} [Tue Sep 13 20:10:47 2022] DELETE /identity/v3/users/f665d658f56e4d569ee87443946cc906 => generated 0 bytes in 392 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 20:10:47.982995 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77767780-bf1d-4a97-b27e-f40db7d61712 service cinder] Authenticating user token {{(pid=82025) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 20:10:47.995585 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77767780-bf1d-4a97-b27e-f40db7d61712 service cinder] Validating token access rules against request {{(pid=82025) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 20:10:48.054449 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42e73180-4d25-49e5-82dc-cec8bda43359 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57539b6a6f3b4d589f5f5e1d211cd6a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b454f707d20347ada3d82aa85495635e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82025) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 20:10:48.055122 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42e73180-4d25-49e5-82dc-cec8bda43359 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:10:48.055414 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42e73180-4d25-49e5-82dc-cec8bda43359 admin admin] SCRIPT_NAME: `/identity` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:10:48.055699 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42e73180-4d25-49e5-82dc-cec8bda43359 admin admin] PATH_INFO: `/v3/projects/30ba66a0b70145dfaf9922eceff30288` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:10:48.057713 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42e73180-4d25-49e5-82dc-cec8bda43359 admin admin] RBAC: Authorizing `identity:delete_project(project_id=30ba66a0b70145dfaf9922eceff30288)` {{(pid=82025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 20:10:48.059642 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42e73180-4d25-49e5-82dc-cec8bda43359 admin admin] RBAC: Authorization granted {{(pid=82025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 20:10:48.077366 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG dbcounter [-] [82025] Writing DB stats keystone:SELECT=100 {{(pid=82025) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 20:10:48.199127 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.notifications [None req-42e73180-4d25-49e5-82dc-cec8bda43359 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '30ba66a0b70145dfaf9922eceff30288', 'request_id': 'req-42e73180-4d25-49e5-82dc-cec8bda43359'} {{(pid=82025) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 20:10:48.205046 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.notifications [None req-42e73180-4d25-49e5-82dc-cec8bda43359 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '30ba66a0b70145dfaf9922eceff30288', 'request_id': 'req-42e73180-4d25-49e5-82dc-cec8bda43359'} {{(pid=82025) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 20:10:48.211399 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.notifications [None req-42e73180-4d25-49e5-82dc-cec8bda43359 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '30ba66a0b70145dfaf9922eceff30288', 'request_id': 'req-42e73180-4d25-49e5-82dc-cec8bda43359'} {{(pid=82025) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 20:10:48.358129 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.notifications [None req-42e73180-4d25-49e5-82dc-cec8bda43359 admin admin] The token cache is being invalidate because project 30ba66a0b70145dfaf9922eceff30288 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82025) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 13 20:10:48.358487 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.notifications [None req-42e73180-4d25-49e5-82dc-cec8bda43359 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82025) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 20:10:48.363846 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.notifications [None req-42e73180-4d25-49e5-82dc-cec8bda43359 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82025) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 20:10:48.363846 dv-cinder-828806-6-smb devstack@keystone.service[82025]: [pid: 82025|app: 0|req: 1471/2880] 10.222.0.33 () {58 vars in 1233 bytes} [Tue Sep 13 20:10:47 2022] DELETE /identity/v3/projects/30ba66a0b70145dfaf9922eceff30288 => generated 0 bytes in 378 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 20:10:48.367945 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59a7083a-7f89-48cb-bbd6-dc09d56f0aca None None] REQUEST_METHOD: `POST` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:10:48.368434 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59a7083a-7f89-48cb-bbd6-dc09d56f0aca None None] SCRIPT_NAME: `/identity` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:10:48.368651 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59a7083a-7f89-48cb-bbd6-dc09d56f0aca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:10:48.393091 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.auth.core [None req-59a7083a-7f89-48cb-bbd6-dc09d56f0aca None None] MFA Rules not processed for user `57539b6a6f3b4d589f5f5e1d211cd6a0`. Rule list: `[]` (Enabled: `True`). {{(pid=82026) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 20:10:48.397746 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.common.fernet_utils [None req-59a7083a-7f89-48cb-bbd6-dc09d56f0aca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82026) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 20:10:48.469568 dv-cinder-828806-6-smb devstack@keystone.service[82026]: [pid: 82026|app: 0|req: 1410/2881] 10.222.0.33 () {58 vars in 958 bytes} [Tue Sep 13 20:10:48 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 20:10:48.471427 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf95a944-31bb-4ca1-9e79-f992af34d3c6 None None] REQUEST_METHOD: `POST` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:10:48.471723 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf95a944-31bb-4ca1-9e79-f992af34d3c6 None None] SCRIPT_NAME: `/identity` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:10:48.472025 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf95a944-31bb-4ca1-9e79-f992af34d3c6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:10:48.492605 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.auth.core [None req-cf95a944-31bb-4ca1-9e79-f992af34d3c6 None None] MFA Rules not processed for user `57539b6a6f3b4d589f5f5e1d211cd6a0`. Rule list: `[]` (Enabled: `True`). {{(pid=82025) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 20:10:48.493848 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.fernet_utils [None req-cf95a944-31bb-4ca1-9e79-f992af34d3c6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82025) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 20:10:48.501961 dv-cinder-828806-6-smb devstack@keystone.service[82025]: [pid: 82025|app: 0|req: 1472/2882] 10.222.0.33 () {58 vars in 958 bytes} [Tue Sep 13 20:10:48 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 20:10:48.506372 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59a7083a-7f89-48cb-bbd6-dc09d56f0aca None None] Authenticating user token {{(pid=82026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 20:10:48.516640 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59a7083a-7f89-48cb-bbd6-dc09d56f0aca None None] Validating token access rules against request {{(pid=82026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 20:10:48.521323 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1d49a77-8f90-45c7-8fff-5b019ff16c35 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57539b6a6f3b4d589f5f5e1d211cd6a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b454f707d20347ada3d82aa85495635e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 20:10:48.521925 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1d49a77-8f90-45c7-8fff-5b019ff16c35 admin admin] REQUEST_METHOD: `GET` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:10:48.522207 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1d49a77-8f90-45c7-8fff-5b019ff16c35 admin admin] SCRIPT_NAME: `/identity` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:10:48.522480 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1d49a77-8f90-45c7-8fff-5b019ff16c35 admin admin] PATH_INFO: `/v3/domains` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:10:48.523175 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1d49a77-8f90-45c7-8fff-5b019ff16c35 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82026) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 20:10:48.523482 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1d49a77-8f90-45c7-8fff-5b019ff16c35 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 20:10:48.525069 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1d49a77-8f90-45c7-8fff-5b019ff16c35 admin admin] RBAC: Authorization granted {{(pid=82026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 20:10:48.537873 dv-cinder-828806-6-smb devstack@keystone.service[82026]: [pid: 82026|app: 0|req: 1411/2883] 10.222.0.33 () {58 vars in 1153 bytes} [Tue Sep 13 20:10:48 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 20:10:48.543003 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf95a944-31bb-4ca1-9e79-f992af34d3c6 None None] Authenticating user token {{(pid=82025) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 20:10:48.552555 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf95a944-31bb-4ca1-9e79-f992af34d3c6 None None] Validating token access rules against request {{(pid=82025) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 20:10:48.557566 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2b65505-c6ea-4295-a38c-00aaeda0113d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57539b6a6f3b4d589f5f5e1d211cd6a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b454f707d20347ada3d82aa85495635e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82025) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 20:10:48.558172 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2b65505-c6ea-4295-a38c-00aaeda0113d admin admin] REQUEST_METHOD: `POST` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:10:48.558455 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2b65505-c6ea-4295-a38c-00aaeda0113d admin admin] SCRIPT_NAME: `/identity` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:10:48.558740 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2b65505-c6ea-4295-a38c-00aaeda0113d admin admin] PATH_INFO: `/v3/projects` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:10:48.559407 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2b65505-c6ea-4295-a38c-00aaeda0113d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 20:10:48.561369 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2b65505-c6ea-4295-a38c-00aaeda0113d admin admin] RBAC: Authorization granted {{(pid=82025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 20:10:48.666963 dv-cinder-828806-6-smb devstack@keystone.service[82025]: [pid: 82025|app: 0|req: 1473/2884] 10.222.0.33 () {60 vars in 1153 bytes} [Tue Sep 13 20:10:48 2022] POST /identity/v3/projects => generated 391 bytes in 124 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 13 20:10:48.671400 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1d49a77-8f90-45c7-8fff-5b019ff16c35 admin admin] Authenticating user token {{(pid=82026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 20:10:48.682606 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1d49a77-8f90-45c7-8fff-5b019ff16c35 admin admin] Validating token access rules against request {{(pid=82026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 20:10:48.686362 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG dbcounter [-] [82026] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82026) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 20:10:48.739877 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0128aaf2-5334-4cc7-af26-400ce3c9764b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57539b6a6f3b4d589f5f5e1d211cd6a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b454f707d20347ada3d82aa85495635e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 20:10:48.740411 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0128aaf2-5334-4cc7-af26-400ce3c9764b admin admin] REQUEST_METHOD: `POST` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:10:48.740699 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0128aaf2-5334-4cc7-af26-400ce3c9764b admin admin] SCRIPT_NAME: `/identity` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:10:48.740980 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0128aaf2-5334-4cc7-af26-400ce3c9764b admin admin] PATH_INFO: `/v3/users` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:10:48.741612 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0128aaf2-5334-4cc7-af26-400ce3c9764b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 20:10:48.743612 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0128aaf2-5334-4cc7-af26-400ce3c9764b admin admin] RBAC: Authorization granted {{(pid=82026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 20:10:48.820077 dv-cinder-828806-6-smb devstack@keystone.service[82026]: [pid: 82026|app: 0|req: 1412/2885] 10.222.0.33 () {60 vars in 1144 bytes} [Tue Sep 13 20:10:48 2022] POST /identity/v3/users => generated 296 bytes in 149 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 13 20:10:48.824538 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2b65505-c6ea-4295-a38c-00aaeda0113d admin admin] Authenticating user token {{(pid=82025) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 20:10:48.834764 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2b65505-c6ea-4295-a38c-00aaeda0113d admin admin] Validating token access rules against request {{(pid=82025) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 20:10:48.840160 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bf7e294-9835-4dcc-9004-b66dc944c2c9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57539b6a6f3b4d589f5f5e1d211cd6a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b454f707d20347ada3d82aa85495635e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82025) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 20:10:48.840757 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bf7e294-9835-4dcc-9004-b66dc944c2c9 admin admin] REQUEST_METHOD: `GET` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:10:48.841041 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bf7e294-9835-4dcc-9004-b66dc944c2c9 admin admin] SCRIPT_NAME: `/identity` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:10:48.841327 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bf7e294-9835-4dcc-9004-b66dc944c2c9 admin admin] PATH_INFO: `/v3/roles` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:10:48.841962 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bf7e294-9835-4dcc-9004-b66dc944c2c9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 20:10:48.843579 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bf7e294-9835-4dcc-9004-b66dc944c2c9 admin admin] RBAC: Authorization granted {{(pid=82025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 20:10:48.853509 dv-cinder-828806-6-smb devstack@keystone.service[82025]: [pid: 82025|app: 0|req: 1474/2886] 10.222.0.33 () {58 vars in 1122 bytes} [Tue Sep 13 20:10:48 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 13 20:10:48.857503 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0128aaf2-5334-4cc7-af26-400ce3c9764b admin admin] Authenticating user token {{(pid=82026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 20:10:48.867501 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0128aaf2-5334-4cc7-af26-400ce3c9764b admin admin] Validating token access rules against request {{(pid=82026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 20:10:48.872748 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ef6afd2-d5f1-4769-a9db-1288125dfd80 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57539b6a6f3b4d589f5f5e1d211cd6a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b454f707d20347ada3d82aa85495635e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 20:10:48.873345 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ef6afd2-d5f1-4769-a9db-1288125dfd80 admin admin] REQUEST_METHOD: `GET` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:10:48.873632 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ef6afd2-d5f1-4769-a9db-1288125dfd80 admin admin] SCRIPT_NAME: `/identity` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:10:48.873955 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ef6afd2-d5f1-4769-a9db-1288125dfd80 admin admin] PATH_INFO: `/v3/roles` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:10:48.874610 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ef6afd2-d5f1-4769-a9db-1288125dfd80 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 20:10:48.876313 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ef6afd2-d5f1-4769-a9db-1288125dfd80 admin admin] RBAC: Authorization granted {{(pid=82026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 20:10:48.887857 dv-cinder-828806-6-smb devstack@keystone.service[82026]: [pid: 82026|app: 0|req: 1413/2887] 10.222.0.33 () {58 vars in 1122 bytes} [Tue Sep 13 20:10:48 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 13 20:10:48.892767 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bf7e294-9835-4dcc-9004-b66dc944c2c9 admin admin] Authenticating user token {{(pid=82025) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 20:10:48.903663 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bf7e294-9835-4dcc-9004-b66dc944c2c9 admin admin] Validating token access rules against request {{(pid=82025) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 20:10:48.908456 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87663b53-a5de-4727-b4f6-4ff960945143 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57539b6a6f3b4d589f5f5e1d211cd6a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b454f707d20347ada3d82aa85495635e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82025) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 20:10:48.909114 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87663b53-a5de-4727-b4f6-4ff960945143 admin admin] REQUEST_METHOD: `PUT` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:10:48.909408 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87663b53-a5de-4727-b4f6-4ff960945143 admin admin] SCRIPT_NAME: `/identity` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:10:48.909782 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87663b53-a5de-4727-b4f6-4ff960945143 admin admin] PATH_INFO: `/v3/projects/5973b36c0f57488fbee7872cbc5cd9aa/users/d2ca0bda2ef44fcbb6570455ac0a941b/roles/3618ab638a65401f82333da7596d1daf` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:10:48.925597 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87663b53-a5de-4727-b4f6-4ff960945143 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5973b36c0f57488fbee7872cbc5cd9aa, user_id=d2ca0bda2ef44fcbb6570455ac0a941b, role_id=3618ab638a65401f82333da7596d1daf)` {{(pid=82025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 20:10:48.928407 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87663b53-a5de-4727-b4f6-4ff960945143 admin admin] RBAC: Authorization granted {{(pid=82025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 20:10:49.033495 dv-cinder-828806-6-smb devstack@keystone.service[82025]: [pid: 82025|app: 0|req: 1475/2888] 10.222.0.33 () {60 vars in 1483 bytes} [Tue Sep 13 20:10:48 2022] PUT /identity/v3/projects/5973b36c0f57488fbee7872cbc5cd9aa/users/d2ca0bda2ef44fcbb6570455ac0a941b/roles/3618ab638a65401f82333da7596d1daf => generated 0 bytes in 141 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 20:10:49.045611 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b049f594-e723-429d-b0c7-c91dc8a93cbe None None] REQUEST_METHOD: `POST` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:10:49.045905 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b049f594-e723-429d-b0c7-c91dc8a93cbe None None] SCRIPT_NAME: `/identity` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:10:49.046186 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b049f594-e723-429d-b0c7-c91dc8a93cbe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:10:49.076539 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.auth.core [None req-b049f594-e723-429d-b0c7-c91dc8a93cbe None None] MFA Rules not processed for user `d2ca0bda2ef44fcbb6570455ac0a941b`. Rule list: `[]` (Enabled: `True`). {{(pid=82026) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 20:10:49.078748 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.common.fernet_utils [None req-b049f594-e723-429d-b0c7-c91dc8a93cbe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82026) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 20:10:49.140414 dv-cinder-828806-6-smb devstack@keystone.service[82026]: [pid: 82026|app: 0|req: 1414/2889] 10.222.0.33 () {58 vars in 958 bytes} [Tue Sep 13 20:10:49 2022] POST /identity/v3/auth/tokens => generated 3268 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 20:10:49.151697 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87663b53-a5de-4727-b4f6-4ff960945143 admin admin] Authenticating user token {{(pid=82025) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 20:10:49.153531 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.fernet_utils [None req-87663b53-a5de-4727-b4f6-4ff960945143 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82025) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 20:10:49.211886 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87663b53-a5de-4727-b4f6-4ff960945143 admin admin] Validating token access rules against request {{(pid=82025) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 20:10:49.215625 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6286944d-2caa-4c6f-9f03-fab1cd6af83a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46024fc6167f4321818b1bed27a521a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8c6fba0f15b4d6a84ff601919b7b8e4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82025) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 20:10:49.216224 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6286944d-2caa-4c6f-9f03-fab1cd6af83a service cinder] REQUEST_METHOD: `GET` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:10:49.216537 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6286944d-2caa-4c6f-9f03-fab1cd6af83a service cinder] SCRIPT_NAME: `/identity` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:10:49.216814 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6286944d-2caa-4c6f-9f03-fab1cd6af83a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:10:49.225329 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6286944d-2caa-4c6f-9f03-fab1cd6af83a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=82025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 20:10:49.226751 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6286944d-2caa-4c6f-9f03-fab1cd6af83a service cinder] RBAC: Authorization granted {{(pid=82025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 20:10:49.236147 dv-cinder-828806-6-smb devstack@keystone.service[82025]: [pid: 82025|app: 0|req: 1476/2890] 10.222.0.33 () {60 vars in 1365 bytes} [Tue Sep 13 20:10:49 2022] GET /identity/v3/auth/tokens => generated 3268 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 20:10:59.137638 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG dbcounter [-] [82026] Writing DB stats keystone:SELECT=63,keystone:INSERT=3 {{(pid=82026) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 20:10:59.231930 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG dbcounter [-] [82025] Writing DB stats keystone:SELECT=74,keystone:DELETE=7,keystone:INSERT=3 {{(pid=82025) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 20:11:01.451502 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b049f594-e723-429d-b0c7-c91dc8a93cbe None None] Authenticating user token {{(pid=82026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 20:11:01.514745 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b049f594-e723-429d-b0c7-c91dc8a93cbe None None] Validating token access rules against request {{(pid=82026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 20:11:01.519920 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbc386bd-7a66-42ef-a5ad-ff2ba8f63507 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57539b6a6f3b4d589f5f5e1d211cd6a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b454f707d20347ada3d82aa85495635e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 20:11:01.520689 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbc386bd-7a66-42ef-a5ad-ff2ba8f63507 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:11:01.520971 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbc386bd-7a66-42ef-a5ad-ff2ba8f63507 admin admin] SCRIPT_NAME: `/identity` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:11:01.521268 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbc386bd-7a66-42ef-a5ad-ff2ba8f63507 admin admin] PATH_INFO: `/v3/users/d2ca0bda2ef44fcbb6570455ac0a941b` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:11:01.522421 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbc386bd-7a66-42ef-a5ad-ff2ba8f63507 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d2ca0bda2ef44fcbb6570455ac0a941b)` {{(pid=82026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 20:11:01.524470 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbc386bd-7a66-42ef-a5ad-ff2ba8f63507 admin admin] RBAC: Authorization granted {{(pid=82026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 20:11:01.775515 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.notifications [None req-bbc386bd-7a66-42ef-a5ad-ff2ba8f63507 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd2ca0bda2ef44fcbb6570455ac0a941b'} {{(pid=82026) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 20:11:01.905716 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.notifications [None req-bbc386bd-7a66-42ef-a5ad-ff2ba8f63507 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd2ca0bda2ef44fcbb6570455ac0a941b'} {{(pid=82026) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 20:11:01.919698 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.notifications [None req-bbc386bd-7a66-42ef-a5ad-ff2ba8f63507 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd2ca0bda2ef44fcbb6570455ac0a941b'} {{(pid=82026) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 20:11:01.920390 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.notifications [None req-bbc386bd-7a66-42ef-a5ad-ff2ba8f63507 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd2ca0bda2ef44fcbb6570455ac0a941b'} {{(pid=82026) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 20:11:01.927748 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.notifications [None req-bbc386bd-7a66-42ef-a5ad-ff2ba8f63507 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd2ca0bda2ef44fcbb6570455ac0a941b'} {{(pid=82026) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 20:11:01.934715 dv-cinder-828806-6-smb devstack@keystone.service[82026]: [pid: 82026|app: 0|req: 1415/2891] 10.222.0.33 () {58 vars in 1224 bytes} [Tue Sep 13 20:11:01 2022] DELETE /identity/v3/users/d2ca0bda2ef44fcbb6570455ac0a941b => generated 0 bytes in 484 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 20:11:01.939472 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-636f8a09-f5fa-449f-aee5-8cf227d3e704 None None] REQUEST_METHOD: `POST` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:11:01.939939 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-636f8a09-f5fa-449f-aee5-8cf227d3e704 None None] SCRIPT_NAME: `/identity` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:11:01.940246 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-636f8a09-f5fa-449f-aee5-8cf227d3e704 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:11:01.960132 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.auth.core [None req-636f8a09-f5fa-449f-aee5-8cf227d3e704 None None] MFA Rules not processed for user `57539b6a6f3b4d589f5f5e1d211cd6a0`. Rule list: `[]` (Enabled: `True`). {{(pid=82025) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 20:11:01.961387 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.fernet_utils [None req-636f8a09-f5fa-449f-aee5-8cf227d3e704 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82025) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 20:11:02.033373 dv-cinder-828806-6-smb devstack@keystone.service[82025]: [pid: 82025|app: 0|req: 1477/2892] 10.222.0.33 () {58 vars in 958 bytes} [Tue Sep 13 20:11:01 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 20:11:02.040045 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbc386bd-7a66-42ef-a5ad-ff2ba8f63507 admin admin] Authenticating user token {{(pid=82026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 20:11:02.041717 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.common.fernet_utils [None req-bbc386bd-7a66-42ef-a5ad-ff2ba8f63507 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82026) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 20:11:02.099843 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbc386bd-7a66-42ef-a5ad-ff2ba8f63507 admin admin] Validating token access rules against request {{(pid=82026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 20:11:02.104137 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7e2f6b8-2e56-4062-87dc-7a45c4c0c02d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '023a2c79c2444611b3d431928e56685d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8c6fba0f15b4d6a84ff601919b7b8e4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 20:11:02.104756 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7e2f6b8-2e56-4062-87dc-7a45c4c0c02d service neutron] REQUEST_METHOD: `GET` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:11:02.105040 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7e2f6b8-2e56-4062-87dc-7a45c4c0c02d service neutron] SCRIPT_NAME: `/identity` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:11:02.105321 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7e2f6b8-2e56-4062-87dc-7a45c4c0c02d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:11:02.114451 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7e2f6b8-2e56-4062-87dc-7a45c4c0c02d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 20:11:02.115980 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7e2f6b8-2e56-4062-87dc-7a45c4c0c02d service neutron] RBAC: Authorization granted {{(pid=82026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 20:11:02.126290 dv-cinder-828806-6-smb devstack@keystone.service[82026]: [pid: 82026|app: 0|req: 1416/2893] 10.222.0.33 () {60 vars in 1365 bytes} [Tue Sep 13 20:11:02 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 20:11:02.615497 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-636f8a09-f5fa-449f-aee5-8cf227d3e704 None None] Authenticating user token {{(pid=82025) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 20:11:02.616968 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.fernet_utils [None req-636f8a09-f5fa-449f-aee5-8cf227d3e704 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82025) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 20:11:02.629706 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-636f8a09-f5fa-449f-aee5-8cf227d3e704 None None] Validating token access rules against request {{(pid=82025) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 20:11:02.634555 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efa9f9b4-4951-490e-981d-7bee485ed819 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57539b6a6f3b4d589f5f5e1d211cd6a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b454f707d20347ada3d82aa85495635e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82025) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 20:11:02.635532 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efa9f9b4-4951-490e-981d-7bee485ed819 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:11:02.635824 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efa9f9b4-4951-490e-981d-7bee485ed819 admin admin] SCRIPT_NAME: `/identity` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:11:02.636106 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efa9f9b4-4951-490e-981d-7bee485ed819 admin admin] PATH_INFO: `/v3/projects/5973b36c0f57488fbee7872cbc5cd9aa` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:11:02.637283 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efa9f9b4-4951-490e-981d-7bee485ed819 admin admin] RBAC: Authorizing `identity:delete_project(project_id=5973b36c0f57488fbee7872cbc5cd9aa)` {{(pid=82025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 20:11:02.639324 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efa9f9b4-4951-490e-981d-7bee485ed819 admin admin] RBAC: Authorization granted {{(pid=82025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 20:11:02.740299 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.notifications [None req-efa9f9b4-4951-490e-981d-7bee485ed819 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5973b36c0f57488fbee7872cbc5cd9aa', 'request_id': 'req-efa9f9b4-4951-490e-981d-7bee485ed819'} {{(pid=82025) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 20:11:02.746030 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.notifications [None req-efa9f9b4-4951-490e-981d-7bee485ed819 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5973b36c0f57488fbee7872cbc5cd9aa', 'request_id': 'req-efa9f9b4-4951-490e-981d-7bee485ed819'} {{(pid=82025) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 20:11:02.752466 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.notifications [None req-efa9f9b4-4951-490e-981d-7bee485ed819 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5973b36c0f57488fbee7872cbc5cd9aa', 'request_id': 'req-efa9f9b4-4951-490e-981d-7bee485ed819'} {{(pid=82025) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 20:11:02.842455 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.notifications [None req-efa9f9b4-4951-490e-981d-7bee485ed819 admin admin] The token cache is being invalidate because project 5973b36c0f57488fbee7872cbc5cd9aa was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82025) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 13 20:11:02.842743 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.notifications [None req-efa9f9b4-4951-490e-981d-7bee485ed819 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82025) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 20:11:02.843452 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.notifications [None req-efa9f9b4-4951-490e-981d-7bee485ed819 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82025) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 20:11:02.844947 dv-cinder-828806-6-smb devstack@keystone.service[82025]: [pid: 82025|app: 0|req: 1478/2894] 10.222.0.33 () {58 vars in 1233 bytes} [Tue Sep 13 20:11:02 2022] DELETE /identity/v3/projects/5973b36c0f57488fbee7872cbc5cd9aa => generated 0 bytes in 230 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 20:11:04.774274 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7e2f6b8-2e56-4062-87dc-7a45c4c0c02d service neutron] Authenticating user token {{(pid=82026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 20:11:04.776636 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.common.fernet_utils [None req-a7e2f6b8-2e56-4062-87dc-7a45c4c0c02d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82026) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 20:11:04.789608 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7e2f6b8-2e56-4062-87dc-7a45c4c0c02d service neutron] Validating token access rules against request {{(pid=82026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 20:11:04.809119 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG dbcounter [-] [82026] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82026) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 20:11:04.847982 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fa9b385-c894-4d40-b89c-46a5028e1dfc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57539b6a6f3b4d589f5f5e1d211cd6a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b454f707d20347ada3d82aa85495635e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 20:11:04.848598 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fa9b385-c894-4d40-b89c-46a5028e1dfc admin admin] REQUEST_METHOD: `DELETE` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:11:04.848884 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fa9b385-c894-4d40-b89c-46a5028e1dfc admin admin] SCRIPT_NAME: `/identity` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:11:04.849162 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fa9b385-c894-4d40-b89c-46a5028e1dfc admin admin] PATH_INFO: `/v3/users/42b29d1badfe4200910ff0fb48d63dcd` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:11:04.850298 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fa9b385-c894-4d40-b89c-46a5028e1dfc admin admin] RBAC: Authorizing `identity:delete_user(user_id=42b29d1badfe4200910ff0fb48d63dcd)` {{(pid=82026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 20:11:04.852277 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fa9b385-c894-4d40-b89c-46a5028e1dfc admin admin] RBAC: Authorization granted {{(pid=82026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 20:11:05.040178 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.notifications [None req-3fa9b385-c894-4d40-b89c-46a5028e1dfc admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '42b29d1badfe4200910ff0fb48d63dcd'} {{(pid=82026) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 20:11:05.111107 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.notifications [None req-3fa9b385-c894-4d40-b89c-46a5028e1dfc admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '42b29d1badfe4200910ff0fb48d63dcd'} {{(pid=82026) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 20:11:05.127679 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.notifications [None req-3fa9b385-c894-4d40-b89c-46a5028e1dfc admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '42b29d1badfe4200910ff0fb48d63dcd'} {{(pid=82026) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 20:11:05.305269 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.notifications [None req-3fa9b385-c894-4d40-b89c-46a5028e1dfc admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '42b29d1badfe4200910ff0fb48d63dcd'} {{(pid=82026) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 20:11:05.305269 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.notifications [None req-3fa9b385-c894-4d40-b89c-46a5028e1dfc admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '42b29d1badfe4200910ff0fb48d63dcd'} {{(pid=82026) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 20:11:05.305269 dv-cinder-828806-6-smb devstack@keystone.service[82026]: [pid: 82026|app: 0|req: 1417/2895] 10.222.0.33 () {58 vars in 1224 bytes} [Tue Sep 13 20:11:04 2022] DELETE /identity/v3/users/42b29d1badfe4200910ff0fb48d63dcd => generated 0 bytes in 369 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 20:11:05.433864 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efa9f9b4-4951-490e-981d-7bee485ed819 admin admin] Authenticating user token {{(pid=82025) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 20:11:05.435833 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.fernet_utils [None req-efa9f9b4-4951-490e-981d-7bee485ed819 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82025) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 20:11:05.455573 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efa9f9b4-4951-490e-981d-7bee485ed819 admin admin] Validating token access rules against request {{(pid=82025) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 20:11:05.527154 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6adea6f4-1b74-4218-8674-6d384bc410fb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57539b6a6f3b4d589f5f5e1d211cd6a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b454f707d20347ada3d82aa85495635e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82025) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 20:11:05.527787 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6adea6f4-1b74-4218-8674-6d384bc410fb admin admin] REQUEST_METHOD: `DELETE` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:11:05.528068 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6adea6f4-1b74-4218-8674-6d384bc410fb admin admin] SCRIPT_NAME: `/identity` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:11:05.528342 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6adea6f4-1b74-4218-8674-6d384bc410fb admin admin] PATH_INFO: `/v3/projects/e327f0c9e8fd41889d447dd6147df9cf` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:11:05.529462 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6adea6f4-1b74-4218-8674-6d384bc410fb admin admin] RBAC: Authorizing `identity:delete_project(project_id=e327f0c9e8fd41889d447dd6147df9cf)` {{(pid=82025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 20:11:05.531392 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6adea6f4-1b74-4218-8674-6d384bc410fb admin admin] RBAC: Authorization granted {{(pid=82025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 20:11:05.655234 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG dbcounter [-] [82025] Writing DB stats keystone:SELECT=91,keystone:DELETE=8,keystone:INSERT=1 {{(pid=82025) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 20:11:05.676103 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.notifications [None req-6adea6f4-1b74-4218-8674-6d384bc410fb admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e327f0c9e8fd41889d447dd6147df9cf', 'request_id': 'req-6adea6f4-1b74-4218-8674-6d384bc410fb'} {{(pid=82025) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 20:11:05.682831 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.notifications [None req-6adea6f4-1b74-4218-8674-6d384bc410fb admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e327f0c9e8fd41889d447dd6147df9cf', 'request_id': 'req-6adea6f4-1b74-4218-8674-6d384bc410fb'} {{(pid=82025) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 20:11:05.689478 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.notifications [None req-6adea6f4-1b74-4218-8674-6d384bc410fb admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e327f0c9e8fd41889d447dd6147df9cf', 'request_id': 'req-6adea6f4-1b74-4218-8674-6d384bc410fb'} {{(pid=82025) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 20:11:05.808445 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.notifications [None req-6adea6f4-1b74-4218-8674-6d384bc410fb admin admin] The token cache is being invalidate because project e327f0c9e8fd41889d447dd6147df9cf was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82025) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 13 20:11:05.808746 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.notifications [None req-6adea6f4-1b74-4218-8674-6d384bc410fb admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82025) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 20:11:05.809394 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.notifications [None req-6adea6f4-1b74-4218-8674-6d384bc410fb admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82025) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 20:11:05.810906 dv-cinder-828806-6-smb devstack@keystone.service[82025]: [pid: 82025|app: 0|req: 1479/2896] 10.222.0.33 () {58 vars in 1233 bytes} [Tue Sep 13 20:11:05 2022] DELETE /identity/v3/projects/e327f0c9e8fd41889d447dd6147df9cf => generated 0 bytes in 378 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 20:11:05.814962 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fa9b385-c894-4d40-b89c-46a5028e1dfc admin admin] Authenticating user token {{(pid=82026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 20:11:05.816483 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.common.fernet_utils [None req-3fa9b385-c894-4d40-b89c-46a5028e1dfc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82026) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 20:11:05.830349 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fa9b385-c894-4d40-b89c-46a5028e1dfc admin admin] Validating token access rules against request {{(pid=82026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 20:11:05.887817 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c75c907f-40bc-4b78-8c12-2d4f95fb544f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57539b6a6f3b4d589f5f5e1d211cd6a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b454f707d20347ada3d82aa85495635e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 20:11:05.888451 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c75c907f-40bc-4b78-8c12-2d4f95fb544f admin admin] REQUEST_METHOD: `DELETE` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:11:05.888744 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c75c907f-40bc-4b78-8c12-2d4f95fb544f admin admin] SCRIPT_NAME: `/identity` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:11:05.889032 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c75c907f-40bc-4b78-8c12-2d4f95fb544f admin admin] PATH_INFO: `/v3/users/175efa6933cd4ac7a91fe0a2dd2f7822` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:11:05.890178 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c75c907f-40bc-4b78-8c12-2d4f95fb544f admin admin] RBAC: Authorizing `identity:delete_user(user_id=175efa6933cd4ac7a91fe0a2dd2f7822)` {{(pid=82026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 20:11:05.892214 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c75c907f-40bc-4b78-8c12-2d4f95fb544f admin admin] RBAC: Authorization granted {{(pid=82026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 20:11:06.147372 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG dbcounter [-] [82026] Writing DB stats keystone:SELECT=83,keystone:DELETE=16,keystone:INSERT=1 {{(pid=82026) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 20:11:06.150582 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.notifications [None req-c75c907f-40bc-4b78-8c12-2d4f95fb544f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '175efa6933cd4ac7a91fe0a2dd2f7822'} {{(pid=82026) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 20:11:06.334178 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.notifications [None req-c75c907f-40bc-4b78-8c12-2d4f95fb544f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '175efa6933cd4ac7a91fe0a2dd2f7822'} {{(pid=82026) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 20:11:06.347144 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.notifications [None req-c75c907f-40bc-4b78-8c12-2d4f95fb544f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '175efa6933cd4ac7a91fe0a2dd2f7822'} {{(pid=82026) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 20:11:06.347797 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.notifications [None req-c75c907f-40bc-4b78-8c12-2d4f95fb544f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '175efa6933cd4ac7a91fe0a2dd2f7822'} {{(pid=82026) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 20:11:06.354768 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.notifications [None req-c75c907f-40bc-4b78-8c12-2d4f95fb544f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '175efa6933cd4ac7a91fe0a2dd2f7822'} {{(pid=82026) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 20:11:06.361102 dv-cinder-828806-6-smb devstack@keystone.service[82026]: [pid: 82026|app: 0|req: 1418/2897] 10.222.0.33 () {58 vars in 1224 bytes} [Tue Sep 13 20:11:05 2022] DELETE /identity/v3/users/175efa6933cd4ac7a91fe0a2dd2f7822 => generated 0 bytes in 547 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 13 20:11:06.609725 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6adea6f4-1b74-4218-8674-6d384bc410fb admin admin] Authenticating user token {{(pid=82025) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 20:11:06.611206 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.fernet_utils [None req-6adea6f4-1b74-4218-8674-6d384bc410fb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82025) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 20:11:06.631483 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6adea6f4-1b74-4218-8674-6d384bc410fb admin admin] Validating token access rules against request {{(pid=82025) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 20:11:06.686779 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68fec790-8ee4-4029-a6a8-f46244072ef3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57539b6a6f3b4d589f5f5e1d211cd6a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b454f707d20347ada3d82aa85495635e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82025) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 20:11:06.687341 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68fec790-8ee4-4029-a6a8-f46244072ef3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:11:06.687630 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68fec790-8ee4-4029-a6a8-f46244072ef3 admin admin] SCRIPT_NAME: `/identity` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:11:06.687906 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68fec790-8ee4-4029-a6a8-f46244072ef3 admin admin] PATH_INFO: `/v3/projects/4110aafeb3d544039ada9c1c742dd5c4` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:11:06.689043 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68fec790-8ee4-4029-a6a8-f46244072ef3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=4110aafeb3d544039ada9c1c742dd5c4)` {{(pid=82025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 20:11:06.690937 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68fec790-8ee4-4029-a6a8-f46244072ef3 admin admin] RBAC: Authorization granted {{(pid=82025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 20:11:06.791351 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.notifications [None req-68fec790-8ee4-4029-a6a8-f46244072ef3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4110aafeb3d544039ada9c1c742dd5c4', 'request_id': 'req-68fec790-8ee4-4029-a6a8-f46244072ef3'} {{(pid=82025) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 20:11:06.796993 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.notifications [None req-68fec790-8ee4-4029-a6a8-f46244072ef3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4110aafeb3d544039ada9c1c742dd5c4', 'request_id': 'req-68fec790-8ee4-4029-a6a8-f46244072ef3'} {{(pid=82025) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 20:11:06.803352 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.notifications [None req-68fec790-8ee4-4029-a6a8-f46244072ef3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4110aafeb3d544039ada9c1c742dd5c4', 'request_id': 'req-68fec790-8ee4-4029-a6a8-f46244072ef3'} {{(pid=82025) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 20:11:06.916664 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.notifications [None req-68fec790-8ee4-4029-a6a8-f46244072ef3 admin admin] The token cache is being invalidate because project 4110aafeb3d544039ada9c1c742dd5c4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82025) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 13 20:11:06.916962 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.notifications [None req-68fec790-8ee4-4029-a6a8-f46244072ef3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82025) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 20:11:06.917616 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.notifications [None req-68fec790-8ee4-4029-a6a8-f46244072ef3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82025) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 20:11:06.919131 dv-cinder-828806-6-smb devstack@keystone.service[82025]: [pid: 82025|app: 0|req: 1480/2898] 10.222.0.33 () {58 vars in 1233 bytes} [Tue Sep 13 20:11:06 2022] DELETE /identity/v3/projects/4110aafeb3d544039ada9c1c742dd5c4 => generated 0 bytes in 310 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 20:11:06.923987 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35ba3739-a150-4e35-88cd-f696198af256 None None] REQUEST_METHOD: `POST` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:11:06.924476 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35ba3739-a150-4e35-88cd-f696198af256 None None] SCRIPT_NAME: `/identity` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:11:06.924589 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35ba3739-a150-4e35-88cd-f696198af256 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:11:06.944755 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.auth.core [None req-35ba3739-a150-4e35-88cd-f696198af256 None None] MFA Rules not processed for user `57539b6a6f3b4d589f5f5e1d211cd6a0`. Rule list: `[]` (Enabled: `True`). {{(pid=82026) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 20:11:06.945876 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.common.fernet_utils [None req-35ba3739-a150-4e35-88cd-f696198af256 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82026) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 20:11:07.003258 dv-cinder-828806-6-smb devstack@keystone.service[82026]: [pid: 82026|app: 0|req: 1419/2899] 10.222.0.33 () {58 vars in 958 bytes} [Tue Sep 13 20:11:06 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 20:11:07.013456 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfdceeac-b8ff-4fdb-85d1-a7e94ce4f8b3 None None] REQUEST_METHOD: `POST` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:11:07.013456 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfdceeac-b8ff-4fdb-85d1-a7e94ce4f8b3 None None] SCRIPT_NAME: `/identity` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:11:07.013456 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfdceeac-b8ff-4fdb-85d1-a7e94ce4f8b3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:11:07.031899 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.auth.core [None req-dfdceeac-b8ff-4fdb-85d1-a7e94ce4f8b3 None None] MFA Rules not processed for user `57539b6a6f3b4d589f5f5e1d211cd6a0`. Rule list: `[]` (Enabled: `True`). {{(pid=82025) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 20:11:07.033119 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.fernet_utils [None req-dfdceeac-b8ff-4fdb-85d1-a7e94ce4f8b3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82025) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 20:11:07.041611 dv-cinder-828806-6-smb devstack@keystone.service[82025]: [pid: 82025|app: 0|req: 1481/2900] 10.222.0.33 () {58 vars in 958 bytes} [Tue Sep 13 20:11:07 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 20:11:07.045792 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35ba3739-a150-4e35-88cd-f696198af256 None None] Authenticating user token {{(pid=82026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 20:11:07.055493 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35ba3739-a150-4e35-88cd-f696198af256 None None] Validating token access rules against request {{(pid=82026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 20:11:07.060389 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e32f9566-bf85-49a8-97d8-3510ec94843b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57539b6a6f3b4d589f5f5e1d211cd6a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b454f707d20347ada3d82aa85495635e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 20:11:07.060986 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e32f9566-bf85-49a8-97d8-3510ec94843b admin admin] REQUEST_METHOD: `GET` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:11:07.064035 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e32f9566-bf85-49a8-97d8-3510ec94843b admin admin] SCRIPT_NAME: `/identity` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:11:07.064035 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e32f9566-bf85-49a8-97d8-3510ec94843b admin admin] PATH_INFO: `/v3/domains` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:11:07.064035 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e32f9566-bf85-49a8-97d8-3510ec94843b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82026) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 20:11:07.064035 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e32f9566-bf85-49a8-97d8-3510ec94843b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 20:11:07.064448 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e32f9566-bf85-49a8-97d8-3510ec94843b admin admin] RBAC: Authorization granted {{(pid=82026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 20:11:07.075575 dv-cinder-828806-6-smb devstack@keystone.service[82026]: [pid: 82026|app: 0|req: 1420/2901] 10.222.0.33 () {58 vars in 1153 bytes} [Tue Sep 13 20:11:07 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 20:11:07.079858 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfdceeac-b8ff-4fdb-85d1-a7e94ce4f8b3 None None] Authenticating user token {{(pid=82025) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 20:11:07.089607 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfdceeac-b8ff-4fdb-85d1-a7e94ce4f8b3 None None] Validating token access rules against request {{(pid=82025) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 20:11:07.094769 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82676f83-0f2c-4939-a6a3-3df4972ed081 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57539b6a6f3b4d589f5f5e1d211cd6a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b454f707d20347ada3d82aa85495635e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82025) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 20:11:07.095412 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82676f83-0f2c-4939-a6a3-3df4972ed081 admin admin] REQUEST_METHOD: `POST` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:11:07.095699 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82676f83-0f2c-4939-a6a3-3df4972ed081 admin admin] SCRIPT_NAME: `/identity` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:11:07.095977 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82676f83-0f2c-4939-a6a3-3df4972ed081 admin admin] PATH_INFO: `/v3/projects` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:11:07.096626 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82676f83-0f2c-4939-a6a3-3df4972ed081 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 20:11:07.098663 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82676f83-0f2c-4939-a6a3-3df4972ed081 admin admin] RBAC: Authorization granted {{(pid=82025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 20:11:07.216863 dv-cinder-828806-6-smb devstack@keystone.service[82025]: [pid: 82025|app: 0|req: 1482/2902] 10.222.0.33 () {60 vars in 1153 bytes} [Tue Sep 13 20:11:07 2022] POST /identity/v3/projects => generated 361 bytes in 137 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 13 20:11:07.221627 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e32f9566-bf85-49a8-97d8-3510ec94843b admin admin] Authenticating user token {{(pid=82026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 20:11:07.237412 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e32f9566-bf85-49a8-97d8-3510ec94843b admin admin] Validating token access rules against request {{(pid=82026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 20:11:07.298395 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c934fc80-78e3-408b-a063-4ab6382dd1c9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57539b6a6f3b4d589f5f5e1d211cd6a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b454f707d20347ada3d82aa85495635e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 20:11:07.299121 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c934fc80-78e3-408b-a063-4ab6382dd1c9 admin admin] REQUEST_METHOD: `POST` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:11:07.299361 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c934fc80-78e3-408b-a063-4ab6382dd1c9 admin admin] SCRIPT_NAME: `/identity` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:11:07.299644 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c934fc80-78e3-408b-a063-4ab6382dd1c9 admin admin] PATH_INFO: `/v3/users` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:11:07.300288 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c934fc80-78e3-408b-a063-4ab6382dd1c9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 20:11:07.302221 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c934fc80-78e3-408b-a063-4ab6382dd1c9 admin admin] RBAC: Authorization granted {{(pid=82026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 20:11:07.425616 dv-cinder-828806-6-smb devstack@keystone.service[82026]: [pid: 82026|app: 0|req: 1421/2903] 10.222.0.33 () {60 vars in 1144 bytes} [Tue Sep 13 20:11:07 2022] POST /identity/v3/users => generated 281 bytes in 205 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 13 20:11:07.429845 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82676f83-0f2c-4939-a6a3-3df4972ed081 admin admin] Authenticating user token {{(pid=82025) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 20:11:07.440393 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82676f83-0f2c-4939-a6a3-3df4972ed081 admin admin] Validating token access rules against request {{(pid=82025) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 20:11:07.445045 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07cb1103-e094-496e-9a1f-b97413fa11ec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57539b6a6f3b4d589f5f5e1d211cd6a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b454f707d20347ada3d82aa85495635e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82025) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 20:11:07.445648 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07cb1103-e094-496e-9a1f-b97413fa11ec admin admin] REQUEST_METHOD: `GET` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:11:07.445936 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07cb1103-e094-496e-9a1f-b97413fa11ec admin admin] SCRIPT_NAME: `/identity` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:11:07.446216 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07cb1103-e094-496e-9a1f-b97413fa11ec admin admin] PATH_INFO: `/v3/roles` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:11:07.447425 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07cb1103-e094-496e-9a1f-b97413fa11ec admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 20:11:07.450888 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07cb1103-e094-496e-9a1f-b97413fa11ec admin admin] RBAC: Authorization granted {{(pid=82025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 20:11:07.462507 dv-cinder-828806-6-smb devstack@keystone.service[82025]: [pid: 82025|app: 0|req: 1483/2904] 10.222.0.33 () {58 vars in 1122 bytes} [Tue Sep 13 20:11:07 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 13 20:11:07.467473 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c934fc80-78e3-408b-a063-4ab6382dd1c9 admin admin] Authenticating user token {{(pid=82026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 20:11:07.477494 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c934fc80-78e3-408b-a063-4ab6382dd1c9 admin admin] Validating token access rules against request {{(pid=82026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 20:11:07.482459 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbe51b9a-669a-40ab-9140-190c524ebf29 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57539b6a6f3b4d589f5f5e1d211cd6a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b454f707d20347ada3d82aa85495635e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 20:11:07.483083 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbe51b9a-669a-40ab-9140-190c524ebf29 admin admin] REQUEST_METHOD: `GET` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:11:07.483382 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbe51b9a-669a-40ab-9140-190c524ebf29 admin admin] SCRIPT_NAME: `/identity` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:11:07.483662 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbe51b9a-669a-40ab-9140-190c524ebf29 admin admin] PATH_INFO: `/v3/roles` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:11:07.484318 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbe51b9a-669a-40ab-9140-190c524ebf29 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 20:11:07.485919 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbe51b9a-669a-40ab-9140-190c524ebf29 admin admin] RBAC: Authorization granted {{(pid=82026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 20:11:07.498233 dv-cinder-828806-6-smb devstack@keystone.service[82026]: [pid: 82026|app: 0|req: 1422/2905] 10.222.0.33 () {58 vars in 1122 bytes} [Tue Sep 13 20:11:07 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 13 20:11:07.502349 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07cb1103-e094-496e-9a1f-b97413fa11ec admin admin] Authenticating user token {{(pid=82025) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 20:11:07.508709 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG dbcounter [-] [82025] Writing DB stats keystone:DELETE=13,keystone:SELECT=84,keystone:INSERT=3 {{(pid=82025) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 20:11:07.513059 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07cb1103-e094-496e-9a1f-b97413fa11ec admin admin] Validating token access rules against request {{(pid=82025) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 20:11:07.517694 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf67bbc0-f540-4cdb-8449-40833c438f6a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57539b6a6f3b4d589f5f5e1d211cd6a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b454f707d20347ada3d82aa85495635e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82025) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 20:11:07.524456 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf67bbc0-f540-4cdb-8449-40833c438f6a admin admin] REQUEST_METHOD: `PUT` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:11:07.524456 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf67bbc0-f540-4cdb-8449-40833c438f6a admin admin] SCRIPT_NAME: `/identity` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:11:07.524456 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf67bbc0-f540-4cdb-8449-40833c438f6a admin admin] PATH_INFO: `/v3/projects/6c54bef1ed18498a9fa79326ff12e337/users/bbc8df2939a74456b6c75b487c6b3111/roles/3618ab638a65401f82333da7596d1daf` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:11:07.533773 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf67bbc0-f540-4cdb-8449-40833c438f6a admin admin] RBAC: Authorizing `identity:create_grant(project_id=6c54bef1ed18498a9fa79326ff12e337, user_id=bbc8df2939a74456b6c75b487c6b3111, role_id=3618ab638a65401f82333da7596d1daf)` {{(pid=82025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 20:11:07.536426 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf67bbc0-f540-4cdb-8449-40833c438f6a admin admin] RBAC: Authorization granted {{(pid=82025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 20:11:07.637454 dv-cinder-828806-6-smb devstack@keystone.service[82025]: [pid: 82025|app: 0|req: 1484/2906] 10.222.0.33 () {60 vars in 1483 bytes} [Tue Sep 13 20:11:07 2022] PUT /identity/v3/projects/6c54bef1ed18498a9fa79326ff12e337/users/bbc8df2939a74456b6c75b487c6b3111/roles/3618ab638a65401f82333da7596d1daf => generated 0 bytes in 136 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 20:11:07.647371 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b8c2e62-492c-4452-8875-d226d24eb317 None None] REQUEST_METHOD: `POST` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:11:07.649442 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b8c2e62-492c-4452-8875-d226d24eb317 None None] SCRIPT_NAME: `/identity` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:11:07.649442 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b8c2e62-492c-4452-8875-d226d24eb317 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:11:07.677489 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.auth.core [None req-9b8c2e62-492c-4452-8875-d226d24eb317 None None] MFA Rules not processed for user `bbc8df2939a74456b6c75b487c6b3111`. Rule list: `[]` (Enabled: `True`). {{(pid=82026) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 20:11:07.678734 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.common.fernet_utils [None req-9b8c2e62-492c-4452-8875-d226d24eb317 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82026) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 20:11:07.691735 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG dbcounter [-] [82026] Writing DB stats keystone:DELETE=4,keystone:SELECT=92,keystone:INSERT=4 {{(pid=82026) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 20:11:07.743155 dv-cinder-828806-6-smb devstack@keystone.service[82026]: [pid: 82026|app: 0|req: 1423/2907] 10.222.0.33 () {58 vars in 958 bytes} [Tue Sep 13 20:11:07 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 20:11:07.782955 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf67bbc0-f540-4cdb-8449-40833c438f6a admin admin] Authenticating user token {{(pid=82025) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 20:11:07.784737 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.fernet_utils [None req-cf67bbc0-f540-4cdb-8449-40833c438f6a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82025) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 20:11:07.842708 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf67bbc0-f540-4cdb-8449-40833c438f6a admin admin] Validating token access rules against request {{(pid=82025) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 20:11:07.846413 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdc2f50d-7462-4605-b82e-8c8e546df76d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46024fc6167f4321818b1bed27a521a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8c6fba0f15b4d6a84ff601919b7b8e4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82025) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 20:11:07.847092 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdc2f50d-7462-4605-b82e-8c8e546df76d service cinder] REQUEST_METHOD: `GET` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:11:07.847402 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdc2f50d-7462-4605-b82e-8c8e546df76d service cinder] SCRIPT_NAME: `/identity` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:11:07.847694 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdc2f50d-7462-4605-b82e-8c8e546df76d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:11:07.856292 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdc2f50d-7462-4605-b82e-8c8e546df76d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=82025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 20:11:07.857719 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdc2f50d-7462-4605-b82e-8c8e546df76d service cinder] RBAC: Authorization granted {{(pid=82025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 20:11:07.866377 dv-cinder-828806-6-smb devstack@keystone.service[82025]: [pid: 82025|app: 0|req: 1485/2908] 10.222.0.33 () {60 vars in 1365 bytes} [Tue Sep 13 20:11:07 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 20:11:07.883141 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b8c2e62-492c-4452-8875-d226d24eb317 None None] Authenticating user token {{(pid=82026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 20:11:07.945176 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b8c2e62-492c-4452-8875-d226d24eb317 None None] Validating token access rules against request {{(pid=82026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 20:11:07.950531 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69dc3a43-0322-49fb-ac43-a88b0fb9398d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57539b6a6f3b4d589f5f5e1d211cd6a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b454f707d20347ada3d82aa85495635e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 20:11:07.951199 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69dc3a43-0322-49fb-ac43-a88b0fb9398d admin admin] REQUEST_METHOD: `DELETE` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:11:07.951487 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69dc3a43-0322-49fb-ac43-a88b0fb9398d admin admin] SCRIPT_NAME: `/identity` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:11:07.951769 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69dc3a43-0322-49fb-ac43-a88b0fb9398d admin admin] PATH_INFO: `/v3/users/bbc8df2939a74456b6c75b487c6b3111` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:11:07.952914 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69dc3a43-0322-49fb-ac43-a88b0fb9398d admin admin] RBAC: Authorizing `identity:delete_user(user_id=bbc8df2939a74456b6c75b487c6b3111)` {{(pid=82026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 20:11:07.954888 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69dc3a43-0322-49fb-ac43-a88b0fb9398d admin admin] RBAC: Authorization granted {{(pid=82026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 20:11:08.131782 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.notifications [None req-69dc3a43-0322-49fb-ac43-a88b0fb9398d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'bbc8df2939a74456b6c75b487c6b3111'} {{(pid=82026) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 20:11:08.219693 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.notifications [None req-69dc3a43-0322-49fb-ac43-a88b0fb9398d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'bbc8df2939a74456b6c75b487c6b3111'} {{(pid=82026) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 20:11:08.233408 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.notifications [None req-69dc3a43-0322-49fb-ac43-a88b0fb9398d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'bbc8df2939a74456b6c75b487c6b3111'} {{(pid=82026) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 20:11:08.234077 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.notifications [None req-69dc3a43-0322-49fb-ac43-a88b0fb9398d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'bbc8df2939a74456b6c75b487c6b3111'} {{(pid=82026) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 20:11:08.241072 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.notifications [None req-69dc3a43-0322-49fb-ac43-a88b0fb9398d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'bbc8df2939a74456b6c75b487c6b3111'} {{(pid=82026) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 20:11:08.247686 dv-cinder-828806-6-smb devstack@keystone.service[82026]: [pid: 82026|app: 0|req: 1424/2909] 10.222.0.33 () {58 vars in 1224 bytes} [Tue Sep 13 20:11:07 2022] DELETE /identity/v3/users/bbc8df2939a74456b6c75b487c6b3111 => generated 0 bytes in 365 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 20:11:08.252199 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b151aba0-472c-499e-8ace-0a2cf6f3e79b None None] REQUEST_METHOD: `POST` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:11:08.252488 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b151aba0-472c-499e-8ace-0a2cf6f3e79b None None] SCRIPT_NAME: `/identity` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:11:08.252767 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b151aba0-472c-499e-8ace-0a2cf6f3e79b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:11:08.271628 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.auth.core [None req-b151aba0-472c-499e-8ace-0a2cf6f3e79b None None] MFA Rules not processed for user `57539b6a6f3b4d589f5f5e1d211cd6a0`. Rule list: `[]` (Enabled: `True`). {{(pid=82025) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 20:11:08.275091 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.fernet_utils [None req-b151aba0-472c-499e-8ace-0a2cf6f3e79b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82025) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 20:11:08.333937 dv-cinder-828806-6-smb devstack@keystone.service[82025]: [pid: 82025|app: 0|req: 1486/2910] 10.222.0.33 () {58 vars in 958 bytes} [Tue Sep 13 20:11:08 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 20:11:08.343930 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69dc3a43-0322-49fb-ac43-a88b0fb9398d admin admin] Authenticating user token {{(pid=82026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 20:11:08.345366 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.common.fernet_utils [None req-69dc3a43-0322-49fb-ac43-a88b0fb9398d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82026) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 20:11:08.386236 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG dbcounter [-] [82026] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82026) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 20:11:08.406717 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69dc3a43-0322-49fb-ac43-a88b0fb9398d admin admin] Validating token access rules against request {{(pid=82026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 20:11:08.420758 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aed704c-16ae-4b9e-85b5-20e9b7a946cf service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '023a2c79c2444611b3d431928e56685d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8c6fba0f15b4d6a84ff601919b7b8e4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 20:11:08.421383 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aed704c-16ae-4b9e-85b5-20e9b7a946cf service neutron] REQUEST_METHOD: `GET` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:11:08.421671 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aed704c-16ae-4b9e-85b5-20e9b7a946cf service neutron] SCRIPT_NAME: `/identity` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:11:08.421948 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aed704c-16ae-4b9e-85b5-20e9b7a946cf service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:11:08.432909 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7aed704c-16ae-4b9e-85b5-20e9b7a946cf service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 20:11:08.434355 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7aed704c-16ae-4b9e-85b5-20e9b7a946cf service neutron] RBAC: Authorization granted {{(pid=82026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 20:11:08.443773 dv-cinder-828806-6-smb devstack@keystone.service[82026]: [pid: 82026|app: 0|req: 1425/2911] 10.222.0.33 () {60 vars in 1365 bytes} [Tue Sep 13 20:11:08 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 100 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 20:11:08.981538 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b151aba0-472c-499e-8ace-0a2cf6f3e79b None None] Authenticating user token {{(pid=82025) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 20:11:08.983010 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.fernet_utils [None req-b151aba0-472c-499e-8ace-0a2cf6f3e79b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82025) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 20:11:08.995541 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b151aba0-472c-499e-8ace-0a2cf6f3e79b None None] Validating token access rules against request {{(pid=82025) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 20:11:09.000227 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f84ae38-4fa7-48f8-b077-12ee59b3a04e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57539b6a6f3b4d589f5f5e1d211cd6a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b454f707d20347ada3d82aa85495635e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82025) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 20:11:09.000867 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f84ae38-4fa7-48f8-b077-12ee59b3a04e admin admin] REQUEST_METHOD: `DELETE` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:11:09.001153 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f84ae38-4fa7-48f8-b077-12ee59b3a04e admin admin] SCRIPT_NAME: `/identity` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:11:09.001434 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f84ae38-4fa7-48f8-b077-12ee59b3a04e admin admin] PATH_INFO: `/v3/projects/6c54bef1ed18498a9fa79326ff12e337` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:11:09.002606 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f84ae38-4fa7-48f8-b077-12ee59b3a04e admin admin] RBAC: Authorizing `identity:delete_project(project_id=6c54bef1ed18498a9fa79326ff12e337)` {{(pid=82025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 20:11:09.004568 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f84ae38-4fa7-48f8-b077-12ee59b3a04e admin admin] RBAC: Authorization granted {{(pid=82025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 20:11:09.228353 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.notifications [None req-7f84ae38-4fa7-48f8-b077-12ee59b3a04e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6c54bef1ed18498a9fa79326ff12e337', 'request_id': 'req-7f84ae38-4fa7-48f8-b077-12ee59b3a04e'} {{(pid=82025) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 20:11:09.233761 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.notifications [None req-7f84ae38-4fa7-48f8-b077-12ee59b3a04e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6c54bef1ed18498a9fa79326ff12e337', 'request_id': 'req-7f84ae38-4fa7-48f8-b077-12ee59b3a04e'} {{(pid=82025) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 20:11:09.240358 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.notifications [None req-7f84ae38-4fa7-48f8-b077-12ee59b3a04e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6c54bef1ed18498a9fa79326ff12e337', 'request_id': 'req-7f84ae38-4fa7-48f8-b077-12ee59b3a04e'} {{(pid=82025) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 20:11:09.391420 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.notifications [None req-7f84ae38-4fa7-48f8-b077-12ee59b3a04e admin admin] The token cache is being invalidate because project 6c54bef1ed18498a9fa79326ff12e337 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82025) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 13 20:11:09.391724 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.notifications [None req-7f84ae38-4fa7-48f8-b077-12ee59b3a04e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82025) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 20:11:09.392354 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.notifications [None req-7f84ae38-4fa7-48f8-b077-12ee59b3a04e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82025) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 20:11:09.393841 dv-cinder-828806-6-smb devstack@keystone.service[82025]: [pid: 82025|app: 0|req: 1487/2912] 10.222.0.33 () {58 vars in 1233 bytes} [Tue Sep 13 20:11:08 2022] DELETE /identity/v3/projects/6c54bef1ed18498a9fa79326ff12e337 => generated 0 bytes in 413 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 20:11:09.398701 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d609e1a-4456-448c-825a-5bf025f1beb4 None None] REQUEST_METHOD: `POST` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:11:09.399210 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d609e1a-4456-448c-825a-5bf025f1beb4 None None] SCRIPT_NAME: `/identity` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:11:09.399332 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d609e1a-4456-448c-825a-5bf025f1beb4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:11:09.418573 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.auth.core [None req-3d609e1a-4456-448c-825a-5bf025f1beb4 None None] MFA Rules not processed for user `57539b6a6f3b4d589f5f5e1d211cd6a0`. Rule list: `[]` (Enabled: `True`). {{(pid=82026) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 20:11:09.419819 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.common.fernet_utils [None req-3d609e1a-4456-448c-825a-5bf025f1beb4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82026) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 20:11:09.486021 dv-cinder-828806-6-smb devstack@keystone.service[82026]: [pid: 82026|app: 0|req: 1426/2913] 10.222.0.33 () {58 vars in 958 bytes} [Tue Sep 13 20:11:09 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 20:11:09.495214 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fac1363a-1332-45e1-8f66-59230aca8a20 None None] REQUEST_METHOD: `POST` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:11:09.495505 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fac1363a-1332-45e1-8f66-59230aca8a20 None None] SCRIPT_NAME: `/identity` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:11:09.495785 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fac1363a-1332-45e1-8f66-59230aca8a20 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:11:09.511757 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG dbcounter [-] [82025] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=82025) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 20:11:09.517539 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.auth.core [None req-fac1363a-1332-45e1-8f66-59230aca8a20 None None] MFA Rules not processed for user `57539b6a6f3b4d589f5f5e1d211cd6a0`. Rule list: `[]` (Enabled: `True`). {{(pid=82025) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 20:11:09.518826 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.fernet_utils [None req-fac1363a-1332-45e1-8f66-59230aca8a20 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82025) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 20:11:09.526915 dv-cinder-828806-6-smb devstack@keystone.service[82025]: [pid: 82025|app: 0|req: 1488/2914] 10.222.0.33 () {58 vars in 958 bytes} [Tue Sep 13 20:11:09 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 20:11:09.531266 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d609e1a-4456-448c-825a-5bf025f1beb4 None None] Authenticating user token {{(pid=82026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 20:11:09.541174 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d609e1a-4456-448c-825a-5bf025f1beb4 None None] Validating token access rules against request {{(pid=82026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 20:11:09.546012 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04763218-bf21-49c2-9bdc-60ecc3883dee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57539b6a6f3b4d589f5f5e1d211cd6a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b454f707d20347ada3d82aa85495635e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 20:11:09.546649 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04763218-bf21-49c2-9bdc-60ecc3883dee admin admin] REQUEST_METHOD: `GET` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:11:09.546937 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04763218-bf21-49c2-9bdc-60ecc3883dee admin admin] SCRIPT_NAME: `/identity` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:11:09.547253 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04763218-bf21-49c2-9bdc-60ecc3883dee admin admin] PATH_INFO: `/v3/domains` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:11:09.547945 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04763218-bf21-49c2-9bdc-60ecc3883dee admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82026) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 20:11:09.548293 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04763218-bf21-49c2-9bdc-60ecc3883dee admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 20:11:09.549907 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04763218-bf21-49c2-9bdc-60ecc3883dee admin admin] RBAC: Authorization granted {{(pid=82026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 20:11:09.563080 dv-cinder-828806-6-smb devstack@keystone.service[82026]: [pid: 82026|app: 0|req: 1427/2915] 10.222.0.33 () {58 vars in 1153 bytes} [Tue Sep 13 20:11:09 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 20:11:09.567456 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fac1363a-1332-45e1-8f66-59230aca8a20 None None] Authenticating user token {{(pid=82025) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 20:11:09.580451 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fac1363a-1332-45e1-8f66-59230aca8a20 None None] Validating token access rules against request {{(pid=82025) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 20:11:09.582714 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f7db23f-873f-4373-87c7-fddb08798292 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57539b6a6f3b4d589f5f5e1d211cd6a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b454f707d20347ada3d82aa85495635e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82025) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 20:11:09.583363 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f7db23f-873f-4373-87c7-fddb08798292 admin admin] REQUEST_METHOD: `POST` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:11:09.583711 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f7db23f-873f-4373-87c7-fddb08798292 admin admin] SCRIPT_NAME: `/identity` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:11:09.583990 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f7db23f-873f-4373-87c7-fddb08798292 admin admin] PATH_INFO: `/v3/projects` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:11:09.584627 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f7db23f-873f-4373-87c7-fddb08798292 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 20:11:09.586536 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f7db23f-873f-4373-87c7-fddb08798292 admin admin] RBAC: Authorization granted {{(pid=82025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 20:11:09.695854 dv-cinder-828806-6-smb devstack@keystone.service[82025]: [pid: 82025|app: 0|req: 1489/2916] 10.222.0.33 () {60 vars in 1153 bytes} [Tue Sep 13 20:11:09 2022] POST /identity/v3/projects => generated 369 bytes in 129 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 13 20:11:09.700798 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04763218-bf21-49c2-9bdc-60ecc3883dee admin admin] Authenticating user token {{(pid=82026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 20:11:09.710824 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04763218-bf21-49c2-9bdc-60ecc3883dee admin admin] Validating token access rules against request {{(pid=82026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 20:11:09.767121 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40bb0674-e5f8-4d5a-9959-f47bb2f2a63b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57539b6a6f3b4d589f5f5e1d211cd6a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b454f707d20347ada3d82aa85495635e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 20:11:09.767661 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40bb0674-e5f8-4d5a-9959-f47bb2f2a63b admin admin] REQUEST_METHOD: `POST` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:11:09.767946 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40bb0674-e5f8-4d5a-9959-f47bb2f2a63b admin admin] SCRIPT_NAME: `/identity` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:11:09.768224 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40bb0674-e5f8-4d5a-9959-f47bb2f2a63b admin admin] PATH_INFO: `/v3/users` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:11:09.768856 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40bb0674-e5f8-4d5a-9959-f47bb2f2a63b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 20:11:09.770776 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40bb0674-e5f8-4d5a-9959-f47bb2f2a63b admin admin] RBAC: Authorization granted {{(pid=82026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 20:11:09.877409 dv-cinder-828806-6-smb devstack@keystone.service[82026]: [pid: 82026|app: 0|req: 1428/2917] 10.222.0.33 () {60 vars in 1144 bytes} [Tue Sep 13 20:11:09 2022] POST /identity/v3/users => generated 285 bytes in 177 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 13 20:11:09.881486 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f7db23f-873f-4373-87c7-fddb08798292 admin admin] Authenticating user token {{(pid=82025) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 20:11:09.892008 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f7db23f-873f-4373-87c7-fddb08798292 admin admin] Validating token access rules against request {{(pid=82025) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 20:11:09.896903 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcd2b6e6-95c1-48d3-9ae0-6e3a74a65b97 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57539b6a6f3b4d589f5f5e1d211cd6a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b454f707d20347ada3d82aa85495635e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82025) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 20:11:09.897514 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcd2b6e6-95c1-48d3-9ae0-6e3a74a65b97 admin admin] REQUEST_METHOD: `GET` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:11:09.897795 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcd2b6e6-95c1-48d3-9ae0-6e3a74a65b97 admin admin] SCRIPT_NAME: `/identity` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:11:09.898088 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcd2b6e6-95c1-48d3-9ae0-6e3a74a65b97 admin admin] PATH_INFO: `/v3/roles` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:11:09.898718 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcd2b6e6-95c1-48d3-9ae0-6e3a74a65b97 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 20:11:09.900438 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcd2b6e6-95c1-48d3-9ae0-6e3a74a65b97 admin admin] RBAC: Authorization granted {{(pid=82025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 20:11:09.910511 dv-cinder-828806-6-smb devstack@keystone.service[82025]: [pid: 82025|app: 0|req: 1490/2918] 10.222.0.33 () {58 vars in 1122 bytes} [Tue Sep 13 20:11:09 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 13 20:11:09.917961 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40bb0674-e5f8-4d5a-9959-f47bb2f2a63b admin admin] Authenticating user token {{(pid=82026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 20:11:09.928747 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40bb0674-e5f8-4d5a-9959-f47bb2f2a63b admin admin] Validating token access rules against request {{(pid=82026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 20:11:09.934892 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2effdbe3-7caa-4236-bbe5-a0d34227252c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57539b6a6f3b4d589f5f5e1d211cd6a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b454f707d20347ada3d82aa85495635e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 20:11:09.935582 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2effdbe3-7caa-4236-bbe5-a0d34227252c admin admin] REQUEST_METHOD: `GET` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:11:09.935873 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2effdbe3-7caa-4236-bbe5-a0d34227252c admin admin] SCRIPT_NAME: `/identity` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:11:09.936158 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2effdbe3-7caa-4236-bbe5-a0d34227252c admin admin] PATH_INFO: `/v3/roles` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:11:09.936813 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2effdbe3-7caa-4236-bbe5-a0d34227252c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 20:11:09.938429 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2effdbe3-7caa-4236-bbe5-a0d34227252c admin admin] RBAC: Authorization granted {{(pid=82026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 20:11:09.949666 dv-cinder-828806-6-smb devstack@keystone.service[82026]: [pid: 82026|app: 0|req: 1429/2919] 10.222.0.33 () {58 vars in 1122 bytes} [Tue Sep 13 20:11:09 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 13 20:11:09.953870 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcd2b6e6-95c1-48d3-9ae0-6e3a74a65b97 admin admin] Authenticating user token {{(pid=82025) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 20:11:09.964903 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcd2b6e6-95c1-48d3-9ae0-6e3a74a65b97 admin admin] Validating token access rules against request {{(pid=82025) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 20:11:09.969617 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89f34fb6-b523-4845-af7d-5238a07b37d2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57539b6a6f3b4d589f5f5e1d211cd6a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b454f707d20347ada3d82aa85495635e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82025) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 20:11:09.974744 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89f34fb6-b523-4845-af7d-5238a07b37d2 admin admin] REQUEST_METHOD: `PUT` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:11:09.974744 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89f34fb6-b523-4845-af7d-5238a07b37d2 admin admin] SCRIPT_NAME: `/identity` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:11:09.974744 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89f34fb6-b523-4845-af7d-5238a07b37d2 admin admin] PATH_INFO: `/v3/projects/cd5a8246a22443aaa38b83e0510033aa/users/52adcbde7d2a463db8be652d9af86c2a/roles/3618ab638a65401f82333da7596d1daf` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:11:09.985956 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89f34fb6-b523-4845-af7d-5238a07b37d2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=cd5a8246a22443aaa38b83e0510033aa, user_id=52adcbde7d2a463db8be652d9af86c2a, role_id=3618ab638a65401f82333da7596d1daf)` {{(pid=82025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 20:11:09.988635 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89f34fb6-b523-4845-af7d-5238a07b37d2 admin admin] RBAC: Authorization granted {{(pid=82025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 20:11:10.076940 dv-cinder-828806-6-smb devstack@keystone.service[82025]: [pid: 82025|app: 0|req: 1491/2920] 10.222.0.33 () {60 vars in 1483 bytes} [Tue Sep 13 20:11:09 2022] PUT /identity/v3/projects/cd5a8246a22443aaa38b83e0510033aa/users/52adcbde7d2a463db8be652d9af86c2a/roles/3618ab638a65401f82333da7596d1daf => generated 0 bytes in 124 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 13 20:11:10.087862 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c0b141c-82b0-4b08-be90-467d10963542 None None] REQUEST_METHOD: `POST` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:11:10.088160 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c0b141c-82b0-4b08-be90-467d10963542 None None] SCRIPT_NAME: `/identity` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:11:10.088490 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c0b141c-82b0-4b08-be90-467d10963542 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:11:10.116720 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.auth.core [None req-7c0b141c-82b0-4b08-be90-467d10963542 None None] MFA Rules not processed for user `52adcbde7d2a463db8be652d9af86c2a`. Rule list: `[]` (Enabled: `True`). {{(pid=82026) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 20:11:10.117921 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.common.fernet_utils [None req-7c0b141c-82b0-4b08-be90-467d10963542 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82026) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 20:11:10.149092 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG dbcounter [-] [82026] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=82026) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 20:11:10.182024 dv-cinder-828806-6-smb devstack@keystone.service[82026]: [pid: 82026|app: 0|req: 1430/2921] 10.222.0.33 () {58 vars in 958 bytes} [Tue Sep 13 20:11:10 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 20:11:10.194232 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89f34fb6-b523-4845-af7d-5238a07b37d2 admin admin] Authenticating user token {{(pid=82025) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 20:11:10.195917 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.fernet_utils [None req-89f34fb6-b523-4845-af7d-5238a07b37d2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82025) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 20:11:10.254095 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89f34fb6-b523-4845-af7d-5238a07b37d2 admin admin] Validating token access rules against request {{(pid=82025) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 20:11:10.257764 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4adab49c-8358-41fe-8a41-c900a8893fa8 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f7b2421bf1f84193a29f79709d1d5a19', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8c6fba0f15b4d6a84ff601919b7b8e4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82025) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 20:11:10.258369 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4adab49c-8358-41fe-8a41-c900a8893fa8 service glance] REQUEST_METHOD: `GET` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:11:10.258657 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4adab49c-8358-41fe-8a41-c900a8893fa8 service glance] SCRIPT_NAME: `/identity` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:11:10.258940 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4adab49c-8358-41fe-8a41-c900a8893fa8 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:11:10.267394 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4adab49c-8358-41fe-8a41-c900a8893fa8 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=82025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 20:11:10.268825 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4adab49c-8358-41fe-8a41-c900a8893fa8 service glance] RBAC: Authorization granted {{(pid=82025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 20:11:10.278159 dv-cinder-828806-6-smb devstack@keystone.service[82025]: [pid: 82025|app: 0|req: 1492/2922] 10.222.0.33 () {60 vars in 1365 bytes} [Tue Sep 13 20:11:10 2022] GET /identity/v3/auth/tokens => generated 3246 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 20:11:20.271048 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG dbcounter [-] [82026] Writing DB stats keystone:SELECT=12 {{(pid=82026) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 20:11:20.273529 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG dbcounter [-] [82025] Writing DB stats keystone:SELECT=50,keystone:INSERT=2 {{(pid=82025) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 20:11:35.288649 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c0b141c-82b0-4b08-be90-467d10963542 None None] Authenticating user token {{(pid=82026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 20:11:35.352276 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c0b141c-82b0-4b08-be90-467d10963542 None None] Validating token access rules against request {{(pid=82026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 20:11:35.356805 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f489e625-9a6d-48d1-b516-4e2cb0610c26 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57539b6a6f3b4d589f5f5e1d211cd6a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b454f707d20347ada3d82aa85495635e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 20:11:35.357471 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f489e625-9a6d-48d1-b516-4e2cb0610c26 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:11:35.357757 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f489e625-9a6d-48d1-b516-4e2cb0610c26 admin admin] SCRIPT_NAME: `/identity` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:11:35.358039 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f489e625-9a6d-48d1-b516-4e2cb0610c26 admin admin] PATH_INFO: `/v3/users/52adcbde7d2a463db8be652d9af86c2a` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:11:35.359203 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f489e625-9a6d-48d1-b516-4e2cb0610c26 admin admin] RBAC: Authorizing `identity:delete_user(user_id=52adcbde7d2a463db8be652d9af86c2a)` {{(pid=82026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 20:11:35.361136 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f489e625-9a6d-48d1-b516-4e2cb0610c26 admin admin] RBAC: Authorization granted {{(pid=82026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 20:11:35.547749 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.notifications [None req-f489e625-9a6d-48d1-b516-4e2cb0610c26 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '52adcbde7d2a463db8be652d9af86c2a'} {{(pid=82026) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 20:11:35.630508 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.notifications [None req-f489e625-9a6d-48d1-b516-4e2cb0610c26 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '52adcbde7d2a463db8be652d9af86c2a'} {{(pid=82026) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 20:11:35.642924 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.notifications [None req-f489e625-9a6d-48d1-b516-4e2cb0610c26 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '52adcbde7d2a463db8be652d9af86c2a'} {{(pid=82026) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 20:11:35.643589 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.notifications [None req-f489e625-9a6d-48d1-b516-4e2cb0610c26 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '52adcbde7d2a463db8be652d9af86c2a'} {{(pid=82026) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 20:11:35.650588 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.notifications [None req-f489e625-9a6d-48d1-b516-4e2cb0610c26 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '52adcbde7d2a463db8be652d9af86c2a'} {{(pid=82026) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 20:11:35.656505 dv-cinder-828806-6-smb devstack@keystone.service[82026]: [pid: 82026|app: 0|req: 1431/2923] 10.222.0.33 () {58 vars in 1224 bytes} [Tue Sep 13 20:11:35 2022] DELETE /identity/v3/users/52adcbde7d2a463db8be652d9af86c2a => generated 0 bytes in 368 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 20:11:35.660989 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4b7255b-d2f9-4315-a3c3-3363e99c3f0e None None] REQUEST_METHOD: `POST` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:11:35.661495 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4b7255b-d2f9-4315-a3c3-3363e99c3f0e None None] SCRIPT_NAME: `/identity` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:11:35.661610 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4b7255b-d2f9-4315-a3c3-3363e99c3f0e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:11:35.681235 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.auth.core [None req-a4b7255b-d2f9-4315-a3c3-3363e99c3f0e None None] MFA Rules not processed for user `57539b6a6f3b4d589f5f5e1d211cd6a0`. Rule list: `[]` (Enabled: `True`). {{(pid=82025) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 20:11:35.682437 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.fernet_utils [None req-a4b7255b-d2f9-4315-a3c3-3363e99c3f0e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82025) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 20:11:35.742136 dv-cinder-828806-6-smb devstack@keystone.service[82025]: [pid: 82025|app: 0|req: 1493/2924] 10.222.0.33 () {58 vars in 958 bytes} [Tue Sep 13 20:11:35 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 20:11:35.752651 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f489e625-9a6d-48d1-b516-4e2cb0610c26 admin admin] Authenticating user token {{(pid=82026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 20:11:35.754107 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.common.fernet_utils [None req-f489e625-9a6d-48d1-b516-4e2cb0610c26 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82026) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 20:11:35.811330 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f489e625-9a6d-48d1-b516-4e2cb0610c26 admin admin] Validating token access rules against request {{(pid=82026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 20:11:35.815152 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-364067db-840d-4fc8-b857-3ea7e1829f86 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '023a2c79c2444611b3d431928e56685d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8c6fba0f15b4d6a84ff601919b7b8e4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 20:11:35.815759 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-364067db-840d-4fc8-b857-3ea7e1829f86 service neutron] REQUEST_METHOD: `GET` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:11:35.816046 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-364067db-840d-4fc8-b857-3ea7e1829f86 service neutron] SCRIPT_NAME: `/identity` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:11:35.816465 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-364067db-840d-4fc8-b857-3ea7e1829f86 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:11:35.825416 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-364067db-840d-4fc8-b857-3ea7e1829f86 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 20:11:35.826885 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-364067db-840d-4fc8-b857-3ea7e1829f86 service neutron] RBAC: Authorization granted {{(pid=82026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 20:11:35.836252 dv-cinder-828806-6-smb devstack@keystone.service[82026]: [pid: 82026|app: 0|req: 1432/2925] 10.222.0.33 () {60 vars in 1365 bytes} [Tue Sep 13 20:11:35 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 20:11:36.267557 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4b7255b-d2f9-4315-a3c3-3363e99c3f0e None None] Authenticating user token {{(pid=82025) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 20:11:36.277594 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.fernet_utils [None req-a4b7255b-d2f9-4315-a3c3-3363e99c3f0e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82025) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 20:11:36.282638 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4b7255b-d2f9-4315-a3c3-3363e99c3f0e None None] Validating token access rules against request {{(pid=82025) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 20:11:36.291857 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04c52711-cad5-46a3-a56e-6dcba3c98778 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57539b6a6f3b4d589f5f5e1d211cd6a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b454f707d20347ada3d82aa85495635e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82025) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 20:11:36.292508 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04c52711-cad5-46a3-a56e-6dcba3c98778 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:11:36.292788 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04c52711-cad5-46a3-a56e-6dcba3c98778 admin admin] SCRIPT_NAME: `/identity` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:11:36.293063 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04c52711-cad5-46a3-a56e-6dcba3c98778 admin admin] PATH_INFO: `/v3/projects/cd5a8246a22443aaa38b83e0510033aa` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:11:36.294227 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04c52711-cad5-46a3-a56e-6dcba3c98778 admin admin] RBAC: Authorizing `identity:delete_project(project_id=cd5a8246a22443aaa38b83e0510033aa)` {{(pid=82025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 20:11:36.296406 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04c52711-cad5-46a3-a56e-6dcba3c98778 admin admin] RBAC: Authorization granted {{(pid=82025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 20:11:36.471896 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.notifications [None req-04c52711-cad5-46a3-a56e-6dcba3c98778 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'cd5a8246a22443aaa38b83e0510033aa', 'request_id': 'req-04c52711-cad5-46a3-a56e-6dcba3c98778'} {{(pid=82025) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 20:11:36.477361 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.notifications [None req-04c52711-cad5-46a3-a56e-6dcba3c98778 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'cd5a8246a22443aaa38b83e0510033aa', 'request_id': 'req-04c52711-cad5-46a3-a56e-6dcba3c98778'} {{(pid=82025) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 20:11:36.483790 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.notifications [None req-04c52711-cad5-46a3-a56e-6dcba3c98778 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'cd5a8246a22443aaa38b83e0510033aa', 'request_id': 'req-04c52711-cad5-46a3-a56e-6dcba3c98778'} {{(pid=82025) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 20:11:36.590017 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.notifications [None req-04c52711-cad5-46a3-a56e-6dcba3c98778 admin admin] The token cache is being invalidate because project cd5a8246a22443aaa38b83e0510033aa was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82025) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 13 20:11:36.590310 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.notifications [None req-04c52711-cad5-46a3-a56e-6dcba3c98778 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82025) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 20:11:36.590955 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.notifications [None req-04c52711-cad5-46a3-a56e-6dcba3c98778 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82025) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 20:11:36.592554 dv-cinder-828806-6-smb devstack@keystone.service[82025]: [pid: 82025|app: 0|req: 1494/2926] 10.222.0.33 () {58 vars in 1233 bytes} [Tue Sep 13 20:11:36 2022] DELETE /identity/v3/projects/cd5a8246a22443aaa38b83e0510033aa => generated 0 bytes in 326 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 20:11:36.597533 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b142701b-6bc1-4452-8a82-88eb9565b088 None None] REQUEST_METHOD: `POST` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:11:36.598053 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b142701b-6bc1-4452-8a82-88eb9565b088 None None] SCRIPT_NAME: `/identity` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:11:36.598053 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b142701b-6bc1-4452-8a82-88eb9565b088 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:11:36.617245 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.auth.core [None req-b142701b-6bc1-4452-8a82-88eb9565b088 None None] MFA Rules not processed for user `57539b6a6f3b4d589f5f5e1d211cd6a0`. Rule list: `[]` (Enabled: `True`). {{(pid=82026) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 20:11:36.618445 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.common.fernet_utils [None req-b142701b-6bc1-4452-8a82-88eb9565b088 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82026) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 20:11:36.635396 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG dbcounter [-] [82026] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82026) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 20:11:36.676869 dv-cinder-828806-6-smb devstack@keystone.service[82026]: [pid: 82026|app: 0|req: 1433/2927] 10.222.0.33 () {58 vars in 958 bytes} [Tue Sep 13 20:11:36 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 20:11:36.686745 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-479e81ce-518a-46ff-9f96-29ef843a7fb8 None None] REQUEST_METHOD: `POST` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:11:36.687268 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-479e81ce-518a-46ff-9f96-29ef843a7fb8 None None] SCRIPT_NAME: `/identity` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:11:36.687375 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-479e81ce-518a-46ff-9f96-29ef843a7fb8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:11:36.707740 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.auth.core [None req-479e81ce-518a-46ff-9f96-29ef843a7fb8 None None] MFA Rules not processed for user `57539b6a6f3b4d589f5f5e1d211cd6a0`. Rule list: `[]` (Enabled: `True`). {{(pid=82025) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 20:11:36.708980 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.fernet_utils [None req-479e81ce-518a-46ff-9f96-29ef843a7fb8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82025) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 20:11:36.717282 dv-cinder-828806-6-smb devstack@keystone.service[82025]: [pid: 82025|app: 0|req: 1495/2928] 10.222.0.33 () {58 vars in 958 bytes} [Tue Sep 13 20:11:36 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 20:11:36.721759 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b142701b-6bc1-4452-8a82-88eb9565b088 None None] Authenticating user token {{(pid=82026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 20:11:36.738518 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b142701b-6bc1-4452-8a82-88eb9565b088 None None] Validating token access rules against request {{(pid=82026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 20:11:36.742053 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4627ae47-7777-43ca-83f0-34cf75004b4b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57539b6a6f3b4d589f5f5e1d211cd6a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b454f707d20347ada3d82aa85495635e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 20:11:36.742658 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4627ae47-7777-43ca-83f0-34cf75004b4b admin admin] REQUEST_METHOD: `GET` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:11:36.742940 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4627ae47-7777-43ca-83f0-34cf75004b4b admin admin] SCRIPT_NAME: `/identity` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:11:36.743249 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4627ae47-7777-43ca-83f0-34cf75004b4b admin admin] PATH_INFO: `/v3/domains` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:11:36.743978 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4627ae47-7777-43ca-83f0-34cf75004b4b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82026) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 20:11:36.744283 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4627ae47-7777-43ca-83f0-34cf75004b4b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 20:11:36.745882 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4627ae47-7777-43ca-83f0-34cf75004b4b admin admin] RBAC: Authorization granted {{(pid=82026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 20:11:36.758592 dv-cinder-828806-6-smb devstack@keystone.service[82026]: [pid: 82026|app: 0|req: 1434/2929] 10.222.0.33 () {58 vars in 1153 bytes} [Tue Sep 13 20:11:36 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 20:11:36.763084 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-479e81ce-518a-46ff-9f96-29ef843a7fb8 None None] Authenticating user token {{(pid=82025) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 20:11:36.773121 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-479e81ce-518a-46ff-9f96-29ef843a7fb8 None None] Validating token access rules against request {{(pid=82025) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 20:11:36.777752 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51c9f1f9-2772-4bdc-8236-d09e0340e6a4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57539b6a6f3b4d589f5f5e1d211cd6a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b454f707d20347ada3d82aa85495635e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82025) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 20:11:36.778325 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51c9f1f9-2772-4bdc-8236-d09e0340e6a4 admin admin] REQUEST_METHOD: `POST` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:11:36.778604 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51c9f1f9-2772-4bdc-8236-d09e0340e6a4 admin admin] SCRIPT_NAME: `/identity` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:11:36.778875 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51c9f1f9-2772-4bdc-8236-d09e0340e6a4 admin admin] PATH_INFO: `/v3/projects` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:11:36.779656 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51c9f1f9-2772-4bdc-8236-d09e0340e6a4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 20:11:36.781550 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51c9f1f9-2772-4bdc-8236-d09e0340e6a4 admin admin] RBAC: Authorization granted {{(pid=82025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 20:11:36.900524 dv-cinder-828806-6-smb devstack@keystone.service[82025]: [pid: 82025|app: 0|req: 1496/2930] 10.222.0.33 () {60 vars in 1153 bytes} [Tue Sep 13 20:11:36 2022] POST /identity/v3/projects => generated 361 bytes in 137 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 13 20:11:36.904351 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4627ae47-7777-43ca-83f0-34cf75004b4b admin admin] Authenticating user token {{(pid=82026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 20:11:36.914698 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4627ae47-7777-43ca-83f0-34cf75004b4b admin admin] Validating token access rules against request {{(pid=82026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 20:11:36.971651 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e97b8bf-24c7-4152-96d5-1320521c0738 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57539b6a6f3b4d589f5f5e1d211cd6a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b454f707d20347ada3d82aa85495635e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 20:11:36.972249 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e97b8bf-24c7-4152-96d5-1320521c0738 admin admin] REQUEST_METHOD: `POST` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:11:36.972531 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e97b8bf-24c7-4152-96d5-1320521c0738 admin admin] SCRIPT_NAME: `/identity` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:11:36.972805 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e97b8bf-24c7-4152-96d5-1320521c0738 admin admin] PATH_INFO: `/v3/users` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:11:36.973478 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e97b8bf-24c7-4152-96d5-1320521c0738 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 20:11:36.975413 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e97b8bf-24c7-4152-96d5-1320521c0738 admin admin] RBAC: Authorization granted {{(pid=82026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 20:11:37.071172 dv-cinder-828806-6-smb devstack@keystone.service[82026]: [pid: 82026|app: 0|req: 1435/2931] 10.222.0.33 () {60 vars in 1144 bytes} [Tue Sep 13 20:11:36 2022] POST /identity/v3/users => generated 281 bytes in 167 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 13 20:11:37.075598 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51c9f1f9-2772-4bdc-8236-d09e0340e6a4 admin admin] Authenticating user token {{(pid=82025) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 20:11:37.086560 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51c9f1f9-2772-4bdc-8236-d09e0340e6a4 admin admin] Validating token access rules against request {{(pid=82025) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 20:11:37.091184 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08fe23a5-2eeb-42bd-8148-2f6b6cd140f0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57539b6a6f3b4d589f5f5e1d211cd6a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b454f707d20347ada3d82aa85495635e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82025) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 20:11:37.092365 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08fe23a5-2eeb-42bd-8148-2f6b6cd140f0 admin admin] REQUEST_METHOD: `GET` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:11:37.092651 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08fe23a5-2eeb-42bd-8148-2f6b6cd140f0 admin admin] SCRIPT_NAME: `/identity` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:11:37.092932 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08fe23a5-2eeb-42bd-8148-2f6b6cd140f0 admin admin] PATH_INFO: `/v3/roles` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:11:37.093577 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08fe23a5-2eeb-42bd-8148-2f6b6cd140f0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 20:11:37.095236 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08fe23a5-2eeb-42bd-8148-2f6b6cd140f0 admin admin] RBAC: Authorization granted {{(pid=82025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 20:11:37.105500 dv-cinder-828806-6-smb devstack@keystone.service[82025]: [pid: 82025|app: 0|req: 1497/2932] 10.222.0.33 () {58 vars in 1122 bytes} [Tue Sep 13 20:11:37 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 13 20:11:37.110177 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e97b8bf-24c7-4152-96d5-1320521c0738 admin admin] Authenticating user token {{(pid=82026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 20:11:37.120352 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e97b8bf-24c7-4152-96d5-1320521c0738 admin admin] Validating token access rules against request {{(pid=82026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 20:11:37.125939 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94f67567-ecff-4041-a2e5-2d4ff998ef15 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57539b6a6f3b4d589f5f5e1d211cd6a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b454f707d20347ada3d82aa85495635e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 20:11:37.126573 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94f67567-ecff-4041-a2e5-2d4ff998ef15 admin admin] REQUEST_METHOD: `GET` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:11:37.126858 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94f67567-ecff-4041-a2e5-2d4ff998ef15 admin admin] SCRIPT_NAME: `/identity` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:11:37.127173 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94f67567-ecff-4041-a2e5-2d4ff998ef15 admin admin] PATH_INFO: `/v3/roles` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:11:37.127819 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94f67567-ecff-4041-a2e5-2d4ff998ef15 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 20:11:37.129431 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94f67567-ecff-4041-a2e5-2d4ff998ef15 admin admin] RBAC: Authorization granted {{(pid=82026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 20:11:37.140486 dv-cinder-828806-6-smb devstack@keystone.service[82026]: [pid: 82026|app: 0|req: 1436/2933] 10.222.0.33 () {58 vars in 1122 bytes} [Tue Sep 13 20:11:37 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 13 20:11:37.144713 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08fe23a5-2eeb-42bd-8148-2f6b6cd140f0 admin admin] Authenticating user token {{(pid=82025) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 20:11:37.155273 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08fe23a5-2eeb-42bd-8148-2f6b6cd140f0 admin admin] Validating token access rules against request {{(pid=82025) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 20:11:37.160077 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0002bae-25fe-4b4b-89b0-de33b00cc983 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57539b6a6f3b4d589f5f5e1d211cd6a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b454f707d20347ada3d82aa85495635e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82025) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 20:11:37.160728 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0002bae-25fe-4b4b-89b0-de33b00cc983 admin admin] REQUEST_METHOD: `PUT` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:11:37.161008 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0002bae-25fe-4b4b-89b0-de33b00cc983 admin admin] SCRIPT_NAME: `/identity` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:11:37.161288 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0002bae-25fe-4b4b-89b0-de33b00cc983 admin admin] PATH_INFO: `/v3/projects/89b8bb6beadd436d8dc141599b4006c8/users/73a66fc581c44bc38518b418e0990cc3/roles/3618ab638a65401f82333da7596d1daf` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:11:37.176693 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0002bae-25fe-4b4b-89b0-de33b00cc983 admin admin] RBAC: Authorizing `identity:create_grant(project_id=89b8bb6beadd436d8dc141599b4006c8, user_id=73a66fc581c44bc38518b418e0990cc3, role_id=3618ab638a65401f82333da7596d1daf)` {{(pid=82025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 20:11:37.179423 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0002bae-25fe-4b4b-89b0-de33b00cc983 admin admin] RBAC: Authorization granted {{(pid=82025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 20:11:37.265231 dv-cinder-828806-6-smb devstack@keystone.service[82025]: [pid: 82025|app: 0|req: 1498/2934] 10.222.0.33 () {60 vars in 1483 bytes} [Tue Sep 13 20:11:37 2022] PUT /identity/v3/projects/89b8bb6beadd436d8dc141599b4006c8/users/73a66fc581c44bc38518b418e0990cc3/roles/3618ab638a65401f82333da7596d1daf => generated 0 bytes in 121 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 20:11:37.281457 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2591384b-7aaa-4455-a134-7bd16111f078 None None] REQUEST_METHOD: `POST` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:11:37.281804 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2591384b-7aaa-4455-a134-7bd16111f078 None None] SCRIPT_NAME: `/identity` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:11:37.282092 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2591384b-7aaa-4455-a134-7bd16111f078 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:11:37.311274 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.auth.core [None req-2591384b-7aaa-4455-a134-7bd16111f078 None None] MFA Rules not processed for user `73a66fc581c44bc38518b418e0990cc3`. Rule list: `[]` (Enabled: `True`). {{(pid=82026) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 20:11:37.312490 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.common.fernet_utils [None req-2591384b-7aaa-4455-a134-7bd16111f078 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82026) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 20:11:37.377172 dv-cinder-828806-6-smb devstack@keystone.service[82026]: [pid: 82026|app: 0|req: 1437/2935] 10.222.0.33 () {58 vars in 958 bytes} [Tue Sep 13 20:11:37 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 20:11:37.388484 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0002bae-25fe-4b4b-89b0-de33b00cc983 admin admin] Authenticating user token {{(pid=82025) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 20:11:37.390362 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.fernet_utils [None req-e0002bae-25fe-4b4b-89b0-de33b00cc983 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82025) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 20:11:37.415715 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG dbcounter [-] [82025] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=82025) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 20:11:37.455649 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0002bae-25fe-4b4b-89b0-de33b00cc983 admin admin] Validating token access rules against request {{(pid=82025) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 20:11:37.459312 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca6d3967-c110-4079-91da-0ee4661c077a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46024fc6167f4321818b1bed27a521a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8c6fba0f15b4d6a84ff601919b7b8e4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82025) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 20:11:37.459917 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca6d3967-c110-4079-91da-0ee4661c077a service cinder] REQUEST_METHOD: `GET` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:11:37.460199 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca6d3967-c110-4079-91da-0ee4661c077a service cinder] SCRIPT_NAME: `/identity` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:11:37.460475 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca6d3967-c110-4079-91da-0ee4661c077a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:11:37.469313 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca6d3967-c110-4079-91da-0ee4661c077a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=82025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 20:11:37.470784 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca6d3967-c110-4079-91da-0ee4661c077a service cinder] RBAC: Authorization granted {{(pid=82025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 20:11:37.479854 dv-cinder-828806-6-smb devstack@keystone.service[82025]: [pid: 82025|app: 0|req: 1499/2936] 10.222.0.33 () {60 vars in 1365 bytes} [Tue Sep 13 20:11:37 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 20:11:47.373733 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG dbcounter [-] [82026] Writing DB stats keystone:SELECT=89,keystone:INSERT=3 {{(pid=82026) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 20:11:47.510377 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG dbcounter [-] [82025] Writing DB stats keystone:SELECT=17 {{(pid=82025) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 20:12:12.660170 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2591384b-7aaa-4455-a134-7bd16111f078 None None] Authenticating user token {{(pid=82026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 20:12:12.728351 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2591384b-7aaa-4455-a134-7bd16111f078 None None] Validating token access rules against request {{(pid=82026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 20:12:12.732942 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dcbe8c6-bb62-4528-ae34-8d7883608f00 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57539b6a6f3b4d589f5f5e1d211cd6a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b454f707d20347ada3d82aa85495635e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 20:12:12.733574 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dcbe8c6-bb62-4528-ae34-8d7883608f00 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:12:12.733924 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dcbe8c6-bb62-4528-ae34-8d7883608f00 admin admin] SCRIPT_NAME: `/identity` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:12:12.734870 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dcbe8c6-bb62-4528-ae34-8d7883608f00 admin admin] PATH_INFO: `/v3/users/73a66fc581c44bc38518b418e0990cc3` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:12:12.736087 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dcbe8c6-bb62-4528-ae34-8d7883608f00 admin admin] RBAC: Authorizing `identity:delete_user(user_id=73a66fc581c44bc38518b418e0990cc3)` {{(pid=82026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 20:12:12.738041 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dcbe8c6-bb62-4528-ae34-8d7883608f00 admin admin] RBAC: Authorization granted {{(pid=82026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 20:12:12.970984 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.notifications [None req-7dcbe8c6-bb62-4528-ae34-8d7883608f00 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '73a66fc581c44bc38518b418e0990cc3'} {{(pid=82026) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 20:12:13.047746 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.notifications [None req-7dcbe8c6-bb62-4528-ae34-8d7883608f00 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '73a66fc581c44bc38518b418e0990cc3'} {{(pid=82026) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 20:12:13.061416 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.notifications [None req-7dcbe8c6-bb62-4528-ae34-8d7883608f00 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '73a66fc581c44bc38518b418e0990cc3'} {{(pid=82026) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 20:12:13.062109 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.notifications [None req-7dcbe8c6-bb62-4528-ae34-8d7883608f00 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '73a66fc581c44bc38518b418e0990cc3'} {{(pid=82026) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 20:12:13.069393 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.notifications [None req-7dcbe8c6-bb62-4528-ae34-8d7883608f00 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '73a66fc581c44bc38518b418e0990cc3'} {{(pid=82026) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 20:12:13.075430 dv-cinder-828806-6-smb devstack@keystone.service[82026]: [pid: 82026|app: 0|req: 1438/2937] 10.222.0.33 () {58 vars in 1224 bytes} [Tue Sep 13 20:12:12 2022] DELETE /identity/v3/users/73a66fc581c44bc38518b418e0990cc3 => generated 0 bytes in 416 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 20:12:13.081333 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88b02c21-d21a-4c71-a96d-2246d69bea18 None None] REQUEST_METHOD: `POST` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:12:13.082367 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88b02c21-d21a-4c71-a96d-2246d69bea18 None None] SCRIPT_NAME: `/identity` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:12:13.082655 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88b02c21-d21a-4c71-a96d-2246d69bea18 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:12:13.102112 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.auth.core [None req-88b02c21-d21a-4c71-a96d-2246d69bea18 None None] MFA Rules not processed for user `57539b6a6f3b4d589f5f5e1d211cd6a0`. Rule list: `[]` (Enabled: `True`). {{(pid=82025) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 20:12:13.103367 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.fernet_utils [None req-88b02c21-d21a-4c71-a96d-2246d69bea18 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82025) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 20:12:13.163600 dv-cinder-828806-6-smb devstack@keystone.service[82025]: [pid: 82025|app: 0|req: 1500/2938] 10.222.0.33 () {58 vars in 958 bytes} [Tue Sep 13 20:12:13 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 20:12:13.173727 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dcbe8c6-bb62-4528-ae34-8d7883608f00 admin admin] Authenticating user token {{(pid=82026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 20:12:13.175162 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.common.fernet_utils [None req-7dcbe8c6-bb62-4528-ae34-8d7883608f00 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82026) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 20:12:13.235361 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dcbe8c6-bb62-4528-ae34-8d7883608f00 admin admin] Validating token access rules against request {{(pid=82026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 20:12:13.239015 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a959ce47-2305-4ef3-bc31-4d57cb217263 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '023a2c79c2444611b3d431928e56685d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8c6fba0f15b4d6a84ff601919b7b8e4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 20:12:13.239687 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a959ce47-2305-4ef3-bc31-4d57cb217263 service neutron] REQUEST_METHOD: `GET` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:12:13.239973 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a959ce47-2305-4ef3-bc31-4d57cb217263 service neutron] SCRIPT_NAME: `/identity` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:12:13.240254 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a959ce47-2305-4ef3-bc31-4d57cb217263 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:12:13.249253 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a959ce47-2305-4ef3-bc31-4d57cb217263 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 20:12:13.251614 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a959ce47-2305-4ef3-bc31-4d57cb217263 service neutron] RBAC: Authorization granted {{(pid=82026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 20:12:13.261687 dv-cinder-828806-6-smb devstack@keystone.service[82026]: [pid: 82026|app: 0|req: 1439/2939] 10.222.0.33 () {60 vars in 1365 bytes} [Tue Sep 13 20:12:13 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 13 20:12:13.741814 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88b02c21-d21a-4c71-a96d-2246d69bea18 None None] Authenticating user token {{(pid=82025) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 20:12:13.743502 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.fernet_utils [None req-88b02c21-d21a-4c71-a96d-2246d69bea18 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82025) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 20:12:13.756170 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88b02c21-d21a-4c71-a96d-2246d69bea18 None None] Validating token access rules against request {{(pid=82025) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 20:12:13.761265 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f4154cb-9e69-44ef-91f2-d30e38c0f40d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57539b6a6f3b4d589f5f5e1d211cd6a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b454f707d20347ada3d82aa85495635e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82025) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 20:12:13.761790 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f4154cb-9e69-44ef-91f2-d30e38c0f40d admin admin] REQUEST_METHOD: `DELETE` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:12:13.762071 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f4154cb-9e69-44ef-91f2-d30e38c0f40d admin admin] SCRIPT_NAME: `/identity` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:12:13.762347 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f4154cb-9e69-44ef-91f2-d30e38c0f40d admin admin] PATH_INFO: `/v3/projects/89b8bb6beadd436d8dc141599b4006c8` {{(pid=82025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:12:13.771666 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f4154cb-9e69-44ef-91f2-d30e38c0f40d admin admin] RBAC: Authorizing `identity:delete_project(project_id=89b8bb6beadd436d8dc141599b4006c8)` {{(pid=82025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 20:12:13.771666 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f4154cb-9e69-44ef-91f2-d30e38c0f40d admin admin] RBAC: Authorization granted {{(pid=82025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 20:12:13.928413 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.notifications [None req-6f4154cb-9e69-44ef-91f2-d30e38c0f40d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '89b8bb6beadd436d8dc141599b4006c8', 'request_id': 'req-6f4154cb-9e69-44ef-91f2-d30e38c0f40d'} {{(pid=82025) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 20:12:13.934947 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.notifications [None req-6f4154cb-9e69-44ef-91f2-d30e38c0f40d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '89b8bb6beadd436d8dc141599b4006c8', 'request_id': 'req-6f4154cb-9e69-44ef-91f2-d30e38c0f40d'} {{(pid=82025) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 20:12:13.941934 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.notifications [None req-6f4154cb-9e69-44ef-91f2-d30e38c0f40d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '89b8bb6beadd436d8dc141599b4006c8', 'request_id': 'req-6f4154cb-9e69-44ef-91f2-d30e38c0f40d'} {{(pid=82025) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 20:12:14.019237 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.notifications [None req-6f4154cb-9e69-44ef-91f2-d30e38c0f40d admin admin] The token cache is being invalidate because project 89b8bb6beadd436d8dc141599b4006c8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82025) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 13 20:12:14.019466 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.notifications [None req-6f4154cb-9e69-44ef-91f2-d30e38c0f40d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82025) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 20:12:14.020094 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG keystone.notifications [None req-6f4154cb-9e69-44ef-91f2-d30e38c0f40d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82025) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 20:12:14.021562 dv-cinder-828806-6-smb devstack@keystone.service[82025]: [pid: 82025|app: 0|req: 1501/2940] 10.222.0.33 () {58 vars in 1233 bytes} [Tue Sep 13 20:12:13 2022] DELETE /identity/v3/projects/89b8bb6beadd436d8dc141599b4006c8 => generated 0 bytes in 280 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 20:12:23.257376 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG dbcounter [-] [82026] Writing DB stats keystone:SELECT=79,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82026) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 20:12:24.015360 dv-cinder-828806-6-smb devstack@keystone.service[82025]: DEBUG dbcounter [-] [82025] Writing DB stats keystone:SELECT=54,keystone:DELETE=7,keystone:INSERT=1 {{(pid=82025) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 20:14:25.745428 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a959ce47-2305-4ef3-bc31-4d57cb217263 service neutron] Authenticating user token {{(pid=82026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 20:14:25.747136 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.common.fernet_utils [None req-a959ce47-2305-4ef3-bc31-4d57cb217263 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82026) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 20:14:25.816605 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a959ce47-2305-4ef3-bc31-4d57cb217263 service neutron] Validating token access rules against request {{(pid=82026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 20:14:25.874926 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ffc44cb-9105-462e-96e5-142b54de6a58 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '060ea3dea2134429967c164bd158b272', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8c6fba0f15b4d6a84ff601919b7b8e4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 20:14:25.876071 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ffc44cb-9105-462e-96e5-142b54de6a58 service placement] REQUEST_METHOD: `GET` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:14:25.876353 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ffc44cb-9105-462e-96e5-142b54de6a58 service placement] SCRIPT_NAME: `/identity` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:14:25.876627 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ffc44cb-9105-462e-96e5-142b54de6a58 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=82026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:14:25.878360 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.common.fernet_utils [None req-5ffc44cb-9105-462e-96e5-142b54de6a58 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82026) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 20:14:25.889355 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ffc44cb-9105-462e-96e5-142b54de6a58 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=82026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 20:14:25.891544 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ffc44cb-9105-462e-96e5-142b54de6a58 service placement] RBAC: Authorization granted {{(pid=82026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 20:14:25.901470 dv-cinder-828806-6-smb devstack@keystone.service[82026]: [pid: 82026|app: 0|req: 1440/2941] 10.222.0.33 () {60 vars in 1365 bytes} [Tue Sep 13 20:14:25 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 157 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 20:14:35.897271 dv-cinder-828806-6-smb devstack@keystone.service[82026]: DEBUG dbcounter [-] [82026] Writing DB stats keystone:SELECT=58 {{(pid=82026) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}